Atgeir Solutions - Data Engineer - Java/Python/Scala (5-10 yrs)

Role Overview :

As a Data Engineer at Atgeir Solutions, you will play a pivotal role in designing, developing, and optimizing our data infrastructure and workflows.

Your academic expertise will contribute to building robust systems that drive insightful analytics, enhance AI/ML models, and enable data-driven decision-making for our clients.

Key Responsibilities :

- Data Architecture and Pipeline Development: Design and implement scalable data architectures, ETL pipelines, and data workflows to process, store, and analyze large datasets effectively.

- Data Integration: Integrate and consolidate data from various sources, including APIs, databases, and cloud platforms, ensuring data integrity and quality.

- Data Governance and Security: Implement data governance practices, including data cataloging, lineage tracking, and ensuring compliance with information security standards (ISO 27001 or similar).

- Collaboration with Teams: Work closely with data scientists, software engineers, and business analysts to align data engineering solutions with business goals and requirements.

- Optimization: Optimize database performance, query execution, and storage solutions for efficiency and cost-effectiveness.

- Innovation and Mentorship: Contribute to innovative projects and mentor junior team members.

- Leverage your academic expertise to foster a culture of continuous learning and development.

Required Skills and Qualifications :

Technical Expertise :

- Proficiency in programming languages such as Python, Java, or Scala.

- Hands-on experience with big data technologies (i.e., Hadoop, Spark).

- Strong knowledge of SQL and NoSQL databases (i.e., PostgreSQL, MongoDB, Cassandra).

- Familiarity with data warehousing tools like Snowflake, Redshift, or BigQuery.

- Experience with cloud platforms like Google Cloud Platform (GCP), AWS, or Azure.

Data Engineering Fundamentals :

- Expertise in ETL/ELT processes, data modeling, and data lake architectures.

- Knowledge of data visualization tools like Tableau, Power BI, or Looker.

Educational/Academic Experience :

- Experience teaching relevant technical subjects (i.e., data engineering, databases, distributed systems, or machine learning) in engineering colleges.

- Proven ability to explain complex concepts to diverse audiences.

Soft Skills :

- Excellent analytical and problem-solving skills.

- Strong interpersonal skills and the ability to collaborate effectively in cross-functional teams.

- Demonstrated ability to balance technical depth with business understanding.

Preferred Qualifications :

- Certifications in cloud technologies (i.e., GCP Professional Data Engineer, AWS Certified Data Analytics).

- Familiarity with AI/ML tools and frameworks (i.e., TensorFlow, PyTorch).

- Contributions to research papers, technical blogs, or open-source projects