Data Engineer

Bachelor'sRole & responsibilities

• Design and implement scalable data models and architectures to support analytics and operational needs.
• Build and manage data warehousing solutions, particularly leveraging Snowflake.
• Develop and maintain ETL/ELT pipelines using tools like Azure Data Factory, Informatica, Talend, and SSIS.
• Implement real-time data streaming and processing using Apache Kafka and Spark Streaming.
• Develop and deploy data transformation workflows using Apache Airflow.
• Write efficient and optimized code in Python, Java, or Scala for data processing tasks.
• Leverage Azure Databricks and Azure Data Lake for big data processing and storage.
• Design and maintain relational databases using SQL and implement NoSQL solutions such as MongoDB, Cassandra, or DynamoDB.
• Collaborate with DevOps teams to build and maintain CI/CD pipelines for data workflows using Git and other tools.
• Monitor and optimize data workflows for performance, scalability, and cost-efficiency.

Preferred candidate profile

• Bachelors or Masters degree in Computer Science, Engineering, or a related field.
• 5+ years of experience in data engineering or a related role.
• Data Modeling and schema design for analytics and reporting.
• Proficiency in Snowflake for cloud-based data warehousing.
• Strong experience in Python, with additional skills in Java or Scala.
• In-depth knowledge of Azure services: Azure Data Factory, Azure Databricks, Azure Data Lake.
• Hands-on experience with ETL/ELT tools like Informatica, Talend, or SSIS.
• Expertise in streaming frameworks like Apache Kafka and Spark Streaming.
• Proficiency in writing complex SQL queries and working with NoSQL databases.
• Strong familiarity with Git for version control and CI/CD pipelines.