Data Engineer

About the Role:

We are looking for a Data Engineer with over 5 years of experience, along with a strong background in Azure Data Factory, Databricks, Python and SQL. The incumbent should also have sound understanding of DevOps practices.

Requirements:

• Minimum 5+ years of experience as a Data Engineer or in a similar role.
• Intense hands-on experience with Azure Data Factory for building and managing data pipelines.
• Expertise in Databricks for data processing and transformation with a deep understanding of Apache Spark.
• Proficient in Python, for scripting, data processing, and building custom ETL/ELT logic.
• Enhanced knowledge of SQL for querying, data manipulation and performance tuning.
• Experience with DevOps practices, including CI/CD pipelines, version control Git and automated deployments.
• Understanding of data architecture data warehousing, and data modeling concepts.
• Preferable experience in APIs and RESTful services for data integration.
• In-depth knowledge of Big Data Tools and frameworks beyond Databricks, such as Hadoop, Kafka or Airflow.
• Ease with containerization technologies like Docker and Kubernetes.
• Mandatory Certifications in Microsoft Azure such as Azure Data Engineer Associate, Azure Solutions Architect is a plus.