Associate Manager Data Engineering

We are seeking a highly skilled and experienced Azure Data Engineer to join our dynamic team. In this critical role, you will be responsible for designing, developing, and maintaining robust and scalable data solutions on the Microsoft Azure platform. You will work closely with data scientists, analysts, and business stakeholders to translate business requirements into effective data pipelines and data models.

* Design, develop, and implement data pipelines and ETL/ELT processes using Azure Data Factory, Azure Databricks, and other relevant Azure services.
* Develop and maintain data lakes and data warehouses on Azure, including Azure Data Lake Storage Gen2 and Azure Synapse Analytics.
* Build and optimize data models for data warehousing, data marts, and data lakes.
* Develop and implement data quality checks and data governance processes.
* Troubleshoot and resolve data-related issues.
* Collaborate with data scientists and analysts to support data exploration and analysis.
* Stay current with the latest advancements in cloud computing and data engineering technologies.
* Mentor junior data engineers and contribute to the development of best practices.
* Participate in all phases of the software development lifecycle, from requirements gathering to deployment and maintenance.

* 10+ years of experience in data engineering, with at least 5 years of experience working with Azure data services.
* Strong proficiency in Python, and other relevant programming languages.
* Experience with data warehousing and data lake architectures.
* Experience with ETL/ELT tools and technologies, such as Azure Data Factory, Azure Databricks, and Apache Spark.
* Experience with data modeling and data warehousing concepts.
* Experience with data quality and data governance best practices.
* Strong analytical and problem-solving skills.
* Excellent communication and collaboration skills.
* Experience with Agile development methodologies.
* Bachelor's degree in Computer Science, Engineering, or a related field (Master's degree preferred).
* Relevant Azure certifications (e.g., Azure Data Engineer Associate) are a plus.

Bonus Points:
* Experience with machine learning and artificial intelligence.
* Experience with containerization technologies (e.g., Docker, Kubernetes).
* Experience with DevOps practices and tools.