Data Engineer - Python/Azure (4-11 yrs)

Responsibilities :

- Design, construct, install, test, and maintain data management systems.

- Ensure all systems meet business and performance requirements.

- Create and maintain optimal data pipeline architecture.

- Assemble large, complex datasets that meet functional and non-functional business requirements.

- Develop and implement data flows to connect operational systems, data for analytics, and BI (Business Intelligence) systems.

- Design, implement, and optimize data models on Azure data platforms.

- Implement effective metrics and monitoring processes.

- Drive the collection, cleaning, processing, and analysis of new and existing data sources.

- Work with data and analytics experts to strive for greater functionality in data systems.

- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, redesigning infrastructure for greater scalability, etc.

Skill : Azure Data Engineer (Python, Pyspark, ADF, Databricks, Synapse, Fabric, SQL).