Prep.Study - Azure Data Engineer - ETL (4-10 yrs)

Job Description :

- Design, architect, and develop end-to-end data solutions on the Azure Stack platform.

- Implement and optimize data pipelines, ETL processes, and data integration solutions using Azure Data Factory, Azure Data Lake, Azure Databricks, Azure SQL Database, and other relevant Azure services.

- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and translate them into technical solutions.

- Perform advanced data modelling, data profiling, and data quality assessments to ensure accurate and reliable data.

- Optimize data processing workflows for performance, scalability, and cost efficiency.

- Implement data governance, data security, and compliance practices in line with industry standards and regulations.

- Monitor and troubleshoot data solutions, identify, and resolve issues, and implement proactive measures to ensure data availability and reliability.

- Mentor and guide junior data engineers, provide technical leadership, and contribute to the continuous improvement of data engineering practices.

- Experience with cloud-based analytics platforms such as Databricks, Azure Synapse analytics, Other data specific cloud services

- Extensive hands-on experience with Azure data services such as Azure Data Factory, Azure Data Lake, Azure Databricks, Azure SQL Database, etc.

- Proven expertise in designing and implementing complex data integration solutions and data pipelines on the Azure Stack platform

- Experience with data governance frameworks, data security, and compliance practices.

- In-depth knowledge of big data technologies such as Apache Spark, Hadoop, or Databricks.

- Familiarity with DevOps practices and CI/CD pipelines for data engineering.

- Strong problem-solving, analytical, and troubleshooting skills.

- Excellent communication and collaboration skills, with the ability to work effectively in a team environment.

- Strong problem-solving, analytical, and troubleshooting skills.

- Bachelor's or master's degree in computer science, Information Systems, or a related field.