Sr Azure Data Engineer

Role & responsibilities :

• Data Pipeline Development: Design, develop, and maintain scalable and efficient data pipelines using Azure Data Factory and Synapse analytics transforming, and loading data from various sources.
• Demonstrated in-depth skills with Azure Databricks PySpark, and SQL
• Must have been involved in building scalable, metadata-driven pipelines using established best practices.
• Strong experience in developing Modern Data Warehouse solutions using Azure Stack (Azure Data Lake, Azure Databricks) and PySpark
• Strong experience in ADF and Synapse pipeline performance tuning, identifying bottlenecks

Suggesting alternative approaches.

• Strong experience in optimizing the performance and reliability of Databricks clusters and jobs to meet SLAs and business requirements.
• Ability to build and maintain a Lakehouse architecture in ADLS / Databricks.
• Must have completed end-to-end at least two large-scale migrations from on-prem to Azure successfully.
• Demonstrated practical expertise in leveraging Delta Live Tables and Autoloader to build scalable, real-time data pipelines in Databricks, ensuring data quality and operational efficiency.
• Solid skills in Azure Databricks are desired for Data ingestion, Data transformation and Data manipulation.
• Collaborate with your Data Science and Business Intelligence colleagues across the world to share key learnings, leverage ideas and solutions, and propagate best practices.
• Willing to learn and expand skillset repository.
• Databricks Certified Data Engineer Associate/Professional Certification (Desirable).
• Excellent oral and written communication skills

Perks and benefits : 5 Days Work from Office ,