Azure Data Engineer

Job Title: Azure Data Engineer (SQL & Azure Data Services)

Location: Gurgaon ODC

About Us:

Job Description:

The Azure Data Engineer will be responsible for developing, maintaining, and optimizing data pipelines and SQL databases using Azure Data Factory (ADF), Microsoft Fabrics and other Azure services. The role requires expertise in SQL Server, ETL/ELT processes, and data modeling to support business intelligence and operational applications. The ideal candidate will collaborate with cross-functional teams to deliver reliable, scalable, and high-performing data solutions.

Key Responsibilities:

• Design, develop, and manage SQL databases, tables, stored procedures, and T-SQL queries.
• Develop and maintain Azure Data Factory (ADF) pipelines to automate data ingestion, transformation, and integration.
• Build and optimize ETL/ELT processes to transfer data between Azure Data Lake, SQL Server, and other systems.
• Design and implement Microsoft Fabric Lake houses for structured and unstructured data storage.
• Build scalable ETL/ELT pipelines to move and transform data across Azure Data Lake, SQL Server, and external data sources.
• Develop and implement data modeling strategies using star schema, snowflake schema, and dimensional models to support analytics use cases.
• Integrate Azure Data Lake Storage (ADLS) with Microsoft Fabric for scalable, secure, and cost-effective data storage.
• Monitor, troubleshoot, and optimize data pipelines using Azure Monitor, Log Analytics, and Fabric Monitoring capabilities.
• Ensure data integrity, consistency, and security following data governance frameworks such as Azure Purview.
• Collaborate with DevOps teams to implement CI/CD pipelines for automated data pipeline deployment.
• Utilize Azure Monitor, Log Analytics, and Application Insights for pipeline monitoring and performance optimization.
• Stay updated on Azure Data Services and Microsoft Fabric innovations, recommending enhancements for performance and scalability.

Requirements:

• 4+ years of experience in data engineering with strong expertise in SQL development.
• Proficiency in SQL Server, T-SQL, and query optimization techniques.
• Hands-on experience with Azure Data Factory (ADF), Azure Synapse Analytics, and Azure SQL Database.
• Solid understanding of ETL/ELT processes, data integration patterns, and data transformation.
• Practical experience with Microsoft Fabric components:
• Fabric Dataflows for self-service data preparation.
• Fabric Lake houses for unified data storage.
• Fabric Synapse Real-Time Analytics for streaming data insights.
• Fabric Direct Lake mode with Power BI for optimized performance.
• Strong understanding of Azure Data Lake Storage (ADLS) for efficient data management.
• Proficiency in Python or Scala for data transformation tasks.
• Experience with Azure DevOps, Git, and CI/CD pipeline automation.
• Knowledge of data governance practices, including data lineage, sensitivity labels, and RBAC.
• Experience with Infrastructure-as-Code (IaC) using Terraform or ARM templates.
• Understanding of data security protocols like data encryption and network security groups (NSGs).
• Familiarity with streaming services like Azure Event Hub or Kafka is a plus.
• Excellent problem-solving, communication, and team collaboration skills.
• Azure Data Engineer Associate (DP-203) and Microsoft Fabric Analytics certifications are desirable.

What We Offer:

• Opportunity to work with modern data architectures and Microsoft Fabric innovations.
• Competitive salary and benefits package, tailored to experience and qualifications.
• Opportunities for professional growth and development in a supportive and collaborative environment.
• A culture that values diversity, creativity, and a commitment to excellence.