Azure Data Engineer

Job Title:

Azure Data Engineer

Job Description

The Data Engineer will be responsible for designing, developing, and maintaining robust data pipelines and architectures in Azure and Databricks. The ideal candidate will have a strong background in data engineering, cloud platforms, and big data technologies.

• Design and implement scalable data pipelines using Azure Data Factory, Databricks, and other Azure services.
• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions.
• Optimize and troubleshoot data workflows to ensure efficient and reliable data processing.
• Implement data quality checks and validation processes to ensure data integrity.
• Monitor and maintain data infrastructure, ensuring high availability and performance.
• Develop and manage data models, schemas, and metadata in Databricks.
• Stay updated with the latest industry trends and best practices in data engineering and cloud computing.
• Expertise in Azure services, including Azure Data Factory, Azure Synapse, Azure Data Lake and Azure Storage.
• Knowledge of Data Warehousing/Data Lakehouse concepts.
• Proficiency in Databricks and Spark for data processing and analysis.
• Strong programming skills in Python, PySpark, SQL, and familiarity with ETL processes.
• Excellent problem-solving skills and attention to detail.
• Strong communication skills with the ability to work collaboratively in a team environment.

Location:

IND Bangalore - 1st Floor Block G4 Aspen Building, Embassy Manyata Business Park

Language Requirements:

Time Type:

Full time

If you are a California resident, by submitting your information, you acknowledge that you have read and have access to the Job Applicant Privacy Notice for California Residents