Data Engineer

Job Description:

We are looking for an experienced Databricks Engineer to join our team. The ideal candidate should have 4-7 years of experience working with Databricks, Snowflake, PySpark, Azure Data Factory (ADF), and SQL. You will be responsible for designing, developing, and optimizing data pipelines, ensuring seamless data integration and transformation on Azure Cloud.

Key Responsibilities:

• Develop and optimize ETL/ELT pipelines using Azure Databricks, PySpark, and ADF.
• Work with Snowflake to design and maintain scalable data warehousing solutions.
• Write efficient SQL queries for data transformation, analysis, and reporting.
• Implement data governance, security, and monitoring in Azure-based data solutions.
• Optimize data processing workflows for performance and cost efficiency.
• Collaborate with data scientists, analysts, and business teams to ensure data availability and quality.
• Troubleshoot issues related to data ingestion, transformation, and processing.

Required Skills & Qualifications:

• 4-7 years of experience in Azure Data Engineering.
• Strong expertise in Azure Databricks and PySpark for big data processing.
• Hands-on experience with Snowflake for data warehousing.
• Proficiency in Azure Data Factory (ADF) for orchestrating data workflows.
• Strong SQL skills for complex query writing and performance tuning.
• Experience in data modeling, data transformation, and pipeline optimization.
• Knowledge of Azure services like Azure Synapse, Azure Storage, and Azure Monitor is a plus.
• Experience with CI/CD for data pipelines is an advantage.
• Excellent problem-solving and communication skills.