Azure Data Engineer - Big Data (1-6 yrs)

We are hiring for one of the IT product-based company.

Location : Pune/Gurgaon/Noida.

Work Mode : Hybrid.

Exp - 1-6 Years.

Required Skills and Qualifications :

Technical Expertise :

- Strong experience with Azure services, including Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Azure Synapse, Azure Databricks, and Azure Functions.

- Proficiency with big data tools and frameworks like Spark, Hadoop, or PySpark.

- Expertise in working with SQL and NoSQL databases (e.g, Azure SQL, Cosmos DB).

Programming Skills :

- Proficiency in Python, Scala, or Java for data engineering tasks.

- Familiarity with PowerShell or Bash scripting for automation.

Data Integration Expertise :

- Experience with ETL/ELT processes, APIs, and real-time streaming solutions (e.g, Event Hubs, Azure Stream Analytics).

Soft Skills :

- Excellent problem-solving and analytical skills.

- Strong communication and collaboration skills to work effectively with diverse teams.

- Ability to prioritize tasks and manage multiple projects simultaneously.

Preferred Qualifications :

- Azure certifications such as Azure Data Engineer Associate, Azure Solutions Architect Expert, or Azure Developer Associate.

Responsibilities :

- Design, develop, and maintain scalable and efficient data pipelines using Azure Data Factory (ADF), Azure Databricks, and other Azure data services.

- Build and manage data storage solutions using Azure Data Lake Storage (ADLS) and Azure Synapse Analytics.

- Develop and optimize data processing jobs using Spark, PySpark, and other big data tools.

- Work with SQL and NoSQL databases, including Azure SQL and Cosmos DB, to store and retrieve data.

- Implement ETL/ELT processes to integrate data from various sources, including APIs and real-time streaming platforms (e.g., Event Hubs, Azure Stream Analytics).

- Develop and deploy Azure Functions for serverless data processing.

- Write and maintain clean, efficient, and well-documented code in Python, Scala, or Java. Automate tasks and processes using PowerShell or Bash scripting.

- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver effective solutions.

- Troubleshoot and resolve data-related issues in a timely manner.

- Ensure data quality, security, and compliance with company policies and industry standards.

- Participate in code reviews and contribute to continuous improvement of data engineering practices.