Data Engineer - ETL/SQL (7-11 yrs)

Job Description :

We are seeking an experienced Data Engineer with expertise in Azure Cloud technologies, Azure Data Factory (ADF), and SQL. The ideal candidate will design, build, and optimize data pipelines and workflows to enable efficient data integration and analytics, ensuring high data quality and performance for enterprise solutions.

Key Responsibilities :

- Design, develop, and maintain scalable ETL/ELT pipelines using Azure Data Factory (ADF).

- Work with structured and unstructured datasets to design and implement efficient data ingestion and transformation processes.

- Develop and optimize queries and data models in SQL to support analytics and reporting needs.

- Manage and maintain Azure resources such as Data Lake Storage, Blob Storage, and Azure Synapse Analytics.

- Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements and deliver robust solutions.

- Ensure data integrity, security, and compliance with industry standards and regulations.

- Monitor, troubleshoot, and optimize data pipelines and workflows to ensure peak performance.

- Leverage Azure DevOps or similar tools to implement CI/CD pipelines for data workflows.

- Document technical designs, workflows, and processes to facilitate knowledge sharing and operational continuity.

- Stay updated on emerging trends and best practices in Azure and big data technologies.

Qualifications :

- Bachelor's degree in Computer Science, Data Engineering, or a related field.

- 3+ years of experience in data engineering or a similar role.

- Hands-on experience with Azure Data Factory (ADF) for data orchestration and workflow automation.

- Proficiency in SQL for database design, query optimization, and data analysis.

- Familiarity with Azure services such as Data Lake Storage, Blob Storage, Azure Synapse Analytics, and Azure Databricks.

- Strong understanding of data modeling, ETL/ELT processes, and data warehousing concepts.

- Experience with version control and CI/CD pipelines, preferably using Azure DevOps.

- Excellent problem-solving and analytical skills.

- Strong communication and teamwork abilities.

Preferred Skills :

- Knowledge of programming languages like Python or Scala for data processing.

- Familiarity with big data frameworks such as Spark or Hadoop.

- Experience in handling real-time data processing with tools like Event Hubs or Kafka.

- Understanding of data visualization tools like Power BI or Tableau.

- Microsoft Azure certifications, such as Azure Data Engineer Associate, are a plus.

Why Join Us?

- Opportunity to work on cutting-edge data engineering projects with the latest Azure technologies.

- Be part of a collaborative and innovative team environment.

- Competitive compensation, benefits, and career growth opportunities.

- Work with a forward-thinking organization that values employee development and success.