Azure Data Engineer - ETL Pipeline (4-6 yrs)

Job Description :

Bachelor's or master's degree in computer science or related engineering field w/experience in software development. Developer should have 4-5 years of hands-on experience in ADF development.

Key Responsibilities :

- Build and maintain ETL pipelines using Azure Data Factory, Dataflows etc.

- Work with teams to understand and solve data needs (Ingestion, transformation, integration)

- Manage data lakes and data warehouses in Azure

- Optimize ADF/Spark jobs for speed and cost

- Proficient in Microsoft Azure services

- Automate data workflows using Azure Data Factory (ADF) pipelines

- Troubleshoot and fix ADF job issues

- Stay updated on new features in Azure.

- Good to have knowledge or any ETL tool like SSIS, Informatica, DataStage.

- Good to have ETL migration experience

- Strong analytical and problem-solving skills.

- Excellent writing skills, with the ability to create clear requirements, specifications, and Documentation

- Proficient in SQL.

- Willing to work on R & D project and various other technologies

- Design, develop, and implement Azure Data Factory (ADF) solutions to support data integration and ETL processes.

- Lead and execute migration projects from on-premises to Azure, ensuring seamless data transfer and system integration.

- Collaborate with cross-functional teams to understand business requirements and design scalable data solutions.

- Optimize SQL queries and databases for performance and reliability in an Azure environment.

- Ensure data security, integrity, and compliance with relevant standards and regulations.

- Provide clear communication and documentation for technical and non-technical stakeholders.