Data Pipeline Specialist - Azure Data Factory/Snowflake DB (6-10 yrs)

Job Title : ADF Developer with Snowflake Data Pipeline Expertise.

Location : Hyderabad (On-site).

Employment Type : Contract (1 Year).

Shift : Indian Standard Time (Daytime Office Hours).

Job Description :

We are looking for a seasoned ADF (Azure Data Factory) Developer with 6-10 years of experience and expertise in Snowflake data pipeline creation to support complex ETL workflows for our US based client.

This is a 1-year long contract role based in Hyderabad, offering an exciting opportunity to work on challenging data integration and migration projects.

The candidate must be available to join within 2 weeks and possess strong technical capabilities in ADF and Snowflake.

Responsibilities :

- Design, build, and manage advanced data pipelines in Snowflake using Azure Data Factory.

- Lead end-to-end data migration workflows from diverse sources to Snowflake, ensuring high performance and data integrity.

- Implement efficient ETL processes using Azure and Snowflake technologies, tailored to meet client requirements.

- Optimize pipelines and troubleshoot performance issues to ensure seamless operations.

- Develop and maintain reusable, scalable Snowflake pipelines, leveraging features like streams, tasks, and stored procedures.

- Collaborate with stakeholders to gather requirements, provide insights, and deliver robust solutions.

- Create comprehensive documentation for workflows, designs, and best practices.

- Participate in client meetings during U.S. hours when required to discuss project updates and deliverables.

Required Skills :

- Azure Data Factory (ADF) : Expertise in building and managing ADF pipelines for large-scale data integration and migration projects.

- Snowflake : Proven hands-on experience with data pipeline creation and management in Snowflake, including advanced SQL, Snowflake tasks, and performance tuning.

- ETL Processes : Strong background in designing, implementing, and optimizing ETL workflows in Azure-Snowflake ecosystems.

- Experience Level : 6-10 years of total IT experience with at least 3+ years of relevant work in ADF and Snowflake.

- Project Management : Ability to independently lead data migration projects and articulate contributions to past projects effectively.

- Availability : Must be able to join within 2 weeks.

- Soft Skills : Strong communication, analytical, and problem-solving skills, with experience in working with global teams.

Nice-to-Have Skills :

- Familiarity with Snowflake utilities like Snowpipe for automated data ingestion.

- Experience with CI/CD pipelines for ETL workflow automation.

- API integration knowledge for enhanced data processing.

- Basic understanding of Cosmos DB or other Azure-native databases.