ETL Lead - Azure Data Factory (10-15 yrs)

Location : Hyderabad-WFO

Experience : 10+ years

Key Responsibilities :

Leadership and Team Management :

- Lead and mentor a team of team of 2 - 3 engineers.

- Assign tasks, manage workloads, and ensure team members meet deadlines and project milestones.

- Foster a collaborative and innovative team environment.

Project Management :

- Plan, design, and manage ETL projects from conception to deployment.

- Collaborate with business analysts and stakeholders to gather requirements and translate them into technical specifications.

- Ensure projects are delivered on time, within scope, and within budget.

ETL Development and Maintenance :

- Design, develop, and maintain robust ETL processes and workflows.

- Ensure data quality and integrity throughout the ETL lifecycle.

- Optimize ETL performance and troubleshoot issues as they arise.

Architecture and Design :

- Define ETL architecture and select appropriate tools and technologies.

- Ensure scalability, reliability, and security of ETL processes.

- Develop and maintain data models, including star and snowflake schemas.

Data Integration :

- Integrate data from various sources, including databases, flat files, APIs, and cloud services.

- Implement complex data transformations to meet business requirements.

Documentation and Standards :

- Create and maintain technical documentation for ETL processes and workflows.

- Establish and enforce coding standards and best practices.

Collaboration :

- Coordinate with IT teams to ensure seamless integration and deployment of ETL solutions.

Continuous Improvement :

- Stay updated with the latest ETL tools, technologies, and trends.

- Identify and implement process improvements to enhance efficiency and performance.

Qualifications :

Experience :

- Minimum of 10+ years of experience in ETL development and data integration.

- Proven experience leading and managing technical teams.

- Extensive experience with ETL tools (e.g., SSIS, ADF).

- Experience Microsoft Azure SQL DB, SSIS, ADF, SQL Tuning.

Technical Skills :

- Proficiency in SQL and database management.

- Familiarity with scripting languages (e.g., Python/Power/Shell scripting).

- Strong understanding of data warehousing concepts and data modeling techniques.

- Experience with cloud platforms like Azure.