Senior Data Engineer - ETL Tools (10-16 yrs)

Job Description :

Responsibilities :

- Design and develop data pipelines for data ingestion, transformation, and integration using cloud-based ETL/ELT tools (Data Factory, Glue, Airflow, etc.)

- Build and maintain data models to support efficient data analysis and reporting.

- Utilize data manipulation and processing techniques to prepare data for consumption by various stakeholders.

- Leverage cloud platforms (AWS/Azure) and big data technologies (Databricks, Synapse, Redshift, Kinesis) to build scalable and reliable data solutions.

- Version control code using Git and implement CI/CD practices with tools like GitHub Actions or Azure DevOps.

- Collaborate with business analysts and stakeholders to understand data requirements and translate them into technical solutions.

- Document data pipelines and solutions using tools like MKDocs.

- Mentor junior data engineers and contribute to knowledge sharing initiatives.

Qualifications :

- 10-16 years of experience in data engineering with a focus on cloud platforms and big data technologies.

- In-depth knowledge of data modeling concepts and best practices.

- Proficiency in data manipulation and processing techniques (SQL, Python, etc.)

- Experience with cloud platforms (AWS or Azure) and big data tools (Data Factory, Databricks, Synapse, etc.) is a plus.

- Familiarity with CI/CD practices and version control systems (Git, GitHub Actions, Azure DevOps) is a plus.

- Excellent communication and collaboration skills to bridge the gap between technical and non-technical stakeholders.

- Strong analytical and problem-solving skills.

- A passion for learning and staying current with the latest advancements in data engineering