Lead Data Engineer - ETL (10-13 yrs)

Key Responsibilities :

- Design, develop, and implement data pipelines and architectures for ingesting, processing, and transforming large volumes of data from various sources.

- Lead the development and implementation of data lakes, data warehouses, and other data platforms.

- Design and implement data integration solutions using ETL/ELT tools and technologies.

- Optimize data pipelines for performance, scalability, and cost-effectiveness.

- Lead and mentor a team of data engineers, providing technical guidance and support.

- Conduct code reviews, provide feedback, and foster a collaborative and high-performing team environment.

- Guide team members in adopting best practices for data engineering and development.

- Evaluate and recommend new technologies and tools for data engineering, such as cloud data services, big data technologies, and machine learning platforms.

- Stay abreast of the latest advancements in data engineering and cloud technologies.

- Ensure data quality and integrity throughout the data lifecycle.

- Implement data governance policies and procedures to ensure data security and compliance.

- Collaborate with stakeholders to define project scope, timelines, and budgets.

- Track project progress, identify and mitigate risks, and ensure timely project delivery.

- Communicate project status and progress effectively to stakeholders.

Qualifications :

- Experience : Experience in data engineering, with at least 5 years of experience in a leadership role.

- Education : Bachelor's degree in Computer Science, Computer Engineering, or a related field (Master's degree preferred).

Technical Skills :

- Strong proficiency in data engineering principles and best practices.

- Experience with data ingestion, transformation, and loading (ETL/ELT) processes.

- Proficiency in Python, Scala, or Java. Experience with scripting languages.

- Experience with big data technologies such as Hadoop, Spark, Hive, and Kafka.

- Experience with cloud platforms such as AWS, Azure, or GCP, including cloud data services.

- Experience with relational databases (e.g., MySQL, PostgreSQL) and NoSQL databases.

- Experience with DevOps principles and tools, including CI/CD pipelines and containerization technologies.

Other Skills :

- Strong analytical and problem-solving skills.

- Excellent communication, interpersonal, and presentation skills.

- Ability to work independently and as part of a team.

- Strong leadership, mentoring, and team management skills.