eClerx - Director - Data Engineer (15-20 yrs)

Job Description :

We are seeking an experienced and highly skilled Data Engineering Lead to join our team.

As the Data Engineering Lead, you will be responsible for overseeing the design, development, and maintenance of our data infrastructure, ensuring its reliability, scalability, and performance.

You will work closely with cross-functional teams, including data scientists, software engineers, and analysts, to support their data needs and enable data-driven decision-making.

Additionally, you will be responsible for managing a team of data engineers, providing technical guidance, and fostering a collaborative and innovative work environment.

Responsibilities :

- Lead and manage a team of data engineers, providing mentorship, guidance, and technical expertise to ensure the successful execution of data engineering projects.

- Collaborate with stakeholders, including data scientists, software engineers, and analysts, to understand business requirements and translate them into scalable data solutions.

- Design, implement, and maintain robust data infrastructure, including data pipelines, data warehouses, and ETL processes, ensuring the reliability, scalability, and performance of the systems.

- Optimize data pipelines and workflows to improve efficiency and reduce processing time.

- Identify and implement best practices for data engineering, ensuring data quality, data integrity, and data governance.

- Stay up to date with the latest trends and advancements in data engineering and recommend innovative solutions to enhance our data infrastructure.

- Conduct performance evaluations, provide feedback, and foster a culture of continuous learning and professional development within the data engineering team.

- Collaborate with cross-functional teams to define data engineering standards, processes, and tools to enhance productivity and collaboration.

Qualifications :

- Bachelor's or Master's degree in Computer Science, Data Science, or a related field.

- Overall experience of 15+ years with proven experience (9+ years) working in data engineering, with a focus on designing and implementing data infrastructure and pipelines.

- Excellent understanding of software development life cycle and/or agile development environment with emphasis on BI practices.

- Strong expertise in programming languages such as Python, Java, or Scala, and experience with SQL.

- Experience with big data technologies such as Hadoop, Spark, or Kafka.

- Proficiency in working with cloud-based data platforms (e.

, AWS, GCP, or Azure) and related services (S3, Redshift, BigQuery, etc.

- In-depth knowledge of data modeling, data warehousing, and ETL processes.

- Experience with data integration, data migration, and data governance.

- Strong leadership and team management skills with the ability to motivate and inspire a team of data engineers.

- Excellent problem-solving and analytical skills, with the ability to handle complex data challenges.

- Effective communication skills, both verbal and written, with the ability to convey technical concepts to non-technical stakeholders.