2 The HRism Jobs
Lead Data Engineer - Python/PySpark (8-12 yrs)
The HRism
posted 14hr ago
Key skills for the job
We are hiring Lead Data Engineer for US based product MNC having operations in multiple countries, for more details please feel free to contact.
Job Responsibilities :
As a Lead Data Engineer, you will play a critical role in the design, development, and maintenance of data pipelines, data architecture, and data systems with project deliverable and task management of team.
You will lead a team of data engineers, collaborate with data scientists, architects, and work closely with other cross-functional teams to deliver high-quality, reliable, and scalable data solutions.
Qualifications :
- Bachelor's or Master's degree in computer science, Engineering, or a related field.
- Proven experience (8+ years) as a Data Engineer, with demonstrated expertise in leading data engineering teams.
- Proficiency in Python and PySpark, with a strong understanding of distributed computing and big data processing.
- Proficiency in real time data processing application with dashboard insight on UI.
- Extensive experience with AWS data services, including but not limited to S3, EMR, Redshift, Glue, Lake Formation, Lambda, SNS and CloudWatch.
- Strong knowledge of database systems, data modelling, and data warehousing principles.
- Experience in data pipeline orchestration tools like Apache Airflow, Event Bridge and Step Functions.
- Familiarity with data governance, security, and compliance practices.
- Excellent problem-solving and analytical skills, with a keen attention to detail.
- Strong communication skills and ability to effectively convey technical concepts to non-technical stakeholders.
- Leadership and mentoring abilities, with a track record of successfully leading and managing a team of data engineers.
- Ability to work in a fast-paced, dynamic environment and adapt to changing priorities.
Functional Areas: Software/Testing/Networking
Read full job description2-4 Yrs