Lead PySpark Developer - Data Engineering (10-16 yrs)

Position Name : Lead PySpark Developer

Experience : 10 - 16 yrs

Location : Pan India

Budget : 46 LPA max including variables

Notice Period : Immediate to Serving NP (30 Days max remaining)

Job Description :

Primary Skill : Lead PySpark Developer

Secondary Skill : SAS tools

- Lead a team of data engineers in the design and implementation of big data solutions using PySpark.

- Collaborate with cross-functional teams to understand business needs and develop data-driven solutions.

- Design and implement scalable and robust data pipelines using PySpark.

- Ensure data accuracy and integrity by implementing data validation and quality checks.

- Mentor and coach team members in PySpark and big data best practices.

- Stay up-to-date with the latest developments in big data technologies and incorporate them into the team's workflow.

Requirements :

- 9+ years in PySpark/ Data engineer development and implementation

- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

- Proven experience as a PySpark Lead or similar role.

- Expertise in PySpark and big data technologies such as Hadoop, Hive, and Spark.'

Skills : Hadoop, Spark, Spark SQL - Scala