PySpark Developer

At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the worlds mostinnovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as theyprovide unique R&D and engineering services across all industries. Join us for a career full of opportunities. Where you can make a difference. Where no two days arethe same.
 Job Description 

4+ years of experience in the design and implementation of Big Data systems using PySpark, database migration, transformation and integration solutions for any Data warehousing project.

Must have excellent knowledge in Apache Spark and Python programming experience

Deep experience in developing data processing tasks using PySpark such as reading data from external sources, merging data, performing data enrichment and loading into target data destinations.

Experience in deployment and operationalizing the code, knowledge of scheduling tools like Airflow, Autosys. is preferred

Working experience on Cloud technology architecture like Google Cloud, BigQuery etc. is an added advantage

Understanding of Unix/Linux + Shell Scripting

 Primary Skills 

Apache Pyspark

Spark

Python