Python Pyspark Developer

Primary Skills / Must have:

1. Should have strong programming skills in Python.
2. Experience in creating large scale data processing pipelines using a Python and Spark based framework.
3. Work with different aspects of the Spark ecosystem, including Spark SQL, DataFrames, Datasets, and Streaming
4. Should possess strong SQL skills.
5. Excellent understanding of Unix ecosystem and should have experience in creating the shell scripts.
6. Excellent understanding of Hive/Hadoop ecosystem.
7. Solid Understanding of data engineering concepts and best practices.
8. Excellent understanding of Job Scheduling mechanisms like Autosys, TWS.
9. Excellent problem solving and analytical skills.
10. Excellent verbal and written communication skills.
11. Experience in optimizing large data loads.

Please apply in the below SF & provide your data privacy consent by clicking on the below link.

https://careers.ey.com/job-invite/1550037/