Python and PySpark Developer

Contract Type: 6-month contract (with the possibility of extension)

Location: Hybrid 2-3 days a week in office at Seawoods, Navi Mumbai

Industry: IT Services

Experience: 5+ Years

Salary: 1.1 to 1.2 lacs

We are seeking a skilled Python & PySpark Developer to join our dynamic team. The ideal candidate will have a strong background in Python programming and hands-on experience with PySpark to build and optimize large-scale data processing pipelines. You will work closely with data engineers and analysts to transform complex data into actionable insights, ensuring robust, efficient, and scalable solutions.

Role & Responsibilities:

• Design, develop, and implement high-performance ETL pipelines using PySpark on AWS EMR
• Write reusable, testable, and efficient code
• Optimize Spark jobs, ensuring performance tuning and seamless execution
• Work with AWS S3 object storage and configure EMR clusters
• Troubleshoot Spark jobs and monitor them using Spark UI
• Collaborate with cross-functional teams and engage with customers effectively
• Deliver high-quality solutions on time while mentoring team members
  

Required Skills & Experience:

• 5+ years of experience in Python programming
• Strong PySpark expertise (3+ years) and understanding of Spark Dataframe & API
• Hands-on experience in AWS EMR cluster configuration
• Familiarity with functional programming concepts
• Expertise in troubleshooting & monitoring Sparks jobs
• Strong communication & stakeholder management skills