Prama - Python/PySpark Developer - Google Cloud Platform (3-6 yrs)

About the Role :

- We are seeking a highly skilled Python/PySpark Developer to join our dynamic data engineering team.

- In this role, you will be responsible for developing and maintaining high-performance data pipelines using PySpark on cloud platforms (preferably AWS).

- You will work closely with data engineers to extract, transform, and load large datasets for analysis and reporting.

Responsibilities :

- Design, develop, and maintain data pipelines using PySpark on cloud platforms (e.g., AWS EMR, AWS Glue).

- Write efficient and well-documented Python code for data processing and transformation tasks.

- Strong SQL experience is essential.

- Optimize data pipelines for performance, scalability, and cost-effectiveness.

- Collaborate with data engineers and analysts to understand data requirements and translate them into technical solutions.

- Develop and implement data quality checks and validation procedures.

- Troubleshoot and resolve data pipeline issues.

- Stay abreast of the latest advancements in data engineering technologies and best practices.

- Experience with AWS data services (e.g., S3, Redshift, Glue) is a plus.

Qualifications :

- Bachelor's degree in Computer Science, Computer Engineering, or a related field.

- 3+ years of experience in Python development.

- 2+ years of experience with PySpark and Spark ecosystem.

- Strong understanding of data structures, algorithms, and object-oriented programming.

- Experience with data warehousing concepts and ETL/ELT processes.

- Proficiency in SQL and experience with relational databases.

- Excellent analytical and problem-solving skills.

- Strong communication and interpersonal skills.

- Ability to work independently and as part of a team.