Senior Associate Data Engineer - PySpark/Python (5-10 yrs)

Responsibilities :

Design, develop, and maintain scalable data pipelines and ETL processes using Apache Spark,

Databricks, Python, and SQL.

Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.

- Optimize and improve existing data workflows for performance, reliability, and scalability.

- Implement data quality checks and ensure data integrity across all data pipelines.

- Monitor and troubleshoot data pipeline issues, ensuring timely resolution.

- Stay up-to-date with the latest industry trends and best practices in data engineering and incorporate

them into our processes.

Requirements :

- 5+ years of experience in data engineering or a similar role.

- Proficiency in Apache Spark, Databricks, Python, and SQL.

- Experience in the Capital Market/Private Equity domain

- Strong understanding of data warehousing concepts and ETL processes.

- Excellent problem-solving skills and attention to detail.

- Strong communication and collaboration skills.

- Bachelor's degree in computer science, IT, or a related discipline.