data engineer- Bangalore- BFSI- Immediate

Hi All,

Note: Candidate should have project experience in capital market/Banking/Investment banking/Financial domains and strong exposure to Data Bricks with Spark and Python
Key Responsibilities:

• Design, develop, and maintain scalable data pipelines using Databricks, Python, and Spark.
• Work with large, complex datasets and ensure efficient data processing and transformation.
• Collaborate with cross-functional teams to gather and understand data requirements.
• Write and optimize SQL queries for data extraction, transformation, and loading (ETL).
• Ensure data quality, integrity, and security across all processes.
• Contribute to the architecture and design of data systems and solutions.

Required Skills & Qualifications:

• 5+ years of experience in data engineering or a related field.
• Strong expertise in Databricks for large-scale data processing and analytics.
• Proficiency in Python, with a focus on Spark for distributed data processing.
• Solid experience in writing and optimizing SQL queries.
• Experience working with large-scale data systems and tools.
• Knowledge of the Capital Market/Private Equity domain is a plus (relaxation may apply).

Preferred Skills:

• Familiarity with cloud platforms (e.g., AWS, Azure, GCP).
• Experience with data warehousing and ETL processes.
• Strong problem-solving and analytical skills.