Senior Data Engineer - Apache Spark/Databricks (5-10 yrs)

Experience:

- 5+ years of experience in data engineering or a similar role.

- Proficiency in Apache Spark. Databricks Data Cloud, including schema design, data partitioning, and query optimization

- Exposure to Azure.

- Exposure to Streaming technologies. (e.g Autoloader, DLT Streaming)

- Advanced SQL, data modeling skills, and data warehousing concepts tailored to investment management data (e.g., transaction, accounting, portfolio data, reference data etc).

- Experience with ETL/ELT tools like snap logic and programming languages (Python/Scala/R programming).

- Familiarity with workload automation and job scheduling tools such as Control M.

- Familiar with data governance frameworks and security protocols.

- Excellent problem-solving skills and attention to detail.

- Strong communication and collaboration skills.

Education :

- Bachelor's degree in computer science, IT, or a related discipline.

Domain expertise : Investment banking, Mortgage, capital market, banking, financial services, private equity (Mandatory)