Senior Data Specialist

Experience in Capital Market/Investment Banking domain is MUST. Immediate joiners preferred.

Key Responsibilities:

1. Develop and implement efficient data pipelines and ETL processes to migrate and manage client, investment, and accounting data in Databricks
2. Work closely with the investment management team to understand data structures and business requirements, ensuring data accuracy and quality.
3. Monitor and troubleshoot data pipelines, ensuring high availability and reliability of data systems.
4. Optimize database performance by designing scalable and cost-effective solutions.

Databricks Skills Required:

• Proficiency in Apache Spark. Databricks Data Cloud, including schema design, data partitioning, and query optimization
• Exposure to Azure.
• Exposure to Streaming technologies. (e.g Autoloader, DLT Streaming)
• Advanced SQL, data modeling skills and data warehousing concepts tailored to investment management data (e.g., transaction, accounting, portfolio data, reference data etc).
• Experience with ETL/ELT tools like snap logic and programming languages (e.g., Python, Scala, R programing).
• Familiarity workload automation and job scheduling tool such as Control M.
• Familiar with data governance frameworks and security protocols.

Preferred Skills:

• Familiarity with programming languages such as Python.

Education:

• Bachelors in Computer Science, Data Engineering, or related field.