Senior Data Engineer - ETL/Python (5-6 yrs)

Senior Data Engineer.

Location : Bengaluru, India.

Experience : 5+ yrs.

Summary :

- We are seeking a highly skilled and motivated Data Engineer to join our dynamic team.

- The ideal candidate will have extensive experience in data engineering, with a strong focus on Databricks, Python, and SQL.

- As a Data Engineer you will play a crucial role in designing, developing, and maintaining our data infrastructure to support various business needs.

- Develop and implement efficient data pipelines and ETL processes to migrate and manage client, investment, and accounting data in Databricks.

- Work closely with the investment management team to understand data structures and business requirements, ensuring data accuracy and quality.

- Monitor and troubleshoot data pipelines, ensuring high availability and reliability of data systems.

- Optimize database performance by designing scalable and cost-effective solutions.

What's on offer :

- Competitive salary and benefits package.

- Opportunities for professional growth and development.

- A collaborative and inclusive work environment.

- The chance to work on impactful projects with a talented team.

- 5+ years of experience in data engineering or a similar role.

- Proficiency in Apache Spark.

- Databricks Data Cloud,- including schema design, data partitioning, and query optimization.

- Exposure to Azure.

- Exposure to Streaming technologies.(e.g Autoloader, DLT Streaming).

- Advanced SQL, data modeling skills, and data warehousing concepts tailored to investment management data (e.g , transaction, accounting, portfolio data, reference data etc).

- Experience with ETL/ELT tools like snap logic and programming languages (Python/Scala/R programming).

- Familiarity with workload automation and job scheduling tools such as Control M.

- Familiar with data governance frameworks and security protocols.

- Excellent problem-solving skills and attention to detail.

- Strong communication and collaboration skills.

Education :

- Bachelor's degree in computer science, IT, or a related discipline.