Senior Data Engineer - Python/ETL (7-10 yrs)

Position : Data Engineer

Experience : 7+ years (Senior)

Number of positions : 4

Job Description :

Python Developer - Data engineer is expected to work in investment banking / fund management domain with excellent coding and debugging skills in python, deep understanding of algorithms in data ingestion, transformation and storage mechanism

Responsibilities :

- Real-time data streaming and data analysis

- Build data-driven models.

- Create bespoke data models and algorithms.

- Work on relational and non-relational data storages

- Design, develop, test, and document the data collection framework

- Implementing data pipeline infrastructure for data ingestion.

- Transform and aggregate data, automated jobs and maintain them

- Identify data integrity issues while implementing and maintaining database structures

- Identify and leverage 3rd party off the shelf tools and libraries.

- Developing python based tools & utilities in-house to improve efficiency

- Work in collaboration with IT engineering and business teams

Qualifications :

- Bachelor's degree in Computer Science or Engineering

- 3+ years of experience in data engineering using python, experienced in performing ETL and/or data pipeline implementations

- Expertise in data Lake technologies, data storage formats and query engines

- Exceptional in Pandas, NumPy and dataframes, and work experience in Spark, AWS Glue, AWS Redshift is a definite plus

- Experienced in financial domain.

- BFSI domain / investment banking knowledge is a definite plus

- Experienced In AWS CDK or CloudFormation