Data Engineer

Position : Data Engineer

Experience : 7+ years (Senior)

Job Description:

Python Developer Data engineer is expected to work in investment banking / fund management domain with excellent coding and debugging skills in python, deep understanding of algorithms in data ingestion, transformation and storage mechanism

Responsibilities:
o Real-time data streaming and data analysis
o Build data-driven models. Create bespoke data models and algorithms. Work on relational and non-relational data storages
o Design, develop, test, and document the data collection framework
o Implementing data pipeline infrastructure for data ingestion. Transform and aggregate data, automated jobs and maintain them
o Identify data integrity issues while implementing and maintaining database structures
o Identify and leverage 3rd party off the shelf tools and libraries. Developing python based tools & utilities in-house to improve efficiency
o Work in collaboration with IT engineering and business teams

Qualifications:
o Bachelors degree in Computer Science or Engineering
o 3+ years of experience in data engineering using python, experienced in performing ETL and/or data pipeline implementations
o Expertise in data Lake technologies, data storage formats and query engines
o Exceptional in Pandas, NumPy and dataframes, and work experience in Spark, AWS Glue, AWS Redshift is a definite plus
o Experienced in financial domain. BFSI domain / investment banking knowledge is a definite plus
o Experienced In AWS CDK or CloudFormation