Data Engineer

Experience : 4+ years

Job Description:

Python Developer Data engineer is expected to work in investment banking / fund management domain with excellent coding and debugging skills in python, deep understanding of algorithms in data ingestion, transformation and storage mechanism

Responsibilities:
Real-time data streaming and data analysis
Build data-driven models. Create bespoke data models and algorithms. Work on relational and non-relational data storages
Design, develop, test, and document the data collection framework
Implementing data pipeline infrastructure for data ingestion. Transform and aggregate data, automated jobs and maintain them
Identify data integrity issues while implementing and maintaining database structures
Identify and leverage 3rd party off the shelf tools and libraries. Developing python based tools & utilities in-house to improve efficiency
Work in collaboration with IT engineering and business teams

Qualifications:
Bachelors degree in Computer Science or Engineering
3+ years of experience in data engineering using python, experienced in performing ETL and/or data pipeline implementations
Expertise in data Lake technologies, data storage formats and query engines
Exceptional in Pandas, NumPy and dataframes, and work experience in Spark, AWS Glue, AWS Redshift is a definite plus
Experienced in financial domain. BFSI domain / investment banking knowledge is a definite plus
Experienced In AWS CDK or Cloud Formation Role & responsibilities

Experienced in Snowflake