Data Engineer - Predictive Modeling (3-7 yrs)

We are looking for a senior data engineer who will help us source, validate, and manage financial data using state-of-the-art data mining algorithms.

The role involves leveraging the latest data mining techniques, designing validation engines, error monitoring, and conducting root cause analysis.

The candidate will also be responsible for statistical analysis of our datasets and creating robust data pipelines for data consumption.

Experience : 3 - 7 Years

Location : Bengaluru.

Notice period : Immediate 15 Days.

Responsibilities :

- Building efficient models for large-scale data extraction from websites and handling vendor-sourced data.

- Designing, constructing, installing, testing, and maintaining data management systems.

- Building high-performance algorithms, predictive models, and prototypes for existing and new datasets.

- Ensuring that all systems meet the business/company requirements as well as industry practices.

- Developing set processes for data mining, data modeling, and data production.

- Researching new uses for existing data.

- Collaborating with team members (like data architects, IT team, data scientists, etc.) on the project's goals.

- Installing/updating disaster recovery procedures and managing data security requirements.

- Recommending ways to constantly improve data reliability and quality.

- Designing and building validation engines for monitoring of sourced data.

- Processing, cleansing, and verifying the integrity of data used for analysis.

- Enhancing data collection procedures to include information that is relevant for building analytic systems.

Skills and Qualifications :

- Graduate in Engineering, Technology, Applied Mathematics, Physics, Statistics along with good business skills.

- Proficiency in Python.

- Experience with Financial Data, AWS, NoSQL databases, and Restful APIs.

- Familiarity with web scraping.

- Experience with building and maintaining data pipelines.

- Understanding of DataOps practices.

- Knowledge of AWS serverless CI/CD (preferred).

- Experience with big data technologies (preferred).

- A strong understanding of data structures and algorithms (preferred).

- Ability to create Grafana/QuickSight dashboards for logs and data monitoring (preferred).

- Good communication skills.

- Good problem-solving and negotiation skills.