Data Engineer - Python/SQL (3-8 yrs)

Role & Responsibilities :

1. Building data transformation pipelines with humans in the loop :

- In order to increase the frequency of our ML models updates, you will be in charge of automating and expanding a semi-manual datasets generation pipeline, including tagging jobs preparation, scheduling and post-processing.

2. Data distribution shift monitoring :

- You will design a system capable of detecting changes in our data distribution, as well as the apparition of unknown data types by monitoring the behavior of our ML models in production

3. Dataset growth strategy :

- You will use your developed expertise of our business data and system monitoring tooling to help identify valuable zones of expansion of our automated solution

4. Datasets versioning management :

- You will be in charge of managing and documenting datasets versions of an ecosystem of highly dependent and changing datasets

5. Data volatility management :

- You will help develop solutions to stabilize our datasets in an environment where data retention is time-limited

6. System performance analysis :

- You will support your team and the organization in answering questions related to the behavior of our automated system on particular transactions and data buckets by diving into the data and our models.

- You will use your advanced Python skills to produce targeted performance metrics that will lead you from a metric to problematic examples.

Experience and Qualifications :

1. Building data pipelines in dynamic and changing environments

2. Wrangling data with Python (pandas, numpy) and SQL

3. Performing data analysis and data deep dives using Jupyter notebooks (or other notebook tools)

4. Experience and/or interest in Machine Learning and Data Science

5. Proficiently leveraging cloud environments