Lead Data Engineer

What you will do:

Analyze and organize raw data Create and maintain optimal data pipeline architecture,

Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.

Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS big data technologies.

Prepare data for prescriptive and predictive modelling build algorithms and prototypes.

Who you are:

5-8 years of experience as a Data Engineer

Experience building and optimizing big data data pipelines, architectures, and data sets

Experience with big data tools: Spark, Flink, Kafka, Airflow, etc

Experience with relational SQL and NoSQL databases, including Postgres and Cassandra

Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.