Data Engineer

Data Engineer

As part of the team, you will be responsible for building and running the data pipelines and services that are required to support business functions/reports/dashboards. We are heavily dependent on BigQuery/Snowflake, Airflow, Stitch/Fivetran, debt, and Tableau/Looker for our business intelligence and embrace AWS with some GCP.

As a Data Engineer you are:

Developing end-to-end ETL/ELT Pipeline working with Data Analysts of Business Functions.Designing, developing, and implementing scalable, automated processes for data extraction, processing, and analysis in a Data Mesh architecture Fother Junior Engineers in the TeamBe a go-to” expert for data technologies and solutions to provide on-the-ground troubleshooting and diagnosis to architecture and design challengesTroubleshooting and resolving technical issues as they arise looking for ways of improving both what and how data pipelines are delivered by the department translating business requirements into technical requirements, such as entities that need to be modeled, DBT models that need to be built, timings, tests and reportsOwning the delivery of data models and reports end to and perform exploratory data analysis to identify data quality issues early in the process and implement tests to ensure prevent them in the future working with Data Analysts to ensure that all data feeds are optimized and available at the required times. This can include Change Capture, Change Data Control, and other “delta loading” approachesDiscovering, transforming, testing, deploying, and documenting data source supplying, helping define, and championing data warehouse governance: data quality, testing, coding best practices, and peer review building Looker Dashboard for use cases if required.

What makes you a great fit:

Having 3+ years of extensive development experience using Snowflake or similar data warehouse technology working experience with debt and other technologies of the modern data stack, such as Snowflake, Apache Airflow, Fivetran, AWS, git, LookerExperience in agile processes, such as SCRUMExtensive experience in writing advanced SQL statements and performance tuning the experience in Data Ingestion techniques using custom or SAAS tool like fivetranExperience in data modeling and can optimize existing/new data models experience in data mining, data warehouse solutions, and ETL, and using databases in a business environment with large-scale, complex datasets