Data Engineer - ETL/Data Warehousing (5-9 yrs)

About the role :

- As a Data Engineer Specialist, you will be a subject matter expert responsible for developing and maintaining data pipelines to assist us aggregate number of client data sources into a single view for our teams to utilize. The data is often incomplete, inconsistent and stored in silos with access primarily through APIs and FTPs. We are looking for a creative, experienced and motivated individual to build solutions for integrating CRM and Marketing data in GCP & BigQuery environments.

Responsibilities :

- Build and maintain custom ingestion and integration pipelines from multiple sources (Digital Marketing and CRM data) - 70% (of time)

- Establish monitoring systems to give visibility to pipelines' status and monitor automated jobs. - 10%

- Bringing consistency to our Data handling and schemas across the board. - 5%

- Developing quality standards to ensure data quality and integrity across all database systems. - 5%

- Partner with analysts and data scientists to improve the efficiency and performance of their data products. - 5%

- Where appropriate, train other team members to support the development of products, tools and technologies. - 5%

Experience :

Required :

- 5+ years' experience developing data processing and storage solutions on a cloud architecture; prior knowledge of GCP ecosystem is a major advantage.

- Experience dealing with Digital marketing and CRM data.

- Experience in building pipelines from various data sources especially APIs.

- 2013-2023 SixBerries Ltd Confidential Page 3

Preferred :

- Experience with Python development.

- Experience with using version control via Git and CI/CD systems.

- Demonstrated success as a developer in the full scope of the development lifecycle; including, but not limited to, understanding business needs, design, development, and deployment.

Requirements and skills :

Required :

- Excellent communication and teamwork skills

- A willingness to continually learn and adapt

- Organisational skills

- An analytical mind

- Digital marketing and CRM data pipeline knowledge

- Understands efficient data warehousing designs and schemas.

- Comfortable with ETL tools such as Alteryx, Parabola or Talend

- Highly skilled at writing advanced SQL queries and comfortable with merging complex datasets into functional presentation layers for model inputs.

- Comfortable with working with orchestration tools such as Airflow, Dataproc, dbt or Cloud Composer for ETL and ELT.

Preferred :

- Knowledgeable about data infrastructure management and Unix/Linux operating systems.

- Skilled at deploying containerization solutions such as Docker or Kubernetes.