Data Engineer

Job Description: Data Engineer

We are seeking a skilled Data Engineer with a deep understanding of data integration and engineering techniques to design and deliver robust, scalable, and efficient data solutions. In this role, you will focus on the design, implementation, automation, and optimization of data pipelines and enterprise-wide applications, such as data lakes and data warehouses, to manage and analyze large and complex datasets effectively.

Key Responsibilities

• Design, develop, and maintain high-performing data pipelines for extracting, transforming, and loading (ETL/ELT) data.
• Collaborate with QA teams to ensure the accuracy and integrity of data pipelines through rigorous testing.
• Manage source code repositories to maintain software versioning and collaboration.
• Utilize workflow orchestration tools to schedule and execute pipeline workflows seamlessly.
• Implement CI/CD techniques and platforms to automate pipeline deployments and ensure continuous delivery.

Required Skills & Qualifications

• Proven expertise in Data Engineering, with a track record of successfully delivering complex projects.
• In-depth knowledge of ELT/ETL processes, Data Warehousing, and Data Visualization techniques.
• Advanced SQL skills, with the ability to write and optimize queries for relational database platforms.
• Experience working within major public cloud ecosystems such as AWS, Azure, or Google Cloud Platform (GCP).
• Proficiency in workflow orchestration and scheduling solutions.
• Hands-on experience with tools like Snowflake and Matillion.

Preferred Qualifications

• Experience in building automated testing frameworks for validating data pipelines.
• Solid understanding of Continuous Integration and Delivery (CI/CD) principles and their practical application.

This is an exciting opportunity to work with cutting-edge technologies and drive impactful data solutions within a dynamic and collaborative environment.