Lead Data Engineer

The Role

The Data Engineer is a vital role within the Blenheim Chalcot portfolio and Fospha. You will collaborate with cross-functional teams to understand data requirements and deliver effective solutions. You will gain hands-on experience in a fast-paced and progressive environment, where you will support us in building our next generation of GenAI enabled tech businesses.

Key Responsibilities

• Implement and maintain ELT (Extract, Load, Transform) processes using scalable data pipelines and data architecture.
• Collaborate with cross-functional teams to understand data requirements and deliver effective solutions.
• Ensure data integrity and quality across various data sources.
• Support data-driven decision-making by providing clean, reliable, and timely data.
• Define the standards for high-quality data for Data Science and Analytics use-cases and help shape the data roadmap for the domain.
• Design, develop, and maintain the data models used by ML Engineers, Data Analysts and Data Scientists to access data.
• Conduct exploratory data analysis to uncover data patterns and trends.
• Identify opportunities for process improvement and drive continuous improvement in data operations.
• Stay updated on industry trends, technologies, and best practices in data engineering.

Required Skills:

• Excellent knowledge of PostgreSQL and SQL technologies.
• Fluent in Python.
• Understanding of data architecture, pipelines and ELT flows/technology/methodologies.
• Understanding of agile methodologies and practices.

Preferred Skills:

• Experience using dbt (Data Build Tool).
• Experience using pipeline technologies within AWS.
• Knowledge of data modeling and statistics.