Data Engineer

ROLE TITLE: Data Engineer

JOB FAMILY: Data and Development

ROLE PURPOSE: Development and technical delivery of data engineering pipelines within Balfour Beatty's data engineering function.

ACCOUNTABILITIES

• Work as a key part of our data engineering and analytics teams to develop and maintain data engineering pipelines from our internal and external business applications.
• Deliver optimised ingestions and transforms to our AWS S3 and Redshift based data lake.
• Work on process automation and systems integrations from disparate systems including ‘big data’ databases, Rest and Soap APIs, LiDAR surveys platforms, IoT sensor networks and live streaming telematics.
• Create analytics optimised datasets to our data analytics team.
• Work on to create AWS based APIs for in-house and external consumption.

PERSONAL QUALITIES AND EXPERIENCE :

Technical Skills - Essential

• Python in a data engineering or analytics environment.
• Experience with AWS technologies ideally Lambda, Glue, Kinesis, Redshift, s3, SES, API Gateway, EC2 etc.
• Experience in building APIs
• Experience interfacing with other technologies to extract, transform, and load (ETL) data.
• Experience in building Infrastructure pipelines to support and optimise the AWS infrastructure
  
  Technical Skills - Desirable
  
• Azure infrastructure
• Microsoft Power BI
• Database architecture and design
• Real world understanding of PL/SQL, MSSQL or other flavours.
• AWS SAM (Serverless Application Framework) experience.
• GIS (location) data experience
• Visual ETL technologies e.g. Matillion
• Working closely with team members to drive real-time model implementations for monitoring and alerting of risk systems.
• Docker/Kubernetes
• Unix

Interpersonal Skills

• Fast, organised and can take direction well.
• Logical thinker with ability to solve problems
• Good verbal communication skills with senior management in customer base
• Good written skills
• Tenacious with desire to achieve defined outcome to a high quality
• Strong organisational and communications skills along with understanding production values, deadlines and priorities
• Previous work with an onshore professional services team

Education

• Degree or equivalent in Computer Science/Engineering or related field or relevant work experience

LAST UPDATE 31/01/2025