Senior Data Engineer

Grade HResponsible for supporting the delivery of business analysis and consulting processes and procedures for the defined specialism using sound technical capabilities, building and maintaining effective working relationships, ensuring relevant standards are defined and maintained, and supporting delivery of process and system improvements. Specialisms: Business Analysis; Data Management and Data Science; Digital Innovation. Technology IT&S Group

• Design and implement data pipelines using AWS services (EMR, Glue, Redshift, S3, Lambda)
• Lead sprint work for data migration and optimization initiatives
• Build and maintain ETL workflows using Python, Spark, and AWS native tools
• Optimize AWS costs through efficient resource utilization and architecture improvements
• Implement automated testing and monitoring for data pipelines
• Lead data platform migrations and legacy system deprecation
• Participate in sprint planning and daily stand-ups
• Deliver sprint commitments consistently and independently
• Part of a cross-disciplinary team, working closely with other data engineers, software engineers, data scientists, data managers and business partners.
• Architects, designs, implements and maintains reliable and scalable data infrastructure to move, process and serve data.
• Writes, deploys and maintains software to build, integrate, manage, maintain, and quality-assure data at bp

Negligible travel should be expected with this role This role is eligible for relocation within country This position is a hybrid of office/remote working Commercial Acumen, Communication, Data Analysis, Data cleansing and transformation, Data domain knowledge, Data Integration, Data Management, Data Manipulation, Data Sourcing, Data strategy and governance, Data Structures and Algorithms (Inactive), Data visualization and interpretation, Digital Security, Extract, transform and load, Group Problem Solving