Senior Data Engineer

Job Title : Senior Data Engineer

About the Role:

• You have several years of experience in Data/Software Engineering on a cloud platform.
• You like working in a collaborative team where there is collective ownership.
• You enjoy getting involved with every stage of the engineering lifecycle.
• Have an understanding of data and distributed systems concepts, a familiarity with the Data Mesh Architecture would be beneficial.
• You understand the benefits of Test Driven Development and automation.
• You are comfortable pair programming and practising continuous integration and continuous delivery.
• You see the value in developers owning production software and view failure as a chance to learn.

Roles and Responsibilities :

As part of an Agile product team, day-to-day you will:

• Take part in our daily stand-ups.
• Contribute to ceremonies like steering, story writing, collaborative design and retrospectives.
• Develop new features and improve code quality by pair programming with other team members.
• Take part in the support and monitoring of our services.

Within 3 Months you will:

• Get familiar with our emerging technology stack and data landscape. 
• Align yourself with the work of the data platform team and understand the data requirements and issues facing our users.
• Collaborate effectively with each discipline on the team.
• Actively participate in technical discussions and share ideas.
• Work with architects and other data engineers in the organisation to align the data processing architecture 

By 3-6 months you will:

• Have an understanding of the teams context within the wider organisation.
• Be a supportive member of the team, developing the platform by using the appropriate technology solutions to solve the problem at hand.
• Triage support queries and diagnose issues in our live applications.
• Identify new sources of data across the organisation and build relationships with data providers to gain access.
• Understand the processes by which data is acquired and any resulting limitations or bias and communicate this to the team.
• Develop and maintain data pipelines to load data into systems like BigQuery, to analyse, clean and join datasets, in an automated, repeatable way.
• Ensure that data is stored securely and in compliance with GDPR.
• Work with data owners to understand how we can allow them to self-serve their data using tools we develop.

By 6-12 months you will:

• Develop processes and tools to monitor feeds and test data integrity and completeness and to alert users when a problem occurs.
• Understand our customers needs, both internal and external, and how your work affects their experience.
• Able to gauge the complexity or scope of a piece of work, breaking it into smaller pieces when appropriate.
• Give and receive constructive feedback within your team.
• Mentor other members of the team in the principles of data engineering and promote best practice.
• Promote and advocate the use of data across Springer Nature.
• If you have an interest in data science there may be opportunities to apply machine learning techniques to these datasets to assist in the work of domain teams. Role & responsibilities

Preferred candidate profile

Perks and benefits