Big Data Engineer- Aftersales

Key roles and responsibilities include:

Work with Business IT teams to gather, understand and define requirements and break down Demands into EPICS and User Stories, where needed.

Design and build end-to-end CI/CD data pipelines / deployments to get the relevant data and for the deliverables

Reviewing design, code and other deliverables created by your team to guarantee high-quality results

Define acceptance criteria, manage perform testing of own pipelines to ensure expected quality

Own the status of Change requirements throughout the lifecycle adapt changes to the existing scripts, codes and pipelines.

Own PoCs and deliver the results in reasonable time

Ensuring appropriate use of MB IT project management tools, governance, processes, policies and methodologies

Bring value adds by contributing to continuous improvement and innovation, encourage best practices, challenge current practices, provide feedback to colleagues

Presents user stories in demand concept meetings together with respective stakeholders

Align with architects if and as needed

Detect dependencies to other systems/demands

Conduct regular status meetings with all stakeholders, keeping the stakeholders needs and requirements continuously in view

Qualifications

Mandatory Requirements

Total 3-6 Years of Experience in cloud with data engineering analytics

Bachelors Degree in computer science or equivalent

Hands on experience in Azure and Azure Data Factory, Storage accounts and Databricks, PySpark, DeltaLake, SQL

Hands on experience in Azure DevOps/GIT, creating CI/CD pipelines and setting up branching / deployment strategies of data engineering

Good knowledge in Azure key vaults, Authentication methods, Data security and error handling in Azure Data Factory and Azure DataBricks

Good experience with DWH, ETL/ELT process, hands-on expertise ETL tools, relational DB or MPP, query tuning and performance tuning, and Apache Kafka

Good knowledge in Agile(Scrum, DevOps Boards etc.)

Exposure to log analytics and debugging

Good presentation, communication (written and verbal English) skills, and interpersonal skills and comfortable in liaising with stakeholders independently

Ability to juggle and prioritize multiple tasks within a collaborative team environment

Drive and desire to learn and grow both technical and functional skill sets

Exposure to client facing roles both from IT and Business

Proven ability leveraging analytical and problem-solving skills in a fast paced environment

Preferred Experience and Skills

Microsoft Azure Certifications

Good knowledge of data architecture patterns (Data lakehouse, delta lake, streaming, Lambda/Kappa architecture)

Experienced in Powershell scripting for orchestration