Senior Data Engineer

Role: Senior Data Engineer
Experience: 7+ years
Location: Remote (PAN India)
Tenure: 3 Months Contract (Possible Extension)

Role Overview
We are seeking a highly skilled and experienced Senior Data Engineer to join our team on a 3-month contract, with the potential for extension based on project requirements. The ideal candidate will have a strong background in building scalable data architectures and a proven ability to lead cross-functional collaborations. This role offers the opportunity to work with an Australian client in the automotive domain, contributing to innovative data solutions that drive business insights.

Key Responsibilities

• Contributing to the delivery of scalable data architectures, and data product development & design best practices.
• Leading collaborations across data disciplines to develop, optimize, and maintain data pipelines and solutions.
• Engages actively in facilitating team-based problem-solving sessions and contribute to the development of best practices.
• Initiating and nurturing effective working relationships, acting as a trusted advisor on product analytics and commercial data solutions.
• Leading technical recommendations and decision-making while mentoring early-career engineers playing a key role in growing the team's capabilities
• Owning the delivery of their allocated initiatives within specified scope, times, and budgets.

What are we looking for?

• Critical to success in the role is the ability to operate in the liminal space between business, data, and technical practice.
• An all-of-business mindset over siloed success, leading with high levels of personal integrity and accountability.
• Skilled at distilling business and analytics requirements into well-defined engineering problems.
• Skilled at applying appropriate software engineering methods (e.g. modularisations, abstractions) that make data assets tractable.
• Track record architecting, building, and integrating with RESTful APIs and microservices architectures.
• Proficient in containerization platforms (e.g. Docker) and CI/CD pipelines Data engineering experience (e.g. transformations, modeling) grounded in the basics of an analytical discipline.
• Skilled in designing and building software/pipelines using cloud services such as AWS EC2, Glue, Lambda, SNS, SQS, IAM, ECS, or equivalent.
• Demonstrated experience with distributed technologies and data-intensive processing frameworks -e.g. Airflow, HDFS, Spark, EMR.
• Proficient in at least two programming languages (e.g. Python, Spark, Scala). Experience with .Net frameworks is highly favorable

Technical Requirements:

• API and Microservices: Experience with architecting, building, and integrating RESTful APIs and microservices.
• Containerization and CI/CD: Proficient in Docker and CI/CD pipelines.
• Cloud Services: Skilled in AWS services like EC2, Glue, Lambda, SNS, SQS, IAM, and ECS.
• Data Engineering: Experience in data transformations, modeling, and distributed frameworks (Airflow, HDFS, Spark, EMR).
• Programming: Proficient in Python, Spark, Scala; experience with .Net is a plus.