Senior Data Engineer - Sensing

What you will do

In this vital role you will be responsible for managing and optimizing the company's data infrastructure and architecture. You will design and implement data pipelines, develop data models, perform data integration, and ensure data quality and governance.

Your expertise in data engineering, big data technologies, and data manipulation will contribute to the effective storage, processing, and utilization of large-scale data sets.

We are seeking a top-tier Senior Data Engineer to drive the development and implementation of our data strategy. The ideal candidate possesses a strong blend of technical expertise and data-driven problem-solving skills.

As a Senior Data Engineer, you will play a crucial role in designing, building, and optimizing our data pipelines and platforms while mentoring junior engineers.

Roles & Responsibilities:

• Contribute to the design, development, and implementation of data pipelines, ETL/ELT processes, and data integration solutions.
• Take ownership of data pipeline projects from inception to deployment, managing scope, timelines, and risks.
• Ensure data quality and integrity through meticulous testing and monitoring.
• Leverage cloud platforms (AWS preferred) to build scalable and efficient data solutions.
• Work closely with data analysts, data scientists, and business stakeholders to understand data requirements.
• Identify and resolve complex data-related challenges.
• Adhere to data engineering best practices and standards.
• Experience developing in an Agile development environment, and comfortable with Agile terminology and ceremonies.
• Familiarity with code versioning using GIT, Jenkins and code migration tools.
• Exposure to Jira or Rally.
• Identifying and implementing opportunities for automation and CI/CD.
• Stay up to date with the latest data technologies and trends.

What we expect of you

Basic Qualifications:

• Masters degree in computer science or STEM majors with a minimum of 5 years of Information Systems experience OR
• Bachelors degree in computer science or STEM majors with a minimum of 7 years of Information Systems experience.

Preferred Qualifications:

Must-Have Skills (Not more than 3 to 4):

• Demonstrated hands-on experience with cloud platforms (AWS, Azure, GCP) and the ability to architect cost-effective and scalable data solutions.
• Proficiency in Python, PySpark, SQL. Hands on experience with big data ETL performance tuning.
• Strong development knowledge in Databricks.
• Strong analytical and problem-solving skills to address complex data challenges.

Good-to-Have Skills:

• Experienced with data modeling and performance tuning for both OLAP and OLTP databases
• Experienced working with Apache Spark, Apache Airflow
• Experienced with software engineering best-practices, including but not limited to version control (Git, Subversion, etc.), CI/CD (Jenkins, Maven etc.), automated unit testing, and DevOps
• Experience in SQL/NOSQL database, vector database for large language models
• Experience with prompt engineering, model fine tuning
• Experience with DevOps/MLOps CICD build and deployment pipeline

Professional Certifications (please mention if the certification is preferred or required for the role):

• AWS Certified Data Engineer (preferred)
• Databricks Certification (preferred)
• Any SAFe Agile certification (preferred)

Soft Skills:

• Initiative to explore alternate technology and approaches to solving problems.
• Skilled in breaking down problems, documenting problem statements, and estimating efforts.
• Effective communication and interpersonal skills to collaborate with multi-functional teams.
• Excellent analytical and problem solving skills.
• Strong verbal and written communication skills
• Ability to work effectively with global, virtual teams
• High degree of initiative and self-motivation.
• Ability to manage multiple priorities successfully.
• Team-oriented, with a focus on achieving team goals
• Strong presentation and public speaking skills.