Senior Data Engineer - Sensing

We are seeking a top-tier Senior Data Engineer to drive the development and implementation of our data strategy. The ideal candidate possesses a strong blend of technical expertise and data-driven problem-solving skills. As a Senior Data Engineer, you will play a crucial role in designing, building, and optimizing our data pipelines and platforms while mentoring junior engineers.

Roles & Responsibilities:

• Contribute to the design, development, and implementation of data pipelines, ETL/ELT processes, and data integration solutions.
• Take ownership of data pipeline projects from inception to deployment, managing scope, timelines, and risks.
• Ensure data quality and integrity through meticulous testing and monitoring.
• Leverage cloud platforms (AWS preferred) to build scalable and efficient data solutions.
• Work closely with data analysts, data scientists, and business stakeholders to understand data requirements.
• Identify and resolve complex data-related challenges.
• Adhere to data engineering best practices and standards.
• Experience developing in an Agile development environment, and comfortable with Agile terminology and ceremonies.
• Familiarity with code versioning using GIT, Jenkins and code migration tools.
• Exposure to Jira or Rally.
• Identifying and implementing opportunities for automation and CI/CD.
• Stay up to date with the latest data technologies and trends.

Win

What we expect of you

Basic Qualifications:

• Masters degree in computer science or STEM majors with a minimum of 5 years of Information Systems experience OR
• Bachelors degree in computer science or STEM majors with a minimum of 7 years of Information Systems experience.

Preferred Qualifications:

Must-Have Skills (Not more than 3 to 4):

• Demonstrated hands-on experience with cloud platforms (AWS, Azure, GCP) and the ability to architect cost-effective and scalable data solutions.
• Proficiency in Python, PySpark, SQL. Hands on experience with big data ETL performance tuning.
• Strong development knowledge in Databricks.
• Strong analytical and problem-solving skills to address complex data challenges.

Good-to-Have Skills:

• Experienced with data modeling and performance tuning for both OLAP and OLTP databases
• Experienced working with Apache Spark, Apache Airflow
• Experienced with software engineering best-practices, including but not limited to version control (Git, Subversion, etc.), CI/CD (Jenkins, Maven etc.), automated unit testing, and Dev Ops
• Experience in SQL/NOSQL database, vector database for large language models
• Experience with prompt engineering, model fine tuning
• Experience with DevOps/MLOps CICD build and deployment pipeline

Professional Certifications (please mention if the certification is preferred or required for the role):

• AWS Certified Data Engineer (preferred)
• Databricks Certification (preferred)
• Any SAFe Agile certification (preferred)

Soft Skills:

• Initiative to explore alternate technology and approaches to solving problems.
• Skilled in breaking down problems, documenting problem statements, and estimating efforts.
• Effective communication and interpersonal skills to collaborate with multi-functional teams.
• Excellent analytical and problem solving skills.
• Strong verbal and written communication skills
• Ability to work effectively with global, virtual teams
• High degree of initiative and self-motivation.
• Ability to manage multiple priorities successfully.
• Team-oriented, with a focus on achieving team goals
• Strong presentation and public speaking skills.