Senior Data Engineer - Sensing

What you will do

Lets do this. Lets change the world. In this vital role you will be responsible for managing and optimizing the company's data infrastructure and architecture. You will design and implement data pipelines, develop data models, perform data integration, and ensure data quality and governance. Your expertise in data engineering, Big-data technologies, and data manipulation will contribute to the effective storage, processing, and utilization of large-scale data sets.

We are seeking a seasoned Senior Data Engineer to drive the development and implementation of our data strategy. The ideal candidate possesses a strong blend of technical expertise and data-driven problem-solving skills. As a Senior Data Engineer, you will play a crucial role in designing, building, and optimizing our data pipelines and platforms while mentoring junior engineers.

• Contribute to the design, development, and implementation of data pipelines, ETL/ELT processes, and data integration solutions.
• Take ownership of data pipeline projects from inception to deployment, managing scope, timelines, and risks.
• Ensure data quality and integrity through rigorous testing and monitoring.
• Leverage cloud platforms (AWS preferred) to build scalable and efficient data solutions.
• Work closely with data analysts, data scientists, and business collaborators to understand data requirements.
• Identify and resolve complex data-related challenges.
• Adhere to data engineering practices and standards.
• Experience developing in an Agile development environment, and comfortable with Agile terminology and ceremonies.
• Familiarity with code versioning using GIT, Jenkins and code migration tools.
• Exposure to Jira or Rally.
• Identifying and implementing opportunities for automation and CI/CD.
• Stay up to date with the latest data technologies and trends.

What we expect of you

• Doctorate degree OR
• Masters degree and 4 to 6 years of Information Systems experience OR
• Bachelors degree and 6 to 8 years of Information Systems experience OR
• Diploma and 10 to 12 years of Information Systems experience
• Demonstrated hands-on experience with cloud platforms (AWS, Azure, GCP) and the ability to architect cost-effective and scalable data solutions.
• Proficiency in Python, PySpark, SQL. Hands on experience with Big-data ETL performance tuning.
• Strong development knowledge in Databricks.
• Strong analytical and problem-solving skills to address sophisticated data challenges

• Experienced with data modeling and performance tuning for both OLAP and OLTP databases
• Experienced working with Apache Spark, Apache Airflow
• Experienced with software engineering best-practices, including but not limited to version control (Git, Subversion, etc.), CI/CD (Jenkins, Maven etc.), automated unit testing, and Dev Ops
• Experience in SQL/NOSQL database, vector database for large language models
• Experience with timely engineering, model fine tuning
• Experience with DevOps/MLOps CICD build and deployment pipeline

• AWS Certified Data Engineer (preferred)
• Databricks Certification (preferred)
• Any SAFe Agile certification (preferred)

• Initiative to explore alternate technology and approaches to solving problems.
• Skilled in breaking down problems, documenting problem statements, and estimating efforts.
• Effective communication and interpersonal skills to collaborate with multi-functional teams.
• Excellent analytical and problem solving skills.
• Strong verbal and written communication skills
• Ability to work effectively with global, virtual teams
• High degree of initiative and self-motivation.
• Ability to manage multiple priorities successfully.
• Team-oriented, with a focus on achieving team goals
• Strong presentation and public speaking skills.