Lead Data Engineer

The Data Engineer is responsible for designing, developing, and maintaining the infrastructure and systems required for data storage, processing, and analysis. They play a crucial role in building and managing the data pipelines that enable efficient and reliable data integration, transformation, and delivery for all data users across the enterprise. Core Responsibilities. Design and implement processes for the ETL process from various sources into the organizations data systems.

Build data pipelines that enable efficient and reliable data integration, transformation, and delivery for all data users across the enterprise. Ensure timely releases of data pipelines and data products into production. Collaborate with and review the work of contracting data engineers and dataops engineers to successfully accomplish the goals of the project. Work with Agile and DevOps techniques and implementation approaches in the delivery.

Actively participate in all ongoing initiatives related to the data and analytics ecosystem, including capital projects, operational projects, and proof of concept work. Contribute to Ingredion internal groups and forums. Requirements. Bachelors Degree related field.

Experience in all aspects of data engineering especially building pipelines and populating data stores. Must have experience with databases like Oracle, SQL Server, etc and Big Data/Cloud platforms like Microsoft Azure, Google Big Query/ Google cloud platform (GCP), Databricks. Hands-on experience with ETL and coding for unstructured, semi-structured, and structured data. Must have experience with REST API development.

Experience with Kafka, Event Hubs, Python, and Spark is preferred. Ability to work independently and as part of a team to successfully execute projects. Ability to multitask and meet aggressive deadlines efficiently and effectively. Excellent communication and collaboration skills, experience working in collaborative environment.

Proven success in contributing to a multi-location team-oriented environment. Certification in Data engineering or related fields is a plus. Relocation Available:. No. •