Senior Data Engineer

Mandatory Skills: 10-15 yrs of overall experience; Spark, Delta, Scala in recent projects

Key Responsibilities:
- Collaborate with engineering, manufacturing, and quality teams to identify and solve problems using data.
- Define required data for solutions and collaborate with connectivity engineers and users for data collection.
- Create and maintain efficient data pipeline architecture.
- Assemble large, complex datasets to meet business requirements.
- Implement process improvements, automate manual tasks, and optimize data delivery.
- Assist in data preparation and analysis to understand process/machine behavior.
- Deploy and monitor solutions.
- Collaborate with data and analytics experts for system enhancement.
- Work with Data Architects and modeling teams.

Skills/Competencies:
- 10-15 years of experience in Data Engineering
- Ability to apply cross-industry knowledge to improve manufacturing processes.
- Strong problem-solving skills and analytical abilities.
- Experience with big data tools (e.g., Spark, Delta, Kafka) and databases (e.g., Oracle, Hive).
- Proficiency in object-oriented languages (e.g., Scala, Java, C++).
- Familiarity with data visualization tools (e.g., PowerBI, Tableau).
- Solid data engineering skills, including data analysis and transformation.
- Ability to optimize data systems for performance and reliability.