Senior Big Data Engineer

The Intel Foundry Manufacturing and Supply chain FMSC Automation team is looking for a highly motivated Big Data Engineer with strong data engineering skills for data integration of various manufacturing data. You will be responsible for engaging with customers and driving development from ideation to deployment and beyond. This position is a technical role that requires the direct design and development of robust, scalable, performant systems for world-class manufacturing data engineering.

Responsibilities include:

Create and maintain optimal data architectureAssemble large, complex data sets that meet functional and non-functional business requirementsIdentify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sourcesWork with stakeholders including the users, cross functional teams to assist with data-related technical issues and support their data infrastructure needs.

Standard process to keep data secure with right access and authorizationFocus on automated testing and robust monitoringThe ideal candidate must exhibit the following behavioral traits:Excellent problem solving and interpersonal communication skillsStrong desire to learn and share knowledge with others.Be inquisitive, innovative, and a team player with a strong focus on quality workmanship.Troubleshooting skills and root cause analysis for performance issuesAbility to lean, adopt and implement new skills to drive innovation and excellence.Ability to work with cross functional teams in dynamic environment

Minimum Qualifications:

• A bachelor's with 4+ years of experience in related field
• Experience building and optimizing big data pipelines
• Experience with skills pf handling unstructured data
• Experience with data transformations, structures, metadata, workload management
• Experience with big data tools: Spark, Kafka, NIFI, etc.
• Experience with at least programming languages: Python, C#, .NET
• Experience with relational SQL and NOSQL DBs
• Experience in leveraging open-source packages
• Experience in cloud native skills such as Docker, Kubernetes, Rancher etc.

Good to have skills:

Experience with semiconductor manufacturingExperience of data engineering on cloudExperience in developing AI/ML Solutions