Principal Engineer, Big Data Platform

As a hands-on container and infrastructure engineer, you are responsible for design, implement and support our global hybrid cloud container platform using Kubernetes and Google Cloud Platform, (GCP) Anthos and AWS.

Candidate should have expertise in building virtualization platforms of storage, network, and compute for large scale high availability factory manufacturing type workloads. Proven Experience in setting up continuous integration of source code pipelines using Bitbucket, Jenkins, Terraform, Ansible, etc. , is required. Ability to build continuous deployments using Docker, Artifactory, Spinnaker, etc. , is required with a strong advocate of DevOps principles. Candidate should be passionate about developing and delivering modern software-as-a-service (SaaS) design principles. This position requires partnering with various Western Digital manufacturing, engineering, and IT teams in understanding factory-critical workloads and designing solutions.

Big data platform, BDP team provides self-service data and application platforms to enable machine learning (ML) capabilities to engineering and data science community. The ideal candidate should be passionate about working with various cloud tools to handle various Service Level Agreements (SLA). Candidate should be versatile to experiment with fail-fast approach to adopt to new technologies and natural troubleshooting capabilities. Communication with internal customers, external vendors and co-workers in a clear and professional manner is expected.

Job Responsibilities

• Work in global team to design, implement and operate our global hybrid cloud container platform (Kubernetes)
• Define, develop, and maintain customizations/integrations between various Kubernetes OSS tooling (ingress, helm, operators, observability)
• Perform application deployment of container applications to Kubernetes environments using CI/CD workflow tooling
• Manage AWS cloud infrastructure setup for services such as EC2, S3, EKS, AWS Lambda, API gateway etc
• Document common work tasks to be added to shared knowledge base
• Work closely with other business development teams to help them design and deploy their applications