Tech Mahindra - DevOps Architect - Google Cloud Platform (10-15 yrs)

Job Overview :

We are seeking a skilled Senior Cloud Infrastructure Engineer to automate infrastructure creation on Google Cloud Platform (GCP) using Terraform. The candidate will be responsible for provisioning and setting up GCP projects and environments for the entire GCP data engineering stack, including services such as Big Query, Data Flow, Pub/Sub, and GCP DataStream. The role also requires expertise in configuring pipelines using Azure DevOps to automate and manage the infrastructure provisioning process.

Key Responsibilities :

- Automate GCP Infrastructure : Design and implement Terraform scripts to provision and automate GCP projects, environments, and data engineering services.

- Set Up Infrastructure for GCP DataStream : Configure and deploy the infrastructure for GCP DataStream to support real-time data replication and Change Data Capture (CDC) from on-prem databases like Oracle and -DB2- to BigQuery

- Provision and Manage the GCP Data Engineering Stack : Set up and optimize infrastructure for BigQuery, Dataflow, Pub/Sub, Cloud Storage, and other data engineering tools on GCP.

- Automate Infrastructure Pipelines with Azure DevOps : Design, develop, and maintain CI/CD pipelines using Azure DevOps to automate the deployment of Terraform scripts and manage infrastructure changes.

- Optimize Cloud Infrastructure : Ensure high availability, scalability, and security for cloud resources and data pipelines.

- Security and Compliance : Implement best practices for security and compliance across GCP environments, including IAM policies, encryption, and network security.

- Collaboration : Work closely with data engineers and DevOps teams to align infrastructure with data pipelines and operational requirements.

Required Skills and Experience :

- 5+ years of experience in GCP infrastructure automation using Terraform to provision cloud resources and environments.

- Experience with GCP DataStream : Proven ability to set up and configure GCP DataStream for real-time data replication and CDC from on-prem databases (Oracle, DB2) to BigQuery.

- Strong expertise in GCP data engineering services : Hands-on experience with BigQuery, Dataflow-, Pub/Sub, Cloud Storage, and related GCP services.

- Infrastructure Automation : Proficiency in creating reusable Terraform modules and automating cloud infrastructure using Terraform.

- Experience with Azure DevOps : Expertise in configuring and maintaining CI/CD pipelines for infrastructure provisioning using Azure DevOps.

- Networking and Security : Strong understanding of GCP networking, IAM, VPCs, firewall configurations, and security best practices.

- Familiarity with on-prem databases such as Oracle and DB2.

- Scripting and Automation : Proficiency in scripting (e.g., Bash, Python) for cloud automation and troubleshooting.