GCP Devops

We are seeking a skilled Senior Cloud Infrastructure Engineer to automate infrastructure creation on Google Cloud Platform (GCP) using Terraform . The candidate will be responsible for provisioning and setting up GCP projects and environments for the entire GCP data engineering stack, including services such as Big Query, Data Flow, Pub/Sub, and GCP DataStream . The role also requires expertise in configuring pipelines using Azure DevOps to automate and manage the infrastructure provisioning process.

Key Responsibilities:

• Automate GCP Infrastructure: Design and implement Terraform scripts to provision and automate GCP projects, environments, and data engineering services.
• -Set Up Infrastructure for GCP DataStream: Configure and deploy the infrastructure for GCP DataStream to support real-time data replication and Change Data Capture (CDC) from on-prem databases like Oracle and *DB2to BigQuery*.
• -Provision and Manage the GCP Data Engineering Stack: Set up and optimize infrastructure for *BigQuery, *Dataflow*, Pub/Sub, Cloud Storage, and other data engineering tools on GCP.
• Automate Infrastructure Pipelines with Azure DevOps*: Design, develop, and maintain CI/CD pipelines using Azure DevOps to automate the deployment of Terraform scripts and manage infrastructure changes.
• -Optimize Cloud Infrastructure*: Ensure high availability, scalability, and security for cloud resources and data pipelines.
• Security and Compliance*: Implement best practices for security and compliance across GCP environments, including IAM policies, encryption, and network security.
• Collaboration: Work closely with data engineers and DevOps teams to align infrastructure with data pipelines and operational requirements.

Required Skills and Experience:

• -*5+ years of experience in GCP infrastructure automation using Terraform to provision cloud resources and environments.
• Experience with GCP DataStream*: Proven ability to set up and configure GCP DataStream for real-time data replication and CDC from on-prem databases (Oracle, DB2) to BigQuery.
• Strong expertise in GCP data engineering services: Hands-on experience with BigQuery, Dataflow*, Pub/Sub, Cloud Storage, and related GCP services.
• Infrastructure Automation: Proficiency in creating reusable Terraform modules and automating cloud infrastructure using Terraform.
• Experience with Azure DevOps: Expertise in configuring and maintaining CI/CD pipelines for infrastructure provisioning using Azure DevOps*.
• Networking and Security*: Strong understanding of GCP networking, IAM, VPCs, firewall configurations, and security best practices.
• Familiarity with on-prem databases such as Oracle and *DB2*.
• Scripting and Automation*: Proficiency in scripting (e.g., Bash, Python) for cloud automation and troubleshooting.

Devops, Kubernates, Scripting (Python Bash Or Shell), Gcp, Datastream, Terraform, Dataflow, Bigquery