Data Engineer - Google Cloud Platform (3-8 yrs)

Data Engineer (Google Cloud Platform - GCP)

Job Overview :

We are seeking a skilled Data Engineer with expertise in Google Cloud Platform (GCP) to design, build, and maintain scalable data pipelines and infrastructure. The ideal candidate will have hands-on experience with GCP services such as BigQuery, Dataflow, Pub/Sub, Cloud Composer, Cloud Storage, and Dataproc, and strong programming skills in Python, SQL, or Java.

Key Responsibilities :

- Design, develop, and maintain scalable data pipelines and ETL processes using GCP services.

- Build and optimize data warehouse solutions using BigQuery.

- Develop real-time and batch data processing workflows using Apache Beam, Dataflow, and Pub/Sub.

- Automate workflows and orchestrate pipelines with Cloud Composer (Apache Airflow).

- Work with structured and unstructured data to support business analytics and machine learning initiatives.

- Implement data governance, security, and compliance best practices.

- Collaborate with data analysts, data scientists, and business stakeholders to define data requirements.

- Monitor and optimize data processing performance, scalability, and cost efficiency.

- Develop CI/CD pipelines for data engineering solutions using Terraform, Cloud Build, or similar tools.

Required Skills & Qualifications :

- 3+ years of experience in data engineering.

- Hands-on experience with Google Cloud Platform (GCP) services, including BigQuery, Dataflow, Pub/Sub, Cloud Storage, and Cloud Composer.

- Strong programming skills in Python, SQL, or Java.

- Expertise in ETL development, data modeling, and data warehousing.

- Experience with Apache Beam, Apache Airflow, or Spark.

- Proficiency in writing complex SQL queries and optimizing database performance.

- Familiarity with Terraform, Kubernetes, or Docker is a plus.

- Understanding of data security, compliance, and governance best practices.

- Experience with streaming data architectures is a plus.

- Strong problem-solving and communication skills.

Preferred Qualifications :

- Google Cloud Professional Data Engineer certification is a plus.

- Experience in machine learning pipelines and MLOps.

- Knowledge of NoSQL databases (Firestore, Bigtable, or MongoDB).

- Experience with BI tools like Looker, Tableau, or Power BI.