Big Data Developer - Google Cloud Platform (5-10 yrs)

Job Description :

We are seeking a Big Data Developer with expertise in Google Cloud Platform (GCP) and BigQuery to join our team. The ideal candidate should have hands-on experience in building, optimizing, and maintaining large-scale data pipelines and analytics solutions.

Key Responsibilities :

- Design, develop, and optimize scalable ETL/ELT pipelines using BigQuery and other GCP data services.

- Work with Cloud Dataflow, Pub/Sub, and DataProc to process and transform large datasets.

- Implement data modeling, partitioning, and clustering strategies in BigQuery for efficient querying.

- Monitor and enhance data quality, governance, and security within the GCP ecosystem.

- Collaborate with data scientists, analysts, and engineering teams to deliver insights from structured and unstructured data.

- Troubleshoot performance issues and optimize query performance in BigQuery.

- Automate data workflows using Cloud Composer (Apache Airflow) or other orchestration tools.

Required Skills & Qualifications :

- 5+ years of experience in Big Data Development with a focus on Google Cloud (GCP).

- Strong proficiency in BigQuery, SQL, and Python for data processing and analytics.

- Experience with ETL tools, DataFlow, and DataProc for batch and streaming data pipelines.

- Hands-on experience in Cloud Storage, Pub/Sub, and IAM policies on GCP.

- Knowledge of Terraform or Infrastructure as Code (IaC) is a plus.

- Experience with Airflow (Cloud Composer) for workflow automation.

- Understanding of CI/CD, DevOps practices, and data security standards.

- Strong problem-solving skills and ability to work in an agile environment.

Preferred Qualifications :

- Experience with Machine Learning or AI-based data solutions on GCP.

- Familiarity with data visualisation tools (Looker, Data Studio, etc.).

- GCP certifications like Professional Data Engineer or Cloud Architect are a plus.