Data Engineer - Google Cloud Platform (4-5 yrs)

Position : Data Engineer

Location : Mumbai-Andheri

Key Responsibilities :

Design and Develop Data Pipelines : Architect, build, and optimize ETL/ELT pipelines for data ingestion, processing, and storage using GCP tools such as BigQuery, Dataflow, and Pub/Sub.

Data Architecture : Design comprehensive data architecture strategies that align with business needs, ensuring compliance with data governance and security policies.

Collaboration : Work closely with business stakeholders to understand their data requirements and translate them into technical solutions within the Google ecosystem.

Data Modeling : Develop and document data models, data flow diagrams, and architecture guidelines to support data initiatives.

Performance Optimization : Monitor and enhance the performance of existing data processing systems, implementing best practices for reliability, scalability, and cost management.

Technology Evaluation : Assess new data technologies and tools to improve the existing architecture and recommend changes as necessary.

Automation : Automate manual processes to enhance efficiency in data delivery and management.

Required Qualifications :

Experience :

- 4-5 years of experience in data engineering or related roles with a focus on GCP technologies.

Technical Skills :

- Proficiency in GCP services such as BigQuery, Dataflow, Dataproc, Cloud Storage, and Pub/Sub.

- Strong knowledge of SQL and experience with programming languages such as Python or Java.

- Familiarity with infrastructure as code (IaC) tools like Terraform or Cloud Deployment Manager.

- Experience in designing and implementing real-time streaming data solutions.