GCP Data Engineer (5-7 yrs)

GCP DATA ENGINEER

CTC : 18LPA

No of years of Experience : 5+

Work Location : Pune, Bengaluru, Chennai, New Mumbai, Noida

Mode : Hybrid (3days a week)

Key Responsibilities :

- Design, develop, and maintain scalable data pipelines and ETL processes to support various business needs.

- Build and manage data workflows using the Databricks, GCP stack, including BigQuery, Cloud Dataflow, Cloud Storage, Pub/Sub, Cloud Composer, and other GCP services.

- Implement data models and transformations using DBT (Data Build Tool) to support analytical requirements.

- Collaborate with data analysts and scientists to understand and translate data needs into technical specifications.

- Ensure data quality, integrity, and governance by implementing monitoring and alerting mechanisms, along with automated data validation processes.

- Optimize and troubleshoot complex SQL queries and ETLjobs for performance and reliability.

- Develop and maintain comprehensive documentation for data pipelines, ETL processes, and data models.

- Stay up-to-date with the latest trends and technologies in data engineering, cloud computing, and analytics

Key Skills :

- Extensive experience with the GCP stack, including BigQuery, Cloud Dataflow, Cloud Storage, Pub/Sub, Cloud Composer, and other GCP services.

- Proficiency in using DBT (Data Build Tool) for data transformation and modeling.

- Strong SQL skills, with the ability to write complex queries and optimize them for performance.

- Experience with data integration tools and frameworks (e.g., Apache Airflow, QIik, GCP)

- Experience working with real-time data streaming and processing (e.g., Apache Kafka, Pub/Sub).

- Certification in GCP (e.g., Google Professional Data Engineer) is a plus.

- Experience in Agile/Scrum methodologies