Senior Data Engineer - Google Cloud Platform (3-5 yrs)

Responsibilities :

- Design, develop, and maintain data pipelines and ETL processes on GCP.

- Utilize GCP services such as BigQuery, Pub/Sub, Dataflow, Composer (DAGs), and Airflow.

- Write complex SQL queries to transform and analyze data.

- Perform data modeling and mapping.

- Utilize Google Cloud SDK and API scripting.

- Develop and maintain Python scripts for data processing and automation.

- Collaborate with cross-functional teams to understand data requirements and deliver solutions.

- Implement data quality checks and monitoring.

- Follow Agile processes and DevOps methodologies.

(Good to have)

Qualifications :

- Extensive experience (specify desired years of experience, e.g, 5+ years, 7+ years) as a Data Engineer, with a strong focus on GCP.

- 3+ years of hands-on experience with Google BigQuery, Pub/Sub, Dataflow, Composer DAGs, and Airflow.

- Strong SQL skills, with the ability to translate complex scenarios into efficient queries.

- Experience with data modeling and mapping.

- Proficiency in using Google Cloud SDK and API scripting.

- Strong programming skills in Python.

Must-Have Skills :

- GCP (Google Cloud Platform)

- BigQuery

- Pub/Sub

- Dataflow

- Composer (DAGs)

- Airflow

- SQL

- Data Modeling

- Google Cloud SDK

- Python

Good-to-Have Skills :

- Agile

- DevOps

Bonus Points :

- Experience with other cloud platforms (AWS, Azure).

- Experience with data visualization tools.

- Experience with machine learning and AI