Data Engineer - Google Cloud Platform (3-4 yrs)

Key Responsibilities :

- Design and implement scalable and efficient data architectures, including data models, databases, and data warehouses, tailored to meet business needs.

- Utilize Google Cloud Platform (GCP) services such as BigQuery, Cloud Storage, Cloud Pub/Sub, Cloud Dataflow, and Cloud Data Prep to build and manage data solutions.

- Build and optimize data pipelines and ETL (Extract, Transform, Load) processes using tools like Apache Beam, Cloud Dataflow, and third-party tools integrated with GCP.

- Design, manage, and optimize data warehouses, with a focus on BigQuery, ensuring data availability, integrity, and performance.

- Write complex SQL queries and optimize them for performance, particularly within BigQuery and other database environments.

- Design and implement streaming data processing solutions to handle real-time data efficiently.

- Implement Infrastructure as Code (IAC) practices for automation and deployment of cloud-based data solutions.

- Work with containerization and orchestration technologies to improve scalability and efficiency in data processing.

- Collaborate with cross-functional teams to understand business requirements and translate them into effective data architecture and solutions.

Qualifications :

- Extensive experience in designing and implementing data architectures, data models, and data warehouses.

- Strong hands-on experience with Google Cloud Platform (GCP), including services like BigQuery, Cloud Storage, Cloud Pub/Sub, Cloud Dataflow, and Cloud Data Prep.

- Proficiency in building and optimizing data pipelines and ETL processes, with tools like Apache Beam, Cloud Dataflow, and third-party integrations.

- Expertise in data warehousing, particularly with BigQuery, and optimizing complex queries for performance.

- Experience in handling streaming data processing and real-time data solutions.

- Familiarity with tools such as Terraform or CloudFormation.

- Experience with containerization (Docker) and orchestration tools (Kubernetes) to enhance data solution deployment and management