Engineering III Consultant-Data Engineering

We are looking for a Cloud Engineer who has experience in Designing and Developing Data Distribution Solutions on Cloud Platform.

You will be primarily responsible for the following activities but not just limited to these

• Implement End-to-End data pipelines and ETL processes on the GCP platform to ingest, process, and transform large volumes of data from various sources
• Perform Data Engineer tasks to Orchestrate, Design, Develop the reusable workflows in the area of Data Ingestion on GCP
• Perform Proof of Concept by evaluating options for building Data warehouse in GCP Platform
• Design, Build & Operationalize Configurable & Scalable Data Ingestion solutions on GCP Platform
• Implement monitoring, logging and alerting solutions to ensure the reliability, performance, and availability of data pipelines and infrastructure components on GCP.
• Understand the Projects lifecycle, take active role in Production deployments and resolve deployment issues
• Understand Business & Functional requirements and prepare Detailed Technical specifications
• Establish and maintain cross-functional working relationships with other IT groups (including Production Support, Cloud Admin Team etc.) and key business stakeholders

Where you'll be working

In this hybrid role, you'll have a defined work location that includes work from home and assigned office days set by your manager.

We are looking for a Cloud Engineer with Hands-On Experience in implementing Push/Pull Message Queueing (Data Distribution) solutions on Cloud Platform

• Bachelor's degree or four or more years of experience.
• Four or more years of total IT Experience including two or more years of Cloud Platform Experience
• Experience on designing and building Data Pipelines for Batch/Stream process on GCP/Azure/AWS cloud Platform
• Hands-on experience in Big Query, Composer/Air Flow, Cloud Functions, GCS, SQL Programming
• Hands-on Experience in GCP & Python is mandatory
• Experience on driving Data Engineering solutions E2E by guiding team
• Hands-on experience in CI/CD Jenkins, Terraform etc.
• Well versed with Agile Development Methodologies
• Excellent written and spoken communication skills

Even better if you have one or more of the following:

• Experience on GCP Big Query, Data Transfer Services, GCP Data Proc and Data Flow
• Knowledge of CI/CD Implementation on Cloud Platform
• Knowledge of Cloud Orchestration & Workflow scheduler Tools
• Knowledge on Reporting tools like Looker, Qlik etc.
• Certification on data engineering technologies preferably GCP Professional Data Engineer
• Experience in analyzing large amounts of information to discover trends and data
• Experience with Data Quality and Performance Tuning