Data Engineer: Data Platforms-Google

A career in IBM Consulting is rooted by long-term relationships and close collaboration with clients across the globe.
You'll work with visionaries across multiple industries to improve the hybrid cloud and Al journey for the most innovative and valuable companies in the world. Your ability to accelerate impact and make meaningful change for your clients is enabled by our strategic partner ecosystem and our robust technology platforms across the IBM portfolio; including Software and Red Hat.
Curiosity and a constant quest for knowledge serve as the foundation to success in IBM Consulting. In your role, you'll be encouraged to challenge the norm, investigate ideas outside of your role, and come up with creative solutions resulting in ground breaking impact for a wide network of clients. Our culture of evolution and empathy centers on long-term career growth and development opportunities in an environment that embraces your unique skills and experience.

Your Role and Responsibilities

• Skilled Multiple GCP services - GCS, BigQuery, Cloud SQL, Dataflow, Pub/Sub, Cloud Run, Workflow, Composer, Error reporting, Log explorer etc.
• Must have Python and SQL work experience & Proactive, collaborative and ability to respond to critical situation
• Ability to analyse data for functional business requirements & front face customer

Required Technical and Professional Expertise

• End to End functional knowledge of the data pipeline/transformation implementation that the candidate has done, should understand the purpose/KPIs for which data transformation was done.
• Expert in SQL- can do data analysis and investigation using Sql queries
• .Implementation Knowledge Advance Sql functions like- Regular Expressions, Aggregation, Pivoting, Ranking, Deduplication etc.
• BigQuery and BigQuery Transformation (using Stored Procedures)
• Data modelling concepts- Star & Snowflake schemas, Fact & Dimension table, Joins, Cardinality etc
• GCP Services related to data pipelines like- Workflow, Cloud Composer, Cloud Schedular, Cloud Storage.

Preferred Technical and Professional Expertise

• Understanding of CI/CD & related tools- Git & Terraform
• Other GCP Services like- Dataflow, Cloud Build, Pub/Sub, Cloud Functions, Cloud Run, Cloud Workstation etc
• BigQuery Performance tuning
• Spark development exp, Python based API development exp