GCP Developer with Data integration Experience

GCP Developer with Data integration Experience

Mandatory- Pyspark,SQL,GCP/Big query,Big data/Hadoop

Data Engineer with extensive experience in building data integration pipelines in CI/CD model

Experience: 5+ years of relevant experience

Ability to design and develop a high performance data pipeline framework from scratch

Data ingestion across systems

Data quality and curation

Data transformation and efficient data storage

Data reconciliation, monitoring and controls

Support reporting model and other downstream application needs

Skill in technical design documentation, data modeling and performance tuning applications

Skill in the following platform, tools and technologies

GCP cloud platform GCS, Big Query, Streaming (pub/sub), data proc and data flow

Python, PYSpark, Kafka, SQL, shell scripting & Stored procs

Data warehouse, distributed data platforms and data lake

Database definition, schema design, Looker Views, Models

CI/CD pipeline

Proven track record in scripting code in Python, PySpark and SQL

Excellent structured thinking skills, with the ability to break down multi-dimensional problems

Ability to navigate ambiguity and work in a fast-moving environment with multiple stakeholders

Good communication skills and ability to coordinate and work with cross functional teams.