Data Engineer

Job Overview:

Designing, building and operationalizing large-scale enterprise data solutions and applications using one or more of Google Cloud Platform data and analytics services in combination with technologies like Spark, Cloud Dataflow, Apache Beam, Cloud BigQuery, Cloud PubSub, Cloud Functions and Airflow.

Responsibilities:

• Designing and implementing data ingestion and curation functions on GCP cloud using GCP native or custom programming.
• Designing and building production data pipelines from ingestion to consumption within a hybrid big data architecture, using Python, Java etc.
• Optimizing data pipelines for performance and cost for large scale data lakes.

Desired Qualifications:

• Bachelor's degree preferred or equivalent work experience.
• 5+ years of engineering experience in Big Data systems, Data Analytics and Data Integration related fields.
• 3+ years of experience writing complex SQL queries, stored procedures, etc.
• 1+ years of hands-on GCP experience in Data Engineering and Cloud Analytics solutions
• Hands-on experience with Data Ingestion technologies like GCP DataFlow, Kafka and AirFlow.
• Experience in designing and optimizing data models on GCP cloud using GCP data stores such as BigQuery.
• Agile development skills and experience.
• Experience with CI/CD pipelines such as Concourse, Jenkins
• Knowledge to Terraform is a plus.
• Google Cloud Platform certification is a plus.