Data Platform Engineer

Project Role :Data Platform Engineer


Project Role Description :Assists with the data platform blueprint and design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models.

Must have skills :Google Cloud Platform Architecture


Good to have skills :Data Engineering, Confluent Event Streaming Platform, Google Cloud Data Services
Minimum

3 year(s) of experience is required


Educational Qualification :Total 15 years of full time education

Summary:As a Data Platform Engineer, you will be responsible for assisting with the blueprint and design of the data platform components. Your typical day will involve collaborating with Integration Architects and Data Architects to ensure cohesive integration between systems and data models using Google Cloud Platform Architecture.
Roles & Responsibilities:

Develop and maintain data pipelines and data processing systems using Google Cloud Data Services and Confluent Event Streaming Platform.

Developing ETL (or ELT) processes to move and transform data between different systems and storage solutions

Working with big data technologies such as Apache Hadoop, Apache Spark, Google Cloud Dataproc for processing and analyzing large datasets

Utilizing GCP services like BigQuery, Cloud Storage, Cloud Dataprep, and Cloud Dataflow for data storage, processing, and analytics

Implementing real-time data processing solutions using GCP services like Kafka, Cloud Pub/Sub and Cloud Dataflow for stream processing.

Managing and optimizing databases on GCP, including services like Cloud SQL, Cloud Spanner, and Cloud Bigtable

Implement CICD to deploy data services using IaC
Professional & Technical Skills:

Must To Have Skills:Proficiency in Google Cloud Platform Architecture.

Good To Have Skills:Experience with Google Cloud Data Services, Confluent Event Streaming Platform, and Data Engineering.

Experience with Google Cloud Services such as Streaming + Batch, Cloud Storage, Cloud Dataflow, Data Proc , Pub/Sub, Cloud Function, Big Query & Big Table

Experience with data pipeline development and data processing systems using Google Cloud Data Services and Kafka.

Proven ability in one or more of the following programming or scripting languages- Python, JavaScript, Java, R, UNIX Shell, php, ruby

Experience in writing CI/CD, IaC (Terraform, Cloud Deployment Manager, Cloud SDK)

Understanding of data modeling, data warehousing, and data integration concepts.

Knowledge of data security and privacy measures, including data encryption, access control, and data masking techniques.
Additional Information:

The candidate should have a minimum of 4 years of total IT experience

The candidate should have a minimum of 2 years of experience in Google Cloud Platform Architecture.

The ideal candidate will possess a strong educational background in computer science, data engineering, or a related field, along with a proven track record of delivering impactful data-driven solutions.

Active Google Cloud Data Engineer Certification or Active Google Professional Cloud Architect Certification

Qualifications
Total 15 years of full time education