Big Data Developer - Google Cloud Platform (6-12 yrs)

Job Summary :

We are seeking a talented and motivated Big Data Hadoop/GCP Specialist to join our dynamic team. In this role, you will be responsible for designing, implementing, and managing large-scale data processing systems using Hadoop and Google Cloud Platform (GCP). You will work closely with cross-functional teams to derive actionable insights from vast amounts of data.

Key Responsibilities :

- Develop, maintain, and optimize scalable data pipelines using Hadoop and GCP tools.

- Design and implement data models, data flows, and ETL processes using Hive and Spark.

- Write and optimize SQL queries for efficient data retrieval and processing.

- Utilize Python for data manipulation, analysis, and automation of data workflows.

- Collaborate with data engineers, analysts, and stakeholders to understand data requirements and deliver solutions.

- Monitor and troubleshoot data processing issues, ensuring high availability and performance of data systems.

- Stay updated on industry trends and technologies to continuously improve data processes and solutions.

Skills Required :

- Big Data Technologies : Proficiency in Hadoop ecosystem components (HDFS, MapReduce, etc.).

- Data Processing Frameworks : Experience with Hive and Spark for big data processing and analysis.

- Programming : Strong skills in Python for data manipulation and automation.

- SQL : Expertise in writing and optimizing SQL queries for data retrieval.

- Cloud Platforms : Hands-on experience with Google Cloud Platform (GCP) services, particularly related to big data (e.g., BigQuery, Dataflow, Pub/Sub).

- Analytical Skills : Ability to analyze complex datasets and derive meaningful insights.

- Collaboration : Strong communication skills to work effectively with cross-functional teams