Data Engineer - GCP BigQuery - Gurugram

Data Pipeline Development: **

- Design & guiding developers in develop and maintain data processing pipelines using PySpark.

- Collaborate with data engineers and analysts to integrate data from various sources.

- Implement data transformations, aggregations, and enrichment processes.

- **Performance Optimization: **

- Guiding in optimize Spark jobs for performance and scalability.

- Monitor and troubleshoot performance issues in Spark applications.

- Implement best practices for efficient Spark code and resource utilization.

**Data Model Design & Development:

I. 5 years of experience with cloud platforms (Google Cloud) and their data services are desirable.

II. - Proficiency in Python and PySpark.

III. - Experience with Hadoop ecosystem (HDFS, Hive, HBase) is a plus.

IV.

V. - **Technical Skills:**

VI. - Strong understanding of distributed computing principles.

VII. - Experience with data modeling, ETL processes, and data warehousing Google BigQuery

VIII. - Knowledge of SQL and NoSQL databases.

IX. - Familiarity with version control systems (e.g., Git).

X.

XI. - **Soft Skills:**

XII. - Excellent problem-solving and analytical skills.

XIII. - Strong communication and interpersonal skills.

XIV. - Ability to work effectively in a team-oriented environment.

Self-motivated with a proactive attitude towards learning and development