Zoomcar - Data Engineer - Big Data (8-12 yrs)

Responsibilities :

- Engage with stakeholders to gather requirements to deliver data solutions. Implement best practices around the data platform to automate the ingestion, transformation, and augmentation of data sources, and provide best practices for pipeline operations.

- Innovate at the optimal storage guidelines around transactional, clickstream, and IoT data.

- Manage a team of high-performance 3-5 data engineers. Perform regular performance evaluations and share and seek feedback.

- Create and maintain clear documentation on data models/schemas as well as infra-level processes.

- Help troubleshoot and remediate data quality issues raised by pipeline alerts or downstream consumers.

Requirements :

- 8+ years of hands-on experience in building Data platforms across different cloud stacks (AWS, GCP).

- Hands-on experience in building a data warehouse that involves dimension modeling and SQL-based (expert-level) data transformation and analytics.

- Hands-on experience in Big Data space - that involves designing, developing, testing, and implementing data solutions using Apache Airflow, Kafka, Flink, Spark, Rudderstack, Tableau, and other Big Data ecosystem tools.

- Expert in database technologies. OLTP, OLAP, and MPP are alike.

- Expert-level exposure to GCP cloud with services like BigQuery, Data Catalog, DataProc, Looker, Vertex-AI

- Proven proficiency in programming languages like Java/Python.

- Strong engineering mindset to build resiliency/restartability in all the Data Platform components.

- Ability to thrive in a fast-paced start-up environment, and to manage multiple, competing priorities simultaneously.