Senior Data Engineer(SSE)

Roles & Responsibilities

• Design, develop, and maintain Ninja Vans infrastructure for data streaming, processing, and storage.
• Build tools to ensure effective maintenance and monitoring of the data infrastructure.
• Contribute to key architectural decisions for data pipelines and lead the implementation of major initiatives.
• Collaborate with stakeholders to deliver scalable and high-performance solutions for data requirements, including extraction, transformation, and loading (ETL) from diverse data sources.
• Enhance the teams data capabilities by sharing knowledge, enforcing best practices, and promoting data-driven decision-making.
• Develop and enforce Ninja Vans data retention policies and backup strategies, ensuring data is stored redundantly and securely.

Requirements

• At least 5+ years of experience in a similar role, with a proven track record of building scalable and high-performance data infrastructure using Python, PySpark, Spark, and Airflow.
• Solid computer science fundamentals, excellent problem-solving skills, and a strong understanding of distributed computing principles.
• Expert-level SQL knowledge and extensive experience working with both relational and NoSQL databases.
• Advanced knowledge of Apache Kafka, along with demonstrated proficiency in Hadoop v2, HDFS, and MapReduce.
• Hands-on experience with stream-processing systems (e.g., Storm, Spark Streaming), big data querying tools (e.g., Pig, Hive, Spark), and data serialization frameworks (e.g., Protobuf, Thrift, Avro).
• [Good to have] Familiarity with infrastructure-as-code technologies like Terraform, Terragrunt, Ansible, or Helm. Don t worry if you don t have this experience what matters is your interest in learning!
• [Good to have] Experience with Change Data Capture (CDC) technologies such as Maxwell or Debezium.
• Bachelor s or Master s degree in Computer Science or a related field from a top university.

Tech Stack

Backend: Play (Java 8+), Golang, Node.js , Python, FastAPI

Frontend: AngularJS, ReactJS

Mobile: Android, Flutter, React Native

Cache: Hazelcast, Redis

Data storage: MySQL, TiDB, Elasticsearch, Delta Lake

Infrastructure monitoring: Prometheus, Grafana

Orchestrator: Kubernetes

Containerization: Docker, Containerd

Cloud Provider: GCP, AWS

Data pipelines: Apache Kafka, Spark Streaming, Maxwell/Debezium, PySpark, TiCDC

Workflow manager: Apache Airflow

Query engines: Apache Spark, Trino

Submit a job application

By applying to the job, you acknowledge that you have read, understood and agreed to our Privacy Policy Notice (the Notice ) and consent to the collection, use and/or disclosure of your personal data by Ninja Logistics Pte Ltd (the Company ) for the purposes set out in the Notice. In the event that your job application or personal data was received from any third party pursuant to the purposes set out in the Notice, you warrant that such third party has been duly authorised by you to disclose your personal data to us for the purposes set out in the the Notice.