Senior Data Engineer

Ninja Van is a late-stage logtech startup that is disrupting a massive industry with innovation and cutting edge technology. Launched 2014 in Singapore, we have grown rapidly to become one of Southeast Asia's largest and fastest-growing express logistics companies. Since our inception, weve delivered to 100 million different customers across the region with added predictability, flexibility and convenience. Join us in our mission to connect shippers and shoppers across Southeast Asia to a world of new possibilities

More About Us. We process 250 million API requests and 3TB of data every day

We deliver more than 2 million parcels every day

100% network coverage with 2600+ hubs and stations in 6 SEA markets (Singapore, Malaysia, Indonesia, Thailand, Vietnam and Philippines), reaching 500 million consumers

2 Million active shippers in all e-commerce segments, from the largest marketplaces to the individual social commerce sellers

Raised more than US$500 million over five rounds

We are looking for world-class talent to join our crack team of engineers, product managers and designers. We want people who are passionate about creating software that makes a difference to the world. We like people who are brimming with ideas and who take initiative rather than wait to be told what to do. We prize team-first mentality, personal responsibility and tenacity to solve hard problems and meet deadlines. As part of a small and lean team, you will have a very direct impact on the success of the company

Roles & Responsibilities. Design, develop and maintain Ninja Vans infrastructure for streaming, processing and storage of data

Build tools for effective maintenance and monitoring of the data infrastructure

Contribute to key data pipeline architecture decisions and lead the implementation of major initiatives

Work closely with stakeholders to develop scalable and performant solutions for their data requirements, including extraction, transformation and loading of data from a range of data sources

Develop the teams data capabilities share knowledge, enforce best practices and encourage data-driven decisions

Develop Ninja Vans data retention policies, backup strategies and ensure that the firms data is stored redundantly and securely

Requirements. Bachelors or Masters degree in Computer Science or related field from a top university

Solid Computer Science fundamentals, excellent problem-solving skills and a strong understanding of distributed computing principles

At least 6 years of experience in a similar role, with a proven track record of building scalable and performant data infrastructure

Expert SQL knowledge and deep experience working with relational and NoSQL databases

Advanced knowledge of Apache Kafka and demonstrated proficiency in Hadoop v2, HDFS, and MapReduce

Experience with stream-processing systems (e.g. Storm, Spark Streaming), big data querying tools (e.g. Pig, Hive, Spark) and data serialization frameworks (e.g. Protobuf, Thrift, Avro)

[Good to have] Experience with infrastructure as code technologies like (Terraform, Terragrunt, Ansible, Helm). Dont sweat it if you dont have it, as long as it interests you!. [Good to have] CDC technologies like Maxwell or Debezium

Tech Stack. Backend: Play (Java 8+), Golang, Node.js , Python, FastAPI. Frontend: AngularJS, ReactJS. Mobile: Android, Flutter, React Native. Cache: Hazelcast, Redis. Data storage: MySQL, TiDB, Elasticsearch, Delta Lake. Infrastructure monitoring: Prometheus, Grafana. Orchestrator: Kubernetes. Containerization: Docker, Containerd. Cloud Provider: GCP, AWS. Data pipelines: Apache Kafka, Spark Streaming, Maxwell/Debezium, PySpark, TiCDC. Workflow manager: Apache Airflow. Query engines: Apache Spark, Trino. Submit a job application. By applying to the job, you acknowledge that you have read, understood and agreed to our Privacy Policy Notice (the Notice) and consent to the collection, use and/or disclosure of your personal data by Ninja Logistics Pte Ltd (the Company) for the purposes set out in the Notice. In the event that your job application or personal data was received from any third party pursuant to the purposes set out in the Notice, you warrant that such third party has been duly authorised by you to disclose your personal data to us for the purposes set out in the the Notice

Show more Show less