Staff Software Engineer (Data Analytics Platform)

Roles & Responsibilities

• Design and develop a sophisticated data infrastructure for streaming, processing, and storage, aligned with a modern Lakehouse architecture.
• Build and maintain tools for effective data monitoring and management using best practices in data engineering.
• Lead key architectural decisions and implement significant data pipeline initiatives using the latest technologies.
• Collaborate with various stakeholders to deliver scalable and performant data solutions, supporting all aspects of data handling from extraction to loading.
• Promote knowledge sharing within the team, encouraging best practices for a data-driven culture.
• Ensure robust data governance and compliance with developed data retention, backup strategies, and secure storage solutions.
• Leading a team of 4-5 data engineers

Required Qualifications

• Bachelor s or Master s degree in Computer Science or related field from a top university.
• Over 8 years of experience in data infrastructure, with a proven track record in building scalable and high-performance data systems.
• Deep expertise in SQL and extensive experience with relational and NoSQL databases.
• Advanced proficiency in Apache Kafka, Hadoop ecosystem, and stream-processing systems like Spark Streaming.
• Familiarity with big data tools (Pig, Hive, Spark), data serialization frameworks (Protobuf, Thrift, Avro), and workflow management using Apache Airflow.
• Knowledge of data catalog tools such as Open Metadata and Unity Catalog is highly desirable.
• Experience with infrastructure as code (e.g., Terraform, Ansible) and CDC technologies (e.g., Maxwell, Debezium) is advantageous.

Tech Stack

Backend: Play (Java 8+), Golang, Node.js , Python, FastAPI

Frontend: AngularJS, ReactJS

Mobile: Android, Flutter, React Native

Cache: Hazelcast, Redis

Data storage: MySQL, TiDB, Elasticsearch, Delta Lake

Infrastructure monitoring: Prometheus, Grafana

Orchestrator: Kubernetes

Containerization: Docker, Containerd

Cloud Provider: GCP, AWS

Data pipelines: Apache Kafka, Spark Streaming, Maxwell/Debezium, PySpark, TiCDC

Workflow manager: Apache Airflow

Query engines: Apache Spark, Trino

Submit a job application

By applying to the job, you acknowledge that you have read, understood and agreed to our Privacy Policy Notice (the Notice ) and consent to the collection, use and/or disclosure of your personal data by Ninja Logistics Pte Ltd (the Company ) for the purposes set out in the Notice. In the event that your job application or personal data was received from any third party pursuant to the purposes set out in the Notice, you warrant that such third party has been duly authorised by you to disclose your personal data to us for the purposes set out in the the Notice.