Junglee Games - Data Engineer III - Spark/Scala/Python (5-9 yrs)

As a DE-III, you will also get to work with Senior Engineers at Junglee Games to evolve the design and architecture of the system.

Responsibilities :

- Hands on Responsible for writing code primarily in Spark, Python, and/or Scala.

- Hands on Responsible for developing streaming applications like Spark structured streaming and

Kafka streams.

- Scale our current data infrastructure to handle millions of events/transactions per day.

- Own data integrity and consistency of our Data lake and Data warehouse.

- Working with AWS-managed services and managing NoSQL stores like Cassandra, ElasticSearch, Redis, MongoDB, ScyllaDB, etc.

- Monitor and improvise the best practices and processes to manage data pipeline and ETL operations.

- Work closely with Senior engineers to design, implement and deploy Data pipelines that impact the

Junglee Games business with an emphasis on the gaming industry.

- Solve complex problems innovatively and deliver quality solutions while taking ownership and accountability for assigned things.

- Demonstrate good learnability and adopt technologies that help build large-scale, performant, reliable, and sustainable systems.

- The ideal candidate will be a leader, a quick learner, and be able to work independently.

- Collaborating with peers on all elements of the development process as per industry coding standards and creating appropriate technical documentation.

Requirements :

- A solid engineer at heart with strong abstraction, coding, and distributed system development experience of 5+ years.

- Excellent programming skills in Python/Scala and expertise in multi-threading and object-oriented programming.

- In-depth knowledge of Spark, Kafka, Streaming Systems, AWS, and Cloud Data Warehouse like Trino/Snowflake and Docker/Kubernetes.

- A proven track record of leading a team and development in a startup/e-commerce ecosystem within a high-growth and matrix environment.

- Empathetic, motivated, and a good team player.

- Excellent listener and interpreter.

Special consideration :

- Knowledge in Big Data, Amazon Web Services(AWS), and Apache Spark.

- Knowledge of Cloud Data warehouses such as Redshift, Snowflake, and Trino.

- Knowledge of streaming applications such as Spark Streaming, and Kafka.

- Knowledge of writing complex SQL procedures.