Senior Data Engineer - Java/Scala/Python (6-9 yrs)

Job Description :

As Big Data Engineer, you will develop, maintain, evaluate and test big data solutions.

Responsibilities :

- You will be involved in the design of data solutions using Hadoop based technologies along with Hadoop, AWS.

- Responsibilities includes design and implementation of various Big Data platform components like (Batch Processing, Live Stream Processing, In- Memory Cache, Query Layer (SQL), Rule Engine and Action Framework ).

- Design and Implemented Data Access Layer, which can connect to various data sources and uses advanced caching techniques to provide fast responses to real time SQL queries using Big Data Technologies.

- Implement scalable solutions to meet the ever-increasing data volumes, using big data/cloud technologies; spark, Kafka, any Cloud computing etc.

Requirements :

- 6+ years of Data engineering experience.

- Good hands-on knowledge on one of the programming language java/scala/python.

- Data Store : Good understanding of SQL & NoSQL Data bases. Mysql, Mongo.

- Data Infrastructure : Familiar with cloud solutions for data infrastructure. AWS Preferably.

- Data handling frameworks : Good hands on one of the data handling frameworks - Spark, Apache Beam, Apache flink etc

- Proficient with distributed file system and computations concepts.