Data Engineer

Requirements:

1. Strong hands on experience with big data technologies like Hadoop, preferably in AWS
(Elastic Map Reduce), Athena, Glue, Spark, HDFS, DFS, Zookeeper, Cluster Awareness, EC2,
Labmda

2. Must have the hands on over the Python, Scala, R, Hql.

3. ETL tools such as Airflow, Ooze, Sqoop, KAFKA, Ksql.

4. Strong hands on experience designing data models

5. Proficient database skills in Microsoft SQL Server, Postgres and MySQL, AWS Aurora, RDS

6. Proven ability to debug existing code quickly, and point to areas of optimisation

7. Proven ability monitoring production systems

8. Decent scripting knowledge in any programming language

9. Experience in leading a team.

Good to have:

1. Experience of caching technologies like memcached

2. Knowledge of a NoSQL system: redis or dynamodb etc

3. Knowledge of AWS storage technologies like S3, EMRFS, Aurora,Nitro etc.