Data Engineer - AWS, Pyspark, SQL, Python, Big Data

6+ Years of focused experience in building large scale systems.

Developing ETL pipelines involving big data.

Developing data processing\analytics applications primarily using PySpark.

Experience of developing applications on cloud(AWS) mostly using services related to storage, compute, ETL, DWH, Analytics and streaming.

Clear understanding and ability to implement distributed storage, processing and scalable applications.

Experience of working with SQL and NoSQL database.

Ability to write and analyze SQL, HQL and other query languages for NoSQL databases.

Proficiency is writing disitributed & scalable data processing code using PySpark, Python and related libraries. Data Engineer AEP Comptency

Experience of developing applications that consume the services exposed as ReST APIs.