Senior Data Engineer - Big Data Applications

Notice Period : Immediate to 15 Days (Serving NP candidates)

Mandatory skills : Big data applications, Spark, python, scala , AWS S3,Airflow,Data bricks, data platforms, Jenkins, CICD Pipelines

Requirements :

- 6+ years of experience in developing scalable Big Data applications or solutions on distributed platforms.

- 4+ years of experience working with distributed technology tools, including Spark, Python, Scala

- Working knowledge of Data warehousing, Data modelling, Governance and Data Architecture

- Proficient in working on Amazon Web Services (AWS) mainly S3, Managed Airflow, EMR/ EC2, IAM etc.

- Experience working in Agile and Scrum development process.

- 3+ years of experience in Amazon Web Services (AWS) mainly S3, Managed Airflow, EMR/ EC2, IAM etc.

- Experience architecting data product in Streaming, Serverless and Microservices Architecture and platform.

- 3+ years of experience working with Data platforms, including EMR, Airflow, Databricks (Data Engineering & Delta

- Experience with creating/ configuring Jenkins pipeline for smooth CI/CD process for Managed Spark jobs, build Docker images, etc.

- Working knowledge of Reporting & Analytical tools such as Tableau, Quicksite etc.