Lead AWS Data Engineer

Job description Responsibilities

● 5+ years of experience in handling data and designing ETL pipeline with mandatory 4+years experience in writing Pyspark Code.
● Must have worked on AWS using services like- S3, GLUE, RedShift, Lambda,IAM, DynamoDB etc.
● Must have played a key role in capturing data requirements from Product owner/ Business users.
● Good to have exposure to Data Modeling, Data Analytics and design in both batch processing and real time streaming.
● Solid understanding of Data mapping, data processing patterns, distributed computing and in
building applications for real-time and batch analytics.
● Strong programming skills in design and implementation using Python and PySpark.
● Good exposure in database architecture with Redshift .
● Experience with multiple file formats like Avro, Parquet, ORC, and JSON etc.
● Developing, constructing, testing and maintaining architectures for data lakes, data pipelines,
data warehouses and large-scale data processing systems on AWS.

Qualifications Required

• B.E/B.Tech, preferably in Computer Science or Engineering plus 6+ years relevant work experience Mandatory skills

• Must have worked extensively on Spark, Scala, PySpark, Python, SQL.
  
• Hands On Experience in using AWS services like, S3, GLUE, Lambda, Redshift, IAM
  
• Exposure on Client Interaction.
  
• Writing complex SQLs.
  
• Experience in the healthcare domain is preferred.
  
• Any AWS certifications are good to have.
• 
  Work Location: Bangalore - North Mode: In Office