Senior Data Engineer

Data Engineer

Primary Skill: Scala, Spark & SQL

Secondary Skill: Java

Must Have:

• Tech savvy engineer - willing and able to learn new skills, track industry trend
• 8+ years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed environments with minimum 2 years of experience in Big data related technologies like Spark, Hive, HBase, Scala, etc
• Programming background preferred Scala / Python.
• Experience in Java (must have), Scala, Spark / PySpark.
• Experience in migration of data to AWS cloud
• Experience in SQL and NoSQL databases.
• Optional: Model the data set from Teradata to the cloud.
• Experience in Building ETL Pipelines
• Experience in Building Data pipelines in AWS (S3, EC2, EMR, Athena, Redshift)
• Self-starter & resourceful personality with the ability to manage pressure situations
  
  
• Exposure to Scrum and Agile Development Best Practices
• Experience working with geographically distributed teams

Role & Responsibilities:

• Build Data and ETL pipelines in AWS
• Support migration of data to the cloud using Big Data Technologies like Spark, Hive, Talend, Python
• Interact with customers on a daily basis to ensure smooth engagement
• Responsible for timely and quality deliveries.
• Fulfill organization responsibilities Sharing knowledge and experience within the other groups in the organization, conducting various
  technical sessions and training.