AWS Data Engineer

We are looking for a Data Engineer to be based out of our Chennai/Bangalore/Hyderabad office. This role involves a combination of hands-on contribution, customer engagement, and technical team management. As a Data Engineer, you will

• Design and build solutions for near real-time stream processing as well as batch processing on the Big Data platform.
• Set up and run Hadoop development frameworks.
• Collaborate with a team of business domain experts, data scientists, and application developers to identify relevant data for analysis and develop the Big Data solution.
• Explore and learn new technologies for creative business problem-solving.

Required Experience, Skills & Competencies:

• Ability to develop and manage scalable Hadoop cluster environments
• Ability to design solutions for Big Data applications
• Experience in Big Data technologies like HDFS, Hadoop, Hive, Yarn, Pig, HBase, Sqoop, Flume, etc
• Working experience on Big Data services in any cloud-based environment.
• Experience in Spark, Pyspark, Python, Kafka, Akka, core or advanced Java, and Databricks
• Knowledge of how to create and debug Hadoop and Spark jobs
• Experience in NoSQL technologies like HBase, Cassandra, MongoDB, Cloudera, or Hortonworks Hadoop distribution
• Familiar with data warehousing concepts, distributed systems, data pipelines, and ETL
• Familiar with data visualization tools like Tableau
• Good communication and interpersonal skills
• Minimum 4+ years of Professional experience with 3+ years of Big Data project experience
• B.Tech/B.E from a reputed institute preferred