Hadoop Developer - Scala/Spark (1-12 yrs)

Profile : Hadoop Developer

Work from office and Work from home

Job description

Role & responsibilities :

- Minimum 2+ Years Hands on experience in Hadoop Development, Scala, Spark.

- knowledge in extract transform load (ETL) processes and data warehousing

- Strong problem-solving and analytical skills

- Excellent written and verbal communication skills

- Ability to work well in a team and collaborate with others

- Bachelor's degree in Computer Science or related field

- Design, develop, test, deploy, and maintain large-scale big data processing pipelines using Hadoop ecosystem (HDFS, MapReduce) and Spark.

- Collaborate with cross-functional teams to gather requirements and deliver high-quality solutions on time.

- Develop expertise in working with various technologies such as Cloudera Manager, Python, Scala, Java, Kafka.

- Troubleshoot complex issues related to big data processing workflows and provide timely resolutions.

- Stay up-to-date with industry trends and best practices in big data analytics.

- Meeting with the development team to assess the company s big data infrastructure.

- Designing and coding hadoop applications to analyze data collections.

- Creating data processing frameworks.

- Extracting data and isolating data clusters.

- Testing scripts and analyzing results.

- Troubleshooting application bugs.

- Maintaining the security of company data.

- Creating data tracking programs.

- Producing Hadoop development documentation.

- Training staff on application use.

Hadoop Developer Requirements :

- Bachelor s degree in software engineering or computer science.

- Previous experience as a hadoop developer or big data engineer.

- Advanced knowledge of the hadoop ecosystem and its components.

- In-depth knowledge of Hive, HBase, and Pig.

- Familiarity with MapReduce and Pig Latin Scripts.

- Knowledge of back-end programming languages including JavaScript, Node.js, and OOAD.

- Familiarity with data loading tools including Squoop and Flume.

- High-level analytical and problem-solving skills.

- Good project management and communication skills.