Hadoop/Linux Administrator (3-4 yrs)

Skills :

- Hadoop administration

- Linux system administration

- Troubleshooting, logs

- Linux, zookeeper, Apache tomcat

Experience : 3+ years

Job Description :

We urgently need a Hadoop-Linux Administrator with hands-on experience managing Linux-based systems and Hadoop clusters.

This role demands proficiency in Hadoop, Linux administration, and various development technologies such as Java, JavaScript, and Maven.

The successful candidate will be responsible for ensuring the smooth running of applications, troubleshooting issues, and contributing to the overall infrastructure landscape.

Technical Skills Required :

- Strong understanding of the Hadoop ecosystem (HDFS, YARN, MapReduce, Hive, etc.)

- Proficient in Java programming and front-end technologies such as JavaScript, HTML, and CSS

- Strong experience in Red Hat Linux administration, including shell scripting for Linux environments

- Expertise in using Maven for build automation and dependency management

- Experience with RESTful Web Services

- Proficient in using Git for version control and code management

- Solid understanding of PostgreSQL databases and their integration with Hadoop or Linux environments

- Experience with configuring and maintaining Apache Tomcat servers

- Exposure to or a willingness to learn Oracle, Apache Solr, Redis, and Zookeeper

- Ability to monitor server health, service availability, and application logs in various environments

- Experience in writing clear, concise technical documentation for system configurations, troubleshooting, and future development

Roles & Responsibilities :

- Install, configure, and manage Hadoop clusters on Linux systems to ensure smooth data processing operations

- Monitor and troubleshoot issues related to Hadoop, Java-based applications, and Red Hat Linux servers, ensuring minimal downtime and fast resolution of issues

- Regularly monitor the health of Linux servers and all services running within the Hadoop ecosystem to ensure maximum uptime

- Continuously monitor application logs across multiple environments and troubleshoot critical issues in a timely manner

- Configure and manage Apache Tomcat instances, ensuring applications are deployed and running correctly

- Optimize the performance of both Hadoop clusters and Linux systems to ensure scalability and reliability

- Proactively collaborate with stakeholders, including developers, system admins, and other teams, to ensure seamless integration and smooth operations

- Maintain accurate and up-to-date documentation for all configurations, troubleshooting steps, and system changes to facilitate future developments and team collaboration

- Contribute to shaping and optimizing the overall infrastructure landscape, including recommending tools, technologies, and processes for better management and performance Implement and manage backup solutions for data stored in Hadoop clusters, ensuring disaster recovery is in place

- Write scripts to automate repetitive administrative tasks, system checks, and performance monitoring to improve efficiency

- Ensure that systems and software are up to date with the latest patches and version upgrades to mitigate security risks and improve stability

Preferred Qualification :

- Bachelor's degree in computer science, Information Technology, or a related field

- Certification in Linux administration, Hadoop, or any related field is a plus

- Strong communication skills to work in a fast-paced, collaborative environment

- Familiarity with Oracle, Apache Solr, Redis, and Zookeeper (or willingness to learn)