Hadoop Developer - ETL/Big Data (6-8 yrs)

Role : Hadoop Developer.

Experience: 6+ years.

Location : Bangalore.

Notice Period : Immediate 15 days max (Serving NP candidates preferred).

Budget : 20 LPA.

Role Description : This is a full-time on-site role for a Hadoop Developer for top MNC in Bangalore.

The Hadoop Developer will be responsible for tasks such as Hadoop administration, ETL processes, big data management, data warehousing, and Hadoop development.

Key Responsibilities :

- Install, configure, and administer Hadoop clusters (HDFS, YARN, MapReduce, Hive, Spark)

- Monitor cluster performance, troubleshoot issues, and ensure high availability

- Manage user access and security within the Hadoop environment

- Design, develop, and implement ETL pipelines for data ingestion, transformation, and loading into Hadoop

- Optimize ETL processes for performance and efficiency

- Ensure data quality and integrity throughout the ETL lifecycle

- Manage and maintain large-scale datasets within the Hadoop ecosystem

- Develop and implement data governance and data quality frameworks

- Perform data analysis and generate reports using Hadoop tools

- Design and develop data warehouses and data marts using Hadoop technologies

- Integrate Hadoop data with existing data warehousing systems

- Support business intelligence and reporting activities

- Develop and maintain Hadoop applications using Java, Scala, or Python

- Write efficient MapReduce and Spark jobs for data processing

- Develop and maintain Hive and Pig scripts for data querying and analysis

Required Skills :

- Strong hands-on experience with the Hadoop ecosystem : HDFS, YARN, MapReduce, Hive, Spark, Pig Proficiency in Java, Scala, or Python

- Experience with ETL tools and methodologies

- Experience with data warehousing concepts and methodologies

- Strong SQL and data modeling skills

- Experience with data quality and governance frameworks

- Excellent problem-solving and analytical skills

- Strong communication and interpersonal skills

- Experience with cloud platforms (AWS, Azure, GCP) is a plus

Preferred Qualifications :

- Certifications in Hadoop or related technologies

- Experience with NoSQL databases (e.g., Cassandra, MongoDB)

- Experience with machine learning and AI technologies