Hadoop Developer - Big Data Solutions (5-8 yrs)

Job Description :

Net Connect Global is seeking a highly skilled Hadoop Developer to join their team and support their client, Morgan Stanley. In this role, you will be responsible for designing, developing, and implementing big data solutions using the Hadoop ecosystem.

Responsibilities :

- Design, develop, and implement big data solutions using Hadoop, YARN, MapReduce, Spark, and other related technologies.

- Develop and maintain data pipelines for data ingestion, transformation, and loading (ETL).

- Write and execute complex SQL queries to extract and analyze large datasets.

- Design and implement data warehousing solutions.

- Migrate data from various sources to Hadoop data lake.

- Troubleshoot and debug Hadoop clusters and applications.

- Monitor and optimize the performance of Hadoop clusters.

- Document Hadoop solutions and processes.

- Work effectively with cross-functional teams, including data scientists, business analysts, and software engineers.

Qualifications :

- Bachelor's degree in Computer Science, Information Technology, or a related field.

- 5+ years of experience as a Hadoop Developer.

- Strong experience with big data and analytics concepts.

- Proven experience in designing, developing, and implementing big data solutions using Hadoop ecosystem technologies (YARN, MapReduce, Spark, etc.

- Expertise in SQL, with experience handling complex queries and large datasets.

- Hands-on experience with cloud platforms like Azure Databricks, AWS EMR, or Google Cloud Dataproc (preferred).

- Proficiency in data migration strategies, tools, and best practices.

- Working knowledge of data warehousing concepts, including ETL processes and schema design.

- Strong programming skills in Java, Python, or Scala.

- Excellent analytical, problem-solving, and communication skills