Big Data Developer - Hive/Spark (1-3 yrs)

SALARY : 10LPA

Job Description :

We are looking for an experienced Big Data Developer with a strong background in building scalable and efficient data pipelines. The ideal candidate should have hands-on experience with Hive, Spark, Hadoop, and MapReduce, and possess strong programming skills in Python, Java, or Scala

Key Responsibilities :

- Develop and maintain large-scale data processing pipelines using Hive, Spark, Hadoop, and MapReduce.

- Collaborate with the data engineering team to design, implement, and optimize scalable data solutions.

- Ensure data quality and integrity by implementing data validation and cleansing processes.

- Utilize knowledge in Snowflake, Snowpark, and SnowSQL to handle large datasets and improve performance.

- Work with both RDBMS and NoSQL databases to design and query data models.

- Optimize and deploy data solutions on cloud platforms like AWS, Azure, or GCP.

Required Skills :

- Big Data Technologies : Hive, Spark, Hadoop, MapReduce.

- Proficiency in at least one programming language: Python, Java, or Scala.

- Strong understanding of data structures and programming basics.

- Experience with Snowflake, Snowpark, and SnowSQL.

- Good understanding of RDBMS and NoSQL database concepts.

- Exposure to Cloud Platforms: AWS, Azure, GCP.

Desired Skills :

- Ability to write efficient and optimized code for processing large datasets.

- Familiarity with CI/CD pipelines, version control systems, and testing frameworks.

- Strong problem-solving skills and a desire to learn new technologies.

Educational Qualifications :

- B.E/B.Tech in Computer Science, Information Technology, or a related field.