Java/Scala Developer (5-8 yrs)

Location : Bangalore.

Work from Office.

Exp : 7+yrs.

- We are looking for a strong Java Scala developer to help deliver key initiatives.

- Strong technical experience in Scala, Java, Python and Spark for designing , creating and maintaining big data applications.

- Experience maintaining Cloudera Hadoop infrastructure such as HDFS, YARN, Spark, Impala and edge nodes.

- Experience with developing Cloud based Big Data solutions on AWS or Azure.

Responsibilities :

- Design, develop, and implement scalable and high-performance big data applications using Scala, Java, Python, and Spark.

- Write clean, efficient, and maintainable code, adhering to best practices and coding standards. Participate in code reviews, design discussions, and architectural planning.

- Troubleshoot and resolve complex technical issues related to big data applications.

- Maintain and optimize our Cloudera Hadoop infrastructure, including HDFS, YARN, Spark, Impala, and edge nodes.

- Monitor system performance and identify areas for improvement.

- Implement and manage data pipelines and ETL processes.

- Design and develop cloud-based big data solutions on AWS or Azure.

- Utilize cloud services for data storage, processing, and analytics.

- Ensure data security and compliance in cloud environments.

- Collaborate effectively with cross-functional teams, including data scientists, analysts, and product managers.

- Communicate technical concepts clearly and concisely to both technical and non-technical audiences.

- Mentor junior engineers and share knowledge within the team.

Required Skills and Experience :

- Minimum 7+ years of experience in software development, with a strong focus on big data technologies.

- Expertise in Scala, Java, and Python programming languages.

- Extensive experience with Apache Spark for large-scale data processing.

- Hands-on experience with Cloudera Hadoop ecosystem (HDFS, YARN, Impala).

- Proven experience in developing and maintaining big data applications in a production environment.

- Experience with cloud platforms (AWS or Azure) and their big data services.

- Strong understanding of data structures, algorithms, and software design principles.

- Experience with SQL and relational databases.

- Strong debugging and problem-solving skills.

- Excellent communication and collaboration skills.

Preferred Skills :

- Experience with other big data technologies like Kafka, Flink, or Hive.

- Knowledge of containerization technologies like Docker and Kubernetes.

- Experience with CI/CD pipelines and DevOps practices.

- Experience with data warehousing solutions.