Lead Hadoop Developer

Job Description: As a Hadoop Developer at Bright Vision Technologies, you will be responsible for designing, developing, and maintaining Hadoop-based solutions. You will collaborate with cross-functional teams to implement data processing and analytics pipelines, optimize performance, and ensure data reliability and security.

Responsibilities:
Design, develop, and maintain Hadoop-based solutions
Collaborate with data scientists and data engineers to implement data processing and analytics pipelines
Optimize Hadoop cluster performance and scalability
Troubleshoot and resolve issues related to Hadoop data processing and storage
Ensure data reliability, integrity, and security in Hadoop environments
Stay up-to-date with the latest trends and advancements in the Hadoop ecosystem

Requirements:
Proven experience as a Hadoop Developer or similar role
Strong understanding of the Hadoop ecosystem, including HDFS, MapReduce, Hive, Spark, and related technologies
Proficiency in programming languages such as Java, Scala, or Python
Experience with data processing and analytics frameworks like Apache Kafka, Apache Flink, or Apache Beam
Familiarity with distributed computing concepts and parallel processing
Knowledge of SQL and NoSQL databases
Strong problem-solving and communication skills
Ability to work in a fast-paced and collaborative environment

Preferred Qualifications:
Bachelors degree in Computer Science, Software Engineering, or a related field
Hadoop-related certifications
Experience with data visualization tools and techniques