Java/Spark Lead - ETL/SQL (8-10 yrs)

Job Title : Java Spark Lead

Location : Bangalore, Hyderabad

Experience : 6-10 Years

Job Description :

We are seeking a highly skilled Java Spark Lead with extensive experience in software development and team leadership. The ideal candidate will have a strong background in Core Java, Apache Spark, and Big Data technologies, along with proven expertise in managing successful projects.

Key Responsibilities :

- Lead and mentor a team of developers, ensuring best practices in coding standards and project delivery.

- Design, develop, and maintain scalable data processing pipelines using Core Java and Apache Spark.

- Implement data wrangling and ETL processes using Java.

- Manage and optimize databases for handling extremely large data volumes.

- Collaborate with cross-functional teams in an Agile development environment.

- Write and maintain JUNIT/Mockito test cases to ensure code quality and reliability.

- Oversee Control-M setup for job scheduling and automation.

Technical Requirements :

- 8+ years of experience in software development using Core Java and Apache Spark, with a minimum of 5 years in leadership roles.

- 5+ years of experience with Big Data technologies, including Hadoop, Spark, and Big Data platforms.

- Strong knowledge of RDBMS and NoSQL databases with advanced SQL capabilities.

- Experience with Teradata preferred; Snowflake experience is a plus.

- Familiarity with Agile SDLC tools such as JIRA, BitBucket/Git, and AWS ECS is advantageous.

Key Skills :

- Core Java

- Apache Spark

- Hadoop, RDBMS, NoSQL

- ETL and Data Wrangling

- SQL, Teradata, Snowflake

- Agile SDLC, JIRA, BitBucket/Git

- JUNIT/Mockito Testing

- Control-M setup

Preferred Attributes :

- Ability to work independently and as a technical leader in a fast-paced environment.

- Strong problem-solving skills with a focus on project success.

- Excellent written and verbal communication skills.

- Ability to adjust priorities quickly based on project requirements.