Big Data Engineer (Scala / Spark / Hadoop)

Job Loc: Bangalore

Exp : 6+ Yrs

Role Overview:
We are looking for a Big Data Developer with strong expertise in Scala, Spark, and Hadoop to join our dynamic team. The ideal candidate is a self-driven, dedicated professional who thrives in fast-paced environments and can collaborate effectively with both technical and non-technical stakeholders. You should be comfortable adapting to evolving requirements and capable of quickly learning new technologies and approaches to address complex problems.

Key Responsibilities:

• Design, develop, and optimize big data solutions using Scala and Spark.
• Work with Hadoop (HDFS) and related ecosystems to manage large-scale data processing.
• Develop and maintain efficient database solutions using Hadoop, DB2, or Sybase.
• Collaborate within Agile Scrum teams, participating in sprint planning, reviews, and retrospectives.
• Communicate effectively with cross-functional teams to gather requirements, present solutions, and address technical challenges.
• Investigate and resolve production issues, ensuring system reliability and performance.

Required Skills:

• 5+ years of relevant technical experience.
• Proven hands-on experience in Scala-Spark big data development.
• Strong working knowledge of databases such as Hadoop (HDFS), DB2, or Sybase.
• Solid understanding of the Hadoop ecosystem.
• Strong grasp of the SDLC process and Agile (Scrum) methodology.
• Excellent oral and written communication skills.
• Strong interpersonal and collaboration skills.
• Analytical mindset with strong problem-solving abilities.

Preferred Skills:

• Prior experience working in the Compliance technology domain.
• Hands-on experience developing statistical models and machine learning algorithms, particularly for anomaly detection.
• Familiarity with Spark processing on Hadoop.
• Experience working across global teams in multiple time zones.
• Hands-on experience with data mining and analytical work using big data platforms.
• Experience with Unix OS, shell scripting, and Python.
• Good understanding of DevOps practices, including CI/CD tools like Jenkins.

What we believe:

We re proud to embrace the same values that have shaped UST since the beginning. Since day one, we ve been building enduring relationships and a culture of integrity. And today, its those same values that are inspiring us to encourage innovation from everyone, to champion diversity and inclusion, and to place people at the centre of everything we do.

Humility:

We will listen, learn, be empathetic and help selflessly in our interactions with everyone.

Humanity:

Through business, we will better the lives of those less fortunate than ourselves.

Integrity:

We honour our commitments and act with responsibility in all our relationships.

Equal Employment Opportunity Statement

UST is an Equal Opportunity Employer.

All qualified applicants will receive consideration for employment without regard to race, colour, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

UST reserves the right to periodically redefine your roles and responsibilities based on the requirements of the organization and/or your performance.