Capco - Data Engineer - Scala (5-9 yrs)

Job Title: Data Engineer Scala.

About Us :

"Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount.

With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery.

Note : Only apply if you are available Immediate to max 30 Days.

WHY JOIN CAPCO :

You will work on engaging projects with the largest international and local banks, insurance companies, payment service providers and other key players in the industry. The projects that will transform the financial services industry.

MAKE AN IMPACT :

- Innovative thinking, delivery excellence and thought leadership to help our clients transform their business.

- Together with our clients and industry partners, we deliver disruptive work that is changing energy and financial services.

#BEYOURSELFATWORK : Capco has a tolerant, open culture that values diversity, inclusivity, and creativity.

CAREER ADVANCEMENT : With no forced hierarchy at Capco, everyone has the opportunity to grow as we grow, taking their career into their own hands.

DIVERSITY & INCLUSION : We believe that diversity of people and perspective gives us a competitive advantage.

Job Title : Data Engineer Scala.

Location : Bangalore.

Experience : 5 to 9 years.

Role Description :

Skill Set :

- Must Have : Strong Spark,- Hadoop and Hive- hands-on Technical knowledge and implementation experience Hands-on knowledge Python , Pyspark, Scala.

- Should have : Exposure working with semi structured and large volume of Data Good understanding of CI/CD pipeline Knowledge of any scheduling tool Data Ware housing concepts.

Responsibilities :

- Design, develop, and maintain scalable and high-performance data pipelines using Spark, Scala, and other big data technologies.

- Extract, transform, and load (ETL) data from various sources (e.g., databases, APIs, cloud storage) into data warehouses and data lakes.

- Develop and optimize data processing algorithms and workflows for large-scale data sets.

- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and translate them into technical solutions.

- Perform data quality checks and ensure data integrity throughout the data pipeline.

- Troubleshoot and resolve data-related issues and performance bottlenecks.

- Participate in all phases of the software development lifecycle, including design, development, testing, and deployment.

- Stay abreast of the latest advancements in big data technologies and best practices.

- Contribute to the development and improvement of data engineering best practices and standards.

Required Skills :

Must Have :

- Strong hands-on experience with Spark, Hadoop, and Hive.

- Expert-level proficiency in Scala and Python.

- Solid understanding of data warehousing concepts and best practices.

Should Have :

- Experience working with semi-structured and large volumes of data.

- Good understanding of CI/CD pipelines and related tools.

-Knowledge of any scheduling tool (e.g., Airflow, Oozie).

- Experience with cloud platforms (e.g., AWS, Azure, GCP) is a plus.

Qualifications :

- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

- 5 to 9 years of professional experience as a Data Engineer.

- Strong analytical and problem-solving skills.

- Excellent communication and collaboration skills.

- Passion for data and a strong desire to learn and grow.