Home
Communities
Companies
- Companies
  
  Discover best places to work
- Compare Companies
  
  Compare & find best workplace
- Add Office Photos
  
  Bring your workplace to life
- Add Company Benefits
  
  Highlight your company's perks
Reviews
- Company reviews
  
  Read reviews for 6L+ companies
- Write a review
  
  Rate your former or current company
Salaries
- Browse salaries
  
  Discover salaries for 6L+ companies
- Salary calculator
  
  Calculate your take home salary
- Are you paid fairly?
  
  Check your market value
- Share your salary
  
  Help other jobseekers
- Gratuity calculator
  
  Check your gratuity amount
- HRA calculator
  
  Check how much of your HRA is tax-free
- Salary hike calculator
  
  Check your salary hike
Interviews
- Company interviews
  
  Read interviews for 40K+ companies
- Campus placements
  
  Interviews questions for 2K+ colleges
- Share interview questions
  
  Contribute your interview questions
Jobs
Awards

WINNERS AWAITED!
- ABECA 2025
  
  WINNERS AWAITED!
  
  AmbitionBox Employee Choice Awards - 4th Edition
- ABECA 2024
  
  AmbitionBox Employee Choice Awards - 3rd Edition
- AmbitionBox Best Places to Work 2022
  
  2nd Edition
- AmbitionBox Best Places to Work 2021
  
  1st Edition

Add office photos

Engaged Employer

Capco Technologies

Compare

3.7

based on 500 Reviews

138 Capco Technologies Jobs

AWS Data Engineer - (Hadoop/Hive/python/Spark/Scala)

Capco Technologies Pvt Ltd

3.7

based on 500 Reviews

5-8 years

Bangalore / Bengaluru

1 vacancy

AWS Data Engineer - (Hadoop/Hive/python/Spark/Scala)

Capco Technologies

posted 3d ago

Job Role Insights

Flexible timing

Key skills for the job

Computer Science Data Analytics Python Consulting SQL Clinical Data Management

+ 4 more

Job Description

Job Title: Senior Data Engineer/Developer

Number of Positions: 2

Job Description:

The Senior Data Engineer will be responsible for designing, developing, and maintaining scalable data pipelines and building out new API integrations to support continuing increases in data volume and complexity. They will collaborate with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization.

Responsibilities:

Design, construct, install, test and maintain highly scalable data management systems & Data Pipeline.
Ensure systems meet business requirements and industry practices.
Build high-performance algorithms, prototypes, predictive models, and proof of concepts.
Research opportunities for data acquisition and new uses for existing data.
Develop data set processes for data modeling, mining and production.
Integrate new data management technologies and software engineering tools into existing structures.
Create custom software components and analytics applications.
Install and update disaster recovery procedures.
Collaborate with data architects, modelers, and IT team members on project goals.
Provide senior level technical consulting to peer data engineers during data application design and development for highly complex and critical data projects.

Qualifications:

Bachelors degree in computer science, Engineering, or related field, or equivalent work experience.
Proven 5-8 years of experience as a Senior Data Engineer or similar role.
Experience with big data tools: Hadoop, Spark, Kafka, Ansible, chef, Terraform, Airflow, and Protobuf RPC etc.
Expert level SQL skills for data manipulation (DML) and validation (DB2).
Experience with data pipeline and workflow management tools.
Experience with object-oriented/object function scripting languages: Python, Java, Go lang etc.
Strong problem solving and analytical skills.
Excellent verbal communication skills.
Good interpersonal skills.
Ability to provide technical leadership for the team.