All Filters
(1)166 Senior Data Engineer Jobs in Bangalore / Bengaluru
Senior Data Engineer
SAP
posted 4d ago
Job Role Insights
Flexible timing
Key skills for the job
Job Description
- Design and Build Scalable ETL Pipelines: Architect, build, and optimize large-scale ETL/ELT data pipelines, focusing on performance, scalability, and data integrity. Ensure the pipelines integrate smoothly within the larger data ecosystem.
- Microservices Development and Maintenance: Design and implement microservices for managing data processing tasks. Build reusable and scalable services to handle various data processing needs and ensure maintainability.
- Implement DevOps Practices : Utilize DevOps tools and practices (CI/CD) for automating testing, building, and deployment of data pipelines and microservices. Ensure that data workflows, models, and infrastructure are robust and can scale in a cloud-native environment.
- Data Integration and Transformation : Collaborate with cross-functional teams to design seamless data integrations between HCM and BDC systems. Focus on data transformation, cleansing, and deduplication while ensuring the pipelines are efficient and maintainable.
- Optimize Data Processing : Tune ETL pipeline performance, focusing on real-time data processing and optimizing for low-latency data delivery. Troubleshoot and debug complex pipeline issues in distributed systems.
- Database and Big Data Tools Management : Work extensively with SQL for structured data and leverage big data tools like Hive, HBase, and Parquet for large-scale data storage and querying.
- Performance Optimization & Data Quality : Drive data quality initiatives including data deduplication, data transformation, and performance optimizations across data pipelines and services.
- Collaboration and Mentorship : Partner with Data Scientists, Analysts, and Engineers to ensure seamless data integration. Provide technical leadership, mentorship, and guidance to junior engineers, fostering best practices in both data engineering and DevOps.
- Strong expertise in Python, Java, or Scala for building scalable data pipelines and microservices.
- Proven experience working with Apache Spark, Kafka, and Airflow for building data workflows and processing large datasets.
- Strong knowledge of SQL for querying structured data and interacting with databases.
- Hands-on experience with microservices architecture for building, deploying, and managing data services.
- Experience working in a DevOps environment using tools like Jenkins, Git, Docker, and Kubernetes to support continuous integration and delivery.
- Expertise in big data tools such as Hive, HBase, Parquet, and other storage solutions for managing large volumes of data.
- Hands-on experience with data transformation, deduplication, performance optimization, and distributed systems.
- Familiarity with Machine Learning workflow integration and automating ML data pipelines.
- Ability to architect and scale microservices for high-volume data workloads.
- Strong problem-solving skills with a focus on troubleshooting and debugging in a distributed data environment.
- Experience in mentoring and providing technical leadership to junior engineers in data engineering and DevOps practices
- Requires 8+ years of professional experience is essential for understanding system architecture, programming, and technical troubleshooting.
- Outstanding written and verbal communication skills.
- Bachelors/Masters in computer science required.
Employment Type: Full Time, Permanent
Read full job descriptionPrepare for Senior Data Engineer roles with real interview advice
What Senior Data Engineer at SAP are saying
Senior Data Engineer salary at SAP
Unlock 
What SAP employees are saying about work life
SAP Benefits
View more benefits
Compare SAP with
Oracle
SAS
Zoho
IBM
TCS
Cognizant
Salesforce
Adobe
Microsoft Corporation
Accenture
Infosys
Wipro
HCLTech
Tech Mahindra
Amdocs
Automatic Data Processing (ADP)
Carelon Global Solutions
24/7 Customer
KPIT Technologies
Similar Jobs for you
SAP Bangalore / Bengaluru Office Locations
Karnataka 560066
Karnataka 560103
Senior Data Engineer , Amazon
Amazon India Software Dev Centre Pvt Ltd
2-15 Yrs
Bangalore / Bengaluru
Senior Data Engineer
Wells Fargo International Solutions Private Ltd
4-8 Yrs
Bangalore / Bengaluru
Senior Data Engineer
Adobe Systems India Pvt. Ltd.
12-16 Yrs
Bangalore / Bengaluru
Sr Data Engineer
Photon Infotech P Ltd
4-9 Yrs
Kolkata, Mumbai, New Delhi +4 more
Sr Data Engineer, AWS Data Platform
Amazon India Software Dev Centre Pvt Ltd
3-7 Yrs
Bangalore / Bengaluru
Senior Data Engineer
Virtusa Consulting Services Pvt Ltd
8-10 Yrs
Bangalore / Bengaluru
Recently Viewed
JOBS
Orange Business
No Jobs
JOBS
HNM Sourcing
No Jobs
COMPANY BENEFITS
IBM
No Benefits
REVIEWS
Genpact
No Reviews
JOBS
Sanama solution
No Jobs
JOBS
Accenture
No Jobs
JOBS
Cognizant
No Jobs
COMPANY BENEFITS
DXC Technology
No Benefits
SALARIES
IBM
