All Filters
89 Bamboo Jobs
Data Engineer-Data Platforms-AWS
2-6 years
₹ 4.5 - 28L/yr (AmbitionBox estimate)
Bangalore / Bengaluru
Data Engineer-Data Platforms-AWS
IBM
posted 15d ago
Job Role Insights
Key skills for the job
Job Description
- Design, construct, install, test, and maintain highly scalable data management systems using big data technologies such as Apache Spark (with focus on Spark SQL) and Hive. Manage and optimize our data warehousing solutions, with a strong emphasis on SQL performance tuning. Implement ETL/ELT processes using tools like Talend or custom scripts, ensuring efficient data flow and transformation across our systems.
- Utilize AWS services including S3, EC2, and EMR to build and manage scalable, secure, and reliable cloud-based solutions.
- Develop and deploy scripts in Linux environments, demonstrating proficiency in shell scripting. Utilize scheduling tools such as Airflow or Control-M to automate data processes and workflows.
- Implement and maintain metadata-driven frameworks, promoting reusability, efficiency, and data governance. Collaborate closely with DevOps teams utilizing SDLC tools such as Bamboo, JIRA, Bitbucket, and Confluence to ensure seamless integration of data systems into the software development lifecycle.
- Communicate effectively with both technical and non-technical stakeholders, for handover, incident management reporting, etc
- Demonstrated expertise in Big Data Technologies, specifically Apache Spark (focus on Spark SQL) and Hive.
- Extensive experience with AWS services, including S3, EC2, and EMR.
- Strong expertise in Data Warehousing and SQL, with experience in performance optimization
- Experience with ETL/ELT implementation (such as Talend)
- Proficiency in Linux, with a strong background in shell scripting
- Familiarity with scheduling tools like Airflow or Control-M.
- Experience with metadata-driven frameworks.
- Knowledge of DevOps tools such as Bamboo, JIRA, Bitbucket, and Confluence. Excellent communication skills and a willing attitude towards learning
Employment Type: Full Time, Permanent
Read full job descriptionIBM Interview Questions & Tips
Prepare for IBM Data Engineer roles with real interview advice
What people at IBM are saying
Rating based on 208 Data Engineer
reviews
Anonymous · Engineering - Software & QA
1. Work-Pertional life balance. 2. Your work recognition. 3. Appreciation of your work. 4. Job security. 5. Opportunity to learn and grow yourself in multiple technology and tools.
- Salary - Good
1. All the mentioned benefits are depending on project basis, its not a universal.
Data Engineer salary at IBM
Unlock 
Compare IBM with
Oracle
TCS
Cognizant
Accenture
Infosys
Capgemini
Wipro
Deloitte
Amazon
Amdocs
SAP
Microsoft Corporation
Tech Mahindra
PwC
Ernst & Young
Nagarro
NetApp
Salesforce
SAS
Similar Jobs for you
Data Engineer-Data Platforms-AWS
IBM India Pvt. Limited
2-6 Yrs
Bangalore / Bengaluru
Application Support Engineer
Accenture Solutions Pvt Ltd
5-9 Yrs
Bangalore / Bengaluru
Application Support Engineer
Accenture Solutions Pvt Ltd
5-7 Yrs
Bangalore / Bengaluru
Software Configuration Lead
Accenture Solutions Pvt Ltd
7-12 Yrs
Hyderabad / Secunderabad
Application Automation Engineer
Accenture Solutions Pvt Ltd
5-7 Yrs
Bangalore / Bengaluru
Recently Viewed
SALARIES
Hashone Careers
No Salaries
REVIEWS
Hashone Careers
No Reviews
LIST OF COMPANIES
Hashone Careers
Overview
