AmbitionBox
Jobs
- Reviews
- Salaries
- Interview Questions
- About Company
- Benefits
- Jobs
- Office Photos
- Community
Add office photos
i
IBM
Compare
Proud winner of ABECA 2024 - AmbitionBox Employee Choice Awards
All Filters
1768 IBM Jobs
Data Engineer-Data Platforms-AWS
2-6 years
₹ 4.5 - 28L/yr (AmbitionBox estimate)
Bangalore / Bengaluru
Data Engineer-Data Platforms-AWS
IBM
posted 1hr ago
Job Role Insights
Flexible timing
Key skills for the job
Job Description
- Design, construct, install, test, and maintain highly scalable data management systems using big data technologies such as Apache Spark (with focus on Spark SQL) and Hive. Manage and optimize our data warehousing solutions, with a strong emphasis on SQL performance tuning. Implement ETL/ELT processes using tools like Talend or custom scripts, ensuring efficient data flow and transformation across our systems.
- Utilize AWS services including S3, EC2, and EMR to build and manage scalable, secure, and reliable cloud-based solutions.
- Develop and deploy scripts in Linux environments, demonstrating proficiency in shell scripting. Utilize scheduling tools such as Airflow or Control-M to automate data processes and workflows.
- Implement and maintain metadata-driven frameworks, promoting reusability, efficiency, and data governance. Collaborate closely with DevOps teams utilizing SDLC tools such as Bamboo, JIRA, Bitbucket, and Confluence to ensure seamless integration of data systems into the software development lifecycle.
- Communicate effectively with both technical and non-technical stakeholders, for handover, incident management reporting, etc
- Demonstrated expertise in Big Data Technologies, specifically Apache Spark (focus on Spark SQL) and Hive.
- Extensive experience with AWS services, including S3, EC2, and EMR.
- Strong expertise in Data Warehousing and SQL, with experience in performance optimization
- Experience with ETL/ELT implementation (such as Talend)
- Proficiency in Linux, with a strong background in shell scripting
- Familiarity with scheduling tools like Airflow or Control-M.
- Experience with metadata-driven frameworks.
- Knowledge of DevOps tools such as Bamboo, JIRA, Bitbucket, and Confluence. Excellent communication skills and a willing attitude towards learning
Employment Type: Full Time, Permanent
Read full job descriptionIBM Interview Questions & Tips
Prepare for IBM Data Engineer roles with real interview advice
Top IBM Data Engineer Interview Questions
What people at IBM are saying
Rating based on 205 Data Engineer
reviews
Anonymous · Engineering - Software & QA
1. Work-Pertional life balance. 2. Your work recognition. 3. Appreciation of your work. 4. Job security. 5. Opportunity to learn and grow yourself in multiple technology and tools.
- Salary - Good
1. All the mentioned benefits are depending on project basis, its not a universal.
Data Engineer salary at IBM
What IBM employees are saying about work life
IBM Benefits
View more benefits
Compare IBM with
Oracle
TCS
Cognizant
Accenture
Infosys
Capgemini
Wipro
Deloitte
Amazon
Amdocs
SAP
Microsoft Corporation
Tech Mahindra
PwC
Ernst & Young
Nagarro
NetApp
Salesforce
SAS
Similar Jobs for you
IBM Bangalore / Bengaluru Office Locations
Karnataka 560029
Karnataka 560029
