Upload Button Icon Add office photos
Engaged Employer

i

This company page is being actively managed by IBM Team. If you also belong to the team, you can get access from here

IBM Verified Tick

Compare button icon Compare button icon Compare
filter salaries All Filters

1753 IBM Jobs

Data Engineer-Data Platforms-AWS

2-4 years

Kochi

Data Engineer-Data Platforms-AWS

IBM

posted 30min ago

Job Role Insights

Flexible timing

Job Description

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs.Your primary responsibilities include:

  • Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements.
  • Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization.
  • Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too
Required education
Bachelor's Degree
Preferred education
Master's Degree
Required technical and professional expertise
  • Developed the Pysprk code for AWS Glue jobs and for EMR.. Worked on scalable distributed data system using Hadoop ecosystem in AWS EMR, MapR distribution..
  • Developed Python and pyspark programs for data analysis.. Good working experience with python to develop Custom Framework for generating of rules (just like rules engine).
  • Developed Hadoop streaming Jobs using python for integrating python API supported applications..
  • Developed Python code to gather the data from HBase and designs the solution to implement using Pyspark. Apache Spark DataFrames/RDD's were used to apply business transformations and utilized Hive Context objects to perform read/write operations..
  • Re - write some Hive queries to Spark SQL to reduce the overall batch time
Preferred technical and professional experience
  • Understanding of Devops.
  • Experience in building scalable end-to-end data ingestion and processing solutions
  • Experience with object-oriented and/or functional programming languages, such as Python, Java and Scala

Employment Type: Full Time, Permanent

Read full job description

IBM Interview Questions & Tips

Prepare for IBM Data Engineer roles with real interview advice

Top IBM Data Engineer Interview Questions

Q1. 1) How to handle data skewness in spark.
Q2. 5) How to create a kafka topic with replication factor 2
Q3. 4) How to read json data using spark
View all 29 questions

What people at IBM are saying

4.2
 Rating based on 205 Data Engineer reviews

Likes

1. Work-Pertional life balance. 2. Your work recognition. 3. Appreciation of your work. 4. Job security. 5. Opportunity to learn and grow yourself in multiple technology and tools.

  • Salary - Good
  • +6 more
Dislikes

1. All the mentioned benefits are depending on project basis, its not a universal.

Read 205 Data Engineer reviews

Data Engineer salary at IBM

reported by 2.8k employees
₹3.2 L/yr - ₹24.3 L/yr
28% more than the average Data Engineer Salary in India
View more details

What IBM employees are saying about work life

based on 22k employees
78%
84%
66%
79%
Flexible timing
Monday to Friday
No travel
Day Shift
View more insights

IBM Benefits

Work From Home
Soft Skill Training
Health Insurance
Job Training
Cafeteria
Free Transport +6 more
View more benefits

Compare IBM with

Oracle

3.7
Compare

TCS

3.7
Compare

Cognizant

3.8
Compare

Accenture

3.8
Compare

Infosys

3.6
Compare

Capgemini

3.7
Compare

Wipro

3.7
Compare

Deloitte

3.8
Compare

Google

4.4
Compare

Amazon

4.1
Compare

Amdocs

3.7
Compare

SAP

4.2
Compare

Microsoft Corporation

4.0
Compare

Tech Mahindra

3.5
Compare

PwC

3.4
Compare

Ernst & Young

3.4
Compare

Nagarro

4.0
Compare

NetApp

3.9
Compare

Salesforce

4.0
Compare

SAS

4.4
Compare

Similar Jobs for you

Data Engineer at IBM India Pvt. Limited

Kochi

4-9 Yrs

₹ 6-11 LPA

Data Engineer at IBM India Pvt. Limited

Kochi

4-9 Yrs

₹ 6-11 LPA

Data Engineer at IBM India Pvt. Limited

Kochi

4-9 Yrs

₹ 6-11 LPA

Data Engineer at IBM India Pvt. Limited

Kochi

4-9 Yrs

₹ 6-11 LPA

Data Engineer at IBM India Pvt. Limited

Hyderabad / Secunderabad

3-6 Yrs

₹ 5-9 LPA

Data Engineer at IBM India Pvt. Limited

Pune

2-6 Yrs

₹ 5-8 LPA

Data Platform Engineer at Accenture Solutions Pvt Ltd

Kolkata

2-6 Yrs

₹ 7-11 LPA

AWS Data Engineer at Fusion Plus Solutions Inc

Hyderabad / Secunderabad

2-5 Yrs

₹ 4-7 LPA

Data Engineer at IBM India Pvt. Limited

Pune

3-5 Yrs

₹ 5-10 LPA

Data Engineer at IBM India Pvt. Limited

Pune

2-4 Yrs

₹ 4-7 LPA

Data Engineer-Data Platforms-AWS

2-4 Yrs

Kochi

4hr ago·via naukri.com

Application Developer-ServiceNow

3-5 Yrs

Bangalore / Bengaluru

4hr ago·via naukri.com

Application Developer-DevOps

3-5 Yrs

Pune

4hr ago·via naukri.com

Application Architect-Microsoft .Net

7-11 Yrs

Bangalore / Bengaluru

4hr ago·via naukri.com

Application Developer-Microsoft .NET Stack

4-6 Yrs

Coimbatore

4hr ago·via naukri.com

Application Architect- Business Intelligence

6-10 Yrs

Hyderabad / Secunderabad

4hr ago·via naukri.com

Application Developer-Microsoft .NET Stack

4-6 Yrs

Mysuru / Mysore

4hr ago·via naukri.com

Application Developer-Microsoft Power Platform

3-4 Yrs

Pune

4hr ago·via naukri.com

Application Developer-Microsoft .NET Stack

4-6 Yrs

Mysuru / Mysore

4hr ago·via naukri.com

Application Developer - MuleSoft

5-7 Yrs

Mysuru / Mysore

4hr ago·via naukri.com
write
Share an Interview