90+ IBM Data Engineer Interview Questions & Answers | Complete Prep Guide 2025

IBM Data Engineer Interview Experiences

41 interviews found

Data Engineer Interview Questions & Answers

Anonymous

posted on 4 Jun 2022

I applied via Recruitment Consulltant and was interviewed before Jun 2021. There were 3 interview rounds.

Round 1 - Resume Shortlist

Pro Tip by AmbitionBox:

Keep your resume crisp and to the point. A recruiter looks at your resume for an average of 6 seconds, make sure to leave the best impression.

View all Resume tips

Round 2 - Technical

(2 Questions)

Q1. I have given interview on Pyspark. So everything related to Pyspark ranging from Architecture, Aggregations, Performance Enhancements, Spark SQL, a live SQL query in Pyspark etc.

Add your answer

Q2. Basic to intermediate SQL queries

Add your answer

Round 3 - One-on-one

(1 Question)

Q1. Current, Expected, Gap in career.

Add your answer

Interview Preparation Tips

Interview preparation tips for other job seekers - Prepare for Technical questions Conceptually as well programmatically. Be confident that they don't have to doubt on proxy.

Data Engineer Interview Questions & Answers

Anonymous

posted on 28 Jul 2021

Interview Questionnaire

5 Questions

Q1. 1) How to handle data skewness in spark.

Ans.

Data skewness in Spark can be handled by partitioning, bucketing, or using salting techniques.

Partitioning the data based on a key column can distribute the data evenly across the nodes.
Bucketing can group the data into buckets based on a key column, which can improve join performance.
Salting involves adding a random prefix to the key column, which can distribute the data evenly.
Using broadcast joins for small tables c...

Answered by AI

View 4 more answers

Q2. 2) Difference between partitioning and Bucketing

Ans.

Partitioning is dividing data into smaller chunks based on a column value. Bucketing is dividing data into equal-sized buckets based on a hash function.

Partitioning is used for organizing data for efficient querying and processing.
Bucketing is used for evenly distributing data across nodes in a cluster.
Partitioning is done based on a column value, such as date or region.
Bucketing is done based on a hash function, such ...

Answered by AI

View 1 more answer

Q3. 3) Difference between cache and persistent storage

Ans.

Cache is temporary storage used to speed up access to frequently accessed data. Persistent storage is permanent storage used to store data even after power loss.

Cache is faster but smaller than persistent storage
Cache is volatile and data is lost when power is lost
Persistent storage is non-volatile and data is retained even after power loss
Examples of cache include CPU cache, browser cache, and CDN cache
Examples of per...

Answered by AI

View 2 more answers

Q4. 4) How to read json data using spark

Ans.

To read JSON data using Spark, use the SparkSession.read.json() method.

Create a SparkSession object
Use the read.json() method to read the JSON data
Specify the path to the JSON file or directory containing JSON files
The resulting DataFrame can be manipulated using Spark's DataFrame API

Answered by AI

View 2 more answers

Q5. 5) How to create a kafka topic with replication factor 2

Ans.

To create a Kafka topic with replication factor 2, use the command line tool or Kafka API.

Use the command line tool 'kafka-topics.sh' with the '--replication-factor' flag set to 2.
Alternatively, use the Kafka API to create a topic with a replication factor of 2.
Ensure that the number of brokers in the Kafka cluster is greater than or equal to the replication factor.
Consider setting the 'min.insync.replicas' configurati...

Answered by AI

Add your answer

Skills evaluated in this interview

Data Engineer Interview Questions & Answers

Anonymous

posted on 15 Sep 2021

Interview Questionnaire

3 Questions

Q1. They asked me technology based questions i.e. opentext exstream .

Add your answer

Q2. They asked if I am comfortable to relocate.

Add your answer

Q3. They asked me what's my expected package.

Add your answer

Interview Preparation Tips

Interview preparation tips for other job seekers - Whatever package you expect , ask atleast 10-20% more than that because they will negotiate your package to take it down for sure.

What people are saying about IBM

View All

a servicenow developer

Salary Negotiation

Hi Everyone I am working as a ServiceNow Developer with 6.75 LPA ( 6.1 fixed ) . I got an offer from PWC with 10.5 LPA fixed + 20% variable and I accepted the offer. Now I got another offer from IBM w... read more

Got a question about IBM?

Ask anonymously on communities.

Data Engineer Interview Questions & Answers

Anonymous

posted on 14 Apr 2023

Interview experience

Good

Difficulty level

Moderate

Process Duration

2-4 weeks

Result

Selected

I applied via Naukri.com and was interviewed before Apr 2022. There were 4 interview rounds.

Round 1 - Resume Shortlist

Pro Tip by AmbitionBox:

Keep your resume crisp and to the point. A recruiter looks at your resume for an average of 6 seconds, make sure to leave the best impression.

View all Resume tips

Round 2 - Technical

(1 Question)

Q1. I was asked on the basic concepts of AWS and Python

Add your answer

Round 3 - Technical

(1 Question)

Q1. It was more of scenario based questions

Add your answer

Round 4 - HR

(1 Question)

Q1. A senior manager interviewed me on projects and my choice and flexibility of work.

Add your answer

Interview Preparation Tips

Interview preparation tips for other job seekers - Focus on your project details and architecture

Data Engineer Interview Questions & Answers

Anonymous

posted on 11 Apr 2023

Interview experience

Good

Difficulty level

Moderate

Process Duration

Less than 2 weeks

Result

Selected

I applied via Referral and was interviewed before Apr 2022. There were 2 interview rounds.

Round 1 - Resume Shortlist

Pro Tip by AmbitionBox:

Keep your resume crisp and to the point. A recruiter looks at your resume for an average of 6 seconds, make sure to leave the best impression.

View all Resume tips

Round 2 - Technical

(2 Questions)

Q1. Based on the technology we worked on and covered all scenarios in my technology and giving complex scenario to solve it

Add your answer

Q2. Mostly checking technology and speaking skills .

Add your answer

Interview Preparation Tips

Interview preparation tips for other job seekers - Prepare well in the technology you are looking and maintain good communication skills

Get interview-ready with Top IBM Interview Questions

Data Engineer Interview Questions & Answers

Anonymous

posted on 24 Sep 2021

I applied via Naukri.com and was interviewed in Aug 2021. There were 3 interview rounds.

Interview Questionnaire

2 Questions

Q1. What is difference between union vs union all

Ans.

Union combines and removes duplicates, Union All combines all rows including duplicates.

Union merges two tables and removes duplicates
Union All merges two tables and includes duplicates
Union is slower than Union All as it removes duplicates
Syntax: SELECT column1, column2 FROM table1 UNION/UNION ALL SELECT column1, column2 FROM table2
Example: SELECT name FROM table1 UNION SELECT name FROM table2

Answered by AI

View 1 more answer

Q2. Delete vs truncate vs drop

Ans.

Difference between delete, truncate and drop in SQL

DELETE removes specific rows from a table
TRUNCATE removes all rows from a table
DROP removes the entire table from the database

Answered by AI

Add your answer

Interview Preparation Tips

Interview preparation tips for other job seekers - It was good and clinical

Skills evaluated in this interview

Data Engineer Jobs at IBM

View all

Data Engineer-Data Platforms-Google

Gurgaon / Gurugram

7-12 Yrs

Not Disclosed

Data Engineer-Data Platforms

Hyderabad / Secunderabad

2-5 Yrs

Not Disclosed

Data Engineer-Data Integration

Hyderabad / Secunderabad

2-5 Yrs

Not Disclosed

Data Engineer-Data Integration

Pune

2-5 Yrs

₹ 5.5-25 LPA

Data Engineer - Data Platforms

Pune

2-5 Yrs

₹ 3.65-25 LPA

Data Engineer-Data Integration

Hyderabad / Secunderabad

2-5 Yrs

Not Disclosed

Data Engineer Interview Questions & Answers

Anonymous

posted on 6 Jul 2021

I applied via Recruitment Consultant and was interviewed in Jun 2021. There were 3 interview rounds.

Interview Questionnaire

2 Questions

Q1. Basic and Intermediate questions about SQL,SSIS and Azure.

Add your answer

Q2. Why there are 2 keys available in azure resources

Ans.

Two keys are available in Azure resources for security purposes.

One key is used for authentication and the other for authorization.
Authentication key is used to verify the identity of the user or application accessing the resource.
Authorization key is used to grant or deny access to specific resources or actions.
Having two keys adds an extra layer of security to Azure resources.
Examples of Azure resources that use two

Answered by AI

Add your answer

Interview Preparation Tips

Interview preparation tips for other job seekers - Only one technical round followed by PMO and HR discussion.

Skills evaluated in this interview

Data Engineer Interview Questions & Answers

Anonymous

posted on 31 May 2021

I applied via Walk-in and was interviewed in May 2021. There were 4 interview rounds.

Interview Questionnaire

1 Question

Q1. Spark / scala / AWS / Bigdata

Add your answer

Interview Preparation Tips

Interview preparation tips for other job seekers - Domain specific strong knowledge in theoretical as well as coding perspective knowledge is necessary to crack the interview.

Data Engineer Interview Questions & Answers

Anonymous

posted on 9 Dec 2021

I applied via Naukri.com and was interviewed before Dec 2020. There were 3 interview rounds.

Interview Questionnaire

2 Questions

Q1. What are your project experiences

Add your answer

Q2. What are the tech stacks you've worked with

Ans.

I have worked with tech stacks such as Hadoop, Spark, Kafka, AWS, and SQL.

Experience with Hadoop ecosystem including HDFS, MapReduce, Hive, and Pig
Proficient in Spark for data processing and analysis
Worked with Kafka for real-time data streaming
Familiar with AWS services such as EC2, S3, and EMR
Strong SQL skills for data querying and manipulation

Answered by AI

Add your answer

Interview Preparation Tips

Interview preparation tips for other job seekers - Elaborate your project and its architecture vastly also try to go through all the tech stack you've ever worked on.

Data Engineer Interview Questions & Answers

Anonymous

posted on 15 Sep 2022

I applied via Approached by Company and was interviewed before Sep 2021. There were 4 interview rounds.

Round 1 - Resume Shortlist

Pro Tip by AmbitionBox:

Keep your resume crisp and to the point. A recruiter looks at your resume for an average of 6 seconds, make sure to leave the best impression.

View all Resume tips

Round 2 - Coding Test

Hackarrank questions, practice more of it

Round 3 - Technical

(1 Question)

Q1. Coding questions, about cloud experience

Add your answer

Round 4 - HR

(2 Questions)

Q1. It was mixed of HR and technical

Add your answer

Q2. Why do want to join IBM

Add your answer

Interview Preparation Tips

Interview preparation tips for other job seekers - Be thorough about your resume,
Good technical knowledge is a must.
Try to prove that you will do whatever it takes to complete your tasks.

IBM Interview FAQs

How many rounds are there in IBM Data Engineer interview?

IBM interview process usually has 2-3 rounds. The most common rounds in the IBM interview process are Technical, One-on-one Round and Resume Shortlist.

How to prepare for IBM Data Engineer interview?

Go through your CV in detail and study all the technologies mentioned in your CV. Prepare at least two technologies or languages in depth if you are appearing for a technical interview at IBM. The most common topics and skills that interviewers at IBM expect are Python, Unix Shell Scripting, Big Data, SQL and Interpersonal Skills.

What are the top questions asked in IBM Data Engineer interview?

Some of the top questions asked at the IBM Data Engineer interview -

1) How to handle data skewness in spar...read more
5) How to create a kafka topic with replication facto...read more
4) How to read json data using sp...read more

How long is the IBM Data Engineer interview process?

The duration of IBM Data Engineer interview process can vary, but typically it takes about less than 2 weeks to complete.

Tell us how to improve this page.

IBM Interviews By Designations

Interview Questions for Popular Designations

IBM Data Engineer Interview Process

based on 40 interviews

3 Interview rounds

Technical Round - 1
Technical Round - 2
Personal Interview1 Round

TCS Data Engineer Interview Questions

3.7

• 89 Interviews

Accenture Data Engineer Interview Questions

3.8

• 78 Interviews

LTIMindtree Data Engineer Interview Questions

3.8

• 61 Interviews

Capgemini Data Engineer Interview Questions

3.7

• 33 Interviews

Cognizant Data Engineer Interview Questions

3.8

• 30 Interviews

Infosys Data Engineer Interview Questions

3.6

• 24 Interviews

Wipro Data Engineer Interview Questions

3.7

• 24 Interviews

Tech Mahindra Data Engineer Interview Questions

3.5

• 15 Interviews

HCLTech Data Engineer Interview Questions

3.5

• 12 Interviews

Genpact Data Engineer Interview Questions

3.8

• 8 Interviews

View all

National Institute of Technology (NIT), Warangal Placement Questions

27 Interviews

Indian Institute of Technology (IIT), Chennai Placement Questions

14 Interviews

Veermata Jijabai Technological Institute (VJTI), Mumbai Placement Questions

4 Interviews

Indian Institute of Technology (IIT), Kanpur Placement Questions

3 Interviews

Indian Institute of Technology (IIT), Kharagpur Placement Questions

3 Interviews

Sastra University Placement Questions

3 Interviews

NBKR Institute of Science and Technology, Vidyanagar Placement Questions

2 Interviews

View all

IBM Data Engineer Salary

based on 2.8k salaries

₹5.9 L/yr - ₹25.3 L/yr

33% more than the average Data Engineer Salary in India

View more details

Data Engineer Jobs at IBM

Data Engineer-Data Platforms-Google

Gurgaon / Gurugram

7-12 Yrs

Not Disclosed

Data Engineer-Data Platforms

Hyderabad / Secunderabad

2-5 Yrs

Not Disclosed

Data Engineer-Data Integration

Hyderabad / Secunderabad

2-5 Yrs

Not Disclosed

Explore more jobs

IBM Salaries in India

Application Developer 11.7k salaries	₹0 L/yr - ₹0 L/yr
Software Engineer 5.5k salaries	₹0 L/yr - ₹0 L/yr
Advisory System Analyst 5.2k salaries	₹0 L/yr - ₹0 L/yr
Senior Software Engineer 5k salaries	₹0 L/yr - ₹0 L/yr
Senior Systems Engineer 4.5k salaries	₹0 L/yr - ₹0 L/yr