AmbitionBox
Interview Questions
- Reviews
- Salaries
- Interview Questions
- About Company
- Benefits
- Jobs
- Office Photos
- Community
Add office photos
i
IBM
Compare
Proud winner of ABECA 2024 - AmbitionBox Employee Choice Awards
Filter interviews by
IBM Senior Data Engineer Interview Questions, Process, and Tips
Top IBM Senior Data Engineer Interview Questions and Answers
- Q1. Big data Hadoop architecture and HDFS commands to copy and list files in hdfs spark architecture and Transformation and Action question what happen when we submit spark p ...read more
- Q2. what are the optimization techniques used in your project
- Q3. Difficulties I have faced during during ETL pipelines
IBM Senior Data Engineer Interview Experiences
7 interviews found
Anonymous
Selected
I applied via Naukri.com and was interviewed in Oct 2022. There were 2 interview rounds.
(2 Questions)
- Q1. Big data Hadoop architecture and HDFS commands to copy and list files in hdfs spark architecture and Transformation and Action question what happen when we submit spark program spark dataframe coding que...
- Ans.
Questions on big data, Hadoop, Spark, Scala, Git, project and Agile.
Hadoop architecture and HDFS commands for copying and listing files in HDFS
Spark architecture and Transformation and Action question
What happens when we submit a Spark program
Spark DataFrame coding question
Scala basic program on List
Git and Github
Project-related question
Agile-related
- Q2. What happen when we submit spark program spark dataframe coding quesiton scala basic program on list git and github project related question agile related
Interview Preparation Tips
Skills evaluated in this interview
Selected
I was interviewed in Aug 2024.
Python and sql tasks
(2 Questions)
- Q1. Project related questions
- Q2. Coding questions on pyspark windows
(1 Question)
- Q1. Managerial discussions, mostly in and around the previous projects
(2 Questions)
- Q1. Had to write 2 sql queries.
- Q2. One programming question
(2 Questions)
- Q1. Team conflict questions
- Q2. Questions on daya to day life as a data engineer
Interview Preparation Tips
What people are saying about IBM
I applied via Approached by Company and was interviewed in Jun 2024. There were 2 interview rounds.
Python coding question and couple of SQL questions
(3 Questions)
- Q1. Spark Optimization techniques
- Ans.
Spark optimization techniques focus on improving performance and efficiency of Spark jobs.
Partitioning data to optimize parallelism
Caching frequently accessed data
Using broadcast variables for small lookup tables
Avoiding shuffling operations whenever possible
Tuning memory settings for optimal performance
- Q2. Current Project discussions
- Q3. Difficulties I have faced during during ETL pipelines
- Ans.
I have faced difficulties in handling large volumes of data, ensuring data quality, and managing dependencies in ETL pipelines.
Handling large volumes of data can lead to performance issues and scalability challenges.
Ensuring data quality involves dealing with data inconsistencies, errors, and missing values.
Managing dependencies between different stages of the ETL process can be complex and prone to failures.
Skills evaluated in this interview
IBM interview questions for designations
Bigquery Architecture, Project Discussion
Python and SQL questions
(1 Question)
- Q1. Adf,databricks,spark,basic and easy question .rude interviewer with less knowledge
I applied via Naukri.com and was interviewed in May 2022. There was 1 interview round.
(1 Question)
I was asked to do some python code provided by the interviewer and some senario-based SQL queries and a lot of job processing theory and optimization techniques used in my project.
- Q1. What are the optimization techniques used in your project
- Ans.
Optimization techniques used in project
Caching
Parallel processing
Compression
Indexing
Query optimization
Interview Preparation Tips
- Python
- SQL
- Spark
- sqoop
- AWS
Interview questions from similar companies
I was interviewed in Sep 2024.
(3 Questions)
- Q1. Coding in pyspark
- Ans.
Pyspark is a Python library for big data processing using Spark framework.
Pyspark is used for processing large datasets in parallel.
It provides APIs for data manipulation, querying, and analysis.
Example: Using pyspark to read a CSV file and perform data transformations.
- Q2. Databricks optimisation technique
- Ans.
Databricks optimisation techniques improve performance and efficiency of data processing on the Databricks platform.
Use cluster sizing and autoscaling to optimize resource allocation based on workload
Leverage Databricks Delta for optimized data storage and processing
Utilize caching and persisting data to reduce computation time
Optimize queries by using appropriate indexing and partitioning strategies
- Q3. Aqe details in databricks
- Ans.
Databricks is a unified data analytics platform that provides a collaborative environment for data engineers.
Databricks is built on top of Apache Spark and provides a workspace for data engineering tasks.
It allows for easy integration with various data sources and tools for data processing.
Databricks provides features like notebooks, clusters, and libraries for efficient data engineering workflows.
Skills evaluated in this interview
(1 Question)
- Q1. Adf,etl,python,adb
Swati Gawali
I applied via Naukri.com and was interviewed in Sep 2024. There was 1 interview round.
(2 Questions)
- Q1. What is scd type 2?
- Ans.
SCD type 2 is a method used in data warehousing to track historical changes by creating a new record for each change.
SCD type 2 stands for Slowly Changing Dimension type 2
It involves creating a new record in the dimension table whenever there is a change in the data
The old record is marked as inactive and the new record is marked as current
It allows for historical tracking of changes in data over time
Example: If a cust...
- Q2. Pyspark question read CSV from folder and add column in each csv file and write it to different location.
Skills evaluated in this interview
IBM Interview FAQs
Tell us how to improve this page.
IBM Interviews By Designations
- IBM Application Developer Interview Questions
- IBM Software Developer Interview Questions
- IBM Associate Systems Engineer Interview Questions
- IBM Software Engineer Interview Questions
- IBM Advisory System Analyst Interview Questions
- IBM Data Engineer Interview Questions
- IBM Senior Systems Engineer Interview Questions
- IBM Senior Software Engineer Interview Questions
- Show more
Interview Questions for Popular Designations
- Data Engineer Interview Questions
- Big Data Engineer Interview Questions
- Software Engineer Interview Questions
- Senior Software Engineer Interview Questions
- Database Admin Interview Questions
- Data Analyst Interview Questions
- System Engineer Interview Questions
- Associate Software Engineer Interview Questions
- Show more
IBM Senior Data Engineer Interview Process
based on 7 interviews
2 Interview rounds
- Technical Round - 1
- Technical Round - 2
Senior Data Engineer Interview Questions from Similar Companies
Fast track your campus placements
IBM Senior Data Engineer Reviews and Ratings
based on 51 reviews
Rating in categories
|
Application Developer
11.7k
salaries
|  ₹5.5 L/yr - ₹24 L/yr |
|
Software Engineer
5.5k
salaries
| ₹5.5 L/yr - ₹22.5 L/yr |
|
Advisory System Analyst
5.2k
salaries
| ₹9.4 L/yr - ₹29.8 L/yr |
|
Senior Software Engineer
4.8k
salaries
| ₹8 L/yr - ₹30 L/yr |
|
Senior Systems Engineer
4.5k
salaries
| ₹5.7 L/yr - ₹20.8 L/yr |
Oracle
TCS
Cognizant
Accenture
- Home >
- Interviews >
- IBM Interview Questions >
- IBM Senior Data Engineer Interview Questions
