Add office photos
i
IBM
CompareProud winner of ABECA 2024 - AmbitionBox Employee Choice Awards
Filter interviews by
IBM Big Data Engineer Interview Questions and Answers
IBM Big Data Engineer Interview Experiences
3 interviews found
Anonymous
Selected
I applied via Naukri.com and was interviewed in Jun 2022. There were 4 interview rounds.
(1 Question)
- Q1. Scenario based questions
(1 Question)
- Q1. Project explanation , internal vs external table
- Ans.
Internal tables are managed by Hive, while external tables are managed by the user.
Internal tables are stored in a Hive-managed warehouse directory, while external tables can be stored anywhere.
Internal tables are deleted when the table is dropped, while external tables are not.
External tables can be used to access data stored in non-Hive formats, such as CSV or JSON.
Internal tables are typically used for temporary or ...
(1 Question)
- Q1. What is your current salary and your expectations
Interview Preparation Tips
- Spark,Hive ,Scala
I applied via Naukri.com and was interviewed in Jan 2021. There were 5 interview rounds.
Interview Questionnaire
2 Questions
- Q1. Mostly on Hive, scala questions for first round which is of 43 theory questions and one coding question was asked for
- Q2. 2nd and 3rd round would be on F2F online technical round where it was completely conversing about your project and the stuffs you had used while working. It would basically purely on your work experience s...
Interview Preparation Tips
Prashant Kumar
I applied via Referral and was interviewed before Nov 2020. There were 4 interview rounds.
Interview Questionnaire
3 Questions
- Q1. Spark architecture, Optimization technique , Hive , sql query
- Q2. Python programming for list and string
- Ans.
Python has built-in functions for manipulating lists and strings.
Lists are mutable and can be modified using various methods like append(), insert(), remove(), etc.
Strings are immutable and can be manipulated using slicing, concatenation, and various string methods.
List comprehension and string formatting are powerful tools for working with lists and strings.
Python also has powerful libraries like NumPy and Pandas for
- Q3. Unix and shell scripting
Interview Preparation Tips
Skills evaluated in this interview
What people are saying about IBM
Interview questions from similar companies
Selected
I applied via Naukri.com and was interviewed in Aug 2024. There were 2 interview rounds.
(2 Questions)
- Q1. All type of joins with example
- Ans.
Different types of joins in SQL with examples
Inner Join: Returns rows when there is a match in both tables
Left Join: Returns all rows from the left table and the matched rows from the right table
Right Join: Returns all rows from the right table and the matched rows from the left table
Full Outer Join: Returns all rows when there is a match in either table
- Q2. How to handle large spark datasets
- Ans.
Large Spark datasets can be handled by partitioning, caching, optimizing transformations, and tuning resources.
Partitioning data to distribute workload evenly across nodes
Caching frequently accessed data to avoid recomputation
Optimizing transformations to reduce unnecessary processing
Tuning resources like memory allocation and parallelism for optimal performance
(2 Questions)
- Q1. How do you tune sparks configuration setting's to optimize query performance
- Ans.
Spark configuration settings can be tuned to optimize query performance by adjusting parameters like memory allocation, parallelism, and caching.
Increase executor memory and cores to allow for more parallel processing
Adjust shuffle partitions to optimize data shuffling during joins and aggregations
Enable dynamic allocation to scale resources based on workload demands
Utilize caching to store intermediate results and avo...
- Q2. What strategies do you use to handle data skew and partition imbalance in spark
- Ans.
To handle data skew and partition imbalance in Spark, strategies include using salting, bucketing, repartitioning, and optimizing join operations.
Use salting to evenly distribute skewed keys across partitions
Implement bucketing to pre-partition data based on a specific column
Repartition data based on a specific key to balance partitions
Optimize join operations by broadcasting small tables or using partitioning strategi
Skills evaluated in this interview
I applied via Company Website and was interviewed in Sep 2024. There was 1 interview round.
(3 Questions)
- Q1. Big Data fundamentals concepts on rdd, dataframe and datasets.
- Q2. Spark optimization techniques
- Ans.
Spark optimization techniques involve partitioning, caching, and tuning resource allocation.
Partitioning data to distribute workload evenly
Caching frequently accessed data to avoid recomputation
Tuning resource allocation for optimal performance
- Q3. SQL queries on windows function and joins.
Interview Preparation Tips
Skills evaluated in this interview
I applied via Company Website and was interviewed in Apr 2024. There were 3 interview rounds.
(2 Questions)
- Q1. Mostly about spark topics like shuffeling joins, data skew, and pyspark scenarios
- Q2. Mostly about python and sql scenarios
(2 Questions)
- Q1. About behavioural questions
- Q2. Day to day work and workflow model based questions
(2 Questions)
- Q1. Why you need to join infosys
- Ans.
I want to join Infosys because of its reputation for innovation and growth opportunities.
Infosys is known for its cutting-edge technology solutions and innovative projects.
I am impressed by Infosys' commitment to employee development and career growth.
I believe that joining Infosys will provide me with the opportunity to work on challenging projects and enhance my skills.
- Q2. Self introduction
Interview Preparation Tips
I applied via Company Website and was interviewed in Apr 2024. There were 3 interview rounds.
Questions on software and system designs
Helps employer identify particular personality traits like leadership, confidence, interpersonal and teamwork skills of potential employees
(2 Questions)
- Q1. Why do you want this job? Again, companies want to hire people who are passionate about the job, so you should have a great answer about why you want the ...
- Q2. This opportunity can help me in many ways to boost my confidence as well as drive my career forward
Interview Preparation Tips
- The role of technology in educat
Job Search Tips & Resources
More questions about coding in sql & pyspark
Interview Preparation Tips
Murugan R
Selected
I applied via Job Portal and was interviewed in Sep 2023. There were 3 interview rounds.
Easy only so prepare well that's it
(5 Questions)
- Q1. What method you use
- Ans.
I use a combination of programming languages, tools, and frameworks to analyze and process large datasets.
Utilize programming languages like Python, Java, or Scala for data processing
Leverage tools like Hadoop, Spark, or Kafka for distributed computing
Implement frameworks like MapReduce or Apache Flink for data analysis
Use SQL or NoSQL databases for data storage and retrieval
- Q2. Why you lleave current company
- Q3. What skill you have
- Q4. Tell about ur project
- Q5. What you implemented
- Ans.
Implemented a real-time data processing system using Apache Kafka and Spark for analyzing customer behavior.
Developed data pipelines to ingest, process, and analyze large volumes of data
Utilized Apache Kafka for real-time data streaming
Implemented machine learning algorithms for predictive analytics
Optimized data storage and retrieval for faster query performance
Interview Preparation Tips
Skills evaluated in this interview
Manshi Raghuvanshi
(1 Question)
- Q1. Coalesce vs repartition
- Ans.
Coalesce is used to reduce the number of partitions in a DataFrame, while repartition is used to increase the number of partitions.
Coalesce is a narrow transformation that can only decrease the number of partitions without shuffling data.
Repartition is a wide transformation that can both increase or decrease the number of partitions and involves shuffling data across the cluster.
Coalesce is more efficient for reducing ...
Rank vs dense rank quetions ctes
Python data structure
IBM Interview FAQs
Tell us how to improve this page.
IBM Interviews By Designations
- IBM Application Developer Interview Questions
- IBM Software Developer Interview Questions
- IBM Associate Systems Engineer Interview Questions
- IBM Software Engineer Interview Questions
- IBM Advisory System Analyst Interview Questions
- IBM Data Engineer Interview Questions
- IBM Senior Systems Engineer Interview Questions
- IBM Senior Software Engineer Interview Questions
- Show more
Interview Questions for Popular Designations
People are getting interviews through
Big Data Engineer Interview Questions from Similar Companies
Fast track your campus placements
IBM Big Data Engineer Reviews and Ratings
based on 20 reviews
Rating in categories
|
Application Developer
11.5k
salaries
|  ₹5.5 L/yr - ₹23.6 L/yr |
|
Software Engineer
5.4k
salaries
| ₹4.8 L/yr - ₹22.6 L/yr |
|
Advisory System Analyst
5.2k
salaries
| ₹9.2 L/yr - ₹27 L/yr |
|
Senior Software Engineer
5k
salaries
| ₹8 L/yr - ₹30 L/yr |
|
Senior Systems Engineer
4.6k
salaries
| ₹5.6 L/yr - ₹18.5 L/yr |
Oracle
TCS
Cognizant
Accenture
Calculate your in-hand salary
- Home >
- Interviews >
- IBM Interview Questions >
- IBM Big Data Engineer Interview Questions
