Orange Business Senior Data Engineer Interview Questions and Answers

Q1. Windows function-related questions.
Add your answer
Q2. Join Related Questions.
Add your answer

Q1. Join related Questions
Add your answer
Q2. Subqueries related queations.
Add your answer

Q1. How do you utilize the enhanced optimization option in AWS Glue?
Ans. 
Enhanced optimization in AWS Glue improves job performance by automatically adjusting resources based on workload
• Enhanced optimization in AWS Glue automatically adjusts resources like DPUs based on workload

• It helps improve job performance by optimizing resource allocation

• Users can enable enhanced optimization in AWS Glue job settings
Answered by AI
Add your answer
Q2. What are the best practices for optimizing querying in Amazon Redshift?
Ans. 
Optimizing querying in Amazon Redshift involves proper table design, distribution keys, sort keys, and query optimization techniques.
• Use appropriate distribution keys to evenly distribute data across nodes for parallel processing.

• Utilize sort keys to physically order data on disk, reducing the need for sorting during queries.

• Avoid using SELECT * and instead specify only the columns needed to reduce data transfer.

• Use AN...read more
Answered by AI
Add your answer

Q1. Adf,etl,python,adb
Add your answer

Q1. More questions on spark and java
Add your answer
Q2. More questions on sql
Add your answer

Q1. Over all project architecture
Add your answer
Q2. Sample data and its transformations
Ans. 
Sample data and its transformations
• Sample data can be in the form of CSV, JSON, or database tables

• Transformations include cleaning, filtering, aggregating, and joining data

• Examples: converting date formats, removing duplicates, calculating averages
Answered by AI
Add your answer

Q1. Why are u leaving current job
Ans. 
Seeking new challenges and opportunities for growth in a more dynamic environment.
• Looking for new challenges and opportunities for growth

• Seeking a more dynamic work environment

• Interested in expanding skill set and knowledge

• Want to work on more innovative projects
Answered by AI
Add your answer

Q1. What is scd type 2?
Ans. 
SCD type 2 is a method used in data warehousing to track historical changes by creating a new record for each change.
• SCD type 2 stands for Slowly Changing Dimension type 2

• It involves creating a new record in the dimension table whenever there is a change in the data

• The old record is marked as inactive and the new record is marked as current

• It allows for historical tracking of changes in data over time

• Example: If a cust...read more
Answered by AI
Add your answer
Q2. Pyspark question read CSV from folder and add column in each csv file and write it to different location.
Add your answer

Python and Spark code

Q1. Spark and Cloud question
Add your answer

Q1. Based on client interview
Add your answer

Q1. HR question and salary discussion.
Add your answer

Normal aptitude test

Q1. Technical discussion on big data and some programing problem
Add your answer

Q1. 2nd technical discussion based on project, big data and python
Add your answer

Q1. Normal HR discussion and salary negotiation
Add your answer

Platform - Hackerank
Duration - 2 Hours
Topics - Spark and SQL

Q1. What are the common file formats used in data storages? Which one is best for compression?
Ans. 
Common file formats used in data storages include CSV, JSON, Parquet, Avro, and ORC. Parquet is best for compression.
• CSV (Comma-Separated Values) - simple and widely used, but not efficient for large datasets

• JSON (JavaScript Object Notation) - human-readable and easy to parse, but can be inefficient for storage

• Parquet - columnar storage format that is highly efficient for compression and query performance

• Avro - efficie...read more
Answered by AI
Add your answer
Q2. SQL Problem - Given the empoyee attendance table, write a query to print the employees who is abscent for more than cosecutive 10 days in their tenure.
Add your answer
Q3. Given the list of words, write the Python program to print the most repeating substring out of all words.
Ans. 
Python program to find the most repeating substring in a list of words.
• Iterate through each word in the list

• Generate all possible substrings for each word

• Count the occurrences of each substring using a dictionary

• Find the substring with the highest count
Answered by AI
Add your answer