Merilytics Data Engineer 2 Interview Questions and Answers

Q1. Components of Databricks
Ans. 
Databricks is a unified data analytics platform that includes components like Databricks Workspace, Databricks Runtime, and Databricks Delta.
• Databricks Workspace: Collaborative environment for data science and engineering teams.

• Databricks Runtime: Optimized Apache Spark cluster for data processing.

• Databricks Delta: Unified data management system for data lakes.
Answered by AI
Add your answer
Q2. How to read a json file
Ans. 
To read a JSON file, use a programming language's built-in functions or libraries to parse the file and extract the data.
• Use a programming language like Python, Java, or JavaScript to read the JSON file.

• Import libraries like json in Python or json-simple in Java to parse the JSON data.

• Use functions like json.load() in Python to load the JSON file and convert it into a dictionary or object.

• Access the data in the JSON fi...read more
Answered by AI
Add your answer
Q3. Second highest salary SQL
Ans. 
To find the second highest salary in SQL, use the MAX function with a subquery or the LIMIT clause.
• Use the MAX function with a subquery to find the highest salary first, then use a WHERE clause to exclude it and find the second highest salary.

• Alternatively, use the LIMIT clause to select the second highest salary directly.

• Make sure to handle cases where there may be ties for the highest salary.
Answered by AI
Add your answer
Q4. How to configure the spark while creating the cluster
Ans. 
Spark cluster configuration involves setting up memory, cores, and other parameters for optimal performance.
• Specify the number of executors and executor memory

• Set the number of cores per executor

• Adjust the driver memory based on the application requirements

• Configure shuffle partitions for efficient data processing

• Enable dynamic allocation for better resource utilization
Answered by AI
Add your answer

Q1. NLP based question
Add your answer

Q1. Basic SQL questions and Window fuctions
Add your answer

Q1. HR asked how was the interview last round and gave me feedback
Add your answer

Aptitude test has 70 questions to be done in 75 minutes. It's moderately tough but not very tough with right amount of preparation

I was from non-cs background so coding round was not mandatory but for cs people it was mandatory to clear it. It has SQL and python and they were easy to moderate. I am a fresher (imagineer) so we had to go this interview process

Q1. The interviewer was really nice and that went so smooth for me. 1. Asked questions from IC Engines and stuff 😄, as I was from mechanical 2.In coding, Sorting and Oops concepts were asked 3. Guessimates ...read more
Add your answer

Q1. Typical HR questions
Add your answer

1 hour, 2 coding and 20 MCQs

Q1. 1 hour deep discussion on data engineering
Add your answer

Q1. Salary discussion, company policies etc
Add your answer

Q1. Sql questions and python
Add your answer

Q1. About last projects
Add your answer

Q1. SQL query on joins, window function, remove duplicates, 2nd highest rank
Add your answer
Q2. Azure Data Factory, ETL questions
Add your answer

Q1. SQL, python technical questions
Add your answer
Q2. Managerial questions
Add your answer

Q1. Strength and weakness
Add your answer
Q2. Typical hr questions
Add your answer

Quantitative Analysis, Data Interpretation, Logical Reasoning

They give you SQL assignment to complete based on that select for technical interview

Q1. What are window functions in SQL
Ans. 
Window functions in SQL are used to perform calculations across a set of table rows related to the current row.
• Window functions are used to calculate values based on a set of rows related to the current row.

• They allow you to perform calculations without grouping the rows into a single output row.

• Examples of window functions include ROW_NUMBER(), RANK(), DENSE_RANK(), and NTILE().
Answered by AI
Add your answer
Q2. Difference between group by and distinct
Ans. 
Group by is used to group rows that have the same values into summary rows, while distinct is used to remove duplicate rows from a result set.
• Group by is used with aggregate functions like COUNT, SUM, AVG, etc.

• Distinct is used to retrieve unique values from a column or set of columns.

• Group by is used to perform operations on groups of rows, while distinct is used to filter out duplicate rows.

• Group by is used in conjunc...read more
Answered by AI
Add your answer