Blackstraw AI Data Engineer Interview Questions and Answers

Q1. How to decide upon Spark cluster sizing?
Ans. 
Spark cluster sizing depends on workload, data size, memory requirements, and processing speed.
• Consider the size of the data being processed

• Take into account the memory requirements of the Spark jobs

• Factor in the processing speed needed for the workload

• Scale the cluster based on the number of nodes and cores required

• Monitor performance and adjust cluster size as needed
Answered by AI
Add your answer
Q2. Question on Spark internals
Add your answer

Implement a pipeline based on given conditions and data requirement

Q1. There were no questions as such. They want me join on very next day when the HR discussion was over and started itimidating me with aggressive approach even without discussing the salary part and the benef...read more
Add your answer

I cannot recall the platform, but it featured a combination of Python and SQL questions, with the majority being focused on SQL.

Q1. SQL basics like Indexes, Clustering, Keys, Data warehousing concepts, Normalization and Denormalization etc..
Add your answer
Q2. SQL coding questions
Add your answer

Q1. SQL questions to solve using different types of joins
Add your answer
Q2. Questions based on project and data quality checks
Add your answer

Q1. Behavioral questions
Add your answer
Q2. Culture fit
Add your answer

In the first round they ask some technical mcq and gave some coding questions in python and SQL.there were less aptitude questions.

Q1. Just asking simple string based questions and some difficult sql questions .it was 1hr section.
Add your answer
Q2. Groupby having, joins like inner outer left right
Add your answer
Q3. Most frequent word in a sentence ?
Ans. 
The most frequent word in a sentence can be found by counting the occurrence of each word and selecting the one with the highest count.
• Split the sentence into words using whitespace as delimiter

• Create a dictionary to store the count of each word

• Iterate through the words and update the count in the dictionary

• Find the word with the highest count in the dictionary
Answered by AI
Add your answer
Q4. Given some tables and extract the values between some values and fileter by some values
Add your answer

Simple mcq's and coding

Q1. In depth question on your work
Add your answer

Q1. Detailed question of your tech stack advancement
Add your answer

Q1. Work culture, location
Add your answer

Q1. Explain spark architecture
Ans. 
Spark architecture is a distributed computing framework that consists of a driver program, cluster manager, and worker nodes.
• Consists of a driver program that manages the execution of tasks

• Utilizes a cluster manager to allocate resources and schedule tasks

• Worker nodes execute the tasks and store data in memory or disk

• Supports fault tolerance through resilient distributed datasets (RDDs)
Answered by AI
Add your answer

Q1. Different type of license in power bi. Data Modelling.
Ans. 
Power BI offers different types of licenses for data modeling, including Power BI Pro and Power BI Premium.
• Power BI Pro license allows users to create and share reports and dashboards with others.

• Power BI Premium license offers additional features such as larger data capacity and advanced AI capabilities.

• Power BI Embedded license is designed for embedding reports and dashboards into custom applications.

• Power BI Report ...read more
Answered by AI
Add your answer

Q1. What abt you know tiger
Add your answer
Q2. General hr questions
Add your answer

Q1. Spark Architecture
Add your answer
Q2. Data warehousing
Add your answer