Blackbuck Insights Senior Data Engineer Interview Questions and Answers

Q1. What is dual mode in Power BI
Ans. 
Dual mode in Power BI allows users to switch between DirectQuery and Import modes for data sources.
• Dual mode allows users to combine the benefits of both DirectQuery and Import modes in Power BI.

• Users can switch between DirectQuery and Import modes for different data sources within the same report.

• DirectQuery mode connects directly to the data source for real-time data retrieval, while Import mode loads data into Power...read more
Answered by AI
Add your answer

Q1. All employees having same salary in the smae department sql and pysprk
Add your answer
Q2. How to create pipeline in databricks
Ans. 
To create a pipeline in Databricks, you can use Databricks Jobs or Apache Airflow for orchestration.
• Use Databricks Jobs to create a pipeline by scheduling notebooks or Spark jobs.

• Utilize Apache Airflow for more complex pipeline orchestration with dependencies and monitoring.

• Leverage Databricks Delta for managing data pipelines with ACID transactions and versioning.
Answered by AI
Add your answer
Q3. Palindrome, 2nd char in every word make is to upper case, sql rank and dense rank releated questions , given 2 tables country and city we need to calculate total population in each continent by joining the...read more
Add your answer
Q4. String manuplation questions inpython
Add your answer

Two coding questions

Q1. DBMS questions, keys
Add your answer
Q2. SQL related queries
Add your answer

Coding test was bad. they asked irrelevant things that were not related to the field

Q1. What is data engineering
Ans. 
Data engineering is the process of designing, building, and maintaining the infrastructure for data storage and processing.
• Data engineering involves creating and managing data pipelines

• It includes tasks such as data modeling, data integration, and data warehousing

• Data engineers work with big data technologies such as Hadoop, Spark, and NoSQL databases

• They also ensure data quality, security, and scalability

• Examples of d...read more
Answered by AI
Add your answer
Q2. What is resilient distributed database
Ans. 
A resilient distributed database is a database that can continue to function even if some of its nodes fail.
• It is designed to be fault-tolerant and highly available.

• Data is distributed across multiple nodes to ensure redundancy.

• If one node fails, the database can continue to function using data from other nodes.

• Examples include Apache Cassandra, Riak, and HBase.
Answered by AI
Add your answer

Q1. Describe your workflow of the last project
Ans. 
Developed ETL pipeline to ingest, clean, and analyze customer data for personalized marketing campaigns
• Gathered requirements from stakeholders to understand data sources and business objectives

• Designed data model to store customer information and campaign performance metrics

• Implemented ETL process using Python and Apache Spark to extract, transform, and load data

• Performed data quality checks and created visualizations ...read more
Answered by AI
Add your answer
Q2. What are the different transformations you have used
Ans. 
I have used various transformations such as filtering, joining, aggregating, and pivoting in my data engineering projects.
• Filtering data based on certain conditions

• Joining multiple datasets together

• Aggregating data to summarize information

• Pivoting data from rows to columns or vice versa
Answered by AI
Add your answer

Q1. Join two tables in pyspark code and dataframe
Ans. 
Join two tables in PySpark code and DataFrame
• Create two DataFrames from the tables

• Specify the join condition using join() function

• Select the columns to be displayed using select() function

• Use show() function to display the result
Answered by AI
Add your answer

Q1. What is the best place you visisted in pune
Add your answer

Q1. How much salary you are expectin herein the saama technoligies
Add your answer

It was a written test where theoretical SQL questions were asked like primary key, foreign key, set operators and some queries

Q1. All SQL Concepts like Join, normalization, trigger, stored procedure, keys, drop truncate del difference, where having difference, Aggregate scaler window functions, fetch duplicate records query, acid pro...read more
Add your answer

Q1. Questions about the tech skills you have
Add your answer

Q1. Salary discussion .
Add your answer