ConsultAdd Data Engineer Interview Questions and Answers

Q1. Spark related question
Add your answer
Q2. Python coding questions
Add your answer

It was a written test where theoretical SQL questions were asked like primary key, foreign key, set operators and some queries

Q1. All SQL Concepts like Join, normalization, trigger, stored procedure, keys, drop truncate del difference, where having difference, Aggregate scaler window functions, fetch duplicate records query, acid pro...read more
Add your answer

Q1. Explain process in adf
Ans. 
ADF stands for Azure Data Factory, a cloud-based data integration service that allows you to create, schedule, and manage data pipelines.
• ADF allows you to create data-driven workflows for orchestrating and automating data movement and data transformation.

• You can use ADF to ingest data from various sources, process and transform the data, and then publish the data to different destinations.

• ADF supports a wide range of d...read more
Answered by AI
Add your answer

Q1. Describe your workflow of the last project
Ans. 
Developed ETL pipeline to ingest, clean, and analyze customer data for personalized marketing campaigns
• Gathered requirements from stakeholders to understand data sources and business objectives

• Designed data model to store customer information and campaign performance metrics

• Implemented ETL process using Python and Apache Spark to extract, transform, and load data

• Performed data quality checks and created visualizations ...read more
Answered by AI
Add your answer
Q2. What are the different transformations you have used
Ans. 
I have used various transformations such as filtering, joining, aggregating, and pivoting in my data engineering projects.
• Filtering data based on certain conditions

• Joining multiple datasets together

• Aggregating data to summarize information

• Pivoting data from rows to columns or vice versa
Answered by AI
Add your answer

Q1. Related to data warehouse
Add your answer

Q1. Python, data warehouse, data modelling
Add your answer

Q1. What is dual mode in Power BI
Ans. 
Dual mode in Power BI allows users to switch between DirectQuery and Import modes for data sources.
• Dual mode allows users to combine the benefits of both DirectQuery and Import modes in Power BI.

• Users can switch between DirectQuery and Import modes for different data sources within the same report.

• DirectQuery mode connects directly to the data source for real-time data retrieval, while Import mode loads data into Power...read more
Answered by AI
Add your answer

Q1. Join two tables in pyspark code and dataframe
Ans. 
Join two tables in PySpark code and DataFrame
• Create two DataFrames from the tables

• Specify the join condition using join() function

• Select the columns to be displayed using select() function

• Use show() function to display the result
Answered by AI
Add your answer

Q1. What is the best place you visisted in pune
Add your answer

Q1. How much salary you are expectin herein the saama technoligies
Add your answer

Q1. Questions about the tech skills you have
Add your answer

Q1. Salary discussion .
Add your answer