Accenture Azure Data Engineer Interview Questions, Process, and Tips

Q1. What is difference between scheduled trigger and tumbling window trigger
Ans. 
Scheduled trigger is time-based while tumbling window trigger is data-based.
• Scheduled trigger is based on a specific time or interval, such as every hour or every day.

• Tumbling window trigger is based on the arrival of new data or a specific event.

• Scheduled trigger is useful for regular data processing tasks, like ETL jobs.

• Tumbling window trigger is useful for aggregating data over fixed time intervals.

• Scheduled trigger...read more
Answered by AI
Add your answer
Q2. What are the control flow activites in adf
Ans. 
Control flow activities in Azure Data Factory (ADF) are used to define the workflow and execution order of activities.
• Control flow activities are used to manage the flow of data and control the execution order of activities in ADF.

• They allow you to define dependencies between activities and specify conditions for their execution.

• Some commonly used control flow activities in ADF are If Condition, For Each, Until, and Sw...read more
Answered by AI
Add your answer
Q3. What is linked services in adf
Ans. 
Linked services in ADF are connections to external data sources or destinations that allow data movement and transformation.
• Linked services are used to connect to various data sources such as databases, file systems, and cloud services.

• They provide the necessary information and credentials to establish a connection.

• Linked services enable data movement activities like copying data from one source to another or transform...read more
Answered by AI
Add your answer
Q4. What are the types of IR
Ans. 
IR stands for Integration Runtime. There are two types of IR: Self-hosted and Azure-SSIS.
• Self-hosted IR is used to connect to on-premises data sources.

• Azure-SSIS IR is used to run SSIS packages in Azure Data Factory.

• Self-hosted IR requires an on-premises machine to be installed and configured.

• Azure-SSIS IR is a fully managed service provided by Azure.

• Both types of IR enable data movement and transformation in Azure Dat
Answered by AI
View 2 more answers

Q1. Which IR should we use if we want to copy data from on-premise db to azure
Ans. 
We should use the Self-hosted Integration Runtime (IR) to copy data from on-premise db to Azure.
• Self-hosted IR allows data movement between on-premise and Azure

• It is installed on a local machine or virtual machine in the on-premise network

• Self-hosted IR securely connects to the on-premise data source and transfers data to Azure

• It supports various data sources like SQL Server, Oracle, MySQL, etc.

• Self-hosted IR can be ma
Answered by AI
View 1 more answer

Q1. Activities used in ADF
Ans. 
Activities in Azure Data Factory (ADF) are the building blocks of a pipeline and perform various tasks like data movement, data transformation, and data orchestration.
• Activities can be used to copy data from one location to another (Copy Activity)

• Activities can be used to transform data using mapping data flows (Data Flow Activity)

• Activities can be used to run custom code or scripts (Custom Activity)

• Activities can be u...read more
Answered by AI
Add your answer
Q2. Dataframes in pyspark
Ans. 
Dataframes in pyspark are distributed collections of data organized into named columns.
• Dataframes are similar to tables in a relational database, with rows and columns.

• They can be created from various data sources like CSV, JSON, Parquet, etc.

• Dataframes support SQL queries and transformations using PySpark functions.

• Example: df = spark.read.csv('file.csv')
Answered by AI
Add your answer

Q1. Managerial Questions
Add your answer
Q2. About project roles and resposibilities
Add your answer

Most of the questions were from resume and scenario-based. The basic SQL and Pyspark Questions

Q1. Tell me about yourself
Ans. Tell about your background and current project work
Answered Anonymously
Add your answer
Q2. What is azure data factory
Ans. 
Azure Data Factory is a cloud-based data integration service that allows you to create, schedule, and manage data pipelines.
• Azure Data Factory is used to move and transform data from various sources to destinations.

• It supports data integration and orchestration of workflows.

• You can monitor and manage data pipelines using Azure Data Factory.

• It provides a visual interface for designing and monitoring data pipelines.

• Azure...read more
Answered by AI
Add your answer
Q3. What is Azure data lake
Ans. 
Azure Data Lake is a scalable data storage and analytics service provided by Microsoft Azure.
• Azure Data Lake Store is a secure data repository that allows you to store and analyze petabytes of data.

• Azure Data Lake Analytics is a distributed analytics service that can process big data using Apache Hadoop and Apache Spark.

• It is designed for big data processing and analytics tasks, providing high performance and scalabili
Answered by AI
Add your answer
Q4. 2nd highest salary from employee table
Add your answer
Q5. What is index in table
Ans. 
An index in a table is a data structure that improves the speed of data retrieval operations on a database table.
• Indexes are used to quickly locate data without having to search every row in a table.

• They can be created on one or more columns in a table.

• Examples of indexes include primary keys, unique constraints, and non-unique indexes.
Answered by AI
Add your answer