Accenture Data Engineer Interview Questions, Process, and Tips

Python Code
SQL Code

Q1. Spark Architecture
Add your answer

Q1. Explain different kind of joins and give use case of self join
Ans. 
Different types of joins include inner join, outer join, left join, and right join. Self join is used to join a table with itself.
• Inner join: Returns rows when there is a match in both tables

• Outer join: Returns all rows when there is a match in one of the tables

• Left join: Returns all rows from the left table and the matched rows from the right table

• Right join: Returns all rows from the right table and the matched rows ...read more
Answered by AI
Add your answer
Q2. What are different kind of triggers available in data factory and tell use case of each trigger
Ans. 
Different kinds of triggers in Data Factory and their use cases
• Schedule Trigger: Runs pipelines on a specified schedule, like daily or hourly

• Tumbling Window Trigger: Triggers pipelines based on a defined window of time

• Event Trigger: Triggers pipelines based on events like file arrival or HTTP request

• Data Lake Storage Gen2 Trigger: Triggers pipelines when new data is added to a Data Lake Storage Gen2 account
Answered by AI
Add your answer
Q3. Difference between primary key and foreign key
Ans. 
Primary key uniquely identifies a record in a table, while foreign key establishes a link between two tables.
• Primary key ensures each record is unique in a table

• Foreign key establishes a relationship between tables

• Primary key is used to enforce entity integrity

• Foreign key is used to enforce referential integrity
Answered by AI
Add your answer

30 mins. Questions on Pyspark, SQL, Internals of Pyspark

Q1. Basic of programming
Add your answer
Q2. Fundamental of Computer science
Add your answer

Q1. RDD vs Dataframe
Add your answer
Q2. Spark optimization
Add your answer

Q1. What does select count(0) mean?
Ans. 
Select count(0) returns the count of rows in a table, regardless of the values in the specified column.
• Select count(0) counts all rows in a table, ignoring the values in the specified column.

• It is equivalent to select count(*) or select count(1).

• Example: SELECT COUNT(0) FROM table_name;
Answered by AI
Add your answer
Q2. What is sharding?
Ans. 
Sharding is a database partitioning technique where large databases are divided into smaller, more manageable parts called shards.
• Sharding helps distribute data across multiple servers to improve performance and scalability.

• Each shard contains a subset of the data, allowing for parallel processing and faster query execution.

• Common sharding strategies include range-based sharding, hash-based sharding, and list-based sha...read more
Answered by AI
Add your answer
Q3. What are slots in Bigquery?
Ans. 
Slots in Bigquery are virtual partitions that allow users to control the amount of data processed by a query.
• Slots help in managing query resources and controlling costs

• Users can purchase additional slots to increase query capacity

• Slots are used to allocate processing power for queries based on the amount purchased
Answered by AI
Add your answer