PwC Data Engineer Interview Questions, Process, and Tips

Aptitude was Okay. Time given was less.

Q1. Project architecture
Add your answer
Q2. Dataframes in Pyspark
Ans. 
Dataframes in Pyspark are distributed collections of data organized into named columns.
• Dataframes are similar to tables in a relational database.

• They can be created from various data sources like CSV, JSON, Parquet, etc.

• Dataframes support SQL queries and transformations using PySpark functions.
Answered by AI
Add your answer

Q1. Python Question for 2nd highest salary
Add your answer
Q2. Pyspark scenario based question
Add your answer

Q1. Ready to travel on site
Ans. 
Yes, I am ready to travel on site for data engineering projects.
• I am willing to travel for client meetings, project kick-offs, and on-site troubleshooting.

• I understand the importance of face-to-face interactions in project delivery.

• I have previous experience traveling for work, such as attending conferences or training sessions.

• I am flexible with my schedule and can accommodate last-minute travel if needed.
Answered by AI
Add your answer
Q2. Salary negotiation
Add your answer

Q1. Sql question of rank sumover and partion by kinda question
Add your answer
Q2. Roles n responsibility
Add your answer

Q1. Write code to print reverse of string.
Ans. 
Code to print reverse of string
• Use a loop to iterate through the characters of the string in reverse order

• Append each character to a new string to build the reversed string

• Return the reversed string
Answered by AI
Add your answer

Q1. Sql questions using row_num and rank
Add your answer
Q2. How to delete duplicate from a database
Ans. 
To delete duplicates from a database, you can use SQL queries to identify and remove duplicate records.
• Use the DISTINCT keyword in a SELECT query to retrieve unique records

• Identify duplicate records using GROUP BY and HAVING clauses

• Delete duplicate records using DELETE statement with subquery to keep only one instance
Answered by AI
Add your answer

Q1. Why do I want to join PWC
Add your answer
Q2. What are qualities I bring to my job
Add your answer

Q1. Pyspark related questions.
Add your answer

Q1. Repartition vs coalease
Ans. 
Repartition is used to increase or decrease the number of partitions in a DataFrame, while coalesce is used to decrease the number of partitions without shuffling data.
• Repartition involves shuffling data across the network, which can be expensive in terms of performance and resources.

• Coalesce is a more efficient operation as it minimizes data movement by only creating new partitions if necessary.

• Example: Repartition(10...read more
Answered by AI
Add your answer
Q2. Copy Activity in ADF
Ans. 
Copy Activity in ADF is used to move data between supported data stores
• Copy Activity is a built-in activity in Azure Data Factory (ADF)

• It can be used to move data between supported data stores such as Azure Blob Storage, SQL Database, etc.

• It supports various data movement methods like copy, transform, and load (ETL)

• You can define source and sink datasets, mapping, and settings in Copy Activity

• Example: Copying data from...read more
Answered by AI
Add your answer

Q1. Technical questions, related to pySpark and Sql, moderate level.
Add your answer