MakeMyTrip Datastage Developer Interview Questions and Answers

Coding questions on sde profile

Q1. Technical round
Add your answer
Q2. Pyspark? Coalesce vs reparation?
Ans. 
Coalesce and repartition are both methods used in Pyspark for reducing the number of partitions in a DataFrame.
• Coalesce is used to reduce the number of partitions without shuffling the data, while repartition involves shuffling the data to create a specified number of partitions.

• Coalesce is more efficient when reducing the number of partitions, as it avoids shuffling the data unnecessarily.

• Repartition is useful when yo...read more
Answered by AI
Add your answer