1) What is internal mechanism in spark . 2) tungsten project in spark explanation 3) sql problem to check where last two transaction belongs to particular retail

Question

Accepted Answer

Questions related to Spark internals, Tungsten project, and SQL problem for retail transactions.

Spark's internal mechanism includes components like Spark Core, Spark SQL, Spark Streaming, and MLlib.
Tungsten project in Spark aims to improve the performance of Spark by optimizing memory usage and CPU utilization.
To solve the SQL problem, we can use a query to filter transactions for a particular retail and then use the 'ORDER BY' clause to sort them by date and time. We can then use the 'LIMIT' clause to get the last two transactions.
Example SQL query: SELECT * FROM transactions WHERE retail = 'ABC' ORDER BY date_time DESC LIMIT 2

1) What is internal mechanism in spark . 2) tungsten project in spark explanation 3) sql problem to check where last two transaction belongs to particular retail

Top Paytm Data Engineer interview questions & answers

Popular interview questions of Data Engineer

Top HR questions asked in Paytm Data Engineer