Freshworks Data Engineer Interview Questions, Process, and Tips

Q1. Write a lambda function in python
Ans. 
A lambda function in Python is a small anonymous function defined using the lambda keyword.
• Lambda functions can have any number of arguments, but can only have one expression.

• Syntax: lambda arguments : expression

• Example: lambda x, y : x + y
Answered by AI
Add your answer
Q2. Dbutils in databricks
Ans. 
dbutils is a utility provided by Databricks for interacting with files and directories in the Databricks environment.
• dbutils.fs.ls('/') - list files in root directory

• dbutils.fs.cp('dbfs:/file.txt', 'file.txt') - copy file from DBFS to local file system

• dbutils.fs.mkdirs('dbfs:/new_dir') - create a new directory in DBFS
Answered by AI
Add your answer
Q3. Persist and cache
Add your answer
Q4. What is commit in SQL
Ans. 
A commit in SQL is a command that saves all the changes made in a transaction to the database.
• A commit is used to make all the changes made in a transaction permanent.

• Once a commit is issued, the changes cannot be rolled back.

• It is important to use commit to ensure data integrity and consistency.

• Example: COMMIT; - this command is used to commit the changes in a transaction.
Answered by AI
Add your answer
Q5. Rank and dans_rank
Add your answer

There is a test where you build data pipeline

Q1. Streaming use case with spark
Ans. 
Spark can be used for real-time data processing in streaming use cases.
• Spark Streaming allows for processing real-time data streams.

• It can handle high-throughput and fault-tolerant processing.

• Examples include real-time analytics, monitoring, and alerting.
Answered by AI
View 1 more answer