VELOTIO Technologies Senior Data Engineer Interview Questions and Answers

Q1. How does spark run in the background?
Ans. 
Spark runs in the background using a cluster manager to allocate resources and schedule tasks.
• Spark uses a cluster manager (such as YARN, Mesos, or Kubernetes) to allocate resources and schedule tasks.

• Tasks are executed by worker nodes in the cluster, which communicate with the driver program.

• The driver program coordinates the execution of tasks and manages the overall workflow.

• Spark's DAG scheduler breaks the job into...read more
Answered by AI
Add your answer

Q1. Write a python program to find the most occurred number in sequence
Ans. 
Python program to find the most occurred number in a sequence
• Iterate through the sequence and count the occurrences of each number using a dictionary

• Find the number with the highest count in the dictionary

• Handle edge cases like empty sequence or multiple numbers with the same highest count
Answered by AI
Add your answer

Q1. All employees having same salary in the smae department sql and pysprk
Add your answer
Q2. How to create pipeline in databricks
Ans. 
To create a pipeline in Databricks, you can use Databricks Jobs or Apache Airflow for orchestration.
• Use Databricks Jobs to create a pipeline by scheduling notebooks or Spark jobs.

• Utilize Apache Airflow for more complex pipeline orchestration with dependencies and monitoring.

• Leverage Databricks Delta for managing data pipelines with ACID transactions and versioning.
Answered by AI
Add your answer
Q3. Palindrome, 2nd char in every word make is to upper case, sql rank and dense rank releated questions , given 2 tables country and city we need to calculate total population in each continent by joining the...read more
Add your answer
Q4. String manuplation questions inpython
Add your answer

Q1. Basics of Python
Add your answer
Q2. Basics of Django
Add your answer

Q1. Python concepts knowledge check
Add your answer
Q2. Django architecture and projects discussion
Add your answer

Q1. General communication about the role and previous experience
Add your answer

Q1. Package negotiation and culture check
Add your answer

Q1. Given the react machine coding example
Add your answer

Q1. Explain about your projects
Add your answer

In the coding test, there were 2 problems based on arrays and hashing (easy to medium level leetcode)

Q1. Several OOP questions were asked.... like, Can we have a class inside an interface? Can we have a static constructor? Can we have multiple main methods?
Add your answer
Q2. DBMS question: Normalization questions and keys concepts.
Add your answer

Q1. DSA question (stack based) You have a stack full of numbers, you have to arrange them in ascending order in the same stack without using any other data structure.
Add your answer
Q2. OS and DBMS questions(sharding, semaphores, etc.)
Add your answer

Q1. Questions based on Consultadd principles.
Add your answer

Q1. A Lot of OOPS and Virtual concept
Add your answer
Q2. Basic SQL till joins
Add your answer
Q3. Java script medium
Add your answer
Q4. C# oops output based
Add your answer

Dsa problems dp and tress problem

Q1. Tell me about your self
Add your answer
Q2. Projects and intership
Add your answer