Vaantech Data Engineer Interview Questions and Answers

Q1. I was asked to write code and some scenario based question on Big Data etc
Add your answer

2nd with VP which is easy but he seems not okay with my ECTC

Q1. General Data Warehousing questions like explain your pipeline, how you implemented scd2?
Add your answer
Q2. SQL questions like increment top 5th salary by 10k, last day of month, etc.
Add your answer

Basic aptitude test asking questions very basic

Coding questions based on dsa

Q1. Basic hr question
Add your answer

Q1. Mostly on cloud tools
Add your answer

Q1. General questions about data engineering
Add your answer

Q1. General question on data topics and cloud
Add your answer

Q1. Salary and location
Add your answer

Q1. Self Introduction
Add your answer
Q2. About the current project
Add your answer
Q3. Different types of joins in SQL
Ans. 
Different types of joins in SQL include inner join, left join, right join, and full outer join.
• Inner join: Returns rows when there is a match in both tables.

• Left join: Returns all rows from the left table and the matched rows from the right table.

• Right join: Returns all rows from the right table and the matched rows from the left table.

• Full outer join: Returns rows when there is a match in either table.
Answered by AI
Add your answer
Q4. Questions related to Cloud
Add your answer

Q1. Roles and responsibilities in current project
Add your answer
Q2. Optimizations used in present project
Ans. 
Various optimizations such as indexing, caching, and parallel processing were used in the project.
• Implemented indexing on frequently queried columns to improve query performance

• Utilized caching mechanisms to store frequently accessed data and reduce database load

• Implemented parallel processing to speed up data processing tasks

• Optimized algorithms and data structures for efficient data retrieval and manipulation
Answered by AI
Add your answer
Q3. How did you overcome out of memory issues
Ans. 
I optimized code, increased memory allocation, used efficient data structures, and implemented data partitioning.
• Optimized code by identifying and fixing memory leaks

• Increased memory allocation for the application

• Used efficient data structures like arrays, hashmaps, and trees

• Implemented data partitioning to distribute data across multiple nodes
Answered by AI
Add your answer

Q1. Pyspark - How to add new column to the data How to read data from Csv file
Ans. 
To add a new column to data in Pyspark, use 'withColumn' method. To read data from a CSV file, use 'spark.read.csv' method.
• To add a new column to data in Pyspark, use 'withColumn' method

• Example: df.withColumn('new_column', df['existing_column'] * 2)

• To read data from a CSV file, use 'spark.read.csv' method

• Example: df = spark.read.csv('file.csv', header=True, inferSchema=True)
Answered by AI
Add your answer