Visionet Systems Data Engineer Interview Questions and Answers

Q1. Azure Scenario based questions
Add your answer
Q2. Pyspark Coding based questions
Add your answer

Q1. ADF, Databricks related question
Add your answer
Q2. Spark Performance problem and scenarios
Ans. 
Spark performance problems can arise due to inefficient code, data skew, resource constraints, and improper configuration.
• Inefficient code can lead to slow performance, such as using collect() on large datasets.

• Data skew can cause uneven distribution of data across partitions, impacting processing time.

• Resource constraints like insufficient memory or CPU can result in slow Spark jobs.

• Improper configuration settings, su...read more
Answered by AI
Add your answer

Q1. Question based on big data
Add your answer
Q2. Cloud based messaging system
Add your answer

Q1. Cloud based operations
Add your answer

Q1. SCD questions. Iceberg questions
Add your answer
Q2. Basic python programing, pyspark architechture.
Add your answer

Q1. Spark basic question , hive related questions.
Add your answer

1- sql adn 10 spark questions.

Q1. Python programs - 4
Add your answer
Q2. Sql questions - 4
Add your answer

Q1. Project related and work experience questions
Add your answer

Q1. Managerial question
Add your answer

Aptitude test had few quant and verbal questions then SQL MCQs and 3 Coding question

Q1. Questions about guesstimates and puzzles
Add your answer
Q2. Which coding language is better and why?
Ans. 
There is no one 'better' coding language, as it depends on the specific use case and requirements.
• The best coding language depends on the project requirements, team expertise, and ecosystem support.

• For data engineering, languages like Python, Scala, and SQL are commonly used for their data processing capabilities.

• Python is popular for its simplicity and extensive libraries like Pandas and NumPy, while Scala is known fo...read more
Answered by AI
Add your answer

Q1. Python Lambda Function
Add your answer
Q2. What are pods in Kubernetes
Ans. 
Pods are the smallest deployable units in Kubernetes, consisting of one or more containers.
• Pods are used to run and manage containers in Kubernetes

• Each pod has its own unique IP address within the Kubernetes cluster

• Pods can contain multiple containers that share resources and are scheduled together

• Pods are ephemeral and can be easily created, destroyed, or replicated

• Pods can be managed and scaled using Kubernetes contr
Answered by AI
Add your answer

Q1. It wnt well basics of hadoop,spark and my project
Add your answer
Q2. Basics of sql and joins
Add your answer

Basics of sql and joins