TO THE NEW Data Engineer Interview Questions and Answers

Q1. Question based on big data
Add your answer
Q2. Cloud based messaging system
Add your answer

Q1. Cloud based operations
Add your answer

Q1. Spark basic question , hive related questions.
Add your answer

1- sql adn 10 spark questions.

Q1. Python programs - 4
Add your answer
Q2. Sql questions - 4
Add your answer

Q1. Project related and work experience questions
Add your answer

Q1. Managerial question
Add your answer

Technical Assessment Test (MCQs) - 30 mins.

Q1. Basic Questions on: 1.Python 2.SQL 3.Spark
Add your answer
Q2. Python: Replace all occurrences of word: "apple" with "froot" and count no.of occurrences of word: "apple" - in a given string (multiple lines) SQL: 1. Retrieve employee details, drawing the maximum salar...read more
Add your answer
Q3. Convert string (multiple lines) to list
Ans. 
Use the split() method to convert a string with multiple lines into a list of strings.
• Use the split() method with the newline character '\n' as the delimiter to split the string into a list of strings.

• Example: 'Hello\nWorld\n' -> ['Hello', 'World']
Answered by AI
Add your answer
Q4. Convert string of multiple lines with 'n' words to multiple arrays of fixed size: k, with no overlap of elements accross arrays.
Ans. 
Convert a string of multiple lines with 'n' words to multiple arrays of fixed size without overlap.
• Split the string into individual words

• Create arrays of fixed size 'k' and distribute words evenly

• Handle cases where the number of words is not divisible by 'k'
Answered by AI
Add your answer

Q1. Python Lambda Function
Add your answer
Q2. What are pods in Kubernetes
Ans. 
Pods are the smallest deployable units in Kubernetes, consisting of one or more containers.
• Pods are used to run and manage containers in Kubernetes

• Each pod has its own unique IP address within the Kubernetes cluster

• Pods can contain multiple containers that share resources and are scheduled together

• Pods are ephemeral and can be easily created, destroyed, or replicated

• Pods can be managed and scaled using Kubernetes contr
Answered by AI
Add your answer

Q1. BigQuery Architecture and file formats
Add your answer
Q2. Airflow operators and what is the use of Airflow python operator
Ans. 
Airflow operators are used to define tasks in a workflow. The Airflow Python operator is used to execute Python functions as tasks.
• Airflow operators are used to define individual tasks in a workflow

• The Airflow Python operator is specifically used to execute Python functions as tasks

• It allows for flexibility in defining custom tasks using Python code

• Example: PythonOperator(task_id='my_task', python_callable=my_python_fu
Answered by AI
Add your answer

Q1. Explain the entire ETL workload in your current company project and how to handle the data quality issues.
Add your answer

Basic aptitude and three levels of coding (easy,medium,hard)

Q1. Sql and java programming question
Add your answer

Q1. Advanced questions on sql and programming
Add your answer

Q1. Normal hobbies and communication skills
Add your answer