NTT Data Information Processing Services Data Engineer Interview Questions and Answers

Q1. How to Ensure Data loss in ETL pipeline
Add your answer
Q2. Why to spin up Dataproc cluster when there is serverless batch job exists.
Add your answer

Q1. Write code in regular expression to remove the special characters
Ans. 
Use regular expression to remove special characters from a string
• Use the regex pattern [^a-zA-Z0-9\s] to match any character that is not a letter, digit, or whitespace

• Use the replace() function in your programming language to replace the matched special characters with an empty string

• Example: input string 'Hello! How are you?' will become 'Hello How are you' after removing special characters
Answered by AI
Add your answer
Q2. Questions on resume
Add your answer

Q1. Python SQL question
Add your answer

Q1. More on Project side
Add your answer

Q1. Salary Discussion
Add your answer

Q1. Data engineer roles and resposibilities
Add your answer

Its mandatory test even for experience people

Q1. Related to technology
Add your answer

Q1. Very good discussion towards work culture, salary and all
Add your answer

Q1. Pyspark problem
Ans. 
The question is about a Pyspark problem.
• Use SparkSession to create a Spark application

• Load data from a source like CSV or Parquet files

• Perform transformations and actions on the data using PySpark functions

• Optimize performance by using caching and partitioning
Answered by AI
Add your answer
Q2. Sql problems and problem solving
Add your answer

Q1. Sql questions were
Add your answer
Q2. Spark related aswell
Add your answer

1. Questions on spark basica
2. Sql coding questions
3. Java or scala basics