National Australia Bank Data Engineer Interview Questions and Answers

Q1. Tell me about you experience as a data engineer
Add your answer
Q2. In depth technical discussion about projects
Add your answer

Q1. Load 60 GB of csv file and perform transformation.
Ans. 
Use distributed computing framework like Apache Spark to efficiently load and transform the large CSV file.
• Use Apache Spark to distribute the workload across multiple nodes for faster processing.

• Utilize Spark's DataFrame API to read the CSV file and apply transformations.

• Consider partitioning the data to optimize performance.

• Use Spark SQL for complex transformations and aggregations.

• Leverage in-memory processing capabi
Answered by AI
Add your answer

The first round which is online assessment for eliminating candidates was conducted consist of medium level aptitude questions there were 3 sub sec have duration of 20 15 15 minutes and questions 15 10 10 respectively and you cannot move to further section there is time constraints for each then followed by 15 minutes psychometric section having 50 questions that's all for screening round the total duration was 65 min.
Total 24 candidates were selected from this round out of 200 plus

Discussion of jd, technical questions on spark

Q1. Spark framework
Add your answer
Q2. Spark dataframes
Add your answer

Q1. Current ctc getting
Ans. 
I am currently earning $80,000 per year.
• My current annual salary is $80,000.

• I am earning $6,666.67 per month.

• I receive a monthly salary of $6,666.67.
Answered by AI
Add your answer
Q2. Expected CTC that is needed
Ans. 
Expected CTC should be based on industry standards, experience, skills, and location.
• Research industry standards for Data Engineers in your location

• Consider your level of experience and skills

• Factor in the cost of living in the area where the job is located

• Negotiate based on the value you bring to the company
Answered by AI
Add your answer

Q1. Airflow SQL Python DWH
Add your answer

Q1. Airflow Pyspark SQL AWS
Add your answer

Q1. Relocation , tech stack
Add your answer

Q1. What is an index and what does it do
Ans. 
An index is a data structure that improves the speed of data retrieval operations in a database by allowing quick access to specific data.
• Indexes are used to quickly locate data without having to search every row in a database table.

• They are created on specific columns in a table to speed up queries that filter or sort by those columns.

• Examples of indexes include primary keys, unique keys, and non-unique indexes.
Answered by AI
Add your answer

Q1. Tell me a time you resolve conflict
Add your answer

Spark Sql and Spark Scripting

Data Modelling for retail brand like dmart

ETL Pipeline which handles streaming data as well

Q1. Questions on pyspark coding, windowing function and all
Add your answer
Q2. Questions on hive and yarn
Add your answer