Axis Bank Data Engineer Interview Questions and Answers

Q1. What motivates to you for this job ?
Add your answer
Q2. What are the risks you have taken in previous role?
Add your answer
Q3. How do you handle the situation when your opinion differ from your senior members in your team?
Add your answer
Q4. Provide a approach to develop ETL pipeline where csv file is dropped in S3 and transform through airflow and load to snowflake.
Ans. 
Develop ETL pipeline using Airflow to process CSV files in S3 and load data into Snowflake.
• Set up an S3 sensor in Airflow to detect when a new CSV file is dropped in the specified bucket.

• Create a custom Python operator in Airflow to read the CSV file from S3, perform necessary transformations, and load data into Snowflake.

• Use SnowflakeHook in Airflow to establish connection with Snowflake and execute SQL queries to loa...read more
Answered by AI
Add your answer

Spark Sql and Spark Scripting

Data Modelling for retail brand like dmart

ETL Pipeline which handles streaming data as well

Q1. Explain spark stages and tasks
Ans. 
Spark stages are a collection of tasks that are executed together to perform a specific computation.
• Stages are created based on the transformations and actions in a Spark job.

• Each stage consists of a set of tasks that can be executed in parallel.

• Stages are divided into two types: narrow (one-to-one) and wide (one-to-many) transformations.

• Tasks within a stage are executed on different partitions of the data in parallel.

• ...read more
Answered by AI
Add your answer
Q2. Sql windoq questions
Add your answer

Q1. Advance delta table optimizatoins
Add your answer
Q2. Data modelling in previous project
Ans. 
Implemented data modelling using star schema in a retail analytics project.
• Designed star schema to optimize query performance

• Used fact and dimension tables to organize data

• Implemented ETL processes to populate the data warehouse

• Utilized tools like SQL, Python, and Apache Spark for data modelling
Answered by AI
Add your answer

Q1. More related towards Hadoop, Spark, scenario based competency questions
Add your answer

Q1. Code performance, optimization, batch processing
Add your answer

Q1. Questions on Data Modelling
Add your answer
Q2. Questions on SQL and Data Warehousing
Add your answer

Q1. SQL query writing involving complex queries
Add your answer
Q2. Questions on Snowflake and other distributed systems
Add your answer

Q1. What are the windows functions in sql
Ans. 
Window functions in SQL are used to perform calculations across a set of rows that are related to the current row.
• Window functions are used to calculate running totals, moving averages, and rank values.

• They are applied to a set of rows defined by an OVER clause.

• Examples of window functions include ROW_NUMBER, RANK, DENSE_RANK, and NTILE.
Answered by AI
Add your answer
Q2. Explain CTE in detail
Ans. 
CTE stands for Common Table Expression, a temporary named result set that can be referenced within a SELECT, INSERT, UPDATE, or DELETE statement.
• CTE is defined using the WITH keyword followed by a name and a SELECT statement.

• It can be used to simplify complex queries, improve readability, and reduce code duplication.

• CTE can also be recursive, allowing for hierarchical queries.

• Example: WITH sales AS (SELECT * FROM order...read more
Answered by AI
Add your answer

Q1. What is your expected salary
Add your answer

Q1. Basic technical questions not much complicated
Add your answer
Q2. Explain spark architecture
Ans. 
Spark architecture is a distributed computing framework that consists of a driver program, cluster manager, and worker nodes.
• Consists of a driver program that manages the execution of the Spark application

• Utilizes a cluster manager to allocate resources and coordinate tasks across worker nodes

• Worker nodes execute the tasks and store data in memory or disk for processing

• Supports fault tolerance through resilient distrib...read more
Answered by AI
Add your answer
Q3. Technical skills on hive Hadoop spark and python
Add your answer

Q1. Mostly on salary part
Add your answer

Q1. Tell me about your current work status, past internships and projects
Add your answer

Q1. Difference between sql joins, few sql queries
Ans. 
SQL joins are used to combine rows from different tables based on a related column, while SQL queries are used to retrieve specific data from a database.
• SQL joins are used to combine rows from different tables based on a related column

• There are different types of SQL joins, such as inner join, left join, right join, and full outer join

• SQL queries are used to retrieve specific data from a database based on certain condi...read more
Answered by AI
Add your answer

Q1. Behavioural questions
Add your answer