TCS Azure Data Engineer Interview Questions, Process, and Tips

Q1. 1. What is the difference between Blob and adls?
Ans. 
Blob is a storage service for unstructured data, while ADLS is a distributed file system for big data analytics.
• Blob is a general-purpose object storage service for unstructured data, while ADLS is optimized for big data analytics workloads.

• Blob storage is suitable for storing large amounts of data, such as images, videos, and logs, while ADLS is designed for processing large datasets in parallel.

• ADLS offers features l...read more
Answered by AI
View 1 more answer
Q2. 2. What is the get metadata activity and what are the parameters we have to pass?
Ans. 
Get metadata activity is used to retrieve metadata of a specified data store or dataset in Azure Data Factory.
• Get metadata activity is used in Azure Data Factory to retrieve metadata of a specified data store or dataset.

• Parameters to pass include dataset, linked service, and optional folder path.

• The output of the activity includes information like schema, size, last modified timestamp, etc.

• Example: Get metadata of a SQ...read more
Answered by AI
View 1 more answer
Q3. 3. How can we monitor the child pipeline in the master pipeline?
Ans. 
You can monitor the child pipeline in the master pipeline by using Azure Monitor or Azure Data Factory monitoring tools.
• Use Azure Monitor to track the performance and health of the child pipeline within the master pipeline.

• Leverage Azure Data Factory monitoring tools to view detailed logs and metrics for the child pipeline execution.

• Set up alerts and notifications to be informed of any issues or failures in the child p
Answered by AI
View 1 more answer
Q4. 4. Difference between delta and parquet?
Ans. 
Delta is an open-source storage layer that brings ACID transactions to Apache Spark and big data workloads, while Parquet is a columnar storage format optimized for reading and writing data in large volumes.
• Delta is designed for use with big data workloads and provides ACID transactions, while Parquet is optimized for reading and writing large volumes of data efficiently.

• Delta allows for updates and deletes of data, wh...read more
Answered by AI
View 1 more answer
Q5. 5. SQL inner and left join with tables having duplicate values
Ans. 
SQL inner and left join can be used to combine tables with duplicate values based on specified conditions.
• Use INNER JOIN to return rows from both tables that have matching values

• Use LEFT JOIN to return all rows from the left table and the matched rows from the right table

• Handle duplicate values by using DISTINCT or GROUP BY clauses
Answered by AI
Add your answer
Q6. 6. show me the newly joined employee details based two tables using employee table and salry table. (Emp I'd is the foreign key).
Add your answer
Q7. 7. How can we load multiple(50)tables at a time using adf?
Ans. 
You can load multiple tables at a time using Azure Data Factory by creating a single pipeline with multiple copy activities.
• Create a pipeline in Azure Data Factory

• Add multiple copy activities to the pipeline, each copy activity for loading data from one table

• Configure each copy activity to load data from a different table

• Run the pipeline to load data from all tables simultaneously
Answered by AI
View 3 more answers

Q1. 1. Tell me about your self?
Add your answer
Q2. 2. Do you know data bricks? And from when you are working on it?
Ans. 
Yes, I am familiar with Databricks and have been working on it for the past 2 years.
• I have been using Databricks for data engineering tasks such as data processing, data transformation, and data visualization.

• I have experience in building and optimizing data pipelines using Databricks.

• I have worked on collaborative projects with team members using Databricks notebooks.

• I have utilized Databricks for big data processing ...read more
Answered by AI
Add your answer
Q3. 3. What is the notice period? And are you serving NP?
Add your answer
Q4. 4. Do you know pyspark?
Ans. 
Yes, pyspark is a Python API for Apache Spark, used for big data processing and analytics.
• pyspark is a Python API for Apache Spark, allowing users to write Spark applications using Python.

• It provides high-level APIs in Python for Spark's functionality, making it easier to work with big data.

• pyspark is commonly used for data processing, machine learning, and analytics tasks.

• Example: Using pyspark to read data from a CSV...read more
Answered by AI
View 2 more answers
Q5. 5. Why do you want to change the company?
Add your answer

Q1. Why do you want to change your company?
Add your answer
Q2. What is your expected salary?
Add your answer

Q1. What is ADLS and diff between ADLS gen1 and gen2
Ans. 
ADLS is Azure Data Lake Storage, a scalable and secure data lake solution. ADLS gen2 is an improved version of gen1.
• ADLS is a cloud-based storage solution for big data analytics workloads

• ADLS gen1 is based on Hadoop Distributed File System (HDFS) and has limitations in terms of scalability and performance

• ADLS gen2 is built on Azure Blob Storage and offers improved performance, scalability, and security features

• ADLS gen...read more
Answered by AI
Add your answer

Q1. What is your career aspiration?
Ans. 
My career aspiration is to become a highly skilled Azure Data Engineer and contribute to the development of innovative data solutions.
• I aim to continuously improve my technical skills and stay up-to-date with the latest technologies and trends in the field.

• I want to work on challenging projects that require creative problem-solving and collaboration with cross-functional teams.

• Ultimately, I hope to become a respected t...read more
Answered by AI
Add your answer

Q1. How much is your salary expectation
Ans. 
My salary expectation is in line with industry standards and commensurate with my experience and skills.
• I have researched the industry standards for this role and my salary expectation is within that range.

• My salary expectation is based on my experience and skills that I bring to the table.

• I am open to negotiation and willing to discuss the salary package in detail.
Answered by AI
Add your answer

Q1. Asked about basics of sql
Add your answer
Q2. Asked about azure basics and data factory
Add your answer

Basic aptitude,logical reasoning,math questions.

Q1. Sql,Python code with test cases.
Add your answer

Discussion on profile. Both technical and non technical questions.