TCS AWS Data Engineer Interview Questions, Process, and Tips

Q1. Question on AWS services like Glue, Lambda, EMR, S3 Python and SQL
Add your answer
Q2. Python- List comprehension, function, various methods SQL -window function, rollback, commit, savepoint and it's diffrence Joins AWS- S3 lifecycle, it's use. Glue questions
Add your answer
Q3. Explain use of * in both the args and kwargs. Expedition handling.use of pass function in python
Ans. 
The * symbol is used to pass variable number of arguments and keyword arguments in Python functions.
• The * symbol before a parameter name in a function definition allows it to accept variable number of arguments as a tuple.

• The ** symbol before a parameter name in a function definition allows it to accept variable number of keyword arguments as a dictionary.

• The * symbol before an iterable object in a function call unpack...read more
Answered by AI
Add your answer

Q1. Resume based questions Data modelling SQL
Add your answer
Q2. From SQL focus was on self join Data modelling question from existing project Explain projects and existing pipeline
Add your answer
Q3. Given two table explain joins created and total count
Ans. 
Explaining joins and total count for two tables
• Joins combine data from two or more tables based on a common column

• Inner join returns only the matching rows from both tables

• Left join returns all rows from the left table and matching rows from the right table

• Right join returns all rows from the right table and matching rows from the left table

• Full outer join returns all rows from both tables

• Total count is the number of r
Answered by AI
Add your answer

Q1. Question based on resume, cloud databases, EMR, Athena, Ec2, Sql
Add your answer
Q2. Scenario based questions
Add your answer

Q1. Managerial questions
Add your answer

Q1. What is AWS and its Architecture
Ans. 
AWS is a cloud computing platform provided by Amazon with a scalable and flexible architecture.
• AWS stands for Amazon Web Services

• It offers a wide range of cloud services including computing power, storage, and databases

• AWS architecture is designed to be scalable, secure, and cost-effective

• Examples of AWS services include EC2 for virtual servers, S3 for storage, and RDS for databases
Answered by AI
Add your answer
Q2. What is Data Lake and Data warehouse
Ans. 
Data Lake is a storage repository that holds a vast amount of raw data in its native format, while Data Warehouse is a structured repository for processed and analyzed data.
• Data Lake stores raw, unstructured data in its original form for future processing and analysis.

• Data Warehouse stores structured, processed data for querying and reporting.

• Data Lake is ideal for big data analytics and machine learning applications.

• D...read more
Answered by AI
Add your answer
Q3. What AWS Glue Service and and It's Components
Ans. 
AWS Glue is a fully managed extract, transform, and load (ETL) service that makes it easy to prepare and load data for analytics.
• AWS Glue Data Catalog: A central metadata repository that stores metadata information about datasets and sources.

• AWS Glue ETL: Allows you to create ETL jobs to transform data from various sources into a format that can be easily analyzed.

• AWS Glue Crawler: Automatically discovers data in vario...read more
Answered by AI
Add your answer
Q4. When to use Lambda and Glue
Ans. 
Lambda for event-driven processing, Glue for ETL jobs
• Use Lambda for event-driven processing, such as real-time data processing or triggering actions based on events

• Use Glue for ETL (Extract, Transform, Load) jobs, especially when dealing with large volumes of data or complex transformations

• Lambda is serverless and scales automatically, while Glue provides managed ETL capabilities with built-in connectors to various dat...read more
Answered by AI
Add your answer

Create Architecture for Scalable AWS Data Pipeline

Q1. What is background and overall exp
Add your answer
Q2. Your Weakness and strength
Add your answer
Q3. Salary negotiation
Add your answer