Metyis Lead Data Engineer Interview Questions and Answers

Q1. Given a DataFrame df with columns 'A', 'B','C' how would you group the data by the values in column 'A' and calculate the mean of column 'B' for each group, while also summing the values in column 'C' ?
Ans. 
Group data by column 'A', calculate mean of column 'B' and sum values in column 'C' for each group.
• Use groupby() function in pandas to group data by column 'A'

• Apply mean() function on column 'B' and sum() function on column 'C' for each group

• Example: df.groupby('A').agg({'B':'mean', 'C':'sum'})
Answered by AI
Add your answer
Q2. Explain the difference deepcopy() and copy() methods in Python's copy module. Provide a scenario where you would use deepcopy() over copy().
Ans. 
deepcopy() creates a new object with completely independent copies of nested objects, while copy() creates a shallow copy.
• deepcopy() creates a new object and recursively copies all nested objects, while copy() creates a shallow copy of the top-level object only.

• Use deepcopy() when you need to create a deep copy of an object with nested structures, to avoid any references to the original object.

• Use copy() when you only ...read more
Answered by AI
Add your answer
Q3. Discuss the concept of Python decorators and provide an example of how you would use decorators to measure the execution time of a function.
Ans. 
Python decorators are functions that modify the behavior of other functions. They are commonly used for adding functionality to existing functions without modifying their code.
• Decorators are defined using the @ symbol followed by the decorator function name.

• They can be used to measure the execution time of a function by wrapping the function with a timer decorator.

• Example: def timer(func): def wrapper(*args, **kwargs...read more
Answered by AI
Add your answer

Q1. Questions related to the current and past projects.
Add your answer
Q2. Aws related questions.
Add your answer
Q3. Data warehousing basics
Add your answer

Q1. Explain about the roles and responsibilities.
Add your answer
Q2. Discussion about the role in Genpact.
Add your answer

Q1. Asked about expectated salary
Add your answer
Q2. Why are you switching
Add your answer

Q1. Window function coding test
Ans. 
Window function coding test involves using window functions in SQL to perform calculations within a specified window of rows.
• Understand the syntax and usage of window functions in SQL

• Use window functions like ROW_NUMBER(), RANK(), DENSE_RANK(), etc. to perform calculations

• Specify the window frame using PARTITION BY and ORDER BY clauses

• Practice writing queries with window functions to get comfortable with their usage
Answered by AI
Add your answer
Q2. Explain azure data factory
Ans. 
Azure Data Factory is a cloud-based data integration service that allows you to create, schedule, and manage data pipelines.
• Azure Data Factory is used to move and transform data from various sources to destinations.

• It supports data integration processes like ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform).

• You can create data pipelines using a visual interface in Azure Data Factory.

• It can connect to on...read more
Answered by AI
Add your answer

Q1. What is data vault
Ans. 
Data Vault is a modeling methodology for designing highly scalable and flexible data warehouses.
• Data Vault focuses on long-term historical data storage

• It consists of three main components: Hubs, Links, and Satellites

• Hubs represent business entities, Links represent relationships between entities, and Satellites store attributes of entities

• Data Vault allows for easy scalability and adaptability to changing business requ
Answered by AI
Add your answer
Q2. What is lambda architecture
Ans. 
Lambda architecture is a data processing architecture designed to handle massive quantities of data by using both batch and stream processing methods.
• Combines batch processing layer, speed layer, and serving layer

• Batch layer processes historical data in large batches

• Speed layer processes real-time data

• Serving layer merges results from batch and speed layers for querying

• Example: Apache Hadoop for batch processing, Apach
Answered by AI
Add your answer

Q1. Whether have onsite exposure
Ans. 
Yes, I have onsite exposure in previous roles.
• I have worked onsite at various client locations to gather requirements and implement solutions.

• I have experience collaborating with cross-functional teams in person.

• I have conducted onsite training sessions for end users on data architecture best practices.

• I have participated in onsite data migration projects.

• I have worked onsite to troubleshoot and resolve data-related is
Answered by AI
Add your answer

Q1. Data Modeling Concepts, SQL Query
Add your answer
Q2. Data Governance, Data Lineage, ETL process,
Add your answer

SQL Scripts to write and also also asked to design an data model of my choice in Telecom Domain

Test your algorithmic thinking and problem solving skills

Q1. Communications,clearity of answers
Add your answer

Q1. Discussion about packages,joining date
Add your answer

Te Question can came throuth:-
1. How can you take out the details or values from two tables?
2. How can you add Columns and Values in a table?

They can give us some Assistant to do

Q1. About oracle database functionality
Add your answer

Q1. Salary discussion
Add your answer

Q1. Basic of etl process, sql, unix
Add your answer