Kellton Lead Engineer Interview Questions and Answers

Q1. What are python libraries used as a data engineer?
Ans. 
Python libraries commonly used by data engineers include Pandas, NumPy, Matplotlib, and Scikit-learn.
• Pandas: Used for data manipulation and analysis.

• NumPy: Provides support for large, multi-dimensional arrays and matrices.

• Matplotlib: Used for creating visualizations and plots.

• Scikit-learn: Offers machine learning algorithms and tools for data analysis.
Answered by AI
Add your answer
Q2. What is PySpark
Ans. 
PySpark is a Python API for Apache Spark, a powerful open-source distributed computing system.
• PySpark allows users to write Spark applications using Python programming language.

• It provides high-level APIs in Python for Spark's functionality, making it easier to work with large datasets.

• PySpark can be used for data processing, machine learning, graph processing, and more.

• Example: PySpark can be used to perform data anal...read more
Answered by AI
Add your answer
Q3. Explain about your project Architecture
Add your answer

Q1. What is Delta Lake and its benefits
Ans. 
Delta Lake is an open-source storage layer that brings ACID transactions to Apache Spark and big data workloads.
• Provides ACID transactions for big data workloads

• Ensures data reliability and quality by enabling schema enforcement and data versioning

• Supports batch and streaming data processing

• Improves data quality and reliability by enabling schema enforcement and data versioning
Answered by AI
Add your answer
Q2. How will you create a end to end pipelines in Data Factory if my source and target are SQL and ASQL respectively?
Ans. 
Create end to end pipelines in Data Factory with SQL and ASQL as source and target respectively.
• Use Copy Data activity to move data from SQL source to ASQL target

• Define linked services for SQL and ASQL in Data Factory

• Create datasets for SQL and ASQL tables

• Map columns between source and target datasets

• Configure data flow activities for any transformations needed
Answered by AI
Add your answer

Basic of Oracle/SQL : Joins, left join , trigger

Q1. Tell me about yourself
Add your answer
Q2. What are pros and cons
Ans. 
Pros and cons of a Lead Engineer role
• Pros: opportunity to lead and mentor a team, chance to make high-level technical decisions, potential for career growth and advancement

• Cons: increased responsibility and pressure, potential for conflicts with team members or stakeholders, need to balance technical and managerial tasks
Answered by AI
Add your answer

Q1. Good interview with skilled questions and discussions
Add your answer
Q2. How much you expect
Add your answer

Q1. Oops,c# basic,MVC,SQL
Add your answer
Q2. Angular,WEBAPI,dataTable,Kendo
Add your answer

Q1. Manager - most Employee Behaviour test
Add your answer

Q1. Package discussion,basic employee behaviour
Add your answer