Concentrix Catalyst Data Engineer 1 Interview Questions and Answers

MCQ based technical questions they have asked. Covering most of the basic abinitio components

Q1. Technical questions like scd types ,rollup normalise join scenarios.
Add your answer

Aptitude Questions related to Basic Quanitative aptitue, psuedo code snippets,Computer Fundamental Questions, Related to Operating System

There are 3 coding question
1.Easy (Related to Arrays)
2.Medium(String related questions)
3.Medium(Stack related questions)

Q1. 1.Introduction 2.Discussion about my projects 3.Questions on some terms which was mentioned in my project 4.One easy level coding questions 5. Two sql questions related to Join Logic 6.Some questions relat...read more
Add your answer

Q1. Mainly for Document Verification
Add your answer

Q1. How would you create a pipeline for ADLS to SQL data movement?
Add your answer
Q2. How would you create a pipeline from REST API to ADLS? What is there are 8 million rows of records?
Add your answer
Q3. IF data needs filtering, joining and aggregation, how would you do it with ADF?
Add your answer
Q4. Explain medallion architecture.
Add your answer
Q5. Explain medallion with databricks
Add your answer

Q1. Basic questions and salary expectation.
Add your answer

Q1. What are different type of joins available in Databricks?
Ans. 
Different types of joins available in Databricks include inner join, outer join, left join, right join, and cross join.
• Inner join: Returns only the rows that have matching values in both tables.

• Outer join: Returns all rows when there is a match in either table.

• Left join: Returns all rows from the left table and the matched rows from the right table.

• Right join: Returns all rows from the right table and the matched rows ...read more
Answered by AI
Add your answer
Q2. How do you make your data pipeline fault tolerant?
Ans. 
Implementing fault tolerance in a data pipeline involves redundancy, monitoring, and error handling.
• Use redundant components to ensure continuous data flow

• Implement monitoring tools to detect failures and bottlenecks

• Set up automated alerts for immediate response to issues

• Design error handling mechanisms to gracefully handle failures

• Use checkpoints and retries to ensure data integrity
Answered by AI
Add your answer
Q3. What is AutoLoader?
Ans. 
AutoLoader is a feature in data engineering that automatically loads data from various sources into a data warehouse or database.
• Automates the process of loading data from different sources

• Reduces manual effort and human error

• Can be scheduled to run at specific intervals

• Examples: Apache Nifi, AWS Glue
Answered by AI
Add your answer

Q1. How do you connect to different services in Azure?
Ans. 
To connect to different services in Azure, you can use Azure SDKs, REST APIs, Azure Portal, Azure CLI, and Azure PowerShell.
• Use Azure SDKs for programming languages like Python, Java, C#, etc.

• Utilize REST APIs to interact with Azure services programmatically.

• Access and manage services through the Azure Portal.

• Leverage Azure CLI for command-line interface interactions.

• Automate tasks using Azure PowerShell scripts.
Answered by AI
Add your answer
Q2. What are linked Services?
Ans. 
Linked Services are connections to external data sources or destinations in Azure Data Factory.
• Linked Services define the connection information needed to connect to external data sources or destinations.

• They can be used in Data Factory pipelines to read from or write to external systems.

• Examples of Linked Services include Azure Blob Storage, Azure SQL Database, and Amazon S3.
Answered by AI
Add your answer

Q1. Can you provide an overview of your background, including your past experiences and daily activities, as well as the tools you use in your routine?
Add your answer
Q2. What are the concepts of advanced Excel and Power BI projects, and how are they utilized within a company or for clients?
Add your answer

Q1. Can you explain your project experience related to Advanced Excel and Power BI?
Add your answer
Q2. What are the concepts of credit and operations, particularly in relation to Know Your Customer (KYC) procedures and the privacy of client data?
Add your answer

Q1. How can you design an Azure Data Factory pipeline to copy data from a folder containing files with different delimiters to another folder?
Add your answer
Q2. Write a pyspark program that reads multiple csv files and creates a data frame with count of records against each file
Add your answer

Two coding questions related to matrices and heaps.

Q1. Python and SQL coding
Add your answer

Q1. Same questions like tech 1
Add your answer

Q1. Self intro , why tiger
Add your answer
Q2. Relocation
Add your answer

NA kjwnoi wniowe nfiow flmi

NA fklwmoiwef,m ionfwno njnwfeio onfwp

Q1. NAnak wel wenk weon
Add your answer
Q2. NAnank
Add your answer

Q1. Wedlk k fwkllk own lnfw
Add your answer
Q2. Now odnw pmpw pnwpf
Add your answer