IT Convergence Data Engineer Interview Questions and Answers

Medium level of coding questions.

Q1. About azure data factory
Add your answer
Q2. How to copy multiple csv into single file
Ans. 
Use a command line tool like cat to concatenate multiple CSV files into a single file
• Use the cat command in the terminal to concatenate multiple CSV files into a single file

• Navigate to the directory where the CSV files are located

• Run the command 'cat file1.csv file2.csv > combined.csv' to merge file1.csv and file2.csv into a new file named combined.csv
Answered by AI
Add your answer

Q1. What is hdinsights in azure data factory
Ans. 
HDInsight is a cloud-based service in Azure that makes it easy to process big data using Apache Hadoop, Spark, and other tools.
• HDInsight is a fully managed cloud service that makes it easy to process big data using open-source frameworks like Apache Hadoop, Spark, and more.

• It allows you to create, scale, and monitor Hadoop clusters in Azure.

• HDInsight integrates with Azure Data Factory to provide data orchestration and ...read more
Answered by AI
Add your answer
Q2. How to perform data copy in azure
Ans. 
Data copy in Azure can be performed using Azure Data Factory or Azure Storage Explorer.
• Use Azure Data Factory to create data pipelines for copying data between various sources and destinations.

• Use Azure Storage Explorer to manually copy data between Azure storage accounts.

• Utilize Azure Blob Storage for storing the data to be copied.
Answered by AI
Add your answer

Q1. Expectations in the company
Add your answer
Q2. Ctc and relevant stuff
Add your answer

Q1. Fresher or experienced
Add your answer

Q1. Project history
Add your answer
Q2. Tech stack used
Ans. 
Our tech stack includes Python, SQL, Apache Spark, Hadoop, AWS, and Docker.
• Python is used for data processing and analysis

• SQL is used for querying databases

• Apache Spark is used for big data processing

• Hadoop is used for distributed storage and processing

• AWS is used for cloud infrastructure

• Docker is used for containerization
Answered by AI
Add your answer

Q1. Handled team or not?
Add your answer
Q2. Project experience
Add your answer

Q1. Two simple coding with technical questions
Add your answer

Q1. One simple coding and technical questions along with system design questions
Add your answer

Q1. Work experience
Add your answer

Q1. How to configure vpn
Ans. 
To configure a VPN, you need to set up a VPN server, create user accounts, configure client devices, and establish secure connections.
• Set up a VPN server using software like OpenVPN or Windows Server

• Create user accounts with unique credentials for accessing the VPN

• Configure client devices to connect to the VPN server using the provided credentials

• Establish secure connections by encrypting data transmitted over the VPN
Answered by AI
Add your answer
Q2. System slowness how to resolve
Ans. 
To resolve system slowness, check for hardware issues, optimize software, update drivers, and monitor resource usage.
• Check for hardware issues such as low memory or CPU usage

• Optimize software by removing unnecessary programs or services

• Update drivers for hardware components

• Monitor resource usage to identify bottlenecks
Answered by AI
Add your answer

Nothing it went well

Same here , asked basics of java and C#

Q1. What is sql server agent why can't we create objects of abstract class write extension method for abstract class SQL: SP vs Function, which one is faster, why? can I call SP from Function Microservice orch...read more
Ans. 
SQL Server Agent is a job scheduling tool in SQL Server. Abstract classes cannot be instantiated. SPs are faster than functions. Microservice concepts. IEnumerable vs IQueryable.
• SQL Server Agent is a job scheduling tool in SQL Server for automating tasks like backups, database maintenance, etc.

• Abstract classes cannot be instantiated because they are incomplete and meant to be extended by subclasses.

• Extension methods ca...read more
Answered by AI
Add your answer

Q1. What is record in c# write generic method to perform summation of 2 numeric type variable (int, double, float..) write test cases for Sum method which design pattern you used
Ans. 
A record in C# is a data structure that stores a fixed number of fields of different data types.
• A record in C# is similar to a struct in C++, containing fields to store data.

• Example: 'public record Person { public string Name; public int Age; }'

• Generic method for summation: 'public T Sum(T a, T b) where T : struct, IConvertible { return Convert.ToDouble(a) + Convert.ToDouble(b); }'

• Test cases can include checking the su...read more
Answered by AI
Add your answer
Q2. This was the worst interview I have ever given. Interview got rescheduled 3 times. The panelist behaved so rudely, Why people wouldn't even care to show his face, it's literally very frustrating.
Add your answer

Q1. Oops solid sql .net
Add your answer
Q2. Angular .net core
Add your answer