AVASOFT Senior Data Engineer Interview Questions and Answers

Q1. How did you ingest kafka data and you day to day activity
Ans. 
I ingested Kafka data using Kafka Connect and performed data processing and analysis on a daily basis.
• Used Kafka Connect to ingest data from various sources into Kafka topics

• Developed custom Kafka Connect connectors for specific data sources

• Utilized Kafka Streams for real-time data processing and analysis

• Worked with schema registry for data serialization and deserialization
Answered by AI
Add your answer
Q2. What is catalyst optimizer
Ans. 
Catalyst optimizer is a query optimization framework in Apache Spark that improves performance by generating optimized query plans.
• Catalyst optimizer is a rule-based optimization framework in Apache Spark.

• It leverages advanced techniques like predicate pushdown, constant folding, and join reordering to optimize query plans.

• Catalyst optimizer helps in improving the performance of Spark SQL queries by selecting the most ...read more
Answered by AI
Add your answer

Q1. Stored procedure sql hard
Add your answer
Q2. Easy dsa problem solving
Add your answer

Normal online code / frontend test

Q1. How would you build book my show
Ans. 
Designing and building a platform similar to BookMyShow involves creating a user-friendly interface for booking tickets for various events.
• Develop a user-friendly website and mobile app for users to browse and book tickets for movies, concerts, plays, etc.

• Implement a secure payment gateway for users to make online transactions.

• Integrate a database to store information about events, venues, tickets, and user bookings.

• In...read more
Answered by AI
Add your answer

Q1. Solid principals, awareness of patterns
Add your answer

Q1. How would you build tinyurl like service, systems designs
Ans. 
To build a tinyurl-like service, design a system with a URL shortening algorithm, a database to store mappings, and a redirect service.
• Use a hashing algorithm to generate short URLs from long URLs (e.g. MD5, SHA-256).

• Store the mappings of short URLs to long URLs in a database (e.g. MySQL, Redis).

• Implement a redirect service that takes a short URL, looks up the corresponding long URL in the database, and redirects the u...read more
Answered by AI
Add your answer

Q1. Non-technical questions
Add your answer

Mainly 4 Questions
1-2 MCQ
3: Create a class deriving from IReptile and return an object of HatchEgg which has Hatch Method. Hatch Method should return same IReptile object.
4) Sorting IDs in dictionary

Q1. The Interviewer was Very Rude and he doesn't care about the Requirements of Hiring a candidate. he was constantly asking about Other Companies Architectures and The things you did in them. instead of havin...read more
Add your answer
Q2. SOLID, Interfaces , Boxing/Unboxing
Add your answer

Q1. Find longest palindromic substring in a given string.
Ans. 
Use dynamic programming to find the longest palindromic substring in a given string.
• Iterate through the string and expand around each character to find palindromes.

• Store the length of the longest palindrome found so far.

• Return the substring based on the start and end indices of the longest palindrome.
Answered by AI
Add your answer
Q2. How to serialize and deserialise a tree
Ans. 
To serialize and deserialize a tree, use a recursive approach to traverse the tree and store the data in a suitable format.
• Use pre-order traversal to serialize the tree by storing the node values in a list or string.

• For deserialization, reconstruct the tree by recursively building nodes from the serialized data.

• Consider using JSON or XML format for serialization to easily store and retrieve tree structure.
Answered by AI
Add your answer
Q3. Find if a given regex (containing ., * and lower case english chars) matches a given string.
Ans. 
Use regex library to match given regex with string.
• Use a regex library like re in Python to match the given regex with the string.

• Check if the regex matches the string using the library functions.

• Handle cases where the regex contains special characters like . and * appropriately.
Answered by AI
Add your answer
Q4. Explain about throttling and implement throttle function.
Ans. 
Throttling is a technique used to control the rate of requests sent to a server.
• Throttling helps prevent server overload by limiting the number of requests processed at a time.

• Implementing a throttle function involves setting a maximum request rate and delaying excess requests.

• Example: Implementing a throttle function in a web application to limit the number of API calls made to a third-party service.

• Example: Throttlin...read more
Answered by AI
Add your answer

Q1. Find squares of elements in a sorted array and return the sorted response.
Ans. 
Sort the squares of elements in a sorted array and return the sorted response.
• Iterate through the array and square each element.

• Store the squared values in a new array.

• Sort the new array and return it.
Answered by AI
Add your answer
Q2. Write a short promise example and implement your own promise
Ans. 
A promise is a commitment to do something in the future, typically used for asynchronous operations in JavaScript.
• Promises are used to handle asynchronous operations in JavaScript.

• They represent a value that may be available now, in the future, or never.

• Promises have three states: pending, fulfilled, or rejected.

• Example: new Promise((resolve, reject) => { setTimeout(() => resolve('Done!'), 1000); });
Answered by AI
Add your answer
Q3. Explain event loop, what are different types of queues in event loop
Ans. 
Event loop is a mechanism that allows for asynchronous execution of code by managing the order of events in a single thread.
• Event loop continuously checks the call stack for any functions that need to be executed, and processes them in a non-blocking manner.

• Different types of queues in event loop include microtask queue (Promise callbacks), macrotask queue (setTimeout, setInterval callbacks), and animation frame queue
Answered by AI
Add your answer
Q4. What is virtual DOM and why its faster
Ans. 
Virtual DOM is a lightweight copy of the actual DOM, used to improve performance by minimizing direct manipulation of the real DOM.
• Virtual DOM is a concept used in frameworks like React to optimize rendering performance.

• Changes are first made to the virtual DOM, which is then compared to the real DOM to identify the minimal updates needed.

• This approach reduces the number of actual DOM manipulations, resulting in faster...read more
Answered by AI
Add your answer

Q1. Reverse the linked list.
Add your answer

Q1. Internel working of Hashmap
Add your answer

Q1. Salary Discussion
Add your answer

It was well designed

Q1. Basic Questions about data warehousing
Add your answer
Q2. Dbt Scenarios
Add your answer