Accend Systems Data Engineer Interview Questions and Answers

They asked various questions on guestimates and few SQL Questions

Q1. They asked questions on spark, SQL and Python
Add your answer
Q2. They asked questions on ADF as well
Add your answer

Q1. They majorly focused on PySpark and ADF in this round
Add your answer
Q2. They focused on the project also in this round
Add your answer

Q1. They focused on managerial-related questions in this round
Add your answer

Q1. List vs tuple ?
Add your answer
Q2. What is Slowly changing dimension
Add your answer

Q1. What is Databricks, Internals of it, Optimization technique
Ans. 
Databricks is a unified analytics platform that provides a collaborative environment for data scientists, engineers, and analysts.
• Databricks is built on top of Apache Spark, providing a unified platform for data engineering, data science, and business analytics.

• Internals of Databricks include a cluster manager, job scheduler, and workspace for collaboration.

• Optimization techniques in Databricks include query optimizati...read more
Answered by AI
Add your answer
Q2. SQL questions of joins,group by
Add your answer

Q1. Scenario based azure data factory questions
Add your answer
Q2. Project structres, pyspark dataframes related
Add your answer

Q1. What Volume of data have you handled in your POCs ?
Ans. 
I have handled terabytes of data in my POCs, including data from various sources and formats.
• Handled terabytes of data in POCs

• Worked with data from various sources and formats

• Used tools like Hadoop, Spark, and SQL for data processing
Answered by AI
View 1 more answer
Q2. When will you decide to use repartition and coalesce?
Ans. 
Repartition is used for increasing partitions for parallelism, while coalesce is used for decreasing partitions to reduce shuffling.
• Repartition is used when there is a need for more partitions to increase parallelism.

• Coalesce is used when there are too many partitions and need to reduce them to avoid shuffling.

• Example: Repartition can be used before a join operation to evenly distribute data across partitions for bette...read more
Answered by AI
Add your answer
Q3. How will you design/configure a cluster if you have given 10 petabytes of data.
Ans. 
Designing/configuring a cluster for 10 petabytes of data involves considerations for storage capacity, processing power, network bandwidth, and fault tolerance.
• Consider using a distributed file system like HDFS or object storage like Amazon S3 to store and manage the large volume of data.

• Implement a scalable processing framework like Apache Spark or Hadoop to efficiently process and analyze the data in parallel.

• Utilize...read more
Answered by AI
Add your answer

Its mandatory test even for experience people

Q1. Related to technology
Add your answer

Q1. Very good discussion towards work culture, salary and all
Add your answer

Q1. What are cyclic linked lists
Ans. 
Cyclic linked lists are linked lists where the last node points back to the first node, creating a loop.
• Cyclic linked lists have no NULL pointers, making it difficult to determine the end of the list.

• They can be used to efficiently represent circular data structures like a round-robin scheduling algorithm.

• Detecting cycles in a linked list can be done using Floyd's cycle-finding algorithm.
Answered by AI
Add your answer
Q2. Coding question from BST
Add your answer

Q1. About data modelling and Architecture
Add your answer
Q2. Real world problem and solution
Ans. 
Real world problem: Predicting customer churn in a subscription-based service
• Collect and analyze customer data such as usage patterns, demographics, and interactions

• Use machine learning algorithms to identify factors leading to churn

• Implement targeted retention strategies based on the analysis

• Monitor and evaluate the effectiveness of the strategies over time
Answered by AI
Add your answer

Q1. Sql technical round
Add your answer
Q2. About various azure services
Add your answer

Q1. About my work area
Add your answer
Q2. Managerial and company fit
Add your answer

Q1. Sql questions were
Add your answer
Q2. Spark related aswell
Add your answer

Asked me two string array question one was to reverse a string without any pre build function and second one was a medium question to print the number and the count of it into the next level of the tree

Q1. Who is your idol?
Add your answer
Q2. How do you menage your work?
Ans. 
I manage my work by prioritizing tasks, setting goals, staying organized, and communicating effectively with team members.
• Prioritize tasks based on deadlines and importance

• Set clear goals and milestones to track progress

• Stay organized with tools like project management software

• Communicate effectively with team members to ensure alignment and collaboration
Answered by AI
Add your answer