Maxwell Softpark System Analyst Interview Questions and Answers

Creating a dataframe in adb using struct type

• Use the 'CREATE TABLE' statement to define the schema of the dataframe

• Define the struct type using 'STRUCT' keyword

• Insert data into the dataframe using 'INSERT INTO' statement

Code to find max and second highest salary department wise

• Iterate through the list of employees and store max and second highest salary for each department

• Use a hashmap to store department wise salaries

• Sort the salaries in descending order to find max and second highest

You can call a variable from one notebook to another in adb by using the %run magic command.

• Use the %run magic command followed by the path to the notebook containing the variable you want to access.

• Make sure the notebook containing the variable is in the same directory or provide the full path.

• Once you run the %run command, the variables from the other notebook will be available in the current notebook.

Incremental load in ADF is achieved by using watermark columns to track the last loaded data and only loading new or updated records.

• Use watermark columns to track the last loaded data

• Compare the watermark column value with the source data to identify new or updated records

• Use a filter condition in the source query to only select records with a timestamp greater than the watermark value

• Update the watermark column value

Types of Load Tests include Stress Testing, Spike Testing, Endurance Testing, and Volume Testing.

• Stress Testing: Evaluates system behavior under extreme conditions to determine breaking points.

• Spike Testing: Tests system response to sudden spikes in load to ensure stability.

• Endurance Testing: Checks system performance over an extended period to identify any issues related to prolonged use.

• Volume Testing: Assesses syste...read more

Failover testing is a type of testing that verifies a system's ability to seamlessly switch to a backup system in case of failure.

• Failover testing ensures that a system can switch to a backup system without any downtime or data loss.

• It involves intentionally causing a failure in the primary system to see if the backup system can take over successfully.

• Common examples include testing a website's ability to switch to a b...read more

Little's Law can be used to calculate the pacing for a given number of users and transactions per hour.

• Little's Law states that the average number of users in a system (L) is equal to the average arrival rate (λ) multiplied by the average time a user spends in the system (W). Mathematically, L = λW.

• To calculate pacing, we need to rearrange the formula to solve for W: W = L / λ.

• In this case, we have 200 users and 20,000...read more