Citicorp Big Data Engineer Interview Questions and Answers

Q1. Get the maximum salary of the employee from the employee and department table
Add your answer
Q2. Explain the data analysis process that you would follow for employee salary table
Ans. 
The data analysis process for an employee salary table involves data cleaning, exploration, visualization, and modeling.
• Start by cleaning the data to remove any duplicates, missing values, or outliers.

• Explore the data by calculating basic statistics like mean, median, and standard deviation.

• Visualize the data using histograms, box plots, or scatter plots to identify patterns or trends.

• Perform statistical modeling to an...read more
Answered by AI
Add your answer
Q3. Explain the challenges you faced in your project
Ans. 
I faced challenges in managing large datasets and ensuring data accuracy in my project.
• Managing large volumes of data from multiple sources

• Ensuring data accuracy and consistency

• Dealing with missing or incomplete data

• Handling data cleaning and preprocessing tasks

• Addressing technical issues with data storage or processing tools
Answered by AI
Add your answer

Basic aptitude questions

Data structure and algorithms

Q1. Java, SQL questions
Add your answer

Q1. Casual talk about roles
Add your answer

Q1. What is p value?
Ans. 
A p-value is a measure used in statistical hypothesis testing to determine the strength of evidence against the null hypothesis.
• A p-value is the probability of obtaining results as extreme as the observed results, assuming the null hypothesis is true.

• A p-value is compared to a significance level (usually 0.05) to determine if the null hypothesis should be rejected.

• A p-value less than the significance level indicates st
Answered by AI
Add your answer
Q2. Tell the output a**2
Ans. 
The output of a**2 is the square of the value of a.
• The output is the value of a multiplied by itself

• For example, if a = 3, then the output would be 9 (3*3)
Answered by AI
Add your answer
Q3. Difference between append() and concat
Ans. 
append() adds elements to a single DataFrame, while concat() combines multiple DataFrames.
• append() is a method used to add rows to a DataFrame.

• concat() is a function used to combine multiple DataFrames along a particular axis.

• append() modifies the original DataFrame, while concat() returns a new DataFrame.

• Example: df1.append(df2) vs pd.concat([df1, df2])
Answered by AI
Add your answer

Basic aptitude test like distance problem , age etc

Q1. EXPLAIN ABOUT YOUR PROJECT
Add your answer

Q1. Explain error handling in PySpark
Ans. 
Error handling in PySpark involves using try-except blocks and logging to handle exceptions and errors.
• Use try-except blocks to catch and handle exceptions in PySpark code

• Utilize logging to record errors and exceptions for debugging purposes

• Consider using the .option('mode', 'PERMISSIVE') method to handle corrupt records in data processing
Answered by AI
Add your answer

Q1. Data Warehousing related questions
Add your answer

Q1. Data Modelling related questions
Add your answer