OSI Digital Data Engineer Interview Questions and Answers

Based on SQL , statistics , python , cognitive

Q1. Based on AI/Ml and based on cv
Add your answer
Q2. Based on projects
Add your answer

Q1. How to handle toxic work culture?
Ans. 
Address toxic work culture by open communication, setting boundaries, seeking support, and considering leaving if necessary.
• Open communication with colleagues and management about issues

• Set boundaries to protect your mental and emotional well-being

• Seek support from HR, a mentor, or a therapist if needed

• Consider leaving the toxic work environment if the situation does not improve
Answered by AI
Add your answer
Q2. 5 strength and weakness
Add your answer

Q1. Spark basic question , hive related questions.
Add your answer

Q1. Questions on Pyspark
Add your answer
Q2. Questions on SQL
Add your answer
Q3. Transformations
Add your answer
Q4. Questions on Sql optimizations
Add your answer
Q5. Questions About my current Project
Add your answer

Q1. Incremental load in pyspark
Ans. 
Incremental load in pyspark refers to loading only new or updated data into a dataset without reloading the entire dataset.
• Use the 'delta' function in pyspark to perform incremental loads by specifying the 'mergeSchema' option.

• Utilize the 'partitionBy' function to optimize incremental loads by partitioning the data based on specific columns.

• Implement a logic to identify new or updated records based on timestamps or uni...read more
Answered by AI
Add your answer
Q2. Drop duplicates
Add your answer

Technical Assessment Test (MCQs) - 30 mins.

Q1. Basic Questions on: 1.Python 2.SQL 3.Spark
Add your answer
Q2. Python: Replace all occurrences of word: "apple" with "froot" and count no.of occurrences of word: "apple" - in a given string (multiple lines) SQL: 1. Retrieve employee details, drawing the maximum salar...read more
Add your answer
Q3. Convert string (multiple lines) to list
Ans. 
Use the split() method to convert a string with multiple lines into a list of strings.
• Use the split() method with the newline character '\n' as the delimiter to split the string into a list of strings.

• Example: 'Hello\nWorld\n' -> ['Hello', 'World']
Answered by AI
Add your answer
Q4. Convert string of multiple lines with 'n' words to multiple arrays of fixed size: k, with no overlap of elements accross arrays.
Ans. 
Convert a string of multiple lines with 'n' words to multiple arrays of fixed size without overlap.
• Split the string into individual words

• Create arrays of fixed size 'k' and distribute words evenly

• Handle cases where the number of words is not divisible by 'k'
Answered by AI
Add your answer

Java and sql questions

Simple java program for find factorial and prime number

Q1. Different type of license in power bi. Data Modelling.
Ans. 
Power BI offers different types of licenses for data modeling, including Power BI Pro and Power BI Premium.
• Power BI Pro license allows users to create and share reports and dashboards with others.

• Power BI Premium license offers additional features such as larger data capacity and advanced AI capabilities.

• Power BI Embedded license is designed for embedding reports and dashboards into custom applications.

• Power BI Report ...read more
Answered by AI
Add your answer

Q1. What abt you know tiger
Add your answer
Q2. General hr questions
Add your answer

Q1. What is Pyspark?
Ans. 
Pyspark is a Python API for Apache Spark, a powerful open-source distributed computing system.
• Pyspark is used for processing large datasets in parallel across a cluster of computers.

• It provides high-level APIs in Python for Spark programming.

• Pyspark allows seamless integration with other Python libraries like Pandas and NumPy.

• Example: Using Pyspark to perform data analysis and machine learning tasks on big data sets.
Answered by AI
Add your answer
Q2. What is Pyspark SQL?
Ans. 
Pyspark SQL is a module in Apache Spark that provides a SQL interface for working with structured data.
• Pyspark SQL allows users to run SQL queries on Spark dataframes.

• It provides a more concise and user-friendly way to interact with data compared to traditional Spark RDDs.

• Users can leverage the power of SQL for data manipulation and analysis within the Spark ecosystem.
Answered by AI
Add your answer
Q3. How to merge 2 dataframes of different schema?
Ans. 
To merge 2 dataframes of different schema, use join operations or data transformation techniques.
• Use join operations like inner join, outer join, left join, or right join based on the requirement.

• Perform data transformation to align the schemas before merging.

• Use tools like Apache Spark, Pandas, or SQL to merge dataframes with different schemas.
Answered by AI
Add your answer
Q4. What is Pyspark streaming?
Ans. 
Pyspark streaming is a scalable and fault-tolerant stream processing engine built on top of Apache Spark.
• Pyspark streaming allows for real-time processing of streaming data.

• It provides high-level APIs in Python for creating streaming applications.

• Pyspark streaming supports various data sources like Kafka, Flume, Kinesis, etc.

• It enables windowed computations and stateful processing for handling streaming data.

• Example: C...read more
Answered by AI
Add your answer