CVS Health Data Engineer Interview Questions and Answers

Python coding and SQL questions.

Q1. Spark Concepts, architecture, tuning
Add your answer
Q2. Optimization Techniques
Add your answer

Q1. Merge 2 unsorted array
Ans. 
Merge two unsorted arrays into a single sorted array.
• Create a new array to store the merged result

• Iterate through both arrays and compare elements to merge in sorted order

• Handle remaining elements in either array after one array is fully processed
Answered by AI
Add your answer
Q2. Explain spark theory question
Ans. 
Apache Spark is a fast and general-purpose cluster computing system.
• Apache Spark is an open-source distributed computing system that provides an interface for programming entire clusters with implicit data parallelism and fault tolerance.

• It can be used for a wide range of applications such as batch processing, real-time stream processing, machine learning, and graph processing.

• Spark provides high-level APIs in Java, Sc...read more
Answered by AI
Add your answer

Q1. More depth on python and spark
Add your answer

It was more aboiut coding

Q1. What is spark and where is it used?
Add your answer
Q2. What is self hosted ir in adf?
Add your answer

Q1. Joins, Aggregations, Projects detailing
Add your answer
Q2. Python and pyspark codes
Add your answer

Q1. Project question like how connected to s3 bucket through pyspark,HDFS basic commands likhe copy etc ,how and where created hive table (if used in your project).
Add your answer
Q2. Share variables in pyspark like broadcast and accumulator..(i will suggest go through pyspark official documentation once)
Add your answer
Q3. Sql joins- , how to read file in pyspark, job scheduling means resource allocation within and across spark..(ans- can go through job scheduling of pyspark documentaion )
Add your answer

Q1. What is pyspark
Ans. 
PySpark is a Python API for Apache Spark, a powerful open-source distributed computing system.
• PySpark is used for processing large datasets with distributed computing.

• It provides high-level APIs in Python for Spark programming.

• PySpark allows seamless integration with Python libraries like Pandas and NumPy.

• Example: PySpark can be used for data processing, machine learning, and real-time analytics.
Answered by AI
Add your answer
Q2. Difference between external and internal table
Ans. 
External tables reference data stored outside the database, while internal tables store data within the database.
• External tables are defined on data that is stored outside the database, such as in HDFS or S3.

• Internal tables store data within the database itself, typically in a managed storage like HDFS or S3.

• External tables do not delete data when dropped, while internal tables do.

• Internal tables are managed by the dat...read more
Answered by AI
Add your answer

Q1. Few Questions on Spark
Add your answer
Q2. Basic of Scala questions and coding
Add your answer

Quant , reasoning, english, coding

Q1. Technical concepts mentioned in resume
Add your answer
Q2. Some behavioural questions
Add your answer