American Broadcasting Company Data Engineer Interview Questions and Answers

Q1. Spark rddd , data frame and data set difference
Add your answer

Q1. What is hive , scala
Ans. 
Hive is a data warehouse infrastructure tool while Scala is a programming language for data analysis and processing.
• Hive is a data warehouse infrastructure built on top of Hadoop for querying and managing large datasets.

• Scala is a programming language that is concise, expressive, and integrates well with big data tools like Apache Spark.

• Both Hive and Scala are commonly used in big data processing and analytics projects
Answered by AI
Add your answer
Q2. What is spark context
Ans. 
Spark context is the main entry point for Spark functionality and represents the connection to a Spark cluster.
• Main entry point for Spark functionality

• Represents connection to a Spark cluster

• Used to create RDDs, broadcast variables, and accumulators
Answered by AI
Add your answer

Valid parentheses in python

Q1. Types of joins in sql
Ans. 
Types of joins in SQL include inner join, left join, right join, and full outer join.
• Inner join: returns rows when there is a match in both tables

• Left join: returns all rows from the left table and the matched rows from the right table

• Right join: returns all rows from the right table and the matched rows from the left table

• Full outer join: returns all rows when there is a match in either table
Answered by AI
Add your answer
Q2. Best practices used in sql
Ans. 
Best practices in SQL include using indexes, optimizing queries, normalizing data, and using stored procedures.
• Use indexes to improve query performance

• Optimize queries by avoiding unnecessary joins and using appropriate WHERE clauses

• Normalize data to reduce redundancy and improve data integrity

• Use stored procedures for frequently executed tasks to improve performance
Answered by AI
Add your answer