Marsman India Cranes Data Engineer Interview Questions and Answers

Basic aptitude test asking questions very basic

Coding questions based on dsa

Q1. Basic hr question
Add your answer

Q1. General Data Warehousing questions like explain your pipeline, how you implemented scd2?
Add your answer
Q2. SQL questions like increment top 5th salary by 10k, last day of month, etc.
Add your answer

Q1. Project question like how connected to s3 bucket through pyspark,HDFS basic commands likhe copy etc ,how and where created hive table (if used in your project).
Add your answer
Q2. Share variables in pyspark like broadcast and accumulator..(i will suggest go through pyspark official documentation once)
Add your answer
Q3. Sql joins- , how to read file in pyspark, job scheduling means resource allocation within and across spark..(ans- can go through job scheduling of pyspark documentaion )
Add your answer

Q1. Sql scenarios based questions
Add your answer
Q2. Azure data engineering questions
Add your answer

Q1. Ques on GCP, python , sql,github
Add your answer
Q2. What is BQ what are advantages
Ans. 
BQ stands for BigQuery, a fully managed, serverless, and highly scalable cloud data warehouse provided by Google Cloud.
• Advantages of BigQuery include fast query performance due to its distributed architecture

• Scalability to handle large datasets without the need for infrastructure management

• Integration with other Google Cloud services like Dataflow, Dataproc, and Data Studio

• Support for standard SQL queries and real-time...read more
Answered by AI
Add your answer
Q3. Python decorators
Add your answer

Q1. General technical discussion no coding
Add your answer

Q1. SQL - Given 2 tables with some nullls and asked to output the count of rows we get for all types of joins
Add your answer
Q2. Types of joins and explain cross join
Ans. 
Types of joins in SQL include inner, outer, left, right, and cross join.
• Inner join: Returns rows when there is a match in both tables

• Outer join: Returns all rows when there is a match in one of the tables

• Left join: Returns all rows from the left table and the matched rows from the right table

• Right join: Returns all rows from the right table and the matched rows from the left table

• Cross join: Returns the Cartesian produ
Answered by AI
Add your answer

Q1. Projects and impact
Add your answer

Q1. What is the difference between supervised and unsupervised learning?
Ans. 
Supervised learning uses labeled data to train the model, while unsupervised learning uses unlabeled data.
• Supervised learning requires a target variable to be predicted, while unsupervised learning does not.

• In supervised learning, the model learns from labeled training data, whereas in unsupervised learning, the model finds patterns in unlabeled data.

• Examples of supervised learning include regression and classification...read more
Answered by AI
Add your answer
Q2. Elaborate concepts of Object Oriented Programming in Python.
Ans. 
Object Oriented Programming in Python focuses on creating classes and objects to organize code and data.
• Python supports classes, objects, inheritance, polymorphism, and encapsulation.

• Classes are blueprints for creating objects, which are instances of classes.

• Inheritance allows a class to inherit attributes and methods from another class.

• Polymorphism enables objects to be treated as instances of their parent class.

• Encap...read more
Answered by AI
Add your answer
Q3. How to find delta between two tables in SQL?
Ans. 
To find delta between two tables in SQL, use the EXCEPT or MINUS operator.
• Use the EXCEPT operator in SQL to return rows from the first table that do not exist in the second table.

• Use the MINUS operator in SQL to return distinct rows from the first table that do not exist in the second table.
Answered by AI
View 1 more answer
Q4. Illustrate exception handling in python.
Ans. 
Exception handling in Python allows for graceful handling of errors and preventing program crashes.
• Use try-except blocks to catch and handle exceptions.

• Multiple except blocks can be used to handle different types of exceptions.

• Finally block can be used to execute code regardless of whether an exception was raised or not.

• Custom exceptions can be defined by creating a new class that inherits from the built-in Exception c
Answered by AI
Add your answer
Q5. Give an example of decorators in Python?
Ans. 
Decorators in Python are functions that modify the behavior of other functions.
• Decorators are defined using the @decorator_name syntax before the function definition.

• They can be used for logging, timing, authentication, etc.

• Example: @staticmethod decorator in Python makes a method static.
Answered by AI
Add your answer

Q1. What are examples of iaas,paas,saas
Ans. 
Examples of IaaS, PaaS, and SaaS include AWS (IaaS), Google App Engine (PaaS), and Salesforce (SaaS).
• IaaS - Infrastructure as a Service: AWS, Microsoft Azure, Google Cloud Platform

• PaaS - Platform as a Service: Google App Engine, Heroku, Microsoft Azure App Service

• SaaS - Software as a Service: Salesforce, Google Workspace, Microsoft Office 365
Answered by AI
Add your answer
Q2. Difference between Adf and ADB
Ans. 
ADF stands for Azure Data Factory, a cloud-based data integration service. ADB stands for Azure Databricks, an Apache Spark-based analytics platform.
• ADF is used for data integration and orchestration, while ADB is used for big data analytics and machine learning.

• ADF provides a visual interface for building data pipelines, while ADB offers collaborative notebooks for data exploration and analysis.

• ADF supports various da...read more
Answered by AI
Add your answer

Q1. General questions about data engineering
Add your answer

Q1. General question on data topics and cloud
Add your answer

Q1. Salary and location
Add your answer