Add office photos
Filter interviews by
Virtusa Consulting Services Big Data Engineer Interview Questions, Process, and Tips
Top Virtusa Consulting Services Big Data Engineer Interview Questions and Answers
- Q1. what type of filesystem used in ur project
- Q2. Command to check disk utilisation and health in Hadoop
- Q3. Pivot table creation in SQL from not pivot one
Virtusa Consulting Services Big Data Engineer Interview Experiences
2 interviews found
Anonymous
I was interviewed in Nov 2024.
(7 Questions)
- Q1. Command to check disk utilisation and health in Hadoop
- Ans.
Use 'hdfs diskbalancer' command to check disk utilisation and health in Hadoop
Run 'hdfs diskbalancer -report' to get a report on disk utilisation
Use 'hdfs diskbalancer -plan <path>' to generate a plan for balancing disk usage
Check the Hadoop logs for any disk health issues
- Q2. Spark Architecture & the significance of each member of spark Architecture
- Ans.
Spark Architecture consists of Driver, Cluster Manager, and Executors. Driver manages the execution of Spark jobs.
Driver: Manages the execution of Spark jobs, converts user code into tasks, and coordinates with Cluster Manager.
Cluster Manager: Manages resources across the cluster and allocates resources to Spark applications.
Executors: Execute tasks assigned by the Driver and store data in memory or disk for further pr...
- Q3. Partitioning and bucketing
- Q4. Spark optimization techniques
- Ans.
Optimization techniques in Spark improve performance and efficiency of data processing.
Partitioning data to distribute workload evenly
Caching frequently accessed data in memory
Using broadcast variables for small lookup tables
Avoiding shuffling operations whenever possible
Tuning memory settings and garbage collection parameters
- Q5. Second highest salary
- Ans.
I am unable to provide this information as it is confidential.
Confidential information about salaries in previous organizations should not be disclosed.
It is important to respect the privacy and confidentiality of past employers.
Discussing specific salary details may not be appropriate in a professional setting.
- Q6. Pivot table creation in SQL from not pivot one
- Ans.
To create a pivot table in SQL from a non-pivot table, you can use the CASE statement with aggregate functions.
Use the CASE statement to categorize data into columns
Apply aggregate functions like SUM, COUNT, AVG, etc. to calculate values for each category
Group the data by the columns you want to pivot on
- Q7. How to create triggers
- Ans.
Creating triggers in a database involves defining the trigger, specifying the event that will activate it, and writing the code to be executed.
Define the trigger using the CREATE TRIGGER statement
Specify the event that will activate the trigger (e.g. INSERT, UPDATE, DELETE)
Write the code or actions to be executed when the trigger is activated
Test the trigger to ensure it functions as intended
Interview Preparation Tips
They are focusing on concept basically
Skills evaluated in this interview
I applied via Referral and was interviewed in Mar 2022. There was 1 interview round.
(3 Questions)
- Q1. Spark optimization techniques
- Ans.
Spark optimization techniques improve performance and efficiency of Spark applications.
Partitioning data to reduce shuffling
Caching frequently used data
Using broadcast variables for small data
Using efficient data formats like Parquet
Tuning memory and CPU usage
Using appropriate cluster size
Avoiding unnecessary data shuffling
Using appropriate serialization formats
Using appropriate join strategies
- Q2. What type of filesystem used in ur project
- Ans.
We use Hadoop Distributed File System (HDFS) for our project.
HDFS is a distributed file system designed to run on commodity hardware.
It provides high-throughput access to application data and is fault-tolerant.
HDFS is used by many big data processing frameworks like Hadoop, Spark, etc.
It stores data in a distributed manner across multiple nodes in a cluster.
HDFS is optimized for large files and sequential reads and wri
- Q3. Spark + SQL basic coding
Interview Preparation Tips
Skills evaluated in this interview
Interview questions from similar companies
I applied via Referral and was interviewed in Dec 2024. There were 2 interview rounds.
30 Questions in 20 Minutes
(1 Question)
- Q1. Baiscs of SQL,Python,AWS and spark in depth question
I applied via Naukri.com and was interviewed in Jul 2023. There were 2 interview rounds.
(2 Questions)
- Q1. Basic Questions of Scala Functional Programming concepts.
- Q2. Spark internal working and optimization techniques
- Ans.
Spark internal working and optimization techniques
Spark uses Directed Acyclic Graph (DAG) for optimizing workflows
Lazy evaluation helps in optimizing transformations by combining them into a single stage
Caching and persistence of intermediate results can improve performance
Partitioning data can help in parallel processing and reducing shuffle operations
Interview Preparation Tips
Skills evaluated in this interview
The aptitude test lasts 30 minutes and focuses on topics relevant to data engineering, including Spark, SQL, Azure, and PySpark.
The coding test is a one-hour examination on PySpark.
(3 Questions)
- Q1. What is the difference between Cache() and Persist()?
- Q2. What does the purpose of the Spark Submit command in Apache Spark?
- Q3. What are window functions in SQL?
(2 Questions)
- Q1. Could you provide more details about the daily responsibilities associated with this role?
- Q2. How would you describe your work culture?
I applied via Job Fair and was interviewed in Nov 2024. There were 2 interview rounds.
(2 Questions)
- Q1. DAX Related Syntax and Codes
- Q2. Data Modelling, SQL, Python
(1 Question)
- Q1. No Response from HR after calling of selection after Round 1
Vishwajit Kumar
I was interviewed in Dec 2024.
(2 Questions)
- Q1. Windows function-related questions.
- Q2. Join Related Questions.
(2 Questions)
- Q1. Join related Questions
- Q2. Subqueries related queations.
I applied via Naukri.com and was interviewed in Nov 2024. There was 1 interview round.
(2 Questions)
- Q1. How do you utilize the enhanced optimization option in AWS Glue?
- Ans.
Enhanced optimization in AWS Glue improves job performance by automatically adjusting resources based on workload
Enhanced optimization in AWS Glue automatically adjusts resources like DPUs based on workload
It helps improve job performance by optimizing resource allocation
Users can enable enhanced optimization in AWS Glue job settings
- Q2. What are the best practices for optimizing querying in Amazon Redshift?
- Ans.
Optimizing querying in Amazon Redshift involves proper table design, distribution keys, sort keys, and query optimization techniques.
Use appropriate distribution keys to evenly distribute data across nodes for parallel processing.
Utilize sort keys to physically order data on disk, reducing the need for sorting during queries.
Avoid using SELECT * and instead specify only the columns needed to reduce data transfer.
Use AN...
Swati Gawali
I applied via Naukri.com and was interviewed in Sep 2024. There was 1 interview round.
(2 Questions)
- Q1. What is scd type 2?
- Ans.
SCD type 2 is a method used in data warehousing to track historical changes by creating a new record for each change.
SCD type 2 stands for Slowly Changing Dimension type 2
It involves creating a new record in the dimension table whenever there is a change in the data
The old record is marked as inactive and the new record is marked as current
It allows for historical tracking of changes in data over time
Example: If a cust...
- Q2. Pyspark question read CSV from folder and add column in each csv file and write it to different location.
Skills evaluated in this interview
RAVI GUPTA
(1 Question)
- Q1. Data engineer roles and resposibilities
Interview Preparation Tips
Virtusa Consulting Services Interview FAQs
Tell us how to improve this page.
Virtusa Consulting Services Interviews By Designations
- Virtusa Consulting Services Associate Engineer Interview Questions
- Virtusa Consulting Services Software Engineer Interview Questions
- Virtusa Consulting Services Software Developer Interview Questions
- Virtusa Consulting Services Lead Consultant Interview Questions
- Virtusa Consulting Services Associate Software Engineer Interview Questions
- Virtusa Consulting Services Senior Consultant Interview Questions
- Virtusa Consulting Services Associate Consultant Interview Questions
- Virtusa Consulting Services Consultant Interview Questions
- Show more
Interview Questions for Popular Designations
Virtusa Consulting Services Big Data Engineer Interview Process
based on 1 interview
Interview experience
Big Data Engineer Interview Questions from Similar Companies
Fast track your campus placements
Virtusa Consulting Services Big Data Engineer Reviews and Ratings
based on 3 reviews
Rating in categories
|
Senior Consultant
4k
salaries
|  ₹8 L/yr - ₹25.5 L/yr |
|
Consultant
3.3k
salaries
| ₹6 L/yr - ₹20.9 L/yr |
|
Lead Consultant
3.3k
salaries
| ₹10.5 L/yr - ₹36 L/yr |
|
Software Engineer
3.2k
salaries
| ₹3.5 L/yr - ₹13 L/yr |
|
Associate Consultant
2.8k
salaries
| ₹4.6 L/yr - ₹15 L/yr |
Cognizant
TCS
Infosys
Accenture
- Home >
- Interviews >
- Virtusa Consulting Services Interview Questions >
- Virtusa Consulting Services Big Data Engineer Interview Questions
