_VOIS Gcp Data Engineer Interview Questions and Answers

Q1. Explain your project
Ans. 
Developed a data pipeline to ingest, process, and analyze customer feedback data for a retail company.
• Used Google Cloud Platform services like BigQuery, Dataflow, and Pub/Sub for data processing.

• Implemented data cleansing and transformation techniques to ensure data quality.

• Created visualizations and dashboards using tools like Data Studio for stakeholders to easily interpret the data.
Answered by AI
Add your answer
Q2. GCP bigquery architecture
Add your answer
Q3. Gcp object versioning
Add your answer
Q4. Gcp storage class types
Ans. 
GCP offers different storage classes for varying performance and cost requirements.
• Standard Storage: for frequently accessed data

• Nearline Storage: for data accessed less frequently

• Coldline Storage: for data accessed very infrequently

• Archive Storage: for data stored for long-term retention
Answered by AI
Add your answer
Q5. Sql optimisation techniques
Ans. 
SQL optimization techniques focus on improving query performance by reducing execution time and resource usage.
• Use indexes to speed up data retrieval

• Avoid using SELECT * and instead specify only the columns needed

• Optimize joins by using appropriate join types and conditions

• Limit the use of subqueries and instead use JOINs where possible

• Use EXPLAIN to analyze query execution plans and identify bottlenecks
Answered by AI
Add your answer
Q6. Sql coding date format and joins related questions
Add your answer
Q7. Partitioning and cluster by
Add your answer

Q1. Advanced sql recursive cte and python code using lambda function to explode the list
Add your answer
Q2. Project explanation and daily activity and challenge faced in project
Add your answer

Q1. Which of these 2 select * from table and select * from table limit 100 is faster
Ans. 
select * from table limit 100 is faster
• Using 'select * from table' retrieves all rows from the table, which can be slower if the table is large

• Using 'select * from table limit 100' limits the number of rows retrieved, making it faster

• Limiting the number of rows fetched can improve query performance
Answered by AI
Add your answer
Q2. Explain scd and Merge in bigquery
Ans. 
SCD stands for Slowly Changing Dimension and Merge is a SQL operation used to update or insert data in BigQuery.
• SCD is used to track changes to data over time in a data warehouse

• Merge in BigQuery is used to perform insert, update, or delete operations in a single statement

• Example: MERGE INTO target_table USING source_table ON condition WHEN MATCHED THEN UPDATE SET col1 = value1 WHEN NOT MATCHED THEN INSERT (col1, col2)
Answered by AI
Add your answer
Q3. Architecture of bigquery
Ans. 
BigQuery is a fully managed, serverless data warehouse that enables scalable analysis over petabytes of data.
• BigQuery uses a columnar storage format for efficient querying.

• It supports standard SQL for querying data.

• BigQuery allows for real-time data streaming for analysis.

• It integrates with various data sources like Google Cloud Storage, Google Sheets, etc.

• BigQuery provides automatic scaling and high availability.
Answered by AI
Add your answer
Q4. Dataflow function to split sentence
Ans. 
Dataflow function to split sentence
• Use the Split transform in Dataflow to split the sentence into words

• Apply ParDo function to process each word individually

• Use regular expressions to handle punctuation and special characters
Answered by AI
Add your answer

Need to write codes based on the scenarios

Q1. Reverser a number
Ans. 
Reverse a given number
• Convert the number to a string

• Reverse the string

• Convert the reversed string back to a number
Answered by AI
Add your answer
Q2. Recursion function for factorial
Ans. 
Recursion function to calculate factorial of a number
• Define a function that takes an integer as input

• Base case: if input is 0, return 1

• Recursive case: return input multiplied by factorial of input-1

• Example: factorial(5) = 5 * factorial(4) = 5 * 4 * factorial(3) = ... = 5 * 4 * 3 * 2 * 1 = 120
Answered by AI
Add your answer

Q1. Why you choose tcs
Ans. 
I chose TCS for its reputation, global presence, diverse opportunities, and focus on innovation.
• TCS is a renowned company with a strong reputation in the IT industry

• TCS has a global presence with offices in multiple countries, providing opportunities for international exposure

• TCS offers diverse opportunities for career growth and development in various domains

• TCS is known for its focus on innovation and cutting-edge te
Answered by AI
Add your answer
Q2. What is your notice period
Ans. 
I am currently on a 30-day notice period.
• My notice period is 30 days.

• I am required to work for 30 more days before leaving my current position.
Answered by AI
Add your answer

Q1. What is big query, topics on python
Add your answer

Q1. What are sql joins explain About bigquery related
Ans. 
SQL joins are used to combine rows from two or more tables based on a related column between them.
• SQL joins are used to retrieve data from multiple tables based on a related column between them

• Types of SQL joins include INNER JOIN, LEFT JOIN, RIGHT JOIN, and FULL JOIN

• In BigQuery, joins can be performed using standard SQL syntax

• Example: SELECT * FROM table1 INNER JOIN table2 ON table1.column = table2.column
Answered by AI
Add your answer
Q2. Bigquery, GCS related
Add your answer

Q1. About project related questions
Add your answer

Q1. Bigquery architecture, Advanced SQL question scenario based, cloud storage questions,pubsub,dataflow
Add your answer

Q1. Used cases on bigquery and sql
Ans. 
BigQuery is used for analyzing large datasets and running complex queries, while SQL is used for querying databases.
• BigQuery is used for analyzing large datasets quickly and efficiently

• SQL is used for querying databases to retrieve specific data

• BigQuery can handle petabytes of data, making it ideal for big data analysis

• SQL can be used to perform operations like filtering, sorting, and aggregating data
Answered by AI
Add your answer

Q1. Salary discussion and location discussion
Add your answer

Q1. String is palindrome or not
Ans. 
Check if a string is a palindrome or not
• Compare the string with its reverse to check for palindrome

• Ignore spaces and punctuation marks when comparing

• Examples: 'racecar' is a palindrome, 'hello' is not
Answered by AI
Add your answer
Q2. Create gcs bucket using python
Ans. 
Use Python to create a GCS bucket
• Import the necessary libraries like google.cloud.storage

• Authenticate using service account credentials

• Use the library functions to create a new bucket
Answered by AI
Add your answer
Q3. Write a python code to trigger a dataflow job in cloud function
Ans. 
Python code to trigger a dataflow job in cloud function
• Use the googleapiclient library to interact with the Dataflow API

• Authenticate using service account credentials

• Submit a job to Dataflow using the projects.locations.templates.launch endpoint
Answered by AI
Add your answer