Filter interviews by
I applied via Recruitment Consulltant and was interviewed in Nov 2024. There was 1 interview round.
Use distributed computing framework like Apache Spark to efficiently load and transform the large CSV file.
Use Apache Spark to distribute the workload across multiple nodes for faster processing.
Utilize Spark's DataFrame API to read the CSV file and apply transformations.
Consider partitioning the data to optimize performance.
Use Spark SQL for complex transformations and aggregations.
Leverage in-memory processing capabi
I applied via Recruitment Consulltant and was interviewed in Apr 2024. There were 3 interview rounds.
They gave a regular problem like using sqllite in the code and using it to get data from a csv file and parse it. I was allowed to use google. They wanted to see how I approach a problem.
I applied via LinkedIn and was interviewed in Sep 2023. There were 4 interview rounds.
General Aptitude and behaviour test
Data wrangling and processing using python data structures
Presentation test, describe previous work and motivation
Top trending discussions
I applied via Campus Placement
The first round which is online assessment for eliminating candidates was conducted consist of medium level aptitude questions there were 3 sub sec have duration of 20 15 15 minutes and questions 15 10 10 respectively and you cannot move to further section there is time constraints for each then followed by 15 minutes psychometric section having 50 questions that's all for screening round the total duration was 65 min.
Total 24 candidates were selected from this round out of 200 plus
I applied via Naukri.com and was interviewed in Apr 2024. There was 1 interview round.
Develop ETL pipeline using Airflow to process CSV files in S3 and load data into Snowflake.
Set up an S3 sensor in Airflow to detect when a new CSV file is dropped in the specified bucket.
Create a custom Python operator in Airflow to read the CSV file from S3, perform necessary transformations, and load data into Snowflake.
Use SnowflakeHook in Airflow to establish connection with Snowflake and execute SQL queries to loa...
Discussion of jd, technical questions on spark
I am currently earning $80,000 per year.
My current annual salary is $80,000.
I am earning $6,666.67 per month.
I receive a monthly salary of $6,666.67.
Expected CTC should be based on industry standards, experience, skills, and location.
Research industry standards for Data Engineers in your location
Consider your level of experience and skills
Factor in the cost of living in the area where the job is located
Negotiate based on the value you bring to the company
I applied via Walk-in and was interviewed in Nov 2023. There were 3 interview rounds.
An index is a data structure that improves the speed of data retrieval operations in a database by allowing quick access to specific data.
Indexes are used to quickly locate data without having to search every row in a database table.
They are created on specific columns in a table to speed up queries that filter or sort by those columns.
Examples of indexes include primary keys, unique keys, and non-unique indexes.
Building a pipeline involves creating a series of interconnected data processing steps to move and transform data from source to destination.
Identify data sources and destinations
Determine the data processing steps required
Choose appropriate tools and technologies
Design and implement the pipeline
Monitor and maintain the pipeline
In 5 years, I see myself as a senior data engineer leading a team, implementing innovative solutions, and driving data-driven decision-making.
Leading a team of data engineers
Implementing innovative solutions to optimize data processing and analysis
Driving data-driven decision-making across the organization
Continuously learning and staying updated with the latest technologies and trends in data engineering
Contributing t
Interview experience
based on 7 reviews
Rating in categories
Senior Analyst
617
salaries
| ₹3.5 L/yr - ₹12 L/yr |
Credit Assessment Officer
483
salaries
| ₹4 L/yr - ₹15 L/yr |
Analyst
420
salaries
| ₹2 L/yr - ₹8.5 L/yr |
Senior Credit Assessment Officer
268
salaries
| ₹5.5 L/yr - ₹21 L/yr |
Engineer
161
salaries
| ₹11 L/yr - ₹40 L/yr |
HDFC Bank
ICICI Bank
State Bank of India
Axis Bank