filter salaries All Filters (1)

Clear all

77 Data Engineer Jobs in Kolkata

SRE3 - Data Engineering

6-10 years

Kolkata, Mumbai, New Delhi + 4 more

1 vacancy

SRE3 - Data Engineering

Angel One

posted 18d ago

Job Role Insights

Fixed timing

Job Description

  • Design, implement, and maintain scalable data pipelines and infrastructure using Databricks, Redshift, and AWS services.
  • Set up and manage Big Data environments, ensuring high availability and reliability of data processing systems.
  • Develop and optimize ETL processes to transfer data between various sources, including S3, Redshift, and Databricks.
  • Utilize AWS EMR for processing large datasets efficiently, leveraging Spark for distributed data processing.
  • Implement monitoring solutions to track the performance and reliability of data pipelines and storage solutions.
  • Use tools like Prometheus and Grafana to visualize metrics and identify bottlenecks in data workflows.
  • Ensure data integrity and security across all platforms, implementing best practices for data access and management.
  • Collaborate with data governance teams to establish policies for data quality and compliance.
  • Work closely with software development teams to integrate data solutions into applications, ensuring minimal disruption and high performance.
  • Provide insights on data architecture and best practices for leveraging data in applications.
  • Respond to incidents related to data processing and storage, performing root cause analysis and implementing solutions to prevent recurrence.
  • Facilitate blameless post-mortems to improve processes and systems continuously.

Who you are: 

  • Bachelor?s degree in Computer Science, Information Technology, or a related field, or equivalent practical experience.
  • 4-8 years of experience in Data, Site Reliability Engineering, or a related field with a focus on data engineering within AWS.
  • Proficiency in Databricks and Redshift, with experience in data warehousing and analytics.
  • Strong knowledge of AWS services, particularly S3, Athena, and EMR, for data storage and processing.
  • Experience with programming languages such as Python or Scala for data manipulation and automation.
  • Familiarity with SQL for querying databases and performing data transformations.
  • Experience with distributed computing frameworks, particularly Apache Spark, for processing large datasets.
  • Knowledge of data lake and data warehouse architectures, including the use of Delta Lake for managing data in Databricks.
  • Proficiency in using tools like Terraform or AWS CloudFormation for provisioning and managing infrastructure.
  • Familiarity with monitoring tools and practices to ensure system reliability and performance, including the use of AWS CloudWatch.

Tools and Technologies

  • Data Platforms: Databricks, Amazon Redshift, AWS EMR, AWS S3, AWS Athena
  • Big Data Frameworks: Apache Spark, Delta Lake
  • Monitoring Tools: Prometheus, Grafana, AWS CloudWatch
  • Infrastructure Management: Terraform, AWS CloudFormation
  • Programming Languages: Python, Scala, SQL
 

Employment Type: Full Time, Permanent

Read full job description

Prepare for Data Engineer roles with real interview advice

What Data Engineer at Angel One are saying

Data Engineer salary at Angel One

reported by 6 employees with 2-10 years exp.
Lock Unlock
₹9 L/yr - ₹27 L/yr
84% more than the average Data Engineer Salary in India
View more details

What Angel One employees are saying about work life

based on 1.5k employees
52%
58%
62%
98%
Strict timing
Monday to Saturday
No travel
Day Shift
View more insights

Angel One Benefits

Submitted by Company
Great-er Place To Work!
Work is where the heart is!
Angelites, FIRST!
Accelerate your career with us!
Flexing the flexibility!
Culture of Appreciation
Submitted by Employees
Job Training
Work From Home
Health Insurance
Soft Skill Training
Cafeteria
Team Outings +6 more
View more benefits

Compare Angel One with

Zerodha

4.2
Compare

Upstox

3.7
Compare

Groww

3.7
Compare

5paisa Capital Ltd.

3.9
Compare

Kotak Securities

3.6
Compare

Sharekhan

3.8
Compare

ICICI Direct

3.7
Compare

HDFC Securities

3.6
Compare

Motilal Oswal

3.9
Compare

Edelweiss

3.9
Compare

Paytm

3.3
Compare

Care Health Insurance

3.6
Compare

HighRadius

2.9
Compare

AGS Transact Technologies

3.1
Compare

Rupeek

3.7
Compare

Hitachi Payment Services

3.8
Compare

Mswipe Technologies

3.1
Compare

Truhome Finance

3.9
Compare

BankBazaar

3.4
Compare

Razorpay

3.6
Compare

Similar Jobs for you

AWS Architect at Capgemini Technology Services India Limited

Mumbai

6-11 Yrs

₹ 8-14 LPA

Data Engineer at IBM India Pvt. Limited

Kochi

4-9 Yrs

₹ 6-11 LPA

Data Engineer at IBM India Pvt. Limited

Kochi

6-10 Yrs

₹ 10-13 LPA

Big Data Engineer at GSPANN

Bangalore / Bengaluru

6-11 Yrs

₹ 15-30 LPA

Data Engineer at IBM India Pvt. Limited

Kochi

6-10 Yrs

₹ 10-13 LPA

Application Lead at Accenture Solutions Pvt Ltd

Mumbai

5-10 Yrs

₹ 8-12 LPA

Data Engineering Lead at Apex One

Bangalore / Bengaluru, Whitefield

8-13 Yrs

₹ 15-30 LPA

Data Platform Engineer at Accenture Solutions Pvt Ltd

Bangalore / Bengaluru

5-10 Yrs

₹ 7-11 LPA

AWS Data Engineer at GSPANN

Pune

5-10 Yrs

₹ 11-21 LPA

AWS Data Engineer at GSPANN

Gurgaon / Gurugram

5-10 Yrs

₹ 11-21 LPA

6-10 Yrs

Kolkata, Mumbai, New Delhi +4 more

18d ago·via naukri.com

8-9 Yrs

Kolkata, Mumbai, New Delhi +4 more

22d ago·via naukri.com

4-8 Yrs

Kolkata, Mumbai, New Delhi +4 more

22d ago·via naukri.com

10-12 Yrs

Kolkata, Mumbai, New Delhi +4 more

22d ago·via naukri.com

5-7 Yrs

Kolkata, Mumbai, New Delhi +4 more

13d ago·via naukri.com

4-6 Yrs

Kolkata, Mumbai, New Delhi +4 more

13d ago·via naukri.com

4-8 Yrs

Kolkata, Mumbai, New Delhi +4 more

14d ago·via naukri.com

2-5 Yrs

Kolkata, Mumbai, New Delhi +4 more

14d ago·via naukri.com

7-12 Yrs

Kolkata, Mumbai, New Delhi +4 more

15d ago·via naukri.com

8-13 Yrs

Kolkata, Mumbai, New Delhi +4 more

15d ago·via naukri.com
How was your last interview experience?

Recently Viewed

SALARIES

Landmark Group

JOBS

GlobalLogic

No Jobs

SALARIES

Tredence

JOBS

GMR Group

No Jobs

SALARIES

Shoppers Stop

SALARIES

Yusen Logistics

SALARIES

Tesco

SALARIES

Tredence

JOBS

People Impact

No Jobs

How was your last interview experience?
Rate your experience using AmbitionBox
Terrible
Terrible
Poor
Poor
Average
Average
Good
Good
Excellent
Excellent