Upload Button Icon Add office photos
Engaged Employer

i

This company page is being actively managed by Rishabh Software Team. If you also belong to the team, you can get access from here

Rishabh Software Verified Tick

Compare button icon Compare button icon Compare
filter salaries All Filters

26 Rishabh Software Jobs

Senior Data Engineer

8-13 years

Vadodara

1 vacancy

Senior Data Engineer

Rishabh Software

posted 4d ago

Job Description

Project Role Summary
Need an experienced Senior Data Engineer (8+ years) to design, develop, and optimize data pipelines and storage layers in a Medallion Architecture on Microsoft Azure . The ideal candidate will work on building scalable ETL/ELT pipelines , ensuring data governance, security, and performance optimization for batch and real-time data processing .
This role requires expertise in Azure Data Factory (ADF), Azure Databricks, Delta Lake, Microsoft Purview, Unity Catalog, Azure Databricks, ADLS Gen 2 and Python/PySpark to transform raw API-based data into curated and structured data marts.
Key Responsibilities
  • Design, document and implement scalable ETL/ELT pipelines to process data from APIs into Bronze, Silver and Gold layers .
  • Design, document , develop and optimize batch streaming data pipelines using Azure Data Factory, Azure Databricks and Azure Event Hubs .
  • Implement incremental loading strategies (CDC, Delta Lake merge/upsert) to efficiently manage historical and real-time data .
  • Optimize Azure Synapse Analytics queries for analytical performance .
  • Design efficient storage solutions leveraging Azure Data Lake Storage Gen2 Delta Lake .
  • Build and maintain dimensional models (Star Schema, Snowflake Schema) in Gold Layer for analytical and reporting use cases.
  • Develop fact and dimension tables , ensuring referential integrity, indexing and partitioning .
  • Implement data validation, schema enforcement, and quality checks across Bronze, Silver and Gold layers
  • Ensure compliance with data governance frameworks using Microsoft Purview
  • Implement Role-Based Access Control (RBAC), encryption and data masking for secure data handling.
  • Optimize ETL pipelines, queries, Databricks clusters, etc. for cost efficiency.
  • Implement Azure Monitor Log Analytics for real-time data pipeline monitoring .
  • Fine-tune partitioning, caching and indexing strategies for high-performance analytics .
  • Work closely with Data Architects, Analysts, BI Developers and DevOps teams to ensure smooth data integration.
  • Establish CI/CD pipelines for data engineering (Azure DevOps, GitHub Actions).
  • Document data pipelines, models, and transformations in a structured data dictionary .
Technical Skills
  • Strong experience with Azure Data Factory (ADF) and orchestration of ETL pipelines
  • Strong experience with Azure Databricks , PySpark, Python
  • Strong experience with Delta Lake with experience in optimized storage, versioning, and ACID transactions
  • Strong experience with SQL-based analytical processing
  • Strong experience with Writing and optimizing ETL/ELT workflows
  • Strong experience with streaming frameworks (Azure Stream Analytics, Event Hubs)
  • Strong experience with Dimensional modeling (Star Schema, Snowflake Schema)
  • Strong experience with Data partitioning, indexing, and query performance tuning
  • Strong experience with Microsoft Purview, Unity Catalog for data lineage metadata management
  • Strong experience with RBAC, data masking, encryption to protect sensitive information
  • Strong experience with Cost-efficient Databricks cluster management
  • Strong experience with CI/CD pipelines for data pipelines deployment using Azure DevOps
Soft Skills
  • Strong analytical and problem-solving mindset
  • Ability to collaborate with cross-functional teams.
  • Excellent skills for documentation
  • Good communication skills.
Nice to Have
  • Microsoft Azure Data Engineer Associate (DP-203) certification
  • Databricks Certified Data Engineer
  • Infrastructure as Code (IaC) using Terraform .
Education
Bachelor s/Master s degree in Computer Science, Information Technology or related field
Experience
Total experience of 8 + years with at least 5+ years of hands on work experience in Data Engineering, Big Data Processing and Azure Cloud based data engineering solutions like implementing data lakes with medallion architecture

Employment Type: Full Time, Permanent

Read full job description

Prepare for Senior Data Engineer roles with real interview advice

What people at Rishabh Software are saying

Senior Data Engineer salary at Rishabh Software

reported by 4 employees with 8-9 years exp.
Lock Unlock
₹23.5 L/yr - ₹37 L/yr
53% more than the average Senior Data Engineer Salary in India
View more details

What Rishabh Software employees are saying about work life

based on 192 employees
73%
93%
79%
87%
Flexible timing
Monday to Friday
No travel
Day Shift
View more insights

Rishabh Software Benefits

Submitted by Company
Investment in Individual Growth
Leading Skill-Enhancing Trainings
Combining Teamwork and Autonomy
A Culture of Inclusivity
An Expansive Setup
Eco-Friendly Campus
Submitted by Employees
Soft Skill Training
Work From Home
Health Insurance
Cafeteria
Job Training
Team Outings +6 more
View more benefits

Compare Rishabh Software with

Tekwissen

4.8
Compare

Softenger

4.1
Compare

XcelServ Solutions

4.5
Compare

Damco Solutions

3.9
Compare

Capital Numbers Infotech

4.5
Compare

Foray Software

3.5
Compare

Nelito System

3.5
Compare

Webskitters

4.1
Compare

smartData Enterprises

3.3
Compare

Black Knight

3.6
Compare

Orcapod Consulting Services

3.4
Compare

DesignTech Systems

3.3
Compare

In Time Tec Visionsoft

3.8
Compare

C-Edge Technologies

3.8
Compare

Alchemy Techsol India

3.7
Compare

Ascent Business Solutions

3.3
Compare

ESDS Software Solutions

3.8
Compare

MAQ Software

1.9
Compare

DataMetica

3.6
Compare

SISL Infotech

3.6
Compare

Similar Jobs for you

Data Architect at Talentica Software India Pvt Ltd

Bangalore / Bengaluru

8-13 Yrs

₹ 19-24 LPA

Senior Data Engineer at Avontix

Hyderabad / Secunderabad

8-13 Yrs

₹ 30-35 LPA

Senior Data Engineer at Think Right Technologies

Bangalore / Bengaluru

6-8 Yrs

₹ 25-30 LPA

Senior Data Engineer at Cubic Transportation Systems India Pvt. Ltd.

Hyderabad / Secunderabad

4-7 Yrs

₹ 25-70 LPA

Senior Data Engineer at Bottomline Media Pvt Ltd

Kolkata, Mumbai + 5

8-13 Yrs

₹ 30-35 LPA

Senior Data Engineer at MiQ Digital

Bangalore / Bengaluru

6-8 Yrs

₹ 30-33 LPA

Senior Data Engineer at Branch Metrics

Bangalore / Bengaluru

5-7 Yrs

₹ 25-30 LPA

Senior Data Engineer at Tvarit GmbH

Pune

8-13 Yrs

₹ 25-30 LPA

Senior Data Engineer at Pure Storage

Bangalore / Bengaluru

8-13 Yrs

₹ 30-33 LPA

Senior Data Engineer at Inspira Enterprise India Pvt. Ltd.

Kolkata

8-13 Yrs

₹ 30-35 LPA

Senior Data Engineer

8-13 Yrs

Vadodara

4d ago·via naukri.com

HR Business Partner

1-3 Yrs

Vadodara

4d ago·via naukri.com

Product Marketing Manager (SaaS -B2B)

10-18 Yrs

Ahmedabad, Bangalore / Bengaluru, Vadodara

5d ago·via naukri.com

Technical Lead - PHP

2-9 Yrs

Vadodara

13d ago·via naukri.com

Senior Software Engineer - Power BI

3-8 Yrs

Vadodara

14d ago·via naukri.com

Software Test Engineer

3-6 Yrs

Vadodara

14d ago·via naukri.com

Senior Software Engineer - Angular

5-11 Yrs

Vadodara

14d ago·via naukri.com

Software Test Engineer

3-6 Yrs

Vadodara

14d ago·via naukri.com

Job Posting_ Fullstack (.Net Angular) Developer_ Rishabh Software

4-7 Yrs

Pune, Ahmedabad, Vadodara

18d ago·via naukri.com

Java Full Stack Developer - i3

5-11 Yrs

Vadodara

19d ago·via naukri.com

Recently Viewed

write
Share an Interview
Rate your experience using AmbitionBox
Terrible
Terrible
Poor
Poor
Average
Average
Good
Good
Excellent
Excellent