Add office photos
Engaged Employer
i
This company page is being actively managed by
Programming.Com Team. If you also belong to the team, you
can get access from
here
Programming.Com
Compare
All Filters
130 Programming.Com Jobs
Senior Data Engineer
2-6 years
Gurgaon / Gurugram, Bangalore / Bengaluru
1 vacancy
Senior Data Engineer
Programming.Com
posted 14d ago
Job Role Insights
Fixed timing
Key skills for the job
Job Description
Job Description:
Requirement: Senior Data Engineer
Experience: 8+ years
Location: Gurugram
Work Mode: Work from home
Budget: 12-16 LPA
Solution Architect (Databricks)
Responsibilities:
Enforce adherence to architectural standards, global product-specific guidelines, and usability design standards.
Proactively guide engineering methodologies, standards, and leading practices.
Identify, communicate, and mitigate risks, assumptions, issues, and decisions throughout the full lifecycle.
Provide guidelines for best practices and repeatable methodologies in Cloud Data Engineering, including:
Data Storage
ETL (Extract, Transform, Load)
Data Integration Migration
Data Warehousing
Data Governance
Required Skills:
Experience:
9+ years in Data Engineering project development/design, handling large volumes of data.
At least 5+ years using cloud data engineering services (preferably on AWS).
5+ years as a Big Data architect/solution architect on Big Data platforms.
3+ years of proven experience as an architect/solution architect on the Databricks platform.
Project Design Implementation:
Designed and implemented at least 2-3 end-to-end projects in Databricks.
Expertise in E2E architecture of unified data platforms covering data lifecycle aspects: Data Ingestion, Transformation, Serving, and Consumption.
Experience in composable architecture to fully leverage Databricks capabilities.
Implemented and configured Databricks environments (clusters, notebooks, libraries) for optimal performance and resource utilization.
Technical Skills:
Designed and developed scalable batch and streaming data pipelines, data lake architectures, and data warehousing solutions on the Databricks platform using Spark and Delta Lake.
Knowledgeable in the Databricks Lakehouse concept and its enterprise implementation.
Strong understanding of data warehousing, governance, and security standards related to Databricks.
Skilled in cluster optimization, integration with various cloud services, and performance optimization to improve efficiency and reduce costs.
Proficient in writing unit and integration tests, and setting best practices for Databricks CI/CD.
Experience in integrating data from various sources (structured, semi-structured, and unstructured) into Databricks for processing and analysis.
Qualifications:
Proven experience as an Architect/Solution Architect on Databricks.
Hands-on experience with AWS Databricks platform for data processing, warehousing, and analytics solutions.
Strong background in cloud data engineering, ETL, data integration, and data governance.
Looking forward to receiving applications from candidates who meet these criteria and are excited to join our team.
Employment Type: Full Time, Permanent
Read full job descriptionPrepare for Senior Data Engineer roles with real interview advice
People are getting interviews at Programming.Com through
People are getting interviews through
(based on 2 Programming.Com interviews)
Job Portal
100%
Low
Confidence
?
Low Confidence means the data is based on a small number of responses received from the candidates.
What people at Programming.Com are saying
What Programming.Com employees are saying about work life
based on 46 employees
Strict timing
Monday to Friday
No travel
Day Shift
Programming.Com Benefits
View more benefits
Compare Programming.Com with
GeeksForGeeks
Compare
HackerRank
Compare
CodeChef
Compare
upGrad
Compare
Simplilearn
Compare
NIIT
Compare
TCS iON
Compare
Edureka
Compare
Great Learning
Compare
Coursera
Compare
CMS IT Services
Compare
KocharTech
Compare
3i Infotech
Compare
Xoriant
Compare
Photon Interactive
Compare
Sify Technologies
Compare
CitiusTech
Compare
NeoSOFT
Compare
Microland
Compare
Team Computers
Compare
Similar Jobs for you
Programming.Com Gurgaon / Gurugram Office Location
Gurgaon / Gurugram, Haryana Office
46, Sector 18, Gurugram, Sarhoul, Haryana 122015
Gurgaon / Gurugram, Haryana
122015
122015
Dotnet Core Engineer
3-8 Yrs
Mumbai, Chandigarh, Hyderabad / Secunderabad +5 more
Share an Interview