Upload Button Icon Add office photos
filter salaries All Filters

11 Brighttier Inc Jobs

Cloud Data Engineer- Spark & Databricks

7-15 years

Kolkata, Mumbai, New Delhi + 4 more

1 vacancy

Cloud Data Engineer- Spark & Databricks

Brighttier Inc

posted 5mon ago

Job Description

We are looking for a highly skilled Cloud Engineer with a specialization in Apache Spark and Databricks to join our dynamic team. The ideal candidate will have extensive experience working with cloud platforms such as AWS, Azure, and GCP, and a deep understanding of data engineering, ETL processes, and cloud-native tools. Your primary responsibility will be to design, develop, and maintain scalable data pipelines using Spark and Databricks, while optimizing performance and ensuring data integrity across diverse environments.
Key Responsibilities: Design and Development:
  • Architect, develop, and maintain scalable ETL pipelines using Databricks , Apache Spark (Scala, Python), and other cloud-native tools such as AWS Glue , Azure Data Factory , and GCP Dataflow .
  • Design and build data lakes and data warehouses on cloud platforms (AWS, Azure, GCP).
  • Implement efficient data ingestion, transformation, and processing workflows with Spark and Databricks.
  • Optimize the performance of ETL processes for faster data processing and lower costs.
  • Develop and manage data pipelines using other ETL tools such as Informatica , SAP Data Intelligence , and others as needed.
Data Integration and Management:
  • Integrate structured and unstructured data sources (relational databases, APIs, ERP systems) into the cloud data infrastructure.
  • Ensure data quality, validation, and integrity through rigorous testing.
  • Perform data extraction and integration from SAP or ERP systems , ensuring seamless data flow.
Performance Optimization:
  • Monitor, troubleshoot, and enhance the performance of Spark/Databricks pipelines.
  • Implement best practices for data governance, security, and compliance across data workflows.
Collaboration and Communication:
  • Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to define data requirements and deliver scalable solutions.
  • Provide technical guidance and recommendations on cloud data engineering processes and tools.
Documentation and Maintenance:
  • Document data engineering solutions, ETL pipelines, and workflows.
  • Maintain and support existing data pipelines, ensuring they operate effectively and align with business goals.
Qualifications: Education:
  • Bachelors degree in Computer Science , Information Technology , or a related field. Advanced degrees are a plus.
Experience:
  • 7+ years of experience in cloud data engineering or similar roles.
  • Expertise in Apache Spark and Databricks for data processing.
  • Proven experience with cloud platforms like AWS , Azure , and GCP .
  • Experience with cloud-native ETL tools such as AWS Glue , Azure Data Factory , Kafka , GCP Dataflow , etc.
  • Hands-on experience with data platforms like Redshift , Snowflake , Azure Synapse , and BigQuery .
  • Experience in extracting data from SAP or ERP systems is preferred.
  • Strong programming skills in Python , Scala , or Java .
  • Proficient in SQL and query optimization techniques.
Skills:
  • In-depth knowledge of Spark/Scala for high-performance data processing.
  • Strong understanding of data modeling, ETL/ELT processes, and data warehousing concepts.
  • Familiarity with data governance, security, and compliance best practices.
  • Excellent problem-solving, communication, and collaboration skills.
Preferred Qualifications:
  • Certifications in cloud platforms (e.g., AWS Certified Data Analytics , Google Professional Data Engineer , Azure Data Engineer Associate ).
  • Experience with CI/CD pipelines and DevOps practices for data engineering.
  • Exposure to Apache Hadoop , Kafka , or other data frameworks is a plus.

Employment Type: Full Time, Permanent

Read full job description

What people at Brighttier Inc are saying

What Brighttier Inc employees are saying about work life

based on 1 employee
100%
Night Shift
View more insights

Brighttier Inc Benefits

Free Transport
Child care
Gymnasium
Cafeteria
Work From Home
Free Food +6 more
View more benefits

Compare Brighttier Inc with

TCS

3.7
Compare

Accenture

3.8
Compare

Wipro

3.7
Compare

Cognizant

3.7
Compare

Capgemini

3.7
Compare

HDFC Bank

3.9
Compare

Infosys

3.6
Compare

ICICI Bank

4.0
Compare

HCLTech

3.5
Compare

Tech Mahindra

3.5
Compare

Genpact

3.8
Compare

Teleperformance

3.9
Compare

Concentrix Corporation

3.8
Compare

Axis Bank

3.8
Compare

Amazon

4.1
Compare

Jio

3.9
Compare

iEnergizer

4.6
Compare

Reliance Retail

3.9
Compare

IBM

4.0
Compare

LTIMindtree

3.8
Compare

Similar Jobs for you

Cloud Data Engineer at Brighttier

Kolkata, Mumbai + 5

7-9 Yrs

₹ 7-11 LPA

Cloud Data Engineer at Brighttier

Kolkata, Mumbai + 5

12-15 Yrs

₹ 14-17 LPA

Onboarding Engineer at Photon Infotech P Ltd

Kolkata, Mumbai + 5

5-10 Yrs

₹ 7-12 LPA

Cloud Data Engineer at Zensar Technologies

Kolkata, Mumbai + 5

8-12 Yrs

₹ 14-18 LPA

Engineer at Exponentia Team

Gurgaon / Gurugram

2-7 Yrs

₹ 4-8 LPA

Cloud Data Engineer at AstraZeneca India Pvt. Ltd

Chennai

5-6 Yrs

₹ 7-8 LPA

Cloud Data Engineer at Zensar Technologies

Kolkata, Mumbai + 5

4-8 Yrs

₹ 12-16 LPA

Senior Data Engineer at Varite

5-10 Yrs

₹ 15-38 LPA

Data Engineer at DATA ART SOLUTIONS PRIVATE LIMITED

Kolkata, Mumbai + 5

3-6 Yrs

₹ 7-11 LPA

Cloud Data Engineer at quaxigma it solutions private limited

Kolkata, Mumbai + 5

3-6 Yrs

₹ 5-8 LPA

Cloud Data Engineer- Spark & Databricks

7-15 Yrs

Kolkata, Mumbai, New Delhi +4 more

5mon ago·via naukri.com

Cloud Data Engineer - Databricks on AWS/Scala

7-9 Yrs

Kolkata, Mumbai, New Delhi +4 more

2d ago·via naukri.com

Associate PMO - Change Manager

1-3 Yrs

Kolkata, Mumbai, New Delhi +4 more

3mon ago·via naukri.com

Senior Infrastructure / Site Reliability Engineer

2-5 Yrs

Kolkata, Mumbai, New Delhi +4 more

3mon ago·via naukri.com

Associate Process Excellence Lead

3-8 Yrs

Kolkata, Mumbai, New Delhi +4 more

4mon ago·via naukri.com

SolMan and ChaRM consultant

3-10 Yrs

Remote

4mon ago·via naukri.com

Infrastructure Consultant

8-20 Yrs

Chennai, Pune, New Delhi +4 more

4mon ago·via naukri.com

Cloud Data Engineer

12-15 Yrs

Kolkata, Mumbai, New Delhi +4 more

5mon ago·via naukri.com

SAP Basis Consultant - Contract

5-7 Yrs

Kolkata, Mumbai, New Delhi +4 more

5mon ago·via naukri.com

Principal Infrastructure Consultant

10-25 Yrs

Kolkata, Mumbai, New Delhi +4 more

5mon ago·via naukri.com
write
Share an Interview