Home
Communities
Companies
- Companies
  
  Discover best places to work
- Compare Companies
  
  Compare & find best workplace
- Add Office Photos
  
  Bring your workplace to life
- Add Company Benefits
  
  Highlight your company's perks
Reviews
- Company reviews
  
  Read reviews for 6L+ companies
- Write a review
  
  Rate your former or current company
Salaries
- Browse salaries
  
  Discover salaries for 6L+ companies
- Salary calculator
  
  Calculate your take home salary
- Are you paid fairly?
  
  Check your market value
- Share your salary
  
  Help other jobseekers
- Gratuity calculator
  
  Check your gratuity amount
- HRA calculator
  
  Check how much of your HRA is tax-free
- Salary hike calculator
  
  Check your salary hike
Interviews
- Company interviews
  
  Read interviews for 40K+ companies
- Campus placements
  
  Interviews questions for 2K+ colleges
- Share interview questions
  
  Contribute your interview questions
Jobs
Awards

WINNERS AWAITED!
- ABECA 2025
  
  WINNERS AWAITED!
  
  AmbitionBox Employee Choice Awards - 4th Edition
- ABECA 2024
  
  AmbitionBox Employee Choice Awards - 3rd Edition
- AmbitionBox Best Places to Work 2022
  
  2nd Edition
- AmbitionBox Best Places to Work 2021
  
  1st Edition

Add office photos

Employer? Claim Account for FREE

Brighttier Inc

Compare

1.0

based on 1 Review

11 Brighttier Inc Jobs

Cloud Data Engineer - Databricks on AWS/Scala

Brighttier

1.0

based on 1 Review

7-9 years

Kolkata, Mumbai, New Delhi + 4 more

1 vacancy

Cloud Data Engineer - Databricks on AWS/Scala

Brighttier Inc

posted 1d ago

Job Role Insights

Key skills for the job

SAP CO Python SQL Information Technology Clinical Data Management ERP Systems

+ 3 more

Job Description

We are seeking an experienced Cloud Data Engineer with a strong background in AWS, Azure, and GCP. The ideal candidate will have extensive experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, and other ETL tools like Informatica, SAP Data Intelligence, etc. You will be responsible for designing, implementing, and maintaining robust data pipelines and building scalable data lakes. Experience with various data platforms like Redshift, Snowflake, Databricks, Synapse, Snowflake and others is essential. Familiarity with data extraction from SAP or ERP systems is a plus.

Key Responsibilities:

Design and Development:

Design, develop, and maintain scalable ETL pipelines using cloud-native tools (AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc.).
Architect and implement data lakes and data warehouses on cloud platforms (AWS, Azure, GCP).
Develop and optimize data ingestion, transformation, and loading processes using Databricks, Snowflake, Redshift, BigQuery and Azure Synapse.
Implement ETL processes using tools like Informatica, SAP Data Intelligence, and others.
Develop and optimize data processing jobs using Spark Scala.

Data Integration and Management:

Integrate various data sources, including relational databases, APIs, unstructured data, and ERP systems into the data lake.
Ensure data quality and integrity through rigorous testing and validation.
Perform data extraction from SAP or ERP systems when necessary.

Performance Optimization:

Monitor and optimize the performance of data pipelines and ETL processes.
Implement best practices for data management, including data governance, security, and compliance.

Collaboration and Communication:

Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
Collaborate with cross-functional teams to design and implement data solutions that meet business needs.

Documentation and Maintenance:

Document technical solutions, processes, and workflows.
Maintain and troubleshoot existing ETL pipelines and data integrations.

Education:

Bachelor s degree in Computer Science, Information Technology, or a related field. Advanced degrees are a plus.

Experience:

7+ years of experience as a Data Engineer or in a similar role.
Proven experience with cloud platforms: AWS, Azure, and GCP.
Hands-on experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc.
Experience with other ETL tools like Informatica, SAP Data Intelligence, etc.
Experience in building and managing data lakes and data warehouses.
Proficiency with data platforms like Redshift, Snowflake, BigQuery, Databricks, and Azure Synapse.
Experience with data extraction from SAP or ERP systems is a plus.
Strong experience with Spark and Scala for data processing.

Skills:

Strong programming skills in Python, Java, or Scala.
Proficient in SQL and query optimization techniques.
Familiarity with data modeling, ETL/ELT processes, and data warehousing concepts.
Knowledge of data governance, security, and compliance best practices.
Excellent problem-solving and analytical skills.
Strong communication and collaboration skills.

Preferred Qualifications:

Experience with other data tools and technologies such as Apache Spark, or Hadoop.
Certifications in cloud platforms (AWS Certified Data Analytics - Specialty, Google Professional Data Engineer, Microsoft Certified: Azure Data Engineer Associate).
Experience with CI/CD pipelines and DevOps practices for data engineering
Selected applicant will be subject to a background investigation, which will be conducted and the results of which will be used in compliance with applicable law.

Employment Type: Full Time, Permanent

Read full job description