Upload Button Icon Add office photos
Premium Employer

i

This company page is being actively managed by Smartedge IT Services Team. If you also belong to the team, you can get access from here

Smartedge IT Services

Compare button icon Compare button icon Compare
filter salaries All Filters

103 Smartedge IT Services Jobs

AWS Databricks Engineer - SQL (5-8 yrs)

5-8 years

AWS Databricks Engineer - SQL (5-8 yrs)

Smartedge IT Services

posted 1mon ago

Job Description

Job Title : AWS Databricks Engineer (SQL).

Location : Bangalore.

Experience : 5-8 Years.

Job Description :


As an AWS Databricks Engineer (SQL), you will play a key role in the architecture and development of cloud-based data pipelines and solutions on the AWS platform using Databricks. You will work closely with data engineers, analysts, and business teams to create efficient, scalable, and robust data solutions. Your expertise in SQL and Databricks will enable you to manage and process large datasets, ensuring that data is ready for analysis and consumption across various business units.

Key Responsibilities :


- Databricks Development : Design, develop, and maintain data pipelines using AWS Databricks, integrating data from multiple sources for efficient processing and analysis.

- SQL Expertise : Write complex SQL queries to extract, transform, and load (ETL) data from various data sources, ensuring data accuracy and consistency.

- Data Processing : Utilize Databricks to run Spark-based data processing jobs, optimize workflows, and process large datasets in a distributed environment.

- Data Architecture : Collaborate with data architects to design and implement data storage and processing architectures on AWS, ensuring scalability and performance.

- Optimization : Monitor and optimize SQL queries and Databricks workflows for performance and efficiency in the cloud environment.

- Cloud Infrastructure : Leverage AWS services such as S3, Redshift, and Lambda in conjunction with Databricks to build scalable data pipelines.

- Data Governance and Quality : Implement data governance and data quality best practices, ensuring compliance and data accuracy across all data pipelines.

- Collaboration and Documentation : Work closely with cross-functional teams to understand data requirements and document processes, workflows, and technical solutions.

- Troubleshooting and Issue Resolution : Identify and resolve issues related to performance, data inconsistencies, and system errors across Databricks and SQL-based solutions.

Required Skills And Qualifications :


- AWS Databricks : Hands-on experience with Databricks on AWS, including knowledge of Spark and Delta Lake.

- SQL : Strong proficiency in SQL for querying, transforming, and managing data in relational databases.


- AWS Services : Experience working with AWS data services such as S3, Redshift, and Glue, in conjunction with Databricks.


- Data Pipeline Development : Experience building and optimizing data pipelines, ETL processes, and batch processing workflows.

- Big Data Processing : Knowledge of distributed computing frameworks (like Apache Spark) for large-scale data processing.

- Cloud Architecture : Strong understanding of cloud-based data architecture and best practices for building scalable data systems on AWS.

- Performance Optimization : Experience optimizing SQL queries and Databricks jobs for improved speed and resource utilization.


Functional Areas: Other

Read full job description

What people at Smartedge IT Services are saying

What Smartedge IT Services employees are saying about work life

based on 14 employees
63%
87%
57%
100%
Strict timing
Monday to Friday
No travel
Day Shift
View more insights

Smartedge IT Services Benefits

Work From Home
Job Training
Free Transport
Child care
Gymnasium
Cafeteria +6 more
View more benefits

Compare Smartedge IT Services with

Infosys

3.6
Compare

Wipro

3.7
Compare

TCS

3.7
Compare

HCLTech

3.5
Compare

Tech Mahindra

3.5
Compare

Cognizant

3.7
Compare

Accenture

3.8
Compare

Capgemini

3.7
Compare

IBM

4.0
Compare

LTIMindtree

3.8
Compare

HCL Infosystems

3.9
Compare

Accel Frontline

4.0
Compare

Puropale Creations & IT Solutions

4.9
Compare

Diverse Lynx

3.8
Compare

Pitney Bowes

3.8
Compare

Solartis Technology Services

3.6
Compare

Apmosys Technologies

3.4
Compare

Dahua Technology India Pvt.Ltd.

3.5
Compare

Apex CoVantage

3.2
Compare

VHS Consulting

3.7
Compare

Similar Jobs for you

Engineer at Persistent Systems Limited.

5-14 Yrs

₹ 15-42 LPA

Engineer at ACENET CONSULTING PRIVATE LIMITED

4-7 Yrs

₹ 8-15 LPA

Engineer at Zorba Consulting India Pvt. Ltd.

4-9 Yrs

₹ 11-20 LPA

Azure Data Engineer at Saxon Global India Pvt. Ltd.

3-5 Yrs

₹ 12-15 LPA

Engineer at D-TechWorks Pvt Ltd

7-10 Yrs

₹ 28-40 LPA

Engineer at Zorba Consulting India Pvt. Ltd.

3-6 Yrs

₹ 12-17 LPA

AWS Data Engineer at Changeleaders

5-10 Yrs

₹ 20-30 LPA

Azure Data Engineer at CORTEX Consultants

7-10 Yrs

₹ 20-28 LPA

Azure Data Engineer at Marktine Technology Solutions

5-7 Yrs

₹ 15-20 LPA

Azure Data Engineer at Tekfortune IT India Pvt Ltd

5-12 Yrs

₹ 15-35 LPA

Smartedge IT Services Hyderabad / Secunderabad Office Location

View all
Hyderabad / Secunderabad, Telangana Office
Headquarter
Smartedge IT Services Pvt. Ltd Plot No.56, 1st Floor Nagarjuna Hills, Punjagutta Hyderabad – 500 082 India Ph:+91(0)40 400 38599 Hyderabad / Secunderabad, Telangana
500082

AWS Databricks Engineer - SQL (5-8 yrs)

5-8 Yrs

1mon ago·via hirist.com

Lead SAP BRIM Consultant (8-10 yrs)

8-10 Yrs

3d ago·via hirist.com

Guidewire Digital Developer (2-5 yrs)

2-5 Yrs

4d ago·via hirist.com

JBPM Developer - Java/Drools (3-12 yrs)

3-12 Yrs

4d ago·via hirist.com

Technical Consultant - SAP C4C Module (3-6 yrs)

3-6 Yrs

6d ago·via hirist.com
write
Share an Interview