Upload Button Icon Add office photos
Premium Employer

i

This company page is being actively managed by Smartedge IT Services Team. If you also belong to the team, you can get access from here

Smartedge IT Services

Compare button icon Compare button icon Compare
filter salaries All Filters

103 Smartedge IT Services Jobs

Big Data Engineer - ETL/SQL (10-17 yrs)

10-17 years

Big Data Engineer - ETL/SQL (10-17 yrs)

Smartedge IT Services

posted 2mon ago

Job Role Insights

Fixed timing

Job Description

Job Description :

We are looking for a Big Data Engineer to work on collecting, storing, processing, and analyzing large data sets. The primary focus will be on choosing optimal solutions for these purposes, then maintaining, implementing, and monitoring them. You will also be responsible for integrating these solutions with the architecture used across our clients.

Roles and Responsibilities :

- Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities.

- Developing and maintaining data pipelines, implementing ETL processes, monitoring performance, and advising on necessary infrastructure changes.

- Translating complex technical and functional requirements into detailed designs.

- Investigating and analyzing alternative solutions for data storage, processing, etc., to ensure the most streamlined approaches are implemented.

- Serving as a mentor to junior staff by conducting technical training sessions and reviewing project outputs.

Skills and Qualifications :

- Strong understanding of data warehousing and data modeling techniques.

- Proficient understanding of distributed computing principles (e.g., Hadoop v2, MapReduce, HDFS).

- Strong data engineering skills on GCP platforms, including Airflow, Cloud Composer, Data Fusion, Data Flow, Data Proc, BigQuery.

- Experience with building stream-processing systems, using solutions such as Storm or Spark Streaming.

- Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala.

- Experience with Spark, SQL, and Linux.

- Knowledge of various ETL techniques and frameworks, such as Flume, Apache NiFi, or DBT.

- Experience with messaging systems like Kafka or RabbitMQ.

- Good understanding of Lambda Architecture, along with its advantages and drawbacks.


Functional Areas: Software/Testing/Networking

Read full job description

What people at Smartedge IT Services are saying

What Smartedge IT Services employees are saying about work life

based on 13 employees
71%
100%
66%
100%
Strict timing
Monday to Friday
No travel
Day Shift
View more insights

Smartedge IT Services Benefits

Work From Home
Job Training
Free Transport
Child care
Gymnasium
Cafeteria +6 more
View more benefits

Compare Smartedge IT Services with

Infosys

3.6
Compare

Wipro

3.7
Compare

TCS

3.7
Compare

HCLTech

3.5
Compare

Tech Mahindra

3.5
Compare

Cognizant

3.7
Compare

Accenture

3.8
Compare

Capgemini

3.7
Compare

IBM

4.0
Compare

LTIMindtree

3.8
Compare

HCL Infosystems

3.9
Compare

Accel Frontline

4.0
Compare

Puropale Creations & IT Solutions

4.9
Compare

Diverse Lynx

3.8
Compare

Pitney Bowes

3.8
Compare

Solartis Technology Services

3.6
Compare

Apmosys Technologies

3.4
Compare

Dahua Technology India Pvt.Ltd.

3.5
Compare

Apex CoVantage

3.2
Compare

VHS Consulting

3.7
Compare

Similar Jobs for you

Big Data Engineer at AEXONIC TECHNOLOGIES PRIVATE LIMITED

5-8 Yrs

₹ 10-26 LPA

Big Data Engineer at NUSTAR TECHNOLOGIES INDIA PRIVATE LIMITED

6-8 Yrs

₹ 15-26 LPA

Senior Data Engineer at Infometry

5-15 Yrs

₹ 15-30 LPA

Senior Data Engineer at Infometry

5-15 Yrs

₹ 15-30 LPA

Big Data Engineer at ReYcruit Consultancy

8-17 Yrs

₹ 25-45 LPA

Associate Principal Engineer at Nagarro Software Pvt. Ltd

11-14 Yrs

₹ 30-45 LPA

Big Data Engineer at Herkey

2-10 Yrs

₹ 11-35 LPA

Senior Data Engineer at Cynosure Corporate Solutions

6-10 Yrs

₹ 15-25 LPA

Senior Data Engineer at Surya Veena Adarsh Niketan Trust

5-8 Yrs

₹ 30-45 LPA

Big Data Engineer at Lakshya Software Technologies Private Limited

5-8 Yrs

₹ 15-24 LPA

Smartedge IT Services Hyderabad / Secunderabad Office Location

View all
Hyderabad / Secunderabad, Telangana Office
Headquarter
Smartedge IT Services Pvt. Ltd Plot No.56, 1st Floor Nagarjuna Hills, Punjagutta Hyderabad – 500 082 India Ph:+91(0)40 400 38599 Hyderabad / Secunderabad, Telangana
500082

Big Data Engineer - ETL/SQL (10-17 yrs)

10-17 Yrs

2mon ago·via hirist.com

Lead SAP BRIM Consultant (8-10 yrs)

8-10 Yrs

1d ago·via hirist.com

Guidewire Digital Developer (2-5 yrs)

2-5 Yrs

2d ago·via hirist.com

JBPM Developer - Java/Drools (3-12 yrs)

3-12 Yrs

2d ago·via hirist.com
write
Share an Interview