Upload Button Icon Add office photos
filter salaries All Filters

9 Surya Veena Adarsh Niketan Trust Jobs

Senior Data Engineer - SQL/ETL (5-8 yrs)

5-8 years

Senior Data Engineer - SQL/ETL (5-8 yrs)

Surya Veena Adarsh Niketan Trust

posted 2mon ago

Job Description

We need candidates who worked on Building data pipelines heavily towards Spark - SQL. Processing over 100s of terabytes of data. ETL pipeline, Data processing (Raw data processing)

What You'll Be Doing :

1. Build highly scalable, available, fault-tolerant distributed data processing systems (batch and streaming systems) processing over 100s of terabytes of data ingested every day and petabyte-sized data warehouse and elastic search cluster.

2. Build quality data solutions and refine existing diverse datasets to simplified models encouraging self-service

3. Build data pipelines that optimize on data quality and are resilient to poor quality data sources

4. Own the data mapping, business logic, transformations and data quality

5. Low level systems debugging, performance measurement & optimization on large production clusters

6. Participate in architecture discussions, influence product roadmap, and take ownership and responsibility over new projects

7. Maintain and support existing platforms and evolve to newer technology stacks and architectures

We're excited if you have :

1. Proficiency in Python and pyspark

2. Deep understanding of Apache Spark, Spark tuning, creating RDDs, and building data frames. Create Java/ Scala Spark jobs for data transformation and aggregation.

3. Experience in big data technologies like HDFS, YARN, Map-Reduce, Hive, Kafka, Spark, Airflow, Presto, etc.

4. Experience in building distributed environments using any of Kafka, Spark, Hive, Hadoop, etc.

5. Good understanding of the architecture and functioning of Distributed database systems

6. Experience working with various file formats like Parquet, Avro, etc for large volumes of data

7. Experience with one or more NoSQL databases

8. Experience with AWS, GCP

9. 5+ years of professional experience as a data or software engineer


Functional Areas: Software/Testing/Networking

Read full job description

Compare Surya Veena Adarsh Niketan Trust with

TCS

3.7
Compare

Accenture

3.8
Compare

Wipro

3.7
Compare

Cognizant

3.7
Compare

Capgemini

3.7
Compare

HDFC Bank

3.9
Compare

Infosys

3.6
Compare

ICICI Bank

4.0
Compare

HCLTech

3.5
Compare

Tech Mahindra

3.5
Compare

Genpact

3.8
Compare

Teleperformance

3.9
Compare

Concentrix Corporation

3.8
Compare

Axis Bank

3.8
Compare

Amazon

4.1
Compare

Jio

3.9
Compare

iEnergizer

4.6
Compare

Reliance Retail

3.9
Compare

IBM

4.0
Compare

LTIMindtree

3.8
Compare

Similar Jobs for you

Data Engineer at Strategic HR Solutions

6-8 Yrs

₹ 17-30 LPA

Senior Data Engineer at Cynosure Corporate Solutions

6-10 Yrs

₹ 15-25 LPA

Data Engineer at ORBION INFOTECH

5-10 Yrs

₹ 15-30 LPA

Data Engineer at Talent Divas Consulting

4-12 Yrs

₹ 15-40 LPA

Data Engineer at Freelance

3-6 Yrs

₹ 15-25 LPA

Data Engineer at Coders Brain Technology Private Limited

6-12 Yrs

₹ 15-34 LPA

Senior Data Engineer at TechPoppy

5-8 Yrs

₹ 7-30 LPA

Senior Data Engineer at Infometry

8-10 Yrs

₹ 18-45 LPA

Senior Data Engineer at talent corner hr services

5-10 Yrs

₹ 10-30 LPA

Senior Data Engineer at Think bridge Software Pvt. Ltd.

5-8 Yrs

₹ 15-24 LPA

write
Share an Interview