Upload Button Icon Add office photos
filter salaries All Filters

18 METRIX IT SOLUTIONS Jobs

Data Engineer - Python/Spark (5-15 yrs)

5-15 years

Data Engineer - Python/Spark (5-15 yrs)

METRIX IT SOLUTIONS

posted 2d ago

Job Role Insights

Fixed timing

Job Description

Job Description :


Job title : Data Engineer - Engineer II


Exp : 5-15


Location : Chennai


Skill : Python, GCP, ETL-Big Data, PySpark, API, RDBMS, Oracle)


Primary Skills (Essential) :


- Python proficiency (including experience with data manipulation, libraries like pandas)

PySpark expertise (including hands-on experience with Spark transformations and Optimizations)


- Real-time data ingestion experience (e.g., using Kafka, Spark Streaming)


Batch data ingestion :


- Data aggregation and insights generation (using SQL or Spark)


- Rest API integration for data ingestion


- Kafka topic interaction (producing and consuming messages)


- Oracle RDBMS knowledge


- Data purging, and archiving experience


Secondary Skills (Desirable) :


- Familiarity with Generative AI implementation concepts (e.g., data preparation for model training, prompt engineering)


- Understanding of Data lake architecture and Data warehouse concepts


- Having prior experience in AMEX services like Event Engine, HiPED, Hydra deployment


- Having better knowledge on LUMI and Cornerstone data ingestion


Key Responsibilities :


Data Pipeline Development :


- Design, develop, and maintain scalable, efficient, and high-performance data pipelines for ETL (Extract, Transform, Load) processes.


Data Modeling & Warehousing :


- Develop and optimize data models for business intelligence and analytical purposes.


- Manage and improve data warehousing solutions such as Snowflake, Redshift, or BigQuery.


Data Integration :


- Integrate data from various sources, including APIs, third-party tools, and databases, ensuring seamless access to data for analysis.


Collaboration :


- Work closely with data scientists, analysts, and business stakeholders to understand data requirements and deliver data solutions that meet business needs.


Data Quality & Governance :


- Ensure data quality, consistency, and integrity across all systems.


- Implement data governance policies to ensure accurate, accessible, and secure data.


Performance Tuning & Optimization :


- Identify and address performance bottlenecks within data systems, ensuring optimal performance and cost efficiency.


Functional Areas: Software/Testing/Networking

Read full job description

Prepare for Data Engineer roles with real interview advice

What people at METRIX IT SOLUTIONS are saying

What METRIX IT SOLUTIONS employees are saying about work life

based on 22 employees
88%
93%
64%
56%
Strict timing
Monday to Friday
Within city
Night Shift
View more insights

METRIX IT SOLUTIONS Benefits

Free Transport
Child care
Gymnasium
Cafeteria
Work From Home
Free Food +6 more
View more benefits

Compare METRIX IT SOLUTIONS with

TCS

3.7
Compare

Infosys

3.6
Compare

Wipro

3.7
Compare

HCLTech

3.5
Compare

Tech Mahindra

3.5
Compare

LTIMindtree

3.8
Compare

Mphasis

3.4
Compare

Hexaware Technologies

3.5
Compare

Persistent Systems

3.5
Compare

HCL Infosystems

3.9
Compare

Northcorp Software

4.3
Compare

Accel Frontline

4.0
Compare

Puropale Creations & IT Solutions

4.9
Compare

Diverse Lynx

3.8
Compare

Elentec Power India (EPI) Pvt. Ltd.

3.7
Compare

HyScaler

4.5
Compare

Appsierra

4.5
Compare

Pitney Bowes

3.8
Compare

Solartis Technology Services

3.6
Compare

Emblix Solutions

4.6
Compare

Similar Jobs for you

Data Engineer at O2F Info Solutions Pvt. Ltd.

4-8 Yrs

₹ 12-24 LPA

Data Engineer at Allnessjobs

7-10 Yrs

₹ 25-35 LPA

Senior Data Engineer at TalentXo

5-7 Yrs

₹ 30-40 LPA

Data Engineer at NucleusTeq Consulting Pvt. Ltd.

7-15 Yrs

₹ 30-40 LPA

Data Engineer at Zelarsoft Pvt.Ltd.

7-11 Yrs

₹ 15-30 LPA

Data Engineer at Quarks Technosoft

5-7 Yrs

₹ 15-25 LPA

Data Engineer at ConnectIO IT Pvt Ltd

5-15 Yrs

₹ 20-35 LPA

Data Engineer at Worksconsultancy

5-10 Yrs

₹ 25-34 LPA

Data Engineer at SAPBOT Technologies

8-10 Yrs

₹ 15-26 LPA

Data Engineer at People Impact

9-16 Yrs

₹ 30-50 LPA

Data Engineer - Python/Spark (5-15 yrs)

5-15 Yrs

2d ago·via hirist.com

Solution Architect - MS Dynamics 365 (10-15 yrs)

10-15 Yrs

2d ago·via hirist.com

System Engineer - Linux/Windows OS (7-12 yrs)

7-12 Yrs

2d ago·via hirist.com

Senior NetSuite Functional Consultant (5-15 yrs)

5-15 Yrs

2d ago·via hirist.com

Cloud Security Architect/Developer (9-11 yrs)

9-11 Yrs

25d ago·via hirist.com

Custom Reporting Consultant - Avature (6-8 yrs)

6-8 Yrs

25d ago·via hirist.com
write
Share an Interview