filter salaries All Filters

312 Data Lake Jobs

UST - Azure Data Engineer - Scala/Python (1-3 yrs)

1-3 years

UST - Azure Data Engineer - Scala/Python (1-3 yrs)

UST

posted 7d ago

Job Description

Job Title : Azure Data Engineer.


Experience : 1-3 Years.


Location : Bengaluru.


Job Description :


We are seeking an Azure Data Engineer with strong communication skills and a passion for learning. The ideal candidate should have hands-on experience with Azure Data Lake, Azure Data Factory, Azure Databricks, Apache Spark, and Scala/Python programming..


Key Responsibilities :

- Design, develop, and maintain data pipelines using Azure Data Factory to ingest, transform, and load data from various sources.

- Build scalable and efficient data processing workflows using Azure Databricks and Apache Spark.

- Implement data quality checks and validation processes to ensure data accuracy and reliability.

- Manage and maintain Azure Data Lake Storage, ensuring data security, accessibility, and performance.

- Implement data partitioning and optimization strategies for efficient data retrieval.

- Collaborate with data scientists and analysts to provide access to data for analysis and reporting.

- Develop data transformation logic using Scala or Python within Azure Databricks.

- Implement data cleansing and standardization processes to ensure data consistency.

- Optimize data processing jobs for performance and resource utilization.

- Integrate Azure Data Lake, Azure Data Factory, and Azure Databricks with other Azure services, such as Azure SQL Database, Azure Synapse Analytics, and Azure Event Hubs.

- Develop and maintain data connectors and APIs for data integration.

- Write clean, efficient, and well-documented code in Scala or Python.

- Utilize version control systems (Git) for code management and collaboration.

- Participate in code reviews and provide constructive feedback.

- Troubleshoot and resolve data pipeline and data processing issues.

- Monitor system performance and identify areas for improvement.

- Provide technical support to data scientists and analysts.

- Stay up-to-date on the latest Azure data services and technologies.

- Participate in training and development activities to enhance technical skills.

- Contribute to knowledge sharing and documentation efforts.

Technical Skills & Qualifications :

- 1-3 years of experience in data engineering or related fields.

- Hands-on experience with Azure Data Lake Storage.

- Hands-on experience with Azure Data Factory.

- Hands-on experience with Azure Databricks and Apache Spark.

- Proficiency in Scala or Python programming.

- Basic understanding of data warehousing concepts.


- Strong communication and interpersonal skills.

- Passion for learning and a proactive attitude.

- Ability to work effectively in a team environment.

Preferred Qualifications :

- Bachelor's or Master's degree in Computer Science, Data Science, or a related field.

- Experience with SQL and database management.

- Experience with cloud platforms (AWS, GCP).

- Knowledge of data modeling and data architecture.

- Azure certifications (e.g., Azure Data Fundamentals, Azure Data Engineer Associate).


Functional Areas: Other

Read full job description

Prepare for Azure Data Engineer roles with real interview advice

What people at UST are saying

4.6
 Rating based on 3 Azure Data Engineer reviews

Likes

Work Life Balance

  • Skill development - Excellent
  • +3 more
Dislikes

No ethics at all

  • Promotions - Poor
Read 3 Azure Data Engineer reviews

Azure Data Engineer salary at UST

reported by 31 employees with 2-7 years exp.
Lock Unlock
₹4.8 L/yr - ₹16.5 L/yr
13% more than the average Azure Data Engineer Salary in India
View more details

Compare UST with

TCS

3.7
Compare

Infosys

3.6
Compare

Wipro

3.7
Compare

HCLTech

3.5
Compare

Tech Mahindra

3.5
Compare

Cognizant

3.7
Compare

LTIMindtree

3.8
Compare

Mphasis

3.4
Compare

Hexaware Technologies

3.5
Compare

Genpact

3.8
Compare

DXC Technology

3.7
Compare

Sutherland Global Services

3.6
Compare

Optum Global Solutions

4.0
Compare

FIS

3.9
Compare

Virtusa Consulting Services

3.8
Compare

CGI Group

4.0
Compare

GlobalLogic

3.6
Compare

Bosch Global Software Technologies

3.9
Compare

Atos

3.9
Compare

Nagarro

4.0
Compare

Similar Jobs for you

Azure Data Engineer at Thoucentric Technology Pvt. Ltd.

3-5 Yrs

₹ 9-15 LPA

Azure Data Engineer at Recmatrix Consulting Pvt Ltd

3-9 Yrs

₹ 10-35 LPA

Engineer at STEFANINI INDIA PRIVATE LIMITED

3-6 Yrs

₹ 12-18 LPA

Azure Data Factory Developer at SYSTEM SOFT TECHNOLOGIES INDIA PRIVATE LIMITED

3-5 Yrs

₹ 12-15 LPA

Engineer at IT & Services

3-12 Yrs

₹ 10-30 LPA

Azure Data Engineer at Coffeee.io

3-5 Yrs

₹ 12-15 LPA

Senior Big Data Engineer at Info Services

3-6 Yrs

₹ 12-18 LPA

Azure Data Engineer at Saxon Global India Pvt. Ltd.

3-5 Yrs

₹ 12-15 LPA

Engineer at Think bridge Software Pvt. Ltd.

3-5 Yrs

₹ 10-15 LPA

Data Analyst at Sampoorna Consultants Pvt. Ltd

2-5 Yrs

₹ 12-50 LPA

1-3 Yrs

7d ago·via hirist.com

10-15 Yrs

5d ago·via hirist.com

3-7 Yrs

₹ 15 - 25L/yr

Kolkata

20d ago·via naukri.com

6-8 Yrs

22d ago·via hirist.com

3-5 Yrs

1mon ago·via hirist.com

4-8 Yrs

7d ago·via hirist.com

7-16 Yrs

1mon ago·via hirist.com

5-8 Yrs

13d ago·via hirist.com
How was your last interview experience?

Recently Viewed

JOBS

Browse jobs

Discover jobs you love

JOBS

SOFTPATH TECHNOLOGIES

No Jobs

JOBS

Nucleusteq Consulting

No Jobs

How was your last interview experience?
Rate your experience using AmbitionBox
Terrible
Terrible
Poor
Poor
Average
Average
Good
Good
Excellent
Excellent