Azure Data Engineer

(Profiles will be only considered if the form is filled)

Dear Candidates,

We are hiring Data Engineer for Bangalore (Onsite).

As part of our process, we kindly request you to fill out the form with details about your recent relevant projects. Please describe as much as possible in the given form, including your role, responsibilities, technologies used, and key achievements. https://forms.office.com/r/4zyQaHBdT1

(Profiles will be only considered if the form is filled)

Your detailed input will help us better understand your experience and expertise. Kindly complete the form at your earliest convenience. This will be the preliminary round for the selection of your profile. Looking forward to your response.

PFB the JD for your reference.

Necessary Skills / Tools:

• SQL & Python / PySpark
• Azure Services: Synapse Pipelines (or ADF), Spark Pools, Synapse SQL Pools, SQL Managed Instances Mandatory
• Data warehousing basics
• Data modeling basics

Job Description:

• Design and develop data processing pipelines using various ETL tools for data ingestion, cleansing, transformation, and orchestration in the Azure cloud environment.
• Implement data security with role-based access control, as well as masking and encrypting sensitive data.
• Monitor and optimize data storage and processing through monitoring tools, query tuning, and archiving strategies.
• Hands-on experience with Synapse Pipelines (ADF knowledge is also acceptable), Spark Pools, Synapse SQL Pools, and SQL Managed Instances.
• Expertise in Azure Synapse Data Pipelines, PySpark, Spark SQL, and T-SQL.
• Knowledge of Azure Functions App (coded in Python) is a plus.
• Familiarity with monitoring tools, data storage optimization, and archive concepts.
• Proficiency in using ETL tools for data ingestion, job orchestration, and transformation.
• Deep understanding of data security practices and cloud technologies.
• Strong analytical and troubleshooting skills for pipeline issues.

Skills Required:

• Azure Synapse Pipelines (or ADF), Spark Pools, Synapse SQL Pools, SQL Managed Instances.
• PySpark, Spark SQL, T-SQL, and Azure Functions App.
• Monitoring tools for data pipelines and optimization strategies.
• Knowledge of data modeling and ETL processes.
• Problem-solving and troubleshooting for pipeline issues.