Azure Data Engineer For onsite USA

Minimum 10+ years of experience in the Data engineering.Min 10+ years of experience in modern data engineering/data warehousing/data lakes technologies on cloud platforms like Azure, Data Bricks etc. Azure experience is preferred over other cloud platforms.

10 + years of proven experience with SQL, schema design and dimensional data modelling. Hands on experience in SQL is a MUST.

Solid knowledge of data warehouse best practices, development standards and methodologies

Hands on experience with ETL/ELT tools like ADF, Informatica , Talend etc., and data warehousing technologies like Azure Synapse, Azure SQL, AZure data lake, Azure data factory , Snowflake ,etc..

Strong experience with big data tools(Databricks , Spark etc..) and programming skills in PySpark and Spark SQL.

Azure Data Factory, DataBricks, Azure Storage, and Azure VM: The candidate should have practical experience with Azure Data Factory, DataBricks, Azure Storage, and Azure Virtual Machines.

Should be able to design and implement data pipelines using Azure Data Factory, perform data transformations and analytics using DataBricks, and manage data storage and virtual machines in Azure.

Data Governance, Data Quality, and Controls: The candidate should have a strong understanding of data governance principles, data quality management, and data controls. They should be able to implement data governance frameworks, establish data quality standards, and ensure compliance with data regulations and policies

Implementing alerts and notifications for batch jobs: The candidate should have experience in setting up alerts and notifications for batch jobs. Should be able to configure monitoring and alerting mechanisms to ensure timely identification and resolution of issues in batch job execution.

Design, develop, and maintain data pipelines and processes using SSIS and SQL to support data ingestion and integration.

Utilize Azure Data Factory to build scalable data workflows for cloud-based data processing and transformation.

Five or more years of progressive experience in data engineering and data warehousing using Azure Data Factory, Azure Data Flows, and Azure Synapse Analytics

Technical Skills: Python, PySpark, ADF, SQL, ADLS, Microsoft Azure, Azure Databricks, Azure Synapse.