Data Engineer

Design and implement ETL processes using Azure Data Factory and SSIS to facilitate data extraction, transformation, and loading from various sources.
Develop real-time data streaming solutions using Azure Stream Analytics and Azure Event Hubs to support real-time analytics and reporting.
Utilize PySpark and Databricks to perform large-scale data processing and analytics, ensuring high performance and scalability.
Collaborate with data architects and other stakeholders to design and maintain data models and structures for efficient data storage and retrieval.
Implement integration solutions with various ERP systems into data lakes, ensuring seamless data flow and accessibility.
Monitor and optimize SQL queries and data pipelines to enhance performance and reduce latency.
Implement data quality checks and establish monitoring systems to ensure data integrity and accuracy.
Participate in the migration of on-premises data solutions to Azure, ensuring best practices are followed for data security and compliance.
Stay up to date with the latest Azure features and data engineering practices, contributing to continuous improvement initiatives within the team.
Qualifications.
To perform this job successfully, an individual must meet expectations of each essential duty.
The requirements listed below are representative of the knowledge, skills and abilities required.
EDUCATION : Bachelor's degree Bachelor's degree in computer science/engineering.
Experience.
3-5 years of experience in data engineering, with a focus on Azure services.
PREFERRED QUALIFICATIONS: Proficient in SQL Server, SSIS, and Azure SQL Database.
Strong programming skills in Python and experience with PySpark.
TECHNICAL KNOWLEDGE AND/OR ABILITIES: Hands-on experience with Azure Data Factory, Azure Databricks, and Azure Stream Analytics.
Knowledge of real-time data processing and data streaming concepts.
Familiarity with data modeling techniques (Star Schema, Snowflake Schema).
Azure certification (e g, Azure Data Engineer Associate) is highly desirable.
Knowledge of Azure Fabric is a plus.
Excellent problem-solving skills and attention to detail.
Strong communication skills and ability to work collaboratively in a team environment.