Data Engineer

Roles and Responsibilities:

• Design and implement end-to-end Microsoft Azure/Fabric solutions, including data integration, transformation, and analytics.
• Proficiency with Azure services such as Data Factory (ADF), Databricks, Synapse, Data Lake (One Lake), and Azure SQL.
• Develop and optimize pipelines for data ingestion using Microsoft Fabric's Data Factory capabilities.
• Proficiency in Microsoft Fabrics Notebook for developing Apache Spark jobs.
• Hands-on experience with Python, PySpark and SparkSQL/TSQL for data transformations.
• Advanced SQL skills and proficiency in data integration techniques, ETL/ELT processes, and data pipeline architectures.
• Extensive knowledge of MS Fabric components like: Lake houses, One Lake, Data Pipelines, Real-Time Analytics, Power BI Integration, Semantic Model.
• Build and maintain data models and visualizations in Microsoft Fabric for advanced reporting and analytics.
• Collaborate with stakeholders to understand business requirements and translate them into scalable solutions.
• Integrate Microsoft Fabric with other platforms such as Power BI, Data Lake.
• Monitor, troubleshoot, and resolve issues in Microsoft Fabric environments to ensure performance and reliability.
• Provide training and documentation to end-users on Microsoft Fabric tools and best practices.
• Stay updated with the latest Microsoft Fabric features and enhancements to leverage them effectively.