Azure Data Engineer

Location: Remote

JD

Key Responsibilities:

1. Azure Data Platform Development:

• Design, deploy, and manage data solutions on the Azure cloud platform, leveraging services such as Azure Data Factory, Azure SQL Database, and Azure Blob Storage.
• Develop data pipelines and ETL workflows using Azure Data Factory to extract, transform, and load data from various source systems.

2. Fivetran Integration and Configuration:

• Configure and manage Fivetran connectors to extract data from diverse source systems, including databases, SaaS applications, and APIs.
• Customize Fivetran pipelines to meet specific data integration requirements and ensure data quality and consistency.

3. Data Modeling and Transformation:

• Design and implement data models and schemas within Azure SQL Database or Azure Synapse Analytics to support analytics and reporting needs.
• Transform and cleanse data using SQL queries, stored procedures, and data transformation tools within Azure.

4. Monitoring and Optimization:

• Monitor data pipeline performance and health metrics, identifying opportunities for optimization and troubleshooting issues as they arise.
• Optimize data storage and processing configurations within Azure to improve performance and reduce costs.

5. Collaboration and Documentation:

• Collaborate with data engineers, analysts, and business stakeholders to understand data requirements and deliver scalable and reliable data solutions.
• Document technical designs, configurations, and best practices for Azure data engineering and Fivetran integration.