Technical Architect

Roles and Responsibilities

• Design, develop, and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources into SQL databases.
  
• Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs.
  
• Develop complex ETL processes using PySpark on Hadoop clusters to process massive datasets.
  
• Create interactive dashboards using Power BI for reporting purposes.
  
• Ensure high availability, scalability, and performance of all systems by implementing monitoring tools and logging best practices.