Data Engineering Architect

Key Responsibilities

Azure Cloud Data Solutions:

o Identify and implement optimal and secure Azure cloud-based solutions.

o Design and implement end-to-end Azure data solutions covering data ingestion, storage, processing, and visualization.

o Architect data platforms using Azure services such as Azure Data Factory (ADF), Azure Databricks (ADB), Azure SQL Database, and PySpark.

Data Fabric Implementation:

o Develop and deploy a robust data fabric to unify disparate data sources, ensuring seamless integration, data governance, and improved accessibility.

Data Pipeline Model Development:

o Develop and maintain scalable ETL/ELT data pipelines for efficient data movement and transformation.

o Design data models and schemas to support business requirements and drive analytical insights.

Collaboration Leadership:

o Work in tandem with Architecture, Applications, and Security teams to refine technical solutions.

o Collaborate with stakeholders to translate business needs into technical requirements.

o Provide technical leadership and guidance to the data engineering team, fostering best practices and innovation.

Innovation Documentation:

o Stay updated on emerging Azure technologies, industry trends, and best practices in data architecture.

o Recommend improvements to optimize the environment, minimize waste, and maximize investments.

o Create and update comprehensive documentation to facilitate cross-training and troubleshooting.

Security Compliance:

o Collaborate with Security and Architecture teams to deploy and refine security best practices.

o Ensure that data solutions are compliant with industry standards for data protection, threat detection, and recovery.

Experience Expertise:

o Overall 12+ years of IT experience with a minimum of 2 years as an Azure Data Architect.

o Strong expertise in all aspects of Azure services with a focus on data engineering and BI reporting.

o Proven track record in designing and implementing scalable, robust, and secure data solutions.

Technical Skills:

o Proficiency in Azure Data Factory (ADF), Azure Databricks (ADB), Azure SQL Database, PySpark, SQL, NoSQL, and Power BI.

o Extensive experience in data modeling, data warehousing, and business intelligence concepts.

o Familiarity with building and maintaining a data fabric architecture to unify data sources.

Soft Skills:

o Excellent communication, teamwork, analytical, and troubleshooting skills.

o Attentive to detail and capable of working both independently and within a team.

o Self-starter with the ability to adapt in a fast-paced environment.