Big Data Service Core Systems and Integration Engineering

Do you want to define the way our Big Data Platform Products are engineered and operated
We are looking for someone like you who can help us with:
core systems engineering and advisory for our current big data platform products across Azure Databricks, Microsoft Fabric, Synapse Analytics and Cloudera on prem and in Azure
includes emerging topics centered around ML and AI capabilities and key core features like for example Databricks Unity catalog as well core integration with peripheral upstream and downstream systems
capturing and driving best practices across the firm to achieve cost effective and compliant use of deployed instances
creating and maintaining custom azure Audit/deny policy ensuring compliant usage
resolve high-priority defects and deploy fixes to core platform product systems
managing interface to our Azure infrastructure engineering by addressing issues and keeping track of until resolved
participation in various product and service management related activities such as working with users, trainings establishing a vibrant internal community of practitioners
creating, reviewing and maintaining documentation and learning resources for the bank You ll be working in the Big Data Platform Services team within Group CTO which is interacting with
team members in other locations in Europe and Asia and the US. Together we drive consistency across
business divisions and optimize operations and support costs, by providing timely, robust, cost effective
and well architected data platform solutions and products to our clients.
We architect, engineer and support data platform solutions both on prem and in the cloud using various
data platform products. Your team is instrumental in setting the direction and strategy for the Center of
Excellence across the bank for big data technologies with your primary focus being in the core systems
and integration engineering team across BDS platforms.
Teamwork is pivotal to our success, it plays a very important role and you will be working closely with
BDS product managers, advisory SMEs and big data platform solution engineers. deep technical knowledge of Databricks deployments in Azure both from an administrative and a consulting standpoint
ideally 5+ years of solid experience in integrating data processing and data analytics solutions using Databricks on Azure
expertise in Databricks Architecture, Control Plane and Data Plane Components with Control plane-Data Plane Connectivity
proven expertise in full stack integration in Azure (Lakehouse, Gitlab, Databricks SQL, MLFlow, Azure Policy, ADLS, SCIM, PowerBI, Azure Networking)
certified Solutions Architect (AZ 305) is a must and preferable to have certifications in Databricks / Spark / Lakehouse
ability to solve complex issues, good at problem statement analysis and solution design thinking
confident communicator that can explain technology to non-technical audiences
capable of understanding client needs and translating this into products and services