Data Architect - Databricks

Trianz is a leading-edge technology platforms and services company that accelerates digital transformations at Fortune 100 and emerging companies worldwide in data analytics, digital experiences, cloud infrastructure, and security. The company has developed a disruptive IP Led Transformations vision, strategy, and business model over the past 3 years. Some of the company s IP was recently acquired by AWS and its overall business model has taken off sharply in 2024.

Trianz is led by Sri Manchala, a former special forces officer from the Indian army and author of Crossing the Digital Faultline | Trianz , and a team of veterans from well-known firms such as Deloitte, HCL, KPMG, Wipro, Microsoft, TATA, AWS, GE, etc.

About Trianz

Trianz believes that companies around the world face three challenges in their digital transformation journeys - shrinking time to transform due to competition AI, lack of digital-ready talent, and uncertain economic conditions. To help clients leapfrog over these challenges, Trianz has built IP and platforms that have transformed the adoption of the cloud, data, analytics insights AI.

Specifically, the following Trianz platforms are changing the way companies approach transformations in various disciplines:

• Concierto: A fully automated platform to Migrate, Manage, and Maximize the multi hybrid cloud. A zero code and SaaS platform, Concierto allows teams to migrate to AWS, Azure and GCP and manage them efficiently from a single pane of glass. Visit www.concierto.cloud for more information
• Extrica Data to AI Platform: Built on the concept of federated or distributed data , Extrica revolutionizes how users access data anywhere in the company s ecosystems; productizes data and makes it available in a Netflix like user experience while delivering BI and AI powered insights. Visit www.extrica.io for more.
• Pulse: Recognizing that workforces will be distributed, mobile, and fluid, Trianz has built a future of work digital workplace platform called Pulse. Visit www.trianz.com/Pulse

Since the market launch of this strategy in mid-2023, Trianz has experienced enormous growth, success, and recognition.

• Some of Trianz built IP in data and analytics was acquired by Amazon. Since then, Trianz has been made an engineering partner of Amazon for building/supporting connected ecosystems across multiple AWS platforms.
• Most recently, Trianz and AWS have signed a strategic collaboration agreement within which the two companies will work on joint roadmaps/solutions for the cloud; AWS will buy Trianz | Concierto in bulk for AWS partners to use for migrations; AWS will also recommend Concierto to their MSPs and finally, AWS Professional Services and Trianz have signed an agreement for joint solutioning and customer delivery. Read more: Trianz enters into a Strategic Collaboration Agreement with AWS to Revolutionize Cloud Adoption and Management (yahoo.com)

Given all this, Trianz is experiencing a significant demand for its SW platforms and consequent growth. To support this growth, Trianz has recently raised private equity capital to scale the company over the next several years ( Trianz Announces Strategic Growth Capital Investment by Capital Square Partners (prnewswire.com ). It is now bolstering its senior and mid-level leadership with top talent across GTM, Engineering, Services, and Partnership organizations. We are seeking leaders driven by our purpose - to help customers accelerate digital transformations and build the next generation software and services organization.

Trianz | Accelerating Digital Evolution

Leaders in Product Engineering, Data Analytics Consulting, APPS Experience Consulting, Hybrid Cloud Consulting, IT infrastructure services, managed services and IT security consulting.

Job Title : Data Architect - Databricks

Role: Data Architect - Databricks Client: Trianz DAI Practice Employment Type: Employee Work location: India - Hyderabad or Bangalore Work mode: Trianz Office - Hybrid Trianz Grade: 7 / 12 - 14 years / Senior Solutions Architect About Trianz - INSERT TRIANZ BLURB - please share and review with Ben K before publishing Job Summary As a Data Architect, you are core to the DAI (Data AI) Practice s success. Data is foundational to everything we do, and you are accountable for defining and delivering best-in-class Databricks data management solutions across all major cloud platforms. This is a senior role with high visibility and reporting to the DAI Practice Tower Lead. Job Responsibilities Architectural Design: Architect secure, scalable, highly performant data engineering and management solutions, including data warehouses, data lake, ELT / ETL and real-time data engineering / pipeline solutions. Support Principal Data Architect in defining and maintaining Practice reference data engineering and data management architectures. Databricks Implementation: Design and manage scalable end-to-end data solutions leveraging native Databricks capabilities including Data Engineering - Delta Live Tables, Apache Spark, Structured Streaming, Notebooks, Git CI/CD, Databricks supported file types, Libraries. Data Warehousing - Databricks SQL, best practice data modeling. Delta Lake - Delta Lake + Delta Live tables, incremental and streaming workloads, table history, file management, API utilization. Databricks Data Unity Catalog - access control, lineage, Delta Sharing, identity management. Hyperscaler Design: Competently leverage data-related cloud platform (AWS or Azure or GCP) capabilities to architect and develop end-to-end data engineering and data management solutions. Client Engagement: Regular collaboration and partnership with clients to understand their challenges and needs then translate requirements into data solutions that drive customer value. Support proposal development. Data Modeling: Create and maintain conceptual, logical, and physical data models that support both transactional and analytical needs. Ensure data models are optimized for performance and scalability. Creativity: Be an out-of-the-box thinker and passionate about applying your skills to new and existing solutions alike while always demonstrating a customer-first mentality. Mandatory Skills 12+ years hands-on data solution architecture and implementation experience on modern cloud platforms (AWS preferred) including microservice and event-driven architectures. Databricks Professional Data Engineer certification. Databricks Platform Architect accreditation (AWS or Azure). Databricks Platform Administrator accreditation. Hands-on experience with Databricks Lakehouse implementations, Delta Live Tables and building scalable data pipelines including real-time (Kafka, Kinesis) in addition to Databricks Structured Streaming. Demonstrated, holistic experience and competence with Databricks concepts including Delta tables, Apache Spark, Structured Streaming, Notebooks, Git CI/CD, Libraries Databricks SQL. An architectural certification on either AWS, Azure or GCP. Experience with ML orchestration tools such as MLflow and Kubeflow. Containerization proficiency (Docker, Kubernetes) to deploy data pipelines and models. Practical experience with end-to-end data engineering and data management supporting functions including data modeling (conceptual, logical physical), BI analytics, data governance, data quality, data security / privacy / compliance, IAM, performance optimization. Advanced SQL and data profiling. Python or Scala. Strong communication skills with the ability to convey technical concepts to non-technical users. Strong, self-management skills demonstrating ability to multitask and self-manage goals and activities. Additional / Nice-to-have Qualifications Databricks ML Engineer certification (Associate or Professional) Databricks Generative AI Engineer certification Databricks Apache Spark Developer certification Any additional Databricks accreditations or certifications Required Education Master or Bachelor (CS, IT, Applied Mathematics or demonstrated experience) Why Join Us- INSERT TRIANZ BLURB - please share and review with Ben K before publishing Travel Requirement (%) Periodic / infrequent travel as required for In-person client meetings Company culture / focus events Training and/or alliance needs Initial Screening Questions Initial Rejection Screening Questions Does candidate have Databricks Professional Data Engineer certificationIf no, reject Does candidate have Databricks Platform Architect accreditation (AWS or Azure)If no, reject Does candidate have an architectural certification with AWS, Azure or GCPIf no, reject Has candidate successfully designed and implemented modern cloud-based data engineering and data management solutions for more than 7 yearsIf no, reject Does candidate have 5 or more years working directly with clients (internal or external) to collaboratively (direct conversation) develop data engineering and data management solutionsIf no, reject Does candidate communicate clearly in EnglishIf no, reject Prioritization Questions (Candidates with highest points should receive highest ranking in progressing) Does candidate have => 3 years prior consulting experienceIf yes, 1 point Does candidate have any of the nice-to-have qualificationsIf yes, 1 point Does candidate have an architectural certification in AWS or AzureIf yes, 2 points HR Helper Questions What is alignment to practiceThis role predominantly supports our Data Estate Modernization offering. Is this a new role and whyYes, this is a new role as Trianz s DAI is under new leadership (Ravi). This role is central to its success. What is billable time