Databricks Technical Architect in AWS

We are seeking a highly skilled Databricks Technical Architect with a strong background in designing and implementing Lakehouse reference architectures on AWS.The ideal candidate will have hands-on experience with Apache Spark , Spark Streaming, Kafka, and Delta Lake and a proven ability to build and maintain robust data pipelines and production systems.

Key Responsibilities:

• Design and implement Lakehouse reference architectures on AWS using Databricks.
• Develop and maintain big data pipelines leveraging technologies like Apache Spark and Delta Lake.
• Provide expertise in building and optimizing production data systems for performance and scalability.
• Implement Delta Lakes and utilize Unity Catalog to manage metadata and governance.
• Ensure data security, governance, and compliance in accordance with industry standards.
• Collaborate with cross-functional teams to architect solutions.
• Act as a technical leader, guiding clients through architectural design and implementation.
• Stay updated on the latest AWS and Databricks technologies and best practices.

Qualifications-

• 5 to 10 years of experience in a technical role with expertise in data engineering, software engineering, or related fields.
• Hands-on production experience with Apache Spark and other big data technologies such as Spark Streaming, Kafka, and Delta Lake.
• Experience building big data pipelines and maintaining production data systems.
• Expertise in AWS
• Experience with Delta Lakes and Unity Catalog
• Strong understanding of data governance, security, and compliance.
• Technical leadership skills to guide strategic customers through architectural design and implementation.
• familiar with Semantic and API layers with tools such like these two.
• Cube The Universal Semantic Layer
• Semantic Layer Solution BI & Data & Analytics Software | AtScale
• Lakehouse reference architectures (download) | Databricks on AWS