Databricks Architect

Role :

We are seeking an experienced Databricks Architect to join our data team in developing a new solution for our retail business. The ideal candidate will have 5-7 years of experience in data architecture, with a strong focus on Databricks and cloud-based data solutions. The Databricks Architect will play a crucial role in designing and implementing scalable data pipelines, optimizing data workflows, and ensuring data integrity and security.

Key Accountabilities & Responsibilities:

• Design and implement data architecture solutions using Databricks to support retail business needs.
• Collaborate with data engineers, data scientists, and business stakeholders to understand requirements and translate them into technical specifications.
• Develop and optimize ETL processes and data pipelines for efficient data processing and analytics.
• Ensure data quality and integrity through effective data governance practices.
• Monitor and troubleshoot data pipeline performance and address any issues that arise.
• Stay up-to-date with the latest trends and technologies in data architecture and Databricks.
• Provide technical guidance and mentorship to junior team members.

Key Competencies & Skills required

Technical Skills:

• Bachelors degree in Computer Science, Information Technology, or a related field.
• 5-7 years of experience in data architecture, with a focus on Databricks and cloud platforms (e.g., Azure, AWS, GCP).
• Proficiency in SQL, Python, and Spark.
• Experience with data modeling, ETL processes, and data warehousing concepts.
• Strong understanding of data governance and data security best practices.
• Excellent problem-solving skills and ability to work collaboratively in a team environment.
• Strong communication skills, with the ability to convey technical concepts to non-technical stakeholders.