Azure Databricks Architect - Synapse Analytics (8-10 yrs)

Key Responsibilities :

- Design and implement robust and scalable data architectures on Azure Databricks.

- Develop and optimize data pipelines using Apache Spark, including data ingestion, transformation, and loading.

- Integrate Azure Databricks with other Azure services, such as Azure Data Lake, Azure Synapse, and Azure SQL.

- Develop data models and implement ETL processes to ensure data quality and consistency.

- Collaborate with data engineers, data scientists, and business stakeholders to understand data requirements and translate them into effective solutions.

- Perform data analysis, identify trends, and provide insights to support business decisions.

- Stay abreast of the latest advancements in Azure Databricks and cloud-based data technologies.

- Mentor and guide junior team members on best practices for data engineering and cloud-based data solutions.

Qualifications :

- Proven experience as a Data Architect or a similar role with a strong focus on Azure Databricks.

- Extensive experience in designing and implementing data solutions on the Azure platform.

- Proficiency in Azure Databricks, Apache Spark, and data processing frameworks.

- Strong experience with Azure services (e.g., Azure Data Lake, Azure Synapse, Azure SQL).

- Familiarity with data modeling techniques, ETL processes, and data warehousing concepts.

- Proficiency in programming languages such as Python, Scala, or SQL.

- Excellent problem-solving and analytical skills with the ability to identify and resolve complex data challenges.

- Strong communication and collaboration skills, with the ability to effectively communicate technical concepts to both technical and non-technical audiences.

- Ability to manage multiple projects and prioritize tasks effectively in a fast-paced environment.