Associate Technical Architect

Associate Technical Architect Interview Questions and Answers

Updated 20 Dec 2024

Q1. Spark: Repartition and coalesce MLflow in Spark Partitioning of data map and map partition

Ans.

The question covers various topics related to Spark, including repartitioning, coalescing, MLflow, partitioning of data, map, and map partition.

Repartitioning and coalescing are used to change the number of partitions in an RDD/DataFrame.
MLflow is an open-source platform for managing machine learning lifecycle.
Partitioning of data is the process of dividing data into smaller, more manageable parts.
Map and map partition are transformations in Spark used to apply a function to ...read more

Q2. What are service principals and key vaults

Ans.

Service principals are identities used by applications and services to access resources, while key vaults are secure storage for keys, secrets, and certificates.

Service principals are used to authenticate and authorize applications and services to access resources in Azure
Key vaults provide a secure and centralized location to store and manage cryptographic keys, secrets, and certificates
Service principals can be granted access to key vaults to retrieve secrets or keys
Key vau...read more

Q3. Reading files using spark from different locations. (write code snippet)

Ans.

Reading files from different locations using Spark

Use SparkSession to create a DataFrameReader
Use the .option() method to specify the file location and format
Use the .load() method to read the file into a DataFrame

Q4. Azure storage BLOB vs ADLS Gen2

Ans.

Azure storage BLOB is a general-purpose object storage solution, while ADLS Gen2 is optimized for big data analytics workloads.

Azure storage BLOB is suitable for storing unstructured data like images, videos, and documents.
ADLS Gen2 is designed for big data workloads and provides features like hierarchical namespace and optimized performance for analytics.
Azure storage BLOB supports hot, cool, and archive storage tiers, while ADLS Gen2 only supports hot and cool tiers.
ADLS Ge...read more

View 1 answer

Are these interview questions helpful?

Q5. Create low-level design for company employee management.

Ans.

Design a system for managing company employees.

Identify the required employee information to be stored, such as name, contact details, job title, department, etc.
Create a database schema to store employee data, including tables for employees, departments, job titles, etc.
Implement user authentication and authorization to ensure secure access to employee information.
Develop a user-friendly interface for adding, editing, and deleting employee records.
Include features for search...read more