Senior DBA and Data Engineer Interview Questions and Answers

Designing an inhouse data cataloguing tool using open source technologies

• Identify the data sources and types to be catalogued

• Choose a metadata schema and define the attributes to be captured

• Select an open source tool for metadata management, such as Apache Atlas or Metacat

• Integrate the tool with the data sources and automate metadata capture

• Implement a search and discovery interface for users to access the catalogued data

Design Azure architecture for ingesting data from on-prem SQL servers to Azure Gen 2 datalakes

• Create a virtual network to connect on-premises SQL servers to Azure

• Use Azure Data Factory to move data from on-premises SQL servers to Azure Data Lake Gen 2

• Use Azure Data Factory to schedule data ingestion jobs

• Use Azure Data Factory to transform data before ingestion

• Use Azure Data Factory to monitor data ingestion jobs

• Use Azure Data Factory to trigger alerts in case of job failures

Dualtricks software offers cutting-edge technology solutions and a collaborative work environment.

• Innovative technology solutions

• Collaborative work environment

• Opportunities for growth and learning

• Strong company culture