7. How can we load multiple(50)tables at a time using adf?

Question

Accepted Answer

You can load multiple tables at a time using Azure Data Factory by creating a single pipeline with multiple copy activities.

Create a pipeline in Azure Data Factory
Add multiple copy activities to the pipeline, each copy activity for loading data from one table
Configure each copy activity to load data from a different table
Run the pipeline to load data from all tables simultaneously

Accepted Answer

Step 1 : Create a metadata/control table in Sql with and store the source information like schema_name, table name ,database name etc into it 
Step 2 : Create a Adf pipeline in which first create a lookup activity which will read all the required information from above table and then pass this information to next activity.
Step 3: in next activity create one for each loop inside that for each loop create copy activity and pass all parameters to it.
So dynamically our pipeline will run all the 50 tables one by one.

Accepted Answer

Create one dynamic pipeline and set 50 triggers on same which will start on same time

Accepted Answer

Lookup activity to get the list of 50 tables. On completion, add for each activity for iteration. Inside for each acty, add copy data acty.

Check mark the batch count and set it to 50. This way we can load 50 tables at once in adf

7. How can we load multiple(50)tables at a time using adf?

Top TCS Azure Data Engineer interview questions & answers

Popular interview questions of Azure Data Engineer

Top HR questions asked in TCS Azure Data Engineer