Azure Data Factory for Beginners - Build Data Ingestion - Add Filter by CSV

The video tutorial guides viewers through the process of filtering CSV files from a list of metadata. It begins with setting up a filter and connecting activities, followed by creating a condition expression to identify CSV files using the 'endswith' function. The tutorial then covers testing and debugging the pipeline to ensure it functions correctly. Finally, it concludes with observing the output to confirm that only CSV files are retained, achieving the tutorial's objective.

What is the primary goal of the initial steps in the tutorial?

• To delete all files

• To add a new file type

• To filter out non-CSV files

• To rename the files

What is the purpose of connecting activities in the filter setup?

• To add new files to the list

• To delete unwanted files

• To ensure the filter is applied correctly

• To rename the filter

Which function is used to check if a file is a CSV?

• matches

• endswith

• contains

• startswith

What is the role of the 'endswith' function in the tutorial?

• To start a new process

• To check if a file name ends with '.csv'

• To delete files

• To rename files

What should be done after setting up the condition expression?

• Rename the files

• Delete the files

• Run the pipeline

• Add more file types

What is observed in the output after running the pipeline?

• New files are added

• Files are renamed

• Only CSV files are retained

• All files are deleted

What is the next step mentioned at the end of the tutorial?

• Renaming the files

• Deleting all files

• Ingesting each file to the data link

• Adding a new file type