![]() If the “if condition” is “Yes”, a flag (boolean variable) is set to “True” which will trigger the ETL.If the result of the “if condition ” is “Yes”, we proceed to copy the files from the FTP Server to the Blob Storage, if “No”, we do not copy the files.The following activity is an “if condition” which checks if the date that is on Last Modified accounts to the previous day.Once we get the name of each file, we run a ForLoop in which we check for each of the files when it was last modified.The first step on our Pipeline is a Get Metadata activity that will give us the required information from the data sources.In our example we use the Azure Blob Storage service, that will act as a Data Lake, to store the raw data. ![]() ![]()
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |