Autoloader exclude one directory
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-27-2024 03:05 AM
Hi,
I have a bunch of csv files in directories within an azure blob container and I am using autoloader to ingest them into a raw (bronze) table, all csvs apart from one have the same schema. Is there a way to get autoloader to ignore the directory with the one csv that has a different schema to the rest of them?
Thanks
1 REPLY 1
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-04-2024 02:55 PM - edited 12-04-2024 02:56 PM
Auto Loader accept globs as input, including negative globs. You can use this to exclude a directory as long as the path is known ahead of time

