Will auto loader read files if it doesn't need to?
I want to run auto loader on some very large json files. I don't actually care about the data inside the files, just the file paths of the blobs. If I do something like``` spark.readStream .format("cloudFiles") .option("cloudFiles.fo...
- 23 Views
- 0 replies
- 0 kudos