07-18-2023 04:34 AM
Hi @Sparktaculer
In Spark, you can disable the option globPaths. This will skip the pattern matching that happens during file reads.
spark.read.option("__globPaths__", False).format("").load("path[]")
