Hi all, thanks for the help.

Unfortunately pathGlobFilter didn't improve performance for me.

I ended up working around it with some pre-processing to figure out which specific folders I actually needed, then looping through those directories with the connector and combining the results into one dataframe. Each query now runs almost instantly, so the workaround does the job. Still no real fix for the original wildcard approach though.