standup1
Contributor

I think you can use REGEXP to achieve this. This might not be the best way, but it should get the job done. It's all about filtering that file in the df from getting loaded. Try something like this
df.select(“*”,”_metadata”).select(“*”,”_metadata.file_path”).filter(“file_path not REGEXP ‘/folder_name/’ “)

Make sure you change the folder name and df to yours.

You can also look into (pathGlobfilter) if the file name is static.