Hubert-Dudek
Databricks MVP

I checked, and your code is ok. If you set source_dir and output_filename please remember to start path with /dbfs

If you work on the community edition you can get problems with access to underlying filesystem.


My blog: https://databrickster.medium.com/