Use Workspace files (500 MB file limit) and create the file under the SP’s home while running as the SP identity, ensuring association with the SP. 

Docs on workspace files: https://docs.databricks.com/aws/en/files/workspace