Sign DBFS file URLs
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-17-2023 01:49 PM
Is it possible to sign DBFS file URLs via the service principal for temporary public access?
What I actually want to do is to have integration with Databricks in my app platform. For that purpose, I need to sign DBFS file URLs from my platform (ec2) for public temporary access. I think to do it via the service principal. I have no idea whether it is possible, or is it possible via Delta Lake?
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-24-2023 05:33 AM
Signing a file is generally related to what is done by the underlying cloud storage. However, there might be better ways of doing this depending on what you want to share.
- If you want to share structured data you can save it as a Delta table in the Metastore and share it using SQL Execution API or JDBC. You can also use Delta Sharing for this which will use Signed URLs underneath.
- Another functionality for Delta Sharing is to share Notebook files between Databricks workspaces and it could expand later to include other types of files as well.
