Serverless Cluster Issue
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-16-2024 11:31 PM
Hi,
While using Serverless cluster I'm not able to access dbfs files, saying I don't have permission to the file.
But while accessing them using All-purpose cluster I'm able to access them.
Why am I facing this issue?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
05-13-2025 03:57 AM
Hi Avinash,
This is an expected behaviour by design ->
https://docs.databricks.com/aws/en/compute/serverless/limitations#general-limitations
DBFS FUSE (i.e. file access through the local filesystem via /dbfs) is not available by design on serverless
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
05-13-2025 05:05 AM
You might be encountering this issue due to permission differences between the serverless and all-purpose clusters. Serverless environments often have restricted access for enhanced security. Make sure the appropriate IAM roles or access controls are granted. Also, if you're looking into detailed activity tracking or system event logs like Tennessee arrest database, similar permission hierarchies could affect your data visibility there as well. 4o
