Serverless Cluster Issue

[Avinash_Narala]

Hi,

While using Serverless cluster I'm not able to access dbfs files, saying I don't have permission to the file.

But while accessing them using All-purpose cluster I'm able to access them.

Why am I facing this issue?

[Vidhi_Khaitan]

Hi Avinash,

This is an expected behaviour by design ->
https://docs.databricks.com/aws/en/compute/serverless/limitations#general-limitations

DBFS FUSE (i.e. file access through the local filesystem via /dbfs) is not available by design on serverless

[RobertWhite]

You might be encountering this issue due to permission differences between the serverless and all-purpose clusters. Serverless environments often have restricted access for enhanced security. Make sure the appropriate IAM roles or access controls are granted. Also, if you're looking into detailed activity tracking or system event logs like Tennessee arrest database, similar permission hierarchies could affect your data visibility there as well. 4o