Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-30-2025 11:19 AM
In DBR 164.LTS, I am trying to add the following Spark config:
spark.scheduler.allocation.file: file:/Workspace/init/fairscheduler.xml
But the all purpose cluster is throwing this error
Spark error: Driver down cause: com.databricks.backend.daemon.driver.WSFSCredentialForwardingHelper$WorkspaceFilesystemException: Failed to update command details for Files in Repos. Set cluster environment variable WSFS_ENABLE=false if you do not need the feature on this cluster..
What is the location and syntax to resolve this error? Thx
Labels:
- Labels:
-
Spark