Databricks Community

bidek56

When using DBR 16.4, I am seeing a lot of Stack traces as standard error in jobs, any idea why they are showing up and how to turn then off? Thx"FlagSettingCacheMetricsTimer" id=18 state=WAITING- waiting on <0x2d1573c6> (a java.util.TaskQueue)- locke...

bidek56

In DBR 164.LTS, I am trying to add the following Spark config: spark.scheduler.allocation.file: file:/Workspace/init/fairscheduler.xmlBut the all purpose cluster is throwing this error Spark error: Driver down cause: com.databricks.backend.daemon.dri...

bidek56 · 01-06-2025

When will DB release runtime with Scala 2.13? Thx

bidek56

@mark_ott Setting WSFS_ENABLE=false does not effect anything. Thx

bidek56

@mark_ott Was this answer generated by AI? It conflicts with other docs b/c:1. dbfs is deprecated in the latest DBR versions, workspaces are recommend for storing cluster-scoped init scripts and other workspace-related files. Cluster startup fails wh...

bidek56

Kudos to the DB team for keeping up with the community, but can you please work on your product as well?We are experiencing a lot of issues with your paid product: failures, crashes, slow starts and slow performance and the list goes on. Community wo...

bidek56

Just use https://flink.apache.org

bidek56

@VikasSinha Databricks is not stable regardless of the cloud, jobs and clusters keep crashing. Use Polars or Duckdb instead.

Databricks Community

User Stats

User Activity

Stack traces as standard error in job logs

Location of spark.scheduler.allocation.file

When will DB release runtime with Scala 2.13

Re: Location of spark.scheduler.allocation.file

Re: Location of spark.scheduler.allocation.file

Re: Community Fellows: Shout Out to our Bricksters!

Re: Scaling Declarative Streaming Pipelines for CDC from On-Prem Database to Lakehouse

Re: Which is better - Azure Databricks or GCP Databricks?