Databricks Community

szymon_dybczak

For years, there was no simple way to disable a single task in a Databricks workflow. Let that sink in  If you wanted to skip a task, you had to get creative - Add custom flags - Wrap logic in if/else blocks - Or build your own workaround just to no...

szymon_dybczak

Big shift coming for Azure Databricks usersStarting 30 September 2026, all new Azure Databricks workspaces will be Unity Catalog only.- No DBFS root.- No Hive Metastore.- No legacy runtimes below 13.3 LTS.- No “old way” of doing things.Disabling DBFS...

szymon_dybczak

Ever deleted a pipeline… and accidentally wiped out the data with it? Databricks just introduced a beta feature that lets you decouple pipelines from the tables they manage.Lakeflow Spark Declarative Pipelines were desinged with data-as-code approach...

szymon_dybczak

If you’ve ever worked with scheduled refreshes for Materialized Views or Streaming Tables, you probably know this pain. If your DDL-scheduled MV or ST refresh failed, nothing happened. No email, no alert, no indication that your data was stale (until...

Top Solution Authors Leaderboard missing · 02-20-2026

Hi,What happened to the Top Solution Authors Leaderboard? It has disappeared from the homepage. The results from the last week/month/year are also unavailable.Now, they only available results are available here:Top Solution Authors Leaderboard - Data...

szymon_dybczak

Hi, 1. As docs says: "Predictive optimization is enabled by default for accounts created on or after November 11, 2024. Databricks began enabling existing accounts on May 7, 2025. This rollout is gradual and is expected to complete by April 2026. "So...

szymon_dybczak

Hi @FantineM ,Check if that table has predictive optimization enabled. If that's the case than probably that's a root cause. Predictive optimization will run VACCUM automatically.Predictive optimization for Unity Catalog managed tables - Azure Databr...

szymon_dybczak

Hi @Steve_Lyle_BPCS ,It measures your profile completness. For example if you add something to your profile, i.e biography, image, linkedin profile your overall score should increaseIf my answer was helpful, please consider marking it as accepted sol...

szymon_dybczak

Hi @Subhas1729 ,Default location for data assets section of the pipeline configuration UI sets the default catalog and schema for a pipeline. This default catalog and schema are used for all dataset definitions and table reads, unless overridden with...

szymon_dybczak

Hi @MikeGo ,Short answer: no, you cannot select the LLM for a native Genie Space - the model is managed entirely by Databricks.Genie uses a compound AI system to interpret business questions and generate answers. Instead of using a single large lang...

Databricks Community

User Stats

User Activity

Finally! Databricks lets you disable tasks without hacks

Unity Catalog-only workspace for new Azure Databricks deployments

Lakeflow Spark Declarative Pipelines now decouples pipeline and tables lifecycle

Notifications for scheduled refreshes - now in Beta

Top Solution Authors Leaderboard missing

Re: Vector index not syncing: DELTA_UNSUPPORTED_TIME_TRAVEL_BEYOND_DELETED_FILE_RETENTION_DURATION

Re: Vector index not syncing: DELTA_UNSUPPORTED_TIME_TRAVEL_BEYOND_DELETED_FILE_RETENTION_DURATION

Re: What does 50% even mean?

Re: how to access the catalog and schema from my program

Re: Genie space model selection