Databricks Community

Malthe

We're running an optimize on a delta table with a VARIANT column that has a NOT NULL constraint.Now, there are no NULL entries in this column. And yet, OPTIMIZE gives this error:[DELTA_NOT_NULL_CONSTRAINT_VIOLATED] NOT NULL constraint violated for co...

Malthe · 03-25-2026

The Databricks UI sends thousands of repeated queries on the form:/ajax-api/2.0/jobs/get?include_acls=true&job_id=<redacted>Getting a 429 Too Many Requests response. It seems to rotate on a list of job ids.It just keeps trying ...

Malthe · 03-23-2026

Every now and then, we get the following error in job cluster runs (when opening a workspace file):OSError: [Errno 5] Input/output error: '/Workspace/Users/<uuid>/.bundle/<path>'This happens even though the Python notebook (which is also in workspace...

Malthe · 03-11-2026

Using the Observable API on the source dataframe to a Delta Table merge seems to hang indefinitely.Steps to reproduce:Create one or more pyspark.sql.Observation objects.Use DataFrame.observe on the merge source.Run merge.Accessing Observation.get blo...

Malthe · 03-06-2026

The following serverless query has an aggregated task time of 1.94h, but each of the two executions runs in an aggregated time of just a few minutes.How is one supposed to make sense of that?

Malthe

So funny story on this: the column in question does not match on "col is null", but it does match on "col::string is null".Perhaps because in the Parquet-file which corresponds to the rows that have the problem, that column is entirely missing.Still,...

Malthe

When might this limitation be lifted? Is it due to security concerns that serverless doesn't support this?

Malthe · 06-03-2026

The article on Medium includes a diagram that involves Azure Application Gateway, but Databricks' own documentation seems to suggest a quite different setup:https://learn.microsoft.com/en-us/azure/databricks/admin/account-settings/custom-urlAlso, it'...

Malthe · 03-25-2026

Just notify your engineers, they'll know how to handle this and won't need more information. It's a no-brainer to fix this.

Malthe · 03-25-2026

It's an error in the Databricks UI. If it hits a 429, it just keeps going, which means it'll keep going over the limit ... that's my best guest.To fix this, first make sure your UI doesn't repeatedly ask for a resource that previously returned a 429....

Databricks Community

User Stats

User Activity

NOT NULL constraint violated for column during OPTIMIZE

429 XHR requests against jobs endpoint (RESOURCE_EXHAUSTED)

Intermittent OSError: [Errno 5] Input/output error accessing workspace files from job

Observable API and Delta Table merge

Aggregated task time not accounted for in executions

Re: NOT NULL constraint violated for column during OPTIMIZE

Re: Databricks Connect: Enabling Arrow on Serverless Compute

Re: How to enable a custom URL in Azure Databricks?

Re: 429 XHR requests against jobs endpoint (RESOURCE_EXHAUSTED)

Re: 429 XHR requests against jobs endpoint (RESOURCE_EXHAUSTED)