Databricks Community

Malthe

Using read_files to read Avro-formatted blobs from an external location, I get the error:> Malformed records are detected in record parsing: Event 0. Parse Mode: FAILFAST. To process malformed records as null result, try setting the option 'mode' as ...

Malthe · 07-02-2026

We're running an optimize on a delta table with a VARIANT column that has a NOT NULL constraint.Now, there are no NULL entries in this column. And yet, OPTIMIZE gives this error:[DELTA_NOT_NULL_CONSTRAINT_VIOLATED] NOT NULL constraint violated for co...

Malthe · 03-25-2026

The Databricks UI sends thousands of repeated queries on the form:/ajax-api/2.0/jobs/get?include_acls=true&job_id=<redacted>Getting a 429 Too Many Requests response. It seems to rotate on a list of job ids.It just keeps trying ...

Malthe · 03-23-2026

Every now and then, we get the following error in job cluster runs (when opening a workspace file):OSError: [Errno 5] Input/output error: '/Workspace/Users/<uuid>/.bundle/<path>'This happens even though the Python notebook (which is also in workspace...

Malthe · 03-11-2026

Using the Observable API on the source dataframe to a Delta Table merge seems to hang indefinitely.Steps to reproduce:Create one or more pyspark.sql.Observation objects.Use DataFrame.observe on the merge source.Run merge.Accessing Observation.get blo...

Malthe · 07-02-2026

So funny story on this: the column in question does not match on "col is null", but it does match on "col::string is null".Perhaps because in the Parquet-file which corresponds to the rows that have the problem, that column is entirely missing.Still,...

Malthe · 06-29-2026

When might this limitation be lifted? Is it due to security concerns that serverless doesn't support this?

Malthe · 06-03-2026

The article on Medium includes a diagram that involves Azure Application Gateway, but Databricks' own documentation seems to suggest a quite different setup:https://learn.microsoft.com/en-us/azure/databricks/admin/account-settings/custom-urlAlso, it'...

Malthe · 03-25-2026

Just notify your engineers, they'll know how to handle this and won't need more information. It's a no-brainer to fix this.

Malthe · 03-25-2026

It's an error in the Databricks UI. If it hits a 429, it just keeps going, which means it'll keep going over the limit ... that's my best guest.To fix this, first make sure your UI doesn't repeatedly ask for a resource that previously returned a 429....

Databricks Community

User Stats

User Activity

Skipping malformed records when reading Avro-files

NOT NULL constraint violated for column during OPTIMIZE

429 XHR requests against jobs endpoint (RESOURCE_EXHAUSTED)

Intermittent OSError: [Errno 5] Input/output error accessing workspace files from job

Observable API and Delta Table merge

Re: NOT NULL constraint violated for column during OPTIMIZE

Re: Databricks Connect: Enabling Arrow on Serverless Compute

Re: How to enable a custom URL in Azure Databricks?

Re: 429 XHR requests against jobs endpoint (RESOURCE_EXHAUSTED)

Re: 429 XHR requests against jobs endpoint (RESOURCE_EXHAUSTED)