Databricks Community

Malthe

We're experiencing connectivity issues between Power BI (refreshing a dataset) and Databricks.On the Databricks side, we're using a SQL Warehouse (serverless), which reports queries timing out:Query has been timed out due to inactivity.On the Power B...

Malthe · 10-17-2025

Using create_streaming_table and passing table properties as follows, I get an error running the pipeline for the first time:> Your table schema requires manually enablement of the following table feature(s): variantType-preview.I'm using this code:c...

Malthe · 09-11-2025

We've been using auto loader to ingest data from a storage account on Azure (format "cloudFiles").Today, we're starting to see failures during the setup of event notification:25/09/11 19:06:28 ERROR MicroBatchExecution: Non-interrupted exception thro...

Malthe · 08-15-2025

When defining a streaming tables using DLT (declarative pipelines), we can provide a schema which lets us define primary and foreign key constraints.However, references to self, i.e. the defining table, are not currently allowed (you get a "table not...

Malthe · 07-29-2025

We have a job running on a job cluster where sometimes the driver dies:> The spark driver has stopped unexpectedly and is restarting. Your notebook will be automatically reattached.But the metrics don't suggest an explanation for this situation.In th...

Malthe

This is the capacity in Power BI:In the timeframe where we had connectivity issues, the capacity was plenty, but also we can see how the interaction was:Queries were executed fine by Databricks, taking the normal amount of time (from query history);S...

Malthe

For reference, the issue began at 13/12/2025, 02:43 UTC, and ended (last failure) at 19:43 UTC, 17 hours later.We did nothing to alleviate the issue and the SQL Warehouse seemed to operate normally except when the issue began and concluded when there...

Malthe · 10-27-2025

Just wanted to mention that the ETL from Lakebase to Delta Tables preview is mentioned here:https://www.databricks.com/blog/how-use-lakebase-transactional-data-layer-databricks-apps

Malthe · 10-17-2025

There's a workaround available in most situations which is to first create the table without the VARIANT column, run the pipeline at least once, and then add the column in a subsequent refresh.

Malthe · 10-17-2025

Here's a self-contained example in SQL that demonstrates the issue:CREATE TEMPORARY VIEW dummy_kafka AS SELECT 'id' AS id, 'topic' AS topic, current_timestamp() AS timestamp, 1::INTEGER AS partition, 1::long AS offset, parse_json('{}') AS bo...

Databricks Community

User Stats

User Activity

Intermittent connectivity issues between Power BI and Databricks

Can't enable "variantType-preview" using DLTs

Intermittent failures with auto loader on Azure

Self-referential foreign key constraint for streaming tables

Driver terminated abnormally due to FORCE_KILL

Re: Intermittent connectivity issues between Power BI and Databricks

Re: Intermittent connectivity issues between Power BI and Databricks

Re: Syncing lakebase table to delta table

Re: Can't enable "variantType-preview" using DLTs

Re: Can't enable "variantType-preview" using DLTs