Databricks Community

Hey, thanks for replying! I'm not really sure how to upgrade 'further' from what I can currently see under the 'Billing' section of my workplace, screenshot for the same is attached; your advice would be really helpful!

Worth separating "reading Iceberg from Delta" from "Databricks fully adopting Iceberg as a first-class table format" - those are two different things and Databricks has been moving on both fronts. Today: UniForm (Universal Format) makes a Delta table...

This smells like a client/server module-resolution mismatch that's specific to Databricks Connect + serverless, rather than a wheel packaging problem per se. A few things worth checking: 1. Where the StatefulProcessor class lives. Since it's defined ...

@pavannaidu I would like to reopen this issue, as I have faced similar problems (and yes I made sure to enable it properly, toggling off and saving, toggling on and saving again, etc.). For Genie Agent in Chat Mode, when going into the thinking proce...

I’d avoid doing a dbutils.fs.ls followed by one Auto Loader stream per object type. That creates more streams/checkpoints as the number of object types grows.A cleaner pattern is to use one Auto Loader stream over the directory, extract objecttype fr...

The _otel_logs and _otel_metrics tables may remain empty if your traces are stored primarily in the spans table. Check _otel_spans first and verify that the UC trace storage and permissions are configured correctly.For a new setup, use Unity Catalog ...

It sounds more like a cluster/driver initialization or resource issue than a Python problem, especially because even SELECT 1 hangs.I’d check these first:Look at the Driver logs and Event log for errors around the first notebook execution. Databricks...

@airbotsThe underlying issue is generally a metadata reconciliation lag where the Vector Search index status remains stuck displaying Syncing in Catalog Explorer even after the sync pipeline has completed. The metadata status reporting mechanism gene...

Hey, Check the IAMs for both connector and ADLS, your problem will be solved...I have come across the same issue and have cleared it by assigning a role through IAM. LMK, if you have solved it Thanks

Hello Louis,Thank you so much for the incredibly detailed and helpful answer – it was a great help. I have the following question:We have a daily job that loads data from one Databricks schema into one or more Databricks schemas using CDF.In addition...