Databricks Community

Thanks. I reached mainly the same conclusion looking at it a few days ago. I wonder if databricks is going to update serverless runtime versions regarding affected packages and python versions. That would be my preferred solution and make everyone sa...

Hi @Khasim_1,It looks like the template placeholders made it into the post, so I'm not sure exactly where you're stuck. In case it helps, here's a minimal Streamlit app that reads a Unity Catalog table through a SQL warehouse. That covers the three t...

Hi @capoorhimanshu,Your worry about the closure is fair. A secret that rides inside the serialized task is harder to control than one that never leaves a secret store.As far as I can tell, there's no supported setting on standard access mode that pus...

Hi @dbernstein_tp,Good to hear the MERGE is only touching a few thousand rows now. That's the part that matters for Direct Lake. On the job vs manual timing, the same code running at very different speeds almost always means it isn't running on the s...

Hi @suryaprayaga,Good question, and it's a nice change from the usual "how do I" threads. Here are the use cases that come up most often, plus a simple way to put numbers on it.Common use casesInvoices, receipts and purchase orders. Parse with ai_par...

For a more realistic TCO estimate, I’d suggest building a model around data ingestion, daily growth, pipeline complexity, DBU consumption, storage, and expected query workloads. It may also help to create low, medium, and high usage scenarios so stak...

One thing I'd add to the list is identity, because it decides whether the governance point actually holds. By default an app runs as its own service principal, and every user of the app shares whatever that principal can see. Unity Catalog row filter...

Worth knowing before anyone builds on it: the docs now mark the earlier managed memory store as deprecated and point new agents at the newer agent memory plus agent sessions, which Databricks runs on Lakebase for you. The self-managed Lakebase route ...

Hi @margarita_shir,I don't think this follow-up got an answer, so jumping back in. Yes, keep the Tailscale split DNS on cloud.databricks.com pointing at your VPC resolver.Here's why switching it to privatelink.cloud.databricks.com breaks things. Tail...

Hi @vkondepati,Quick follow-up on my view above, because data_pulse's tests made me double-check one line and it needs a fix.CAST(created_at AS TIMESTAMP_NTZ) is evaluated in the session time zone of whoever queries the view. The Databricks docs say ...