Databricks Community

For a more realistic TCO estimate, I’d suggest building a model around data ingestion, daily growth, pipeline complexity, DBU consumption, storage, and expected query workloads. It may also help to create low, medium, and high usage scenarios so stak...

One thing I'd add to the list is identity, because it decides whether the governance point actually holds. By default an app runs as its own service principal, and every user of the app shares whatever that principal can see. Unity Catalog row filter...

Worth knowing before anyone builds on it: the docs now mark the earlier managed memory store as deprecated and point new agents at the newer agent memory plus agent sessions, which Databricks runs on Lakebase for you. The self-managed Lakebase route ...

Hi @margarita_shir,I don't think this follow-up got an answer, so jumping back in. Yes, keep the Tailscale split DNS on cloud.databricks.com pointing at your VPC resolver.Here's why switching it to privatelink.cloud.databricks.com breaks things. Tail...

Hi @vkondepati,Quick follow-up on my view above, because data_pulse's tests made me double-check one line and it needs a fix.CAST(created_at AS TIMESTAMP_NTZ) is evaluated in the session time zone of whoever queries the view. The Databricks docs say ...

Hi @Aviral-Bhardwaj  - From your sample it looks like the values are losing everything past the 2nd decimal place (e.g. 24.5638 → 24.56 / 24.57), which usually points to the scale of the target column or a cast in the pipeline, not a Databricks displ...

Easiest would be to use SAP BDC

Hi @ShivaPolusani  - NOT sure whether you got your answer already or NOT....... but generally I followed the below steps for this activity - Path A: workspace with an account console (paid or trial)In the Databricks account console, go to Settings > ...

Thanks for the write-up @suranga. I investigated this using managed UC volumes in Databricks. I couldn't reproduce a non-ASCII filename issue, but the tests surfaced a few other ways documents can appear processed successfully while retrieval returns...

@johnb1  Thanks for running these additional tests and the efforts. The results help narrow down the issue considerably.current_date() wasn’t the cause: Removing it eliminated PLAN_NOT_DETERMINISTIC, but the refresh still took 199 minutes. So, while ...

Hi @anshul2528   I saw your reply in another query regarding the 50% voucher question. I also did not receive it till now. I finished the Data Engineering Pathway. Could you kindly look into it and make sure that I get the voucher as soon as possible...

@yanchr I validated this using Lakeflow Jobs Dashboard tasks, the Jobs REST API and the Databricks Terraform provider. Here are the options I have tried and the findings:1: Lakeflow Jobs Dashboard task (simplest approach)Option A : Configure through ...