Databricks Community

@Pavel_Sinkevich I tested this feature too using  Databricks CLI 0.290.0. The results confirm that referencing standalone .sql files through a native query_file property is not supported in the tested CLI version.Key findings1. query_file is not supp...

For what it's worth, I am getting the same error when I try to connect Google Analytics Raw data. I am wondering if this is perhaps a limitation of the Databricks free edition.

@johnb1 I tested this on Databricks with multiple runs to verify whether Change Data Feed (CDF) is required on source Delta tables for incremental Materialized View refresh.I created three source configurations and tested INSERT, UPDATE, and DELETE o...

Thanks @SumeshKashyap and @Jen_Evangelista , this is very helpful. Here is where we’ve landed.Table update trigger on the control table, not the dimension tables. Only dimjob1-5 write to it, so manual and ad hoc loads can’t fire factjob1, and polling...

There's no preview toggle for this, which is why you don't see it in the workspace or account previews. For an MV, Compatibility Mode is set with the two table properties Louis showed, when the MV is created. The docs only document ALTER TABLE for ma...

Hi @Aju_Antony, were you able to try the get_uc_tables_sql override in your POC? Quick way to confirm it works: run dbt run with --debug and check that no query in the log references system.information_schema.If that unblocked you, please click Accep...

Hello @ankit2604, I took a look at both internal and external documentation and here is what I found. Thanks @balajij8, @Satyasai, @Jen_Evangelista and @data_pulse for doing most of the work here. The shape they've described is right: streaming table...

Hello @harsh120, I took a look at both internal and external documentation and here is what I found. Building on @data_pulse and @Jen_Evangelista: RemoteSparkConnectScan is the key clue, and this doesn't look like MAP(), isEmpty(), or ANSI mode being...

Hello @cdn_yyz_yul, Thanksto @Jen_Evangelista for the pipeline-config versus table-property framing and to @data_pulse for the Free Edition repro. On the property question: I can't point to a doc line, but the evidence says it's expected that pipelin...

@shubham_1507 Can validate this directly in Databricks Free Edition workspace.Open Genie One and ask:“Is Genie Ontology available in this workspace?” I have tested in Free edition workspace as below, In the expanded Thinking steps, Genie invoked sear...

Hi @gowri_databrick In short, you use the bundle to define what gets deployed and where, and Lakeflow Jobs to control when it runs. (Asset Bundles are now called Declarative Automation Bundles, but the databricks bundle CLI is the same.) How bundles ...

Hi,We've helped teams work through this exact decision (Synapse dedicated pool plus Spark ingestion, Fabric-only vs keeping Databricks). A few points that usually settle it:1. Split the decision by workload, not by platform.- T-SQL warehouse workload...

Hi @bunny_9090,Steve's answer covers the widening mechanics well. There are two things we check before choosing a fix on legacy-to-Delta migrations, because they can change the root cause completely.1. Confirm what "FLOAT" means in your source engine...