Databricks Community

Hi @souravroy1990 ,This syntax is just unsupported. Using ALTER VIEW you can set tag for an entire view:If you need to set tag on a column you've already found a proper way which is to use SET TAG command:SET TAG - Azure Databricks - Databricks SQL |...

@fintech_latency  For streaming: refactor to one long‑running Structured Streaming job with a short trigger interval (for example, 1s) and move “assignment” logic into foreachBatch or a transactional task table updated within the micro‑batch. For per...

Hello @RIDBX , I’m not surprised that some of the actions you’re seeing through Vocareum don’t work in the Free Edition. When our training is developed, parts of it are intentionally tied to Vocareum APIs to support specific tasks and workflows. Beca...

Hi @sebih ,Automatic liquid clustering might not select keys for the following reasons: - The table is too small to benefit from liquid clustering.- You can apply automatic liquid clustering for all Unity Catalog managed tables, regardless of data an...

Hi @Dhruv-22,It's actually not a bug. Let me explain what's happening.The Root CauseThe issue stems from how schema evolution works with Delta Lake's MERGE statement, combined with Spark SQL's case-insensitivity settings.Here's the key insight: spark...

@JothyGanesan Use dynamic schema handling and selective table updates to apply metadata changes incrementally from the current watermark, preserving history across country go-lives.Replace static @dlt.table definitions with Auto Loader's schema infer...

The correct solution is not SQL based.Delta tables are defined by the contents of the delta log directory, not by CREATE TABLE statements. That is why SHOW CREATE TABLE cannot reconstruct partitions, properties or constraints.The only reliable migrat...

Hi @hnnhhnnh DLT streaming tables that use apply changes do not support widening the data type of key columns such as changing an integer to a bigint after the table is created. Even though Delta and Unity Catalog support type widening in general, DL...

Greetings @jpassaro ,  Thanks for laying out the context and the links. Let me clarify what’s actually happening here and how I’d recommend moving forward. Short answer No. On Databricks Runtime, the spark.databricks.delta.vacuum.parallelDelete.enabl...

i updated my CLI and deployed the job, still i dont see the clusters updates in  pipeline

Possible reasons:1. Setting spot_bid_max_price = -1 is not accepted by Azure poolsAzure Databricks only accepts:0 → on-demand onlypositive numbers → max spot price-1 is allowed in cluster policies, but not inside pools, so validation never completes....