Databricks Community

ivanvyd

I was reviewing a schema change recently and wanted a quick answer to a simple question:Could this column be used by a Genie Agent somewhere without me realizing it?There's now a pretty useful way to check I want to share with you.Databricks' March 2...

ivanvyd

I ran the same 24 coding tasks through three arms: fixed Haiku, fixed Opus and Databricks-managed selection. The managed-selection arm passed all 24 tasks. Its 24 routing records also said task profiling was unavailable.That is not a contradiction. T...

ivanvyd

Hello everyone,Databricks’ Adaptive Instructed-Retriever announcement⁠ describes a model that learns when to stop searching. How would you test whether it stops after finding a general policy but before finding the exception that changes the answer?I...

ivanvyd

Suppose a RAG application returns this:{ "response": "You can return the item within 90 days.", "citations": ["returns-policy"] }The cited document allows returns within 30 days.A citation-presence check should pass this response. A check that th...

ivanvyd

Paper event slips trace 18 Lakeflow AUTO CDC configurations: 13 stay on the main sequence while five branch into production stop signs. Change data capture (CDC) keeps a downstream table in step with row-level inserts, updates, and deletes instead of...

ivanvyd

Hey @HZ, Unity Catalog supplies the metadata, but that does not necessarily mean Redshift reads the original files. Databricks documents automatic access to compatibility versions through the Iceberg REST catalog. Could you confirm whether s3-uc appe...

ivanvyd

Adding a column and changing the history-tracking configuration need separate checks. Databricks describes adding columns as generally safe without a full refresh:"Plan your schema to avoid changes that require a full refresh. Adding columns is gener...

ivanvyd

One qualification: AWS's guide covers Delta tables exposed through UniForm, but does not explicitly confirm Compatibility Mode streaming tables or materialized views. Databricks documents their availability through Iceberg REST, so this is a route to...

ivanvyd

@HZ your understanding of Spectrum's Delta reader is correct: it requires manifests. The alternative is Redshift's Iceberg access through Glue catalog federation, which AWS documents for Unity Catalog. These are separate integration paths.For your La...

ivanvyd

Thank you, @tom_n. Could you please clarify one point against the permissions documentation?It says pay-per-token calls enforce the restrictions automatically after enablement, while provisioned-throughput endpoints require manual removal.Does the le...

Databricks Community

User Stats

User Activity

Before dropping a column, check whether Genie has been using it

Task Success is not Routing Health: a Databricks Smart Routing Case Study

How do you test whether a retriever stops too early?

Stop Asking an LLM Judge Questions Your Code Can Answer

All 18 Lakeflow AUTO CDC configurations went green. Five failed my ship check

Re: Compatibility Mode for AWS Redshift

Re: AUTO CDC FROM SNAPSHOT schema evolution in history tracking columns

Re: Compatibility Mode for AWS Redshift

Re: Compatibility Mode for AWS Redshift

Re: Feature enablement for Foundation Model Unity Catalog permissions