Databricks Community

Hi @damodhargandha, A good way to think about a shallow clone is that it copies the table’s metadata but still points to the source table's data files rather than copying them. Databricks explains that behaviour in the Clone a table " section of the ...

Hi @bi_123, I would avoid parsing the full rendered UNKNOWN_FIELD_EXCEPTION message. Databricks explicitly notes in the error-handling documentation that the rendered and parameterised messages are not stable across releases, so any logic that depend...

Hi @Albertino , how are you doing today?Thanks for calling this out. as per my understanding, at the moment, the pandas pin is there intentionally. Databricks Connect release notes say supported pandas versions are currently limited to 1.0.5<=pandas<...

Hi @anmolhhns, I couldn't find any public documentation showing that Databricks Apps supports automatic idle shutdown or usage-based scale-to-zero for the app runtime itself. The current documented lifecycle is that an app can be Running, Stopped, De...

Thanks for reading. I’m especially interested in hearing from people who have worked on real RAG or GenAI workflows.Which one has been the biggest challenge for your team?1. Choosing the right source data2. Access control and governance3. Improving r...

Hi @Jotaefe1991 ,The overlap error you are hitting is a Unity Catalog storage collision, not a DLT limitation.Here is exactly what is happening and how to fix it:The path you provided for "delta.universalFormat.compatibility.location" (abfss://.../br...

Hi,Thank you for sharing this feedback, and great to hear that you have already used BladeBridge successfully in a previous Informatica migration.I agree that a dedicated BladeBridge forum or community section would be useful, especially now that mor...

Thanks for sharing this. It looks useful, especially for iterative notebook development where the expensive part is not just reading source files but recomputing a complex intermediate DataFrame after several joins or transformations.I can see the va...

Thanks for raising this question. I recently evaluated similar options for Snowflake-to-Databricks ingestion and would like to share my perspective.From my understanding, the choice depends on whether your primary focus is performance, ease of manage...

Hi @Gaganmjain_012, I know this is a late reply, but if you are looking for the cleanest way to make a Genie Space shareable and manageable as infrastructure-as-code, the best pattern today is to keep the Genie Space configuration in GitHub and deplo...

@cdn_yyz_yul I think that reading part is where your problem lies. When reading from same pipeline produced datasets, you shouldn't use 3 level name, instead follow DLT's way.Older pipeline versions, where "target" field was used for target schema de...