Databricks Community

suranga

I tested whether a Genie agent picks up a business rule from a Unity Catalog wiki (Beta). Short answer: not today. A Genie agent works from the data, the table and column comments, and the context you configure in the agent. Here's the test and what ...

suranga

I tested Unity Catalog secrets in my own Azure Databricks sandbox (serverless, environment version 6) to see what each privilege actually lets a service principal do. Most of it matches the docs. One thing doesn't: READ SECRET can't be granted on a s...

suranga

Hi all,I tried the new Unity Catalog wikis (Beta) in my own Azure Databricks sandbox, with the public TPC-H sample data. The banner in Catalog Explorer calls the wiki rich documentation "for your team and agents", so I wanted to see if a Genie agent ...

suranga

Hi,I've been testing Unity Catalog secrets in my own sandbox workspace (Azure Databricks, serverless, environment version 6). READ SECRET can't be granted on a schema there, even though the docs say it can.What I ranGRANT READ SECRET ON SCHEMA secret...

suranga

Why TetrisI wanted to know if one Databricks function can play Tetris, and what Unity Gateway sees when an AI agent hammers it move after move.It started with the ai_decide announcement by Jane Zhang, Matthew Ding and Archika Dogra. Their demo is Sna...

suranga

Hi @Jack17,One small addition to the service principal advice above, because it makes testing a lot easier. Since 12 November, OAuth on-behalf-of for service principals is generally available, so you can test the Data API locally as the same service ...

suranga

Hi @AlexMorgan,Mateus covered the checks really well, so I'll just add how I'd answer the PySpark tests vs expectations part, because the two do different jobs:Tests check your code. Unit-test the transformation logic in CI on small, hand-made DataFr...

suranga

Hi @AdnanFaridKhan,Really nice write-up, and @rachelwilson's question is the one I'd worry about too. With tag-driven policies, a tag that never arrives fails open: the table simply shows every row.What I'd add to the sync job is a fail-closed step. ...

suranga

Hi Kiran,That's a really thorough round of checks. A flat heap floor, flat RocksDB and a small state store rule out the usual suspects, which narrows things down a lot.The one thing I'd grab next is the exact OutOfMemoryError line from the driver log...

suranga

Thanks @harissonG, glad it was useful.The revenue question was the one that convinced me too. By the wiki's rule the 1998 answer is 0, and Genie confidently returned the total of every order instead, with nothing to say it had ignored a rule. Until G...

Databricks Community

User Stats

User Activity

Genie agents and Unity Catalog wikis: what I tested, and what to use instead

Unity Catalog secrets: what each grant does, and the schema-level READ SECRET that fails

Do Genie agents use Unity Catalog wikis as context?

Unity Catalog secrets: GRANT READ SECRET ON SCHEMA fails with PRIVILEGE_NOT_APPLICABLE_TO_ENTITY

I Built Tetris in One Databricks Function, Then Let ai_decide and LLMs Play It

Re: Lakebase Data API

Re: How do you test data quality in a Delta Lake pipeline?

Re: Masking Columns for a Client Workspace When You Can’t Use Catalog Binding

Re: Memory Profiling

Re: Genie agents and Unity Catalog wikis: what I tested, and what to use instead