rss.livelink.posts-in-node

Feature enablement for Foundation Model Unity Catalog permissions

broccobroccolis — Tue, 15 Sep 2026 03:43:09 GMT

I am trying to restrict workspace users' access to Databricks Foundation Models using the guidance in the Foundation Model Unity Catalog Permissions documentation.

I have revoked EXECUTE permission for all users from the system.ai schema. However, workspace users can still successfully query foundation models via ai_query() using the databricks-* serving endpoint names:

-- This SUCCEEDS (should be blocked)
SELECT ai_query("databricks-claude-sonnet-4-5", "whats 1+1?") AS response

-- This FAILS with RESOURCE_DOES_NOT_EXIST
SELECT ai_query("system.ai.claude-sonnet-4-5", "whats 1+1?") AS response

The system.ai.* path returns a RESOURCE_DOES_NOT_EXIST error (which I assume is expected) after revoking EXECUTE. However, calling the same model via the databricks-* endpoint name bypasses the UC permission check entirely.

The documentation states: "Foundation model Unity Catalog permissions is generally available but requires enablement. Reach out to your Databricks account team to enable this feature."

What is the Foundation Model Unity Catalog Permissions feature called in Account Previews and how can it be enabled? So that the EXECUTE revoke on system.ai is enforced consistently across all access paths — including pay-per-token databricks-* endpoints called via ai_query().

Side question: does serverless compute bypass Unity Catalog permissions?

Re: Dark mode setting ignored when embedding BI dashboard inside Databricks App

chie_789 — Tue, 15 Sep 2026 00:13:00 GMT

Hi @DB-RKL

Yes I have followed the example in the AIBI client docs.
I have verified that the colour scheme will render in dark mode just fine when running my app (Nuxt.js framework) in a local server, but when running it inside a Databricks App server the colour scheme will not render in dark mode.

Re: Need Databricks Machine Learning Associate Practice Questions

tom-smith — Mon, 14 Sep 2026 20:36:54 GMT

I pass my exam last month. I use Pass4itexam

Re: AI/BI Dashboards

Ashwin_DSA — Mon, 14 Sep 2026 20:00:46 GMT

Hi @km1837,

Databricks AI/BI Dashboards have solid theming and organisational capabilities that should cover most of what you are used to in Power BI.

AI/BI Dashboards don't have a "template file" concept the way Power BI does with .pbit files, but you can achieve the same consistency through two features (Workspace themes and Text widgets with images) working together.

Workspace Themes are the closest equivalent to a Power BI template for branding. A workspace admin can define a default theme that controls fonts (family, colour, size, weight, and case per text category), canvas background colour, widget styling (background, border, corner radius, padding, margin, shadow), visualisation colours (axis, grid lines, categorical and continuous colour palettes), and textbox alignment. Every new dashboard in the workspace automatically inherits this theme, so once it's set up, your team gets consistent branding without any extra effort. You configure it under Settings > Appearance > AI/BI > Theme. See the example below.

Text widgets with images handle the header/banner part of your Power BI template. You can drag a text widget onto the canvas and use the formatting toolbar or raw markdown to add your company logo (via image URL or path), styled header text, links, and tables. This gives you the equivalent of a branded header on each page.

For a practical "template" workflow, I'd suggest: set up the workspace theme for your brand colors and fonts, then build one dashboard with your standard header layout, page structure, and any boilerplate text widgets. Export it as a .lvdash.json file (kebab menu > File actions > Export), and use that as your starting point for new dashboards by importing it and swapping out the data. You can even edit the JSON directly for bulk changes.

With regard to your question about organising by departments, You don't need separate workspaces for Operations, Finance, and Sales. Within a single workspace, you can organise dashboards into folders in the workspace browser, just like you would with any file system. Create a folder structure like /Dashboards/Operations, /Dashboards/Finance, /Dashboards/Sales and manage access through folder-level permissions.

If your organisation does want stronger isolation (separate compute, separate access controls at the workspace level), you can use multiple workspaces and transfer dashboards between them using the export/import workflow or the Workspace API. But for most BI teams serving multiple departments, folders with permissions within a single workspace are simpler and easier to manage.

By the way...you can now import .pbit(Power BI template) files directly into Genie Code, and it will build an AI/BI dashboard that replicates your visualisations. It also creates metric views that mirror the underlying business logic and detects relationships from the source file. This is a great option for migrating existing reports, but there are a couple of things worth noting for your scenario. The import focuses on recreating the data model and visualisations, not the branding layer (headers, logos, colour themes). So even after importing, you'd still want to set up a workspace theme and add your branded text widgets. It also requires partner-powered AI features to be enabled on both the account and workspace.

The workflow is straightforward: go to Dashboards > Create > Import from Power BI, attach the .pbit file, and Genie Code builds the dashboard.

You can also use the /importBI command within Genie Code if the file is stored in a Unity Catalog volume.

Hope this helps.

If this answer resolves your question, could you mark it as “Accept as Solution”? That helps other users quickly find the correct fix.

Re: External embedding for reports using federated credentials fails

iamgoce — Mon, 14 Sep 2026 19:43:45 GMT

Databricks still hasn't committed to addressing this issue.

The only workaround is to get enrolled in the private preview for Dashboard Embedding with SSO (Embed with SSO Preview User Guide - Google Docs). This only works if you're already authorizing users with the same IdP SSO (e.g., Entra ID) and the users have the adequate access to the workspace, dashboard and SQL warehouse.

But for embedding dashboards for public consumption (non-Databricks users), the above won't work. One has to use a SP with a client secret.

Re: How does AUTO CDC resolve same-timestamp tie in SEQUENCE BY?

ivanvyd — Mon, 14 Sep 2026 18:30:01 GMT

@Khasim_1 on your third question, check delete-tombstone retention alongside the sequencing change. The default is two days. The create_auto_cdc_flow reference gives this instruction:

Set pipelines.cdc.tombstoneGCThresholdInSeconds to a value that exceeds the maximum expected delay between event arrival and pipeline execution.

This is a target table property. I’d include outage recovery and replay backlogs when estimating that delay, not just normal processing time.

The AUTO CDC examples show the relevant behavior for userId = 123:

Event	sequenceNum
Initial insert	1
Delete	6
Update arriving out of order	5

With delete handling configured, the documented results are:

SCD1: user 123 remains absent.
SCD2: the history contains versions with __START_AT / __END_AT values of 1 / 5 and 5 / 6. Neither is active, so the earlier update does not undo the later delete.

That example demonstrates event ordering, not what happens after tombstone expiry. For your pipeline, I'd test the same sequence across separate batches within the configured retention window. This checks late-arrival handling alongside the tie-breaking fix.

Re: Non-deterministic ROW_NUMBER() results across Unity Catalog environments

ivanvyd — Mon, 14 Sep 2026 17:59:08 GMT

@Khasim_1 another option for calculating the most frequent name is mode(customer_parent_name, true). The second argument requests deterministic tie handling and is supported in Databricks SQL and DBR 14.1+.

SELECT duns_number, mode(customer_parent_name, true) AS customer_parent_name FROM your_source_table GROUP BY duns_number;

Use your actual table and key names, keeping the same filters as your existing calculation. Run this against the original rows, before the frequency aggregation. Otherwise, each name would count once rather than by its original frequency.

Two details to check before switching: mode ignores nulls, and the documentation warns that some string collations, including UTF8_LCASE, can still produce nondeterministic results with true. I would keep the explicit window ordering if tied names need a particular business rule.

Re: How does AUTO CDC resolve same-timestamp tie in SEQUENCE BY?

data_pulse — Mon, 14 Sep 2026 16:00:26 GMT

@Khasim_1

I tested this with a small AUTO CDC pipeline and SEQUENCE BY STRUCT() works as expected for same-timestamp ties.

Eg: In below data

Event_ts seq_id operation 12:00 seq=1 INSERT 12:10 seq=1 UPDATE 12:10 seq=2 DELETE

with sequence_by=struct("event_ts", "seq_id"), the second field is used as the tie-breaker, so (12:10, 2) is considered later than (12:10, 1).

In my test with SCD Type 1, the final target row was removed because the latest logical event was the DELETE. The source CDC table still retained all events, the target represented only the latest state.

Summary:

Out-of-order arrival -> AUTO CDC handles this through SEQUENCE BY.
Same timestamp ties -> use STRUCT(timestamp, secondary_sequence).
No reliable secondary sequence from source -> add a pre-processing step: staging/dedup before AUTO CDC.

I’d also avoid assuming that AUTO CDC gives DELETE or UPDATE any priority when their sequence values are identical. Use an explicit tie-breaker so the event order is deterministic.

Re: Certification Coupons

Kavipriya25 — Mon, 14 Sep 2026 15:46:21 GMT

HI @Advika ,
TO REGISTER FOR THE 50% DISCOUNT SHOULD I CHECK WHETHER ITS COMMUNITY LOGIN/ACADEMY LOGIN
IF YES PLS TELL ME HOW TO FIND IN OUR PROFILE THANK YOU VERY MUCH
KINDLY DO REPLY
REGARDS,
KAVI

Re: How do you test whether a retriever stops too early?

ivanvyd — Mon, 14 Sep 2026 15:39:18 GMT

Thanks for taking the time, @DoTA. Have you tried paired questions against the same corpus, where the general policy is sufficient for one but an exception changes the answer to the other? I'd be interested in whether the retriever finds the exception when needed without adding unnecessary search steps to the simpler case 🤔

Re: How does AUTO CDC resolve same-timestamp tie in SEQUENCE BY?

Brahmareddy — Mon, 14 Sep 2026 13:50:38 GMT

Hi @Khasim_1, I would suggest not relying only on the timestamp if duplicate timestamps are possible. AUTO CDC can handle out-of-order events using SEQUENCE BY, but the sequencing should be deterministic.

You could try SEQUENCE BY STRUCT(event_timestamp, event_sequence_id) so the second field acts as a tie-breaker. If the source does not provide a reliable sequence or event ID, a small Bronze staging step to resolve those conflicts before AUTO CDC may be safer.

Hope this helps!

Regards,
Brahma

Re: Databricks Certified Professional Data Scientist Exam Question Types

elifjulia27 — Mon, 14 Sep 2026 13:39:32 GMT

Thanks! I recently passed my exam with 93%. I really struggled to find good preparation resources, but I found authentic practice tests Certs-topic It worked so well for me.

Re: Auto Loader stream fails on RocksDB checkpoint after enabling managed file events

data_pulse — Mon, 14 Sep 2026 13:33:22 GMT

After further investigation into it, have understood the root cause and the fix for it.

After enabling Auto Loader managed file events across the platform:

.option("cloudFiles.useManagedFileEvents", "true")

the failed stream started discovering RocksDB checkpoint artifacts such as .zip and .log files because checkpointLocation was nested inside the monitored source path. Auto Loader then attempted to deserialize those files using the configured source format, causing FAILED_READ_FILE.NO_HINT on the rocksdb zip.

Root cause: the ingestion path contained both source data and Structured Streaming checkpoint files without file-level filtering.

Fix: Use the appropriate glob for each format such as *.parquet/ *.json/ *.csv in pathGlobalFilter.

reader_options = { "cloudFiles.useManagedFileEvents": "true", "pathGlobFilter": "*.parquet", }

That did the trick and resolved the issue. It would also be preferrable to place checkpointLocation and cloudFiles.schemaLocation outside the monitored source directory to prevent checkpoint self-ingestion entirely.

So, good lessons learnt.

Re: Subject: Possible incorrect answer key — Evaluating AI Agents assessment (Generative AI Engineer

Brahmareddy — Mon, 14 Sep 2026 13:29:18 GMT

Hi @amittian, Good catch. Your answer looks more aligned with the idea of continuous evaluation, especially since user behavior can change and new issues can appear in production.

The Unity Catalog option seems unrelated to the question. I would suggest the course team review the answer key and update it if needed. Thanks for sharing this with the community.

Re: Follow-up Regarding Missing 50% Certification Voucher – Learning Festival

TyreseR19 — Mon, 14 Sep 2026 13:23:29 GMT

Dear Databricks Team (Advika and @Jim_Anderson (https://community.databricks.com/t5/user/viewprofilepage/user-id/34469) ,

I am writing to follow up once again regarding the 50% certification voucher associated with the Databricks Learning Festival (15 June – 6 July 2026).

I want to confirm that I have definitely completed all requirements for the Data Analyst learning pathway within the event window, including both courses:

AI/BI for Data Analysts
SQL Analytics on Databricks

Every component, including introductions and SCORM sections, was marked as completed before the 6 July deadline. For your convenience, I have attached the official completion evidence again to this message.

Given that the advertised criteria have been fully met, I respectfully request that the 50% discount voucher be awarded to me with urgency. I intend to sit for the Data Analyst Associate Certification exam by 19 September 2026, and this voucher is critical as I have also been offered a potential junior employment opportunity contingent on certification.

I trust that Databricks will uphold the integrity of the Learning Festival commitments and ensure that participants who followed through on the requirements receive the promised incentives.

Thank you for your prompt attention to this matter. I look forward to your confirmation and the issuance of the voucher without further delay.

KINDLY SEE THE ATTACHED WITH REFERENCE TO YOUR QUESTIONS CONCERNING ALL SECTIONS COMPLETED INCLUDING SCORM

Kind regards,

Tyrese Roberts

Email: tyreser@trinityandbennettconsulting.co.za

Re: CSV export from AI/BI Dashboard table widget does not preserve visual column order

tom_n — Mon, 14 Sep 2026 13:09:32 GMT

I built a copy of your setup on a current workspace and couldn't get it to fail, which is itself a useful clue.

I matched it fairly closely: a plain table, several SUM measures with custom display names, a date column via DATE_TRUNC, columns dragged so the display shows dimensions first, and around 170,000 rows so the download goes through the large server-side export rather than the in-browser one. The generated visualisation query listed the aggregates first, same as yours. The exported CSV still came out in the display order, dimensions first, not aggregates first. I only moved a column using the UI and that still came out in the correct order.

NB: the custom Display name is not showing up in Visualization query - this is the same for me.

So on a current build the export lines up with the on-screen order even in your exact shape. That points to this being specific to your build or region rather than table exports in general, and it may already be fixed on a newer build.

A few things that would help pin it down:

1. Run the same export but filtered to well under ~64,000 rows, everything else identical. Does the smaller file come out in the right order (dimensions first), or still aggregates first? And does the small one download instantly while the 170k one shows a "preparing" step? That tells us whether it's tied to the large export path specifically.
2. Does the same reordering happen in Excel and TSV, or only CSV?
3. If you set the column order in the query itself so the dimensions come first, rather than only dragging them in the view, does the export then line up? That also works as a stopgap if it does.

Re: Broken x-axis sort order in combo chart

treesloth — Mon, 14 Sep 2026 13:06:24 GMT

Thank you. I appreciate the detailed response. I'd already done the second option as what I hoped would be a temporary workaround. Sadly, the categories are far from stable, and orders can switch (although that's not quite as common). But, at least now I know I'm not crazy (or, at least, that this is not what proves it). Thank you.

Re: Dark mode setting ignored when embedding BI dashboard inside Databricks App

DB-RKL — Mon, 14 Sep 2026 12:49:01 GMT

Hey @chie_789

Have you tried setting the colour scheme using javascript? we have an example in the AIBI client docs?https://www.jsdelivr.com/package/npm/@databricks/aibi-client

Re: Free Trial – “Daily limit for workspace creation” error

amitjangid — Mon, 14 Sep 2026 12:39:50 GMT

Thank you for the clarification @Ashwin_DSA. This helps explain why the workspace creation attempt was blocked despite having no existing workspaces.

Re: Compatibility Mode for AWS Redshift

ThiamLee — Mon, 14 Sep 2026 11:45:29 GMT

I’ve been wondering about this too. The gap between Compatibility Mode and how Redshift Spectrum actually discovers/queries the Delta data isn’t very clear from the docs. Would love to see a concrete Redshift setup example or recommended architecture.