Display Pyspark Widget in UI Dashboard

HeathDG1 — Tue, 11 Mar 2025 17:47:07 GMT

Hi-

I have a spark DF that I create a visual from, I added a dbutils widget to filter the visual. I want to display the visual in our current IU dashboards (that were created with SQL datasets and calculated measures) but when I click on the drop down below I only get the option to add to a notebook dashboard not our current published dashboards like which we created with the UI.

Please advise.

Thank you!

Re: Display Pyspark Widget in UI Dashboard

Advika_ — Mon, 17 Mar 2025 16:37:47 GMT

Hello @HeathDG1!

It looks like your visualization was created in a Databricks Notebook using the dbutils widget for filtering. However, Databricks only allows SQL-based visualizations to be added to AI/BI dashboards, while notebook visuals can only be used in notebook dashboards, which is why you don't see the option to add it.
To fix this, convert your spark DF into a SQL compatible dataset by saving it as a Delta table (df.write.saveAsTable("table_name")), then recreate the visuals in the UI dashboard using a SQL query with parameter syntax (WHERE column_name = "some_value") instead of dbutils widgets.

topic Display Pyspark Widget in UI Dashboard in Warehousing & Analytics

Display Pyspark Widget in UI Dashboard

Re: Display Pyspark Widget in UI Dashboard