cancel
Showing results for 
Search instead for 
Did you mean: 
Warehousing & Analytics
Engage in discussions on data warehousing, analytics, and BI solutions within the Databricks Community. Share insights, tips, and best practices for leveraging data for informed decision-making.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

MadelynM
by Databricks Employee
  • 1662 Views
  • 0 replies
  • 0 kudos

[Recap] Data + AI Summit 2024 - Warehousing & Analytics | Improve performance and increase insights

Here's your Data + AI Summit 2024 - Warehousing & Analytics recap as you use intelligent data warehousing to improve performance and increase your organization’s productivity with analytics, dashboards and insights.  Keynote: Data Warehouse presente...

Screenshot 2024-07-03 at 10.15.26 AM.png
Warehousing & Analytics
AI BI Dashboards
AI BI Genie
Databricks SQL
  • 1662 Views
  • 0 replies
  • 0 kudos
jacobzeb
by New Contributor II
  • 691 Views
  • 1 replies
  • 0 kudos

Vizro Dashboarding in Databricks

I am attempting to create a Vizro dashboard in a databricks notebook. I have validated that the code to generate dashboard works is accessible when running the notebook on my local machine. However, when attempting to compile the dashboard on a datab...

  • 691 Views
  • 1 replies
  • 0 kudos
Latest Reply
jacobzeb
New Contributor II
  • 0 kudos

  • 0 kudos
alex456897874
by New Contributor II
  • 728 Views
  • 2 replies
  • 0 kudos

how to reuse filter between pages in dashboards?

Hi!I have a multi-page dashboard based on a handful of tables sharing a common run_id field.I created a dropdown filter widget on the first page to filter datasets based on the table's run_id field.It worked fine for this page, but how to reuse it fo...

  • 728 Views
  • 2 replies
  • 0 kudos
Latest Reply
RobrechtS
New Contributor II
  • 0 kudos

Hello,Even when adding a parameter to the dataset this parameter is not updated when switching between pages.If i provide a link to a dashboard with a parameter filled in and the user navigates to the next page the parameter value from the first page...

  • 0 kudos
1 More Replies
jonh
by New Contributor II
  • 1246 Views
  • 6 replies
  • 1 kudos

Resolved! AI/BI Dashboards

We need to build some BI dashboards for a client. We are having issues to find a way to Download a dataset behind a chart. Ideally the dataset subset after appliying a set of filters. The documentation says here that the full dataset could also be do...

jonh_0-1742476574674.png jonh_1-1742476650926.png
  • 1246 Views
  • 6 replies
  • 1 kudos
Latest Reply
Shua42
Databricks Employee
  • 1 kudos

I don't think promoting them to Admins is the best approach. You should be able to assign them to appropriate groups and set permissions to they data you want devs and guests to have query access to, respectively. Then, in terms of sharing the dashbo...

  • 1 kudos
5 More Replies
AnaMocanu
by Contributor
  • 1850 Views
  • 6 replies
  • 2 kudos

Resolved! Streamlit app on Databricks doesn't recognise the DATABRICKS_WAREHOUSE_ID in the yaml file

Hey everyone,So I managed to create a Streamlit app on Databricks, works fine deployed in the cloud.However, when I try to run it locally, it complains about "assert os.getenv('DATABRICKS_WAREHOUSE_ID'), "DATABRICKS_WAREHOUSE_ID must be set in app.ya...

  • 1850 Views
  • 6 replies
  • 2 kudos
Latest Reply
pdiamond
Contributor
  • 2 kudos

I figured it out this morning. You have to use an underscore in the yaml file instead of a dash. This works for me:  - name: "DATABRICKS_WAREHOUSE_ID"    valueFrom: "sql_warehouse"

  • 2 kudos
5 More Replies
BillSundwall
by New Contributor II
  • 1526 Views
  • 3 replies
  • 1 kudos

Maps in AI/BI Dashboards?

Is there any official word as to when we can expect Chloropleth or Marker Map visuals in AI/BI Dashboards? I realize Legacy Dashboards are still supported, but it feels uncertain to build new ones with AI/BI Dashboards in GA.

  • 1526 Views
  • 3 replies
  • 1 kudos
Latest Reply
eason_gao_db
Databricks Employee
  • 1 kudos

Definitely. Marker Maps are now live. You can find documentation for that here. Choropleth maps are in actively development and should land in a few months! 

  • 1 kudos
2 More Replies
mtreigelman
by New Contributor II
  • 1281 Views
  • 5 replies
  • 2 kudos

Re-Using Datasets inside the Same SQL Dashboard

Hi folks, I am creating a SQL dashboard and want to know if I can re-use datasets within the same dashboard. The screenshot below captures what I would like to do pretty well, but to summarize... I need to run an computationally expensive query and w...

databricks_dash_dataset_recycle_question.png
  • 1281 Views
  • 5 replies
  • 2 kudos
Latest Reply
mtreigelman
New Contributor II
  • 2 kudos

@rskuntoji24 My current workaround has been to create the first query as a materialized view in my catalog, and then run a workflow daily to update the view. The downsides to this strategy is that it might not be practical for streaming data (not an ...

  • 2 kudos
4 More Replies
QueryingQuagga
by New Contributor III
  • 880 Views
  • 1 replies
  • 0 kudos

Databricks SQL editor - we can get a long way with a few Quality of Life improvements

Hello all (and, if you are watching these posts, Databricks employees/representatives ),I hope you take this idea into account - I haven't been able to find a place where one can vote on features, but I believe that this idea would make very real im...

  • 880 Views
  • 1 replies
  • 0 kudos
Latest Reply
QueryingQuagga
New Contributor III
  • 0 kudos

Although this is not getting any visibility, I've got another feature idea to add:* Colour coding or otherwise marking columns to reflect table relationIn a simple join between e.g. table "cart" and table "cartItems", columns from "cart" would be mar...

  • 0 kudos
NikkG
by New Contributor
  • 806 Views
  • 3 replies
  • 0 kudos

Worker/Drive Node Config for Free Tier EastUS region

Hello,Right now I have chosen the free tier mode and region is east US. But I am unable to create a all purpose compute cluster. Any config I chose it says not supported. Any help is appreciated for pointing which config for worker and driver I shoul...

  • 806 Views
  • 3 replies
  • 0 kudos
Latest Reply
Walter_C
Databricks Employee
  • 0 kudos

It seems to be an issue with instance availability on the zone, it could be that at the given time there were no infrastructure available or a limitation with the zone itself. Have you checked the link available in the error message?  

  • 0 kudos
2 More Replies
HeathDG1
by New Contributor II
  • 245 Views
  • 1 replies
  • 0 kudos

Display Pyspark Widget in UI Dashboard

Hi-I have a spark DF that I create a visual from, I added a dbutils widget to filter the visual. I want to display the visual in our current IU dashboards (that were created with SQL datasets and calculated measures) but when I click on the drop down...

  • 245 Views
  • 1 replies
  • 0 kudos
Latest Reply
Advika_
Databricks Employee
  • 0 kudos

Hello @HeathDG1! It looks like your visualization was created in a Databricks Notebook using the dbutils widget for filtering. However, Databricks only allows SQL-based visualizations to be added to AI/BI dashboards, while notebook visuals can only b...

  • 0 kudos
Kaz
by New Contributor II
  • 7040 Views
  • 1 replies
  • 0 kudos

Show full logs on job log

Is it possible to show the full logs of a databricks job? Currently, the logs are skipped with:*** WARNING: max output size exceeded, skipping output. ***However, I don't believe our log files are more than 20 MB. I know you can press the logs button...

  • 7040 Views
  • 1 replies
  • 0 kudos
Latest Reply
piotrsofts
New Contributor II
  • 0 kudos

Hey KazWhere did you get that ?

  • 0 kudos
VCA50380
by Contributor
  • 1018 Views
  • 2 replies
  • 0 kudos

Resolved! Error "[INSUFFICIENT_PERMISSIONS] Insufficient privileges SQLSTATE: 42501"

Hello,When I do some DML statements using a view "the_source_view"  direcly in SQL as a basis, all works fine. I can do inserts in another Delta table based on the data coming out of this view.It works too from a Job: WorkFlow -> Task -> Notebook con...

  • 1018 Views
  • 2 replies
  • 0 kudos
Latest Reply
VCA50380
Contributor
  • 0 kudos

Hello,Things are working as soon as I use a compute with Access Mode = Standard.Vinc

  • 0 kudos
1 More Replies
HeathDG1
by New Contributor II
  • 514 Views
  • 2 replies
  • 0 kudos

Resolved! Dashboard Widget Alignment

Hi, Is there a way to aline the databricks widget filters. Please see screenshot below. 

  • 514 Views
  • 2 replies
  • 0 kudos
Latest Reply
Alberto_Umana
Databricks Employee
  • 0 kudos

Hello @HeathDG1, Looks like screenshot is cut off, could you please elaborate more on what do you want to achieve?

  • 0 kudos
1 More Replies
Torch3333
by New Contributor II
  • 612 Views
  • 1 replies
  • 1 kudos

Resolved! Linearizability on Delta Lake table

Hi all, Does Delta Lake table guarantee linearizability for the following operations on a single record:- SELECT- UPDATE and DELETE with condition (WHERE clauses) If linearizability is not guaranteed, what consistency model does Delta Lake provide fo...

  • 612 Views
  • 1 replies
  • 1 kudos
Latest Reply
Advika
Databricks Employee
  • 1 kudos

Hello @Torch3333! Delta Lake does not guarantee linearizability for single record operations. In Delta Lake, isolation levels ensure consistency guarantees in transactions. By default, SELECT operations follow snapshot isolation, ensuring that reads ...

  • 1 kudos
mausch
by New Contributor
  • 432 Views
  • 0 replies
  • 0 kudos

CalledProcessError when running dbt

I've been trying to run a dbt project (sourced in Azure DevOps) in Databricks Workflows, but I get this error message:  CalledProcessError: Command 'b'\nmkdir -p "/tmp/tmp-dbt-run-1124228490001263"\nunexpected_errors="$(cp -a -u "/Workspace/Repos/.in...

  • 432 Views
  • 0 replies
  • 0 kudos