cancel
Showing results for 
Search instead for 
Did you mean: 
Warehousing & Analytics
Engage in discussions on data warehousing, analytics, and BI solutions within the Databricks Community. Share insights, tips, and best practices for leveraging data for informed decision-making.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

MadelynM
by Databricks Employee
  • 3129 Views
  • 0 replies
  • 0 kudos

[Recap] Data + AI Summit 2024 - Warehousing & Analytics | Improve performance and increase insights

Here's your Data + AI Summit 2024 - Warehousing & Analytics recap as you use intelligent data warehousing to improve performance and increase your organization’s productivity with analytics, dashboards and insights.  Keynote: Data Warehouse presente...

Screenshot 2024-07-03 at 10.15.26 AM.png
Warehousing & Analytics
AI BI Dashboards
AI BI Genie
Databricks SQL
  • 3129 Views
  • 0 replies
  • 0 kudos
Akshay_Petkar
by Valued Contributor
  • 2486 Views
  • 10 replies
  • 7 kudos

How to Complete CDW Migration Best Practices Training Labs on Databricks Learning Portal?

I am going through the labs for the CDW Migration Best Practices training on the Databricks Learning Portal and scored 75%. However, it still shows as "In Progress."Can anyone explain the criteria for marking the labs as complete? Do I need a higher ...

  • 2486 Views
  • 10 replies
  • 7 kudos
Latest Reply
betterahyosi2k2
New Contributor II
  • 7 kudos

Hello,I'm trying to finish Delivery Specialization: CDW Migration Best Practices course but I could able to achieve only 50%.could you please share those answer notebooks to this email "betterahyosi2k20@gmail.com" ???

  • 7 kudos
9 More Replies
Paddy_chu
by New Contributor III
  • 1546 Views
  • 5 replies
  • 1 kudos

Does anyone knows how to create Pareto plot on databricks lakeview dashboard?

Hi,Does anyone knows how to create Pareto plot on databricks lakeview dashboard? My stakeholder would really like to see this display on the dashboard. I'm able to get the values on a bar chart and create a cumulative percentage variable, but when I'...

  • 1546 Views
  • 5 replies
  • 1 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 1 kudos

I do not have any handy.  A bit of research on your part might get you what you need.  Also, the recommendations to embed in Lakeview refers to embedding a static image of your chart in Lakeview dashboards.  You cannot integrate third party tools in ...

  • 1 kudos
4 More Replies
thales_campolim
by New Contributor II
  • 1291 Views
  • 3 replies
  • 1 kudos

How to collapse class' methods by default?

I have built a class which is already over 2.5k code lines.It is extremelly painfull have to scroll a lot once you need something you know it on the bottom. I have looked after a solution to set the collapse as a default but could not find.Has anyone...

  • 1291 Views
  • 3 replies
  • 1 kudos
Latest Reply
SP_6721
Honored Contributor
  • 1 kudos

Hi @thales_campolim Just to clarify, are you referring to working in Databricks, or is this in another IDE or code editor?

  • 1 kudos
2 More Replies
koral
by New Contributor
  • 498 Views
  • 1 replies
  • 0 kudos

Unable to View Analytics – Admin Access Issue

Hi,I’m the admin of the account, but when I go to the Analytics section, I can’t see any data.Is there a way to fix this?Thanks!

  • 498 Views
  • 1 replies
  • 0 kudos
Latest Reply
Advika
Databricks Employee
  • 0 kudos

Hello @koral! It’s possible the missing data is due to the dataset being deleted or not properly loaded into the Catalog. Could you check if the dataset is still available and correctly linked? Also, make sure there aren’t any filters applied that co...

  • 0 kudos
MightyMasdo
by New Contributor III
  • 2558 Views
  • 6 replies
  • 2 kudos

writing into delta table using databricks connect

Hello we are currently facing a challenge with writing data from a local machine to Delta tables. While small data loads (e.g., 100 Rows) work without any issues, attempting to write larger batches (around 1,000 Rows) results in an exception. the iss...

  • 2558 Views
  • 6 replies
  • 2 kudos
Latest Reply
vr
Contributor III
  • 2 kudos

Code?

  • 2 kudos
5 More Replies
DataFarmer
by New Contributor II
  • 9495 Views
  • 6 replies
  • 1 kudos

Resolved! How to let Business Users edit tables in Databricks

Hi Community!I have the requirement that business users shall be able to edit/update tables in Unity Catalog, e.g. master data records, mapping tables. I also want thes actions to be logged for auditing/troubleshooting.Is there any simple solution to...

  • 9495 Views
  • 6 replies
  • 1 kudos
Latest Reply
Junpei_Liang
New Contributor II
  • 1 kudos

Just checking in to see if there are any new updates on this. 

  • 1 kudos
5 More Replies
Anton2
by New Contributor II
  • 2154 Views
  • 4 replies
  • 1 kudos

Recovering Lost Dashboard Data

Hello,I attempted to update the SQL warehouse ID for all our dashboards using the Databricks SDK lakeview.update method. However, I mistakenly passed a dashboard object without the serialized_dashboard value, which resulted in all our dashboards beco...

  • 2154 Views
  • 4 replies
  • 1 kudos
Latest Reply
LeviDane
New Contributor II
  • 1 kudos

I am facing the same.

  • 1 kudos
3 More Replies
jhrcek
by New Contributor III
  • 15866 Views
  • 16 replies
  • 8 kudos

Resolved! Misleading UNBOUND_SQL_PARAMETER even though parameter specified

Hello. Please forgive me if this is not the right place to ask, but I'm having issues with databricks' statement execution api. I'm developing Haskell client for this api.I managed to implement most of it, but I'm running into issues with using named...

  • 15866 Views
  • 16 replies
  • 8 kudos
Latest Reply
vivily
New Contributor II
  • 8 kudos

So far, the parameter works for me too if 1. it is fed by a widget or 2. when not mixing python and sql in the same notebook. It is still failing if the two are mixed in the same notebook. 

  • 8 kudos
15 More Replies
Pramod_G
by New Contributor II
  • 1035 Views
  • 1 replies
  • 0 kudos

How can I retrieve the total count of requests processed by the SQL warehouse during a given period?

Hi,I need to create a dashboard displaying the total number of requests per status that have been processed or are currently being processed by the SQL warehouse.I noticed the default graph for the SQL warehouse shows the number of queries executed p...

Pramod_G_0-1743011703416.png
  • 1035 Views
  • 1 replies
  • 0 kudos
Latest Reply
Shua42
Databricks Employee
  • 0 kudos

You can use the system table for this, system.query.history, which is now in public preview: https://docs.databricks.com/aws/en/admin/system-tables/query-history It contains the full query history for warehouses, including status, executer, query tex...

  • 0 kudos
jonh
by New Contributor III
  • 3459 Views
  • 6 replies
  • 1 kudos

Resolved! AI/BI Dashboards

We need to build some BI dashboards for a client. We are having issues to find a way to Download a dataset behind a chart. Ideally the dataset subset after appliying a set of filters. The documentation says here that the full dataset could also be do...

jonh_0-1742476574674.png jonh_1-1742476650926.png
  • 3459 Views
  • 6 replies
  • 1 kudos
Latest Reply
Shua42
Databricks Employee
  • 1 kudos

I don't think promoting them to Admins is the best approach. You should be able to assign them to appropriate groups and set permissions to they data you want devs and guests to have query access to, respectively. Then, in terms of sharing the dashbo...

  • 1 kudos
5 More Replies
AnaMocanu
by Contributor
  • 5271 Views
  • 6 replies
  • 2 kudos

Resolved! Streamlit app on Databricks doesn't recognise the DATABRICKS_WAREHOUSE_ID in the yaml file

Hey everyone,So I managed to create a Streamlit app on Databricks, works fine deployed in the cloud.However, when I try to run it locally, it complains about "assert os.getenv('DATABRICKS_WAREHOUSE_ID'), "DATABRICKS_WAREHOUSE_ID must be set in app.ya...

  • 5271 Views
  • 6 replies
  • 2 kudos
Latest Reply
pdiamond
Contributor
  • 2 kudos

I figured it out this morning. You have to use an underscore in the yaml file instead of a dash. This works for me:  - name: "DATABRICKS_WAREHOUSE_ID"    valueFrom: "sql_warehouse"

  • 2 kudos
5 More Replies
NikkG
by New Contributor
  • 1637 Views
  • 3 replies
  • 0 kudos

Worker/Drive Node Config for Free Tier EastUS region

Hello,Right now I have chosen the free tier mode and region is east US. But I am unable to create a all purpose compute cluster. Any config I chose it says not supported. Any help is appreciated for pointing which config for worker and driver I shoul...

  • 1637 Views
  • 3 replies
  • 0 kudos
Latest Reply
Walter_C
Databricks Employee
  • 0 kudos

It seems to be an issue with instance availability on the zone, it could be that at the given time there were no infrastructure available or a limitation with the zone itself. Have you checked the link available in the error message?  

  • 0 kudos
2 More Replies
HeathDG1
by New Contributor II
  • 1066 Views
  • 1 replies
  • 0 kudos

Display Pyspark Widget in UI Dashboard

Hi-I have a spark DF that I create a visual from, I added a dbutils widget to filter the visual. I want to display the visual in our current IU dashboards (that were created with SQL datasets and calculated measures) but when I click on the drop down...

  • 1066 Views
  • 1 replies
  • 0 kudos
Latest Reply
Advika_
Databricks Employee
  • 0 kudos

Hello @HeathDG1! It looks like your visualization was created in a Databricks Notebook using the dbutils widget for filtering. However, Databricks only allows SQL-based visualizations to be added to AI/BI dashboards, while notebook visuals can only b...

  • 0 kudos
VCA50380
by Contributor II
  • 2180 Views
  • 2 replies
  • 0 kudos

Resolved! Error "[INSUFFICIENT_PERMISSIONS] Insufficient privileges SQLSTATE: 42501"

Hello,When I do some DML statements using a view "the_source_view"  direcly in SQL as a basis, all works fine. I can do inserts in another Delta table based on the data coming out of this view.It works too from a Job: WorkFlow -> Task -> Notebook con...

  • 2180 Views
  • 2 replies
  • 0 kudos
Latest Reply
VCA50380
Contributor II
  • 0 kudos

Hello,Things are working as soon as I use a compute with Access Mode = Standard.Vinc

  • 0 kudos
1 More Replies
HeathDG1
by New Contributor II
  • 1175 Views
  • 2 replies
  • 0 kudos

Resolved! Dashboard Widget Alignment

Hi, Is there a way to aline the databricks widget filters. Please see screenshot below. 

  • 1175 Views
  • 2 replies
  • 0 kudos
Latest Reply
Alberto_Umana
Databricks Employee
  • 0 kudos

Hello @HeathDG1, Looks like screenshot is cut off, could you please elaborate more on what do you want to achieve?

  • 0 kudos
1 More Replies