Here's your Data + AI Summit 2024 - Warehousing & Analytics recap as you use intelligent data warehousing to improve performance and increase your organization’s productivity with analytics, dashboards and insights. Keynote: Data Warehouse presente...
Hello we are currently facing a challenge with writing data from a local machine to Delta tables. While small data loads (e.g., 100 Rows) work without any issues, attempting to write larger batches (around 1,000 Rows) results in an exception. the iss...
We are launching our first Databricks Apps based on Streamlit.The App works when simply running the notebook in our workspace, but fails after deployment due to "could not find a valid JAVA_HOME installation" when running in the system environment.We...
any update on this? Currently running into the issue of java_home not being set for pyspark
Hi Community!I have the requirement that business users shall be able to edit/update tables in Unity Catalog, e.g. master data records, mapping tables. I also want thes actions to be logged for auditing/troubleshooting.Is there any simple solution to...
Hello,I attempted to update the SQL warehouse ID for all our dashboards using the Databricks SDK lakeview.update method. However, I mistakenly passed a dashboard object without the serialized_dashboard value, which resulted in all our dashboards beco...
Hello. Please forgive me if this is not the right place to ask, but I'm having issues with databricks' statement execution api. I'm developing Haskell client for this api.I managed to implement most of it, but I'm running into issues with using named...
So far, the parameter works for me too if 1. it is fed by a widget or 2. when not mixing python and sql in the same notebook. It is still failing if the two are mixed in the same notebook.
Hello,I am struggling trying to assign permission dynamically on a schema. I am using databricks asset bundle and I have a parametrized script to assign permission.grant select on schema {{schema}} to {{group}};I cannot achieve a dynamic grant statem...
Hi,I need to create a dashboard displaying the total number of requests per status that have been processed or are currently being processed by the SQL warehouse.I noticed the default graph for the SQL warehouse shows the number of queries executed p...
You can use the system table for this, system.query.history, which is now in public preview: https://docs.databricks.com/aws/en/admin/system-tables/query-history It contains the full query history for warehouses, including status, executer, query tex...
I am attempting to create a Vizro dashboard in a databricks notebook. I have validated that the code to generate dashboard works is accessible when running the notebook on my local machine. However, when attempting to compile the dashboard on a datab...
We need to build some BI dashboards for a client. We are having issues to find a way to Download a dataset behind a chart. Ideally the dataset subset after appliying a set of filters. The documentation says here that the full dataset could also be do...
I don't think promoting them to Admins is the best approach. You should be able to assign them to appropriate groups and set permissions to they data you want devs and guests to have query access to, respectively. Then, in terms of sharing the dashbo...
Hey everyone,So I managed to create a Streamlit app on Databricks, works fine deployed in the cloud.However, when I try to run it locally, it complains about "assert os.getenv('DATABRICKS_WAREHOUSE_ID'), "DATABRICKS_WAREHOUSE_ID must be set in app.ya...
I figured it out this morning. You have to use an underscore in the yaml file instead of a dash. This works for me: - name: "DATABRICKS_WAREHOUSE_ID" valueFrom: "sql_warehouse"
Hi all!Need help configuring ODBC connection on a Mac. I'm receiving the error "The web server failed to start, please verify if port 8020 is being used by another connection or annother application".I've downloaded and installed Databricks ODBC con...
Is there any official word as to when we can expect Chloropleth or Marker Map visuals in AI/BI Dashboards? I realize Legacy Dashboards are still supported, but it feels uncertain to build new ones with AI/BI Dashboards in GA.
Definitely. Marker Maps are now live. You can find documentation for that here. Choropleth maps are in actively development and should land in a few months!
Hi folks, I am creating a SQL dashboard and want to know if I can re-use datasets within the same dashboard. The screenshot below captures what I would like to do pretty well, but to summarize... I need to run an computationally expensive query and w...
@rskuntoji24 My current workaround has been to create the first query as a materialized view in my catalog, and then run a workflow daily to update the view. The downsides to this strategy is that it might not be practical for streaming data (not an ...
Hello all (and, if you are watching these posts, Databricks employees/representatives ),I hope you take this idea into account - I haven't been able to find a place where one can vote on features, but I believe that this idea would make very real im...
Although this is not getting any visibility, I've got another feature idea to add:* Colour coding or otherwise marking columns to reflect table relationIn a simple join between e.g. table "cart" and table "cartItems", columns from "cart" would be mar...
Hello,Right now I have chosen the free tier mode and region is east US. But I am unable to create a all purpose compute cluster. Any config I chose it says not supported. Any help is appreciated for pointing which config for worker and driver I shoul...
It seems to be an issue with instance availability on the zone, it could be that at the given time there were no infrastructure available or a limitation with the zone itself. Have you checked the link available in the error message?
