Here's your Data + AI Summit 2024 - Warehousing & Analytics recap as you use intelligent data warehousing to improve performance and increase your organization’s productivity with analytics, dashboards and insights. Keynote: Data Warehouse presente...
I have built a class which is already over 2.5k code lines.It is extremelly painfull have to scroll a lot once you need something you know it on the bottom. I have looked after a solution to set the collapse as a default but could not find.Has anyone...
Hi @thales_campolim Just to clarify, are you referring to working in Databricks, or is this in another IDE or code editor?
Hi,I’m the admin of the account, but when I go to the Analytics section, I can’t see any data.Is there a way to fix this?Thanks!
Hello @koral! It’s possible the missing data is due to the dataset being deleted or not properly loaded into the Catalog. Could you check if the dataset is still available and correctly linked? Also, make sure there aren’t any filters applied that co...
Hello we are currently facing a challenge with writing data from a local machine to Delta tables. While small data loads (e.g., 100 Rows) work without any issues, attempting to write larger batches (around 1,000 Rows) results in an exception. the iss...
Hi Community!I have the requirement that business users shall be able to edit/update tables in Unity Catalog, e.g. master data records, mapping tables. I also want thes actions to be logged for auditing/troubleshooting.Is there any simple solution to...
Hello,I attempted to update the SQL warehouse ID for all our dashboards using the Databricks SDK lakeview.update method. However, I mistakenly passed a dashboard object without the serialized_dashboard value, which resulted in all our dashboards beco...
Hello. Please forgive me if this is not the right place to ask, but I'm having issues with databricks' statement execution api. I'm developing Haskell client for this api.I managed to implement most of it, but I'm running into issues with using named...
So far, the parameter works for me too if 1. it is fed by a widget or 2. when not mixing python and sql in the same notebook. It is still failing if the two are mixed in the same notebook.
Hi,I need to create a dashboard displaying the total number of requests per status that have been processed or are currently being processed by the SQL warehouse.I noticed the default graph for the SQL warehouse shows the number of queries executed p...
You can use the system table for this, system.query.history, which is now in public preview: https://docs.databricks.com/aws/en/admin/system-tables/query-history It contains the full query history for warehouses, including status, executer, query tex...
We need to build some BI dashboards for a client. We are having issues to find a way to Download a dataset behind a chart. Ideally the dataset subset after appliying a set of filters. The documentation says here that the full dataset could also be do...
I don't think promoting them to Admins is the best approach. You should be able to assign them to appropriate groups and set permissions to they data you want devs and guests to have query access to, respectively. Then, in terms of sharing the dashbo...
Hey everyone,So I managed to create a Streamlit app on Databricks, works fine deployed in the cloud.However, when I try to run it locally, it complains about "assert os.getenv('DATABRICKS_WAREHOUSE_ID'), "DATABRICKS_WAREHOUSE_ID must be set in app.ya...
I figured it out this morning. You have to use an underscore in the yaml file instead of a dash. This works for me: - name: "DATABRICKS_WAREHOUSE_ID" valueFrom: "sql_warehouse"
Hello,Right now I have chosen the free tier mode and region is east US. But I am unable to create a all purpose compute cluster. Any config I chose it says not supported. Any help is appreciated for pointing which config for worker and driver I shoul...
It seems to be an issue with instance availability on the zone, it could be that at the given time there were no infrastructure available or a limitation with the zone itself. Have you checked the link available in the error message?
Hi-I have a spark DF that I create a visual from, I added a dbutils widget to filter the visual. I want to display the visual in our current IU dashboards (that were created with SQL datasets and calculated measures) but when I click on the drop down...
Hello @HeathDG1! It looks like your visualization was created in a Databricks Notebook using the dbutils widget for filtering. However, Databricks only allows SQL-based visualizations to be added to AI/BI dashboards, while notebook visuals can only b...
Hello,When I do some DML statements using a view "the_source_view" direcly in SQL as a basis, all works fine. I can do inserts in another Delta table based on the data coming out of this view.It works too from a Job: WorkFlow -> Task -> Notebook con...
Hello,Things are working as soon as I use a compute with Access Mode = Standard.Vinc
Hi, Is there a way to aline the databricks widget filters. Please see screenshot below.
Hello @HeathDG1, Looks like screenshot is cut off, could you please elaborate more on what do you want to achieve?
Hi all, Does Delta Lake table guarantee linearizability for the following operations on a single record:- SELECT- UPDATE and DELETE with condition (WHERE clauses) If linearizability is not guaranteed, what consistency model does Delta Lake provide fo...
Hello @Torch3333! Delta Lake does not guarantee linearizability for single record operations. In Delta Lake, isolation levels ensure consistency guarantees in transactions. By default, SELECT operations follow snapshot isolation, ensuring that reads ...
Hey Support Team,We are experiencing an issue with our Databricks warehouse where the auto-stop feature does not seem to be working as expected. Despite setting an idle timeout, the warehouse continues running after the configured auto-stop time has ...
We were able to diagnose and resolve the problem. The problem was caused due to a cube.js JDBC connection repeatedly connecting to our Databricks SQL Warehouse. Databricks SQL Warehouse does not scale down when there are repeated new connections made...
