Hello: Great people. I am new to Databricks and pyspark learning. How can I create a new column called "sub_total"? Where I want to group by "category" "subcategory" and "monthly" sales value. ...
If you need the create statement of a table/view in unity catalog. The SHOW CREATE TABLE statement does not return the catalog information. Example query of "view_c": show create table catalo...
Is there any python script that allows me to terminate (not delete) a cluster in the notebook, similar to this R equivalent of terminate_cluster(cluster_id, workspace, token = NULL, verbose = ...
Hi, I am wondering if multithreading will help with the performance for z-ordering optimization on multiple delta tables. We are periodically doing optimization on thousands of tables and it ...
Hi Team, My client has Azure Service Bus and wants to do streaming using DLT. In my previous client we use Event Hub to get the data. Not sure if we can do this with Service Bus. Thanks in advance,...
Hi Team, I just wanted to know why APPLY_CHANGES do not show how many rows it got upserted in the graph? Is this something in the works in the future? Cheers, G
Hello, I am reaching to the community in order to shed some light into a Bug I have been encountering recently. The two setups are as follows: SETUP-1 (WORKS): Python Notebook in Workspace Fi...
Volumes in unity are said to be ideal for "storing library and config files of arbitrary formats such as .whl or .txt centrally and providing secure access across workspaces to it". So basically t...
I'm trying to get my billing usage data from Databricks API (documentation: https://docs.databricks.com/api/gcp/account/billableusage/download) but I keep getting an 404 error. Code: import...