Databricks

apingle · 02-01-2023

For a KPI dashboard, we need to know the exact size of the data in a catalog and also all schemas inside the catalogs. What is the best way to do this? We tried to iterate over all tables and sum the sizeInBytes using the DESCRIBE DETAIL command for ...

apingle · 12-05-2022

Hey guys,I am trying to create a delta live table in Unity Catalog as follows:CREATE OR REFRESH STREAMING LIVE TABLE <catalog>.<db>.<table_name> AS SELECT ... However, I get the error: org.apache.spark.sql.AnalysisException: Unsupported SQL statemen...

apingle · 03-07-2023

I just saw this today.. https://www.databricks.com/blog/2023/03/07/databricks-sql-statement-execution-api-announcing-public-preview.html

apingle · 03-06-2023

It is supposed to be "FileStore" instead of "Filestore".So this should work: dbutils.fs.ls("dbfs:/FileStore")

apingle · 03-06-2023

As things stand, a user can access all the catalogs (which also means all db's under the catalogs) from any workspace that is Unity catalog enabled. For the time being, it's not possible to bind catalogs to a workspace. However, from what I know, thi...

apingle · 03-06-2023

When you run updates, deletes etc on a delta table, new files are created. However, the old files are not automatically deleted. This is to allow for features like time travel on the Delta tables. In order to delete older files for a delta table, you...

apingle · 12-05-2022

Thanks for confirming. Where did you find this info? Is there a place where we can see the roadmap from Databricks?

Databricks

User Stats

User Activity

Get total size of data in a catalog and schema in Unity Catalog

DLT not working with Unity Catalog

Re: Databricks SQL restful API to query delta table

Re: Error on locating FileStore on Databricks DBFS

Re: Unity catalog - access control to DB and workspace

Re: How do I reduce the size of a hive table's S3 bucket

Re: DLT not working with Unity Catalog