Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
I'm on Demo and Lab in Dataframes section. I've imported the dbc into my company cluster and has run "%run ./Includes/Classroom-Setup" successfully. When i run the 1st sql command %sql
CREATE TABLE IF NOT EXISTS events USING parquet OPTIONS (path "/m...
I had the same issue and solved it like this:In the includes folder, there is a reset notebook, run the first command, this unmounts all mounted databases.Go back to the ASP 1.2 notebook and run the %run ./Includes/Classroom-Setup codeblock.Then run ...
I am trying to run below SQL command for granting column specific control to user but it throws error.I have given USE_CATALOG for catalog and USE_SCHEMA permission for schema for the user and have set current catalog and schema.I am using Databricks...
Hi, you can find the best practises here: https://docs.databricks.com/data-governance/unity-catalog/best-practices.htmlAlso, for cluster access modes for unity catalog : https://docs.databricks.com/data-governance/unity-catalog/index.html#cluster-sec...
Hello there,I currently have the problem of deleted files still being in the transaction log when trying to call a delta table. What I found was this statement:%sql
FSCK REPAIR TABLE table_name [DRY RUN]But using it returned following error:Error in ...