Databricks Community is an open-source platform for data enthusiasts and professionals to discuss, share insights, and collaborate on everything related to Databricks. Members can ask questions, share knowledge, and support each other in an environment that ensures respectful interactions.
...rror: py4j.security.Py4JSecurityException: Method public org.apache.spark.rdd.RDD org.apache.spark.api.java.JavaRDD.rdd() is not whitelisted on class class org.apache.spark.api.java.JavaRDD I have t...
Hi, I want to access the Databricks Audit Logs to check the table usage information. I created a Databricks workspace on the premium pricing tier and enabled it for the Unity Catalogue. ...
Dear community, Our company is using Databricks and we are happy to have Unity Catalog emerged to solve part of our Data Governance problems. We are very interested in the Table Insights feature whi...
      Hello community, i'm trying to create a unity catalog in azure dataricks, but facing the issue, while creating it shows metastore already exist as error but in reality this is the f...
Hi! So I've been looking into trying Unity Catalog since it seems to add many great features. But one thing I cant get my head around is the fact that we cant (shouldn't?) use multiple metastores i...
Is anyone able to see unity catalog objects in Datagrip? I can only view hive_metastore objects. Nothing mentioned here https://docs.databricks.com/dev-tools/datagrip.html
I have a spreadheet containing table & column descriptions (comments) Is there a way to upload this against the schema in unity catalog? Basically instead of running 'Alter t...
Hi, Is it possible to track and display data lineage with Unity Catalog while using databricks on GCP? like so: https://docs.databricks.com/en/data-governance/unity-catalog/data-l...
Recently it has not been possible to create a metastore. The error "Internal Server Error" appears. Despite authorization of the Managed Identities as Storage Blob Data Contributor. Apparently the er...