- 1489 Views
- 3 replies
- 3 kudos
I am trying to setup delta live tables pipelines to ingest data to bronze and silver tables. Bronze and Silver are separate schema. This will be triggered by a daily job. It appears to run fine when set as continuous, but fails when triggered.Table...
- 1489 Views
- 3 replies
- 3 kudos
Latest Reply
Hi @Jennette Shepard​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answ...
2 More Replies
by
harraz
• New Contributor III
- 3407 Views
- 2 replies
- 0 kudos
com.databricks.backend.common.rpc.SparkDriverExceptions$SQLExecutionException: org.apache.spark.sql.connector.catalog.CatalogNotFoundException: Catalog 'uc-dev' plugin class not found: spark.sql.catalog.uc-dev is not defined
....I get the above when ...
- 3407 Views
- 2 replies
- 0 kudos
Latest Reply
Hi @mohamed harraz​ We haven't heard from you since the last response from @karthik p​ ​, and I was checking back to see if her suggestions helped you.Or else, If you have any solution, please share it with the community, as it can be helpful to othe...
1 More Replies
by
Ryu1
• New Contributor
- 476 Views
- 0 replies
- 0 kudos
I am going to use an open source called "datahub" to collect and share metadata information of databricks. (https://datahubproject.io/)Recently, however, there has been a big challenge. That is, to collect the unity catalog information of databricks,...
- 476 Views
- 0 replies
- 0 kudos
- 2743 Views
- 6 replies
- 2 kudos
Delta Sharing and Unity catalog both have elements of data sharing. Can you please explain when one would use Delta sharing vs Unity Catalog?
- 2743 Views
- 6 replies
- 2 kudos
Latest Reply
Based on the Databricks reply from the post below: "Unity Catalog does not currently support separating data by workspace or Azure subscription. As you noted, data from all catalogs within a region can be accessed by any workspace within that region,...
5 More Replies
- 4026 Views
- 5 replies
- 5 kudos
I'm trying to access account console in Azure but I only can see the list of workspaces and access them. I didn't find documentation about account console for Azure. Do you know how to access account console?
- 4026 Views
- 5 replies
- 5 kudos
Latest Reply
Hello @Leszek​ . Please tell me is it works for you ?Did you find the root cause ?I still don't understand why I should grant to myself some extra permissions if I already global administrator, owner of subscription, owner of databricks workspace but...
4 More Replies
- 2092 Views
- 1 replies
- 0 kudos
Hi,As per documentation https://docs.delta.io/latest/quick-start.html , we can configure DeltaCatalog using spark.sql.catalog.spark_catalog.The Iceberg supports two Catalog implementations (https://iceberg.apache.org/docs/latest/spark-configuration/#...
- 2092 Views
- 1 replies
- 0 kudos
Latest Reply
@Arun Sethia​ :Yes, Delta Lake also supports custom catalogs. Delta Lake uses the Spark Catalog API, which allows for pluggable catalog implementations. You can implement your own custom catalog to use with Delta Lake.To use a custom catalog, you can...
by
maaaxx
• New Contributor III
- 2113 Views
- 5 replies
- 0 kudos
Hi databricks community,I have searched quite a while through the internet but did not find an answer. If I have configured the azure datalake connection in Unity data catalog, is it possible to grant the access to users for a specific file or a fold...
- 2113 Views
- 5 replies
- 0 kudos
Latest Reply
As @werners said service principal needs to have access to the file level.In the unity catalog, you can use "READ FILES"/"WRITE FILES" permission to give someone the possibility of reading files from the storage level (but through databricks).
4 More Replies