- 13590 Views
- 12 replies
- 4 kudos
In Azure Databricks Delta Lake not able to see unity catalog databases or tables in the drop down.
I have created an Azure data factory pipeline with a copy data function to copy data from adls path to a delta table .In the delta table drop downs i am able to see only the hive metastore database and tables only but the unity catalog tables are not...
- 13590 Views
- 12 replies
- 4 kudos
- 4 kudos
Hi all, Please try following this syntax in the database field <catalog_name>`.`<database_name> It is important that you use ` not ' This should force the connect to use a Unity Catalog Database.
- 4 kudos
- 5562 Views
- 5 replies
- 4 kudos
Resolved! Access table outside Databricks (hive metastore)
Hi guys, how are you ?How can I access tables outside the Databricks ? (hive metastore)I have a python script in my local structure but I need to access are tables stored in Databricks (hive metastore) , how ???? Have any idea ?Thank you guys
- 5562 Views
- 5 replies
- 4 kudos
- 4680 Views
- 6 replies
- 5 kudos
CREATE TABLE SHALLOW CLONE is not supported in Unity Catalog
Hi,I would like to clone the structure (schema only) of delta table without the content using SHALLOW CLONE command, as recommended in databricks documentation, but it doesn't work. I get an error message that this command is not supported in Unity C...
- 4680 Views
- 6 replies
- 5 kudos
- 5 kudos
You can shallow clone the table to an external location after sync the result of the shallow clone to unity catalog. Here is an example https://medium.com/@wahidatoui/sync-delta-tables-stored-in-dbfs-managed-or-external-to-unity-catalog-1fe29a3ae61b
- 5 kudos
- 1516 Views
- 2 replies
- 0 kudos
How to update change data UnityCatalog table after migrating hive metastore delta table
If I will migrate the Hive_metastore table into Unity Catalog table and subsequently hive metastore table is target of curation process. how I will migrate the delta record from Hive_metastore table to Unity Catalog table
- 1516 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Vivek Singh Banafar​ Hope everything is going great.Just checking in. Does @Debayan Mukherjee​'s response answer your question? If yes, would you be happy to mark it as best so that other members can find the solution more quickly?We'd love to he...
- 0 kudos
- 8930 Views
- 12 replies
- 2 kudos
Create Schema with Unity enabled
i have unit setup, and am trying to create a delta schema and table, i am getting an error on the schema creation, i am able to list the files and folders in the ADLS Gen2 storage account, i am able to write a parquet file to ADLS, but i cannot crea...
- 8930 Views
- 12 replies
- 2 kudos
- 2 kudos
Hi @Shep Sheppard​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Than...
- 2 kudos
- 2303 Views
- 2 replies
- 2 kudos
Resolved! Sync delta tables across workspaces
What is the most cost-effective way to sync delta tables across workspaces? I'd like to sync a production table from the production workspace to a staging workspace for testing. It doesn't have to be in real-time, on a daily basis is acceptable. We a...
- 2303 Views
- 2 replies
- 2 kudos
- 2 kudos
Hi @Liz Zhang​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so we ...
- 2 kudos
- 1965 Views
- 2 replies
- 0 kudos
Delta table error
Hi,we are creating an external table in the Azure databricks but facing this error:org.apache.spark.sql.AnalysisException: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.meta...
- 1965 Views
- 2 replies
- 0 kudos
- 0 kudos
@Priyanka Biswas​ is there a place where we can have updates on metastore upgrades or control plane individual components. usually we can only see control plane region wide status
- 0 kudos
- 2150 Views
- 3 replies
- 20 kudos
Consume Delta table data using .net/python API's to present it on custom web application
How can we connect to unity catalog tables to create REST API's using Python/.NET?
- 2150 Views
- 3 replies
- 20 kudos
- 5350 Views
- 4 replies
- 6 kudos
Resolved! Cannot create a table having a column whose name contains commas in Hive metastore.
Hi Tried to create a delta table from spark data frame using below command:destination_path = "/dbfs/mnt/kidneycaredevstore/delta/df_corr_feats_spark_4"df_corr_feats_spark.write.format("delta").option("delta.columnMapping.mode", "name").option("path"...
- 5350 Views
- 4 replies
- 6 kudos
- 6 kudos
Hi @Shafiul Alam​ ,who gave those names to columns? you can rename you columns, replace spaces / special characters, for example:%python import re list_of_columns = df_corr_feats_spark.colums renamed_list_of_columns = [ re.sub(r'[^0-9a-zA-Z]+', "_", ...
- 6 kudos