cancel
Showing results for 
Search instead for 
Did you mean: 
Data Governance
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

RamaTeja
by New Contributor II
  • 8277 Views
  • 6 replies
  • 0 kudos

In Azure Databricks Delta Lake not able to see unity catalog databases or tables in the drop down.

I have created an Azure data factory pipeline with a copy data function to copy data from adls path to a delta table .In the delta table drop downs i am able to see only the hive metastore database and tables only but the unity catalog tables are not...

  • 8277 Views
  • 6 replies
  • 0 kudos
Latest Reply
latteuro
New Contributor II
  • 0 kudos

Hi, I have the same issue.Additional information: the linked service created in azure data factory using azure databricks deltalake connector is using system-managed-identity rather than Token. Could we have an update? Thank you in advance. 

  • 0 kudos
5 More Replies
William_Scardua
by Valued Contributor
  • 3899 Views
  • 5 replies
  • 4 kudos

Resolved! Access table outside Databricks (hive metastore)

Hi guys, how are you ?How can I access tables outside the Databricks ? (hive metastore)I have a python script in my local structure but I need to access are tables stored in Databricks (hive metastore) , how ???? Have any idea ?Thank you guys

  • 3899 Views
  • 5 replies
  • 4 kudos
Latest Reply
pokharatours
New Contributor II
  • 4 kudos

Thanks, Pokhara Tour

  • 4 kudos
4 More Replies
mohamad_atieh
by New Contributor III
  • 2982 Views
  • 6 replies
  • 5 kudos

CREATE TABLE SHALLOW CLONE is not supported in Unity Catalog

Hi,I would like to clone the structure (schema only) of delta table without the content using SHALLOW CLONE command, as recommended in databricks documentation, but it doesn't work. I get an error message that this command is not supported in Unity C...

  • 2982 Views
  • 6 replies
  • 5 kudos
Latest Reply
WAHID
New Contributor II
  • 5 kudos

You can shallow clone the table to an external location after sync the result of the shallow clone to unity catalog. Here is an example https://medium.com/@wahidatoui/sync-delta-tables-stored-in-dbfs-managed-or-external-to-unity-catalog-1fe29a3ae61b

  • 5 kudos
5 More Replies
Vivek_Singh
by New Contributor III
  • 757 Views
  • 2 replies
  • 0 kudos

How to update change data UnityCatalog table after migrating hive metastore delta table

If I will migrate the Hive_metastore table into Unity Catalog table and subsequently hive metastore table is target of curation process. how I will migrate the delta record from Hive_metastore table to Unity Catalog table

  • 757 Views
  • 2 replies
  • 0 kudos
Latest Reply
Vartika
Moderator
  • 0 kudos

Hi @Vivek Singh Banafar​ Hope everything is going great.Just checking in. Does @Debayan Mukherjee​'s response answer your question? If yes, would you be happy to mark it as best so that other members can find the solution more quickly?We'd love to he...

  • 0 kudos
1 More Replies
sqlshep
by New Contributor III
  • 4304 Views
  • 12 replies
  • 2 kudos

Create Schema with Unity enabled

i have unit setup, and am trying to create a delta schema and table, i am getting an error on the schema creation, i am able to list the files and folders in the ADLS Gen2 storage account, i am able to write a parquet file to ADLS, but i cannot crea...

Screenshot 2023-03-11 at 12.11.33 PM
  • 4304 Views
  • 12 replies
  • 2 kudos
Latest Reply
Anonymous
Not applicable
  • 2 kudos

Hi @Shep Sheppard​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Than...

  • 2 kudos
11 More Replies
Lizz
by New Contributor II
  • 1182 Views
  • 2 replies
  • 2 kudos

Resolved! Sync delta tables across workspaces

What is the most cost-effective way to sync delta tables across workspaces? I'd like to sync a production table from the production workspace to a staging workspace for testing. It doesn't have to be in real-time, on a daily basis is acceptable. We a...

  • 1182 Views
  • 2 replies
  • 2 kudos
Latest Reply
Anonymous
Not applicable
  • 2 kudos

Hi @Liz Zhang​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so we ...

  • 2 kudos
1 More Replies
Arpi
by New Contributor II
  • 887 Views
  • 2 replies
  • 0 kudos

Delta table error

Hi,we are creating an external table in the Azure databricks but facing this error:org.apache.spark.sql.AnalysisException: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.meta...

  • 887 Views
  • 2 replies
  • 0 kudos
Latest Reply
karthik_p
Esteemed Contributor
  • 0 kudos

@Priyanka Biswas​ is there a place where we can have updates on metastore upgrades or control plane individual components. usually we can only see control plane region wide status

  • 0 kudos
1 More Replies
sandhyasr
by New Contributor III
  • 1244 Views
  • 4 replies
  • 20 kudos

Consume Delta table data using .net/python API's to present it on custom web application

How can we connect to unity catalog tables to create REST API's using Python/.NET?

  • 1244 Views
  • 4 replies
  • 20 kudos
Latest Reply
Kaniz
Community Manager
  • 20 kudos

Hi @Sandhya SR​, We haven’t heard from you since the last response from @Jensen Ackles​ and I was checking to see if their suggestions helped you.Or else, If you have any solution, please share it with the community, as it can be helpful to others.Al...

  • 20 kudos
3 More Replies
Shafi
by New Contributor III
  • 3236 Views
  • 4 replies
  • 6 kudos

Resolved! Cannot create a table having a column whose name contains commas in Hive metastore.

Hi Tried to create a delta table from spark data frame using below command:destination_path = "/dbfs/mnt/kidneycaredevstore/delta/df_corr_feats_spark_4"df_corr_feats_spark.write.format("delta").option("delta.columnMapping.mode", "name").option("path"...

  • 3236 Views
  • 4 replies
  • 6 kudos
Latest Reply
Pat
Honored Contributor III
  • 6 kudos

Hi @Shafiul Alam​ ,who gave those names to columns? you can rename you columns, replace spaces / special characters, for example:%python import re list_of_columns = df_corr_feats_spark.colums renamed_list_of_columns = [ re.sub(r'[^0-9a-zA-Z]+', "_", ...

  • 6 kudos
3 More Replies
Labels