โ03-23-2023 01:37 AM
Hi Team,
I have created new databricks workspace for using private network. I want to read/write/update delta table created in old databricks and stored in ADLS as delta.
Any one please help me on this?.....
I tried to create delta table in same location but getting error" Cannotcreate table (tablenmae) . the assosciated location (dbfs mount path) is not empty but its not a Delta Table
โ03-27-2023 04:48 AM
Hi @Ancil P Aโ , First of all, we need to know the status of the data in that location i.e. is it corrupted or is it just in a different format?
In either case, there is no delta log available that is the metadata for the delta table. In absence of a delta log, you cannot create a delta table on top of a non-delta table.
Assuming the data is not corrupted and is in non-delta format, the best solution, in this case, is to create a new delta table and insert the data in this new delta table.
โ03-23-2023 06:44 AM
Hi @Ancil P Aโ , It looks like the table location you are using is not empty. Could you please ensure that the table location is empty . You can use the "rm -r" command to delete the files recursively for that location.
โ03-23-2023 11:12 AM
I have created new databricks workspace for using private network. I want to read/write/update delta table created in old databricks and stored in ADLS as delta.
Any one please help me on this?.....
I tried to create delta table in same location but getting error" Cannotcreate table (tablenmae) . the assosciated location (dbfs mount path) is not empty but its not a Delta Table
โ03-23-2023 05:19 PM
Is there any way to use same delta table adls location in new Databricks workspace . Because I need old data in new Databricks workspace
โ03-24-2023 05:41 AM
Hi @Ancil P Aโ , Databricks allows you to create a delta table on a non-empty location if the location has data in delta format. From, the error message it seems that the data is not in delta format.
Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections.
Click here to register and join today!
Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.