03-23-2023 01:37 AM
Hi Team,
I have created new databricks workspace for using private network. I want to read/write/update delta table created in old databricks and stored in ADLS as delta.
Any one please help me on this?.....
I tried to create delta table in same location but getting error" Cannotcreate table (tablenmae) . the assosciated location (dbfs mount path) is not empty but its not a Delta Table
03-27-2023 04:48 AM
Hi @Ancil P A , First of all, we need to know the status of the data in that location i.e. is it corrupted or is it just in a different format?
In either case, there is no delta log available that is the metadata for the delta table. In absence of a delta log, you cannot create a delta table on top of a non-delta table.
Assuming the data is not corrupted and is in non-delta format, the best solution, in this case, is to create a new delta table and insert the data in this new delta table.
03-23-2023 06:44 AM
Hi @Ancil P A , It looks like the table location you are using is not empty. Could you please ensure that the table location is empty . You can use the "rm -r" command to delete the files recursively for that location.
03-23-2023 11:12 AM
I have created new databricks workspace for using private network. I want to read/write/update delta table created in old databricks and stored in ADLS as delta.
Any one please help me on this?.....
I tried to create delta table in same location but getting error" Cannotcreate table (tablenmae) . the assosciated location (dbfs mount path) is not empty but its not a Delta Table
03-23-2023 05:19 PM
Is there any way to use same delta table adls location in new Databricks workspace . Because I need old data in new Databricks workspace
03-24-2023 05:41 AM
Hi @Ancil P A , Databricks allows you to create a delta table on a non-empty location if the location has data in delta format. From, the error message it seems that the data is not in delta format.
03-24-2023 10:22 AM
Thank you for update, Is there any way to convert the table to DELTA tables.
And use the same data and ADLS location new databricks workspace
03-27-2023 04:48 AM
Hi @Ancil P A , First of all, we need to know the status of the data in that location i.e. is it corrupted or is it just in a different format?
In either case, there is no delta log available that is the metadata for the delta table. In absence of a delta log, you cannot create a delta table on top of a non-delta table.
Assuming the data is not corrupted and is in non-delta format, the best solution, in this case, is to create a new delta table and insert the data in this new delta table.
03-26-2023 10:25 PM
Hi @Ancil P A
Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help.
We'd love to hear from you.
Thanks!
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.
If there isn’t a group near you, start one and help create a community that brings people together.
Request a New Group