topic DeltaTable' object has no attribute 'clone' in Data Engineering

DeltaTable' object has no attribute 'clone'

RantoB — Mon, 25 Jul 2022 14:39:12 GMT

Hello,

I use delta on my local machine and I would like to clone a table, however the cloning is not working.

I have the last version of delta installed (delta-spark==2.0.0) but the clone method does not exist in the python module.

With this code :

delta_table.clone(clone_table_name, isShallow=True, replace=True)

I have the following error :

AttributeError: 'DeltaTable' object has no attribute 'clone'

When I try this way :

spark.sql("""CREATE OR REPLACE TABLE db_2.table_name
   SHALLOW CLONE db_1.table_name""")

I have the following error

mismatched input 'SHALLOW' expecting

It looks like cloning is only available in Databricks yet. If not the case, how should I setup spark to have it working.

Thanks

Re: DeltaTable' object has no attribute 'clone'

-werners- — Tue, 26 Jul 2022 07:15:21 GMT

It is not available in OSS delta AFAIK.

I also think it is still in public preview on Databricks, so maybe it gets added?

Anyhow, the only way to get it working is to use databricks. You can use dbx from databricks-labs if you want to develop locally.

Re: DeltaTable' object has no attribute 'clone'

jose_gonzalez — Mon, 15 Aug 2022 23:06:06 GMT

Hi @Bertrand BURCKER,

Delta clone is not available in OSS yet. Right now you can only use this feature in Databricks.

You can find more details and when it will be available in this Jira https://github.com/delta-io/delta/issues/920

Re: DeltaTable' object has no attribute 'clone'

Vidula — Mon, 05 Sep 2022 13:21:35 GMT

Hello @Bertrand BURCKER

Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help.

We'd love to hear from you.

Thanks!