Unable to clone delta live table

Anish_2 — Fri, 04 Oct 2024 08:44:27 GMT

Hello Team,

In order to avoid any cost of running workflow for historical data, i am trying DEEP clone in order to copy data of streaming table from PROD workspace to QA workspace but it is giving below error. Please suggest some efficient data copy method for delta live tables for historical data.

[STREAMING_TABLE_OPERATION_NOT_ALLOWED.UNSUPPORTED_OPERATION] The operation CLONE is not allowed: The operation is not supported on Streaming Tables. SQLSTATE: 42601

Re: Unable to clone delta live table

szymon_dybczak — Sat, 05 Oct 2024 17:45:00 GMT

Hi @Anish_2 ,

This is well known limitation of DLT. You can read about it at limitation section in documentation. Conclusion is following. If you want to have ability to use all feature of delta protocol, it's better not to use dlt framework. It's great too, but it comes with several limitation

https://docs.databricks.com/en/delta/clone-unity-catalog.html

Regarding copying data from dlt table, you have limited option. Take a look look at below discussion:

https://stackoverflow.com/questions/77186431/blue-green-deployment-table-cloning-and-delta-live-table-pipelines

Conclusion is following. If you want to have ability to use all features of delta protocol, it's better not to use dlt framework. It's great tool, but it comes with several limitations and you've just encountered one of them.

topic Unable to clone delta live table in Get Started Discussions

Unable to clone delta live table

Re: Unable to clone delta live table