Hello,
I'm exercising a migration of an azure delta table (10TB) from Azure Standard performance tier to Azure Premium. The plan is to create a new storage account and copy the table into it. Then we will switch to the new table. The table contains records that are ingested in the system throught an event hub. A databricks job reads from event hub and perists the records to the table.
1/ Is deep clone applicable in this case? Shall I copy the table with deep clone and then use it as destination for databricks streaming jobs? I read the following article and it seems to be the standard option.
https://www.databricks.com/blog/2020/09/15/easily-clone-your-delta-lake-for-testing-sharing-and-ml-r...
2/ What is the best VM type to run the deep clone?
thanks
