topic Re: Delta Live Table Service Upgrade in Data Engineering

Delta Live Table Service Upgrade

kinsun — Mon, 17 Apr 2023 01:50:38 GMT

Dear experts,

Might I know what will happen to the delta live table pipeline which is in a cancelled state, when there is a runtime service upgrade? Thanks!

Re: Delta Live Table Service Upgrade

Anonymous — Fri, 21 Apr 2023 02:21:15 GMT

@KS LAU :

When a runtime service upgrade occurs in Databricks, any running tasks or pipelines may be temporarily interrupted while the upgrade is being applied. In the case of a cancelled Delta Live Table pipeline, it will not be impacted by the upgrade since it is not running.

However, if the upgrade involves changes to the Delta Lake format or features that the pipeline relies on, it is possible that the pipeline may need to be modified or updated in order to be compatible with the new runtime service. It is important to review any release notes or announcements related to the upgrade to determine if any action is required on your part to ensure your pipeline continues to function properly.

Re: Delta Live Table Service Upgrade

kinsun — Thu, 27 Apr 2023 14:26:28 GMT

Thanks a lot @Suteja Kanuri 😀

Re: Delta Live Table Service Upgrade

Anonymous — Thu, 27 Apr 2023 18:24:55 GMT

You could go and mark it as a best answer @KS LAU .