topic Re: DLT current channel uses same runtime as the preview channel in Data Engineering

DLT current channel uses same runtime as the preview channel

miiaramo — Fri, 19 May 2023 09:39:39 GMT

Hi,

According to the latest release notes, the current channel of DLT should be using Databricks runtime 11.3 and the preview channel should be using 12.2.

The current channel was using correct runtime version 11.3 still yesterday morning, but since today both channels seem to be using Databricks runtime 12.2. This is causing our pipelines to fail as 12.2 has an issue with the input_file_name() function.

I wonder if this issue has been noticed already? When can we expect a fix for this?

Latest release notes: https://learn.microsoft.com/en-gb/azure/databricks/release-notes/delta-live-tables/2023/17/

Re: DLT current channel uses same runtime as the preview channel

miiaramo — Mon, 22 May 2023 06:44:52 GMT

The issue resolved itself before our morning runs on Saturday 20th of May but I am still curious to hear what happened.

Re: DLT current channel uses same runtime as the preview channel

adriennn — Wed, 27 Sep 2023 10:05:30 GMT

I'm seeing the same issue with 12 current / 13 preview. Updating the channel didn't bump the runtime version and even creating a pipeline with the preview channel uses the current version.