- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-23-2025 07:35 AM
We are also experiencing the same issue. Since around 6pm ET last night (04-22) our Serverless DLT Pipelines cannot read the hive_metastore. It doesn't seem to be related to Databricks Runtime Version 16.1, however, because previous runs using the same version were successful. Also, we are able to run these DLTs using managed Clusters instead of Serverless, even if the managed Clusters are also at version 16.1. Also, when running regular notebooks or job notebooks using Serverless, we are able to query the hive_metastore as well. The issue seems to only affect DLT Serverless.
We wouldn't want to switch all our pipelines to stop using Serverless, but that is the only setup that currently works for us. Could anything have changed last night specifically at DLT Serverless configuration?