Credential passthrough and Hive metastore table access controls are deprecated

hzh — Sat, 11 May 2024 03:08:47 GMT

Hello,

Based on the recent platform release, the credential passthrough will be deprecated for runtime 15.0 and later.

Our current setup involves using Databricks alongside AWS Glue and Athena, i.e. registering delta tables in AWS Glue and running other workflows and processes in AWS. If credential passthrough is deprecated, does this mean won't be able to write table to the Hive metastore anymore?

If we migrate hive metastore tables to Unity catalog, is there an alternative method to register UC tables with the Glue catalog?

Migrating all downstream workflows and processes to Databricks simply isn't a feasible option.

Re: Credential passthrough and Hive metastore table access controls are deprecated

hzh — Sun, 23 Jun 2024 06:07:54 GMT

Thanks Kaniz,

How to achieve the following under DLT pipeline?

It doesn’t prevent you from writing tables to the Hive metastore. You can still interact with the Hive metastore even without credential passthrough.

Thanks

topic Credential passthrough and Hive metastore table access controls are deprecated in Data Engineering

Credential passthrough and Hive metastore table access controls are deprecated

Re: Credential passthrough and Hive metastore table access controls are deprecated