topic Where mount info get stored in external hive metastore? in Data Governance

Where mount info get stored in external hive metastore?

Vgupta1 — Wed, 30 Nov 2022 23:03:13 GMT

I have created a cluster which has advance options set for external hive metastore. I created a mount using sp for my data lake and then create a table using the mount . As per my knowledge the metadata of the table will be stored in sql db but i would like to know where the mount info will be stored. Will it be sqldb or in databricks?

furthur to this i created another workspace for another team and created a cluster with same advance option to link to external metastore. I havent created the mount in new workspace. If i will access the table will it work? If yes, then it means the mount info was in sql db. If not , then so i need to create mount with same name in the new workspace? What if the previous mount is pointing to prod and new workspace mount is pointing to dev, is it possible scenario.

as the new workspace team is separate team we dont want them to inherit our mount info from sql db.

Re: Where mount info get stored in external hive metastore?

karthik_p — Fri, 02 Dec 2022 03:59:41 GMT

@Vishal Gupta mount information won't be stored anywhere because it involves credentials. databricks does not store because of security reasons. please send command that you used, is that mnt command?

Re: Where mount info get stored in external hive metastore?

Prabakar — Mon, 30 Jan 2023 16:59:27 GMT

hi @Vishal Gupta The mount points are not common across the workspace. you can use the same mount name across all the workspaces. The mount path will be created under dbfs and if you do a ls, you will be able to see the mount paths. The credentials/config that you provide on the cluster will authenticate you to access the data via the mount path.

Re: Where mount info get stored in external hive metastore?

User16725394280 — Tue, 31 Jan 2023 17:59:47 GMT

Hi @Vishal Gupta when we create a mount we store the mount info in a file in the DBFS root bucket.