https://community.databricks.com/t5/data-governance/question-about-hive-metastore-and-aws-glue-federation-in-unity/m-p/105269#M2355 <P>Hello,</P><P>Very excited to see the UC federation for hive and aws glue are now in public review. I have a workspace with hive metastore and it integrates with AWS glue (<A href="https://docs.databricks.com/en/archive/external-metastores/aws-glue-metastore.html" target="_blank" rel="noopener">https://docs.databricks.com/en/archive/external-metastores/aws-glue-metastore.html</A>). There are downstream pipelines in AWS consume tables registed with AWS Glue. The workspace was created 4 years ago and I understand this is considered as 'legacy' setup now.</P><P>In this scenario, when creating connection for UC federation, the connection type is Hive metastore, and what the metastore type should be? Is it Internal? Or AWS Glue?</P><P>Also, the federation supports both reading and writing to tables in internal HMS and only supports read-only access for tables AWS Glue, so if i have hive metastore integrated with AWS glue, can i do both read and write to tables?</P><P>Thanks</P><P>&nbsp;</P> Sat, 11 Jan 2025 02:02:25 GMT hzh 2025-01-11T02:02:25Z https://community.databricks.com/t5/data-governance/question-about-hive-metastore-and-aws-glue-federation-in-unity/m-p/105269#M2355 <P>Hello,</P><P>Very excited to see the UC federation for hive and aws glue are now in public review. I have a workspace with hive metastore and it integrates with AWS glue (<A href="https://docs.databricks.com/en/archive/external-metastores/aws-glue-metastore.html" target="_blank" rel="noopener">https://docs.databricks.com/en/archive/external-metastores/aws-glue-metastore.html</A>). There are downstream pipelines in AWS consume tables registed with AWS Glue. The workspace was created 4 years ago and I understand this is considered as 'legacy' setup now.</P><P>In this scenario, when creating connection for UC federation, the connection type is Hive metastore, and what the metastore type should be? Is it Internal? Or AWS Glue?</P><P>Also, the federation supports both reading and writing to tables in internal HMS and only supports read-only access for tables AWS Glue, so if i have hive metastore integrated with AWS glue, can i do both read and write to tables?</P><P>Thanks</P><P>&nbsp;</P> Sat, 11 Jan 2025 02:02:25 GMT https://community.databricks.com/t5/data-governance/question-about-hive-metastore-and-aws-glue-federation-in-unity/m-p/105269#M2355 hzh 2025-01-11T02:02:25Z https://community.databricks.com/t5/data-governance/question-about-hive-metastore-and-aws-glue-federation-in-unity/m-p/105272#M2356 <P>Hello&nbsp;<a href="https://community.databricks.com/t5/user/viewprofilepage/user-id/105095">@hzh</a>,</P> <P>Thanks for your question!</P> <H3 class="_1jeaq5e0 _1t7bu9h9 heading3">UC Federation Connection Type and Metastore Type</H3> <P class="_1t7bu9h1 paragraph">When creating a connection for UC federation with a Hive metastore integrated with AWS Glue, the connection type should be <STRONG>Hive metastore</STRONG>.</P> <H4 class="_1jeaq5e0 _1t7bu9h9 heading4">Metastore Type</H4> <UL> <LI>If the Hive metastore is integrated with AWS Glue, the metastore type should be <STRONG>AWS Glue</STRONG>.</LI> </UL> <H4 class="_1jeaq5e0 _1t7bu9h9 heading4">Read and Write Access</H4> <UL> <LI>UC federation supports both reading and writing to tables in the internal Hive Metastore (HMS).</LI> <LI>For tables in AWS Glue, UC federation supports <STRONG>read-only</STRONG> access.</LI> </UL> <P class="_1t7bu9h1 paragraph">Therefore, if you have a Hive metastore integrated with AWS Glue, you can do both read and write to tables in the internal HMS, but only read access to tables in AWS Glue.</P> Sat, 11 Jan 2025 04:27:20 GMT https://community.databricks.com/t5/data-governance/question-about-hive-metastore-and-aws-glue-federation-in-unity/m-p/105272#M2356 Alberto_Umana 2025-01-11T04:27:20Z