https://community.databricks.com/t5/data-engineering/delta-table-on-aws-glue-catalog/m-p/64338#M32546 <P><SPAN>Hi, could you please refer to something or explain in more detail your point about querying Delta Lake files directly instead of through the AWS Glue catalog and why it was highlighted as a best practice?</SPAN></P> Thu, 21 Mar 2024 20:43:22 GMT monometa 2024-03-21T20:43:22Z https://community.databricks.com/t5/data-engineering/delta-table-on-aws-glue-catalog/m-p/52437#M29431 <P><SPAN>I have set up Databricks cluster to work with&nbsp;</SPAN><STRONG>AWS Glue Catalog</STRONG><SPAN>&nbsp;by enabling the&nbsp;</SPAN><STRONG><I>spark.databricks.hive.metastore.glueCatalog.enabled</I></STRONG><SPAN>&nbsp;to&nbsp;</SPAN><STRONG><I>true</I></STRONG><SPAN>. However, when I create a</SPAN><STRONG>&nbsp;Delta table</STRONG><SPAN>&nbsp;on Glue Catalog, the schema reflected in the AWS Glue Catalog is incorrect. the table schema only has one column named `col` of type `array&lt;string&gt;`.</SPAN></P><P><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="Tam_0-1700157256870.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/5123iE03C4C8FDF303EED/image-size/medium/is-moderation-mode/true?v=v2&amp;px=400" role="button" title="Tam_0-1700157256870.png" alt="Tam_0-1700157256870.png" /></span></P><P><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="Tam_1-1700157262740.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/5124i51F7BBFE0C2FF9B8/image-size/medium/is-moderation-mode/true?v=v2&amp;px=400" role="button" title="Tam_1-1700157262740.png" alt="Tam_1-1700157262740.png" /></span></P><P><SPAN>Does anyone have any insights?</SPAN></P><P>&nbsp;</P> Thu, 16 Nov 2023 17:56:46 GMT https://community.databricks.com/t5/data-engineering/delta-table-on-aws-glue-catalog/m-p/52437#M29431 Tam 2023-11-16T17:56:46Z https://community.databricks.com/t5/data-engineering/delta-table-on-aws-glue-catalog/m-p/64338#M32546 <P><SPAN>Hi, could you please refer to something or explain in more detail your point about querying Delta Lake files directly instead of through the AWS Glue catalog and why it was highlighted as a best practice?</SPAN></P> Thu, 21 Mar 2024 20:43:22 GMT https://community.databricks.com/t5/data-engineering/delta-table-on-aws-glue-catalog/m-p/64338#M32546 monometa 2024-03-21T20:43:22Z