I have set up Databricks cluster to work with AWS Glue Catalog by enabling the spark.databricks.hive.metastore.glueCatalog.enabled to true. However, when I create a Delta table on Glue Catalog, the schema reflected in the AWS Glue Catalog is incorrect. the table schema only has one column named `col` of type `array<string>`.
Does anyone have any insights?
Hi @Tam , Certainly! Let’s dive into the intricacies of Delta tables in the AWS Glue Catalog.
Delta Lake and AWS Glue:
AWS Glue Delta Crawler:
Native Delta Lake Tables:
Querying Delta Lake Tables:
Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections.
Click here to register and join today!