Hi all.

I have created a Databricks workspace on AWS. I can log into the workspace and successfully perform select operations on files in S3, but I am unable to create tables.The error when creating the table is as follows.

"Your request failed with status FAILED: [BAD_REQUEST] com.databricks.sql.managedcatalog.UnityCatalogServiceException: [RequestId=<request-id>ErrorClass=TABLE_DOES_NOT_EXIST.RESOURCE_DOES_NOT_EXIST] Table '<table-id>' does not exist."

Upon checking the S3 bucket for the metastore, I found that a directory named metastore/<metastore-id>/tables/<table-id> was created, but there were no files inside it.

I set up the VPC as per the following documentation: https://docs.databricks.com/en/security/network/classic/customer-managed-vpc.html

And I configured the IAM settings according to this documentation: https://docs.databricks.com/en/connect/unity-catalog/storage-credentials.html

If you have any suggestions for a solution or things I should try, I would appreciate your advice.

Thanks

Ryo