Can't create table in unity catalog.

RyoAriyama — Thu, 10 Oct 2024 11:12:07 GMT

Hi all.

I have created a Databricks workspace on AWS. I can log into the workspace and successfully perform select operations on files in S3, but I am unable to create tables.The error when creating the table is as follows.

"Your request failed with status FAILED: [BAD_REQUEST] com.databricks.sql.managedcatalog.UnityCatalogServiceException: [RequestId=<request-id>ErrorClass=TABLE_DOES_NOT_EXIST.RESOURCE_DOES_NOT_EXIST] Table '<table-id>' does not exist."

Upon checking the S3 bucket for the metastore, I found that a directory named metastore/<metastore-id>/tables/<table-id> was created, but there were no files inside it.

I set up the VPC as per the following documentation: https://docs.databricks.com/en/security/network/classic/customer-managed-vpc.html

And I configured the IAM settings according to this documentation: https://docs.databricks.com/en/connect/unity-catalog/storage-credentials.html

If you have any suggestions for a solution or things I should try, I would appreciate your advice.

Thanks

Ryo

Re: Can't create table in unity catalog.

RyoAriyama — Thu, 10 Oct 2024 11:55:07 GMT

I attach the screenshot when I encounter the error.

Re: Can't create table in unity catalog.

Stefan-Koch — Wed, 16 Oct 2024 19:56:07 GMT

Hi Ryo

Can you share the code, how you try to create the table?

topic Re: Can't create table in unity catalog. in Data Engineering

Can't create table in unity catalog.

Re: Can't create table in unity catalog.

Re: Can't create table in unity catalog.