My primary objective is to access Unity Catalog from an external Big Data platform. I have tried the following configuration:
"type" = "iceberg", "iceberg.catalog.uri" = "https://*********.gcp.databricks.com/api/2.1/unity-catalog/iceberg", "iceberg.catalog.type" = "rest", "databricks.host" = "https://********.gcp.databricks.com", "databricks.port" = "443", "databricks.http_path" = "sql/protocolv1/o/458975******/1220-****-hrjs4****", "databricks.token" = "dapic2753f3fd55**********", "databricks.catalog" = "demo2"
However, I am unable to establish a working connection.
As an alternative, I am considering creating an internal Hive metastore and connecting to an external Hive metastore.
Which approach would be better to achieve a working connection, and are there any recommended best practices or troubleshooting steps I should follow?