Using a custom Hostname in Databricks CLI instead of per-workspace URL

NadithK — Thu, 24 Aug 2023 07:57:24 GMT

Hi,

At our organization, we have added front end privatelink connection to a Databricks workspace in Azure, and public access to the workspace is disabled. I am able to access the workspace UI with the private IP (in the browser), and able to call the REST APIs. But I am unable to access the workspace using Databricks CLI. Getting below error when I try to connect.

Error: SSLError: HTTPSConnectionPool(host='10.81.x.x', port=443): Max retries exceeded with url: /api/2.0/clusters/list (Caused by SSLError(CertificateError("hostname '10.81.x.x' doesn't match either of '*.azuredatabricks.net', '*.0.azuredatabricks.net', '*.1.azuredatabricks.net', '*.2.azuredatabricks.net', '*.3.azuredatabricks.net', '*.4.azuredatabricks.net', '*.5.azuredatabricks.net', '*.6.azuredatabricks.net', '*.7.azuredatabricks.net', '*.8.azuredatabricks.net', '*.9.azuredatabricks.net', '*.10.azuredatabricks.net', '*.11.azuredatabricks.net', '*.12.azuredatabricks.net', '*.13.azuredatabricks.net', '*.14.azuredatabricks.net', '*.15.azuredatabricks.net', '*.16.azuredatabricks.net', '*.17.azuredatabricks.net', '*.18.azuredatabricks.net', '*.19.azuredatabricks.net', 'azuredatabricks.net', '0.azuredatabricks.net', '1.azuredatabricks.net', '2.azuredatabricks.net', '3.azuredatabricks.net', '4.azuredatabricks.net', '5.azuredatabricks.net', '6.azuredatabricks.net', '7.azuredatabricks.net', '8.azuredatabricks.net', '9.azuredatabricks.net', '10.azuredatabricks.net', '11.azuredatabricks.net', '12.azuredatabricks.net', '13.azuredatabricks.net', '14.azuredatabricks.net', '15.azuredatabricks.net', '16.azuredatabricks.net', '17.azuredatabricks.net', '18.azuredatabricks.net', '19.azuredatabricks.net', '*.pl-auth.azuredatabricks.net', 'pl-auth.azuredatabricks.net'")))

My .databrickscfg file looks like below.

[DEFAULT]

host = https://10.81.x.x/

token = xxxxxxxxxxxxxxxxxxxxxxxx

jobs-api-version = 2.0

Can someone help me how I could resolve this. We are planning to replace these 10.81.x.x private IPs with custom hostnames down the line using our internal DNS.

Thank you.

Re: Using a custom Hostname in Databricks CLI instead of per-workspace URL

NadithK — Fri, 25 Aug 2023 07:52:38 GMT

Hi @Retired_mod,
Thank you for the reply.
Would this not work if I use a custom hostname without *.azuredatabricks.net and use something like

*.adb<my organization>.net

Re: Using a custom Hostname in Databricks CLI instead of per-workspace URL

NadithK — Sun, 27 Aug 2023 02:00:11 GMT

Hi @Retired_mod ,

Thank you for the support.
Really appreciate it.

Thanks

topic Using a custom Hostname in Databricks CLI instead of per-workspace URL in Administration & Architecture

Using a custom Hostname in Databricks CLI instead of per-workspace URL

Re: Using a custom Hostname in Databricks CLI instead of per-workspace URL

Re: Using a custom Hostname in Databricks CLI instead of per-workspace URL