topic There is no response when invoking the REST service in Databricks notebook in Data Governance

There is no response when invoking the REST service in Databricks notebook

rammy — Thu, 01 Dec 2022 14:24:58 GMT

I am trying to invoke a REST service from Databrcisks notebook using python programming. It is working fine before enabling Unity Catalog but after enabling it (In another environment) it is not working and never giving any response and not showing any logs to check the issue.I ran the below code multiple times and the maximum time I ran was 20 hours it is still running and no response as of now.

My question here is what would be the problem with the below code?

Why there is no response?

Where we can check logging info or something to troubleshoot the issue?

Is this issue with some kind of security or certificate validation or Unity catalog or something else?

Any help/input here is really appreciated.

%python
import requests
 
#File download URL1
api_url_1 = "Direct URL1" 
#File download URL2
api_url_2 = "Server URL"
print("before call")
response = requests.get(api_url_1,verify=False,stream=False)
print("after call")
print(response.status_code)
print(response.content)

Note that nc -vz <SERVER_NAME> <PORT_NUMBER> for both services are working

Thanks for your response

Re: There is no response when invoking the REST service in Databricks notebook

Ajay-Pandey — Fri, 02 Dec 2022 03:54:48 GMT

I think u need to configure the unity catalog to connect databricks to other servers

Just try to check if it's connecting to other rest api or not

I my case it working file

Re: There is no response when invoking the REST service in Databricks notebook

rammy — Fri, 02 Dec 2022 07:08:17 GMT

It is connecting to other available load balancer servers but is not able to connect to hosted in-house servers or local servers(localhost or service running on a particular machine with in a network). Not sure if it requires any configuration at databricks side to connect if yes, please let me know

Re: There is no response when invoking the REST service in Databricks notebook

Ajay-Pandey — Fri, 02 Dec 2022 10:31:28 GMT

Please raise a support request to databricks.

Re: There is no response when invoking the REST service in Databricks notebook

Prabakar — Mon, 30 Jan 2023 16:52:01 GMT

I suspect the problem could be caused by the cluster mode. What type of cluster or what access mode do you use for your cluster?