topic Re: Connect to Databricks from PowerApps in Data Engineering

Connect to Databricks from PowerApps

mickniz — Tue, 30 Apr 2024 14:39:32 GMT

Hi All,

Currently I trying to connect databricks Unity Catalog from Powerapps Dataflow by using spark connector specifying http url and using databricks personal access token as specified in below screenshot: I am able to connect but the issue is when I expand thge connection it is not showing me list of tables . Am I missing anything . Couldn't find any relevant documentation. ALooking forward for comments or suggestion.

Re: Connect to Databricks from PowerApps

mickniz — Tue, 07 May 2024 09:35:34 GMT

thanks for replying @Retired_mod . I am using my user person token to connect and I have all access on catalog,schema and tables. I am able to view in Databricks Sql editor but not via Spark connector in power apps. It still shows me

Is there anything else missed or need to be set. Is it possible to connect to Databricks Sql API via powerapps spark dataflow connector

Re: Connect to Databricks from PowerApps

arunavbarooah — Tue, 01 Oct 2024 13:33:19 GMT

I get an invalid credentials error on using this method. I have generated a token in databricks, any idea why?

Re: Connect to Databricks from PowerApps

william_lenotis — Wed, 02 Oct 2024 15:01:01 GMT

hi @mickniz

The Spark PowerAPP connector search only for a two namespace database (SCHEMA.TABLE) while the Databricks catalog has three (CATALOG.SCHEMA.TABLE).

You will need to define a default catalog on the Databricks workspace admin settings, the connector will be only able to connect to the tables on this default catalog.

example:

Re: Connect to Databricks from PowerApps

PepDino — Wed, 09 Oct 2024 00:32:49 GMT

I'm having this same issue, getting Invalid Credentials (or some other error depending on how I set up the Spark connection to the databricks server). I've tried adding a gateway, changing the protocol and port, changing the default catalog, all to no avail.

Is anyone successfully connecting to Databricks SQL from Dataverse, via dataflows or any other means?

Re: Connect to Databricks from PowerApps

william_lenotis — Wed, 09 Oct 2024 16:13:22 GMT

Hi pep, we were able to connect using the spark connector as explained in the beginning of this thread, we only needed to setup the default catalog as I mentioned earlier.

the user you are using to generate the token has access to the sql warehouse and to the catalog?

Re: Connect to Databricks from PowerApps

PepDino — Thu, 10 Oct 2024 04:32:37 GMT

Thanks William. Yes, user token has the access and default catalog was set. Could you possibly provide example of your connection settings for setting up the Spark connector? As the OP mentioned including port 443, changing protocol to Http, and putting HTTP path after the server hostname. I tried all the possible variations of this but only encountered errors.

Edit: We are using 'token' for the Username and the PAT from authorized user as the Password.

Re: Connect to Databricks from PowerApps

william_lenotis — Thu, 10 Oct 2024 10:38:00 GMT

Do you have any firewall restriction? Maybe if the public IP are not allowed for your databricks workspace it is not allowing thew connection, besides that I don't have much clue on how to help. Would suggest open a support ticket.

Re: Connect to Databricks from PowerApps

Toussaint_Webb — Mon, 16 Jun 2025 01:15:50 GMT

If you are an Azure Databricks customer, there is now a connector for Power Platform (Power Apps, Copilot Studio, and Power Automate) in Public Preview.