Connect to Databricks from PowerApps

[mickniz]

Hi All,

Currently I trying to connect databricks Unity Catalog from Powerapps Dataflow by using spark connector specifying http url and using databricks personal access token as specified in below screenshot: I am able to connect but the issue is when I expand thge connection it is not showing me list of tables . Am I missing anything . Couldn't find any relevant documentation. ALooking forward for comments or suggestion.

[mickniz]

thanks for replying @Retired_mod . I am using my user person token to connect and I have all access on catalog,schema and tables. I am able to view in Databricks Sql editor but not via Spark connector in power apps. It still shows me 

Is there anything else missed or need to be set. Is it possible to connect to Databricks Sql API via powerapps spark dataflow connector

[arunavbarooah]

I get an invalid credentials error on using this method. I have generated a token in databricks, any idea why?

[william_lenotis]

hi @mickniz 

The Spark PowerAPP connector search only for a two namespace database (SCHEMA.TABLE) while the Databricks catalog has three (CATALOG.SCHEMA.TABLE).

You will need to define a default catalog on the Databricks workspace admin settings, the connector will be only able to connect to the tables on this default catalog.

example:

[PepDino]

I'm having this same issue, getting Invalid Credentials (or some other error depending on how I set up the Spark connection to the databricks server).  I've tried adding a gateway, changing the protocol and port, changing the default catalog, all to no avail.

Is anyone successfully connecting to Databricks SQL from Dataverse, via dataflows or any other means?

[william_lenotis]

Hi pep, we were able to connect using the spark connector as explained in the beginning of this thread, we only needed to setup the default catalog as I mentioned earlier.

the user you are using to generate the  token has access to the sql warehouse and to the catalog?

[PepDino]

Thanks William. Yes, user token has the access and default catalog was set.  Could you possibly provide example of your connection settings for setting up the Spark connector?  As the OP mentioned including port 443, changing protocol to Http, and putting HTTP path after the server hostname.  I tried all the possible variations of this but only encountered errors.

Edit: We are using 'token' for the Username and the PAT from authorized user as the Password.

[william_lenotis]

Do you have any firewall restriction? Maybe if the public IP are not allowed for your databricks workspace it is not allowing thew connection, besides that I don't have much clue on how to help. Would suggest open a support ticket.