Databricks Community

mickniz · ‎04-30-2024

Hi All,

Currently I trying to connect databricks Unity Catalog from Powerapps Dataflow by using spark connector specifying http url and using databricks personal access token as specified in below screenshot: I am able to connect but the issue is when I expand thge connection it is not showing me list of tables . Am I missing anything . Couldn't find any relevant documentation. ALooking forward for comments or suggestion.

Kaniz_Fatma · ‎05-07-2024

Hi @mickniz, It sounds like you’re trying to connect PowerApps Dataflow to Databricks Unity Catalog using the Spark connector.

Let’s troubleshoot this issue step by step:

Spark Connector Configuration:
- Make sure you’re using the correct configuration for the Spark connector. You mentioned specifying an HTTP URL and using a Databricks personal access token. Let’s verify the details:
  - Use the ‘Spark other’ connector.
  - Set ‘Server’ as: https://SERVER_HOSTNAME:443/HTTP_PATH, where SERVER_HOSTNAME and HTTP_PATH should be replaced appropriately.
  - Set ‘Protocol’ as: HTTP.
  - Set ‘Username’ as ‘token’.
  - Set ‘Password’ as your Databricks personal access token ¹.
Databricks Personal Access Token:
- Ensure that you’ve generated a valid Databricks personal access token. To create one:
  - In your Databricks workspace, click your Databricks username in the top bar.
  - Select “Settings” from the dropdown.
  - Click “Developer.”
  - Next to “Access tokens,” click “Manage.”
  - Click "Generate new token"².
Table Visibility Issue:
- If you’re not seeing the list of tables after expanding the connection, consider the following:
  - Check the permissions associated with the token. Make sure it has appropriate access to the Unity Catalog.
  - Verify that the Databricks workspace you’re connecting to contains the expected tables.
  - Double-check the connection details, including the server URL and token.

Remember to validate each step carefully, and if you encounter any issues, feel free to ask for further assistance. Good luck! 😊¹ ² ³

mickniz · ‎05-07-2024

thanks for replying @Kaniz_Fatma . I am using my user person token to connect and I have all access on catalog,schema and tables. I am able to view in Databricks Sql editor but not via Spark connector in power apps. It still shows me

Is there anything else missed or need to be set. Is it possible to connect to Databricks Sql API via powerapps spark dataflow connector

Kaniz_Fatma · ‎05-07-2024

Hi @mickniz,

Confirm that you’ve set up the Spark connector in PowerApps correctly:
- Use the ‘Spark other’ connector.
- Set the ‘Server’ as: https://SERVER_HOSTNAME:443/HTTP_PATH, where SERVER_HOSTNAME and HTTP_PATH should be replaced appropriately.
- Choose ‘HTTP’ as the protocol.
- Set ‘Username’ as ‘token’.
- Use your Databricks personal access token as the ‘Password’.
If you’re still not seeing the list of tables after expanding the connection, consider the following:
- Verify that the Databricks workspace you’re connecting to contains the expected tables.
- Double-check the connection details, including the server URL and token.
- Ensure that the token has the necessary permissions to access the Unity Catalog.
Unfortunately, the PowerApps Spark dataflow connector does not directly support connecting to the Databricks SQL API. It primarily focuses on connecting to data sources via Spark connectors.
If you specifically need to interact with the Databricks SQL API, you might need to explore other integration options or custom solutions.