topic Re: Making a connection to the tables in Dynamics app through the dataverse TDS endpoint in Data Engineering

Making a connection to the tables in Dynamics app through the dataverse TDS endpoint

AbkSpl — Fri, 13 May 2022 11:52:45 GMT

I wish to do some analysis on tables that are stored in dataverse in databricks. I know that PowerBi uses its Dataverse connector to fetch the data using a Dataverse's TDS endpoint . The tables that we import in PowerBi using this connector is nearly perfect with all the relationships accounted for.

I am trying to establish a similar connection in databricks using connectors or through azure data lake/data warehouse services. Connecting directly to the web app is not an option because it fetches the tables without proper lookup values and relationships.

Is there some suggestions or docs that I could follow?

Re: Making a connection to the tables in Dynamics app through the dataverse TDS endpoint

AbkSpl — Mon, 16 May 2022 13:09:04 GMT

Thank you @Kaniz Fatma for the reply. Is it possible that PowerBi is using an internal azure datalake when importing tables using its TDS (SQL) endpoint connection? It would be helpful to know since I am struggling to reproduce the exact table that Bi imports on databricks (View table data in Power BI Desktop). I could then go ahead and try a connection using an external data lake storage.

Re: Making a connection to the tables in Dynamics app through the dataverse TDS endpoint

tjs1 — Wed, 01 Jun 2022 14:12:15 GMT

Hi @Kaniz Fatma , could you share how to connect to Dataverse from Databricks specifically? This doesn't really answer the question, the doc doesn't help as well unfortunately.

Re: Making a connection to the tables in Dynamics app through the dataverse TDS endpoint

Anonymous — Mon, 11 Jul 2022 18:01:38 GMT

Hey @Arjun Bala Krishnan and @Tomasz Starakiewicz

Hope everything is going great!

Does @Kaniz Fatma's response answer your question? If yes, would you be happy to mark it as best so that other members can find the solution more quickly?

We'd love to hear from you.

Thanks!

Re: Making a connection to the tables in Dynamics app through the dataverse TDS endpoint

AbkSpl — Fri, 15 Jul 2022 07:59:23 GMT

I am not looking to connect data lake to power BI. The objective is to connect dataverse tables to databricks including the relationships.

Re: Making a connection to the tables in Dynamics app through the dataverse TDS endpoint

AbkSpl — Fri, 15 Jul 2022 08:01:17 GMT

Unfortunately the topic is not resolved so far. I have been in contact with MS Support ever since. Both mail and live support has not got us to the expected target. I will propose the best solution that I know of in this thread.

Re: Making a connection to the tables in Dynamics app through the dataverse TDS endpoint

AbkSpl — Fri, 15 Jul 2022 08:25:18 GMT

CData drivers are not free. To connect data from one microsoft service to another must be without the help of outside (paid) solutions. This was also the first google suggestion.

Re: Making a connection to the tables in Dynamics app through the dataverse TDS endpoint

AbkSpl — Fri, 07 Oct 2022 13:16:46 GMT

I finally followed the following method for my requirement:

1) Connected the data verse tables from PowerApps to synapse workspace using the synapse link

2) Used the standard template provided in it to convert the multiple .csv files to parquet format

3) Translated the missing columns in the converted parquet file using the metadata information as given here in Access Dataverse choices

It is still difficult to translate the metadata within databricks since there could be multi-level relationships. But replicating the PowerBI dataverse connector seems to be currently not possible. So I am able to temporarily resolve this issue.

Re: Making a connection to the tables in Dynamics app through the dataverse TDS endpoint

NavinW — Thu, 13 Mar 2025 10:41:14 GMT

Did you manage to connect to dataverse from Databricks ?
I am trying to do the same but no luck.,