cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
cancel
Showing results for 
Search instead for 
Did you mean: 

Databricks Runtime compatibility error with latest version while reading from (ADLS) Dynamic 365 .

nitinsingh1
New Contributor II

We are trying to establish ingestion from dynamic 365 >> ADLS >> Databricks, While reading information we need to use databricks runtime 6.4 to read the raw data from ADLS into Databricks.

Latest databricks runtime couldn’t be used, Need your help to related to this compatibility error and also, requires help in order to pull CDM utilities function in databricks. 

And when reading from 6.4 runtime - we are only able to read base table from dynamic-finance and operation but we need to use entity table to ingest into bronze layer.

Is there any reference where we can use databricks to perform end to end ETL dynamic 365 >> ADLS >> DeltaLake

5 REPLIES 5

Hubert-Dudek
Esteemed Contributor III

In Databricks in Partner Connect first option is Fivetran.

Fivetran has Dynamics 365 connector https://www.fivetran.com/connectors/microsoft-dynamics-365.

Hi @nitin singh​,

Just a friendly follow-up. Did you see Humbert's response? did you give it a try? do you still need help?

@Hubert Dudek​ @Jose Gonzalez​ Thank you guys, We are already partner with Fivetran APAC team. Unfortunately customer is looking into databricks as of now.

Good New - We are able to ingest and load data from dynamic 365 >> ADLS >> Databricks (without any connector ) and load into Delta format successfully. Thank you again. Great day !!

Hi @nitinsingh1 !  Same question as @BobBubble2000 ... how did you achieve this without a 3rd party connector tool?  More specifically, I'm trying to figure out how to connect to a Dynamics 365 Business Central ERP set of APIs to ingest data into the Databricks lakehouse.

thanks!

BobBubble2000
New Contributor II

Hi @nitinsingh1 

Thank you for bringing up this topic, I'm also currently looking into how to ingest exported Dynamics 365 FO data (csv files with CDM) from ADLS into Databricks. Could you share how you achieved this? I'd be very curious to see your approach.

Thanks a lot!

Bob

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.