cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Databricks Runtime compatibility error with latest version while reading from (ADLS) Dynamic 365 .

nitinsingh1
New Contributor II

We are trying to establish ingestion from dynamic 365 >> ADLS >> Databricks, While reading information we need to use databricks runtime 6.4 to read the raw data from ADLS into Databricks.

Latest databricks runtime couldn’t be used, Need your help to related to this compatibility error and also, requires help in order to pull CDM utilities function in databricks. 

And when reading from 6.4 runtime - we are only able to read base table from dynamic-finance and operation but we need to use entity table to ingest into bronze layer.

Is there any reference where we can use databricks to perform end to end ETL dynamic 365 >> ADLS >> DeltaLake

5 REPLIES 5

Hubert-Dudek
Esteemed Contributor III

In Databricks in Partner Connect first option is Fivetran.

Fivetran has Dynamics 365 connector https://www.fivetran.com/connectors/microsoft-dynamics-365.

Hi @nitin singh​,

Just a friendly follow-up. Did you see Humbert's response? did you give it a try? do you still need help?

@Hubert Dudek​ @Jose Gonzalez​ Thank you guys, We are already partner with Fivetran APAC team. Unfortunately customer is looking into databricks as of now.

Good New - We are able to ingest and load data from dynamic 365 >> ADLS >> Databricks (without any connector ) and load into Delta format successfully. Thank you again. Great day !!

Hi @nitinsingh1 !  Same question as @BobBubble2000 ... how did you achieve this without a 3rd party connector tool?  More specifically, I'm trying to figure out how to connect to a Dynamics 365 Business Central ERP set of APIs to ingest data into the Databricks lakehouse.

thanks!

BobBubble2000
New Contributor II

Hi @nitinsingh1 

Thank you for bringing up this topic, I'm also currently looking into how to ingest exported Dynamics 365 FO data (csv files with CDM) from ADLS into Databricks. Could you share how you achieved this? I'd be very curious to see your approach.

Thanks a lot!

Bob

Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!