I thought that Azure Data Factory is built on spark but now when I crushed it I see that is build directly on databricks :-)

Hubert-Dudek
Databricks MVP

I thought that Azure Data Factory is built on spark but now when I crushed it I see that is build directly on databricks 🙂image.png


My blog: https://databrickster.medium.com/

jose_gonzalez
Databricks Employee
Databricks Employee

Yes, it seems like the error stack trace is coming from it.

-werners-
Esteemed Contributor III

correct. Because Data Flows were available before their own (MS) spark pools were available.

But let's be honest: that is only a good thing 🙂