ChristianRRL
Honored Contributor

Since Spark Declarative Pipelines are now open source, is it conceivable that a team may be able to leverage the open-source version to have a working version of SDP that works with All-purpose compute (assuming a future DBR LTS that has 4.1.x and above)? Is there something that I'm not seeing that may impede the open-source version from working in All-purpose compute?

ChristianRRL_0-1768421877875.png