In my pipeline I'm using Azure Data Factory to trigger Databricks notebooks as a linked serviceI want to use spot instances for my job clusters Is there a way to achieve this?I didn't find a way to do this in the GUI.Thanks for your help!Marco
Hi @Werner Stinckens ,Just a quick follow up question.Does it make sense to you that you can select the following options in Azure Data Factory?To my understanding, "cluster version", "Python Version" and the "Worker options" are defined when I crea...
Hi @Werner Stinckens ,Thanks a lot for your helpful information!Until now I never worked with pools but after taking a closer look at it I can profit from a lot of other advantages on top of the "All Spot" option.Have a great day!Cheers,Marco
Hi,I'm working with the Azure Data Factory (ADF) SAP Table connector.Basically I'm using RCA calls to download SAP Tables and save them to ADLS Gen2. In a next step I trigger Databricks notebooks with ADF to transform these files.Best regards,Marco
