Databricks

emanuele_maffeo · 03-17-2022

Hi everybody,Trigger.AvailableNow is released within the databricks 10.1 runtime and we would like to use this new feature with autoloader.We write all our data pipeline in scala and our projects import spark as a provided dependency. If we try to sw...

emanuele_maffeo · 03-17-2022

That's fair. Anyway this feature is basically backported from spark 3.3.0, but since spark 3.3.0 has not been released yet I cannot use it because my code won't compile, hence my whole development process won't work.In the meantime I've found a ugly ...

emanuele_maffeo · 03-17-2022

Yes, it's available in scala, if I use a scala notebook. But what if I develop my code on a IDE and deploy it to databricks using CD pipelines? is there any chance to have the databricks runtime packaged as jar so that I can use it as a sbt dependenc...

Databricks

User Stats

User Activity

Trigger.AvailableNow on scala - compile issue

Re: Trigger.AvailableNow on scala - compile issue

Re: Trigger.AvailableNow on scala - compile issue