I'm seeing this too, but only on my personal cluster with the following config:Access Mode: DedicatedPolicy: UnrestrictedRuntime info: 15.4 LTS (includes Apache Spark 3.5.0, Scala 2.12)If I use the IT department's shared clusters running either 14.3L...
CJS had the best answer by virtue of it being code-based rather than widget-based. In a notebook where the value of the variable must continually be reset, widgets are suboptimal. That said, the easiest way is to wrap the code in python:%pyvar1 = s...
I added a comment above about left joins, please take a look. Re: your question about moving back to traditional methods, I may end up doing a mix where dlt is in play for running everything but the final table in real time, and create a different p...
