- 4209 Views
- 5 replies
- 11 kudos
Resolved! Runtime SQL Configuration - how to make it simple
Hi, I'm running couple of Notebooks in my pipeline and I would like to set fixed value of 'spark.sql.shuffle.partitions' - same value for every notebook. Should I do that by adding spark.conf.set.. code in each Notebook (Runtime SQL configurations ar...
- 4209 Views
- 5 replies
- 11 kudos
Latest Reply
- 11 kudos
Hi, Thank you all for the tips. I tried before to set this option in Spark Config but didn't work for some reason. Today I tried again and it's working :).
- 11 kudos