topic Re: How to display shap waterfall plot in Data Engineering

How to display shap waterfall plot

invalidargument — Fri, 13 Oct 2023 14:00:57 GMT

Hi,

I have managed to display force plot for a single observation using the advice from this thread:

But is there anyway to display the newer "waterfall"-plot

When running

shap.plots.waterfall(shap_values[0])

I get output like

Out[105]: <Figure size 576x468 with 3 Axes>

I have tried calling:

But same result. Any advice? Is it supposed to work?

invalidargument — Mon, 16 Oct 2023 11:56:36 GMT

Thank you for the swift response.

I made a minimal example and it does work as you said. However when I try with my own model it does not work, the only output is

I tried to save the figure as a file and then I do get a plot, but it does look a little broken.

p = shap.plots.waterfall(shap_values[0],show=False)

p.savefig("plot.png")

My guess is that the plot shap outputs for my shap_values is broken,too large or has some other problem so databricks fails to render it.