One very inadequate workaround is to use the focus mode (Ctrl + Alt + o) on a cell to see that cell and output, which will show the R plot even if it doesn't show in the notebook per se. It very much does not replace the purpose of having notebooks, but at least you can see your plots one at a time.