Hover between the cells in the side-to-side middle and you will see a + sign appear. This is how you can insert cells into the top-to-bottom middle of a notebook.

You can also move cells by hovering in the upper left of each cell. A cross-hairs will appear and you can drag the cell up or down.