@hobrob_ex , yes, this is possible, but not like the HTML way; instead, you will have to use the markdown rendering formats.

Add #Heading 1, #Heading 2.. so on in the (+Text) button of the notebook. Once these headings/ sections that you want are configured, use the Table of Contents button on the left side: