Thanks for your answers.

I got a solution in the end, but it was more weirdness. A colleague fired the same query at the same database on his machine, and got the latest data! So I rebooted my PC and opened a new Databricks session, and I got the latest data too! So there must have been some kind of caching going on just for my session.