@ChrisHunt 

check if "spark.conf.get("spark.databricks.io.cache.enabled")" ( disk cache ) is enabled. if so try to clear cache and re-run your query.

command to clear cache - "spark.catalog.clearCache()"

If disk cache is enabled, then the data is kind of stored in the disk for faster read. May be this might have caused the issue. Try to clear the cache and re-run your query, if it works you can try to set disk cache to false so that your query fetches the latest result.

Hope this helps.