Thanks @szymon_dybczak, but I don't think I am doing anything special with my browser/mouse setup. I tried using my MacBook's trackpad and the same behaviour there.
Are you using Azure? We are on AWS, could it be related to that?