Good evening,
I had the same problem and did exactly as you did, i.e., turned off "Smart Size" in my remote desktop setting and the mouse has stopped moving on its own. Therefore, I can concur that this solution does work, and hopefully it works for other individuals as well.