unexpected keyboard settings change in RDP session

Several times now, I have been typing and my keyboard and keys, suddenly and
seemingly randomly, start applications or activities that are completely
unrelated.

For example the "e" key opens windows explorer window. Coincidentally, the
Navigator feature in windows (an accessibility tool that narrates all my
typing) starts everytime, not sure what i'm typing that triggers it. I'm
always surprised as I have only been typing as usual when it suddenly
switches into this bizarre behaviour.

However, this always happens when I connect through RDP to one particular
server or... to my office PC (again, via RDP). If I close the session
abruptly, and then reconnect it goes away - sometimes for weeks, sometimes
for a few minutes.

My first thought is that there is a virus on my PC and I need to flatten and
reinstall, but I'm curious to know if anyone else has experienced this or
knows differently?

Thanks for any help