Just wanted to chime in 10 years later - the original suggestion is still the solution, even in VMWare Horizon Client.
VMWare Horizon Client -> Preferences -> Keyboard & Mouse -> Key Mappings -> Uncheck "Enable Language Specific Key Mappings"
This of course is going to disable these key mappings, but a small price to pay. Remote connections behave as expected when typing fast!
