This explains it http://ask-leo.com/help_my_shift_key_is_stuck.html

You can also turn off these features. Control Panel > Accessibilty Options