See this mskb article on How to Manually Remove Programs from the Add or Remove Programs Tool
http://support.microsoft.com/?kbid=314481
Deleting the key will only remove the program from Currently installed programs list. To uninstall the program you need to remove all related registry entries, folders and files that exist as a result of the program installation.
Bookmarks