See this mskb article on How to Manually Remove Programs from the Add or Remove Programs Tool

http://support.microsoft.com/?kbid=314481

Deleting the key will only remove the program from Currently installed programs list. To uninstall the program you need to remove all related registry entries, folders and files that exist as a result of the program installation.