I once had a Bengali keyboard popping up whenever I started up my Tablet Computer. Problem is that I didn't have Bengali installed, and the keyboard was all blank characters. This meant that I could not sign into my Tablet for 3 days, until I figured out how to shift keyboard modes...
About a year later, I happened to uninstall ALL languages (except original English), and then reinstall the one extra one that I currently use (Chinese). From that day on, my Bengali keyboard disappeared.
So, that's my last suggestion to try. Need to reboot between, of course. You could do a system restore point before any of this, if you need. Also, I assume you'll have your Installation CD handy if you need to reinstall any languages. (I thought you mentioned you had Korean support).
I know IE has extra language support, but I don't have a clue as to whether or not that would apply here...