It depends on the Keyboard. Generally the ones with a grey IBM logo have two piece keys, you can just pull the cap covers off of the key.
On the Blue IBM logo models, made by Lexmark in the early to mid 90's, there are one piece keys that require a bit more effort to remove, but still pretty...