brad_kl,
First of all there could be a couple of reasons this is happening. The first is exactly what Dwayneg has just explained as that allows several users to have the same default keymap and then have something different on the User Programmable Keys [UPK]; this save a programmer from making an individual keymap for each and every phone.
Now a second less common reason is that the keymap doesn't match the phone type. Let's say that you have a 5320 IP phone and the Keymap is for a 5330 IP Phone. The two phones look a lot alike, but the keys do not line up the same when a 5320 uses that keymap then when a 5330 uses it.
Look at the style of the phone you are working with and then look at the style of phone that the keymap is for; hopefully this is not your problem.
Now, you are only telling us that you looked at the programmable keys so we can only assume that the normal key programming was never looked at, which could be the issue, or you look at it and they match up as well.
Another issue could be that you have paper labels, eeeeeeckk, that are labeled differently then the keys are programmed. If you use the Feature Code 396 [default] to view the keys and then press each key one at a time they will tell you what the key is programmed for. If you do a 397 [Default] and press the key and it is a User Programmable Key it will allow you to change it to something else or if you press the hold button to clear out each character at a time it will delete it.
Hopefully that gets you a little closer to your answer. The hard part is that if I were standing right in front of it this would be a 2 second conversion, but since we can't see the phone or the programming we have to direct you in the most likely areas to help you figure it out.
Thanks,
TE