Phone doesn't respond to hardware buttons sometimes

Can't power on, go into recovery, or download mode.

I have to remove the battery, put it back in, and then it works.

Has anyone experienced this?