If your camera is not powering on into the correct default settings this means you are holding down the power button too long. The button only needs to be pressed once for the camera to successfully power on.

By holding down the button to power it on, the HD HERO2 camera thinks it's being powered on and then switched into the next mode.