To replace the batteries for Keybox 2:

Unlock the Keybox 2, locate the battery cover behind the front panel, unscrew the battery cap and remove it. Replace with 4 AAA batteries, close the battery cover and screw it back.

You may wish to refer to this video guide.