I have the answering machine feature, but not directly on the phone; instead, it's via the box by dialing a code (there are no buttons on the base).
I've just completely unplugged the phone: electrical socket and telephone socket. In fact, the beep persists: it originates from the box.