The clock circuit in the radio likely runs on 5 volts or less. Unless your battery is almost stone-dead it will not affect the clock.

The original battery in the X is tiny. It may be time to replace it after 3 1/2 years.