There are two possibilities:
1. The battery is knackered and needs replacing. That will be so if it's an old and well used battery, though I'd expect to see the voltage go down by about 3V as soon as you start to draw power.
2. Connection fault, in particular, the soldering on the back of the...