I think you have a weak cell in your battery.
The connection is good, otherwise you could not have run the bike on no load for hours.
Underload, the current surges - causing the voltage of the weak cell to collapse, the BMS cuts power to the controller, turning off the light on the display.