I found a couple of 20 year old Walkmen - one genuine Sony ( but when they went plastic) and one rip-off clone, both worked fine, but I'd never stored them with batteries in. Actually, I was hard-pushed to find a cassette to test them.
The oldest bit of kit off hand, is a 1952-ish Murphy B52...