For rough terrain, rocks, steep gradients, the entry level Haibike Yamaha full suspension bike gets mentioned a lot as a good starting bike. Though even that is not exactly cheap.
I must admit to liking a good crank drive hard tail for their simplicity, lower maintenance costs, and...