No way, it won't cause a problem.
I was forever after a bit more speed, not torque but that was because I could already pedal a good 20mph average. But the faster I went the more unrealised I enjoyed unassisted riding and the satisfaction I could vet out of riding somewhere on my own.
Now...