Smaller wheels, all else being equal, have higher rolling resistance than larger wheels. source: Rolling resistance - Wikipedia, the free encyclopedia
Of course there is also aerodynamics so if the wheels are to large you will lose speed due to wind.
Regards,
Jo