I think as long as you ride through dry sandy areas and use a dry lube on your drivetrain, then you should have no problems. Wet sand would be a different matter.
I would be inclined not to wash it unless you give it a good brush down, or blast the sand off with an air hose first.