One thing that can happen is the balancing weights on the wheels could get knocked loose, or parts of the tread get altered enough to throw them out of balance.
Ian's right though, you'll do far more damage at speed than slow off-roading - but either might increase the necessity for alignments.
------------------
01 SE 6cyl 5spd Solar Yellow