Actually if you do it responsibly, you will go a long time without damaging your rig. I have more on road damage on both my trucks than offroad (door dings, paint chips, rearended.....)

What's so lame about being able to get to places that most people can't i.e. good hunting grounds, secluded camping spots etc. and have fun while doing it????