Everyone says to remove the rear sway bar for offroading purposes, what will taking it off improve? Is there any point to keeping it on, especially for those everyday drivers???

It lets the suspension travel more and it helps the ride quality off roading and on the road it makes it less jarring over potholes and such.