The unibody does suck, but stock or lightly modded it doesn't present much of a problem. Ground clearance is also a problem. The trade-off for that, however, is better flex via the SFA and the option of QT II, which effectively locks both axles. It may drag around some, but I can't see much argument that a WJ w/ QT II is poorer offroad than a stock first gen X that's open (or nearly so) at both ends. Throw in a $1000 mod budget and it's game over due to the IFS. Throw in a $3,000 mod budget (or whatever a SAS costs) and the X is better (SFA and Frame, the ladder of which the WJ lacks).
I don't think a WJ is the better overall vehicle (or I'd have one), but I do recognize and accept reality.
PS - don't confuse the WJ with the WK. That's a totally different animal.