I don't have that problem and I am almost 6'0. I find that strange. Maybe there is a defect in your Xterra's seats. Have you tried riding in other xterras to see if they cause the same pain.
Actually, I just realized I am takling about my 04, so ignore my statements. Did the 04 Xterra have this problem for you? Or just the 05?