Yep, I hear you. That is why we settled on towing a 4x4.
We had found ourselves saying "no" to too many roads in the south-west, but also in mountainous and urban areas. With few exceptions, we learned it's best to bring the Jeep along. We did tow it on our two week trip around Lake Michigan, but learned in that case we should have left it home. So it's not something to take on "every" planned vacation.
Getting around in a 2100 does offer more flexibility than our 2350. But some of those roads in Utah are just too hard on any PC. They were too hard on our car that we towed before as was the case in Escalante on the road to the trail head to the narrows. Driving a Toyota MR2 Spyder through deep dry washed rock river beds was our turning point. So the 4x4 became our tow vehicle of choice.
If we had a PC Quigley 4x4, I still would not take the PC on some of the roads we travelled due to over-hangs, tip-overs, narrows, height clearances, damaging jolts, wash-boarding and such. Better for us to tow the 4x4 for such day excursions.