Ron, my seats look way worse than that, and so far as I know they have never been treated with a conditioner, so I don't think that is at fault. Mine are also peeling the the sides and backs, where there is little to no "human contact."
I think it is just crappy material, and agree with you that cloth is the answer. I've never liked leather or vinyl anyway, always have preferred cloth seats.