I have a huge love affair with the San Rafael Swell. My earliest memories are of camping in the Swell with my family. With that said, the area he is talking about is not attractive and isn't considered a part of the Swell. If you have alkaline in your blood like me, then that particular part of the desert will fill your heart with fondness, but I am willing to admit it is a desert wasteland. It is the reason I don't eat my dad's cows anymore. There is nothing there for them to eat and the meat tastes terrible because of it.
I could take you off the road he was on and show you some really beautiful springs, Native American dwellings, and cool canyons, but you need a horse or ATV to get to those hidden spots. I am not offended by jdub's take at all.