I am of the opinion you can find just as many spectacular areas for backpacking that do not require large crowds or permits.
You are probably set on California, but if you are willing to travel, the Bob Marshall Wilderness in Montana is absolutely spectacular and requires no permits of any kind.