If you were to stop with just a BA, Stanford would be a better name on the diploma - but that advantage isn't enough. BYU will provide just as good of an education. In some ways it may be superior. (Some profs at Stanford are truly awful teachers.) Most importantly, do well at BYU and you can go to any grad school - just the same as graduating from Stanford. But the spiritual/cultural environment at BYU is far better - and far more important in my opinion - during the under grad years.
I just wish BYU had been built somewhere with great weather like Stanford.