The Church has gone to great lengths to protect the temple.
The Church pretty much owns a wide swath of downtown SLC in an effort to protect the Church assets. The Brethren, justifiably, do not want temple square and the Church offices to be surrounded by urban squalor and decay.