If you're willing to vocalize that--but are unwilling to acknowledge it--then I believe that deep down you may in fact be unwilling to be honest with yourself about the situation for whatever reason.
By why make the statement an all-or-nothing one by adding the word "only"? Really, I think you know the truth of the statement when you take out the "only."
mutu.