Not knowing (or needing to know any specifics), I'd strongly guess that you're not actually feeling guilt (which is ALWAYS constructive, hopeful, and encouraging), but that you're experiencing the adversary's insidious counterfeit to guilt:shame. Shame decimates our platform of worth and floods us with feelings of despair and self-incrimination. Shame first whispers and then shouts that you're an inherently bad and broken person (both not true).
If the voice in your head ever says things to you that you would never allow to be said to someone you care deeply about (a friend or sibling), then please don't allow that voice to loiter and say those things to you.
Sorry for the unsolicited sermon, not trying to be preachy- just please be extra aware of guilt vs. shame. God motivates through love and encouragement, not through disapproval, anger, and fear.