The very fact that you have to qualify that you don't "have an American Accent" pretty much means that you have a strong accent.
It's like a person from Edinburgh coming to your home and insisting that he doesn't have a Scottish Accent. We'd all laugh at him.