that most people have SOMEONE who was a slave owner (including blacks, hispanics, asian, etc). Especially the further you go back. Slavery was a huge problem (actually still is) worldwide so it doesn't matter where you came from. Europe, Africa, Asia ... they all participated heavily in slavery.
Or did you mean to just pick a certain few years in a certain location?