I used to live near farmland in rural New England. I'd catch 30-40 mice a year, and had traps always set. Use the old-fashioned Victor traps or "The Better Mousetrap." Peanut butter is an effective bait. Put the trap near where they otherwise go to snack on your food, or where you see droppings elsewhere.

This is very important and that many people do not do. Make the bait side of the trap flush with the wall, preferably in a corner. They do not like to go away from edges, lose some of their fear while eating in a corner where they feel safer, and it's also much harder to either rob the trap or spring back when they sense it going off.