The poorest towns in each state typically have median household income tens of thousands below the rest of the state.