There is now a setting your follow options (preferences -> follow options in the menu) for "Direct responses to your posts". When this is selected, all direct responses to your posts will show up in "new replies", regardless of your other follow options or if you unfollowed a thread.