My guess is, his guilt for killing the green girl becomes too much
That he uses the time stone bringing her back. He doesn't realize that he also sets off unintended consequences from turning back the time that ultimately makes him vulnerable to be beat.