Thanos needs the infinity stones so it appears he has been the one controlling the villains to gain possession of these stones? They have obviously failed and this is why he says he will have to do it himself.