If anyone was #2 politically it was Grand Moff Tarken, no?
Sideous even forbade Vader from killing him, even if he was free to kill other underperforming staff members. Seems to me Vader was more like assistant to the Emperor, or perhaps the top military leader.