Bear in mind that he was the face of the Empire. People would think of him waaaaaay before they thought of Palpatine at the peak of the Empire.
He killed the first Sith to rule the entire Galaxy and brought temporary balance to the force at the end of his life.
Pawn perhaps, but the greatest pawn you will ever find.