In Madison’s view, “This is a great security.” If the president uses the pardon power in a corrupt way, by pardoning crimes that he has himself advised (and thus sheltering the wrongdoer), impeachment is the remedy.
Madison specifically says that abusing the pardon power is an impeachable offense.
