He suffered a crushing humiliation when his first wife, the beautiful but wayward Jane Digby, left him and took a succession of lovers, first the Austrian Prince Schwarzenberg, with whom Ellenborough fought a duel, then in quick succession the kings of both Bavaria and Greece, and an Albanian general, before ending up happily married to a Bedouin sheikh in Palmyra.