People didn’t leave the island. Tress knew, logically, that wasn’t explicitly true. Royal officials could leave. The duke left on occasion to report to the king. Plus he’d earned all those fancy medals by killing people from a distant place where they looked slightly different. He’d apparently been quite heroic during those wars; you could tell because a great number of his troops had died, while he lived.
