They had used the solar system as a refueling stop, a booster station—call it what you will; and had then spurned it completely, on their way to more important business. They would probably never even know that the human race existed. Such monumental indifference was worse than any deliberate insult.
