The only way to kill the goldfish is to kill every fish along with them in the water, dumping gallons of rotenone, a biocide poisonous to fish, to ensure nothing can survive. But even this is only possible in ponds and lakes, water bodies with hard edges where the poison will not escape.