迭代后从HashSet中删除失败

I'm writing an agglomerative clustering algorithm in java and having trouble with a remove operation. It seems to always fail when the number of clusters reaches half the initial number.I'm writing an agglomerative clustering algorit