It will be a very personal decision sometimes. There are some fish in my tank I've considered taking out and whipping just cause they need it! Others I love and cherish. For me a fish that is hanging in the corner or hiding very often, needs to be moved to prevent stress causing illness. I move thme before they get sick.