You must have scattered the fry, they normally stay with the father until the yolk sacs are absorbed.
I have multiple brown BN breeders that also produce albino and calico fry. I've been dropping the brown fry into tanks with cichlids, already have too many of those.