Astronomical distances are vast, million trillion miles too far, that's over a hundred thousand light years. There are known stellar-mass black holes within just 2000 light years of the Earth. Heck, there might be a primordial black hole in the inner Oort cloud and not only would it not destroy earth, we'd have (are having) trouble detecting it.