Asteroids and Life: How Special Is the Solar System?