Red or blue? A potential kilonova imprint of the delay until black hole formation following a neutron star merger