Color Sensing by Optical Antennas: Approaching the Quantum Efficiency Limit