How to Estimate Unknown Unknowns: From Cosmic Light to Election Polls