They Might Be Giants: An Efficient Color-based Selection of Red Giant Stars