Optical studies of Cassiopeia A. VIII - Search for a stellar remnant