What galaxy surveys really measure