Spectral statistics in constrained many-body quantum chaotic systems