Slowing down of relaxation in a complex system by constraint dynamics