Validation Suite Question

So I have a validation suite made up of a number of constraints in a used project. I want to be able to turn off certain constraints within this suite. Is this possible to do short of making a copy and deleting the constraint out of the tree? I see in the validation options section this is generally possible, but I get this error. Thoughts?