Is there a way to exclude a point in Hole Wizard?

In this example, I want 4 holes centered on this face, easiest way is to add a point in the middle and then a midpoint relation. However, it always sees all points as hole location and the center shouldn't have a hole. Is this easy to do? I'm thinking something like how instances to skip operates in patterns.

I know I could draw some more construction lines and put some Colinears on there but I thought this might be an interesting question.

SolidworksParts And Features