Exclude multiple overlaid points in Hole Wizard?

I use the Hole Wizard tool frequently to make holes based on sketch points, lines, and rectangles. If I use the "Center Rectangle" in my sketch, but I don't want the central hole, I can "Skip Holes" in the wizard and select that center hole to avoid creating an extra hole. This works exactly as desired.

 

However, if I create some sketch geometry with multiple overlaid points, such as two "Midpoint" lines that share a center point, I can't seem to tell the Hole Wizard to ignore that position. I can select one of the points, but the point from the other line still forces a hole to be created. If I select it twice, the point is just removed from the "Instances to Skip" dialogue box.

 

Is there an easy way to get the Hole Wizard tool to skip over multiple points that are in the same position?