Circular hole wizard pattern

I like using the hole wizard for creating my hole patterns.

What I don't get is the circular pattern that I can create inside the hole wizard to place my positions.

I typically like this over circular pattern after placing one hole because its just one less step.

What I'm stuck on is deleting the center hole that SW places on my part when I pattern inside the hole wizard.

Sometimes I can delete but most times I get this error:

SKETCH ENDPOINTS AND CENTER POINTS CANNONT BE DELETED UNLESS THE END POINT IS A SPLIT POINT OF A CURVE.

Any suggestions?

See attached part and drawing. Notice how it does count the extra hole in the center on the drawing.

SolidworksDrawings And Detailing