How to vary sketch pattern

I have a sketch that’s patterning the upper left point over 5 times to the right.  Then I pattern that original hole and pattern down 3 instances. 

However, when I add a configuration and change the first pattern to 4 instances in that config, it leaves two dangling points behind? 

SolidworksSketching