Smart Component feature not working

I am trying to use smart component features to make some holes, but on some parts it works and on some i doesn't 
I cant figure out why. i the first picture what it looks if it fails. the second picture shows what it looks like after i created it, the third one after i use it for the first time. i use the parts out of a custom design library, but i also tried it without the library but it keeps failing. 

does anyone got tips to help this?