Trouble selecting faces in assembly

I'm pretty sure there has to be a setting in Solidworks that is causing this "issue" that I'm having. I'm wanting to click the face of a part in my assembly, but it grabs lines, points, etc from behind the part. Here is an example of 3 clicks that miss the face and finally 1 click that selected the face:

SolidworksAssemblies