Lofting Square to Circle - Guide lines merging at circle quadrants

I have what seems like should be a really simple loft, but I cannot get it to come out how I'm wanting.

I am lofting from a square to a circle. I want the loft lines to converge at the quadrant points of the circle which are at 45 degrees from the square corners.

I can get the shape looking like I want by adding in 3D sketches to use as guide lines, but the loft fails if I try to do this for all 4 sides.

Ideas of what I'm doing wrong?

Thanks!

SolidworksParts And Features