Is there a setting somewhere to avoid this mess? I know if you turn off XYZ info it's cleaner but I frequently want the XYZ too.

Sometimes, it's clean and organized, sometimes it's like this.