Panning problem

When I push down the scroll button to pan it moves fine in the x-direction. As soon as I try to zoom in or pan in the Y-direction the screen jumps like it has some kind of setting making it jump 5 pixels. 

Is there a way to remove this? I've been trying with every setting I can find and no positive results yet. 

I really hope anyone can help me. This is really annoying