Pretty simple; the mouse panning in game is great, but it works completely backwards compared to what i'm used to from panning around images in gimp or any other art program, google maps, what have you.
I guess it can be described as: you have, mouse moves map camera, everyone else does, mouse moves map under camera.