Erratic Joystick operation

Has anyone else had issues with moving the spindle/router around with the joystick and when the move command is complete the machine on its own starts to slowly returning either in a firm Y or X direction without stopping until it starts driving itself into the hard stop limits? Or when sliding in a Y firm direction, while in motion, it jumps at least -0.2 inches in the X direction along with -0.2 inches in the Z direction, or if moving in X firm direction it jumps the -0.2 inches in the Y and Z direction? I have only had erratic operation when the joystick is involved. Its a onefinity wired joystick. Not sure if it is the controller or joystick.

Sounds like stick drift