The connector plug of the Wii MotionPlus is loose or unsteady.
To avoid connection problems with the Wii Remote's external extension connector, the Wii MotionPlus's connector plug is designed to move forward, backwards, left and right. This is not a failure of your hardware, and Wii MotionPlus can be used normally.