"Moved at all" turns out to be a far cry from moved enough to matter, and moved fast enough to matter. Remember that the voltage generated will be related to the magnetic field strength, the distance from magnet to conductors, and the speed of the movement. From the start, this seemed like a theoretical concern totally swamped by the reality that the magnet would carefully, that is probably slowly, be placed in one place and not moved again. That kind of motion would inspire one very low voltage pulse of very rounded wave form.