Don’t watch the video after the jump if you’ve recently seen a Terminator movie – because it’s becoming clear that if the robots come after us, there’ll be no stopping them. The video shows an incredible array of three-fingered robot hand/eye co-ordination exercises, including throwing and catching, spinning pens, tying knots and dribbling a ping-pong ball. The Ishikawa Komuro laboratory at the University of Tokyo put these videos together to demonstrate the incredibly quick parallel processing they are achieving with a mix of visual and tactile sensory inputs. Astounding stuff. Sarah Connor, you’re in deep trouble.
Our own human dexterity is based on the super-quick combination of a number of sensory inputs – we make calculations of trajectory, balance and movement so quickly that we become unaware we’re even thinking about them, and act totally by instinct.
Take the act of catching a spinning mobile phone, like the robot in the video manages so successfully. Our eyes are relaying us stereo images of the phone’s path through the air. We are simultaneously calculating its arc through the air, its spin on three axes, how these relate to the position of our eyes, what this means compared to the positions of our hands, how to move the hand into the projected trajectory, and when to close our fingers to catch the phone … among many, many other things.
The fact that our human machinery can do this so instinctively is one of the many magical marvels of evolution – but watching a computer-controlled robot, programmed by humans, learning to piece these parallel tasks together is more amazing still.
Most of the robot’s motions are managed so quickly that you’ve got to watch them in slow-motion to appreciate them. And once you do, you get a sense of the complexity of what the robot is managing to achieve. This stuff is absolutely mind-bending.