Monthly Archives: January 2010

An Electric Field Pretouch System for Grasping and Co-Manipulation

Pretouch is a sense that is longer range than touch, but shorter than vision. Using electric field sensing hardware that I designed to fit inside a robot’s fingers, several robotic manipulation tasks are made easier or possible.

Human-to-robot and robot-to-human handoff

In this work, the robot is programmed to accept an object from a human, and then hand it to another human.

  • First, the e-field pretouch sensors are used to detect the presence of an object that a human is holding up and track the object to center the robot’s hand on it as a human might be moving around.
  • Once the sensors detect that the object has stopped moving, the sensors are again used to servo the positions of the fingers to equal distances from the object’s surface, about a centimeter away. This ensures that when the fingers close, they will make simultaneous contact to avoid displacing the object.
  • After grasping the object, the robot waits for the human to let go before trying to move away. The human holding onto the object provides an AC path to ground, which the e-field sensors can detect. When the human lets go, this current path goes away and is easily observed in the sensor readings.
  • The robot moves its arm to hand the object to another human. Again, the e-field sensors are used to detect whether the human has accepted the object so that it does not let go prematurely.

Picking up stationary objects

We also demonstrated the use of the e-field pretouch sensors to pick up stationary objects from surfaces when only the approximate position of the object is known. Using closed-loop controllers, the sensor inputs are used to correct the positioning of the arm and fingers to facilitate reliable grasps.

Demonstrations

This technology has been featured in several high-profile demos, including:

  • CeBIT opening ceremony, Hannover, Germany March 2009
  • Intel Developer Forum, San Francisco, CA, September 2008
  • Intel Developer Forum, Taipei, Taiwan, October 2008

Videos


Grasping various objects with and without e-field pretouch sensing


E-field handoff demo at the CeBIT 2009 opening ceremony, with Intel Chairmain Craig Barrett, Governor Schwarzenegger, and Chancellor Merkel

Relevant Publications

Mayton, B., LeGrand, L., and Smith, J. 2009. An Electric Field Pretouch System for Grasping and Co-Manipulation. IEEE International Conference on Robotics and Automation, 2010.

 

Enabling Robots to Plug In to Unmodified Electrical Outlets

Using electric field sensing hardware that I designed, I enabled Marvin, Intel Labs Seattle’s mobile manipulation research platform, to plug itself in to ordinary, unmodified electrical outlets. The robot only needs to know the approximate location of an outlet on its 2D map to drive up to it and precisely align the prongs with the holes in the socket by sensing the emitted 60Hz electric field.

Relevant Publications
Mayton, B.D., Legrand, L., and Smith, J. 2009.  Robot, Feed Thyself: Plugging In to Unmodified Electrical Outlets by Sensing Emitted AC Electric FieldsIEEE International Conference on Robotics and Automation, 2010.

Media Coverage
Gizmodo: Intel Robot Finds Wall Socket, Plugs Self In
Seattle Times: Intel Robot’s New Trick