Journal of Intelligent and Robotic Systems: Theory and Applications
Volume 67, Issue 1, 2012, Pages 7-24

Vision-based kidnap recovery with SLAM for home cleaning robots (Article)

Lee S.* , Baek S.
  • a School of Information and Communication Engineering, Department of Interaction Science, Sungkyunkwan University, Suwon, South Korea, Future IT Laboratory, LG Electronics Inc., Seoul, South Korea; School of Information and Communication Engineering, Department of Interaction Science, Sungkyunkwan University, Suwon, South Korea
  • b Future IT Laboratory, LG Electronics Inc., Seoul, South Korea

Abstract

Emerged as salient in the recent home appliance consumer market is a new generation of home cleaning robot featuring the capability of Simultaneous Localization and Mapping (SLAM). SLAM allows a cleaning robot not only to self-optimize its work paths for efficiency but also to self-recover from kidnappings for user convenience. By kidnapping, we mean that a robot is displaced, in the middle of cleaning, without its SLAM aware of where it moves to. This paper presents a vision-based kidnap recovery with SLAM for home cleaning robots, the first of its kind, using a wheel drop switch and an upward-looking camera for low-cost applications. In particular, a camera with a wide-angle lens is adopted for a kidnapped robot to be able to recover its pose on a global map with only a single image. First, the kidnapping situation is effectively detected based on a wheel drop switch. Then, for an efficient kidnap recovery, a coarse-to-fine approach to matching the image features detected with those associated with a large number of robot poses or nodes, built as a map in graph representation, is adopted. The pose ambiguity, e.g., due to symmetry is taken care of, if any. The final robot pose is obtained with high accuracy from the fine level of the coarse-to-fine hierarchy by fusing poses estimated from a chosen set of matching nodes. The proposed method was implemented as an embedded system with an ARM11 processor on a real commercial home cleaning robot and tested extensively. Experimental results show that the proposed method works well even in the situation in which the cleaning robot is suddenly kidnapped during the map building process. © 2011 Springer Science+Business Media B.V.

Author Keywords

Home cleaning robot Global localization SLAM Kidnap recovery

Index Keywords

cleaning Recovery Low cost applications Simultaneous localization and mapping Drops Cameras Pose ambiguities Global localization Cleaning robot Kidnap recoveries Robots Domestic appliances Graph representation Wheels crime robotics SLAM

Link
https://www.scopus.com/inward/record.uri?eid=2-s2.0-84863214274&doi=10.1007%2fs10846-011-9647-4&partnerID=40&md5=45674cba478620466459ff20c70e882f

DOI: 10.1007/s10846-011-9647-4
ISSN: 09210296
Cited by: 21
Original Language: English