» Download Article

Authors
Jacopo Aleotti; Alessandro Melzi; Stefano Caselli

Identifier
10.3182/20060906-3-IT-2910.00066

Index Terms
robot programming by demonstration,telemanipulation,virtual reality

Abstract
This paper presents a virtual reality based system for programming mobile manipulation tasks. The system supports two modes of operation. The first mode implements a virtual reality interface for teleoperation, while the second mode is based on the programming by demonstration paradigm. The system exploits an advanced user interface allowing users with little or no technical expertise to integrate new tasks in a mobile robotic platform. The user can specify trajectories to be performed by the mobile base by means of a natural interface. Moreover the operator can supervise and validate the demonstrated task through a simulation module, thereby reducing errors in the generation process. Some experiments involving the whole set of system components demonstrate the viability and effectiveness of the approach.

References

[1] R. I. Abenavoli, A. Amoroso, H. Kormanski, and
    K. Rudzinska. Mobile platform simulation and
    control via virtual reality. IEEE Proc. on Intelligent
     Transportation Systems, 2:1589-1594,
    12-15 Oct. 2003.
[2] J. Aleotti, S. Caselli, and M. Reggiani. Leveraging
     on a virtual environment for robot programming
     by demonstration. Robotics and Autonomous
     Systems, 47(2-3):153-161, 2004.
[3] I. R. Belousov, R. Chellali, and G. J. Clapworthy.
    Virtual reality tools for internet robotics. IEEE
    International Conference on Robotics and Automation
    , 2:1878-1883, 2001.
[4] R. Dillmann, O. Rogalla, M. Ehrenmann,
    R. Zöllner, and M. Bordegoni. Learning Robot
    Behaviour and Skills Based on Human Demonstration
     and Advice: The Machine Learning
    Paradigm. In 9th Int'l Symp. of Robotics Research
    , 1999.
[5] B. R Duffy, G. M. P. O'Hare, R. P. S. O'Donoghue,
    C. F. B. Rooney, and R. W. Collier. Reality &
    virtual reality in mobile robotics. 1st International
     Workshop on Managing Interactions in
    Smart Environments, MANSE, December 1999.
[6] H. Friedrich, S. Münch, R. Dillmann, S. Bocionek,
    and M. Sassin. Robot Programming by Demonstration:
     Supporting the Induction by Human
    Interaction. Machine Learning, pages 163-189,
    May 1996.
[7] M. Gutierrez, R. Ott, D. Thalmann, and F. Vexo.
    Mediators: virtual haptic interfaces for teleoperated
     robots. 13th IEEE International
    Workshop on Robot and Human Interactive
    Communication, pages 515-520, 20-22 Sept.
    2004.
[8] S. Iba, C. Paredis, and P. Khosla. Interactive
     multimodal robot programming. International
     Journal of Robotics Research, 24(1):83-
    104, January 2005.
[9] K. Ikeuchi and T. Suehiro. Towards an Assembly
    Plan from Observation, Part I: Task Recognition
     with Polyhedral Objects. IEEE Trans. on
    Robotics and Automation, 10(3), 1994.
[10] S. B. Kang. Robot Instruction by Human Demonstration
     . PhD thesis, Carnegie Mellon University,
      December 1994.
[11] Y. Kuniyoshi, M. Inaba, and H. Inoue. Learning
      by Watching: Extracting Reusable Task
     Knowledge from Visual Observation of Human
     Performance. IEEE Trans. on Robotics and
     Automation, 10(6), 1994.
[12] E. Lloyd, J. S. Beis, D. K. Pai, and D. G. Lowe.
     Programming Contact Tasks Using a Reality-Based
      Virtual Environment Integrated with Vision.
      IEEE Trans. on Robotics and Automation,
     15(3), 1999.
[13] J. Miura, K. Iwase, and Y. Shirai. Interactive
     teaching of a mobile robot. IEEE International
     Conference on Robotics and Automation, pages
     3389-3394, 2005.
[14] H. Ogata and T. Takahashi. Robotic Assembly
     Operation Teaching in a Virtual Environment.
     IEEE Trans. on Robotics and Automation, 10
     (3), 1994.
[15] L. Piegl. On NURBS: A Survey. IEEE Computer
     Graphics and Applications, 11(1):55-71, Jan.
     1991.
[16] C. P. Sayers and R. P. Paul. An Operator Interface
      for Teleprogramming Employing Synthetic
     Fixtures. Presence, 3(4), 1994.
[17] T. Takahashi and T. Sakai. Teaching Robot's
     Movement in Virtual Reality. In IEEE/RSJ Int.
     Workshop on Intelligent robots and systems,
     1991.
[18] R. Zöllner, O. Rogalla, R. Dillmann, and
     M. Zöllner. Understanding Users Intention:
     Programming Fine Manipulation Tasks by
     Demonstration. In IEEE/RSJ Int'l Conference
     on Intelligent Robots and Systems, 2002.