Interest in the rehabilitation applications for robots has been increasing. For example, various devices have been developed to aid in reaching movements of stroke, traumatic brain injury (TBI), and spinal cord injury (SCI) patients. Typically these devices provided guided reaching movements for elbow and shoulder. The robotic aspect allows for repeatability, along with additional data for post-session analysis. To date, robotic rehabilitation systems with haptic feedback have not fully exploited the capabilities of a haptic display device. The simulators primarily focus on obeying the physical laws that govern such systems in order to re-create realistic environments for rehabilitative tasks, or the robotic devices are employed only for their ability to carry the impaired limb through various trajectories. This paper will present a novel active assistance paradigm for interactions in virtual environments displayed via haptic interfaces. The author’s recent research efforts have focused on the design of perceptual overlays in virtual environments that are active rather than passive. Passive virtual fixtures have been the primary perceptual overlay in haptics, and have been used extensively as “virtual rulers” in teleoperation environments to improve operator performance of pick-and-place tasks. Active assistance in the form of shared control between the haptic device and the human operator has the potential to elicit even better performance in virtual and remote environment interactions, and also has implications for improving training effectiveness. The intended applications include stroke rehabilitation and training for pilots, manufacturing, and surgery. A description of perceptual overlays and details of the shared control paradigm are presented, along with results from some preliminary experiments on shared control haptic assistance for training in virtual environments.

Volume Subject Area:
Dynamic Systems and Technology
Topics:
Shared control, Virtual reality, Haptics, Overlays (Materials engineering), Robotics, Feedback, Design, Manufacturing, Physical laws, Robots, Spinal cord, Surgery, Traumatic brain injury, Wounds
1.
Massimino
M. J.
and
Sheridan
T. B.
,
Teleoperator performance with varying force and visual feedback
.
Human Factors
,
1994
.
36
(
1
):
145
–
157
.
2.
Richard, P. and P. Coiffet. Human perceptual issues in virtual environments: sensory substitution and information redundancy. in Robot and Human Communication, 1995. RO-MAN’95 TOKYO, Proceedings., 4th IEEE International Workshop on. 1995.
3.
Fabiani, L., et al. Human interface using the Rutgers Master II force feedback interface. in Proceedings of the IEEE 1996 Virtual Reality Annual International Symposium, Mar 30–Apr 3 1996. 1996. Santa Clara, CA, USA: IEEE, Los Alamitos, CA, USA.
4.
Meech
J. F.
and
Solomonides
A. E.
,
User requirements when interacting with virtual objects
.
IEE Colloquium (Digest) Proc. IEE Colloquium on Virtual Reality - User Issues
, Mar 25
1996
, 1996(
068)
: p.
3
3
.
5.
Adams, R.J., D. Klowden, and B. Hannaford, Virtual training for a manual assembly task. Haptics-e, 2001. 2(2).
6.
Williams, L.E.P., et al. Kinesthetic and visual force display for telerobotics. in 2002 IEEE ICRA, May 11–15 2002. 2002.
7.
O’Malley, M.K., et al. Simulated bilateral teleoperation of Robonaut. in AIAA Space 2003. 2003. Long Beach, CA.
8.
Burdea, G., Force and Touch Feedback for Virtual Reality. 1996: Wiley, Inc.
9.
Mahoney
R. M.
, et al.,
Robotic stroke therapy assistant
.
Robotica
,
2003
.
21
: p.
33
–
44
.
10.
Rosenberg, L.B. Virtual fixtures: perceptual tools for telerobotic manipulation. in 1993 IEEE Annual Virtual Reality International Symposium, Sep 18–22 1993. 1993. Seattle, WA, USA: Publ by IEEE, Piscataway, NJ, USA.
11.
Haanpaa
D. P.
and
Roston
G. P.
,
Advanced haptic system for improving man-machine interfaces
.
Computers & Graphics
(Pergamon),
1997
.
21
(
4
): p.
443
–
449
.
12.
Todorov
E.
,
Shadmehr
P.
, and
Bizzi
E.
,
Augmented feedback presented in a virtual environment accelerates learning of a difficult motor task
.
Journal of Motor Behavior
,
1997
.
29
(
2
): p.
147
–
158
.
13.
Bettini, A., et al. Vision assisted control for manipulation using virtual fixtures: Experiments at macro and micro scales. in 2002 IEEE International Conference on Robotics and Automation, May 11–15 2002.
14.
Gillespie, R.B., et al. Virtual teacher. in Proceedings of the 1998 ASME International Mechanical Engineering Congress and Exposition, Nov 15–20 1998. 1998. Anaheim, CA, USA: ASME, Fairfield, NJ, USA.
15.
Yokokohji, Y., et al. Toward machine mediated training of motor skills - skill transfer from human to human via virtual environment. in Proceedings of the 1996 5th IEEE International Workshop on Robot and Human Communication, RO-MAN, Nov 11-14 1996. 1996. Tsukuba, Jpn: IEEE, Piscataway, NJ, USA.
16.
Henmi, K. and T. Yoshikawa. Virtual lesson and its application to virtual calligraphy system. in Proceedings of the 1998 IEEE International Conference on Robotics and Automation. Part 2 (of 4), May 16–20 1998. 1998. Leuven, Belgium: IEEE, Piscataway, NJ, USA.
17.
Kikuuwe, R. and T. Yoshikawa. Haptic display device with fingertip presser for motion/force teaching to human. in 2001 IEEE ICRA, May 21–26 2001. 2001. Seoul.
18.
Huang, F., R.B. Gillespie, and A. Kuo, Haptic Feedback and Human Performance in a Dynamic Task, in Intl Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. 2002. p. 24–31.
19.
Burgar
C. G.
, et al.,
Development of robots for rehabilitation therapy: The Palo Alto VA/Stanford experience
.
Journal of Rehabilitation Research and Development
,
2000
.
37
(
6
): p.
663
–
673
.
20.
Mussa-Ivaldi, F.A. and J.L. Patton. Robots can teach people how to move their arm. in ICRA 2000: IEEE International Conference on Robotics and Automation, Apr 24–Apr 28 2000. 2000. San Francisco, CA, USA:.
21.
Patton, J.L., F.A. Mussa-Ivaldi, and W.Z. Rymer. Altering movement patterns in healthy and brain-injured subjects via custom designed robotic forces. in 23rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Oct 25–28 2001. 2001. Istanbul, Turkey: Kyoto University.
22.
Patton
J. L.
and
Mussa-Ivaldi
F. A.
,
Robot-Assisted Adaptive Training: Custom Force Fields for Teaching Movement Patterns
.
IEEE Transactions on Biomedical Engineering
,
2004
.
51
(
4
): p.
636
–
646
.
23.
Emken
J. L
, and
Reinkensmeyer
D. J.
,
Robot-Enhanced Motor Learning: Accelerating Internal Model Formation During Locomotion by Transient Dynamic Amplification
.
IEEE Transactions on Neural Systems and Rehabilitation Engineering
13
(
1
), pp.
33
–
39
,
2005
.
24.
O’Malley, M.K., A. Gupta, M. Gen, and Y. Li, Shared Control in Haptic Systems for Performance Enhancement and Training, ASME Journal of Dynamic Systems Measurement and Control (to appear), 2005.
25.
Reed, K., M. Peshkin, et al. (2004). Initial studies in human-robot-human interaction: fitts’ law for two people. Robotics and Automation, 2004. Proceedings. ICRA ’04. 2004 IEEE.
26.
Steele, M. and R.B. Gillespie, Shared Control Between Human and Machine: Using a Haptic Steering Wheel to Aid in Land Vehicle Guidance, in Human Factors and Ergonomics Society, 45th Annual Meeting. 2001.
27.
Yoneda, M., et al., Assistance System for Crane Operation with Haptic Display - Operational Assistance to Suppress Round Payload Swing, in IEEE ICRA. 1999. p. 2924–2929.
28.
Dang, T., T.M. Annaswamy, and M.A. Srinivasan. Development and evaluation of an epidural injection simulator with force feedback for medical training. in Medicine Meets Virtual Reality (MMVR). 2001:
29.
Anderson, R.J., Autonomous, Teleoperated and Shared Control of Robot Systems, IEEE Intl Conf Robotics and Automation. 1996. p. 2025–2032.
30.
Tarn
T.-J.
, et al.,
Task-Oriented Human and Machine Cooperation in Telerobotic Systems
.
Annual Reviews in Control
,
1996
.
20
: p.
173
–
178
.
31.
Williams, R.L., II; Harrison, F.W.; Soloway, D.L.;, Shared control of multiple-manipulator, sensor-based telerobotic systems. Robotics and Automation, 1997. Proceedings., 1997 IEEE International Conference on, 1997. Volume: 2(20–25 April 1997): pp. 962–967 vol. 2.
32.
Ambrose
R. O.
, et al.,
Robonaut: NASA’s space humanoid
.
IEEE Intelligent Systems and Their Applications
,
2000
.
15
(
4
): p.
57
–
63
.
33.
Debus, T., et al., Cooperative Human and Machine Perception in Teleoperated Assembly, in Experimental Robotics VII, D. Rus and S. Singh, Editors. 2000, Springer-Verlag.
34.
Goldberg, K., et al., Collaborative Teleoperation via the Internet, in IEEE International Conference on Robotics and Automation. 2000.
35.
Lim, P., et al., Application of Shared Telerobotic Control for Contour Following Process, in Australasian Conference on Robotics and Automation. 2002. p. 88–93.
36.
Griffin, W.B., Shared Control for Dexterous Telemanipulation with Haptic Feedback. 2003, Stanford University.
37.
Griffin, W.B., W.R. Provancher, and M.R. Cutkosky. Feedback strategies for shared control in dexterous telemanipulation. in Proceedings of the IEEE/RSJ Intl Conf on Intelligent Robots and Systems, 2003.
38.
Payandeh, S. (2001). “Application of shared control strategy in the design of a robotic device.” American Control Conference, 2001. Proceedings of the 2001 Volume: 6(25–27 June 2001): pp. 4532–4536 vol. 6.
39.
Nudehi, S.S., R. Mukherjee, and M. Ghodoussi, “A haptic interface design for minimally invasive telesurgical training and collaboration in the presence of time delay,” Proceedings of the 42nd IEEE Conf on Decision and Control, Dec 2003, pp. 4563–4568.
40.
O’Malley, M.K. and A. Gupta, Passive and Active assistance for Human Performance of a Simulated Underactuated Dynamic Task, in International Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. 2003. p. 348–355.
41.
O’Malley, M.K. and A. Gupta, Skill Transfer in a Simulated Underactuated Dynamic Task, in International Workshop on Robot and Human Interactive Communication. 2003. p. 315–320.
42.
Tahboub, K. A. (2001). “Natural and manmade shared-control systems: an overview.” Robotics and Automation, 2001. Proceedings 2001 ICRA. IEEE Volume: 3, 2001: pp. 2655–2660 vol. 3.
43.
Boian, R., A. Sharma, C. Han, A. Merians, G. Burdea, S. Adamovich, M. Recce, M. Tremaine and H. Poizner (2002) “Virtual Reality-Based Post- Stroke Hand Rehabilitation,” Proceedings of Medicine Meets Virtual Reality 2002 Conference, IOS Press, pp. 64–70.
This content is only available via PDF.
Copyright © 2005
 by ASME
You do not currently have access to this content.