Abstract

This paper develops a robotic cognitive rehabilitation therapy (CRT) system to assist patients with mild cognitive impairment (MCI) in block design test (BDT) rehabilitation training. This system bridges the treatment gap that occurs when one physician has several patients to attend to. One physician can setup the BDT training task and simultaneously monitor the training progress of several patients with MCI, which forms an effective one-to-many rehabilitation model. A target information acquisition method is designed to realize target detection and position extraction in automatic rehabilitation. Two graphic user interfaces (GUIs) are developed to provide intuitive control and immediate visual feedback. Different BDTs are selected from the benchmark by the physician in an integrated GUI (I-GUI) and are assigned to several patient GUIs (P-GUIs), respectively. During training, automatic visual assistance can be triggered by the help button and the patients can be guided in finding the target block. Additionally, a robotic arm could be engaged to further help with teaching so that patients can follow the instructions given by the P-GUI and imitate the demonstration given by the robot arm to finish the training task. This system converts traditional MCI rehabilitation into an automatic process, creating an effective model of BDT training for MCI rehabilitation.

References

1.
Jelic
,
V.
,
Kivipelto
,
M.
, and
Winblad
,
B.
,
2006
, “
Clinical Trials in Mild Cognitive Impairment: Lessons for the Future
,”
J. Neurol., Neurosurg. Psychiatry
,
77
(
4
), pp.
429
438
.10.1136/jnnp.2005.072926
2.
Qiu
,
F.
,
Wei
,
Q.
,
Zhao
,
L.
, and
Lin
,
L.
,
2009
, “
Study on Improving Fluid Intelligence Through Cognitive Training System Based on Gabor Stimulus
,”
First International Conference on Information Science and Engineering
, Nanjing, China, Dec. 26–28, pp.
3459
3462
.10.1109/ICISE.2009.1124
3.
Bright
,
P.
,
Hale
,
E.
,
Gooch
,
V. J.
,
Myhill
,
T.
, and
van der Linde
,
I.
,
2018
, “
The National Adult Reading Test: Restandardisation Against the Wechsler Adult Intelligence Scale-Fourth Edition
,”
Neuropsychol. Rehabil.
,
28
(
6
), pp.
1019
1027
.10.1080/09602011.2016.1231121
4.
Pangman
,
V. C.
,
Sloan
,
J.
, and
Guse
,
L.
,
2000
, “
An Examination of Psychometric Properties of the Mini-Mental State Examination and the Standardized Mini-Mental State Examination: Implications for Clinical Practice
,”
Appl. Nurs. Res.
,
13
(
4
), pp.
209
213
.10.1053/apnr.2000.9231
5.
Nasreddine
,
Z. S.
,
Phillips
,
N. A.
,
Bã©Dirian
,
VéR.
,
Charbonneau
,
S.
,
Whitehead
,
V.
,
Collin
,
I.
,
Cummings
,
J. L.
, and
Chertkow
,
H.
,
2005
, “
The Montreal Cognitive Assessment, Moca: A Brief Screening Tool for Mild Cognitive Impairment
,”
J. Am. Geriatr. Soc.
,
53
(
4
), pp.
695
699
.10.1111/j.1532-5415.2005.53221.x
6.
Mallo
,
S. C.
,
Ismail
,
Z.
,
Pereiro
,
A. X.
,
Facal
,
D.
,
Lojo-Seoane
,
C.
,
Campos-Magdaleno
,
M.
, and
Juncos-Rabadán
,
O.
,
2019
, “
Assessing Mild Behavioral Impairment With the Mild Behavioral Impairment Checklist in People With Subjective Cognitive Decline
,”
Int. Psychogeriatr.
,
31
(
2
), pp.
231
239
.10.1017/S1041610218000698
7.
Kaufman
,
A. S.
,
1983
, “
Test Review: Wechsler, D. Manual for the Wechsler Adult Intelligence Scale, Revised. New York: Psychological Corporation, 1981
,”
J. Psychoeduc. Assess.
,
1
(
3
), pp.
309
313
.10.1177/073428298300100310
8.
Groth-Marnat
,
G.
, and
Teal
,
M.
,
2000
, “
Block Design as a Measure of Everyday Spatial Ability: A Study of Ecological Validity
,”
Perceptual Motor Skills
,
90
(
2
), pp.
522
526
.10.2466/pms.2000.90.2.522
9.
Sharlin
,
E.
,
Itoh
,
Y.
,
Watson
,
B.
,
Kitamura
,
Y.
,
Sutphen
,
S.
,
Liu
,
L.
, and
Kishino
,
F.
,
2004
, “
Spatial Tangible User Interfaces for Cognitive Assessment and Training
,”
International Workshop on Biologically Inspired Approaches to Advanced Information Technology
, Lausanne, Switzerland, Jan. 29–30, pp.
137
152
.10.1007/978-3-540-27835-1_11
10.
Caron
,
M.-J.
,
Mottron
,
L.
,
Berthiaume
,
C.
, and
Dawson
,
M.
,
2006
, “
Cognitive Mechanisms, Specificity and Neural Underpinnings of Visuospatial Peaks in Autism
,”
Brain
,
129
(
7
), pp.
1789
1802
.10.1093/brain/awl072
11.
Cardillo
,
R.
,
Mammarella
,
I. C.
,
Garcia
,
R. B.
, and
Cornoldi
,
C.
,
2017
, “
Local and Global Processing in Block Design Tasks in Children With Dyslexia or Nonverbal Learning Disability
,”
Res. Dev. Disabil.
,
64
, pp.
96
107
.10.1016/j.ridd.2017.03.011
12.
Kanno
,
K. M.
,
Lamounier
,
E. A.
,
Cardoso
,
A.
,
Lopes
,
E. J.
, and
de Lima
,
G. F. M.
,
2018
, “
Augmented Reality System for Aiding Mild Alzheimer Patients and Caregivers
,” IEEE Conference on Virtual Reality and 3D User Interfaces (
VR
), Reutlingen, Germany, Mar. 18–22, pp.
593
594
.10.1109/VR.2018.8446143
13.
Cristina Nascimento Dourado
,
M.
, and
Laks
,
J.
,
2016
, “
Psychological Interventions for Neuropsychiatric Disturbances in Mild and Moderate Alzheimer's Disease: Current Evidences and Future Directions
,”
Curr. Alzheimer Res.
,
13
(
10
), pp.
1100
1111
.10.2174/1567205013666160728143123
14.
Kubota
,
N.
,
Botzheim
,
J.
, and
Obo
,
T.
,
2012
, “
Human Motion Tracking and Feature Extraction for Cognitive Rehabilitation in Informationally Structured Space
,”
Ninth France-Japan and Seventh Europe-Asia Congress on Mechatronics (MECATRONICS)/13th International Workshop on Research and Education in Mechatronics (REM)
, Paris, France, Nov. 21–23, pp.
464
471
. 10.1109/MECATRONICS.2012.6451049
15.
Chan
,
J.
, and
Nejat
,
G.
,
2012
, “
Social Intelligence for a Robot Engaging People in Cognitive Training Activities
,”
Int. J. Adv. Rob. Syst.
,
9
(
4
), p.
113
.10.5772/51171
16.
Rudzicz
,
F.
,
Wang
,
R.
,
Begum
,
M.
, and
Mihailidis
,
A.
,
2014
, “
Speech Recognition in Alzheimer's Disease With Personal Assistive Robots
,”
Proceedings of the Fifth Workshop on Speech and Language Processing for Assistive Technologies
, Baltimore, MD, June, pp.
20
28
.10.3115/v1/W14-1904
17.
Andriella
,
A.
,
Alenyà
,
G.
,
Hernández-Farigola
,
J.
, and
Torras
,
C.
,
2018
, “
Deciding the Different Robot Roles for Patient Cognitive Training
,”
Int. J. Human-Comput. Stud.
,
117
, pp.
20
29
.10.1016/j.ijhcs.2018.03.004
18.
Serbin
,
L. A.
, and
Connor
,
J. M.
,
1979
, “
Sex-Typing of Children's Play Preferences and Patterns of Cognitive Performance
,”
J. Genetic Psychol.
,
134
(
2
), pp.
315
316
.10.1080/00221325.1979.10534065
19.
Drozdick
,
L. W.
,
Wahlstrom
,
D.
,
Zhu
,
J.
, and
Weiss
,
L. G.
,
2012
, “
The Wechsler Adult Intelligence Scale-Fourth Edition and the Wechsler Memory Scale
,”
4th edition
, Contemporary Intellectual Assessment: Theories, Tests, and Issues, The Guilford Press, New York, pp.
197
223
.https://psycnet.apa.org/record/2018-36604-016
20.
Zhu
,
H. G.
, and
Feng
,
Q.
,
2013
, “
A Video Bit Rate Control Algorithm Based on Weighted Estimate of Image Brightness Difference
,”
Appl. Mech. Mater.
,
347
, pp.
844
848
.10.4028/www.scientific.net/AMM.347-350.844
21.
Chen
,
H.-D.
,
Wang
,
Y.-F.
,
Guo
,
Z.
,
Chen
,
W.-X.
, and
Zhao
,
P.
,
2018
, “
A GUI Software for Automatic Assembly Based on Machine Vision
,” IEEE International Conference on Mechatronics, Robotics and Automation (
ICMRA
), Hefei, China, May 18–21, pp.
105
111
.10.1109/ICMRA.2018.8490562
22.
Chen
,
H.
,
Teng
,
Z.
,
Guo
,
Z.
, and
Zhao
,
P.
,
2020
, “
An Integrated Target Acquisition Approach and Graphical User Interface Tool for Parallel Manipulator Assembly
,”
ASME J. Comput. Inf. Sci. Eng.
,
20
(
2
), p. 021006.10.1115/1.4045411
23.
Peng
,
L.
, and
Liu
,
J.
,
2018
, “
Detection and Analysis of Large-Scale wt Blade Surface Cracks Based on Uav-Taken Images
,”
IET Image Process.
,
12
(
11
), pp.
2059
2064
.10.1049/iet-ipr.2018.5542
24.
Gong
,
S.
,
Li
,
G.
,
Zhang
,
Y.
,
Li
,
C.
, and
Yu
,
L.
,
2019
, “
Application of Static Gesture Segmentation Based on an Improved Canny Operator
,”
J. Eng.
,
2019
(
15
), pp.
543
546
.10.1049/joe.2018.9377
25.
Zhang
,
D.
, and
Lu
,
G.
,
2003
, “
A Comparative Study of Curvature Scale Space and Fourier Descriptors for Shape-Based Image Retrieval
,”
J. Visual Commun. Image Representation
,
14
(
1
), pp.
39
57
.10.1016/S1047-3203(03)00003-8
You do not currently have access to this content.