Abstract

A fingernail imaging has been shown to be effective in estimating the finger pad forces along all three directions simultaneously in previous works. However, this method has never been used for the purpose of force measurement during a grasping task with multiple fingers. The objective of this paper is to demonstrate the grasp force-sensing capabilities of the fingernail imaging method integrated with a visual servoing robotic system. In this study, the fingernail imaging method has been used in both constrained and unconstrained multi-digit grasping studies. Visual servoing has been employed to solve the issue of keeping fingernail images in the field of view of the camera during grasping motions. Two grasping experiments have been designed and conducted to show the performance and accuracy of the fingernail imaging method to be used in grasping studies. The maximum value of root-mean-square (RMS) errors for estimated normal and shear forces during constrained grasping has been found to be 0.58 N (5.7%) and 0.49 N (9.2%), respectively. Moreover, a visual servoing system implemented on a 6-degrees-of-freedom (DOF) robot has been devised to ensure that all of the fingers remain in the camera frame at all times. Comparing unconstrained and constrained forces has shown that force collaboration among fingers could change based on the grasping condition.

References

1.
Soechting
,
J. F.
, and
Flanders
,
M.
,
2008
, “
Sensorimotor Control of Contact Force
,”
Curr. Opin. Neurobiol.
,
18
(
6
), pp.
565
572
. 10.1016/j.conb.2008.11.006
2.
Santello
,
M.
,
Bianchi
,
M.
,
Gabiccini
,
M.
,
Ricciardi
,
E.
,
Salvietti
,
G.
,
Prattichizzo
,
D.
,
Ernst
,
M.
,
Moscatelli
,
A.
,
Jörntell
,
H.
,
Kappers
,
A. M. L.
,
Kyriakopoulos
,
K.
,
Albu-Schäffer
,
A.
,
Castellini
,
C.
, and
Bicchi
,
A.
,
2016
, “
Hand Synergies: Integration of Robotics and Neuroscience for Understanding the Control of Biological and Artificial Hands
,”
Phys. Life Rev.
,
17
, pp.
1
23
. 10.1016/j.plrev.2016.02.001
3.
Mojtahedi
,
K.
,
Fu
,
Q.
, and
Santello
,
M.
,
2015
, “
Extraction of Time and Frequency Features From Grip Force Rates During Dexterous Manipulation
,”
IEEE Trans. Biomed. Eng.
,
62
(
5
), pp.
1363
1375
. 10.1109/TBME.2015.2388592
4.
Santello
,
M.
, and
Soechting
,
J. F.
,
2000
, “
Force Synergies for Multifingered Grasping
,”
Exp. Brain Res.
,
133
(
4
), pp.
457
467
. 10.1007/s002210000420
5.
Battaglia
,
E.
,
Bianchi
,
M.
,
Altobelli
,
A.
,
Grioli
,
G.
,
Catalano
,
M. G.
,
Serio
,
A.
,
Santello
,
M.
, and
Bicchi
,
A.
,
2016
, “
Thimblesense: A Fingertip-Wearable Tactile Sensor for Grasp Analysis
,”
IEEE Trans. Haptics
,
9
(
1
), pp.
121
133
. 10.1109/TOH.2015.2482478
6.
Grieve
,
T. R.
,
Hollerbach
,
J. M.
, and
Mascaro
,
S. A.
,
2016
, “
Optimizing Fingernail Imaging Calibration for 3d Force Magnitude Prediction
,”
IEEE Trans. Haptics
,
9
(1), pp.
69
79
. 10.1109/TOH.2015.2468229
7.
Chen
,
N.
,
Urban
,
S.
,
Bayer
,
J.
, and
Van Der Smagt
,
P.
,
2015
, “
Measuring Fingertip Forces From Camera Images for Random Finger Poses
,”
2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
,
Hamburg, Germany
,
Sept. 28–Oct. 2
,
IEEE
, pp.
1216
1221
.
8.
Fallahinia
,
N.
,
Harris
,
S.
, and
Mascaro
,
S.
,
2018
, “
Grasp Force Sensing Using Visual Servoing and Fingernail Imaging
,”
ASME 2018 Dynamic Systems and Control Conference
,
Atlanta, GA
,
Sept. 30–Oct. 3
,
American Society of Mechanical Engineers
,
New York
.
9.
Grieve
,
T. R.
,
Hollerbach
,
J. M.
, and
Mascaro
,
S. A.
,
2015
, “
3-d Fingertip Touch Force Prediction Using Fingernail Imaging With Automated Calibration
,”
IEEE Trans. Rob.
,
31
(
5
), pp.
1116
1129
. 10.1109/TRO.2015.2459411
10.
Grieve
,
T. R.
,
Hollerbach
,
J. M.
, and
Mascaro
,
S. A.
,
2013
, “
Force Prediction by Fingernail Imaging Using Active Appearance Models
,”
World Haptics Conference (WHC)
,
Daejeon, South Korea
,
Apr. 14–17
,
IEEE
, pp.
181
186
.
11.
Chaumette
,
F.
, and
Hutchinson
,
S.
,
2006
, “
Visual Servo Control. i. Basic Approaches
,”
IEEE Rob. Autom. Mag.
,
13
(
4
), pp.
82
90
. 10.1109/MRA.2006.250573
You do not currently have access to this content.