Abstract

This article presents an approach to efficiently control grippers/multifingered hands for dexterous manipulation according to a task, i.e., a predefined trajectory in the object space. The object motion is decomposed using a basis of predefined object motions equivalent to object-level coordinate couplings and leading to the definition of the task-level space. In the proposed approach, the decomposition of the motion in the task space is associated with a robust control design based on linear matrix inequalities (LMIs) and bilinear matrix inequalities (BMIs). Eigenvalue placement ensures the robustness of the system to geometric uncertainties and eigenvector placement decouples the system according to task specifications. A practical evaluation of the proposed control strategy is provided with a two-fingers' and six degrees-of-freedom robotic system manipulating an object in the horizontal plane. Results show a better trajectory tracking and the robustness of the control law according to geometric uncertainties and the manipulation of various objects.

References

1.
Okamura
,
A. M.
,
Smaby
,
N.
, and
Cutkosky
,
M. R.
,
2000
, “
An Overview of Dexterous Manipulation
,”
IEEE International Conference on Robotics and Automation
, Vol.
1
, San Francisco, CA, Apr. 24–28, pp.
255
262
.10.1109/ROBOT.2000.844067
2.
Ozawa
,
R.
, and
Tahara
,
K.
,
2017
, “
Grasp and Dexterous Manipulation of Multi-Fingered Robotic Hands: A Review From a Control View Point
,”
Adv. Rob.
,
31
(
19–20
), pp.
1030
1050
.10.1080/01691864.2017.1365011
3.
Wimböck
,
T.
,
Ott
,
C.
,
Albu-Schäffer
,
A.
, and
Hirzinger
,
G.
,
2012
, “
Comparison of Object-Level Grasp Controllers for Dynamic Dexterous Manipulation
,”
Int. J. Rob. Res.
,
31
(
1
), pp.
3
23
.10.1177/0278364911416526
4.
Li
,
M.
,
2016
, “
Dynamic Grasp Adaptation
,” Ph.D. thesis,
EPFL
, Lausanne, Switzerland.
5.
Todorov
,
E.
, and
Jordan
,
M. I.
,
2002
, “
Optimal Feedback Control as a Theory of Motor Coordination
,”
Nat. Neurosci.
,
5
(
11
), pp.
1226
1235
.10.1038/nn963
6.
Antotsiou
,
D.
,
Garcia-Hernando
,
G.
, and
Kim
,
T.-K.
,
2018
, “
Task- Oriented Hand Motion Retargeting for Dexterous Manipulation Imitation
,”
Proceedings of the European Conference on Computer Vision (ECCV)
, Munich, Germany, Sept.
8
14
.
7.
Grossard
,
M.
,
Felippe
,
G.
,
Hamon
,
G.
, and
Martin
,
J.
,
2013
, “
Force Sensing Strategy for the Backdrivable and Dexterous CEA Hand
,”
IEEE International Conference on Advanced Robotics
, Montevideo, Urugay, Nov. 25–29, pp.
1
7
.10.1109/ICAR.2013.6766555
8.
Cheah
,
C.-C.
,
Han
,
H.-Y.
,
Kawamura
,
S.
, and
Arimoto
,
S.
,
1998
, “
Grasping and Position Control for Multi-Fingered Robot Hands With Uncertain Jacobian Matrices
,”
IEEE International Conference on Robotics and Automation
, Vol.
3
, Leuven, Belgium, May 16–20, pp.
2403
2408
.10.1109/ROBOT.1998.680700
9.
Cheah
,
C.-C.
,
Liu
,
C.
, and
Slotine
,
J.
,
2006
, “
Adaptive Jacobian Tracking Control of Robots With Uncertainties in Kinematic, Dynamic and Actuator Models
,”
IEEE Trans. Autom. Control
,
51
(
6
), pp.
1024
1029
.10.1109/TAC.2006.876943
10.
Yao
,
B.
, and
Tomizuka
,
M.
,
1993
, “
Adaptive Coordinated Control of Multiple Manipulators Handling a Constrained Object
,”
IEEE International Conference on Robotics and Automation
, Atlanta, GA, May 2–6, pp.
624
629
.10.1109/ROBOT.1993.292048
11.
Ueki
,
S.
,
Kawasaki
,
H.
, and
Mouri
,
T.
,
Gifu University, 1-1 Yanagido Gifu, Japan
2009
, “
Adaptive Coordinated Control of Multi-Fingered Robot Hand
,”
J. Rob. Mechatronics
,
21
(
1
), pp.
36
43
.10.20965/jrm.2009.p0036
12.
Van Hoof
,
H.
,
Hermans
,
T.
,
Neumann
,
G.
, and
Peters
,
J.
,
2015
, “
Learning Robot in-Hand Manipulation With Tactile Features
,”
IEEE-RAS 15th International Conference on Humanoid Robots
, Seoul, South Korea, Nov. 3–5, pp.
121
127
.10.1109/HUMANOIDS.2015.7363524
13.
Morgan
,
A. S.
,
Hang
,
K.
,
Bircher
,
W. G.
, and
Dollar
,
A. M.
,
2019
, “
A Data-Driven Framework for Learning Dexterous Manipulation of Unknown Objects
,” IEEE/RSJ International Conference on Intelligent Robots and Systems (
IROS
), Macau, China, Nov.
4
8
.10.1109/IROS40897.2019.8968458
14.
Popov
,
I.
,
Heess
,
N.
,
Lillicrap
,
T.
,
Hafner
,
R.
,
Barth-Maron
,
G.
,
Vecerik
,
M.
,
Lampe
,
T.
,
Tassa
,
Y.
,
Erez
,
T.
, and
Riedmiller
,
M.
,
2017
, “
Data-Efficient Deep Reinforcement Learning for Dexterous Manipulation
,” arXiv preprint arXiv:1704.03073.
15.
Fan
,
Y.
,
Sun
,
L.
,
Zheng
,
M.
,
Gao
,
W.
, and
Tomizuka
,
M.
,
2017
, “
Robust Dexterous Manipulation Under Object Dynamics Uncertainties
,” IEEE International Conference on Advanced Intelligent Mechatronics (
AIM
), Munich, Germany, July 3–7, pp.
613
619
.10.1109/AIM.2017.8014085
16.
Boyd
,
S. P.
,
El Ghaoui
,
L.
,
Feron
,
E.
, and
Balakrishnan
,
V.
,
1994
,
Linear Matrix Inequalities System Control Theory
, Vol.
15
,
Siam
,
Switzerland
.
17.
Buss
,
M.
,
Hashimoto
,
H.
, and
Moore
,
J. B.
,
1996
, “
Dextrous Hand Grasping Force Optimization
,”
IEEE Trans. Rob. Autom.
,
12
(
3
), pp.
406
418
.10.1109/70.499823
18.
Han
,
L.
,
Trinkle
,
J. C.
, and
Li
,
Z. X.
,
2000
, “
Grasp Analysis as Linear Matrix Inequality Problems
,”
IEEE Trans. Rob. Autom.
,
16
(
6
), pp.
663
674
.10.1109/70.897778
19.
Caldas
,
A.
,
Micaelli
,
A.
,
Grossard
,
M.
,
Makarov
,
M.
,
Rodriguez-Ayerbe
,
P.
, and
Dumur
,
D.
,
2015
, “
Object-Level Impedance Control for Dexterous Manipulation With Contact Uncertainties Using an Lmi-Based Approach
,”
IEEE International Conference on Robotics and Automation
, Seattle, WA, May 26–30, pp.
3668
3674
.10.1109/ICRA.2015.7139708
20.
Caldas
,
A.
,
Micaelli
,
A.
,
Grossard
,
M.
,
Makarov
,
M.
,
Rodriguez-Ayerbe
,
P.
, and
Dumur
,
D.
,
2015
, “
On Task-Decoupling by Robust Eigenstructure Assignment for Dexterous Manipulation
,” IEEE/RSJ International Conference on Intelligent Robots and Systems (
IROS
), Hamburg, Germany, Sept. 28–Oct. 2, pp.
5654
5661
.10.1109/IROS.2015.7354180
21.
Murray
,
R. M.
, and
Sastry
,
S. S.
,
1994
,
A Mathematical Introduction to Robotic Manipulation
,
CRC Press, Boca Raton, FL
.
22.
Bullock
,
I. M.
,
Ma
,
R. R.
, and
Dollar
,
A. M.
,
2013
, “
A Hand-Centric Classification of Human and Robot Dexterous Manipulation
,”
IEEE Trans. Haptics
,
6
(
2
), pp.
129
144
.10.1109/TOH.2012.53
23.
Kerr
,
J.
, and
Roth
,
B.
,
1986
, “
Analysis of Multifingered Hands
,”
Int. J. Rob. Res.
,
4
(
4
), pp.
3
17
.10.1177/027836498600400401
24.
Caldas
,
A.
,
Micaelli
,
A.
,
Grossard
,
M.
,
Makarov
,
M.
,
Rodriguez-Ayerbe
,
P.
, and
Dumur
,
D.
,
2014
, “
New Metric for Wrench Space Reachability of Multifingered Hand With Contact Uncertainties
,” IEEE/ASME International Conference on Advanced Intelligent Mechatronics (
AIM
), Besançon, France, July 8–11, pp.
1236
1242
.10.1109/AIM.2014.6878251
25.
Chilali
,
M.
, and
Gahinet
,
P.
,
1996
, “
Hinf Design With Pole Placement Constraints: An LMI Approach
,”
IEEE Trans. Autom. Control
,
41
(
3
), pp.
358
367
.10.1109/9.486637
26.
Caldas
,
A.
,
Makarov
,
M.
,
Grossard
,
M.
, and
Rodriguez-Ayerbe
,
P.
,
2019
, “
LPV Modeling and Control for Dexterous Manipulation With a Multifingered Hand Under Geometric Uncertainties
,” 2019 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (
AIM
), Hong Kong, China, July 8–12, pp.
826
832
.10.1109/AIM.2019.8868786
27.
Yu
,
Z.
,
Chen
,
H.
, and
Woo
,
P.-y.
,
2002
, “
Gain Scheduled Lpv H Control Based on Lmi Approach for a Robotic Manipulator
,”
J. Field Rob.
,
19
(
12
), pp.
585
593
.10.1002/rob.10062
28.
Santello
,
M.
,
Bianchi
,
M.
,
Gabiccini
,
M.
,
Ricciardi
,
E.
,
Salvietti
,
G.
,
Prattichizzo
,
D.
,
Ernst
,
M.
,
Moscatelli
,
A.
,
Jörntell
,
H.
,
Kappers
,
A. M. L.
,
Kyriakopoulos
,
K.
,
Albu-Schäffer
,
A.
,
Castellini
,
C.
, and
Bicchi
,
A.
,
2016
, “
Hand Synergies: Integration of Robotics and Neuroscience for Understanding the Control of Biological and Artificial Hands
,”
Phys. Life Rev.
,
17
, pp.
1
23
.10.1016/j.plrev.2016.02.001
29.
Bicchi
,
A.
,
Gabiccini
,
M.
, and
Santello
,
M.
,
2011
, “
Modelling Natural and Artificial Hands With Synergies
,”
Philos. Trans. R. Soc. B
,
366
(
1581
), pp.
3153
3161
.10.1098/rstb.2011.0152
30.
Gabiccini
,
M.
,
Bicchi
,
A.
,
Prattichizzo
,
D.
, and
Malvezzi
,
M.
,
2011
, “
On the Role of Hand Synergies in the Optimal Choice of Grasping Forces
,”
Auton. Robots
,
31
(
2–3
), pp.
235
252
.10.1007/s10514-011-9244-1
31.
Zhao
,
L.
,
Liu
,
X.
, and
Wang
,
T.
,
2020
, “
Observer-Based Nonlinear Decoupling Control for Two-Joint Manipulator Systems Driven by Pneumatic Artificial Muscles
,”
ASME J. Dyn. Syst., Meas., Control
,
142
(
4
), p.
041001
.10.1115/1.4045701
You do not currently have access to this content.