In the protective glass manufacturing industry for cell phones, placing glass pieces into the slots of the grinder requires submillimeter accuracy which only can be achieved by human workers, leading to a bottle neck in the production line. To address such issue, industrial robot equipped with vision sensors is proposed to support human workers. The high placing performance is achieved by a two step approach. In the first step, an eye-to-hand camera is installed to detect the glass piece and slot with robust vision, which can put the glass piece close to the slot and ensures a primary precision. In the second step, a closed-loop controller based on visual servo is adopted to guide the glass piece into the slot with dual eye-in-hand cameras. However, vision sensor suffers from a very low frame rate and slow image processing speed resulting in a very slow placing performance. In addition, the placing performance is substantially limited by the system parameter uncertainty. To compensate for these limitations, a dual-rate unscented Kalman filter (UKF) with dual-estimation is adopted for sensor data filtering and online parameter identification without requiring any linear parameterization of the model. Experimental results are presented to confirm the effectiveness of the proposed approach.

References

1.
Quarterly
,
M.
,
2016
, “
Where Machines Could Replace Humans and Where They Can't (yet)
,” Digital McKinsey, New York, accessed Sept. 21, 2017, http://www.mckinsey.com/business-functions/digital-mckinsey/our-insights/
2.
McHenry
,
K.
,
Ponce
,
J.
, and
Forsyth
,
D.
,
2005
, “
Finding Glass
,”
IEEE Computer Society Conference on Computer Vision and Pattern Recognition
(
CVPR
), San Diego, CA, June 20–25, pp.
973
979
.
3.
Ihrke
,
I.
,
Kutulakos
,
K. N.
,
Lensch
,
H. P.
,
Magnor
,
M.
, and
Heidrich
,
W.
,
2008
, “
State of the Art in Transparent and Specular Object Reconstruction
,”
EUROGRPAHICS
, Crete, Greece, Apr. 14–18, pp.
87
108
.http://www.cs.toronto.edu/~kyros/pubs/08.eg.star.pdf
4.
Gavin
,
H.
,
2011
, “
The Levenberg–Marquardt Method for Nonlinear Least Squares Curve-Fitting Problems
,” Duke University, Durham, NC.
5.
Corke
,
P.
,
2011
,
Robotics, Vision and Control: Fundamental Algorithms in matlab
, Vol.
73
,
Springer
, Berlin.
6.
Siciliano
,
B.
, and
Khatib
,
O.
,
2008
,
Springer Handbook of Robotics
,
Springer Science & Business Media
, Berlin.
7.
Chaumette
,
F.
, and
Hutchinson
,
S.
,
2006
, “
Visual Servo Control—I: Basic Approaches
,”
IEEE Rob. Autom. Mag.
,
13
(
4
), pp.
82
90
.
8.
Andreff
,
N.
,
Espiau
,
B.
, and
Horaud
,
R.
,
2002
, “
Visual Servoing From Lines
,”
Int. J. Rob. Res.
,
21
(
8
), pp.
679
699
.
9.
Espiau
,
B.
,
Chaumette
,
F.
, and
Rives
,
P.
,
1992
, “
A New Approach to Visual Servoing in Robotics
,”
IEEE Trans. Rob. Autom.
,
8
(
3
), pp.
313
326
.
10.
Wang
,
C.
,
Lin
,
C.-Y.
, and
Tomizuka
,
M.
,
2015
, “
Statistical Learning Algorithms to Compensate Slow Visual Feedback for Industrial Robots
,”
ASME J. Dyn. Syst., Meas., Control
,
137
(
3
), p.
031011
.
11.
Fujii
,
K.
,
2013
, “
Extended Kalman Filter
,”
Reference Manual
, ACFA-Sim-J Group, Japan.
12.
Wan
,
E. A.
, and
Van Der Merwe
,
R.
,
2000
, “
The Unscented Kalman Filter for Nonlinear Estimation
,”
Adaptive Systems for Signal Processing, Communications, and Control Symposium
(
AS-SPCC
), Lake Louise, AB, Canada, Oct. 1–4, pp.
153
158
.
13.
Julier
,
S. J.
, and
Uhlmann
,
J. K.
,
1997
, “
New Extension of the Kalman Filter to Nonlinear Systems
,”
AeroSense
, Orlando, FL, Apr. 20–25, pp.
182
193
.https://www.cs.unc.edu/~welch/kalman/media/pdf/Julier1997_SPIE_KF.pdf
14.
Malis
,
E.
,
Mezouar
,
Y.
, and
Rives
,
P.
,
2010
, “
Robustness of Image-Based Visual Servoing With a Calibrated Camera in the Presence of Uncertainties in the Three-Dimensional Structure
,”
IEEE Trans. Rob.
,
26
(
1
), pp.
112
120
.
15.
Papanikolopoulos
,
N. P.
,
Nelson
,
B. J.
, and
Khosla
,
P. K.
,
1995
, “
Six Degree-of-Freedom Hand/Eye Visual Tracking With Uncertain Parameters
,”
IEEE Trans. Rob. Autom.
,
11
(
5
), pp.
725
732
.
16.
Wang
,
H.
,
Liu
,
Y.-H.
, and
Zhou
,
D.
,
2008
, “
Adaptive Visual Servoing Using Point and Line Features With an Uncalibrated Eye-in-Hand Camera
,”
IEEE Trans. Rob.
,
24
(
4
), pp.
843
857
.
17.
Gonnet
,
G. H.
,
1984
,
Handbook of Algorithms and Data Structures
,
Addison-Wesley
, London.
18.
ABB
,
2016
, “
Programming and Testing-Tools
,” ABB Robotics, Zürich, Switzerland, accessed Sept. 21, 2017, http://developercenter.robotstudio.com/BlobProxy/manuals/IRC5FlexPendantOpManual/doc99.html
19.
Hallenberg
,
J.
,
2007
, “
Robot Tool Center Point Calibration Using Computer Vision
,”
M.Sc. thesis
, Likoping University, Likoping, Sweden.http://www.diva-portal.org/smash/get/diva2:23964/FULLTEXT01.pdf
20.
Fisher
,
B.
,
1997
, “
Projective Transformation
,” University of Edinburgh, Scotland, UK, accessed Sept. 21, 2017, http://homepages.inf.ed.ac.uk/rbf/CVonline/LOCAL_COPIES/BEARDSLEY/node3.html
21.
Illingworth
,
J.
, and
Kittler
,
J.
,
1988
, “
A Survey of the Hough Transform
,”
Comput. Vision, Graphics, Image Process.
,
44
(
1
), pp.
87
116
.
You do not currently have access to this content.