In the protective glass manufacturing industry for cell phones, placing glass pieces into the slots of the grinder requires submillimeter accuracy which only can be achieved by human workers, leading to a bottle neck in the production line. To address such issue, industrial robot equipped with vision sensors is proposed to support human workers. The high placing performance is achieved by a two step approach. In the first step, an eye-to-hand camera is installed to detect the glass piece and slot with robust vision, which can put the glass piece close to the slot and ensures a primary precision. In the second step, a closed-loop controller based on visual servo is adopted to guide the glass piece into the slot with dual eye-in-hand cameras. However, vision sensor suffers from a very low frame rate and slow image processing speed resulting in a very slow placing performance. In addition, the placing performance is substantially limited by the system parameter uncertainty. To compensate for these limitations, a dual-rate unscented Kalman filter (UKF) with dual-estimation is adopted for sensor data filtering and online parameter identification without requiring any linear parameterization of the model. Experimental results are presented to confirm the effectiveness of the proposed approach.
Skip Nav Destination
Article navigation
April 2018
Research-Article
Fast and Precise Glass Handling Using Visual Servo With Unscented Kalman Filter Dual Estimation
Xiaowen Yu,
Xiaowen Yu
Mechanical System Control Laboratory,
Department of Mechanical Engineering,
University of California,
Berkeley, CA 94720
e-mail: aliceyu@berkeley.edu
Department of Mechanical Engineering,
University of California,
Berkeley, CA 94720
e-mail: aliceyu@berkeley.edu
Search for other works by this author on:
Thomas Baker,
Thomas Baker
Department of Mechanical Engineering,
Technische Universität München,
Munich D-80333, Germany
e-mail: tom.baker@tum.de
Technische Universität München,
Munich D-80333, Germany
e-mail: tom.baker@tum.de
Search for other works by this author on:
Yu Zhao,
Yu Zhao
Mechanical System Control Laboratory,
Department of Mechanical Engineering,
University of California,
Berkeley, CA 94720
e-mail: yzhao334@berkeley.edu
Department of Mechanical Engineering,
University of California,
Berkeley, CA 94720
e-mail: yzhao334@berkeley.edu
Search for other works by this author on:
Masayoshi Tomizuka
Masayoshi Tomizuka
Professor
Department of Mechanical Engineering,
University of California,
Berkeley, CA 94720
e-mail: tomizuka@berkeley.edu
Department of Mechanical Engineering,
University of California,
Berkeley, CA 94720
e-mail: tomizuka@berkeley.edu
Search for other works by this author on:
Xiaowen Yu
Mechanical System Control Laboratory,
Department of Mechanical Engineering,
University of California,
Berkeley, CA 94720
e-mail: aliceyu@berkeley.edu
Department of Mechanical Engineering,
University of California,
Berkeley, CA 94720
e-mail: aliceyu@berkeley.edu
Thomas Baker
Department of Mechanical Engineering,
Technische Universität München,
Munich D-80333, Germany
e-mail: tom.baker@tum.de
Technische Universität München,
Munich D-80333, Germany
e-mail: tom.baker@tum.de
Yu Zhao
Mechanical System Control Laboratory,
Department of Mechanical Engineering,
University of California,
Berkeley, CA 94720
e-mail: yzhao334@berkeley.edu
Department of Mechanical Engineering,
University of California,
Berkeley, CA 94720
e-mail: yzhao334@berkeley.edu
Masayoshi Tomizuka
Professor
Department of Mechanical Engineering,
University of California,
Berkeley, CA 94720
e-mail: tomizuka@berkeley.edu
Department of Mechanical Engineering,
University of California,
Berkeley, CA 94720
e-mail: tomizuka@berkeley.edu
Contributed by the Dynamic Systems Division of ASME for publication in the JOURNAL OF DYNAMIC SYSTEMS, MEASUREMENT, AND CONTROL. Manuscript received March 9, 2017; final manuscript received August 12, 2017; published online November 10, 2017. Assoc. Editor: Heikki Handroos.
J. Dyn. Sys., Meas., Control. Apr 2018, 140(4): 041008 (10 pages)
Published Online: November 10, 2017
Article history
Received:
March 9, 2017
Revised:
August 12, 2017
Citation
Yu, X., Baker, T., Zhao, Y., and Tomizuka, M. (November 10, 2017). "Fast and Precise Glass Handling Using Visual Servo With Unscented Kalman Filter Dual Estimation." ASME. J. Dyn. Sys., Meas., Control. April 2018; 140(4): 041008. https://doi.org/10.1115/1.4037734
Download citation file:
Get Email Alerts
Cited By
Offline and online exergy-based strategies for hybrid electric vehicles
J. Dyn. Sys., Meas., Control
Optimal Control of a Roll-to-Roll Dry Transfer Process With Bounded Dynamics Convexification
J. Dyn. Sys., Meas., Control (May 2025)
In-Situ Calibration of Six-Axis Force/Torque Transducers on a Six-Legged Robot
J. Dyn. Sys., Meas., Control (May 2025)
Active Data-enabled Robot Learning of Elastic Workpiece Interactions
J. Dyn. Sys., Meas., Control
Related Articles
Nonlinear Robust Output Stabilization for Mechanical Systems Based on Luenberger-Like Controller/Observer
J. Dyn. Sys., Meas., Control (August,2017)
Nonlinear Parameters and State Estimation for Adaptive Nonlinear Model Predictive Control Design
J. Dyn. Sys., Meas., Control (April,2016)
Adaptive-Robust Stabilization of the Furuta's Pendulum Via Attractive Ellipsoid Method
J. Dyn. Sys., Meas., Control (February,2016)
Robust Control of Uncertain Nonlinear Systems: A Nonlinear DOBC Approach
J. Dyn. Sys., Meas., Control (July,2016)
Related Proceedings Papers
Related Chapters
Fault-Tolerant Control of Sensors and Actuators Applied to Wind Energy Systems
Electrical and Mechanical Fault Diagnosis in Wind Energy Conversion Systems
QP Based Encoder Feedback Control
Robot Manipulator Redundancy Resolution
Feedback-Aided Minimum Joint Motion
Robot Manipulator Redundancy Resolution