This paper presents a novel human arm gesture tracking and recognition technique based on fuzzy logic and nonlinear Kalman filtering with applications in crane guidance. Kinect visual sensor and MYO armband sensor are jointly utilized to perform data fusion in providing more accurate and reliable information on Euler angles, angular velocity, linear acceleration and electromyography data in real-time. Dynamic equations for arm gesture movement are formulated with Newton-Euler equations based on Denavit-Hartenberg parameters. Nonlinear Kalman filtering techniques, including the extended Kalman filter and the unscented Kalman filter, are applied to perform reliable sensor fusion, and their tracking accuracies are compared. A Sugeno-type fuzzy inference system is proposed for arm gestures recognition. Hardware experiments have shown the efficacy of proposed method for crane guidance applications.
- Dynamic Systems and Control Division
Crane Guidance Gesture Tracking and Recognition With Nonlinear Estimation and Fuzzy Logic Available to Purchase
Wang, X, Gordon, C, & Yaz, EE. "Crane Guidance Gesture Tracking and Recognition With Nonlinear Estimation and Fuzzy Logic." Proceedings of the ASME 2018 Dynamic Systems and Control Conference. Volume 2: Control and Optimization of Connected and Automated Ground Vehicles; Dynamic Systems and Control Education; Dynamics and Control of Renewable Energy Systems; Energy Harvesting; Energy Systems; Estimation and Identification; Intelligent Transportation and Vehicles; Manufacturing; Mechatronics; Modeling and Control of IC Engines and Aftertreatment Systems; Modeling and Control of IC Engines and Powertrain Systems; Modeling and Management of Power Systems. Atlanta, Georgia, USA. September 30–October 3, 2018. V002T21A001. ASME. https://doi.org/10.1115/DSCC2018-8932
Download citation file: