This paper provides a natural, yet low-cost way for human to interact with electronic devices indoor: the development of a human-following mobile robot capable of controlling other electrical devices for the user based on the user’s gesture commands. The overall experimental setup consists of a skid-steered mobile robot, Kinect sensor, laptop, wide-angle camera and two lamps. The OpenNI middleware is used to process data from the Kinect sensor, and the OpenCV is used to process data from the wide-angle camera. A new human-following algorithm is proposed based on human motion estimation. The human-following control system consists of two feedback control loop for linear and rotational motions, respectively. A lead-lag and lead controller are developed for the linear and rotational motion control loop, respectively. Experimental results show that the tracking algorithm is robust and reduced the distance and angular error by 40% and 50%, respectively. There are small delays (0.5 s for linear motion and 1.5 s for rotational motion) and steady-state errors (0.1 m for linear motion and 1.5° for rotational motion) of the system’s response. However, the delays and errors are acceptable since they do not cause the tracking distance or angle out of the desirable range (±0.05m and ±10° of the reference input). There are four gestures designed for the user to control the robot, two switch-mode gestures, lamp-creation, lamp-selection and color change gesture. Success rates of gesture recognition are more than 90% within the detectable range of the Kinect sensor.
- Dynamic Systems and Control Division
Development of a Mobile Robot Providing a Natural Way to Interact With Electronic Devices
Chen, J, & Kim, W. "Development of a Mobile Robot Providing a Natural Way to Interact With Electronic Devices." Proceedings of the ASME 2016 Dynamic Systems and Control Conference. Volume 1: Advances in Control Design Methods, Nonlinear and Optimal Control, Robotics, and Wind Energy Systems; Aerospace Applications; Assistive and Rehabilitation Robotics; Assistive Robotics; Battery and Oil and Gas Systems; Bioengineering Applications; Biomedical and Neural Systems Modeling, Diagnostics and Healthcare; Control and Monitoring of Vibratory Systems; Diagnostics and Detection; Energy Harvesting; Estimation and Identification; Fuel Cells/Energy Storage; Intelligent Transportation. Minneapolis, Minnesota, USA. October 12–14, 2016. V001T03A003. ASME. https://doi.org/10.1115/DSCC2016-9751
Download citation file: