This paper proposes a method for robust hand detection for interactive touchless display using cascade classifier technique. A hardware system comprising a transparent display, two video cameras and a projector is assembled to generate on-display-surface object images for touchless display. A well-trained cascade of boosted classifiers is applied to detect the position of the hand in the object image. Using this method, accurate and robust hand detection for touchless display can be achieved. The detected hand trajectory information can be converted into mouse and keyboard inputs for interactive control and manipulation in virtual applications like virtual assembly and virtual design.

References

References
1.
Wu
,
Y.
, and
Huang
,
T. S.
, 2001, “
Hand Modeling Analysis and Recognition for Vision-Based Human Computer Interaction
,”
IEEE Signal Process. Mag.
,
18
(
3
), pp.
51
60
.
2.
Viola
,
P.
, and
Jones
,
M.
, 2001, “
Robust Real-Time Object Detection
,”
Proceedings Second International Workshop on Statistical and Computational Theories of Vision-Modeling, Learning, Computing, and Sampling
,
Vancouver
,
Canada
.
3.
Kolsch
,
M.
, and
Turk
,
M.
, 2004, “
Fast 2D Hand Tracking with Flocks of Features and Multi-Cue Integration
,”
Proceedings Computer Vision and Pattern Recognition Workshop
,
Washington, DC
.
4.
Dadgostar
,
F.
,
Barczak
,
A. L. C.
, and
Sarrafzadeh
,
A.
, 2005, “
A Colour Hand Gesture Database for Evaluating and Improving Algorithms on Hand Gesture and Posture Recognition
,”
Res. Lett. Inf. Math. Sci.
,
7
, pp.
127
134
.
5.
Francke
,
H.
,
Solar
,
J. R.
, and
Verschae
,
R.
, 2007, “
Real-Time Hand Gesture Detection and Recognition Using Boosted Classifiers and Active Learning
,”
Advances in Image and Video Technology
,
Springer Berlin
/
Heidelberg
, pp.
533
547
.
6.
Loewenich
,
F.
, and
Maire
,
F.
, 2008, “
Motion-Tracking and Speech Recognition for Hands-Free Mouse-Pointer Manipulation
,”
Speech Recognition, Technologies and Applications
,
F.
Mihelic
and
J.
Zibert
, eds.,
I-Tech
,
Vienna
,
Austria
.
7.
Manders
,
C.
,
Farbiz
,
F.
,
Khan
,
I. R.
,
Yuan
,
M.
,
Tang
,
K. Y.
,
Loke
,
M. H.
, and
Chua
,
G. G.
, 2009, “
Tracking a User’s Face and Hands in Three Dimensions in Real Time,” Image Processing: Machine Vision Applications II
,”
Proceedings of SPIE-IS&T Electronic Imaging
,
K. S.
Niel
and
D.
Fofi
, eds., Vol.
72510
, pp.
72510L
.
8.
Wilson
,
A. D.
, 2004, “
TouchLight: An Imaging Touch Screen and Display for Gesture-Based Interaction
,”
Proceedings the 6th International Conference on Multimodal Interfaces
,
State College, PA
, pp.
69
76.
9.
Papageorgiou
,
C.
,
Oren
,
M.
, and
Poggio
,
T.
, 1998, “
A General Framework for Object Detection
,”
Proceedings of International Conference on Computer Vision
, Bombay,
India
, pp.
555
562.
10.
Freund
,
Y.
, and
Schapire
,
R. E.
, 1997, “
A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting
,”
J. Comput. Syst. Sci.
,
55
, pp.
119
139
.
11.
Intel Corporation. OpenCV Computer Vision Library (software). Open source software, http://sourceforge.net/projects/opencv/
You do not currently have access to this content.