Understanding of the shape and size of different features of the human body from scanned data is necessary for automated design and evaluation of product ergonomics. In this paper, a computational framework is presented for automatic detection and recognition of important facial feature regions, from scanned head and shoulder polyhedral models. A noise tolerant methodology is proposed using discrete curvature computations, band-pass filtering, and morphological operations for isolation of the primary feature regions of the face, namely, the eyes, nose, and mouth. Spatial disposition of the critical points of these isolated feature regions is analyzed for the recognition of these critical points as the standard landmarks associated with the primary facial features. A number of clinically identified landmarks lie on the facial midline. An efficient algorithm for detection and processing of the midline, using a point sampling technique, is also presented. The results obtained using data of more than 20 subjects are verified through visualization and physical measurements. A color based and triangle skewness based schemes for isolation of geometrically nonprominent features and ear region are also presented.

1.
Robinette
,
K.
,
Blackwell
,
S.
,
Daanen
,
H. A. M.
,
Fleming
,
S.
,
Boehmer
,
M.
,
Brill
,
T.
,
Hoeferlin
,
D.
, and
Burnsides
,
D.
, 2002, “
Civilian American and European Surface Anthropometry Resource(CAESAR), Final Report
,” Report No. AFRL-HE-WP-TR-2002-0169.
2.
Shah
,
J. J.
, 1991, “
Conceptual Development of Form Features and Feature Modelers
,”
Res. Eng. Des.
0934-9839,
2
, pp.
93
108
.
3.
Shah
,
J. J.
, and
Rogers
,
M. T.
, 1993, “
Assembly Modeling as an Extension of Feature-Based Design
,”
Res. Eng. Des.
0934-9839,
5
, pp.
218
237
.
4.
Comey
,
J.
, and
Clark
,
D. E. R.
, 1993, “
Efficient Face-Based Feature Recognition
,”
Proceedings of the ACM on Solid Modeling
, pp.
313
322
.
5.
Regli
,
W. C.
,
Gupta
,
S. K.
, and
Nau
,
D. S.
, 1995, “
Extracting Alternative Machining Features: An Algorithmic Approach
,”
Res. Eng. Des.
0934-9839,
7
(
3
), pp.
173
192
.
6.
Shah
,
J. J.
,
Anderson
,
D.
,
Kim
,
S. Y.
, and
Joshi
,
S.
, 2001, “
A Discourse on Geometric Feature Recognition From CAD Models
,”
ASME J. Comput. Inf. Sci. Eng.
1530-9827,
1
, pp.
41
51
.
7.
Iyer
,
N.
,
Jayanti
,
S.
,
Lou
,
K.
,
Kalyanaraman
,
Y.
, and
Ramani
,
K.
, 2005, “
Shape-Based Searching for Product Lifecycle Applications
,”
Comput.-Aided Des.
0010-4485,
37
(
13
), pp.
1435
1446
.
8.
Zhang
,
E.
,
Mischaikow
,
K.
, and
Turk
,
G.
, 2005, “
Feature Based Surface Parameterization and Texture Mapping
,”
ACM Trans. Graphics
0730-0301,
24
(
1
), pp.
1
27
.
9.
Mitra
,
N. J.
,
Guibas
,
L. J.
, and
Pauly
,
M.
, 2006, “
Partial and Approximate Symmetry Detection for 3D Geometry
,”
Proceedings of the ACM SIGGRAPH
, pp.
560
568
.
10.
Jones
,
J. T.
,
Reidsema
,
C.
, and
Smith
,
A.
, 2006, “
Automated Feature Recognition System for Supporting Conceptual Engineering Design
,”
International Journal of Knowledge-Based and Intelligent Engineering Systems
1327-2314,
10
(
6
), pp.
477
492
.
11.
Gal
,
R.
, and
Cohen-Or
,
D.
, 2006, “
Salient Geometric Features for Partial Shape Matching and Similarity
,”
ACM Trans. Graphics
0730-0301,
25
(
1
), pp.
130
150
.
12.
Langerak
,
T. R.
, and
Vergeest
,
J.
, 2007, “
Feature Recognition of User-Defined Freeform Features
,”
Comput.-Aided Des.
0010-4485,
4
(
1–4
), pp.
529
538
.
13.
Madan
,
J.
,
Rao
,
P. V. M.
, and
Kundra
,
T. K.
, 2007, “
Die-Casting Feature Recognition for Automated Parting Direction and Parting Line Determination
,”
ASME J. Comput. Inf. Sci. Eng.
1530-9827,
7
, pp.
236
248
.
14.
Attene
,
M.
,
Robbiano
,
F.
,
Spagnuolo
,
M.
, and
Falcidieno
,
B.
, 2009, “
Characterization of 3D Shape Parts for Semantic Annotation
,”
Comput.-Aided Des.
0010-4485,
41
, pp.
756
763
.
15.
Brunelli
,
R.
, and
Poggio
,
T.
, 1993, “
Face Recognition: Features Versus Templates
,”
IEEE Trans. Pattern Anal. Mach. Intell.
0162-8828,
15
(
10
), pp.
1042
1052
.
16.
Lin
,
C.
, and
Lin
,
W.
, 1996, “
Extracting Facial Features by an Inhibitory Mechanism Based on Gradient Distributions
,”
Pattern Recogn.
0031-3203,
29
(
12
), pp.
2079
2101
.
17.
Wu
,
H.
,
Yokoyama
,
T.
,
Pramadihanto
,
D.
, and
Yachida
,
M.
, 1996, “
Face and Facial Feature Extraction From Color Image
,”
Proceedings of the Second IEEE International Conference on Automatic Face and Gesture Recognition
, pp.
345
350
.
18.
Yow
,
K. C.
, and
Cipolla
,
R.
, 1997, “
Feature-Based Human Face Detection
,”
Image Vis. Comput.
0262-8856,
15
(
9
), pp.
713
735
.
19.
Jeng
,
S.
,
Liao
,
H. Y.
,
Han
,
C. C.
,
Chern
,
M. Y.
, and
Liu
,
Y. T.
, 1998, “
Facial Feature Detection Using Geometrical Face Model: An Efficient Approach
,”
Pattern Recogn.
0031-3203,
31
(
3
), pp.
273
282
.
20.
Pighin
,
F.
,
Hecker
,
J.
,
Lischinski
,
D.
,
Szeliski
,
R.
, and
Salesin
,
H. D.
, 1998, “
Synthesizing Realistic Facial Expressions From Photographs
,”
Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques
, pp.
75
84
.
21.
Blanz
,
V.
, and
Vetter
,
T.
, 1999, “
A Morphable Model for the Synthesis of 3D Faces
,”
Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques
, pp.
187
194
.
22.
Hjelmas
,
E.
, and
Low
,
B. K.
, 2001, “
Face Detection: A Survey
,”
Comput. Vis. Image Underst.
1077-3142,
83
, p.
236274
.
23.
Shen
,
T.
,
Huang
,
J.
, and
Menq
,
C.
, 2001, “
Multiple-Sensor Planning and Information Integration for Automatic Coordinate Metrology
,”
ASME J. Comput. Inf. Sci. Eng.
1530-9827,
1
, pp.
167
179
.
24.
Wang
,
J.
, and
Sung
,
E.
, 1999, “
Frontal-View Face Detection and Facial Feature Extraction Using Color and Morphological Operations
,”
Pattern Recogn. Lett.
0167-8655,
20
, pp.
1053
1068
.
25.
Cristinance
,
D.
,
Cootes
,
T.
, and
Scott
,
I.
, 2004, “
A Multi-Stage Approach to Facial Feature Detection
,”
Proceedings of the Machine Vision Conference
, pp.
231
240
.
26.
Viola
,
P.
, 2004, “
Robust Real-Time Face Detection
,”
Int. J. Comput. Vis.
0920-5691,
57
(
2
), pp.
137
154
.
27.
Shih
,
F. Y.
, and
Chuang
,
C. F.
, 2004, “
Automatic Extraction of Head and Face Boundaries and Facial Features
,”
Inf. Sci. (N.Y.)
0020-0255,
158
, pp.
117
130
.
28.
Bronstein
,
M. A.
,
Bronstein
,
M. M.
, and
Kimmel
,
R.
, 2006, “
Robust Expression-Invariant Face Recognition From Partially Missing Data, Part III
,”
A.
Leonardis
,
H.
Bischof
, and
A.
Pinz
, eds.,
ECCV 2006, Part III, LNCS 3953
,
Springer-Verlag
,
Berlin Heidelberg
, pp.
396
408
.
29.
Cristinance
,
D.
, and
Cootes
,
T.
, 2006, “
Feature Detection and Tracking With Constrained Local Models
,”
Proceedings of the 17th British Machine Vision Conference
, BMVC 2006, 4-7 September,
Edinburgh
, pp.
929
938
.
30.
Cristinance
,
D.
, and
Cootes
,
T. F.
, 2006, “
Facial Feature Detection and Tracking With Automatic Template Selection
,”
Proceedings of the Seventh International Conference on Automatic Face and Gesture Recognition
, pp.
429
434
.
31.
Wilson
,
P. I.
, and
Fernandez
,
J.
, 2006, “
Facial Feature Detection Using Haar Classifiers
,”
Journal of Computing Sciences in Colleges
1937-4771,
21
(
4
), pp.
127
133
.
32.
Mahoor
,
M. H.
, and
Abdel-Mottaleb
,
M.
, 2006, “
Facial Features Extraction in Color Images Using Enhanced Active Shape Model
,”
Proceedings of the Seventh International Conference on Automatic Face and Gesture Recognition
, FGR'06,
Southampton, UK
, April 10-12, pp.
138
143
.
33.
Chatting
,
D. J.
, 2006, “
Making Recognisable Faces
,”
Proceedings of the Seventh International Conference on Automatic Face and Gesture Recognition
, FGR'06,
Southampton, U
K, April 10-12, pp.
144
148
.
34.
Asteriadis
,
S.
,
Nikolaidis
,
N.
, and
Pitas
,
I.
, 2009, “
Facial Feature Detection Using Distance Vector Fields
,”
Pattern Recogn.
0031-3203,
42
, pp.
1388
1398
.
35.
Xu
,
C.
,
Li
,
S.
,
Tan
,
T.
, and
Quan
,
L.
, 2009, “
Automatic 3D Face Recognition From Depth and Intensity Gabor Features
,”
Pattern Recogn.
0031-3203,
42
, pp.
1895
1905
.
36.
Ren
,
C.
, and
Dai
,
D.
, 2010, “
Incremental Learning of Bidirectional Principal Components for Face Recognition
,”
Pattern Recogn.
0031-3203,
43
, pp.
318
330
.
37.
Lam
,
K. -M.
, and
Yan
,
H.
, 1996, “
Locating and Extracting the Eye in Human Face Images
,”
Pattern Recogn.
0031-3203,
29
(
5
), pp.
771
779
.
38.
Chen
,
H.
, and
Bhanu
,
B.
, 2007, “
Human Ear Recognition in 3D
,”
IEEE Trans. Pattern Anal. Mach. Intell.
0162-8828,
29
(
4
), pp.
718
737
.
39.
Matts
,
P. J.
, 2008, “
New Insights Into Skin Appearance and Measurement
,”
J. Investig. Dermatol. Symp. Proc.
1087-0024,
13
, pp.
6
9
.
40.
Bastys
,
A.
,
Kranauskas
,
J.
, and
Masiulis
,
R.
, 2009, “
Iris Recognition by Local Extremum Points of Multiscale Taylor Expansion
,”
Pattern Recogn.
0031-3203,
42
, pp.
1869
1877
.
41.
Nanni
,
L.
, and
Lumini
,
A.
, 2009, “
Fusion of Color Spaces for Ear Authentication
,”
Pattern Recogn.
0031-3203,
42
, pp.
1906
1913
.
42.
Petajan
,
E.
, and
Graf
,
H. P.
, 1996, “
Robust Face Analysis for Automatic Speechreading and Character Animation
,”
Proceedings of the Second IEEE International Conference on Automatic Face and Gesture Recognition
, Killington, VT, Oct. 14–16, pp.
357
362
.
43.
Baskan
,
S.
,
Bulut
,
M. M.
, and
Atalay
,
V.
, 2002, “
Projection Based Method for Segmentation of Human Face and its Evaluation
,”
Pattern Recogn. Lett.
0167-8655,
23
, pp.
1623
1629
.
44.
Lu
,
X.
,
Jain
,
A.
, and
Colbry
,
D.
, 2006, “
Matching 2.5D Face Scans to 3D Models
,”
IEEE Trans. Pattern Anal. Mach. Intell.
0162-8828,
28
(
1
), pp.
31
43
.
45.
Kakadiaris
,
I. A.
,
Passalis
,
G.
,
Toderici
,
G.
,
Murtuza
,
M. N.
,
Lu
,
Y.
,
Karampatzi-akis
,
N.
, and
Theoharis
,
T.
, 2007, “
Three-Dimensional Face Recognition in the Presence of Facial Expressions: An Annotated Deformable Model Approach
,”
IEEE Trans. Pattern Anal. Mach. Intell.
0162-8828,
29
(
4
), pp.
640
649
.
46.
Chew
,
W. J.
,
Ang
,
L.
, and
Seng
,
K. P.
, 2008, “
Automatic Model Based Face Feature Detection System
,”
Proceedings of the International Symposium on Information Technology
, Vol.
2
, pp.
26
28
.
47.
Colombo
,
A.
,
Cusano
,
C.
, and
Schettini
,
R.
, 2006, “
3D Face Detection Using Curvature Analysis
,”
Pattern Recogn.
0031-3203,
39
, pp.
444
455
.
48.
Tanaka
,
J. W.
, and
Farah
,
M. J.
, 1993, “
Parts and Wholes in Face Recognition
,”
Q. J. Exp. Psychol. A
0272-4987,
46
(
2
), pp.
225
245
.
49.
Wang
,
C. L.
, 2004, “
CyberTape: An Interactive Measurement Tool on Polyhedral Surface
,”
Comput. Graph.
0097-8930,
28
, pp.
731
745
.
50.
Alaa
,
E.
, 2003, “
Statistical Variation of Three Dimensional Face Models
,” MS thesis, IT-University of Copenhagen, Denmark.
51.
Farkas
,
L. G.
, 1995,
Anthropometry of the Head and Face
,
2nd ed.
,
Lippincott Williams & Wilkins
.
52.
Meunier
,
P.
,
Tack
,
D.
,
Ricci
,
A.
,
Bossi
,
L.
, and
Angel
,
H.
, 2000, “
Helmet Accommodation Analysis Using 3D Laser Scanning
,”
Appl. Ergon
0003-6870,
31
, pp.
361
369
.
53.
Flynn
,
P. J.
, and
Jain
,
A. K.
, 1989, “
On Reliable Curvature Estimation
,”
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition
, pp.
110
116
.
54.
Taubin
,
G.
, 2004, “
Estimating the Tensor of Curvature of a Surface From Polyhedral Approximation
,”
Proceedings of the Fifth International Conference on Computer Vision
, pp.
902
907
.
55.
Page
,
D. L.
,
Sun
,
Y.
,
Koschan
,
A. F.
, and
Abidi
,
M. A.
, 2002, “
Normal Vector Voting: Crease Detection and Curvature Estimation on Large, Noisy Meshes
,”
Graphical Models
1524-0703,
64
, pp.
199
229
.
56.
Meyer
,
M.
,
Desbrun
,
M.
,
Schröder
,
P.
, and
Barr
,
A. H.
, 2002, “
Discrete Differential-Geometry Operators for Triangulated 2-Manifolds
,”
Proceedings of International Workshop on Visualization and Mathematics
, Berlin-Dahlem, Germany,
H.
Christian
,
H. K.
Polthier
, eds.,
Springer-Verlag
,
Heidelberg
, pp.
35
57
. (http://www.cs.caltech.edu/~mmeyer/Publications/diffGeomOps.pdfhttp://www.cs.caltech.edu/~mmeyer/Publications/diffGeomOps.pdf).
57.
Gunduz
,
A.
, and
Krim
,
H.
, 2003, “
Facial Feature Extraction Using Topological Methods
,”
Proceedings of the International Conference on Image Processing
, pp.
673
676
.
58.
Rössl
,
C.
,
Kobbelt
,
L.
, and
Seidel
,
H. P.
, 2000, “
Extraction of Feature Lines on Triangulated Surfaces Using Morphological Operators
,”
Proceedings of the 2000 AAAI Symposium
, pp.
71
75
.
59.
2007,
Assessment of the NIOSH Head-and-Face Anthropometric Survey on U.S. Respirator Users
,
J. C.
Bailar
III
,
E. A.
Meyer
, and
R.
Pool
, eds.,
National Academic Press
,
Washington
, pp.
38
40
.
You do not currently have access to this content.