We present a paradigm for natural and exploratory shape modeling by introducing novel 3D interactions for creating, modifying, and manipulating 3D shapes using arms and hands. Though current design tools provide complex modeling functionalities, they remain nonintuitive for novice users. Significant training is required to use these tools since they segregate 3D shapes into hierarchical 2D inputs, binding the user to stringent procedural steps and making modifications cumbersome. On the other hand, the use of computer-aided design (CAD) systems is typically involved during the final phases of design. This leaves a void in the early design phase wherein the creative exploration is critical. We present a shape creation paradigm as an exploration of creative imagination and externalization of shapes, particularly in the early phases of design. We integrate the capability of humans to express 3D shapes via hand-arm motions with traditional sweep surface representation to demonstrate rapid exploration of a rich variety of 3D shapes. We track the skeleton of users using the depth data provided by low-cost depth sensing camera (Kinect). Our modeling tool is configurable to provide a variety of implicit constraints for shape symmetry and resolution based on the position, orientation, and speed of the arms. An intuitive strategy for shape modifications is also proposed. Our main goal is to help the user to communicate the design intent to the computer with minimal effort. To this end, we conclusively demonstrate the creation of a wide variety of product concepts and show an average modeling time of a only few seconds while retaining the intuitiveness of the design process.

References

References
1.
Engelbart
,
D. C.
,
1970
, “
X-Y Position Indicator for a Display System
,” US 3541541.
2.
van Dam
,
A
.,
1997
, “
Post-WIMP User Interfaces
,”
Commun. ACM
,
40
, pp.
63
67
.10.1145/253671.253708
3.
Jacob
,
R. J. K.
,
Girouard
,
A.
,
Hirshfield
,
L. M.
,
Horn
,
M. S.
,
Shaer
,
O.
,
Solovey
,
E. T.
, and
Zigelbaum
,
J.
,
2008
, “
Reality-Based Interaction: A Framework for Post-WIMP Interfaces
,”
Proceedings of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems, CHI’08, ACM
, pp.
201
210
.
4.
Wigdor
,
D.
, and
Wixon
,
D.
,
2011
,
Brave NUI World: Designing Natural User Interfaces for Touch and Gesture
,
1st
ed.,
Morgan Kaufmann
, Burlington, MA.
5.
Holz
,
C.
, and
Wilson
,
A.
,
2011
, “
Data Miming: Inferring Spatial Object Descriptions From Human Gesture
,”
Proceedings of the 2011 Annual Conference on Human Factors in Computing Systems, CHI’11, ACM
, pp.
811
820
.
6.
Varga
,
E
.,
2008
, “
Using Hand Motions in Conceptual Shape Design: Theories, Methods and Tools
,”
Product Engineering
, D. Talaba and A. Amditis, eds.
Springer
,
Netherlands
, pp.
367
382
.
7.
Schkolne
,
S.
,
Pruett
,
M.
, and
Schröder
,
P.
,
2001
, “
Surface Drawing: Creating Organic 3D Shapes With the Hand and Tangible Tools
,”
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI’01, ACM
, pp.
261
268
.
8.
Fuge
,
M.
,
Yumer
,
M. E.
,
Orbay
,
G.
, and
Kara
,
L. B.
,
2012
, “
Conceptual Design and Modification of Freeform Surfaces Using Dual Shape Representations in Augmented Reality Environments
,”
Comput. Aided Des.
,
44
(
10
), pp.
1020
1032
.10.1016/j.cad.2011.05.009
9.
Suryanarayan
,
P.
,
Subramanian
,
A.
, and
Mandalapu
,
D.
,
2010
, “
Dynamic Hand Pose Recognition Using Depth Data
,”
Proceedings of the 2010 20th International Conference on Pattern Recognition, ICPR'10, IEEE Computer Society
, pp.
3105
3108
.
10.
Oikonomidis
,
I.
,
Kyriazis
,
N.
, and
Argyros
,
A.
,
2011
, “
Efficient Model-Based 3D Tracking of Hand Articulations Using Kinect
,” J. Hoey, S. McKenna and E. Trucco, eds.,
Proceedings of the British Machine Vision Conference
,
BMVA Press
, pp.
101.1
101.11
.10.5244/C.25.101
11.
Shotton
,
J.
,
Fitzgibbon
,
A.
,
Cook
,
M.
,
Sharp
,
T.
,
Finocchio
,
M.
,
Moore
,
R.
,
Kipman
,
A.
, and
Blake
,
A.
,
2011
, “
Real-Time Human Pose Recognition in Parts From Single Depth Images
,”
Comput. Vision Patt. Recog.
, pp.
1297
1304
.
12.
Horváth
,
I.
,
2004
, “
On Some Crucial Issues of Computer Support of Conceptual Design
,”
Product Engineering
,
D.
Talabă
, and
T.
Roche
, eds.,
Springer
,
Netherlands
, pp.
123
142
.
13.
Seth
,
A.
,
Vance
,
J.
, and
Oliver
,
J.
,
2011
, “
Virtual Reality for Assembly Methods Prototyping: A Review
,”
Virtual Reality
,
15
, pp.
5
20
.10.1007/s10055-009-0153-y
14.
Mäntylä
,
M.
,
1987
,
An Introduction to Solid Modeling
,
Computer Science Press, Inc.
,
New York
.
15.
Rogers
,
D. F.
, and
Adams
,
J. A.
,
1989
,
Mathematical Elements for Computer Graphics
,
2nd
ed.
McGraw-Hill Higher Education
, Columbus, OH.
16.
Chang
,
T.-I.
,
Lee
,
J.-H.
,
Kim
,
M.-S.
, and
Hong
,
S. J.
,
1998
, “
Direct Manipulation of Generalized Cylinders Based on B-Spline Motion
,”
Visual Comput.
,
14
(
5/6
), pp.
228
239
.10.1007/s003710050137
17.
Hyun
,
D.-E.
,
Yoon
,
S.-H.
,
Chang
,
J.-W.
,
Seong
,
J.-K.
,
Kim
,
M.-S.
, and
Jüttler
,
B.
,
2005
, “
Sweep-Based Human Deformation
,”
Visual Comput.
,
21
(
8–10
), pp.
542
550
.10.1007/s00371-005-0343-x
18.
Yoon
,
S.-H.
, and
Kim
,
M.-S.
,
2006
, “
Sweep-Based Freeform Deformations
,”
Comput. Graph. Forum
,
25
(
3
), pp.
487
496
.10.1111/j.1467-8659.2006.00968.x
19.
Han
,
L.
, and
Rudolph
,
L.
,
2006
, “
Inverse Kinematics for a Serial Chain With Joints Under Distance Constraints
,”
Proceedings of Robotics: Science and Systems
,
G. S.
Sukhatme
,
S.
Schaal
,
W.
Burgard
, and
D.
Fox
eds.,
The MIT Press
, Cambridge, MA.
20.
Han
,
L.
, and
Rudolph
,
L.
,
2007
, “
A Unified Geometric Approach for Inverse Kinematics of a Spatial Chain With Spherical Joints
,”
2007 IEEE International Conference on Robotics and Automation, ICRA 2007
, April 10–14,
2007
, Roma, Italy, pp.
4420
4427
.
You do not currently have access to this content.