We compare the performance of human players against that of the efficient global optimization (EGO) algorithm for an NP-complete powertrain design and control problem. Specifically, we cast this optimization problem as an online competition and received 2391 game plays by 124 anonymous players during the first month from launch. We found that while only a small portion of human players can outperform the algorithm in the long term, players tend to formulate good heuristics early on that can be used to constrain the solution space. Such constraining of the search enhances algorithm efficiency, even for different game settings. These findings indicate that human-assisted computational searches are promising in solving comprehensible yet computationally hard optimal design and control problems, when human players can outperform the algorithm in a short term.

References

References
1.
Bayrak
,
A. E.
,
Ren
,
Y.
, and
Papalambros
,
P. Y.
,
2013
, “
Design of Hybrid-Electric Vehicle Architecture Using Auto-Generation of Feasible Driving Modes
,”
ASME
Paper No. DETC2013-13043.
2.
Larsen
,
U. D.
,
Signund
,
O.
, and
Bouwsta
,
S.
,
1997
, “
Design and Fabrication of Compliant Micromechanisms and Structures With Negative Poisson's Ratio
,”
J. Microelectromech. Syst.
,
6
(
2
), pp.
99
106
.
3.
Miskin
,
M. Z.
, and
Jaeger
,
H. M.
,
2013
, “
Adapting Granular Materials Through Artificial Evolution
,”
Nat. Mater.
,
12
(
4
), pp.
326
331
.
4.
Schneider
,
G.
, and
Fechner
,
U.
,
2005
, “
Computer-Based De Novo Design of Drug-Like Molecules
,”
Nat. Rev. Drug Discovery
,
4
(
8
), pp.
649
663
.
5.
Koza
,
J. R.
,
Bennett
,
F. H.
, III
,
Andre
,
D.
,
Keane
,
M. A.
, and
Dunlap
,
F.
,
1997
, “
Automated Synthesis of Analog Electrical Circuits by Means of Genetic Programming
,”
IEEE Trans. Evol. Comput.
,
1
(
2
), pp.
109
128
.
6.
Bendsøe
,
M. P.
, and
Kikuchi
,
N.
,
1988
, “
Generating Optimal Topologies in Structural Design Using a Homogenization Method
,”
Comput. Methods Appl. Mech. Eng.
,
71
(
2
), pp.
197
224
.
7.
Kicinger
,
R.
,
Arciszewski
,
T.
, and
Jong
,
K. D.
,
2005
, “
Evolutionary Computation and Structural Design: A Survey of the State-of-the-Art
,”
Comput. Struct.
,
83
(
23
), pp.
1943
1978
.
8.
von Ahn
,
L.
,
2009
, “
Human Computation
,” 46th
ACM/IEEE
Design Automation Conference
, San Francisco, CA, July 26–31, pp.
418
419
.
9.
Cooper
,
S.
,
Khatib
,
F.
,
Treuille
,
A.
,
Barbero
,
J.
,
Lee
,
J.
,
Beenen
,
M.
,
Leaver-Fay
,
A.
,
Baker
,
D.
,
Popović
,
Z.
, and > 57,000 Foldit Players,
2010
, “The Challenge of Designing Scientific Discovery Games,”
International Conference on the Foundations of Digital Games
, Monterey, CA, pp.
40
47
.
10.
Cooper
,
S.
,
Khatib
,
F.
,
Treuille
,
A.
,
Barbero
,
J.
,
Lee
,
J.
,
Beenen
,
M.
,
Leaver-Fay
,
A.
,
Baker
,
D.
, and
Popović
,
Z.
,
2010
, “
Predicting Protein Structures With a Multiplayer Online Game
,”
Nature
,
466
(
7307
), pp.
756
760
.
11.
Khatib
,
F.
,
Cooper
,
S.
,
Tyka
,
M. D.
,
Xu
,
K.
,
Makedon
,
I.
,
Popović
,
Z.
,
Baker
,
D.
, and
Players
,
F.
,
2011
, “
Algorithm Discovery by Protein Folding Game Players
,”
Proc. Natl. Acad. Sci.
,
108
(
47
), pp.
18949
18953
.
12.
Lee
,
J.
,
Kladwang
,
W.
,
Lee
,
M.
,
Cantu
,
D.
,
Azizyan
,
M.
,
Kim
,
H.
,
Limpaecher
,
A.
,
Yoon
,
S.
,
Treuille
,
A.
, and
Das
,
R.
,
2014
, “
RNA Design Rules From a Massive Open Laboratory
,”
Proc. Natl. Acad. Sci.
,
111
(
6
), pp.
2122
2127
.
13.
Lee
,
J.
,
Kladwang
,
W.
,
Lee
,
M.
,
Cantu
,
D.
,
Azizyan
,
M.
,
Kim
,
H.
,
Limpaecher
,
A.
,
Yoon
,
S.
,
Treuille
,
A.
, and
Das
,
R.
,
2014
, “
Eterna
,” http://eterna.cmu.edu
14.
Le Bras
,
R.
,
Bernstein
,
R.
,
Gomes
,
C. P.
,
Selman
,
B.
, and
Van Dover
,
R. B.
,
2013
, “
Crowdsourcing Backdoor Identification for Combinatorial Optimization
,”
Twenty-Third International Joint Conference on Artificial Intelligence
, Beijing, Aug. 3–9, AAAI Press, pp.
2840
2847
.
15.
Kawrykow
,
A.
,
Roumanis
,
G.
,
Kam
,
A.
,
Kwak
,
D.
,
Leung
,
C.
,
Wu
,
C.
,
Zarour
,
E.
,
Sarmenta
,
L.
,
Blanchette
,
M.
, and
Waldispühl
,
J.
,
2012
, “
Phylo: A Citizen Science Approach for Improving Multiple Sequence Alignment
,”
PLoS One
,
7
(
3
), p.
e31362
.
16.
Von Ahn
,
L.
,
2006
, “
Games With a Purpose
,”
Computer
,
39
(
6
), pp.
92
94
.
17.
Schrope
,
M.
,
2013
, “
Solving Tough Problems With Games
,”
Proc. Natl. Acad. Sci.
,
110
(
18
), pp.
7104
7106
.
18.
Abbeel
,
P.
, and
Ng
,
A. Y.
,
2004
, “
Apprenticeship Learning Via Inverse Reinforcement Learning
,”
Twenty-First International Conference on Machine Learning
, Banff, Alberta, Canada, July 4–9, p.
1
.
19.
Folkesson
,
A.
,
Andersson
,
C.
,
Alvfors
,
P.
,
Alaküla
,
M.
, and
Overgaard
,
L.
,
2003
, “
Real Life Testing of a Hybrid PEM Fuel Cell Bus
,”
J. Power Sources
,
118
(
1
), pp.
349
357
.
20.
Gao
,
D.
,
Jin
,
Z.
, and
Lu
,
Q.
,
2008
, “
Energy Management Strategy Based on Fuzzy Logic for a Fuel Cell Hybrid Bus
,”
J. Power Sources
,
185
(
1
), pp.
311
317
.
21.
Lin
,
C.-C.
,
Peng
,
H.
,
Grizzle
,
J. W.
, and
Kang
,
J.-M.
,
2003
, “
Power Management Strategy for a Parallel Hybrid Electric Truck
,”
IEEE Trans. Control Syst. Technol.
,
11
(
6
), pp.
839
849
.
22.
Evans
,
D. G.
,
Polom
,
M. E.
,
Poulos
,
S. G.
,
Van Maanen
,
K. D.
, and
Zarger
,
T. H.
,
2003
, “
Powertrain Architecture and Controls Integration for GM's Hybrid Full-Size Pickup Truck
,”
SAE
Technical Paper No. 2003-01-0085.
23.
Fish
,
S.
,
Savoie
,
T.
, and
Vanicek
,
H.
,
2001
, “
Modeling Hybrid Electric HMMWV Power System Performance
,”
IEEE Trans. Magn.
,
37
(
1
), pp.
480
484
.
24.
Antoniou
,
A.
,
Komyathy
,
J.
,
Bench
,
J.
, and
Emadi
,
A.
,
2005
, “
Modeling and Simulation of Various Hybrid Electric Configurations of the High-Mobility Multipurpose Wheeled Vehicle (HMMWV)
,”
IEEE
Vehicle Power and Propulsion Conference
, Chicago, IL, Sept. 7–9, pp.
507
514
.
25.
Ed Bargar
,
H.
,
Li
,
J.
,
Goering
,
D. J.
, and
Lee
,
J. H.
,
2003
, “
Modeling and Verification of Hybrid Electric HMMWV Performance
,” 29th Annual Conference of the
IEEE
Industrial Electronics Society
, Roanoke, VA, Nov. 2–6, Vol.
1
, pp.
939
944
.
26.
Liu
,
J.
,
2007
, “
Modeling, Configuration and Control Optimization of Power-Split Hybrid Vehicles
,”
Ph.D. thesis
, The University of Michigan, Ann Arbor, MI.
27.
Fathy
,
H. K.
,
Reyer
,
J. A.
,
Papalambros
,
P. Y.
, and
Ulsov
,
A.
,
2001
, “
On the Coupling Between the Plant and Controller Optimization Problems
,”
2001 American Control Conference
, IEEE, Arlington, VA, June 25–27, Vol.
3
, pp.
1864
1869
.
28.
Peters
,
D.
,
Papalambros
,
P.
, and
Ulsoy
,
A.
,
2010
, “
Relationship Between Coupling and the Controllability Grammian in Co-Design Problems
,”
2010 American Control Conference
, IEEE, Baltimore, MD, June 30–July 2, pp.
623
628
.
29.
Allison
,
J. T.
,
Guo
,
T.
, and
Han
,
Z.
,
2014
, “
Co-Design of an Active Suspension Using Simultaneous Dynamic Optimization
,”
ASME J. Mech. Des.
,
136
(
8
), p.
081003
.
30.
Allison
,
J. T.
,
2013
, “
Plant-Limited Co-Design of an Energy-Efficient Counterbalanced Robotic Manipulator
,”
ASME J. Mech. Des.
,
135
(
10
), p.
101003
.
31.
Liu
,
J.
, and
Peng
,
H.
,
2010
, “
A Systematic Design Approach for Two Planetary Gear Split Hybrid Vehicles
,”
Veh. Syst. Dyn.
,
48
(
11
), pp.
1395
1412
.
32.
Zhang
,
X.
,
Li
,
C.-T.
,
Kum
,
D.
, and
Peng
,
H.
,
2012
, “
Prius+ and Volt-: Configuration Analysis of Power-Split Hybrid Vehicles With a Single Planetary Gear
,”
IEEE Trans. Veh. Technol.
,
61
(
8
), pp.
3544
3552
.
33.
Cheong
,
K. L.
,
Li
,
P. Y.
, and
Chase
,
T. R.
,
2011
, “
Optimal Design of Power-Split Transmissions for Hydraulic Hybrid Passenger Vehicles
,”
2011 American Control Conference
, IEEE, San Francisco, CA, June 29–July 1, pp.
3295
3300
.
34.
Liu
,
J.
, and
Peng
,
H.
,
2006
, “
Control Optimization for a Power-Split Hybrid Vehicle
,”
2006 American Control Conference
, IEEE, Minneapolis, MN, June 14–16.
35.
Delprat
,
S.
,
Guerra
,
T.
, and
Rimaux
,
J.
,
2002
, “
Control Strategies for Hybrid Vehicles: Optimal Control
,” 56th
IEEE
Vehicular Technology Conference
, Vancouver, Canada, Sept. 24–28, Vol.
3
, pp.
1681
1685
.
36.
Kim
,
N.
,
Cha
,
S.
, and
Peng
,
H.
,
2011
, “
Optimal Control of Hybrid Electric Vehicles Based on Pontryagin's Minimum Principle
,”
IEEE Trans. Control Syst. Technol.
,
19
(
5
), pp.
1279
1287
.
37.
Paganelli
,
G.
,
Delprat
,
S.
,
Guerra
,
T.-M.
,
Rimaux
,
J.
, and
Santin
,
J.-J.
,
2002
, “
Equivalent Consumption Minimization Strategy for Parallel Hybrid Powertrains
,” 55th
IEEE
Vehicular Technology Conference
, Birmingham, AL, May 6–9, Vol.
4
, pp.
2076
2081
.
38.
Bellman
,
R.
,
1957
,
Dynamic Programming
,
1st ed.
,
Princeton University Press
,
Princeton, NJ
.
39.
Abbeel
,
P.
,
Coates
,
A.
, and
Ng
,
A. Y.
,
2010
, “
Autonomous Helicopter Aerobatics Through Apprenticeship Learning
,”
Int. J. Rob. Res.
,
29
(
13
), pp.
1608
1639
.
40.
Ren
,
Y.
, and
Bayrak
,
A. E.
,
2014
, “
EcoRacer
,” http://ecoracer.herokuapp.com
41.
Lembcke
,
S.
, and
Gentle
,
J.
,
2007
, “
Chipmunk Physics JS
,” https://github.com/josephg/Chipmunk-js
42.
Jones
,
D.
,
Schonlau
,
M.
, and
Welch
,
W.
,
1998
, “
Efficient Global Optimization of Expensive Black-Box Functions
,”
J. Global Optim.
,
13
(
4
), pp.
455
492
.
43.
Chang
,
C.-C.
, and
Lin
,
C.-J.
,
2011
, “
LIBSVM: A Library for Support Vector Machines
,”
ACM Trans. Intell. Syst. Technol. (TIST)
,
2
(
3
),
p. 27
.
44.
Stanley
,
K. O.
, and
Miikkulainen
,
R.
,
2002
, “
Efficient Evolution of Neural Network Topologies
,”
2002 Congress on Evolutionary Computation
, IEEE, Honolulu, HI, May 12–17, Vol.
2
, pp.
1757
1762
.
45.
Konda
,
V. R.
, and
Tsitsiklis
,
J. N.
,
1999
, “
Actor-Critic Algorithms
,”
NIPS
,
13
, pp.
1008
1014
.
You do not currently have access to this content.