An entropy-based metric is presented that can be used for assessing the quality of a solution set as obtained from multi-objective optimization techniques. This metric quantifies the “goodness” of a set of solutions in terms of distribution quality over the Pareto frontier. The metric can be used to compare the performance of different multi-objective optimization techniques. In particular, the metric can be used in analysis of multi-objective evolutionary algorithms, wherein the capabilities of such techniques to produce and maintain diversity among different solution points are desired to be compared on a quantitative basis. An engineering test example, the multi-objective design optimization of a speed-reducer, is provided to demonstrate an application of the proposed entropy metric.
Issue Section:
Technical Papers
1.
Zitzler, E., 1999, “Evolutionary Algorithms for Multiobjective Optimization: Methods and Applications,” Ph.D. Dissertation, Swiss Federal Institute of Technology (ETH), Zurich, Switzerland.
2.
Van Valdhuizen
, D. A.
, and Lamont
, G. B.
, 2000
, “Multiobjective Evolutionary Algorithms: Analyzing the State-of-the-Art
,” Evol. Comput.
, 8
(2
), pp. 125
–147
.3.
Deb, K., 2001, Multi-objective Optimization Using Evolutionary Algorithms, John Wiley and Sons, Chichester, U.K.
4.
Knowles, J. D., 2002, “Local-Search and Hybrid Evolutionary Algorithms for Pareto Optimization,” Ph.D. Dissertation, University of Reading, Department of Computer Science, Reading, U.K.
5.
Zitzler, E., and Thiele, L., 1998, “Multiobjective Optimization Using Evolutionary Algorithms—A Comparative Study,” Proc. 5th International Conference: Parallel Problem Solving from Nature—PPSN V, Springer, Amsterdam, The Netherlands, pp. 292–301.
6.
Van Veldhuizen, D. A., 1999, “Multiobjective Evolutionary Algorithm: Classification, Analyses and New Innovations,” Ph.D. Dissertation, Dept. of Electrical and Computer Engineering, Air Force Institute of Technology, Wright-Patterson AFB, OH.
7.
Sayin
, S.
, 2000
, “Measuring the Quality of Discrete Representations of Efficient Sets in Multiple Objective Mathematical Programming
,” Math. Program.
, 87
, pp. 543
–560
.8.
Wu
, J.
, and Azarm
, S.
, 2001
, “Metrics for Quality Assessment of a Multiobjective Design Optimization Solution Set
,” ASME J. Mech. Des.
, 123
, pp. 18
–25
.9.
Deb, K., 1998, “Multi-Objective Genetic Algorithms: Problem Difficulties and Construction of Test Problems,” Technical Report CI-49/98, Department of Computer Science/LS11, University of Dortmund, Germany.
10.
Schott, J. R., 1995, “Fault Tolerant Design Using Single and Multicriteria Genetic Algorithm Optimization,” M.S. Thesis, Department of Aeronautics and Astronautics, M.I.T., Cambridge, MA.
11.
Deb
, K.
, Agrawal
, S.
, Pratab
, A.
, and Meyarivan
, T.
, 2002
, “A Fast Elitist Non-Dominated Sorting Genetic Algorithm for Multi-Objective Optimization: NSGA-II
,” IEEE Transactions on Evolutionary Computation
, 6
(2
), pp. 182
–197
.12.
Steuer, R. E., 1986, Multiple Criteria Optimization: Theory, Computation, and Application, John Wiley & Sons, NY.
13.
Miettinen, K. M., 1999, Nonlinear Multiobjective Optimization, Kluwer Academic Publishers, Boston, MA.
14.
Lewandowski, A., and Wierzbicki, A. P., 1989, “Aspiration Based Decision Support Systems,” Lecture Notes in Economics and Mathematical Systems, Springer-Verlag, Berlin-Heidelberg, Vol. 331.
15.
Korhonen
, P. S.
, Steuer
, R. E.
, 1997
, “A Heuristic for Estimating Nadir Criterion Values in Multiple Objective Linear Programming
,” Oper. Res.
, 45
(5
), pp. 751
–757
.16.
Fukunaga
, K.
, and Hostetler
, L. D.
, 1975
, “The Estimation of the Gradient of a Density Function with Applications in Pattern Recognition
,” IEEE Trans. Inf. Theory
, 21
(1
), pp. 32
–87
.17.
Hinneburg, A., and Keim, D. A., 1998, “An Efficient Approach to Clustering in Large Multimedia Databases with Noise,” Proc. 4th Int. Conf. on Knowledge Discovery and Data Mining (KDD98), AAAI Press, NY, pp. 58–65.
18.
Schnell
, P.
, 1964
, “A Method to Find Point-Groups
,” Biometrika
, 6
, pp. 47
–48
.19.
Shannon
, C. E.
, 1948
, “A Mathematical Theory of Communication
,” Bell Syst. Tech. J.
, 27
, pp. 379
–423
and 623–656 (July and October).20.
Jaynes
, E. T.
, 1957
, “Information Theory and Statistical Mechanics
,” Phys. Rev.
, 106
, pp. 620
–630
.21.
Burg, J. P., 1975, “Maximum Entropy Spectral Analysis,” Ph.D. Dissertation, Stanford University, Stanford, CA.
22.
Levin, R. D., and Tribus, M., 1979, The Maximum Entropy Formalism, The MIT Press, Cambridge, MA.
23.
Jessop
, A.
, 1999
, “Entropy In Multiattribute Problems
,” Journal of Multi-Criteria Decision Analysis
, 8
(2
), pp. 61
–70
.24.
Peters, M. F., 1975, “Entropy and Information: Conformities and Controversies,” Entropy and Information in Science and Philosophy, Elsevier, NY.
25.
Shewry
, M. C.
, and Wynn
, H. P.
, 1987
, “Maximum Entropy Sampling
,” Journal of Applied Statistics
, 14
, pp. 165
–170
.26.
Jessop, A., 1995, Informed Assessments: An Introduction to information, Entropy and Statistics, Ellis Horwood, NY.
27.
Noble, B., and Daniel, J. W., 1988, Applied Linear Algebra, Third Edition, Prentice-Hall, Englewood Cliffs, NJ.
28.
Koehler, J. R., and Owen, A. B., 1996, “Computer Experiments,” Ghosh, S. and Rao, C. R., eds., Handbook of Statistics, Elsevier Science, NY, Vol. 13, pp. 261–308.
29.
Coello, C. A., 1999, “An Updated Survey of Evolutionary Multiobjective Optimization Techniques: State of the Art and Future Trends,” Proceedings of Congress on Evolutionary Computation, IEEE Press, Washington D.C., 1, pp. 3–12.
30.
Deb, K., 1999, “Evolutionary Algorithms For Multi-Criterion Optimization In Engineering Design,” Proc. Evolutionary Algorithms in Engineering and Computer Science (EUROGEN’99), pp. 135–161.
31.
Golinski
, J.
, 1970
, “Optimal Synthesis Problems Solved by Means of Nonlinear Programming and Random Methods
,” J. Mec.
, 5
, pp. 287
–309
.32.
Azarm, S., Tits, A., and Fan, M. K. H., 1989, “Tradeoff Driven Optimization-based Design of Mechanical Systems,” AIAA-92-4758-CP, 4th AIAA/USAF/NASA/OAI Symposium on Multidisciplinary Analysis and Optimization, Cleveland, OH, pp. 551–558.
33.
Narayanan
, S.
, and Azarm
, S.
, 1999
, “On Improving Multiobjective Genetic Algorithms for Design Optimization
,” Struct. Optim.
, 18
, pp. 146
–155
.Copyright © 2003
by ASME
You do not currently have access to this content.
