Recently, increasing interest has been shown in applying the concept of Pareto-optimality to machine learning, particularly inspired by the successful developments in evolutionary multi-objective optimization. It has been shown that the multi-objective approach to machine learning is particularly successful to improve the performance of the traditional single objective machine learning methods, to generate highly diverse multiple Pareto-optimal models for constructing ensembles models and, and to achieve a desired trade-off between accuracy and interpretability of neural networks or fuzzy systems. This monograph presents a selected collection of research work on multi-objective approach to machine learning, including multi-objective feature selection, multi-objective model selection in training multi-layer perceptrons, radial-basis-function networks, support vector machines, decision trees, and intelligent systems.
Multi-Objective Clustering, Feature Extraction and Feature Selection.- Feature Selection Using Rough Sets.- Multi-Objective Clustering and Cluster Validation.- Feature Selection for Ensembles Using the Multi-Objective Optimization Approach.- Feature Extraction Using Multi-Objective Genetic Programming.- Multi-Objective Learning for Accuracy Improvement.- Regression Error Characteristic Optimisation of Non-Linear Models.- Regularization for Parameter Identification Using Multi-Objective Optimization.- Multi-Objective Algorithms for Neural Networks Learning.- Generating Support Vector Machines Using Multi-Objective Optimization and Goal Programming.- Multi-Objective Optimization of Support Vector Machines.- Multi-Objective Evolutionary Algorithm for Radial Basis Function Neural Network Design.- Minimizing Structural Risk on Decision Tree Classification.- Multi-objective Learning Classifier Systems.- Multi-Objective Learning for Interpretability Improvement.- Simultaneous Generation of Accurate and Interpretable Neural Network Classifiers.lSZ