Incorporating User Preferences in Multi-objective Feature Selection in Software Product Lines Using Multi-Criteria Decision Analysis

Abstract

Software Product Lines Engineering has created various tools that assist with the standardisation in the design and implementation of clusters of equivalent software systems with an explicit representation of variability choices in the form of Feature Models, making the selection of the most ideal software product a Feature Selection problem. With the increase in the number of properties, the problem needs to be defined as a multi-objective optimisation where objectives are considered independently one from another with the goal of finding and providing decision-makers a large and diverse set of non-dominated solutions/products. Following the optimisation, decision-makers define their own (often complex) preferences on how does the ideal software product look like. Then, they select the unique solution that matches their preferences the most and discard the rest of the solutions-sometimes with the help of some Multi-Criteria Decision Analysis technique. In this work, we study the usability and the performance of incorporating preferences of decision-makers by carrying-out Multi-Criteria Decision Analysis directly within the multi-objective optimisation to increase the chances of finding more solutions that match preferences of the decision-makers the most and avoid wasting execution time searching for non-dominated solutions that are poor with respect to decision-makers' preferences.

Investigating Multi-feature Selection and Ensembling for Audio Classification

“…Furthermore, while we have only focused on accuracy in this work, it is possible that a feature/model ensembling does not achieve the best accuracy, but performs better on other metrics. Therefore, it will be beneficial to formulate the problem as a multi-objective feature selection [27][28][29]33]…”