Metaheuristics Evaluation: A Proposal for a Multicriteria Methodology

Abstract

In this work we propose a multicriteria evaluation scheme for heuristic algorithms based on the classic Condorcet ranking technique. Weights are associated to the ranking of an algorithm among a set being object of comparison. We used five criteria and a function on the set of natural numbers to create a ranking. The discussed comparison involves three well-known problems of combinatorial optimization -Traveling Salesperson Problem (TSP), Capacitated Vehicle Routing Problem (CVRP) and Quadratic Assignment Problem (QAP). The tested instances came from public libraries. Each algorithm was used with essentially the same structure, the same local search was applied and the initial solutions were similarly built. It is important to note that the work does not make proposals involving algorithms: the results for the three problems are shown only to illustrate the operation of the evaluation technique. Four metaheuristics -GRASP, Tabu Search, ILS and VNS -are therefore only used for the comparisons.

Heuristic Evaluation of Peruvian Government Web Portals, used within the State of Emergency

“…Five criteria and one function were used for natural number ranking. Each algorithm was used with its same structure, applying the same techniques [8]. Thus, the mention of these papers will allow us to have a broad vision to analyze and use new approaches to heuristic evaluation allowing us to make a more effective evaluation of the usability of governmental web portals.…”