Nash equilibria and Pareto optimality are two distinct concepts when dealing with multiple criteria. It is well known that the two concepts do not coincide. However, in this work we show that it is possible to characterize the set of all Nash equilibria for any non-cooperative game as the Pareto optimal solutions of a certain vector optimization problem. To accomplish this task, we enlarge the objective function and formulate a non-convex ordering cone under which Nash equilibria are Pareto efficient. We demonstrate these results, first, for shared constraint games in which a joint constraint is applied to all players in a non-cooperative game. This result is then extended to generalized Nash games, where we deduce two vector optimization problems providing necessary and sufficient conditions, respectively, for generalized Nash equilibria. Finally, we show that all prior results hold for vector-valued games as well. Multiple numerical examples are given and demonstrate the computational advantages of finding the set of Nash equilibria via our proposed vector optimization formulation.