We prove that the space of isometry classes of finite subsets of the real line endowed with the Euclidean-Hausdorff distance cannot be coarsely embedded into any uniformly convex Banach space, and so, in particular, into any Hilbert space. As a consequence, we obtain the same result for the space of isometry classes of finite metric spaces endowed with the Gromov-Hausdorff distance.