We show that measuring any two low rank quantum states in a random orthonormal basis gives, with high probability, two probability distributions having total variation distance at least a universal constant times the Frobenius distance between the two states. This implies that for any finite ensemble of quantum states there is a single POVM that distinguishes between every pair of states from the ensemble by at least a constant times their Frobenius distance; in fact, with high probability a random POVM, under a suitable definition of randomness, suffices. There are examples of ensembles with constant pairwise trace distance where a single POVM cannot distinguish pairs of states by much better than their Frobenius distance, including the important ensemble of coset states of hidden subgroups of the symmetric group (Moore et al.,