Change point testing is a well-studied problem in statistics and there is a rich literature. Owing to the emergence of high-dimensional data with structural breaks, there has been a recent surge of interests in developing methods to accommodate the high-dimensionality. In practice, when the dimension is less than the sample size but is not small, it is often unclear whether a method that is tailored to highdimensional data or simply a classical method that is developed and justified for low-dimensional data, is preferred. In addition, the methods designed for low-dimensional data may not work well in the highdimensional environment and vice versa. This naturally brings up the question whether there is a change point test that can work for data of low, medium and high dimensions.In this paper, we first propose a dimension-agnostic testing procedure targeting at a single change point in the mean of multivariate time series. Our new test is inspired by recent work of [18], who formally developed the notion of "dimension-agnostic" in several testing problems for iid data. We develop a new test statistic by adopting their sample splitting and projection ideas, and combining it with the self-normalization method for time series [29,31]. Using a novel conditioning argument, we are able to show that the limiting null distribution for our test statistic is the same regardless of the dimensionality (fixed versus growing), and the magnitude of cross-sectional dependence (weak versus strong). The power analysis is also conducted to understand the large sample behavior of the proposed test. Furthermore, we present an extension to test for multiple change points in mean and derive the limiting distributions of the new test statistic under both the null and alternatives. Through Monte Carlo simulations, we show that the finite sample results strongly corroborate the theory and suggest that the proposed tests can be used as a benchmark for many time series data due to its robustness to weak temporal dependence, arbitrary cross-sectional dependence and a wide range of dimensionality.