Optical fibers are used in various applications, e. g. optical communication, material processing, as a laser medium or to generate efficient supercontinua. For most of these applications the knowledge of the dispersion is an essential prerequisite. The dispersion and modal properties of photonic crystal fibers (PCF) strongly depend on the hole diameter and pitch. Since fabrication tolerances affect the structure of the photonic lattice, the dispersion behavior as well as the number of guided transverse modes can differ from numerical calculations. Dispersion measurement of singlemode photonic crystal fibers has been well described in recent papers. However, the determination of dispersion in the presence of higher-order modes is much more difficult.To measure the dispersion of optical fibers with high accuracy, a time-domain white-light interferometer based on a Mach-Zehnder interferometer is presented. The experimental setup allows to determine the wavelengthdependent differential group delay of light travelling through conventional fibers and PCFs within the wavelength range from VIS to NIR. Interferences appear due to superposition of two laser beams, one propagating through the tested fiber and the other travelling through air. Measuring the different group delays of a step-index fiber shows the sufficient accuracy of the interferometer. This paper demonstrates a simple yet effective way to suppress higher-order modes, making it possible to measure the chromatic dispersion of singlemode as well as multimode fibers.