Full‐field deformation measurement of specific materials is an important issue in civil engineering materials testing. This paper presents a flexible videogrammetric scheme to measure full‐field deformation of an artificial rock‐like material under uniaxial compression. In this scheme, two high‐speed cameras were used to measure the spatial morphological changes of the material surface, which was sprayed with a speckle pattern. A robust self‐adaptive window matching strategy is then proposed to extract accurate displacements of tracking points. Finally, three‐dimensional (3D) point clouds and full‐field deformation can be calculated by photogrammetric and spatiotemporal analysis. Simulation and empirical tests demonstrated that the self‐adaptive window matching strategy used with high‐speed videogrammetric speckle image sequences can detect more subtle deformation and avoid more mismatches than a fixed‐window matching strategy.