In this paper, a method to extract building wall textures from an on-vehicle camera imagesis proposed as an aid to construct the 3D maps. The building wall textures are required to attach to 3Dpolygons which are obtained through 3D measurements in urban space.We assume that the on-vehiclecamera is under linear uniform motion and building walls are planar regions perpendicular to the opti-cal axis. Under the assumption, the same building wall region has the same depth, or disparities, overthe region among successive images. Since disparities derived from foreground objects are differentfrom the disparities derived from the building wall, we can use the disparity differences as a clue toeffectively distinguish the building walls from the foreground objects. We formulate the extractionof building wall textures incorporating these consideration as an optimization problem which can besolved by graph-cut algorithm. To show the effectiveness of the proposed method, it is applied to somesequential scenes.