This paper describes a remote controlled assembly using a haptic device. Most haptic devices have six Degrees Of Freedom (DOFs) for a higher sense of reality. However, for assembly operation, the simultaneous motion of parts with only one or two DOFs is required, and force feedback to operators is used only to maintain contact and detect collisions among parts. This leads to the possibility of assembly operations using a haptic device with a small number of DOFs. In this paper, we propose virtual planes to perform remote control of a 6DOF assembly by way of 1DOF user operations. Virtual planes separate the DOFs for user operation and for automatically generated motions that complement the user operation DOF in each assembly operation. A prototype system was developed with a 6DOF manipulator and camera. The system allows an operator to place virtual planes in any position and orientation using a camera image of the workspace. The experiment results showed the effectiveness of the method for remote controlled assembly without geometry information on the parts.