We present the form factor design iteration process of the Gesture Watch, a wearable gesture interface that utilizes non-contact hand gestures to control mobile devices while non-visual feedback is provided from its tactile display. Based on limitations discovered from a previous prototype, we identified three design challenges: wearability, mobility, and tactile perception. In addressing these challenges, we focus on three main parts affecting the form factor: the sensor housing, the strap, and the motor housing.