Purpose of this paper, coupled with Kinect controller, utilizes handwritten recognition for digit home interactive TV channel controlling. The results of this paper are divided into three parts. The first part presents the development of handwritten digit rules and operations environment using Principal curves method. The second part shows the skeleton tracking system for features extraction. The third part developes an accomplishment of digit recognition function through neural network. In this system, it enables users to operate video and finishs interactive operation in a more intuitive and friendly way, instead of the traditional button control to achieve interactive effect of human-machine interface.