In recent years, spinal disorders, spinal deformities, and scoliosis have become more frequent, especially chronic systemic inflammatory diseases, such as early-onset scoliosis, idiopathic scoliosis, and ankylosis spondylitis, which have unknown causes, insidious onset, and progressive development, resulting in irreversible spinal joint deformities and stiffness at advanced stages and high disability rates. As one of the traditional Chinese health and fitness qigong exercises, Taijiquan has the effect of strengthening the waist and kidneys, sparing the tendons and softening the body, unblocking the meridians, unblocking the qi and blood, and strengthening the body and increasing intelligence. To this end, this paper proposes a data enhancement method that uses the spine line as the control curve to deform the human contours, drawing on the moving least squares deformation method to fit a variety of scoliosis cases and increase the diversity of the dataset, thereby improving the generalisation capability of the network. The colour map and depth map information are then integrated using a four-channel method and a dual feature extraction network structure to improve the accuracy of segmentation.