In this paper, the issue of detecting a user’s position in relation to the antenna geometry in ultra-wideband (UWB) off-body wireless body area network (WBAN) communication using deep learning methods is presented. To measure the impulse response of the channel, a measurement stand consisting of EVB1000 devices and DW1000 radio modules was developed and indoor static measurement scenarios were performed. It was proven that for the binary classification of user orientation, neural networks achieved accuracy that was more than 9% higher than that for the well-known threshold method. In addition, the classification of user position angles relative to the reference node was analyzed. It was proven that, using the proposed deep learning approach and the channel impulse response, it was possible to estimate the angle of the user’s position in relation to the antenna geometry. Absolute user orientation angle errors of about 4–7° for convolutional neural networks and of about 14–15° for multilayer perceptrons were achieved in approximately 85% of the cases in both tested scenarios.