Single-person human pose estimation facilitates markerless movement analysis in sports, as well as in clinical applications. Still, state-of-the-art models for human pose estimation generally do not meet the requirements of real-life applications. The proliferation of deep learning techniques has resulted in the development of many advanced approaches. However, with the progresses in the field, more complex and inefficient models have also been introduced, which have caused tremendous increases in computational demands. To cope with these complexity and inefficiency challenges, we propose a novel convolutional neural network architecture, called EfficientPose, which exploits recently proposed EfficientNets in order to deliver efficient and scalable single-person pose estimation. EfficientPose is a family of models harnessing an effective multi-scale feature extractor and computationally efficient detection blocks using mobile inverted bottleneck convolutions, while at the same time ensuring that the precision of the pose configurations is still improved. Due to its low complexity and efficiency, EfficientPose enables real-world applications on edge devices by limiting the memory footprint and computational cost. The results from our experiments, using the challenging MPII single-person benchmark, show that the proposed EfficientPose models substantially outperform the widely-used OpenPose model both in terms of accuracy and computational efficiency. In particular, our top-performing model achieves state-of-the-art accuracy on single-person MPII, with low-complexity ConvNets.
ObjectivesTo determine whether videos taken by parents of their infants’ spontaneous movements were in accordance with required standards in the In-Motion-App, and whether the videos could be remotely scored by a trained General Movement Assessment (GMA) observer. Additionally, to assess the feasibility of using home-based video recordings for automated tracking of spontaneous movements, and to examine parents’ perceptions and experiences of taking videos in their homes.DesignThe study was a multi-centre prospective observational study.SettingParents/families of high-risk infants in tertiary care follow-up programmes in Norway, Denmark and Belgium.MethodsParents/families were asked to video record their baby in accordance with the In-Motion standards which were based on published GMA criteria and criteria covering lighting and stability of smartphone. Videos were evaluated as GMA ‘scorable’ or ‘non-scorable’ based on predefined criteria. The accuracy of a 7-point body tracker software was compared with manually annotated body key points. Parents were surveyed about the In-Motion-App information and clarity.ParticipantsThe sample comprised 86 parents/families of high-risk infants.ResultsThe 86 parent/families returned 130 videos, and 121 (96%) of them were in accordance with the requirements for GMA assessment. The 7-point body tracker software detected more than 80% of body key point positions correctly. Most families found the instructions for filming their baby easy to follow, and more than 90% reported that they did not become more worried about their child’s development through using the instructions.ConclusionsThis study reveals that a short instructional video enabled parents to video record their infant’s spontaneous movements in compliance with the standards required for remote GMA. Further, an accurate automated body point software detecting infant body landmarks in smartphone videos will facilitate clinical and research use soon. Home-based video recordings could be performed without worrying parents about their child’s development.Trials registration numberNCT03409978.
Key Points
Question
What is the external validity of a deep learning–based method to predict cerebral palsy (CP) based on infants’ spontaneous movements at 9 to 18 weeks’ corrected age?
Findings
In this prognostic study of 557 infants with a high risk of perinatal brain injury, a deep learning–based method for early prediction of CP had sensitivity of 71%, specificity of 94%, positive predictive value of 68%, and negative predictive value of 95%. Prognosis of CP based on the deep learning–based method was associated with later functional level and CP subtype in children with CP.
Meaning
This study’s findings suggest that deep learning–based assessments could support early detection of CP in infants at high risk.
This study investigated the explanatory power of a sensor fusion of two complementary methods to explain performance and its underlying mechanisms in ski jumping. A differential Global Navigation Satellite System (dGNSS) and a markerless video-based pose estimation system (PosEst) were used to measure the kinematics and kinetics from the start of the in-run to the landing. The study had two aims; firstly, the agreement between the two methods was assessed using 16 jumps by athletes of national level from 5 m before the take-off to 20 m after, where the methods had spatial overlap. The comparison revealed a good agreement from 5 m after the take-off, within the uncertainty of the dGNSS (±0.05m). The second part of the study served as a proof of concept of the sensor fusion application, by showcasing the type of performance analysis the systems allows. Two ski jumps by the same ski jumper, with comparable external conditions, were chosen for the case study. The dGNSS was used to analyse the in-run and flight phase, while the PosEst system was used to analyse the take-off and the early flight phase. The proof-of-concept study showed that the methods are suitable to track the kinematic and kinetic characteristics that determine performance in ski jumping and their usability in both research and practice.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.