This paper is concerned with recognizing realistic human actions in videos based on spatio-temporal interest points (STIPs

Abstract-This paper considers the recognition of realistic human actions in videos based on spatio-temporal interest points (STIPs). Existing STIP-based action recognition approaches operate on intensity representations of the image data. Because of this, these approaches are sensitive to disturbing photometric phenomena, such as shadows and highlights. In addition, valuable information is neglected by discarding chromaticity from the photometric representation. These issues are addressed by color STIPs. Color STIPs are multichannel reformulations of STIP detectors and descriptors, for which we consider a number of chromatic and invariant representations derived from the opponent color space. Color STIPs are shown to outperform their intensity-based counterparts on the challenging UCF sports, UCF11 and UCF50 action recognition benchmarks by more than 5% on average, where most of the gain is due to the multichannel descriptors. In addition, the results show that color STIPs are currently the single best low-level feature choice for STIP-based approaches to human action recognition.

No abstract

Background Machine learning (ML) allows the exploration and progressive improvement of very complex high-dimensional data patterns that can be utilised to optimise specific classification and prediction tasks, outperforming traditional statistical approaches. An enormous acceleration of ready-to-use tools and artificial intelligence (AI) applications, shaped by the emergence, refinement, and application of powerful ML algorithms in several areas of knowledge, is ongoing. Although such progress has begun to permeate the medical sciences and clinical medicine, implementation in cardiovascular medicine and research is still in its infancy. Objectives To lay out the theoretical framework, purpose, and structure of a novel AI consortium. Methods We have established a new Dutch research consortium, the CVON-AI, supported by the Netherlands Heart Foundation, to catalyse and facilitate the development and utilisation of AI solutions for existing and emerging cardiovascular research initiatives and to raise AI awareness in the cardiovascular research community. CVON-AI will connect to previously established CVON consortia and apply a cloud-based AI platform to supplement their planned traditional data-analysis approach. Results A pilot experiment on the CVON-AI cloud was conducted using cardiac magnetic resonance data. It demonstrated the feasibility of the platform and documented excellent correlation between AI-generated ventricular function estimates as compared to expert manual annotations. The resulting AI solution was then integrated in a web application. Conclusion CVON-AI is a new consortium meant to facilitate the implementation and raise awareness of AI in cardiovascular research in the Netherlands. CVON-AI will create an accessible cloud-based platform for cardiovascular researchers, demonstrate the clinical applicability of AI, optimise the analytical methodology of other ongoing CVON consortia, and promote AI awareness through education and training.