Smartphone-based imaging systems for medical applications: a critical review

Abstract

. Significance: Smartphones come with an enormous array of functionality and are being more widely utilized with specialized attachments in a range of healthcare applications. A review of key developments and uses, with an assessment of strengths/limitations in various clinical workflows, was completed. Aim: Our review studies how smartphone-based imaging (SBI) systems are designed and tested for specialized applications in medicine and healthcare. An evaluation of current research studies is used to provide guidelines for improving the impact of these research advances. Approach: First, the established and emerging smartphone capabilities that can be leveraged for biomedical imaging are detailed. Then, methods and materials for fabrication of optical, mechanical, and electrical interface components are summarized. Recent systems were categorized into four groups based on their intended application and clinical workflow: ex vivo diagnostic, in vivo diagnostic, monitoring, and treatment guidance. Lastly, strengths and limitations of current SBI systems within these various applications are discussed. Results: The native smartphone capabilities for biomedical imaging applications include cameras, touchscreens, networking, computation, 3D sensing, audio, and motion, in addition to commercial wearable peripheral devices. Through user-centered design of custom hardware and software interfaces, these capabilities have the potential to enable portable, easy-to-use, point-of-care biomedical imaging systems. However, due to barriers in programming of custom software and on-board image analysis pipelines, many research prototypes fail to achieve a prospective clinical evaluation as intended. Effective clinical use cases appear to be those in which handheld, noninvasive image guidance is needed and accommodated by the clinical workflow. Handheld systems for in vivo , multispectral, and quantitative fluorescence imaging are a promising development for diagnostic and treatment guidance applications. Conclusions: A holistic assessment of SBI systems must include interpretation of their value for intended clinical settings and how their implementations enable better workflow. A set of six guidelines are proposed to evaluate appropriateness of smartphone utilization in terms of clinical context, completeness, compactness, connectivity, cost, and claims. Ongoing work should prioritize realistic clinical assessments with quantitative and qualitative comparison to non-smartphone systems to clearly demonstrate the value of smartphone-based systems. Improved hardware design to accommodate the rapidly changing smartphone ecosystem, creation of open-source image acquisition and analysis pipelines, and adoption of robust calibration techniques to address phone-to-phone variability are three high priority areas to move SBI research forwar...

Automated Affective Computing Based on Bio-Signals Analysis and Deep Learning Approach

“…Moreover, the market entry of smaller and low-cost thermal cameras is paving the way for thermal IR imaging applications outside laboratory environments, especially for cutting-edge applications in the affective computing field. Furthermore, smart thermal devices have proved effective in important real-life scenarios, such as driver drowsiness state evaluation [73,74], human stress recognition [75], and smartphone-based clinical imaging systems [76,77]. In this regard, this research reports a significant novelty.…”

Clinical assessment of a low-cost hand-held smartphone-attached intraoral imaging probe for ALA PDT monitoring and guidance

“…The wide availability and popularity of smartphones, particularly in the developing countries, make this device promising as a low-cost, portable, and capable theragnostic cancer technology for global health. 19 Further, large-scale case studies will required to validate and calibrate the R value imaging during monitoring and guidance of PDT. In future this potential approach can discriminate between low to severe dysplasia before developing to CIS.…”

Skin chromophore mapping by smartphone RGB camera under spectral band and spectral line illumination

“… 3 Recently, skin imaging by smartphones under white broadband illumination exploiting the embedded LEDs or ambient light was proposed as a diagnostic modality. 4 – 8 There are smartphone apps that use the ABCDE criteria, 9 commonly exploited by dermatologists, for analysis of the taken color images of skin neoplasms. However, only the color and shape features of the malformation cannot assure proper skin cancer diagnostics; the smartphone RGB image apps such as Google’s “dermatology assist tool” are heavily criticized by doctors.…”