Recently pre-trained models have achieved state-of-the-art results in various language understanding tasks. Current pre-training procedures usually focus on training the model with several simple tasks to grasp the co-occurrence of words or sentences. However, besides co-occurring information, there exists other valuable lexical, syntactic and semantic information in training corpora, such as named entities, semantic closeness and discourse relations. In order to extract the lexical, syntactic and semantic information from training corpora, we propose a continual pre-training framework named ERNIE 2.0 which incrementally builds pre-training tasks and then learn pre-trained models on these constructed tasks via continual multi-task learning. Based on this framework, we construct several tasks and train the ERNIE 2.0 model to capture lexical, syntactic and semantic aspects of information in the training data. Experimental results demonstrate that ERNIE 2.0 model outperforms BERT and XLNet on 16 tasks including English tasks on GLUE benchmarks and several similar tasks in Chinese. The source codes and pre-trained models have been released at https://github.com/PaddlePaddle/ERNIE.

Photoplethysmography (PPG) is a non-invasive optical technique for detecting microvascular blood volume changes in tissues. Its ease of use, low cost and convenience make it an attractive area of research in the biomedical and clinical communities. Nevertheless, its single spot monitoring and the need to apply a PPG sensor directly to the skin limit its practicality in situations such as perfusion mapping and healing assessments or when free movement is required. The introduction of fast digital cameras into clinical imaging monitoring and diagnosis systems, the desire to reduce the physical restrictions, and the possible new insights that might come from perfusion imaging and mapping inspired the evolution of conventional PPG technology to imaging PPG (IPPG). IPPG is a noncontact method that can detect heart-generated pulse waves by means of peripheral blood perfusion measurements. Since its inception, IPPG has attracted significant public interest and provided opportunities to improve personal healthcare. This study presents an overview of the wide range of IPPG systems currently being introduced along with examples of their application in various physiological assessments. We believe that the widespread acceptance of IPPG is happening, and it will dramatically accelerate the promotion of this healthcare model in the near future.

We present a novel language representation model enhanced by knowledge called ERNIE (Enhanced Representation through kNowledge IntEgration). Inspired by the masking strategy of BERT (Devlin et al., 2018), ERNIE is designed to learn language representation enhanced by knowledge masking strategies, which includes entity-level masking and phrase-level masking. Entity-level strategy masks entities which are usually composed of multiple words. Phrase-level strategy masks the whole phrase which is composed of several words standing together as a conceptual unit. Experimental results show that ERNIE outperforms other baseline methods, achieving new state-of-the-art results on five Chinese natural language processing tasks including natural language inference, semantic similarity, named entity recognition, sentiment analysis and question answering. We also demonstrate that ERNIE has more powerful knowledge inference capacity on a cloze test.

Abstract. With the advance of computer and photonics technology, imaging photoplethysmography [(PPG), iPPG] can provide comfortable and comprehensive assessment over a wide range of anatomical locations. However, motion artifact is a major drawback in current iPPG systems, particularly in the context of clinical assessment. To overcome this issue, a new artifact-reduction method consisting of planar motion compensation and blind source separation is introduced in this study. The performance of the iPPG system was evaluated through the measurement of cardiac pulse in the hand from 12 subjects before and after 5 min of cycling exercise. Also, a 12-min continuous recording protocol consisting of repeated exercises was taken from a single volunteer. The physiological parameters (i.e., heart rate, respiration rate), derived from the images captured by the iPPG system, exhibit functional characteristics comparable to conventional contact PPG sensors. Continuous recordings from the iPPG system reveal that heart and respiration rates can be successfully tracked with the artifact reduction method even in high-intensity physical exercise situations. The outcome from this study thereby leads to a new avenue for noncontact sensing of vital signs and remote physiological assessment, with clear applications in triage and sports training. C 2011 Society of Photo-Optical Instrumentation Engineers (SPIE).

No abstract

No abstract

Although anomalies in the topological architecture of whole-brain connectivity have been found to be associated with Alzheimer’s disease (AD), our understanding about the progression of AD in a functional connectivity (FC) perspective is still rudimentary and few study has explored the function-structure relations in brain networks of AD patients. By using resting-state functional MRI (fMRI), this study firstly investigated organizational alternations in FC networks in 12 AD patients, 15 amnestic mild cognitive impairment (aMCI) patients, and 14 age-matched healthy aging subjects and found that all three groups exhibit economical small-world network properties. Nonetheless, we found a decline of the optimal architecture in the progression of AD, represented by a more localized modular organization with less efficient local information transfer. Our results also show that aMCI forms a boundary between normal aging and AD and represents a functional continuum between healthy aging and the earliest signs of dementia. Moreover, we revealed a dissociated relationship between the overall FC and structural connectivity (SC) in AD patients. In this study, diffusion tensor imaging tractography was used to map the structural network of the same individuals. The decreased FC-SC coupling may be indicative of more stringent and less dynamic brain function in AD patients. Our findings provided insightful implications for understanding the pathophysiological mechanisms of brain dysfunctions in aMCI and AD patients and demonstrated that functional disorders can be characterized by multimodal neuroimaging-based metrics.

Subjective cognitive decline (SCD) is regarded as the first clinical manifestation in the Alzheimer’s disease (AD) continuum. Investigating populations with SCD is important for understanding the early pathological mechanisms of AD and identifying SCD-related biomarkers, which are critical for the early detection of AD. With the advent of advanced neuroimaging techniques, such as positron emission tomography (PET) and magnetic resonance imaging (MRI), accumulating evidence has revealed structural and functional brain alterations related to the symptoms of SCD. In this review, we summarize the main imaging features and key findings regarding SCD related to AD, from local and regional data to connectivity-based imaging measures, with the aim of delineating a multimodal imaging signature of SCD due to AD. Additionally, the interaction of SCD with other risk factors for dementia due to AD, such as age and the Apolipoprotein E (ApoE) ɛ4 status, has also been described. Finally, the possible explanations for the inconsistent and heterogeneous neuroimaging findings observed in individuals with SCD are discussed, along with future directions. Overall, the literature reveals a preferential vulnerability of AD signature regions in SCD in the context of AD, supporting the notion that individuals with SCD share a similar pattern of brain alterations with patients with mild cognitive impairment (MCI) and dementia due to AD. We conclude that these neuroimaging techniques, particularly multimodal neuroimaging techniques, have great potential for identifying the underlying pathological alterations associated with SCD. More longitudinal studies with larger sample sizes combined with more advanced imaging modeling approaches such as artificial intelligence are still warranted to establish their clinical utility.