SThy-Net: a feature fusion-enhanced dense-branched modules network for small thyroid nodule classification from ultrasound images

Al-Jebrni, Abdulrhman H.; Ali, Saba Ghazanfar; Li, Huating; Lin, Xiao; Li, Ping; Jung, Younhyun; Kim, Jinman; Feng, David Dagan; Sheng, Bin; Jiang, Lixin; Du, Jiajun

doi:10.1007/s00371-023-02984-x

Cited by 6 publications

(1 citation statement)

References 31 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This paper divides image inpainting into two phases. In the first phase, a Generative Adversarial Network (GAN) is employed to semantically inpaint human faces, thereby enhancing the accuracy of face structure prediction [23,24]. Inspired by LiaoLiang [25][26][27], we utilize a random walk algorithm [28] during the process of obtaining the facial parsing map.…”

Section: Introductionmentioning

confidence: 99%

Selection and Guidance: High-dimensional Identity Consistency Preservation for Face Inpainting

li,

Zhan,

et al. 2024

Preprint

View full text Add to dashboard Cite

This paper primarily investigates the issue of identity inconsistency resulting from facial inpainting. In the current facial image inpainting process, most low-frequency information is learned directly from the uncovered areas, while high-frequency information, including texture details, is generated from the dataset. The averageness of low-frequency features and the unreliability of high-frequency features result in identity deviations in the inpainted faces. To address this problem, a two-stage generative model is proposed, which includes structural prior guidance and multidimensional consistency guidance. Firstly, a parsing inpainting module was designed to predict structural information. Subsequently, a multidimensional information guidance module was constructed, which, based on semantic consistency guidance, extracts low-frequency confidence information of the inpainted image to suppress the averageness of facial inpainting. Frequency-domain information is extracted from the inpainted image, combined with a facial recognition network, and the frequency-domain identity feature consistency loss is calculated to aid in the inpainting of high-frequency information, including identity features, thus achieving identity consistency in facial inpainting. Furthermore, to evaluate the consistency of the identity information of inpainted faces and real, identity features generated by the inpainting network are extracted, and the distribution of these features is utilized as a measure of inpainting quality. We conducted experiments on the CelebAMask-HQ dataset, and both qualitative and quantitative studies indicate that our proposed algorithm outperforms state-of-the-art methods.

show abstract