Center region aware cross former for image forgery localization

Abstract

Image forgery has been a serious issue in real life during this boosting big data era. There have been many methods depending on detecting footprints such as edge inconsistency, camera noise, JPEG artifacts, etc., proposed. Unlike the existing methods, we propose a more general method, CRAC-formerNet to capture more stable manipulation traces, not only including RGB domain but also from high-frequency features generated from Steganalysis Rich Model (SRM) 1 and District Cosine transformer in the frequency domain. A shared query is generated from features from both the RGB and frequency domains. The keys and values are generated from each domain respectively. Moreover, features of manipulated and manipulated regions should belong to different distributions, especially features in edge regions. We use a center contrastive loss to learn fine-grained features. A manipulated region proposal module is proposed for improving computing efficiency when calculating the loss. We empirically demonstrate that our method achieves competitive results on four benchmark image manipulation datasets.