Situation-Aware Deep Reinforcement Learning Link Prediction Model for Evolving Criminal Networks

Abstract

Evidently, criminal network activities have shown an increasing trend in terms of complexity and frequency, particularly with the advent of social media and modern telecommunication systems. In these circumstances, law enforcement agencies have to be armed with advance criminal network analysis (CNA) tools capable of uncovering with speed, probable key hidden relationships (links/edges) and players (nodes) in order to anticipate, undermine and cripple organised crime syndicates and activities. The development of link prediction models for network orientated domains is based on Social Network Analysis (SNA) methods and models. The key objective of this research is to develop a link prediction model that incorporates a fusion of metadata (i.e. environment data sources such as arrest warrants, judicial judgement, wiretap records and police station proximity) with a time-evolving criminal dataset in order to be aware of real-world situations to improve the quality of link prediction. Based on the review of related work, most of the models are constructed by leveraging on classical machine learning (ML) techniques such as support vector machine (SVM) without metadata fusion. The problem with the use of classical ML techniques is the lack of available domain dataset which is sufficiently large for training purpose. Compared to sociaI network, criminal network dataset by nature tends to relatively much smaller. In view of this, deep reinforcement learning (DRL) technique which could improve the training of models with the self-generated dataset is leveraged upon to construct the model. In this research, a purely time-evolving DRL model (TDRL-CNA) without metadata fusion is designed as a baseline for comparison with the metadata fusion model (FDRL-CNA). The experimental results show that the predictive accuracy of new and recurrent links by the FDRL-CNA model is higher than the baseline TDRL-CNA model that does not factor data fusion from different data sources. INDEX TERMS Data fusion, time-evolving network, criminal network analysis, deep reinforcement learning, node similarity.

Comprehensive Review of Cybercrime Detection Techniques

“…Therefore, normal machine learning algorithms are not sufficient in such cases and DRL algorithm provides better performance. Another research tackled this issue in [82] presented by Lim et al utilizing time evolving deep reinforcement learning (TDRL) and compare it with meta-data fusion model (FDRL), where meta data fusion is extracted from the real environment such as recordings and arrest warrants. Table 6 summarizes the deeplearning-based cybercrime detection techniques applied in previous studies.…”

Risk Prediction of Theft Crimes in Urban Communities: An Integrated Model of LSTM and ST-GCN

“…In terms of prediction content, the prediction of crimes is roughly subcategorized as follows: re-offending prediction [11,12], victim prediction [13], offender prediction [14,15] crime pattern prediction [16,17] and crime hot spots prediction [18]. Crime hot spots prediction can be classified into temporal prediction [19], spatial prediction [20] and spatial-temporal prediction [21,22].…”

Machine learning partners in criminal networks

“…All these regularities and patterns have great potential in helping police investigations, serving as predictive features of future criminal behavior, missing links between individuals, and other properties of unlawful associations. However, there have thus far been very few attempts to use these network patterns to predict static and dynamic properties of criminal networks with machine learning methods 13,[25][26][27] . The paucity of such studies reflects the challenges of obtaining representations for nodes and edges of complex networks that would allow the encoding of structural patterns into vectors to then be used in machine learning algorithms.…”