Sparse inverse covariance matrix estimation is a fundamental problem in a Gaussian network model and has attracted much attention in the last decade. A widely used approach for estimating the sparse inverse covariance matrix is the regularized negative log-likelihood minimization, where the regularization term promotes the sparsity of the inverse covariance matrix. Although the -norm is the most popular sparsity promoting function due to its convexity, it may not result in sufficiently satisfied estimations. The -norm is the most natural function to measure sparsity and the -norm regularized negative log-likelihood minimization has been demonstrated to produce favorable results. However, when the sample covariance matrix is singular, the -norm problem has no optimal solution. In this paper, we propose to estimate the sparse inverse covariance matrix via simultaneously using the -norm and the Tikhonov regularization. The resulting minimization problem is guaranteed to have optimal solutions. To overcome the numerical difficulty caused by the -norm, we utilize the penalty decomposition approach. We prove the asymptotic approximation and exact approximation to local (resp., global) minimizers of the original problem by those of the penalty decomposition problem. Then, local minimizers of the penalty decomposition problem are characterized as fixed-points of a system of fixed-point equations with the help of proximity operators. Based on these theoretical results, we design for solving the proposed minimization problem a penalty decomposition fixed-point proximity algorithm and provide the convergence analysis of the algorithm. Numerical results indicate that the proposed algorithm outperforms the compared state-of-the-art algorithms in terms of accuracy.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.