Information theoretic learning (ITL) criteria have emerged useful for mitigating degradations caused by unknown non-Gaussian noise processes in future wireless communication systems. Specifically, the reproducing kernel Hilbert space (RKHS) based approaches relying on ITL based learning criteria are envisioned to provide nearoptimal mitigation of unknown hardware impairments and non-Gaussian noises. Among several ITL criteria, the recent works find the minimum error entropy with fiducial points (MEE-FP) promising due to its guarantee of unbiased estimation and generalization over generic noise distributions. However, MEE-FP based learning approaches are known to depend on an accurate kernel-width initialization. Also, the optimal value of this kernelwidth is well-known to vary temporally and across deployment scenarios. To remove the dependency on kernelwidth, a hyperparameter-free MEE-FP based adaptive algorithm is derived using random-Fourier features with sampled kernel widths (RFF-SKW). In addition, a detailed convergence analysis is presented for the proposed hyperparameter-free MEE-FP, which promises a near-optimal error-floor independent of step-size and guarantees convergence for a wide range of step sizes. The promised hyperparameter-independence and improved convergence for the proposed hyperparameter-free MEE-FP are validated by computer simulations considering different case studies.
Information theoretic learning (ITL) criteria have emerged useful for mitigating degradations caused by unknown non-Gaussian noise processes in future wireless communication systems. Specifically, the reproducing kernel Hilbert space (RKHS) based approaches relying on ITL based learning criteria are envisioned to provide nearoptimal mitigation of unknown hardware impairments and non-Gaussian noises. Among several ITL criteria, the recent works find the minimum error entropy with fiducial points (MEE-FP) promising due to its guarantee of unbiased estimation and generalization over generic noise distributions. However, MEE-FP based learning approaches are known to depend on an accurate kernel-width initialization. Also, the optimal value of this kernelwidth is well-known to vary temporally and across deployment scenarios. To remove the dependency on kernelwidth, a hyperparameter-free MEE-FP based adaptive algorithm is derived using random-Fourier features with sampled kernel widths (RFF-SKW). In addition, a detailed convergence analysis is presented for the proposed hyperparameter-free MEE-FP, which promises a near-optimal error-floor independent of step-size and guarantees convergence for a wide range of step sizes. The promised hyperparameter-independence and improved convergence for the proposed hyperparameter-free MEE-FP are validated by computer simulations considering different case studies.
This paper provides analytical results on fixed kernel width based RFF based DL (RFF-DL). The derived analysis and the presented case-studies indicate the RFF-DL's robustness to kernel-width initializations, and offers improved convergence in the low-data regime.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
customersupport@researchsolutions.com
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.