Radio frequency interference mitigation based on the asymmetrically reweighted penalized least squares and SumThreshold method

Qing, Zeng; Chen, Xue; Li, Xiangru; Han, J. L.; Wang, Chen; Zhou, Defu; Wang, Tao

doi:10.1093/mnras/staa2551

Cited by 24 publications

(18 citation statements)

References 18 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…These are narrow band emissions that can account for a significant fraction of the received power and have to be filtered out. A baseline [16] is fitted to the spectrum of the data and frequency bin values exceeding the baseline by 50% are set to zero.…”

Section: Radio Frequency Interference (Rfi) Removalmentioning

confidence: 99%

The NuMoon Experiment: Lunar Detection of Cosmic Rays and Neutrinos with LOFAR

Krampah¹,

Buitink²,

Corstanje³

et al. 2021

Proceedings of 37th International Cosmic Ray Conference — PoS(ICRC2021)

View full text Add to dashboard Cite

The low flux of ultra-high-energy cosmic rays (UHECRs) makes it challenging to understand their origin and nature. A very large effective aperture is provided by the Lunar Askaryan technique. Particle cascades in a dielectric medium produce radio emission through the Askaryan effect. Ground based radio telescopes are used to search for nanosecond radio pulses that are produced when cosmic rays or neutrinos interact with the Moon's surface. The LOw Frequency ARray (LOFAR) is currently the largest radio array operating at frequencies between 110 − 190 MHz; the optimum frequency range for Lunar signal search and 30 − 80 MHz for radio detection of air showers. One minute of observation has been carried out with six LOFAR stations beam-formed towards the Moon. In this contribution, we present some preliminary results of the analysis of the data and a complete description of the analysis steps.

show abstract

Section: Radio Frequency Interference (Rfi) Removalmentioning

confidence: 99%

The NuMoon Experiment: Lunar Detection of Cosmic Rays and Neutrinos with LOFAR

Krampah¹,

Buitink²,

Corstanje³

et al. 2021

Proceedings of 37th International Cosmic Ray Conference — PoS(ICRC2021)

View full text Add to dashboard Cite

show abstract

“…There are several shared bottlenecks for the current status. First, the linear methods have a limited excision range due to the inherent limitations of linearity, e.g., they are only adapted to RFI with repeated patterns (Akeret et al 2017) and are not suitable for frequency varying RFI (Offringa et al 2010;Zeng et al 2021). Linearity also leads to difficulties of RFI modeling (Zeng et al 2021).…”

Section: Introductionmentioning

confidence: 99%

“…First, the linear methods have a limited excision range due to the inherent limitations of linearity, e.g., they are only adapted to RFI with repeated patterns (Akeret et al 2017) and are not suitable for frequency varying RFI (Offringa et al 2010;Zeng et al 2021). Linearity also leads to difficulties of RFI modeling (Zeng et al 2021). Thus, nonlinearity deserves special emphases in the future, and should not limit itself mainly in the category of ML and NNs.…”

Section: Introductionmentioning

confidence: 99%

Robust RFI Excision for Pulsar Signals by a Novel Nonlinear M-type Estimator with an Application to Pulsar Timing

Shan

2023

ApJ

View full text Add to dashboard Cite

Radio frequency interference (RFI) mitigation for pulsar signals is a long perplexing issue in astrophysical measurements. Linear mitigation methods are often criticized for limited RFI excision range and weakness of RFI modeling. Meanwhile, thresholding methods (e.g., the SumThreshold) suffer from empirical factors. In our opinion, the main defect of the current status is the lack of a concise definition to distinguish signals from RFI with the aid of certain techniques, e.g., sparse representation. This point is the root cause of these problems and also forms our motivation. This paper aims to expand the excision range (e.g., the on-pulse and quasiperiodic RFI) and cut down some empirical factors. The main contribution is that we give a definition and derive a widely practicable nonlinear framework for RFI excision. This framework can overcome the susceptibility of the least-square criterion to RFI, and excise almost all types of RFI once and for all. A robust LnCosh criterion based nonlinear maximum likelihood-type (M-type) penalized smoothing estimator is introduced. The novelty is that this estimator is first embedded into the iterative shrinkage-thresholding algorithm (ISTA) and the fast ISTA. Nonlinearity highlights this method. Curvelet sparsity gives satisfying approximation for pulsar signals containing dispersion feature. Finally, useful signal details will be retrieved from the excision residual by a morphological component analysis. This method is applied to the time-frequency signals collected by the Nanshan 26 m Radio Telescope. The numerical experiments can persuasively prove that it has desired application prospects.

show abstract

“…Finding alternative methods for flagging RFI is an ongoing area of research and experimentation (e.g. [3][4][5]). Algorithms that flag RFI must conform to a specific standard that the technical challenges of interferometry impose.…”

Section: Introductionmentioning

confidence: 99%

Trialling the use of generative adversarial networks for efficient identification of radio frequency interference

Brooks¹,

Argo²

2023

Proceedings of 15th European VLBI Network Mini-Symposium and Users' Meeting — PoS(EVN2022)

View full text Add to dashboard Cite

A new method of detecting RFI in time-frequency visibility images is presented, using the novel Generative Adversarial Network machine learning architecture. The network is trained entirely on manually flagged data produced by the Multi-Element Radio Linked Interferometer Network (e-MERLIN). The network shows an excellent ability to identify and flag RFI features that are common in the training set, but is not as proficient at identifying less common features such as wide-band RFI. The network will be tested against current methods of automatic flagging to quantify and compare its effectiveness. More advanced methods of excising RFI are critical to the future of radio astronomy as the radio spectrum becomes more polluted and even the most remote stations are disrupted by modern satellite networks.

show abstract

Radio frequency interference mitigation based on the asymmetrically reweighted penalized least squares and SumThreshold method

Cited by 24 publications

References 18 publications

The NuMoon Experiment: Lunar Detection of Cosmic Rays and Neutrinos with LOFAR

The NuMoon Experiment: Lunar Detection of Cosmic Rays and Neutrinos with LOFAR

Robust RFI Excision for Pulsar Signals by a Novel Nonlinear M-type Estimator with an Application to Pulsar Timing

Trialling the use of generative adversarial networks for efficient identification of radio frequency interference

Contact Info

Product

Resources

About