In terrestrial remote sensing applications, the spaceborne Global Navigation Satellite System-Reflectometry (GNSS-R) has demonstrated its worth. The application to land surface soil moisture (SSM) detection is particularly intriguing since it has the ability to provide fine-scale results to supplement traditional satellite-based active and passive missions. To date, many retrieval algorithms for spaceborne GNSS-R have been developed in order to produce SSM products. However, detailed product reliability and robustness evaluations are still absent. In this study, the satellite-based microwave radiometry product, the model-base product, and in-situ measurements from the Chinese soil moisture monitoring network with over 1800 ground stations during the year 2018 were used to evaluate the CYclone Global Navigation Satellite System (CYGNSS) mission Level-3 SSM products released by the University Corporation for Atmospheric Research (UCAR) and the University of Colorado at Boulder (CU). Typical relative skill metrics and triple collocation-based metrics, along with corresponding confidence intervals, are given to analyze the performance. According to the pixel-by-pixel validation and overall statistical findings, the results reveal that the current CYGNSS-based SSM exhibits low performance in southern China when compared to the radiometry-based data with a low R2 (median R2=0.09) and the ubRMSD 0.055 cm3cm-3, which is poorer than the results from SMAP against in-situ measurements (median R2=0.25, ubRMSD=0.046 cm3cm-3). To acquire better results to support the related operational applications in the future, the new enhanced retrieval algorithms and high-accuracy calibration referenced data must be used.