Yan Fu (1854-1921) and the Peking University = Yan Fu yu Beijing da xue

Abstract

Text evaluation has historically posed significant challenges, often demanding substantial labor and time cost. With the emergence of large language models (LLMs), researchers have explored LLMs' potential as alternatives for human evaluation. While these single-agent-based approaches show promise, experimental results suggest that further advancements are needed to bridge the gap between their current effectiveness and human-level evaluation quality. Recognizing that best practices of human evaluation processes often involve multiple human annotators collaborating in the evaluation, we resort to a multi-agent debate framework, moving beyond single-agent prompting strategies. The multi-agentbased approach enables a group of LLMs to synergize with an array of intelligent counterparts, harnessing their distinct capabilities and expertise to enhance efficiency and effectiveness in handling intricate tasks. In this paper, we construct a multi-agent referee team called ChatEval to autonomously discuss and evaluate the quality of generated responses from different models on open-ended questions and traditional natural language generation (NLG) tasks. We derive insights and lessons from practical scenarios where humans instigate group discussions for brainstorming and propose different communication strategies within ChatEval. Our experiments on two benchmark tasks illustrate that ChatEval delivers superior accuracy and correlation in alignment with human assessment. Furthermore, we find that the diverse role prompts (different personas) are essential in the multi-agent debate process; that is, utilizing the same role description in the prompt can lead to a degradation in performance. Our qualitative analysis also shows that ChatEval transcends mere textual scoring, offering a humanmimicking evaluation process for reliable assessments. Our code is available at https://github.com/chanchimin/ChatEval.

Plato’s Myth of Er for Psychic Education in the Philosophical Way

“…They are interactive in an organic unity, aiming through correct education and training to facilitate the harmony between the soul and the body, foster the personality of kalokagathia as beauty-cum-good based on the cardinal virtues of wisdom, courage, temperance and justice, and eventually cultivate more qualified citizens for the sake of the ideal city-state in Plato"s vision. [6] This discussion is to tender much attention to the allegorical exposition of the myth of Er in particular. It looks into the three ways of educating the human soul with regard to the primary weaknesses of human nature and the theoretical hypotheses of human perfection tallied with perfect citizenship.…”

Highly Efficient Power Conversion from Salinity Gradients with Ion-Selective Polymeric Nanopores

“…Compared with PET, polyimide (PI) has more abundant aromatic rings, hence it is more susceptive to ion irradiation damage while less sensitive to UV light than PET. [6,8] Thus, we speculate that nanopores could form in the irradiated PI membrane even without UV illumination, and these nanopores could also show selective ionic transport as those in PET membranes.…”

“…However, their energy conversion efficiency is usually limited to 31-37%, below the theoretical limit of 50%. [3,4,6] A nanofluidic energy conversion device has also been fabricated with polymer membranes subjected to high-energy ion irradiation and subsequent chemical etching. [1] Despite its robustness, flexibility and efficiency in large-scale production, the previous polymeric device only has a highest energy conversion efficiency of ∼35%, [1] and a maximum output power of 56 mW/m 2 .…”

“…[1] Despite its robustness, flexibility and efficiency in large-scale production, the previous polymeric device only has a highest energy conversion efficiency of ∼35%, [1] and a maximum output power of 56 mW/m 2 . [6] Theoretical analysis suggests that the energy conversion efficiency can be optimized by enhancing the surface-charge density and reducing the diameter of the nanochannel. On the other hand, it is also important to increase the number density of the nanopores to further improve the maximum output power.…”

“…However, with the conventional chemical etching, the irradiation ion fluence is often limited to 10 6 /cm 2 because the samples with higher ion fluences often suffer from the loss of selective ionic transport due to quick formation of oversize pores. [6] Interestingly, our recent study revealed that no chemical etching is needed in fabricating highly selective ionic transport nanopores in polyethylene terephthalate (PET) membranes irradiated with an ion fluence as high as 10 11 /cm 2 . [7] A sufficiently long UV treatment after ion irradiation was found to be the key fabrication procedure.…”