A commentary of GPT-3 in MIT Technology Review 2021

Zhang, Min; Li, Juntao

doi:10.1016/j.fmre.2021.11.011

Cited by 78 publications

(30 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…These advances in technology have led to the ability to process human language in efficient ways. Basing language models on complicated analysis of statistical data are not a new concept as it can be traced back to the 1940s when N-Gram models made their first appearance in the field of computational linguistics and probability [64].…”

Section: Automatic Text Generation and Deep Learningmentioning

confidence: 99%

AI in the Foreign Language Classroom: A Pedagogical Overview of Automated Writing Assistance Tools

Alharbi

2023

Education Research International

View full text Add to dashboard Cite

Recent technological advances in artificial intelligence (AI) have paved the way for improved and in many cases the creation of entirely new and innovative, electronic writing tools. These writing support systems assist during and after the writing process making them indispensable to many writers in general and to students in particular who can get human-like sentence completion suggestions and text generation. Although the wide adoption of these tools by students has been faced with a steady growth of scientific publications in the field, the results of these studies are often contradictory and their validity may be questioned. To gain a deeper understanding of the validity of AI-powered writing assistance tools, we conducted a systematic review of the recent empirical AI-powered writing assistance studies. The purpose of this review is twofold. First, we wanted to explore the recent scholarly publications that evaluated the use of AI-powered writing assistance tools in the classroom in terms of their types, uses, limits, and potential for improving students’ writing skills. Second, the review also sought to explore the perceptions of educators and researchers about learners’ use of AI-powered writing tools and review their recommendations on how to best ingrate these tools into the contemporary and future classroom. Using the Scopus research database, a total of 104 peer-reviewed papers were identified and analyzed. The findings indicate that students are increasingly using a variety of AI-powered writing assistance tools for improving their writing. The tools they are using can be categorized into four main groups: (1) automated writing evaluation tools, (2) tools that provide automated writing corrective feedback, (3) AI-powered machine translators, and (4) GPT-3 automatic text generators. The analysis also highlighted the scholars’ recommendations regarding dealing with learners’ use of AI-powered writing assistance tools and grouped the recommendations into two groups for researchers and educators.

show abstract

Section: Automatic Text Generation and Deep Learningmentioning

confidence: 99%

AI in the Foreign Language Classroom: A Pedagogical Overview of Automated Writing Assistance Tools

Alharbi

2023

Education Research International

View full text Add to dashboard Cite

show abstract

“…Hundreds of billions of parameter model of Gpt3 trained by OpenAI belongs to a model of single text recognition. In the next step, the larger parameter text+image model belongs to the binary text+visual reflection, but its perception has not formed a heart-sensing generated system, and it only has very low cognitive and thinking ability 35 .…”

Section: Model Of Thirteen Sensory Reflexmentioning

confidence: 99%

Generated art if icial general intelligence --the philosophical principle of artificial general intelligence and give an example

Ma¹

2022

Preprint

View full text Add to dashboard Cite

In recent years, with the development of brain science, neuroscience and cognitive science, artificial intelligence technology has made a series of achievements.however, it still fails to achieve the human level of universal artificial intelligence, and the cognitive structure and consciousness are still unsolved mysteries.this paper integrates the evolutionary lawsof the universe, life and thinking, summarizes a modelof generated general intelligence and reveal its philosophical principle and algorithm structure, thencalculates the functions of thinking and consciousnessone by one.the results show that the model and its based principles and algorithms conform to the essential characteristics of biology, physics, neuroscience, cognitive science and philosophy of intelligent species. It is a first implementation modelof artificialgeneral intelligence that truly simulates human intelligence.this paper reveals the essence of cognition, thinking and consciousness, which is the first time to find the operation mode of the last mysterious zone thathuman brain, and also the first answer to the origin of philosophy and the mystery of human mind since human history.

show abstract

“…e pretraining language model [19] has developed rapidly since it was proposed, producing many excellent methods, such as features-based ELMo [20] and fine-tuning-based Open AI GPT [21]. However, these language models are one-way in nature, limiting the ability of pretrained representation.…”

Section: State Of the Artmentioning

confidence: 99%

An Assistant Teaching System of English Creative Writing Based on Semantic Mining

Zhang

2022

Mobile Information Systems

View full text Add to dashboard Cite

To enhance students’ English writing ability, English creative writing has become a common course offered by colleges and universities. English reference is an indispensable tool for creative English writing. How to choose appropriate English references is an important guarantee to complete good work. Therefore, this paper proposes a Deep Semantic Mining-based Recommendation (DSMR) algorithm for English writing reference selection and recommendation to assist the completion of high-quality English creative writing works. The model can extract user features and document attributes more accurately by deeply mining semantic information of literature content and user needs, so as to achieve more accurate recommendations. First, the Bidirectional Encoder Representation from Transformers (BERT) pretraining model is adopted to process literature content and user requirement documents. Through in-depth mining of user characteristics and literature attributes, the problems of data sparsity and cold start of items are effectively alleviated. Then, the forward long short-term memory (LSTM) network was used to focus on the changes in user preferences over time, resulting in more accurate recommendations. The experimental results show that the use of heterogeneous information can significantly improve the recommendation performance, and the additional use of user attribute information can also improve the recommendation performance. Compared with other benchmark models, the recommendation quality of this model is greatly improved.

show abstract

A commentary of GPT-3 in MIT Technology Review 2021

Cited by 78 publications

References 0 publications

AI in the Foreign Language Classroom: A Pedagogical Overview of Automated Writing Assistance Tools

AI in the Foreign Language Classroom: A Pedagogical Overview of Automated Writing Assistance Tools

Generated art if icial general intelligence --the philosophical principle of artificial general intelligence and give an example

An Assistant Teaching System of English Creative Writing Based on Semantic Mining

Contact Info

Product

Resources

About