A Rapidly Adjustable Object Recognition System through Language Based Prompt Engineering

Abstract

We propose the use of language-based prompt engineering to achieve rapidly adjustable object recognition in RoboCup@Home. The proposed prompt engineering involves humans adding features, such as the color and material of an object, into the text prompts inputted into Language Segment Anything. In this research, we evaluated the effectiveness of our proposed method in three benchmark tests for object recognition at RoboCup@Home 2023. The results show that the highest scores were obtained in specific tasks, indicating that the proposed method applies to various recognition tasks.