Emotional expression is an essential and important link in human social activities and daily communication activities. Emotion recognition is a technology that uses computer technology to recognize the emotion of recognized objects. When emotion recognition technology was born, the research on human emotion recognition mainly focused on single-modal emotion recognition. Single-modal emotion recognition has been the most commonly used emotion recognition method. However, in recent years, with the continuous development of science and technology and the continuous improvement of people’s awareness of the defects of single-modal emotion recognition, the research on multimodal emotion recognition is increasingly emerging. This paper is aimed at analyzing and studying the multimodal emotion recognition algorithm in artificial intelligence information system. Based on this research topic, this paper designs a single-modal and multimodal emotion recognition comparison simulation experiment for the four emotional characteristics of happiness, sadness, shock, and anger extracted from artificial intelligence information systems. The experiment concluded that the comprehensive emotion recognition accuracy rate of the multimodal emotion recognition algorithm in the artificial intelligence information system reached 93%. Compared with single-mode emotion recognition, the comprehensive recognition accuracy is improved by 7%.