As concept maps are useful for knowledge organization, representation and sharing, people used to draw concept maps by pen in their daily life. And some concept maps are closely related to physical world. In this paper, we propose a kind of context-aware handdrawn concept map with RFID tags, which is especially useful for pen-based mobile devices. First, the structure of the hand-drawn concept map is extracted. And then users can assign RFID tags to concept nodes. With the RFID labeled concept nodes, concept maps are linked to the physical world, which can facilitate users' understanding and retrieval of hand-drawn concept maps.