We present a mobile phone based augmented reality (AR) assembly system that enable users to view complex models on their mobile phones. It is based on a client-server architecture, where complex model information is located on a PC, and a mobile phone with the camera is used as a thin client access device to this information. With this system users are able to see an AR view that provides step by step guidance for a real world assembly task. We also present results from a pilot user study evaluating the system, showing that people felt the interface was intuitive and very helpful in supporting the assembly task.
INTRODUCTIONWe are interested in exploring how augmented reality (AR) technology can be used to provide intuitive assistance with real world assembly, repair and training tasks. In this paper we present our mobile phone based augmented reality assembly system. We first review previous related work, and then describe our prototype based on a mobile phone client and remote PC server architecture. Finally we provide some preliminary results from a pilot user study evaluating the system.
RELATED WORKSeveral other research groups have explored the use of AR for assisting with real world assembly tasks. One of the earliest of these efforts was augmenting of wire harness assembly at Boeing [1], using a wearable PC with head mounted display attached. More recent augmented assembly and maintenance solutions have been based on portable PC hardware, for example BMW's augmented car maintenance system [3]. Among the first to employ handheld devices were Geiger et al. [2], in an application providing augmented operation instructions for home appliances. Currently hand held (ultra mobile) PCs are a popular choice for portable AR assembly applications, e.g. the ULTRA system [4].Most recently, mobile phones have been used for AR applications, although not for assembly tasks. The first of these, AR-Phone [5], used Bluetooth to send phone camera images to a remote sever for processing and graphics overlay, taking several seconds per image. Since then, Moehring [7] developed the first example of an AR application running entirely on the phone, while Henrysson ported the ARToolKit library over to the Symbian phone platform [6]. Since that time there have been other examples of mobile phone based AR interfaces, e.g. [8].As can be seen, AR technology has shown to be useful for assembly tasks, but until now it has not been delivered on a mobile phone platform. Our work is novel because it provides the first example of an AR assembly interface delivered on a mobile phone, it has unique interface elements that have not been demonstrated before in an AR assembly application, and it also provides a user study of the AR interface.
DEMONSTRATION SYSTEMThere are a number of challenges in providing a high quality user experience for augmented assembly on mobile phones. Product model formats vary enormously, and the number of polygons can be very large (e.g the 0.5 million triangle model in Figure 1 is very small for industrial ...
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.