Integration of visual focus into marine operation simulator for behavior observation and analysis

Abstract

Abstract-This paper presents a framework of visual focus integration into marine operation simulator for behavior observation and analysis. Towards an evaluation of trainees' situation awareness in simulators, the eye tracking device is considered an important facility of understanding trainees' operational proficiency and response capacity to uncertain disturbances. Taking advantages of programmability of Tobii pro glasses 2, the process flow for remote manipulation of the Tobii glasses from creating projects to start/stop recordings is implemented. Meanwhile, taking real-time interaction in the training program into consideration, live video transmission of visual focus is realized by means of multi-threading and pipeline streaming technology. Furthermore, visualization of both statistical data and sensor data according to the recording result of Tobii glasses is achieved, enabling intuitive behavior observation and further behavior analysis. A case study of heavy lifting operation is carried out, from which the integration of the eye tracking system is verified useful for the training of marine operation in simulators.Index Terms-Marine operation simulator, Eye tracking, Tobii pro glasses 2, Live video stream.

Visual Attention Assessment for Expert-in-the-Loop Training in a Maritime Operation Simulator

“…The AOIs in different stages, in conjunction with the corresponding critical operation, are depicted in Table I. Data was collected by our developed software [31] and the gaze points were mapped to the image shown in Fig. 7 with a pixel size of 1210×1047.…”

A Decentralized Sensor Fusion Approach to Human Fatigue Monitoring in Maritime Operations

“…In addition, visual focus is considered a valid clue for fatigue detection. Here we utilized the professional wearable eye tracking device -Tobii pro glasses 2 with gyro and accelerometer integrated for head movement analysis [22] and our developed eye-tracking software to collect the data [23].…”

Analysis and evaluation of eye behavior for marine operation training - A pilot study

“…Eye tracking is implemented in many research areas with respect to training. For example, Kasarskis et al [ 3 ], Sadasivan et al [ 4 ], Sarter et al [ 5 ], Yang et al [ 6 ], Kang & Landry [ 7 ], Dehais et al [ 8 ] and Wickens et al [ 9 ] implemented eye tracking techniques to study flight training with a focus on fixation number, mean fixation duration, mean dwell duration and scanpath; Balk et al [ 10 ], Fisher et al [ 11 ], Palinko et al [ 12 ], Paeglis et al [ 13 ], and Xu et al [ 14 ] studied driving training by analyzing mean fixation duration and its standard deviation, saccade size, pupil diameter and scanpath; Miall & Tchalenko [ 15 ], and Tchalenko [ 16 ] researched drawing issues introducing dwell time; Law et al [ 17 ], and Chetwood et al [ 18 ] carried out surgery training; Kovácsová et al [ 19 ] researched cyclists’ eye movements by introducing fixation duration; Although many successes of eye tracking applications validate the feasibility in human training, it is seldom to see applying eye tracking technology to marine operation training [ 20 ], much less researches on analyzing and evaluating eye behavior during the training.…”