Consistency in the development of performance assessment methods in the maritime domain

Abstract

Maritime navigation involves the process of monitoring and controlling the movement of a ship from one position to another. When the ship is approaching or leaving a port, a local navigational expert, the pilot, is often provided for assisting the bridge team to safely and efficiently navigate the littoral waters. However, statistics concerning maritime accidents continues to associate human errors with accidents, which advocates a scrutiny of maritime education and training (MET) for pilotage operations. The pilotage operation is a unique phase of the voyage in which the bridge team has to rely on an external expert with whom they have no prior working experience with. Also, the pilot-bridge team often has to perform immediately, and the consequences of not performing can be calamitous. These aspects suggest a need for dedicated research on how to ensure that bridge teams have the necessary competencies for carrying out safe and efficient pilotage operations. Training and assessment are quintessential instruments for this mission. MET facilities increasingly rely on full-scale simulators for their benefits in training for complex operations. Meanwhile, the assessment of training performance is often based on subjective criteria, which has implications on the reliability and validity of the assessment. Consequently, lacking a reliable and valid assessment method could have repercussions on the educational quality, as well as subsequent developments to the MET facilities' training and education programs. The aim of this research is to understand and to advance performance assessment related to the use of full-scale maritime simulators in MET, with a main objective to reduce the subjective impact that can be present in the performance assessment of pilotage operations. This thesis presents a computer-assisted assessment tool based on a structural probabilistic network, in which the assessment criteria are weighted by using an analytical hierarchical process. This tool is designed for flexibility, so it can easily be Ernstsen: Reducing the subjective impact in performance assessment ___ VI employed across a multitude of pilotage scenarios, and to be less subjective so that it can present more reliable and valid performance information to its stakeholders. The results show that the presented assessment tool can be used for higher reliability in the assessment of technical performance, but that more research is required to assess teamwork performance reliably. The tool's content validity is considered adequate, and that studies over time are required to assess its criterion validity effectively. Regardless, the tool is deemed opportune for generating precise and accurate assessment of training performance and could serve as a steppingstone to objective assessment. Accurate and precise assessment of training performance are imperative for stakeholders that make executive decisions concerning the development of training programs, competency mappings of the workforce, as well as for the trainee to know his or her strengt...

Incidental Memory Recall in Virtual Reality: An Empirical Investigation

“…At the same time, exploring ways to train people in safetycritical operations is central for improving these operations' safety and efficient further, as well as preparing for future safety demands (Mallam, Nazir, Sharma, & Veie, 2018). Understanding how emerging technologies can improve factors relevant to safety-critical operations, such as incidental learning, is essential, which must also be connected with the way these operations are assessed (Ernstsen & Nazir, 2018). The lack of results when comparing IVR and desktop environment regarding this factor may also be because the dependent variables in the study are not connected to effective training.…”

Immersive and Non-Immersive Simulators for the Education and Training in Maritime Domain—A Review

“…The MET schools designed their curriculum to meet the STCW Code's Knowledge, Understanding, and Proficiency (KUP) requirements by combining conventional classrooms, textbooks, and theory assignments with hands-on practical training in laboratories or workshops, virtual training through simulators, and practical on-the-job-training at sea [24]. Convenience in maritime simulations has led to the increased usage of full-mission bridge and engine room simulators for more realistic training [61].…”

Maritime Cyber Risk Management: An Experimental Ship Assessment

“…The first phase outputs were used to develop a survey for on board ship estimation of cyber security safeguards implemented on the ship (second phase of the process). Compared to other types of ship assessment (Ernstsen and Nazir, 2018), the most specific element of the cyber security risk assessment is the conduct of computational vulnerability scanning of the ship's critical cyber systems. Computational cyber vulnerability scanning is a process of reviewing critical systems and assets to locate and identify known weaknesses.…”