“Cargo Cult” science in traditional organization and information systems survey research: A case for using nontraditional methods of data collection, including Mechanical Turk and online panels

Lowry, Paul Benjamin; D’Arcy, John; Hammer, Bryan I.; Moody, Gregory D.

doi:10.1016/j.jsis.2016.06.002

Cited by 219 publications

(123 citation statements)

References 51 publications

(68 reference statements)

Supporting

Mentioning

113

Contrasting

Order By: Relevance

“…To test our hypotheses, we collected responses from 411 organizational insiders through a prescreened online panel (i.e., SurveyMonkey—an online survey platform that provides panels from industry), which is a well‐established methodology in IS research (Steelman, Hammer, & Limayem, ; Lowry, D'Arcy, Hammer, & Moody, ). Prescreened panels are especially apt for gathering responses from individuals of a specified population across organizations (Lowry et al., ). For example, based on the panel provider's detailed knowledge of panel members, we were able to gather survey responses from employed individuals using computers to complete a portion of their work tasks.…”

Section: Studymentioning

confidence: 99%

Intentions to Comply Versus Intentions to Protect: A VIE Theory Approach to Understanding the Influence of Insiders’ Awareness of Organizational SETA Efforts

et al. 2017

View full text Add to dashboard Cite

In contemporary organizations, the protection of an organization's information assets is reliant on the behavior of those entrusted with access to organizational information and information systems (IS). Because of this reliance, organizations increasingly prioritize the training and education of employees through security education, training, and awareness (SETA) initiatives. Through expectancy theory and its central components of valence, instrumentality, and expectancy (VIE), we investigate the role of insiders’ awareness of organizational SETA efforts on two similar, yet distinct, security‐related intentions: intention to comply with information security policies (ISPs) and intention to protect the organization's information assets from their threats. Not only do we show how distinct these two concepts are from a quantitative standpoint, we also demonstrate differences between insiders’ compliance and protection intentions, as well as their motivational antecedents. Moreover, we demonstrate how our powerful, yet parsimonious, model based on expectancy theory explains a significant portion of the variance in these two important concepts: 52.7% in intentions to comply with ISPs and 68.1% in intentions to protect organizational information assets. We discuss the implications of our findings for research and practice and offer future research opportunities.

show abstract

Section: Studymentioning

confidence: 99%

Intentions to Comply Versus Intentions to Protect: A VIE Theory Approach to Understanding the Influence of Insiders’ Awareness of Organizational SETA Efforts

et al. 2017

View full text Add to dashboard Cite

show abstract

“…We used Amazon Mechanical Turk (aka mTurk) to collect anonymous responses from a highly filtered demographic. We followed the latest procedures on effectively conducting research on mTurk, including careful demographic screening and the use of attention traps in the survey, which improved the data quality (Lowry, D'Arcy, Hammer, & Moody, ). Our filters required participants to adhere to the following requirements: be at least 24 years old; speak English at a highly proficient level (85% minimum proficiency); be research‐oriented students or academics; use a large‐screen device (not a smartphone) while participating in the study. …”

Section: Methodsmentioning

confidence: 99%

Visual storytelling for improving the comprehension and utility in disseminating information systems research: Evidence from a quasi‐experiment

Mirkovski

Gaskin

Hull

et al. 2019

Information Systems Journal

Self Cite

View full text Add to dashboard Cite

Since the start of human civilisation, storytelling has served as an effective medium for disseminating important knowledge within families, communities, and organisations. We make a case for the use of visual storytelling, namely, video stories, to supplement traditional scholarly articles in the Information Systems (IS) discipline, thereby exploring its potential to improve actual and perceived comprehension, perceived utility, satisfaction as well as intentions to cite, share, and accept research. Drawing on cognitive learning theory, the cognitive theory of multimedia learning and the literature on deep processing, we develop our research model, which is based on the model by Jiang and Benbasat (2007). We test our model in experimental settings with 269 research‐oriented students and academics who were randomised into four conditions: (1) reading a text‐based article, (2) reading the script for a video about the article, (3) viewing the video story of the article, and (4) viewing the video story followed by reading the article. Results showed that the article's script was significantly perceived to be the least useful in disseminating research content. The video story and text‐based article were perceived to be equally useful, and supplementing the text‐based article with a video story was perceived to be the most useful. Moreover, the video story and text‐based article supplemented by a video story were of roughly equal effectiveness; yet, the video script was the most effective, and the text‐based article was least effective relative to other formats in disseminating scholarly knowledge. Last, we discuss how to further improve the design of video stories by referring to the critical narrative theory, which has the potential to significantly promote the dissemination of IS scholarly knowledge.

show abstract

“…To deal with this issue, some organisational researchers have taken to online recruiting strategies (eg, advertisements on Craigslist and on Facebook's targeted advertisement system) to obtain ESM study participants Judge, Simon, Hurst, & Kelley, 2014;Rodell & Judge, 2009;Simon, Hurst, Kelley, & Judge, 2015). Appendix S2 describes MTurk, our recruiting procedures, and the screening techniques we used to ensure an appropriate sample for our organisational context, which were guided by recent recommendations for using MTurk in organisational research (Lowry, D'Arcy, Hammer, & Moody, 2016). Our study targeted employed, computer-using professionals from the United States.…”

Section: Methodsmentioning

confidence: 99%

Cognitive‐affective drivers of employees' daily compliance with information security policies: A multilevel, longitudinal study

D’Arcy

Lowry

2017

Information Systems Journal

Self Cite

131

View full text Add to dashboard Cite

We present a model of employee compliance with information security policy (ISP) that (1) explicates stable, cognitive beliefs regarding the consequences of compliance and noncompliance as well as state‐based affective constructs, namely, positive and negative mood states and episodic, security‐related work‐impediment events, and (2) provides an expanded conceptualisation of moral considerations and normative influences regarding employees' ISP compliance. Because affect is central to this theorisation, we ensure that the model captures and explains differences in day‐to‐day affective constructs to account for the often fleeting nature of affective states. We test our multilevel model using an experience‐sampling methodology design, in which employees completed daily surveys over a 2‐week period, followed by a hierarchal linear modelling statistical assessment. Our contribution to theory is a unique account of ISP compliance that integrates affective factors with constructs from rational choice theory and theory of planned behaviour and that diverges from prior conceptualisations of ISP compliance as a purely stable and reason‐based phenomenon. For practitioners, our results suggest that a combination of cognitive and affective influences may produce discrete episodes of ISP compliance that do not coincide with prior behavioural trends.

show abstract

“Cargo Cult” science in traditional organization and information systems survey research: A case for using nontraditional methods of data collection, including Mechanical Turk and online panels

Cited by 219 publications

References 51 publications

Intentions to Comply Versus Intentions to Protect: A VIE Theory Approach to Understanding the Influence of Insiders’ Awareness of Organizational SETA Efforts

Intentions to Comply Versus Intentions to Protect: A VIE Theory Approach to Understanding the Influence of Insiders’ Awareness of Organizational SETA Efforts

Visual storytelling for improving the comprehension and utility in disseminating information systems research: Evidence from a quasi‐experiment

Cognitive‐affective drivers of employees' daily compliance with information security policies: A multilevel, longitudinal study

Contact Info

Product

Resources

About