Assessing the Reporting of Reliability in Published Content Analyses: 1985–2010

Lovejoy, Jennette; Watson, Brendan R.; Lacy, Stephen; Riffe, Daniel

doi:10.1080/19312458.2014.937528

Cited by 28 publications

(27 citation statements)

References 18 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Mean percent agreement was 81% on the average. However, more robust reliability coefficients (e.g., Krippendorff's α) were very low and not acceptable. Therefore, we conducted further reliability codings post hoc for 5 of the 10 countries, increasing the number of articles to N = 30–40 per country.…”

Section: Methodsmentioning

confidence: 95%

The Mediated Amplification of a Crisis: Communicating the A/H1N1 Pandemic in Press Releases and Press Coverage in Europe

2017

View full text Add to dashboard Cite

In the aftermath of the A/H1N1 pandemic, health authorities were criticized for failures in crisis communication efforts, and the media were accused of amplifying the pandemic. Considering these criticisms, A/H1N1 provides a suitable case for examining risk amplification processes that may occur in the transfer of information from press releases to print news media during a health crisis. We integrated the social amplification of risk framework with theories of news decisions (news values, framing) in an attempt to contribute to existing research both theoretically and empirically. We conducted a quantitative content analysis of press releases disseminated by health and governmental authorities, as well as the quality and tabloid press in 10 European countries between March 2009 and March 2011. Altogether 243 press releases, 1,243 quality press articles, and 834 tabloid press articles were coded. Consistent with research on news values and framing the results suggest that quality and tabloid papers alike amplified A/H1N1 risks by emphasizing conflict and damage, presenting information in a more dramatized way, and using risk-amplifying frames to a greater extent and risk-attenuating frames to a lesser extent than press releases. To some extent, the quality and tabloid press differed in how risk information was presented. While tabloid press articles seemed to follow the leading quality press with regards to content and framing of health crisis coverage, they exhibited a stronger emphasis on drama and emotion in the way they presented information.

show abstract

Section: Methodsmentioning

confidence: 95%

The Mediated Amplification of a Crisis: Communicating the A/H1N1 Pandemic in Press Releases and Press Coverage in Europe

2017

View full text Add to dashboard Cite

show abstract

“…There is no need to assess intercoder reliability in an algorithmic approach, thus distinguishing it from traditional content analysis. This is noteworthy in light of scholars' concern about the poor reporting of intercoder reliability in published content analyses (Lovejoy et al 2014;Riffe and Freitag 1997).…”

Section: Assessing Intercoder Reliabilitymentioning

confidence: 94%

Content Analysis and the Algorithmic Coder

Zamith

Lewis²

2015

The ANNALS of the American Academy of Political and Social Scie

View full text Add to dashboard Cite

To deal with ever-larger datasets, media scholars are increasingly using computational analytic methods. This article focuses on how the traditional (manual) approach to conducting a content analysis-a primary method in the study of media messages-is being reconfigured, assesses what is gained and lost in turning to computational solutions, and builds on a "hybrid" approach to content analysis. We argue that computational methods are most fruitful when variables are readily identifiable in texts and when source material is easily parsed. Manual methods, though, are most appropriate for complex variables and when source material is not well digitized. These modes can be effectively combined throughout the process of content analysis to facilitate expansive and powerful analyses that are reliable and meaningful.Keywords: content analysis; computational social science; computational content analysis; hybrid content analysis; digital research methods; media analysis; algorithms T he abundance of digitized data has become a defining feature of modern society, and particularly of communication that is expressed through digital, social, and mobile platforms: 308 The ANNALS OF The AMeRICAN ACADeMY communication and media research, especially, the possibilities are great: as computational tools and processes have become easier to employ (e.g., via opensource software), as large-scale datasets of digital media content have become more readily attainable (e.g., by scraping tweets or websites), and even as print media content, such as old newspapers and books, have become increasingly available in digital form, new types of large-scale, algorithm-driven analyses of media content have become possible, enabling scholars to address novel questions. To cite just one example, Colleoni, Rozza, and Arvidsson (2014) used more than a billion data points to reveal key differences in the structures of political homophily among Democrats and Republicans on social networks such as Twitter. Such "naturally occurring" data such as public tweets, and the growth in computing capacity that facilitates the collection and analysis of such voluminous data, marks a key turn toward computational social science (Shah, Cappella, and Neuman, this volume).As a distinct approach to social inquiry, computational social science is characterized by research that (1) uses large, complex datasets; (2) often involves social and digital media sources; (3) employs algorithmic or computational solutions to generate patterns and inferences from data; and (4) is applicable to social theory in a wide variety of domains (Shah, Cappella, and Neuman, this volume). examples of such research may be found across a range of disciplines, including a growing number and variety at the intersection of the social sciences and the digital humanities (Bruns 2013). Much of this work involves the quantitative analysis of textual content. Yet unlike traditional content analyses-which rely predominantly on human judgments-these studies are largely driven by algorithms and framework...

show abstract

“…Communication scholars have explored trends in research methods (e.g., Lovejoy, Watson, Lacy, & Riffe, 2014;Riffe & Freitag, 1997), as well as substantive and conceptual areas like journalism (e.g., Cooper, Potter, & Dupagne, 1994), advertising (e.g., Soley & Reid, 1988), new media (e.g., Cho & Khang, 2006;Tomasello, 2001), public relations (e.g., Ki & Khang, 2005;Pasadeos, Berger, & Renfro, 2010), and crisis communication (e.g., An & Cheng, 2010;Avery et al, 2010;Palenchar & Heath, 2007).…”

Section: Trend Study In Communication Researchmentioning

confidence: 99%

Assessing the Reporting of Reliability in Published Content Analyses: 1985–2010

Cited by 28 publications

References 18 publications

The Mediated Amplification of a Crisis: Communicating the A/H1N1 Pandemic in Press Releases and Press Coverage in Europe

The Mediated Amplification of a Crisis: Communicating the A/H1N1 Pandemic in Press Releases and Press Coverage in Europe

Content Analysis and the Algorithmic Coder

Crisis-related research in communication and business journals: An interdisciplinary review from 1992 to 2011

Contact Info

Product

Resources

About