Using Power Analysis to Evaluate and Improve Research

Murphy, Kevin R.

doi:10.1002/9780470756669.ch6

Cited by 7 publications

(4 citation statements)

References 28 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Due to the large amount of uncertainty when estimating population parameters, small samples tend to produce unstable and untrustworthy results (Murphy, 2002). If research showed that 60 percent of all members support a name change of their SCM society in order to reflect developments in the field, it would be doubtful whether there is a real majority (at population level) if only ten random members were asked for their opinion in the survey.…”

Section: Methodological Issues Of Small Sample Studiesmentioning

confidence: 99%

Small sample surveys: increasing rigor in supply chain management research

Beuckelaer

Wagner²

2012

International Journal of Physical Distribution &Amp; Logistics Management

View full text Add to dashboard Cite

PurposeAttaining high response rates in survey‐based supply chain management (SCM) research is becoming increasingly difficult, but small samples can limit the reliability and validity of empirical research findings. The purpose of this article is to analyze the status quo and provide a discussion of methodological issues related to the use of small samples in SCM research.Design/methodology/approachAn in‐depth review of 75 small sample survey studies published between 1998 and 2007 in three journals in the field that frequently publish survey‐based research papers (TJ, IJPDLM, and JBL) was conducted, and key characteristics of these studies were compared with the characteristics from 44 small sample survey studies published in leading operations management (JOM) and management (AMJ) journals.FindingsThe review of papers published in TJ, IJPDLM, and JBL shows that small samples are frequently used in SCM research. This study provides an overview of current practices, opportunities for improvement, and a number of specific recommendations that may help increase the analytical rigor of (future) survey‐based studies that rely on small samples.Originality/valueThe recommendations provided in this article can greatly benefit researchers in the field of SCM. By following these proposals, the reliability and validity of research findings will be increased, researchers will be better equipped to investigate interesting questions where small samples are the norm rather than the exception (e.g., the study of dyadic supply chain relationships), and important and valid contributions to the theory and practice of SCM will be generated.

show abstract

Section: Methodological Issues Of Small Sample Studiesmentioning

confidence: 99%

Small sample surveys: increasing rigor in supply chain management research

Beuckelaer

Wagner²

2012

International Journal of Physical Distribution &Amp; Logistics Management

View full text Add to dashboard Cite

show abstract

“…Further, by commonly held standards in social and behavioural sciences (Murphy, 2003), with a power of 0.80 (a = 0.05), and a research design with the capacity to detect even small effects, the results speak for themselves. Because the standard deviation measures the variability in outcomes, independent of standardized meta-assessment training, d = 0.27 indicates that the average effect is more than a quarter of the size of the variability in outcomes that one might expect without standardized meta-assessment training.…”

Section: Resultsmentioning

confidence: 99%

Improving learning through meta assessment

McDonald

2010

Active Learning in Higher Education

View full text Add to dashboard Cite

Meta assessment goes beyond assessment in that it examines not only the elements of assessment but also the necessary and sufficient conditions as well as the needs of the assessment. Meta assessment in education tends to be the domain of course designers, planners and policy makers but rarely that of students. This article examines the role of meta assessment in improving student learning. The sample comprised 50 mathematics students from a tertiary educational institution. Achievement scores from the experimental group (those who did standardized meta-assessment training) on a difficult and an easy teacher-made assignment showed that those students performed better than their untrained counterparts from the control group. Findings from semi-structured interviews demonstrated both the breadth and depth of student understanding. This research fills the gap in the literature by demonstrating in a practical way how students who receive standardized meta-assessment training practise reflection and experience learning advantages. From this work, practitioners could take away sufficient stimulus material for developing additional in-depth questions for meta-assessment training and also some best practices that could be used in training their own students. Practitioners would be in a better position to formulate appropriate assessments for their students, assessments that encourage deep thinking and foster lifelong learning.

show abstract

“…First, although we collected data from two samples to test our hypothesized relationships, the size of each sample was relatively small. The samples sizes could have impacted our statistical power and therefore increased the probability of failing to reject the H0 when it was, in fact, untrue (Murphy, 2001). Since some support was found for the hypothesized relationships, we do not think sample size is a major concern.…”

Section: Discussionmentioning

confidence: 99%

Beyond personality: the impact of GMA on performance for entry‐level service employees

Tews

Michel

Lyons

2010

Journal of Service Management

View full text Add to dashboard Cite

Purpose -While personality is often deemed important, few studies have examined the relationship between general mental ability (GMA) and job performance for entry-level service employees. As such, the present study aims to examine the impact of GMA, along with the Big Five personality dimensions, on performance in this context. Design/methodology/approach -Data were collected on servers from multiple units of two large restaurant chains. The employees completed GMA and personality assessments. Managers in Sample 1 provided ratings of service performance and two dimensions of contextual performanceinterpersonal facilitation and job dedication. In Sample 2, sales performance data were obtained from company records. Findings -Unlike the Big Five taxonomy, GMA was the only variable to significantly predict all performance criteria. Research limitations/implications -Successful job performance requires more than habits and motivation rooted in personality; it also requires knowledge acquisition and ongoing problem solving facilitated by GMA. Practical implications -Managers should consider GMA along with personality in hiring decisions to maximize the prediction of employee performance. Originality/value -The paper demonstrates that GMA impacts multiple dimensions of server performance, including task and contextual performance.

show abstract

Using Power Analysis to Evaluate and Improve Research

Cited by 7 publications

References 28 publications

Small sample surveys: increasing rigor in supply chain management research

Small sample surveys: increasing rigor in supply chain management research

Improving learning through meta assessment

Beyond personality: the impact of GMA on performance for entry‐level service employees

Contact Info

Product

Resources

About