← Back to Search
Effect Size Measures For Mediation Models: Quantitative Strategies For Communicating Indirect Effects.
K. Preacher, K. Kelley
Published 2011 · Psychology, Medicine
Download PDFAnalyze on Scholarcy
The statistical analysis of mediation effects has become an indispensable tool for helping scientists investigate processes thought to be causal. Yet, in spite of many recent advances in the estimation and testing of mediation effects, little attention has been given to methods for communicating effect size and the practical importance of those effect sizes. Our goals in this article are to (a) outline some general desiderata for effect size measures, (b) describe current methods of expressing effect size and practical importance for mediation, (c) use the desiderata to evaluate these methods, and (d) develop new methods to communicate effect size in the context of mediation analysis. The first new effect size index we describe is a residual-based index that quantifies the amount of variance explained in both the mediator and the outcome. The second new effect size index quantifies the indirect effect as the proportion of the maximum possible indirect effect that could have been obtained, given the scales of the variables involved. We supplement our discussion by offering easy-to-use R tools for the numerical and visual communication of effect size for mediation effects.
This paper references
Multivariate analysis in education research
M M Tatsuoka (1973)
Confidence Intervals for Standardized Effect Sizes: Theory, Application, and Implementation
K. Kelley (2007)
How to Estimate and Interpret Various Effect Sizes
T. Vacha-Haase (2004)
The Sage Handbook of Social Research Methods
Pertti Alasuutari (2008)
Estimating the proportion of treatment effect explained by a surrogate marker.
P. Flandre (1999)
Comparison of methods for constructing confidence intervals of standardized indirect effects
M. Cheung (2009)
Contemporary approaches to assessing mediation in communication research.
K. Preacher (2008)
On the Logic and Purpose of Significance Testing
J. M. Cortina (1997)
NCES Statistical Standards.
E. Flemming (1992)
Sample size planning for statistical power and accuracy in parameter estimation.
S. Maxwell (2008)
The Mediation Proportion: A Structural Equation Approach for Estimating the Proportion of Exposure Effect on Outcome Explained by an Intermediate Variable
S. Ditlevsen (2005)
Methods for the Behavioral, Educational, and Social Sciences: An R package
K. Kelley (2007)
Large Sample Estimators for Standard Errors of Functions of Correlation Coefficients
P. Bobko (1980)
The Controversy over Null Hypothesis Significance Testing Revisited
N. Balluerka (2005)
Effect Size Estimation: Factors to Consider and Mistakes to Avoid
James A. Breaugh (2003)
Magnitudes of experimental effects
W. H. Yeaton (1982)
Going beyond tests of significance: Is psychology ready?
D. Dooling (1975)
Introduction to Robust Estimation and Hypothesis Testing
J. Kastner (2005)
Confidence intervals and statistical power of the ‘Validation’ ratio for surrogate or intermediate endpoints
L. Freedman (2001)
Effect size, confidence interval
S. 1136bmj.c869 Nakagawa (2007)
Comparison of Mediated Effects: A Correlation Structure Modeling Approach
T. Raykov (2008)
Standardization in Causal Analysis
Jae-on Kim (1981)
A comparison of methods to test mediation and other intervening variable effects.
D. MacKinnon (2002)
Sample Size Planning
K. Kelley (2010)
An Introduction to the Bootstrap
M. Kenward (2007)
The Complex Nature of Unique and Shared Effects in Hierarchical Linear Regression : Implications for Developmental Psychology
R. Baltes (2001)
Criteria for the validation
M. 014920630302900106 Buyse (1998)
Handbook of research methods in personality psychology
Richard W. Robins (2007)
The fallacy of employing standardized regression coefficients and correlations as measures of effect.
S. Greenland (1986)
Frank W. Schmidt (2008)
Statistical Reform in Psychology
G. Cumming (2007)
Effect-Size Estimates: Issues and Problems in Interpretation
Edward F. Fern (1996)
Socialization of problem behavior
R. Press. Jessor (1991)
Mediators, Moderators, and Tests for Mediation.
L. James (1984)
Meta-analysis of raw mean differences.
C. Bond (2003)
PREACHER AND KELLEY
MBESS (Version 3.2.0) [Computer software
K. 108000273170802490632 Kelley (2010)
Variance Explained: Why Size Does Not (Always) Matter
M. Fichman (1999)
The nature of data, or how to choose a correlation
J. B. Carroll (1961)
Criteria for the validation of surrogate endpoints in randomized experiments.
M. Buyse (1998)
The nature of the data, or how to choose a correlation coefficient
J. Carroll (1961)
Measures of explained variance: Cautions
K. E. O’Grady (1982)
Confidence Intervals as an Alternative to Significance Testing
E. Brandstätter (1999)
Estimating Mediated Effects in Prevention Studies
D. MacKinnon (1993)
Statistical reform in psychology: Is anything changing?
G Cumming (2007)
Correlation and the coefficient of determination
D. Ozer (1985)
How Not to Lie with Statistics: Avoiding Common Mistakes in Quantitative Political Science
G. King (1986)
Computing Correct Confidence Intervals for Anova Fixed-and Random-Effects Effect Sizes
Fiona Fidler (2001)
Effect size, confidence interval and statistical significance: a practical guide for biologists
S. Nakagawa (2007)
Mediation in experimental and non
P. E. 0193841X8200600501 Shrout (2002)
Introduction to Robust Estimation and Hypothesis Testing (2nd ed.)
Eric R. Ziegel (2005)
Addressing Moderated Mediation Hypotheses: Theory, Methods, and Prescriptions
K. Preacher (2007)
Methods of Correlation Analysis.
H. C. Carver (1931)
Asymptotic and resampling
A measure of the proportion of treatment effect explained by a surrogate marker.
Y. Wang (2002)
Quantifying Parsimony in Structural Equation Modeling
K. Preacher (2006)
Introduction to Statistical Mediation Analysis
D. MacKinnon (2008)
Contrasts in multiple mediator models.
D. MacKinnon (2000)
The Fallacy of the
A. Keller (1945)
Analysis of mediating variables in prevention intervention studies Scientific methods for prevention intervention research
D P Mackinnon (1994)
Reporting Practices and APA Editorial Policies Regarding Statistical Significance and Effect Size
T. Vacha-Haase (2000)
Power and accuracy for omnibus
K. 989X.8.3.305 Kelley (2008)
Statistical methods in psychology journals
L Wilkinson (1999)
Sample Size Planning for the Squared Multiple Correlation Coefficient: Accuracy in Parameter Estimation via Narrow Confidence Intervals
K. Kelley (2008)
D. MacKinnon (2007)
Asymptotic and resampling strategies for assessing and comparing indirect effects in multiple mediator models
K. Preacher (2008)
Measuring Representation: Perils of the Correlation Coefficient
Christopher H. Achen (1977)
It's Not Effect Sizes So Much as Comments About Their Magnitude That Mislead Readers
D. Robinson (2003)
Confidence Intervals for Effect Sizes
X. Fan (2001)
Problem Behavior and Psychosocial Development; a Longitudinal Study of Youth
E. Labouvie (1978)
Practical Significance: A Concept Whose Time Has Come
R. Kirk (1996)
Defending the Statistical Status Quo
R. Frick (1999)
Covariances between regression coefficient estimates in a single mediator model.
Davood Tofighi (2009)
Reporting practices and APA editorial policies regarding REPORTING EFFECT SIZE FOR MEDIATION statistical significance and effect size
T Vacha-Haase (2000)
Statistical Methods in Psychology Journals: Guidelines and Explanations
L. Wilkinson (1999)
Optimal design in psychological research.
Gary H. McClelland (1997)
CONSORT 2010 Explanation and Elaboration: updated guidelines for reporting parallel group randomised trials
D. Moher (2010)
Standards for Reporting on Empirical Social Science Research in AERA Publications
P. Moss (2006)
Better Bootstrap Confidence Intervals
B. Efron (1987)
Standardized or simple effect
T. Author. Baguley (2009)
The moderator-mediator variable distinction in social psychological research: conceptual, strategic, and statistical considerations.
R. M. Baron (1986)
Confidence intervals for standardized effect
The law of maximum expected potential effect: constraints placed on program effectiveness by mediator relationships
W. Hansen (1996)
A Note on the Restriction of Range for Pearson Product-Moment Correlation Coefficients
L. Hubert (1972)
Evaluating effect size in personality research
R. W. Robins (2007)
Quantifying parsimony in structural equation
K. J. Guilford Press. Preacher (2006)
Bias in cross-sectional analyses of longitudinal mediation.
S. Maxwell (2007)
Determining relative importance of predictors with the observational design.
J. M. Cortina (1998)
Effect-Size Measures and Meta-Analytic Thinking in Counseling Psychology Research
Robin K Henson (2006)
What Future Quantitative Social Science Research Could Look Like: Confidence Intervals for Effect Sizes
B. Thompson (2002)
Socialization of problem behavior in youth [Data file and code book
R Jessor (1991)
Sociological Methodology 1982
R. G. Stansfield (1983)
A Simulation Study to
Explore Configuring (2004)
Statistical difficulties of detecting interactions and moderator effects.
G. Mcclelland (1993)
Sample size for multiple regression: obtaining regression coefficients that are accurate, not simply significant.
K. Kelley (2003)
Correct Confidence Intervals for Various Regression Effect Sizes and Parameters: The Importance of Noncentral Distributions in Computing Intervals
M. Smithson (2001)
The burden of benevolent sexism: how it contributes to the maintenance of gender inequalities
M. Barreto (2005)
Statistical assessment of mediational effects for logistic mediational models.
B. Huang (2004)
Testing mediational models with longitudinal data: questions and tips in the use of structural equation modeling.
D. Cole (2003)
Standardized or simple effect size: what should be reported?
Thom Baguley (2009)
Asymptotic Confidence Intervals for Indirect Effects in Structural Equation Models
M. Sobel (1982)
A Simulation Study of Mediated Effect Measures.
D. MacKinnon (1995)
Confidence intervals and statistical power
L. S. Freedman (2001)
Evaluating Results Using Corrected and Uncorrected Effect Size Estimates
P. Snyder (1993)
Estimating mediated effects
Mediation in experimental and nonexperimental studies: new procedures and recommendations.
P. Shrout (2002)
Confidence Intervals for Effect Sizes in Analysis of Variance
K. Bird (2002)
Statistics As Principled Argument
R. Abelson (1995)
Magnitudes of Experimental Effects in Social Science Research
L. Sechrest (1982)
Statistical Power Analysis for the Behavioral Sciences
J. Cohen (1969)
Effect sizes, confidence intervals, and confidence intervals for effect sizes
B. Thompson (2007)
Measures of explained variance: Cautions and limitations.
K. E. O’grady (1982)
Methods for integrating moderation and mediation: a general analytical framework using moderated path analysis.
J. Edwards (2007)
Analysis of mediating variables in prevention intervention studies
D. P. MacKinnon (1994)
Standards for Reporting on Empirical Social Science Research in AERA Publications American Educational Research Association
B. Schneider (2006)
Multivariate analysis in education research
B. Thompson (1973)
Publication Manual of the American Psychological Association
Kate E Decleene (2012)
Mediation analysis via potential outcomes models.
J. Albert (2008)
Effect sizes for research: A broad practical approach.
Robert J. Grissom (2005)
The Decomposition of Effects in Path Analysis
D. Alwin (1975)
R2 effect-size measures for mediation analysis
Amanda J Fairchild (2009)
Analysis of mediating variables in prevention and intervention research.
D. MacKinnon (1994)
Least Sum of Euclidean Regression Residuals: Estimation of Effect Size
K. Berry (2002)
Publication manual of the
Statistical Power Analysis for the Behavioral Sciences (2nd ed.)
P. Lachenbruch (1989)
Is the Pearson r 2 Biased, and if So, What Is the Best Correction Formula?
Zhongmiao Wang (2007)
The Sage sourcebook of advanced data analysis methods for communication research
A. Hayes (2008)
Evaluating effect size in personality research
D J Ozer (2007)
The controversy over null
N. 000712608X377117 Balluerka (2005)
A Primer on the Understanding, Use, and Calculation of Confidence Intervals that are Based on Central and Noncentral Distributions
G. Cumming (2001)
Clarifying conditions and decision points for mediational type inferences in Organizational Behavior
J. Mathieu (2006)
This paper is referenced by
“I Don’t Care About Politics, I Just Like That Guy!” Affective Disposition and Political Attributes in Information Processing of Political Talk Shows
C. Weinmann (2017)
STEM Stereotypic Attribution Bias Among Women in an Unwelcoming Science Setting
J. LaCosse (2016)
How forgiveness affects processing time: Mediation by rumination about the transgression
Ramzi Fatfouta (2015)
Health Literacy and Patient-Reported Outcomes: A Cross-Sectional Study of Underserved English- and Spanish-Speaking Patients With Type 2 Diabetes
E. Hahn (2015)
Autonomy and competence frustration in young adolescent classrooms: Different associations with active and passive disengagement
Stephen R. Earl (2017)
Bidirectional mediation of depression and pain intensity on their associations with upper extremity physical function
M. Talaei-Khoei (2017)
The Relationship between Cultural Identification, Family Socialization and Adolescent Alcohol Use among Native American Families
Zhyldyz Urbaeva (2017)
The Mediating Relationship between Maladaptive Behaviours, Cognitive Factors, and Generalised Anxiety Disorder Symptoms
A. Mahoney (2018)
Interpersonal rejection sensitivity mediates the associations between peer victimization and two high-risk outcomes
Caitlin A. Williams (2017)
A peripheral epigenetic signature of immune system genes is linked to neocortical thickness and memory
V. Freytag (2017)
Posttraumatic Stress Symptoms and Marital Adjustment Among Israeli Combat Veterans: The Role of Loneliness and Attachment
Liat Itzhaky (2017)
Emotion dysregulation and coping drinking motives in college women.
T. Messman‐Moore (2014)
Observed parental responsiveness/warmth and children's coping: cross-sectional and prospective relations in a family depression preventive intervention.
Kelly H. Watson (2014)
Older workers’ representation and age-based stereotype threats in the workplace
Eduardo André da Silva Oliveira (2017)
Grin and Bear It?: Employees' Use of Surface Acting During Co‐worker Conflict
A. Nixon (2017)
Do Children’s Attributions Mediate the Link Between Parental Conditional Regard and Child Depression and Emotion?
Laura Perrone (2016)
Functionality, comorbidity, complication & surgery of hip fracture in older adults by age distribution.
Sonia Jiménez-Mola (2018)
Negative Stress Beliefs Predict Somatic Symptoms in Students Under Academic Stress
S. Fischer (2016)
Toward a Psychosocial Model of Employees’ Participation in Corporate Social Responsibility. Evidence from Italian Small and Medium-Sized Enterprises
Gianvito D'Aprile (2020)
Salivary markers of stress system activation and social withdrawal in humans.
S. Bauduin (2020)
The effect of religiosity on violence: Results from a Brazilian population-based representative survey of 4,607 individuals
J. P. B. Gonçalves (2020)
The Role of Trust as a Mediator Between System Characteristics and Response Behaviors
Eric T. Chancey (2015)
Self-Efficacy as a Mechanism Linking Daily Stress to Mental Health in Students: A Three-Wave Cross-Lagged Study
P. Schönfeld (2018)
Perceived autonomy-supportive parenting and internet addiction: respiratory sinus arrhythmia moderated the mediating effect of basic psychological need satisfaction
D. Liu (2019)
Role of anxiety, depression and neurocognition for cognitive behavioural therapy pre-therapy skills in people living with dementia, older and younger adults✰.
J. Stott (2020)
Religious Head Covering, Being Perceived as Foreigners, Victimization, and Adjustment Among Sikh American Adolescents
K. Atwal (2019)
Examining Chinese kindergarten children’s psychological needs satisfaction in problem solving: A self-determination theory perspective
Heyi Zhang (2019)
The relationship between parental conflict and preschool children's behavior problems: A moderated mediation model of parenting stress and child emotionality
X. Xuan (2018)
How do organizational practices relate to perceived system safety effectiveness? Perceptions of safety climate and co-worker commitment to safety as workplace safety signals.
Madelynn R D Stackhouse (2019)
The Influence of Internalized Shame on the Drinking Problems Among College Students: The Mediating Effects of Dysfunctional Anger Expression
Direct and Indirect Effects of Five Factor Personality and Gender on Depressive Symptoms Mediated by Perceived Stress
S. Kim (2016)
Applying career construction model of adaptation to career transition in adolescence: A two-study paper
Iva Šverko (2019)See more