EVAL 6970: Meta-Analysis

Course Description 

This course is an advanced graduate seminar designed to provide students with the knowledge, skills, and abilities necessary to conduct basic research reviews, research syntheses, and meta-analyses. Topics covered include, but are not limited to, the increasing use of meta-analysis in formulating and enacting evidence-based policies and practices, the role of meta-analysis in theory development, principles and procedures for planning and executing research reviews and meta-analyses, identifying and retrieving literature, coding studies, computing effect sizes (e.g., based on means, binary data, and correlations) and their corresponding confidence intervals for meta-analysis, converting among effect sizes, factors that affect precision (e.g., variance, standard error, confidence intervals), fixed-effect and random-effects models for meta-analysis, identifying and quantifying heterogeneity, prediction intervals, subgroup analysis, meta-regression, meta-analysis with complex data structures, power analysis for meta-analysis, publication bias, and psychometric meta-analysis. Students should have at least a fundamental knowledge of applied statistics and experimental and quasi-experimental design to succeed in the course and will be required to plan and execute a basic meta-analysis. EMR 6550: Experimental and Quasi-Experimental Designs, is a recommended, but not required, prerequisite.


Course Syllabus PDF


Dr. Chris L. S. Coryn

Kristin A. Hobson

Required Textbooks

Bornenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009). Introduction to meta-analysis. West Sussex, UK: Wiley.

Cooper, H., Hedges, L. V., & Valentine, J. C. (Eds.). (2009). The handbook of research synthesis and meta-analysis (2nd ed.). New York, NY: Russell Sage Foundation.

Comprehensive Meta-Analysis 2.0

Order Form DOCX


Required Readings

These readings are for instructional purposes only.

Anderson, C. A., et al. (2010). Violent video game effects on aggression, empathy, and prosocial behavior in eastern and western countries: A meta-analytic review. Psychological Bulletin, 136(2), 151-173. PDF

Beretavs, S. N. (2010). Meta-analysis. In G. R. Hancock, G. R. R. O. & Mueller (Eds.), The reviewer’s guide to quantitative methods in the social sciences (pp. 255-264). New York, NY: Routledge. PDF

Bornmann, L., diger Mutz, R., & Daniel, H-D. (2010). A reliability-generalization study of journal peer reviews: A multilevel meta-analysis of inter-rater reliability and its determinants. PLoS ONE5(2), e14331. PDF

Cook, T. D., & Leviton, L. C. (1980). Reviewing the literature: A comparison of traditional methods with meta-analysis. Journal of Personality, 48(4), 449-472. PDF

DuBois, D. L., Holloway, B. E., Valentine, J. C., & Cooper, H. (2002). Effectiveness of mentoring programs for youth: A meta-analytic review. American Journal of Community Psychology, 30(2), 157-197. PDF

Peterson, J. L., & Shibley Hyde, J. (2010). A meta-analytic review of research on gender differences in sexuality, 1993–2007. Psychological Bulletin, 136(1), 21-38. PDF

Schwandt, T. A. (2000). Meta-analysis and everyday life: The good, the bad, and the ugly. American Journal of Evaluation, 21(2), 213-219. PDF

Wilson, S. J., & Lipsey, M. W. (2000).Wilderness challenge programs for delinquent youth: a meta-analysis of outcome evaluations. Evaluation and Program Planning, 23(1), 1-12. PDF

Data Sets and Supplementary Materials

Effect Size Substantive Interpretation Guidelines PDF

Effect Size Calculator for Standardized Mean Difference Type Effects (Wilson, 2001) XLSX

Meta-Analysis with Means, Binary Data, and Correlations XLSX

Campbell Collaboration Effect Size Calculator (Wilson, n.d.) HTML

American Psychological Association (APA) Meta-Analysis Reporting Standards (MARS) PDF

Sample Code Book PDF

Data Sets 1-6 XLSX

Data Sets for Heterogeneity Analysis XLSX

Data Set for Subgroup Analysis XLSX

Homework and Projects

Homework #1 PDF

Homework #2 PDF

Homework #3 PDF

Homework #4 PDF

Final Project PDF

Lecture Notes

Lecture 1 PPTX

Lecture2 PPTX

Lecture 3 PPTX PDF

Lecture 4 PPTX PDF

Lecture 5 PPTX PDF

Lecture 6 PPTX PDF

Lecture 7 PPTX PDF

Lecture 8 PPTX PDF

Lecture 9 PPTX PDF

Lecture 10 PPTX PDF

Meta-Analysis Repositories

The Cochrane Collaboration HTML

The Campbell Collaboration HTML

What Works Clearinghouse HTML

No Comments

No comments yet.

RSS feed for comments on this post.

Sorry, the comment form is closed at this time.