Course Description

This course is an advanced graduate seminar designed to provide students with the knowledge, skills, and abilities necessary to conduct basic research reviews, research syntheses, and meta-analyses. Topics covered include, but are not limited to, the increasing use of meta-analysis in formulating and enacting evidence-based policies and practices, the role of meta-analysis in theory development, principles and procedures for planning and executing research reviews and meta-analyses, identifying and retrieving literature, coding studies, computing effect sizes (e.g., based on means, binary data, and correlations) and their corresponding confidence intervals for meta-analysis, converting among effect sizes, factors that affect precision (e.g., variance, standard error, confidence intervals), fixed-effect and random-effects models for meta-analysis, identifying and quantifying heterogeneity, prediction intervals, subgroup analysis, meta-regression, meta-analysis with complex data structures, power analysis for meta-analysis, publication bias, and psychometric meta-analysis. Students should have at least a fundamental knowledge of applied statistics and experimental and quasi-experimental design to succeed in the course and will be required to plan and execute a basic meta-analysis. EVAL 6970: Experimental and Quasi-Experimental Designs for Applied Research and Evaluation, or an equivalent course (e.g., EMR 6550), is a recommended, but not required, prerequisite.

Syllabus

Course Syllabus PDF

Instructor

Dr. Chris L. S. Coryn

Required Textbooks

Bornenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009). Introduction to meta-analysis. West Sussex, UK: Wiley.

Cooper, H., Hedges, L. V., & Valentine, J. C. (Eds.). (2009). The handbook of research synthesis and meta-analysis (2^nd ed.). New York, NY: Russell Sage Foundation.

These readings are for instructional purposes only.

Anderson, C. A., et al. (2010). Violent video game effects on aggression, empathy, and prosocial behavior in eastern and western countries: A meta-analytic review. Psychological Bulletin, 136(2), 151-173. PDF

Bornmann, L., diger Mutz, R., & Daniel, H-D. (2010). A reliability-generalization study of journal peer reviews: A multilevel meta-analysis of inter-rater reliability and its determinants. PLoS ONE,  5(2), e14331. PDF

Cook, T. D., & Leviton, L. C. (1980). Reviewing the literature: A comparison of traditional methods with meta-analysis. Journal of Personality, 48(4), 449-472. PDF

DuBois, D. L., Holloway, B. E., Valentine, J. C., & Cooper, H. (2002). Effectiveness of mentoring programs for youth: A meta-analytic review. American Journal of Community Psychology, 30(2), 157-197. PDF

Peterson, J. L., & Shibley Hyde, J. (2010). A meta-analytic review of research on gender differences in sexuality, 1993–2007. Psychological Bulletin, 136(1), 21-38. PDF

Schwandt, T. A. (2000). Meta-analysis and everyday life: The good, the bad, and the ugly. American Journal of Evaluation, 21(2), 213-219. PDF

Wilson, S. J., & Lipsey, M. W. (2000).Wilderness challenge programs for delinquent youth: a meta-analysis of outcome evaluations. Evaluation and Program Planning, 23(1), 1-12. PDF

Effect Size Substantive Interpretation Guidelines PDF

Effect Size Calculator for Standardized Mean Difference Type Effects (Wilson, 2001) XLSX

Meta-Analysis with Means, Binary Data, and Correlations XLSX

Campbell Collaboration Effect Size Calculator (Wilson, n.d.) HTML

American Psychological Association (APA) Meta-Analysis Reporting Standards (MARS) PDF

Sample Code Book PDF

Data Sets 1-6 XLSX

Data Sets for Heterogeneity Analysis XLSX

Data Set for Subgroup Analysis XLSX

Homework #1 PDF

Homework #2 PDF

Homework #3 PDF

Homework #4 PDF

Final Examination PDF

Lecture Notes

Lecture 1 PPTX

Lecture 2 PPTX

Lecture 3 PPTX

Lecture 4 PPTX

Lecture 5 PPTX

Lecture 6 PPTX

Lecture 7 PPTX

Lecture 8 PPTX

Lecture 9 PPTX

Lecture 10 PPTX

Statistics Tutorials

StatTrek HTML

Research Methods Knowledge Base HTML

Online Stats Book HTML

Meta-Analysis Repositories

The Cochrane Collaboration HTML

The Campbell Collaboration HTML

What Works Clearinghouse HTML