2004 Summer Evaluation Institute

Institute Overview

The primary goal of the summer evaluation institute is enhanced evaluation capacity for Science, Technology, Engineering, and Mathematics education (STEM). The institute provides instruction in the fundamentals of evaluation. These fundamentals include preparation and use of evaluation standards, careful review and analysis of several evaluation models, and skill development in a variety of evaluation areas. In some instances the methods are directly taught; in others, evaluation skills are employed to exemplify evaluation practices. The institute also focuses on developing materials for instructional support and developing evaluation tools.

The study of evaluation will begin with a focus on standards developed by the Joint Committee on Standards for Educational Evaluation for program, personnel, and student evaluations. The relationship and relevance of other standards will be considered and discussed. Instruction on using standards will be followed by instruction on models for evaluation. This instruction will use Stufflebeam's Foundational Models for 21st Century Program Evaluation as a means to introduce and study a cross section of the strongest models among the more than 20 popular models of evaluation.

With this instruction as a backdrop, participant teams will develop and conduct components of evaluation projects. These development efforts will be expected to model what has been learned about evaluation practices. Teams will be expected to present clear strategies and results of their evaluation activities. Participants will also work on other development activities. Each participant will participate in formative review and feedback of other presentations.

The institute will provide instruction in evaluation design and methods. Participants will be introduced to and instructed on several topics including evaluation design; evaluation budgeting; checklist, observation, interview, and survey methodology; and methods for evaluation reporting and follow-up. Instruction and discussions of evaluation methodology will focus primarily on educational contexts and settings. This instruction is intended to both increase participants' skills in the targeted areas and result in development of evaluation materials in one or more areas of evaluation. The institute will provide opportunities for participants to interact with the visiting scholars and The Evaluation Center staff.

We expect institute participants to develop and improve their evaluation and materials development skills. We anticipate that the teams will produce strong materials artifacts and move forward to complete and validate their materials after the close of the institute. As an incentive to participants to continue development efforts, the project is prepared to provide travel support for several persons who present their work and findings at national or regional conferences following the institute.

Participants complete an anonymous self-analysis of their evaluation skills prior to beginning the institute and again at the close. This self-analysis enables participants to better understand their personal growth and provides an opportunity for the institute staff to measure the institute's contribution to participant knowledge and skill development. Additionally, the Kercher Center for Social Research, directed by Dr. David Hartmann, will conduct an external evaluation of the institute program, interact with and gather data from participants, and provide both formative and summative feedback to participants and the institute staff.

Participants always identify collegial interactions and networking among the most valuable products of the institute. Because the Center's staff play key roles in evaluation-based organizations such as the American Evaluation Association, the Joint Committee on Standards for Educational Evaluation, and the Consortium for Research on Educational Accountability and Teacher Evaluation, institute participants gain insight into and opportunities for involvement in these organizations.

We encourage interested persons to visit the project Web site and/or encourage others to visit the site and consider applying for the institute.