MTS SUMMER EVALUATION INSTITUTE

 

Schedule and Curriculum

 

June 2000

 

Explanation:

 

General observations about the schedule:  Participants will meet at 8 AM each day of the institute.  During the first hour (8 – 9), procedural items will be taken care of and participants will have time to check email, make last minute preparations, etc.  Presentations are then scheduled from 9 until 12 each day, with a brief time for breaks.  Some morning sessions will continue into the afternoon session (with an hour for lunch).  Afternoon sessions will begin with an evaluation of the morning activities.  The Q & A sessions are scheduled for afternoons, and other afternoon activities will vary from formal presentations, participant presentations, field trips, and participant work time.

 

Initials:   The initials after schedule items correspond to who is scheduled for that session.  The full names follow.

ag –        Arlen Gullickson (Eval. Center)

ba –        Brooks Applegate (Eval. Center)

cn –        Cris Nelson (Eval. Center)

cr –         Craig Russon (Eval. Center)

dls –       Daniel Stufflebeam (Eval. Center)

df –         Dale Farland (Eval. Center)

gm –       Gary Miron (Eval. Center)

gr –         Gloria Rogers (Visiting Scholar)

hm –       Howard Mzumara (Visiting Scholar)

jf          Joan Farland (Eval. Center)

jh –         Jerry Horn (Eval. Center)

js –          James Sanders (Eval. Center)

lw –         Lori Wingate (Eval. Center)

ms –        Michael Scriven (Visiting Scholar)

pa –        Peter Airasian (Visiting Scholar)

sv –        Sally Veeder (Eval. Center)

tr –          Todd Rogers (Visiting Scholar)

yl –         Yvonna Lincoln (Visiting Scholar)

 

Needs assessment data:  We have designed the curriculum based upon general understanding of the field of evaluation, what has been presented in past institutes, on the constraints of instructor’s schedules, and upon a needs assessment of the applicants to the institute and those selected to participate.  The curriculum does not totally reflect any one of those influences.  A summary of the needs assessment data is included in a separate document.  We encourage you to review the document to get a sense of participant perceptions of the topics that you will be teaching. 

 

Q & A sessions:  Our intention for the Q & A sessions is for the participants to have an opportunity to hear some of the current thinking of the instructors and to interact informally about that topic or others that arise.  As scheduled, we have asked the instructors to informally present about a topic of choice for 10 to 15 minutes, followed by 10 to 15 minutes for questions and discussion.

 

Teams 1 – 5:  Fifteen participants have agreed to attend the institute.  The participants will be grouped into five teams of three each.  The grouping will be done randomly.  Individual participant and team presentations will be made at several times during the Institute, as indicated by the schedule.  


 


MTS Institute 2000  SCHEDULE -- WEEK 1 -- Foundations

 

 

Week 1

 

Monday 6/12/00

 

Tuesday 6/13/00

 

Wednesday 6/14/00

 

Thursday 6/15/00

 

Friday 6/16/00

 

8:00-

9:00

$ Introductions

$ Getting started {ag}

$ Announcements

$ Orientation

$ Getting started {df}

$ Center/campus tour

$ Announcements

$ Getting started {df}

$ Announcements

$ Getting started {df}

$ Announcements (transportation & directions)

$ Getting started {df}

$ Announcements

 

  9:00-10:00

$ Overview of the curriculum {ag}

$ Introduction to the Program Standards {dls}

$ Personnel Standards {tr}

$ Presentation on alternative evaluation approaches /  models {dls}

$ Divide and conquer strategy for designing evaluations {ag}

$ NSF User-friendly Handbook on Program Evaluation {ag}

$ Qualitative Evaluation methods and models (yl)

 

 

 

10:00-11:00

$ Standards continued {dls}

$ Personnel Standards simulation {ag, tr}

$ Briefing on the CIPP Model {dls}

$ Quantitative evaluation project examples {ba & gm re Edison evaluation}

 

 

11:00-12:00

$ Preparation for simulation exercise {dls, lw, sv}

 

$ Evaluation for internal & external use in nonprofit organizations {js}

$ NSF User-friendly Handbook on Mixed Methods Evaluation {jh}

 

1:00- 1:15

$ Evaluation

$ Evaluation

$ Evaluation

$ Evaluation

$ Evaluation

 

1:15-4:00

$ Standards application simulation {lw, sv}

$ Q & A session with Dr. Stufflebeam

$ Student Evaluation  Standards {tr}

$ Q & A session with Dr. T. Rogers

$ Q & A session with Dr. Sanders

$ Overview and explanation of participant products and presentations {df}

$ Mixed method evaluation project examples (e.g. RSI, Sara, EETAP) {cr}

$ Evaluation of charter schools {gm}

$ Q & A session with Dr. Miron

$ 5:30 PM at Gullickson home

$ Q & A session with Dr. Lincoln

$ Team presentations on selected component of evaluation problem and solution based upon models/standards (~ 15 minutes per team)

 



MTS Institute 2000  SCHEDULE -- WEEK 2 -- Methods

 

 

Week 2

 

Monday 6/19/00

 

Tuesday 6/20/00

 

Wednesday 6/21/00

 

Thursday 6/22/00

 

Friday 6/23/00

 

8:00-

9:00

$ Getting started {df}

$ Announcements

$ Assessments

$ Getting started {df}

$ Announcements

$ Assessments

$ Getting started {df}

$ Announcements

$ Assessments

$ Getting started {df}

$ Announcements

$ Assessments

$ Getting started {df}

$ Announcements

$ Assessments

 

  9:00-10:00

$ Proposal preparation {jh, ag}

$ Staffing for evaluations {jh}

$ Briefing presentation on evaluation reporting and follow-up {Team 1}

 

$ Trans-discipline evaluation {ms}

$ Checklists – introduction,  examples in evaluation {dls, ms}

$ Metaevaluation checklist {dls}

$ Briefing presentation on survey methods in evaluation {Team 2}

 

10:00-11:00

$ Budgeting for evaluations {ag}

$ Reporting evaluation findings {ag}

$ Big footprint evaluation {ms}

$ Contracting checklist {dls}

$ Survey considerations {ag}

 

11:00-12:00

$ Contracting for evaluations {jh}

$ Quantitative evaluation methods; planning, analysis, reporting  {cn}

$ Goal-free evaluation {ms}

$ Key evaluation checklist {ms}

$  Survey examples and applications {ag, df}

 

1:00- 1:15

$ Evaluation

$ Evaluation

$ Evaluation

$ Evaluation (12:50-1:00)

$ Evaluation

 

1:15-4:00

$ Professional development in evaluation {cr}

$ Q & A session with Dr. Horn

$ Data base development for evaluation {ba}

$ Q & A session with Dr. Applegate

$ Q & A session with Dr. Scriven

$  Leave for Battle Creek (by 1:00 PM)

$ 2-4; Visit to Kellogg Foundation, Battle Creek

$ Introduction to the intern program {ag}

$ An intern’s view of the internship {hm}

$ Coordination of the internship program {jf}

$ Q & A session with Dr. Gullickson



MTS Institute 2000  SCHEDULE -- WEEK 3 -- Participation

 

 

Week 3

 

Monday 6/26/00

 

Tuesday 6/27/00

 

Wednesday 6/28/00

 

Thursday 6/29/00

 

Friday 6/30/00

 

8:00-

9:00

$ Getting started {df}

$ Announcements

$ Assessments

$ Getting started {df}

$ Announcements

$ Assessments

$ Getting started {df}

$ Announcements

$ Assessments

$ Getting started {df}

$ Announcements

$ Assessments

$ Getting started {df}

$ Announcements

$ Assessments

 

  9:00-10:00

$ Program vs course assessment

$ Good Practice in assessing student learning

$ Use of assessment models

$ Best practices in assessment of program effectiveness

$ Common mistakes in outcomes assessment

$ Assessment as a mediator for change

$ Understanding change process

$ Politics of implementing assessment processes {gr}

$ Selecting instruments

$ Designing instruments

$ Finding instruments

$ Administration {pa}

$ Airasian, continued

$ Briefing presentation on critical issues in evaluation {Team 4}

 

 

10:00-11:00

$ Development of RosE-Portfolio, demonstration

 

 

 

$ Briefing presentation on “gaps” in the Summer Institute curriculum {Team 5}

 

11:00-

12:00

$ Advice from the field {gr}

 

 

 

$  Debriefing

$  Evaluation of the institute

1:00- 1:15

$ Evaluation

$ Evaluation

$ Evaluation

$ Evaluation

 

 

1:15-4:00

$ Use of team facilitation

$ Developing a program assessment plan

$ Developing measurable learning outcomes

$ Review of “catalog” of outcome attributes

$ Choosing effective assessment methods

$ Assessment method truisms

$ Q & A session with Dr. G. Rogers

$ Q & A session with Dr. Nelson

$ Briefing presentation on professional development programs in science education {Team 3}

$ Q & A session with Dr. Airasian

$ Participant presentations about your Institute “artifacts” (about 5 minutes each)

$ Q & A session with Dr. Russon

$ Leave for Lake Michigan