Arlen Gullickson

Instruction Goal: The session is designed for participants to learn how access and use literature sources to inform and assist the evaluator in framing evaluation plans and preparing evaluation measures, protocols, and materials.

We will address five general issues:

1. What constitutes a good review of literature?

2. How do you access and assure long-term viability of a reference source?

3. What are viable mechanisms to organize a literature review?

4. What steps should be employed to establish literature review objectives?

5. What are viable ways to use diverse and sometimes conflicting information?

Expected Outcomes: From the exercise each participant should gain (a) a set of criteria that can be applied to address each of the five identified points and (b) sound, clear strategies for conducting literature reviews that meet these criteria. Secondarily, if data are gathered and prepared effectively, the findings from the class can be used to frame a set of papers for presentation and/or publication.

Feedback Activities: Each participant’s contributions will be used as part of the foundation for group presentations. As such, the presentations provide some feedback regarding the substance of individual’s knowledge and skill in the targeted area. Additionally, Dr. Gullickson will be available to meet with participant groups prior to the class session (as presentations are being prepared) and after the class session. The last part of the class session will be devoted to feedback as part of the general discussion on the five topics.

Specific Activities: This session requires pre-institute preparation on the part of participants. Each participant is asked to do the following homework (including prepare and submit in electronic form the following materials) by June 1, 2002.

1. Interview one person to obtain that person’s perspectives on the five above points. From that interview the participant should:

a. Briefly, describe the qualifications of the interviewee.

b. Take notes on and summarize the interviewee’s response for each of the five points (list the item number and question preceding your summary).

2. Select a literature review source (or a study that effectively uses literature sources) that you deem to be good. (You may choose to use only part of a referenced study, e.g., literature that makes the case for an instrument or evaluation protocol.)

a. Cite the review reference.

b. Provide a brief abstract/summary of the review (bring a copy of the referenced material with you to the Institute).

c. Report how this literature review addresses each of the five general issues. Answer each separately (precede each answer with the item number and question statement).

Attention to Hands-on Involvement by Participants: Between June 1 and June 10 all homework will be organized into the five issue categories. On June 10 the submitted materials will be given to participants. Each group of three participants will receive the submitted information for one of the issues along with directions for planning and presenting on that topic. On June 14 each group will report their “literature review” findings and conclusions for the assigned issue (5 to 10 minute presentation). Following these reports, we will discuss what has been uncovered and learned. Criteria participant groups should apply in preparation of their reports include: identification and description of key points pertinent to the issue, utility of the information for conducting reviews, and relevance to evaluators.