Evaluation Café

Lively discussions, engaging debates, and dynamic presentations about evaluation over the lunch hour.  Bring your lunch--freshly brewed coffee and gourmet cookies provided.

printable Spring 2010 schedule

If you would like to be notified of upcoming Evaluation Café events via e-mail, please send a message to 

Past Events:   2002-03  2003-04  2004-05  2005-06  2006-07  2007-08  2008-09  2009-10

Handouts and/or slides available for most presentations.


Upcoming Events:  Spring 2010

All Evaluation Café events take place from 12:00 to 1:00 p.m. at The Evaluation Center, 4405 Ellsworth Hall unless otherwise noted.


January 27, 2010

*Note Special Day *

Title:  An Epidemiologist's Perspective on Some Evaluation Research Issues

Presenter:  Jim Anthony—Professor of Epidemiology, Michigan State University

Abstract:  If a study is to be ”epidemiological,” there must be a theory or concept of a ”source population” under study. Or, there must be a specific study population roster to be studied or sampled, often nested within a source population, as is required for estimation of standardized mortality ratios and standardized morbidity ratios. This basic principle of epidemiological research is the starting point for today's talk, which includes a selective and somewhat autobiographical review of evaluation research issues that arise when evaluation researchers might choose to assume the epidemiologist's perspective.

Flyer


February 2, 2010

Title:  The Utility of Clinical Diagnostic Reasoning in Performance Analysis

Presenter:  Nicholas Andreadis—Acting Dean, Lee Honors College, WMU

Abstract:  The effective practice of organizational development (OD) requires that interventions are based on the results of a thorough performance analysis. Practitioners are taught to recognize suboptimal performance, collect and analyze relevant data, diagnose and draw conclusions, and then introduce rational interventions. Inherent to these analytical approaches are the cognitive reasoning processes. Making the right diagnosis is essential to the performance improvement process. In this discussion Dr. Andreadis will argue that the art and science of clinical diagnosis as performed by experienced physicians has utility in organizational settings as a method of reasoning helpful to OD practitioners.

Flyer


February 9, 2010

Title:  The Direction for Research at Western Michigan University

Presenter:  Paula Kohler—Associate Vice President, WMU

Abstract:  Given the change in federal administration and the rapid development of new legislation and technologies, opportunities abound for research and evaluation. Western Michigan University is poised to build on its existing research and evaluation capacities and take greater steps into collaboration with federal departments. As the new Associate Vice President for Research, Dr. Kohler will speak about the evolution of research opportunities for faculty and staff and her vision for Western’s part in the increasing call for evidence-based practices.

Flyer


February 16, 2010

Title:  Evaluation Reports as Metaevaluation Data: How Much Can and Should Written Reports Tell Us About an Evaluation's Quality?

Presenter:  Lori Wingate—Senior Research Associate, The Evaluation Center, WMU

Abstract:  Evaluation reports often are the primary source of data used for a metaevaluation, but they offer only a limited view of how an evaluation was conducted. In this session, results from a metaevaluation of 10 evaluations conducted by 30 independent raters in terms of how well the evaluations met the Program Evaluation Standards will be presented.  An analysis of the relative frequency with which raters refrained from judgment because of “insufficient information” across the 30 Standards will serve as a springboard for a facilitated discussion about (a) what information can and should be included in evaluation reports, (b) which Standards can be applied when reports are the only source of data for an evaluation, and (c) which Standards metaevaluators should exclude from consideration if they do not have access to additional data.

Flyer


February 23, 2010

Title:  Nonprofits and Evaluation: Internal and External Accountability

Presenter:  Bobbe Luce—Director of ONEplace, Kalamazoo Public Library

Abstract:  Nonprofit organizations are mission-driven, public entities that typically focus most of their energies on the programs and services they believe benefit their constituents. More and more they are being asked by donors and funders to “prove” benefits actually occur; that outcomes, rather than numbers, are effective and efficiently delivered. They also are required to increase internal operational competencies, transparency, and accountability by the government. While evaluation is increasingly recognized as necessary and valuable, many nonprofits don't know how to get started, which tools to use, what to measure, how to use data, or how to work with outside evaluators. Bobbe A. Luce, director of ONEplace @ kpl, will explore these challenges and what you need to know about nonprofits to work with them in the evaluation process.

Flyer


March 9, 2010

Title:  An Introduction to Analyzing Text Data with MAXQDA

Presenter:  Chris Coryn—Director, Interdiscciplinary Ph.D. in Evaluation Program, WMU

Abstract: 


March 16, 2010

Title:  Evaluation of the "Letter and Life" Professional Development Program for Teachers

Presenter:  Adriana Bauer—Visiting Scholar, Interdisciplinary Ph.D. in Evaluation Program, WMU

Abstract: 


March 23, 2010

Title:  Foundation Evaluation

Presenter:  Teresa Behrens—Editor-in-Chief, The Foundation Review & Senior Research Associate, Community Research Institute

Abstract:  Teri Behrens is the former Director of Evaluation at the W. K. Kellogg Foundation. She left WKKF in January 2009 to join the Johnson Center for Philanthropy at GVSU, where she launched The Foundation Review, the first peer-reviewed journal of philanthropy.  Teri will discuss why she started this journal and the role and challenges of peer review in the philanthropic sector.  She’ll also provide an overview of the Johnson Center for Philanthropy.

Flyer


March 30, 2010

Title:  Michigan $aves: Evaluability Assessment & Process Evaluation of an Innovative Energy Program

Presenter:  Daniela Schroeter—Director of Research, Anne Cullen—Senior Research Associate, & Kelly Robertson—Research Associate, The Evaluation Center, WMU

Abstract: 


April 6, 2010

Title:  Models to Evaluate System Change in Community Initiatives

Presenter:  Margaret Richardson—Doctoral student, Interdisciplinary Ph.D. in Evaluation Program, WMU

Abstract:  Because of the circular and intertwining nature of system interaction, social system change initiatives provide challenges for robust evaluation.  Logic models provide a static picture of change, but lack the conceptualization of social change within a more fluid systems change framework.  The more dynamic the system change initiative, the more dynamic the evaluation model needs to be to capture nuances that are enhancing or inhibiting change of the larger system.  A theoretical framework for initiating system change will be shared to help understand necessary implementation factors for system change, along with an example of an applied, structured framework for evaluation of system change initiatives.

Flyer


April 14, 2010

** Note Special Day and Format - Contact chris.coryn@wmich.edu **

Title:  Workshop: Participatory Evaluation Up Close

Presenter:  J. Bradley Cousins—Professor of Educational Administration, University of Ottawa

Abstract:  This full day workshop will consider connections between the theory and practice of participatory evaluation and the promise and potential of research on participatory approaches. Two streams, practical and transformative participatory evaluation, will be differentiated and consideration will be given to important process dimensions. In addition to practical, illustrative examples, a tentative agenda for ongoing research will be discussed.

Flyer


April 20, 2010

Title:  Racism, Evaluation, & Research

Presenter:  Kelly Robertson—Research Associate, The Evaluation Center, WMU & Diane Rogers—Assessment for Learning Fellow, WMU

Abstract: