Evaluation Café
Lively discussions, engaging debates, and dynamic presentations about evaluation over the lunch hour. Bring your lunch--freshly brewed coffee and gourmet cookies provided.
Past Events: 2002-03 2003-04 2004-05 2005-06 2006-07 2007-08 2008-09 2009-10
Handouts and/or slides available for most presentations.
Upcoming Events: Spring 2010
All Evaluation Café events take place from 12:00 to 1:00 p.m. at The Evaluation Center, 4405 Ellsworth Hall unless otherwise noted.
January 27, 2010
*Note Special Day *Title: An Epidemiologist's Perspective on Some Evaluation Research Issues
Presenter: Jim Anthony—Professor of Epidemiology, Michigan State University
Abstract: If a study is to be ”epidemiological,” there must be a theory or concept of a ”source population” under study. Or, there must be a specific study population roster to be studied or sampled, often nested within a source population, as is required for estimation of standardized mortality ratios and standardized morbidity ratios. This basic principle of epidemiological research is the starting point for today's talk, which includes a selective and somewhat autobiographical review of evaluation research issues that arise when evaluation researchers might choose to assume the epidemiologist's perspective.
February 2, 2010
Title: The Utility of Clinical Diagnostic Reasoning in Performance Analysis
Presenter: Nicholas Andreadis—Acting Dean, Lee Honors College, WMU
Abstract: The effective practice of organizational development (OD) requires that interventions are based on the results of a thorough performance analysis. Practitioners are taught to recognize suboptimal performance, collect and analyze relevant data, diagnose and draw conclusions, and then introduce rational interventions. Inherent to these analytical approaches are the cognitive reasoning processes. Making the right diagnosis is essential to the performance improvement process. In this discussion Dr. Andreadis will argue that the art and science of clinical diagnosis as performed by experienced physicians has utility in organizational settings as a method of reasoning helpful to OD practitioners.
February 9, 2010
Title: The Direction for Research at Western Michigan University
Presenter: Paula Kohler—Associate Vice President, WMU
Abstract: Given the change in federal administration and the rapid development of new legislation and technologies, opportunities abound for research and evaluation. Western Michigan University is poised to build on its existing research and evaluation capacities and take greater steps into collaboration with federal departments. As the new Associate Vice President for Research, Dr. Kohler will speak about the evolution of research opportunities for faculty and staff and her vision for Western’s part in the increasing call for evidence-based practices.
February 16, 2010
Title: Evaluation Reports as Metaevaluation Data: How Much Can and Should Written Reports Tell Us About an Evaluation's Quality?
Presenter: Lori Wingate—Senior Research Associate, The Evaluation Center, WMU
Abstract: Evaluation reports often are the primary source of data used for a metaevaluation, but they offer only a limited view of how an evaluation was conducted. In this session, results from a metaevaluation of 10 evaluations conducted by 30 independent raters in terms of how well the evaluations met the Program Evaluation Standards will be presented. An analysis of the relative frequency with which raters refrained from judgment because of “insufficient information” across the 30 Standards will serve as a springboard for a facilitated discussion about (a) what information can and should be included in evaluation reports, (b) which Standards can be applied when reports are the only source of data for an evaluation, and (c) which Standards metaevaluators should exclude from consideration if they do not have access to additional data.
February 23, 2010
Title: Nonprofits and Evaluation: Internal and External Accountability
Presenter: Bobbe Luce—Director of ONEplace, Kalamazoo Public Library
Abstract: Nonprofit organizations are mission-driven, public entities that typically focus most of their energies on the programs and services they believe benefit their constituents. More and more they are being asked by donors and funders to “prove” benefits actually occur; that outcomes, rather than numbers, are effective and efficiently delivered. They also are required to increase internal operational competencies, transparency, and accountability by the government. While evaluation is increasingly recognized as necessary and valuable, many nonprofits don't know how to get started, which tools to use, what to measure, how to use data, or how to work with outside evaluators. Bobbe A. Luce, director of ONEplace @ kpl, will explore these challenges and what you need to know about nonprofits to work with them in the evaluation process.
March 9, 2010
Title: An Introduction to Analyzing Text Data with MAXQDA
Presenter: Chris Coryn—Director, Interdiscciplinary Ph.D. in Evaluation Program, WMU
Abstract:
March 16, 2010
Title: Evaluation of the "Letter and Life" Professional Development Program for Teachers
Presenter: Adriana Bauer—Visiting Scholar, Interdisciplinary Ph.D. in Evaluation Program, WMU
Abstract:
March 23, 2010
Title: Foundation Evaluation
Presenter: Teresa Behrens—Editor-in-Chief, The Foundation Review & Senior Research Associate, Community Research Institute
Abstract: Teri Behrens is the former Director of Evaluation at the W. K. Kellogg Foundation. She left WKKF in January 2009 to join the Johnson Center for Philanthropy at GVSU, where she launched The Foundation Review, the first peer-reviewed journal of philanthropy. Teri will discuss why she started this journal and the role and challenges of peer review in the philanthropic sector. She’ll also provide an overview of the Johnson Center for Philanthropy.
March 30, 2010
Title: Michigan $aves: Evaluability Assessment & Process Evaluation of an Innovative Energy Program
Presenter: Daniela Schroeter—Director of Research, Anne Cullen—Senior Research Associate, & Kelly Robertson—Research Associate, The Evaluation Center, WMU
Abstract:
April 6, 2010
Title: Models to Evaluate System Change in Community Initiatives
Presenter: Margaret Richardson—Doctoral student, Interdisciplinary Ph.D. in Evaluation Program, WMU
Abstract: Because of the circular and intertwining nature of system interaction, social system change initiatives provide challenges for robust evaluation. Logic models provide a static picture of change, but lack the conceptualization of social change within a more fluid systems change framework. The more dynamic the system change initiative, the more dynamic the evaluation model needs to be to capture nuances that are enhancing or inhibiting change of the larger system. A theoretical framework for initiating system change will be shared to help understand necessary implementation factors for system change, along with an example of an applied, structured framework for evaluation of system change initiatives.
April 14, 2010
** Note Special Day and Format - Contact chris.coryn@wmich.edu **Title: Workshop: Participatory Evaluation Up Close
Presenter: J. Bradley Cousins—Professor of Educational Administration, University of Ottawa
Abstract: This full day workshop will consider connections between the theory and practice of participatory evaluation and the promise and potential of research on participatory approaches. Two streams, practical and transformative participatory evaluation, will be differentiated and consideration will be given to important process dimensions. In addition to practical, illustrative examples, a tentative agenda for ongoing research will be discussed.
April 20, 2010
Title: Racism, Evaluation, & Research
Presenter: Kelly Robertson—Research Associate, The Evaluation Center, WMU & Diane Rogers—Assessment for Learning Fellow, WMU
Abstract: