Fall 2014 Evaluation Café Events


*Please join us for our Spring 2015 Evaluation Café Speaker Series (schedule coming soon).

Cafes are held at The Evaluation Center, located in 4410 Ellsworth Hall, from noon-1pm on Wednesdays.

Useful and Free Evaluation Websites with Dr. Wendy L. Tackett—President, iEval 

Wednesday, September 10
Noon-1pm
4410 Ellsworth Hall

Demonstration—We will explore over 40 web sites that provide free resources for you to use in your evaluation work, including learning about evaluation, tools and instruments, data visualization, data sources, blogs, and some fun surprises. While some of the websites will be shared just for reference, we’ll do some hands-on work in several of them to demonstrate the ease of use and the potential usefulness.

Slides

Harnessing Complexity: Analysis Methodology and Ethical Frame for Using Video Data in Evaluations with Dr. Kurt Wilson—President, Effect X 

Wednesday, September 17
Noon-1pm
4410 Ellsworth Hall

Paper—Many evaluations are conducted in contexts of complexity; the specific intervention being evaluated is but one of many interrelated factors influencing the desired outcome. Video data, especially when directly generated by program participants, can provide both exceptionally rich qualitative data as well as contextually-relevant feedback within complex systems. Despite these unique strengths and opportunities, video data is underutilized in the field of evaluation. This presentation is based on a three paper dissertation and addresses two barriers to the use of video data: high time and expense of analysis, and ethical concerns.

Slides

Digital Qualitative: Leveraging Technology for Deeper Insight with Dr. Robert W. Kahle—Kahle Research Solutions Inc. 

Wednesday, September 24
Noon-1pm
4410 Ellsworth Hall

Demonstration—Technological advancements provide a platform for a wide variety of new qualitative research techniques. Sometimes called Qualitative 2.0, New Qualitative or Digital Qualitative, these new techniques are powerful when appropriately applied and carefully implemented. This informal presentation will provide an inventory of qualitative research techniques, from the traditional focus group and depth interview to the newest technology-enabled mobile methods. Presentation learning objectives: 1. Understand the range of new qualitative techniques currently available; 2. Identify when and why to use specific qualitative techniques; 3. Understand the advantages and disadvantages of these new qualitative methods; and 4. Learn about hybrid designs.

Handout

Slides

NSF Investment in Advancing Evaluation Theory, Methods, and Practice: Outcomes, Trends, and Implications with Dr. Lori Wingate, Corey Smith, Jason Burkhardt, and Emma Perk – The Evaluation Center, WMU

Wednesday, October 8
Noon-1pm
4410 Ellsworth Hall

Poster -In this session, we’ll presents the results of a systematic review of all grants made by the National Science Foundation’s Directorate for Education and Human Resources that focused on advancing STEM education evaluation theory, practice, and methods in the decade spanning 2004 through 2013. We reviewed all abstracts in the NSF awards database containing the word “evaluation” for this time frame. Of these 2,990 awards, about 90 focused specifically on advancing STEM education evaluation by developing evaluation instruments, providing evaluation training and/or resource materials, developing evaluation frameworks, and/or holding conferences focused on evaluation. Based on our review of the publications, websites, project outcome reports, and other documentation from these grants, we developed an inventory of the grant outcomes. In addition to provide a high-level view of the results of NSF’s investment in advancing evaluation, our analysis reveals trends and gaps in what NSF has funded and the results of this funding.

Doing Evaluation by Combining “Traditional” Knowledge with “Complex” Understanding of how the World Works with Dr. Jonathan (Jonny) A. Morell—Director of Evaluation, Fulcrum Corporation and Editor, Evaluation and Program Planning

Wednesday, October 22
Noon-1pm
4410 Ellsworth Hall

Paper—Research on “complexity” reveals many notions of how the world works that are at odds with “traditional” social science knowledge and evaluation program theories. “Strange attractor” is a particularly attention grabbing example, but many other examples are out there. It is easy to abandon “traditional” theories and just explain programs in terms of complexity. It’s also easy to ignore complex behavior. Neither approach makes sense. When we design evaluations we need to pay attention to “complex”, and “traditional” knowledge, and draw from each as wisdom and expertise dictate. This presentation will provide examples of what such combinations would look like.

Slides

Video

Evaluation and Social Justice with Dr. Jerry Johnson – Associate Professor, School of Social Work and Research Director, Johnson Center Community Research Institute, Grand Valley State University

Wednesday, October 29
Noon-1pm
4410 Ellsworth Hall

Project Management – Tools and Techniques with Dr. Daniel Gaymer – Faculty Specialist, Educational Leadership, Research, and Technology, WMU

Wednesday, November 5
Noon-1pm
4410 Ellsworth Hall

This workshop covers the fundamentals of project management.  Participants will learn the basic concepts of project management and be introduced to project management tools with an emphasis on the role of project leaders with respect to personal and professional effectiveness, task management, communication strategies, and project team leadership.  Learners will leave with tools, techniques, and documents that will prepare them to manage projects effectively.

Handout

Using Multi-Attribute Utility Theory in Evaluation: Challenges and Opportunities with Dr. Daniela Schroeter—Director of Research, The Evaluation Center, WMU

Wednesday, November 12
Noon-1pm
4410 Ellsworth Hall

This presentation will illustrate the use of multi-attribute utility theory as part of a multiple, mixed methods evaluation. Methodological considerations and stakeholder engagement will be at the center of the discussion. Evaluation Café participants will be introduced to tools used as part of the evaluation and are encouraged to critically reflect on the opportunities and limitations of using multi-attribute theory as a means to operationalize the logic of evaluation.

Slides

DUE TO WEATHER THIS EVENT HAS BEEN CANCELED AND RESCHEDULED FOR FEBRUARY 18, 2015

The Detroit Sexual Assault Kit (SAK) Action Research Project: Developmental Evaluation in Practice with Dr. Rebecca Campbell—Professor of Ecological-Community Psychology, Michigan State University and Recipient of AEA’s 2013 Outstanding Evaluation Award

Wednesday, November 19
Noon-1pm
4410 Ellsworth Hall

Paper—In 2009, 11,000+ sexual assault kits (SAKs) were discovered in a Detroit Police Department property storage facility, most of which had never been forensically tested and/or investigated by the police. In 2011, a multi-stakeholder group convened to develop long-term response strategies, including protocols for notifying victims whose kits had been part of the backlog. In this presentation, I will describe the process by which we used developmental evaluation theory to create a mixed-methods evaluation of this initiative. This presentation will summarize the numerous challenges (psychological, ethical, and legal) we have faced attempting to locate survivors so many years later to evaluate the efficacy of the protocols developed by the multidisciplinary team.

Tools and Resources for Using Geographic Information Systems (GIS) in Evaluation with Corey Smith—Doctoral Associate, WMU

Wednesday, December 3
Noon-1pm
4410 Ellsworth Hall

Demonstration—Geographic Information Systems (GIS) allow users to represent data geographically. In evaluation, we often have data which has some connection or association with a geographic place. GIS provides a tool to explore whether or not these connections are meaningful, or reveal trends or patterns that we may otherwise miss. I my Evaluation Café I will walk through a number of GIS related resources, demonstrate a few of them, while also commenting on the utility and application of GIS in evaluation.

Slides

No Comments

No comments yet.

RSS feed for comments on this post.

Sorry, the comment form is closed at this time.