Past Projects

The Evaluation Center at Western Michigan University has provided successful program evaluation services since 1973. Completed projects is a partial listing of those projects since 1990.

Current projects

A B | C D | E F | G H | I J | K L | M N | O P | Q R | S T | U V | WXYZ

21st Century Community Learning Centers

Sponsor: Kalamazoo Public Schools
Principal investigator: Dr. Gary Miron
Dates: Dec. 1, 2004, to June 30, 2007

This after-school program was operated by the Kalamazoo Communities in Schools Foundation in collaboration with the Kalamazoo Public Schools. It sought to help at-risk student through homework assistance, tutoring, arts and sciences enrichment activities, and drug abuse prevention. The center evaluated program implementation and impacts on school climate, academic achievement and parent and student satisfaction.

AA Effects on Drinking

Sponsor: National Institutes of Health
Principal investigator: Dr. Stephen Magura
Dates: Aug. 25, 2009, to July 31, 2012

The study used three advanced statistical techniques to adjust for selection bias into Alcoholics Anonymous within the Project MATCH national treatment data set to determine whether there is a true causal connection between AA participation and reduction in drinking behaviors and related problems.

Achievement Group

Date: Sept. 30, 2002

Provide technical assistance to meet the needs of intensive and focused schools to increase student achievement as each school moved toward academic excellence.

AccessMichigan

Sponsor: AccessMichigan and Michigan Department of Education
Principal investigator: Dr. Lori Wingate
Dates: Jan. 7 to July 30, 2000

AccessMichigan was a collaborative project of Michigan libraries to create a digital information environment that would offer every resident of the state equitable and easy-to-use access to a core set of information sources. A Technology Literacy Challenge Fund grant from the Michigan Department of Education was used by AccessMichigan to purchase three full-text databases for K-9 students. The Evaluation Center evaluated the K-9 database project through a survey of personnel at public libraries and school library media centers and case studies of six school library media centers.

Advanced Technological Education Central Subaward

Sponsor: University of Wisconsin—Madison Institute for Research on Poverty
Principal Investigator: Dr. Lori Wingate
Oct. 1, 2013 to Sep. 30, 2017

This project:

• Assists ATE Central in the development and deployment of a survey of the constituency of the ATE projects and centers.
• Prepares publishable manuscripts on the survey process and results.

Dr. Lori Wingate and Krystin Martens work with personnel from ATE Central in the development and deployment of the survey:

• Year 1: Advise on the survey content, design and sampling, including focus groups to obtain input on the survey questions from ATE and community college audiences.
• Year 2: Advise on data analysis and write up results into a publishable manuscript.
• Year 3: Advise on the revision of the survey’s content and design, including focus groups to obtain input from ATE and community college audiences.
• Year 4: Advise on data analysis and write up results into a second publishable manuscript.

American Association for the Advancement of Science Project 2061

Sponsor: American Association for the Advancement of Science and the NSF
Principal investigator: Dr. Lori Wingate
Dates: July 15, 2001, to Sept. 30, 2005

This subcontract with the American Association for the Advancement of Science was funded by a continuing grant from the National Science Foundation. AAAS Project 2061 developed materials that primarily were disseminated to curriculum developers. The materials are expected to help developers understand and employ better approaches to facilitate student understanding of basic science concepts and help students and teachers see linkages (strands) among the wide array of science and math topics.

American Evaluation Association Birth Story

Sponsor: American Evaluation Association
Principal investigator: Dr. Liesel Ritchie
Dates: Aug. 10, 2005, to May 31, 2007

The Evaluation Center documented the history of birth of the organization through interviews with key players in the merger and analysis of historical records. The AEA was created when the Evaluation Research Society and Evaluation Network merged in 1986. AEA selected The Evaluation Center to document the history of birth of the organization through interviews with key players in the merger and analysis of historical records.

American Evaluation Association Public Policy Program

Sponsor: American Evaluation Association
Principal investigator: Dr. James Sanders
Dates: Oct.1, 2001, to Sept. 30, 2005

The Evaluation Center served as fiduciary agent for AEA on a policy-oriented project funded by NSF. The NSF grant provided support to AEA to prepare public policy statements from an evaluation perspective on issues of national significance, such as high-stakes testing. It also enabled AEA to develop policies and procedures for developing and approving public policy statements.

Annual Status Survey of Advanced Technological in Education Projects and Centers

Sponsor: National Science Foundation
Principal investigator: Dr. Arlen Gullickson
Dates: Dec. 12, 2006, to Nov. 30, 2009

Develop data collection, reporting system and develop guide books to assist ATE centers to prepare and provide impact and effectiveness information.

Appalachia Educational Laboratory

Sponsor: Appalachia Educational Laboratory
Principal investigator: Dr. Arlen Gullickson
Dates: March 1, 1990, to Dec. 15, 2005

This external evaluation addressed AEL’s evaluation needs; explored the impact AEL had in its region; assessed the quality of services and the extent to which needs are being served, as perceived by constituents; and conducted a metaevaluation of the evaluation activities implemented by AEL. The Evaluation Center conducted the external evaluation of the Appalachia Educational Laboratory for approximately 15. AEL was one of the ten federally funded regional educational laboratories. The mission of AEL was to serve educational organizations at all levels through its projects, products and services.

This external evaluation addressed AEL’s evaluation needs; explored the impact AEL was having in its region; assessed the quality of services and the extent to which needs were being served, as perceived by constituents; and conducted a metaevalaution of the evaluation activities implemented by AEL.

One component of AEL was its Field-based Development and Applied Research component which included six projects focused on comprehensive school reform efforts. The external evaluation conducted by The Evaluation Center addressed the research and development component of AEL, plus all other aspects of its activities with educational institutions. The evaluation was multifaceted, including both formative and summative evaluation.

Argonne National Laboratory

Sponsor: Argonne National Laboratory
Principal investigator: Dr. Jerry Horn
Dates: Oct. 1, 2000, to Dec. 31, 2001

Evaluated the Undergraduate Student Research Participation Program at Argonne National Laboratory.

Assessment for Learning Research Scholars: Capacity Building in Mathematics and Science Education

Sponsor: National Science Foundation
Principal investigator: Dr. Arlen Gullickson and Dr. Steven Ziebarth
Dates: Sept. 1, 2007, to Aug. 31, 2014

This project represents collaboration among The Evaluation Center, the Department of Mathematics and the Mallinson Institute for Science Education at Western Michigan University. The project expands on research in assessment for learning or “the process of seeking and interpreting evidence for use by learners and their teachers to decide where the learners are in their learning, where they need to go and how best to get there” (Assessment Report Group, 2002). A cadre of five doctoral students in science, technology, engineering and mathematics were trained in and conducted research on measurement and evaluation.

Axiom CommScope

Sponsor: Axiom Sales Force Development LLC
Principal investigator: Dr. Daniela Schroeter
Dates: Nov. 1, 2012, to May 31, 2013

This project concerns the planning of the CommScope training impact evaluation,conducted on behalf of Axiom Sales Force Development LLC.

Axiom Silverpop

Sponsor: Axiom Sales Force Development LLC
Principal investigator: Dr. Daniela Schroeter
Dates: April 1 to Oct. 10, 2013

The Evaluation Center examined the effectiveness of the AXIOM sales force development program for Silverpop, a digital marketing provider. AXIOM teaches a customer-based sales approach that moves beyond the traditional seller-buyer relationship, molding sellers into trusted advisors offering client centric solutions. The Evaluation Center used Success Case methodology to provide information regarding the implementation of AXIOM with the Silverpop sales force.

Axiom Verizon

Sponsor: Axiom Sales Force Development LLC
Principal investigator: Dr. Daniela Schroeter
Dates: May 1 to Sept. 30, 2012

This project concerned the planning of the Verizon training impact evaluation conducted on behalf of Axiom Sales Force Development LLC.

Benchmarking Student Evaluation Practices

Sponsor: National Science Foundation
Principal investigator: Dr. Arlen Gullickson
Dates: March 1, 2008, to Feb. 28, 2011

An invitational conference was held in February 2009 to examine and improve current student evaluation practices through the use of conference and follow-up activities to increase awareness and knowledge of The Student Evaluation Standards, promote research on student evaluation practices, develop and disseminate a model and tools for benchmarking student evaluation practice and provide a structure to serve long-term studies of the student evaluation standards and their impact. A diverse group of educators were engaged in applying the information and benchmarking tools to improve teachers’ student evaluation practices in local school settings. Invited speakers included Dr. Judy Arter, Educational Testing Service, a nationally recognized expert in performance assessment; Dr. Katharine Cummings, WMU College of Education, who was working with a project to engage practicing teachers and teacher education candidates in a process of benchmarking; Dr. Joan Herman, CRESST, whose research focused on the validity and utility of teachers’ formative assessment practices in science; Mr. Benjamin Sinwell, a National Board-certified mathematics teacher in Montgomery County, Md.; and Dr. Caroline Wylie, Educational Testing Service, whose research centered around the use of formative assessment as a mechanism for improving teaching and learning in classrooms.

Best Practices of Technology Integration

Date: July 31, 2000

Evaluation of the Technology Literacy Challenge Grant awarded to the Great Lakes Education Network.

Buprenorphine Treatment in Jail and Post-Release

Sponsor: National Institute of health
Principal investigator: Dr. Stephen Magura
Dates: July 2, 2007, to March 31, 2009

Heroin and other opioid abuse continue to be a significant problem among the criminal justice population. In 2002, the criminal justice system was the source of referral for 36 percent of all substance abuse treatment admissions, the largest source of referrals. Injection, still the primary route of administration among heroin users, is strongly associated with the transmission of HIV, hepatitis C and other blood-borne diseases. The relationship between heroin use and criminal activity has been documented extensively. Correctional systems in the U.S., with few exceptions, have not provided institutional access to methadone maintenance. Buprenorphine maintenance is a recently approved therapy that may be more acceptable than methadone to the criminal justice system and opioid-dependent offenders. With one minor exception, buprenorphine has never been administered systematically as an opioid replacement therapy in a correctional setting in the U.S. Consenting eligible inmates were randomly assigned to buprenorphine or methadone maintenance in jail and were to be referred to a corresponding community treatment at release. Outcomes were to be assessed at three months after release from jail by chart review and personal interviews.

Calhoun II Capacity Building

Date: June 30, 2000

Management support of nonprofit agencies in Calhoun County.

California State University Charter School of Education

Sponsor: California State University
Principal investigator: Dr. Jerry Horn

Dates: April 8, 1999 to Dec. 30, 1999

The Evaluation Center conducted an external evaluation of the Charter School of Education at California State University, the nation’s first and only charter school of education. The evaluation was designed to provide an external analysis of CSOE’s progress in meeting its goals and to inform decisions regarding continuation or institutionalization of the charter.

Center for Research on Educational Accountability and Teacher Evaluation (CREATE)

Sponsor: U.S. Department of Education
Principal investigator: Dr. Daniel Stufflebeam
Date: Nov. 1, 1990, to Oct. 31, 1995

This was a federally funded research and development center for research on educational accountability and teacher evaluation. The center’s mission was to improve educational evaluation practices in public and private schools in all 50 states. The program consisted of 16 projects under 4 programs: improvement of teacher performance evaluations; improvement of evaluations of administrators, support personnel, and schools; dissemination of products and services; and theory development and special projects.

Center for Student Opportunity

Sponsor: Center for Student Opportunity
Principal investigator: Dr. Daniela Schroeter
Dates: March 2 to Aug. 31, 2009

This evaluation for the Center for Student Opportunity project developed a data collection plan and sampling framework, developed data collection instruments, implemented a needs assessment and created a report in aggregate.

Centers for Disease Control University

Sponsor: Centers for Disease Control and Prevention
Principal investigator: Dr. Lori Wingate
Dates: Feb. 4 to May 31, 2013

The center provided four workshops on evaluation for CDC University, a professional development program for employees at the Centers for Disease Control and Prevention in Atlanta, Georgia. Topics included data interpretation, evaluation question and translating findings into action.

Charter School Student Achievement in the Great Lakes Region

Sponsor: Arizona State University
Principal investigator: Dr. Gary Miron
Dates: May 1, 2006, to April 30, 2008

The Evaluation Center conducted secondary analysis of student achievement data for charter schools in Illinois, Indiana, Michigan, Minnesota, Ohio and Wisconsin.

Charter School Teacher Attrition in the Great Lakes Region

Sponsor: Arizona State University's Educational Policy Studies Lab
Principal investigator: Dr. Gary Miron
Dates: May 1, 2006, to April 30, 2007

The Evaluation Center researched the causes of teacher attrition in charter schools in Illinois, Indiana, Michigan, Minnesota, Ohio, and Wisconsin. This research included data mining from state-level charter school evaluations.

Chronic Care Collaborative

Sponsor: Integrated Health Partners
Principal investigator: Dr. Chris Coryn
Dates: Sept. 15, 2008, to June 30, 2011

The Evaluation Center assessed the effectiveness of Integrated Health Partners’ collaborative efforts aimed at improving the health outcomes of persons with chronic health conditions using a one-group pretest-post test design with multiple post tests (i.e., longitudinal, repeated measures). Staff included Stephanie Evergreen, project manager; Jan Kevin Fields; and Carl Westine.

Chronic Care Model

Sponsor: Trinity/Integrated Health Partners
Principal investigator: Dr. Chris Coryn
Dates: Oct. 1, 2007, to June 30, 2009

This evaluation was to determine the effectiveness of Trinity Health’s collaborative efforts in the form of the Chronic Care Model in improving health outcomes for persons having chronic health conditions (e.g., diabetes).

Cleveland Charter Schools

Sponsor: Ohio Department of Education
Principal investigator: Dr. Gary Miron
Dates: Aug. 1, 2000, to June 30, 2005

The Evaluation Center conducted a qualitative study of four charter schools in Cleveland, Ohio, that are sponsored by The Cleveland Foundation. During the three-year project, the center addressed a variety of research questions related to the charter schools as well as their impact on local public schools and communities. As part of the project, center staff provided technical assistance to strengthen the accountability plans of the participating charter schools and to develop their capacity to use evaluation to improve their operation and instruction.

Colorado Advanced Technological in Education Targeted Research

Sponsor: University of Colorado and NSF
Principal investigator: Dr. Stephen Magura
Dates: March 23, 2009, to July 31, 2012

The center conducted research to define and measure the effectiveness of ATE centers and projects.

Comprehensive Assessment of School Environments

Sponsor: The National Association of Secondary School Principals
Principal investigator: Dr. Paul Berge
Dates: July 1, 1988, to June 30, 2006

The Evaluation Center provided scoring and related consultant services for the National Association of Secondary School Principals’ Comprehensive Assessment of School Environment battery of instruments, which assessed relationships between school inputs and student outcomes, and for the CASE Information Management System, which provided analysis of school effectiveness and efficiency and includes possible interventions for school improvement.

Comprehensive Gambling in Michigan

Sponsor: Michigan Department of Community Health
Principal investigator: Dr. Arlen Gullickson
Dates: April 1 to Sept 30, 2001

This project completed a compulsive gambling follow-up study to determine the extent of gambling addictions among Michigan citizens.

Confidential Close Call Reporting System

Sponsor: Federal Railroad Administration via New Vectors
Principal investigator: Dr. Liesel Ritchie
Dates: March 10, 2006, to March 31, 2008

The Evaluation Center subcontracted with New Vectors to assist in its evaluation of the Federal Railroad Administration’s Confidential Close Call Reporting System. This involved evaluation activities focusing on a small number of pilot railroad sites (three rail yards and one passenger rail hub) where C3RS was being implemented. The work entailed instrument development, ongoing data collection, data analysis activities and reporting.

Connecticut Charter Schools

Sponsor: Connecticut Department of Education
Principal investigator: Dr. Jerry Horn
Date: Sept. 30, 2002

The Evaluation Center conducted an evaluation of individual charter schools and the charter school initiative for the Connecticut Department of Education. During the five-year evaluation, the center conducted impact and process evaluations with indicators common to all the Connecticut charter schools; assisted each charter school to identify indicators unique to its specific goals and missions; provided technical assistance to the charter schools in developing a system for annually collecting and reporting data pertinent to their local evaluation models; and served as a resource for measurement, evaluation and decision-making issues.

Consuelo—Hawaii

Sponsor: Consuelo Zobel Alger Foundation
Principal investigator: Dr. Daniel Stufflebeam
Date: Oct. 1, 1995, to Sept. 30, 2002

Continued the longitudinal evaluation of the Waianae Self-Help Housing Initiative.

CREATE Publications

Date: June 30, 2000

Continued dissemination of CREATE publications.

Controlled Trial of Self-Help for Dually Diagnosed Persons

Sponsor: NDRI/National Institute on Drug Abuse
Principal Investigator: Dr. Stephen Magura
July 1, 2007, to June 30, 2008

The final project year was to develop statistical analytical plans, provide statistical analysis of the data, write articles for publication, and prepare the final report to the National Institute on Drug Abuse.

CPR Refreshers

Sponsor: Western Michigan University
Principal investigator: Dr. Michael Miller
Co-principal investigators: Dr. Stephen Magura, Dr. Timothy Michael and Dr. Robert Bensley
Dates: June 15, 2008, to April 30, 2011

The center conducted the evaluation component of the proposal to develop and administer refreshers training in cardiopulmonary resuscitation. The center collaborated with the WMU Department of Health, Physical Education and Recreation.

CREATE Institute

Dates: Jan. 1, 1991, to Dec. 31, 1999

The Evaluation Center housed a federally funded research and development the Center for Research on Educational Accountability and Teacher Evaluation. The center’s mission was to improve educational evaluation practices in public and private schools in all 50 states. The program consisted of 16 projects under four programs; improvement of teacher performance evaluations; improvement of evaluations of administrators, support personnel and schools; dissemination of products and services; and theory development and special projects. CREATE collaborated with the University of Alabama, Des Moines Public Schools, Joint Committee on Standards for Educational Evaluation, National Association for Secondary School Principals, Pacific Graduate School of Psychology, University of South Florida, Westat, Western Illinois University and the College of William and Mary.

The annual National Evaluation Institute began during CREATE’s second year. These institutes became so popular that, when federal funding was not renewed for this program, a group of individuals formed a new organization—also named CREATE—in order to continue the work and the networking that had begun. The Evaluation Center continues to receive requests for information and documents that were developed under the auspices of CREATE.

Cultural Connections Evaluation

Sponsor: Fulbright-Hayes Group Study Abroad
Staff: W.F. Santiago-Valles, co-principle investigator; Stephanie Evergreen, co-principal investigator; and Yuanlong Liu, evaluator
Dates: March 1, 2010, to May 1, 2011

The center provided feedback and reflection opportunities for a group of scholars who traveled to West Africa to develop curriculum for implementation in Midwest U.S. classrooms. The Haenicke Institute for Global Education; the departments of Speech Pathology and Audiology, Africana Studies, and Health, Physical Education, and Recreation; and numerous public schools around the Midwest collaborated with the center on this work. Cultural Connections website.

Delaware Charter Schools

Sponsor: Delaware State Board of Education and Department of Education
Principal investigators: Dr. Jerry Horn and Dr. Gary Miron
Dates: Dec. 5, 2003, to Jan. 31, 2007

The Evaluation Center contracted with the Delaware State Board of Education and Department of Education to conduct a comprehensive evaluation of the charter school initiative in Delaware. The critical questions addressed concerned impact, innovation, comparison with public school districts, relationships between schools and authorizers, management structure, factors linked to success in achieving school mission and improving learning, and how best to strengthen initiative. The analysis of student level data to measure the impact of the charter schools was one of the most rigorous studies of student achievement in charter schools ever completed.

Detroit Public Television

Sponsor: U.S. Department of Education
Principal investigator: Dr. Pamela Zeller
Date: Oct. 30, 2003

This two-year project was funded through the Federal Department of Education. The Enrichment Channel was a unique new multimedia experience that delivered learning materials and lesson guides directly into classrooms and homes via computer and telecommunications technologies.

This two-year project was funded through the Federal Department of Education. The Enrichment Channel was a unique new multimedia experience that delivered learning materials and lesson guides directly into classrooms and homes via computer and telecommunications technologies. It provided students, teachers and families in southeastern Michigan and the Upper Peninsula with unique arts and culture materials aligned with the Michigan Curriculum Framework. Products included three thematically integrated video, CD-ROM and Internet Literacy Content Units. The process and outcome methodologies for the evaluation of this project included content validation for all products, face-to-face and telephone interviews, group discussions and on-site observations for programming and taping of products.

The primary purposes of the evaluation were to ensure that project activities and products were keyed to the needs of educators and students, describe the process and products associated with the project and assess the overall merit and worth of the project.

Development of Personnel Evaluation Standards

Principal investigator: Dr. James R. Sanders
Dates: Oct. 1, 2000, to Sep. 30, 2002

This project included the revision of Personnel Evaluation Standards.

Development of Student Evaluation Standards

Principal investigator: Dr. Arlen Gullickson
Dates: Sep. 30, 2000, to Sep. 30, 2004

This project included reforming the way decisions are made about students.

Diversity Awareness and Leadership Training Program

Sponsor: W.K. Kellogg Foundation and Diversity Awareness and Leadership Training Program
Staff: Stephanie Evergreen, principal investigator, and Lindsay Noakes
Dates: Sept. 1, 2008, to Aug. 31, 2009

This project evaluated the effects of the program on its youth participants by using evaluative activities. A sustainable evaluation design was created to help the DALT staff to conduct internal monitoring and evaluation, which helped the program serve its youth participants better and improve its effectiveness.

Dual Focus Mutual Aid

Sponsor: National Institute of Health
Principal investigator: Dr. Stephen Magura
Dates: July 1, 2008, to April 30, 2014

The study aimed to:

• Conduct a multisite randomized controlled trial to determine the efficacy of dual focus 12-step mutual aid groups for persons with co-occurring substance use and mental discords.
• Determine the personal, social and environmental, and treatment-related variables that predict DTR affiliation.
• Determine the therapeutic mechanisms mediating between Double Trouble in Recovery participation and behavioral outcomes.

Education for the Arts

Sponsor: Irving S. Gilmore Foundation
Staff: Dr. Michael Scriven, principal investigator, and Dr. James Sanders, co-principal investigator
Dates: March 1, 2006, to Dec. 31, 2007

Education for the Arts was a Kalamazoo Regional Educational Service Agency program funded by the Irving S. Gilmore Foundation to enhance K-12 education throughout Kalamazoo County.

Environmental Education and Training Partnership

Sponsor: U.S. Environmental Protection Agency
Principal investigator: Dr. Craig Russon
Dates: Dec. 1, 1996, to March 31, 2001

The Evaluation Center evaluated the work of the Environmental Education and Training Program, a comprehensive collaborative of more than 12 professional organizations and agencies in the field of environmental education. EETAP was funded by the U.S. Environmental Protection Agency for the purpose of advancing knowledge and understanding of environmental education, developing synergistic activities among partners, and focusing attention on traditionally underserved educators and students in environmental education.

Evaluation of Indiana State University's Accelerating College Completion Through Math Mindset Project

Sponsor: Indiana State University
Principal Investigators: Dr. Brad Watts 
Oct. 1, 2014 to Sept. 30, 2019

The WMU Evaluation Center is providing evaluation services to Indiana State University’s FIPSE grant. Based on an experimental design, the project seeks to identify most effective strategies to accelerate college completion. The evaluation will provide expert reviews of the RCT and related reports, and provide formative and summative feedback that informs overall project performance and GPRA measures.

Evaluation of Sobriety Court

Sponsor: Muskegon County
Principal investigator: Dr. Stephanie Evergreen
Dates: Oct. 16, 2009, to Nov. 1, 2011

The external evaluation of Muskegon County’s Sobriety Court used longitudinal data and interviews with ex-offenders to examine effectiveness and impacts. Recidivism, improved education and employment, secure housing and sobriety are main project outcomes the evaluation assessed. The evaluation sought to understand the main participant groups taking part in Sobriety Court to help the client see with whom the court system is having the most success. Ultimately, the evaluation showed that the program reduced recidivism and was cost effective. Final report.

Evaluation of Swiss National Science Foundation

Sponsor: Swiss National Science Foundation
Principal investigators: Dr. Chris Coryn, Dr. Brooks Applegate and Dr. Daniela Schroeter
Dates: Jan. 1, 2012, to Dec. 31, 2013

The Foundation Council of the SNSF conducted an evaluation to improve overall quality assurance and transparency in evaluation across its funding instruments.

Evaluation of the ATE ICT

Sponsor: Springfield Technical Community College
Principal investigator: Dr. Chris Coryn
Dates: June 17 to Aug. 31, 2013

Evaluation of the Center for Performative Design and Engineering Technology

Sponsor: New York College of Technology, National Science Foundation
Principal investigators: Dr. Lori Wingate and Krystin Martens
Dates: Sep. 1, 2012, to Aug. 31, 2014

The project’s evaluation included formative and summative components. The formative evaluation component provided timely feedback to enable reflection on the effectiveness of the project’s implementation strategies so that improvements could be made as necessary. The summative component focused on determining the extent to which the project’s anticipated outcomes were achieved, identified any unintended positive or negative outcomes and captured lessons learned.

Evaluation of the Dynasty Foundation

Sponsor: Dynasty Foundation
Principal investigator: Dr. Daniela Schroeter
Dates: April 2 to Oct. 31, 2012

The Dmitry Zimin’s Dynasty Foundation for Not-for-Profit Programs evaluation provided a comprehensive, independent, external evaluation of its performance in comparison to the highest international standards with the intent to explore new opportunities for improving the foundation’s performance.

Evaluation of the Edison Project

Sponsor: The Edison Project
Principal investigator: Dr. Gary Miron
Date: June 30, 2000

The Evaluation Center examined the impact of The Edison Project schools on student learning. The Edison Project, one of the largest educational management organizations that operates public schools in the U.S., manages 51 contract and charter schools in 12 states. The study focused on 12 schools that had been operated by The Edison Project for at least three years. Center researchers evaluated existing research and evaluated the impact of Edison schools, comparing student achievement at Edison schools with state and national norms and local district schools, and developing and analyzing case studies for each of the 12 Edison schools examined.

Evaluation of the Family Literacy Program

Sponsor: Literacy Center of West Michigan
Principal investigator: Stephanie Means
Dates: Sept. 8, 2008, to Oct. 31, 2013

This evaluation examined both the Family Literacy Program and the Iglesias de Esperanzas program. The broad objectives for the evaluation were to:

• Ascertain the effect of the programs on the students in participating families.
• Ascertain the degree of change in at-home parent/child literacy and language activities.
• Determine the improvement of English as a second language and parenting skills for the parents in participating families.
• Provide information on the successes and challenges of programs to the Literacy Center of West Michigan.

Evaluation of the International Codex Outreach Program

Sponsor: U.S. Department of Agriculture
Principal investigator: Dr. Daniela Schroeter
Dates: Sept. 30, 2013, to Sept. 30, 2014

This program evaluated the International Codex Outreach program.

Evaluation of the NSF Advanced Technological Education Program—Annual Survey

Sponsor: National Science Foundation
Principal investigator: Dr. Arlen Gullickson
Dates: Dec. 1, 1999, to Nov. 30, 2009

The evaluation began in 2000 and continued until 2009. The annual survey provided information needed to assess the impact and effectiveness of the ATE program. Along with information gathered by other ATE-targeted studies, this survey was used to address four basic questions:

• How effective was it when it reached its constituents?
• To what degree was the program achieving its goals?
• Was it making an impact, reaching the individuals and groups intended?
• Were there ways the program could be improved significantly?

Many ATE evaluators noted their own inexperience as evaluators and especially their unfamiliarity with technological education. Thus, The Evaluation Center personnel worked closely with the ATE projects and centers and with ATE program staff to continue to refine a model framework. This collaborative effort yielded useful program level information that provides all constituent groups with direct and easy access to useful information about center and project activities, impact and effectiveness.

Evaluation of the Race Exhibit Initiative

Sponsor: Race Exhibit Initiative and Kalamazoo Community Foundation
Principal investigator: Dr. Stephanie Evergreen
Dates: Dec. 31, 2010, to June 1, 2012

The Race Exhibit Initiative was a community-wide coalition of organizations that produced events to engage residents in a deep dialogue about race. The evaluation determined whether or not the coalition met its targets in terms of the number of residents engaged and the depth of their understanding about race. The evaluation also documented the challenges and successes of community collaboration.

Evaluation Plan for the High Expectations-High Standards GOALS 2000 Project

Sponsor: Wayne County RESA
Principal investigator: Dr. Pamela Zeller
Dates: Jan. 1, 1997, to Sept. 30, 1998

Conducted an external evaluation to provide Genesee Intermediate School District staff with both formative and summative evaluation feedback.

Even Start

Sponsor: Bay-Arenac ISD
Principal investigator: Dr. Pamela Zeller
Dates: Dec. 7, 2005, to Dec. 30, 2006

EvenStart is a family literacy program of Bay-Arenac ISD. The evaluation included formative and summative components, focusing on the program’s impact on the literacy level of involved families.

Evidence-Based Practice

Sponsor: U.S. Department of Health and Human Services and the National Institutes of Health
Principal investigator: Dr. Stephen Magura
Dates: July 1, 2011, to June 30, 2014

Identifying what works in the behavioral health disciplines is crucial for making well-informed defensible decisions when selecting and implementing behavioral health-related interventions. As the need for relevant, accessible and systematically derived information that supports policy decisions has increased, so has the demand for comprehensive sources of information about effective programs and intervention modalities. To this end, a number of evidence based repositories and registers have been developed by various federal and state organizations, non-governmental organizations and universities. More project information.

Federal Railroad Administration

Sponsor: U.S. Department of Transportation
Principal investigator: Dr. Christopher Nelson
Dates: Oct. 30, 2002

Designed and conducted two elements of the examination of an Amtrak safety initiative, Rulebook Consolidation Project.

Field Initiated Research Trauma Informed Juvenile Assessment and Treatment

Sponsor: U.S. Department of Justice Office Juvenile Justice and Delinquency Prevention
Principal investigator: Dr. James Henry and Dr. Chris Coryn
Dates: Sept. 1, 2011, to Aug. 30, 2014

An intra-country comparison group was composed within each of the five counties and then analyzed using structured equation modeling. The hypothesis was that youth who receive trauma informed interventions will have a reduction in recidivism in committing subsequent crimes, have increased academic progress and show reduced behavioral symtomology compared to those that are not participating in trauma assessment and treatment.

FIPSE Evaluation—Kalamazoo College

Sponsor: U.S. Department of Education and FIPSE
Principal investigator: Dr. Daniela Schroeter
Dates: July 1, 2011, to Dec. 31, 2013

This proposal provided external evaluation services for a Kalamazoo College FIPSE grant to improve student retention and connection through innovative advising practices. We collaborated with Kalamazoo College in refining internal and external, formative and summative research and evaluation mechanisms, implementing external evaluation efforts, involving interdisciplinary Ph.D. in evaluation program students to conduct interviews with Kalamazoo College students, and completing related analyses and reporting requirements.

Food Resources Bank

Sponsor: Food Resource Bank
Principal investigator: Dr. Daniela Schroeter
Dates: Jan. 1 to Aug. 31, 2005

The Evaluation Center provided quality data on the organization’s operations and results so that the FRB could use the evaluation to assist in developing its strategic plan. Food Resource Bank is a non-governmental organization that describes itself as a Christian response to world hunger. FRB is dedicated to helping reduce hunger in the developing world through small-scale agricultural production leading to sustainable food security. The bulk of the funds managed by FRB come from church-connected community growing projects (coalitions of people growing a crop to be monetized and donated to FRB).

FRA—Behavior-Based Safety

Sponsor: U.S. Department of Transportation
Principal investigator: Dr. Christopher Nelson
Dates: Oct. 30, 2002

This project provided an evidentiary base on which the Federal Railroad Administration can make policy decisions about the applicability of behavior-based safety to the rail industry.

Fulcrum

Sponsor: Fulcrum Corporation
Principal investigator: Dr. Daniela Schroeter
Dates: Jan. 15 to Dec. 31, 2009

This project provided evaluation services for the Federal Railroad Administration’s International Conference on Fatigue Management and support to the evaluation track of the conference.

Genesee County Intermediate School District Technology Literacy Grant

Sponsor: Genesee County Intermediate School District
Principal investigator: Dr. Pamela Zeller
Dates: Aug. 1, 2000, to July 31, 2001

This project conducted an external evaluation of the Genesee County Intermediate School District Technology Literacy Grant.

German Logic Model

Sponsor: Duetsches Jugendinstitat e.V.
Principal investigators: Dr. Daniela Schroeter and Dr. Gary Miron
Dates: Oct. 1 to Dec. 31, 2007

An annotated bibliography on logic modeling was developed in the language of the work, and a synthesis report was written in German to reflect major findings form the review.

Grand Rapids Youth Master Plan

Sponsor: City of Grand Rapids, Michigan
Staff: Dr. Chris Coryn, principal investigator; Stephanie Evergreen, project manager; and Brandy Pratt
Dates: July 28, 2008, to March 31, 2010

This project determined the needs of Grand Rapids’ youth by providing an evaluation design and logic model to meet the needs of the program, conducting a needs assessment of Grand Rapids youth, providing feedback to stakeholders for program improvement purposes and by documenting accomplishments and disseminating critical findings based on project activities.

Grand Rapids Urban Legue Sowing Opportunities Now (SON) Program

Sponsor: W.K. Kellogg Foundation
Principal Investigator: Dr. Kelly Robertson
Apr. 17, 2017 to Sep. 30, 2019

The SON program seeks to empower at-risk males of color between the ages of 16-24 to work towards family well being and economic self-sufficiency. The overarching purpose of the evaluation is to establish monitoring and evaluation practices that will allow the program to make evidence-based decision..

GOALS 2000 No. 2

Sponsor: Wayne County RESA
Principal investigator: Dr. Pamela Zeller
Dates: Sept. 1, 2001, to Aug. 31, 2002

Evaluation plan for the High Expectations-High Standards GOALS 2000 No. 2.

Hamtramck/Plymouth-Canton Schools

Sponsor: Michigan Department of Education
Principal investigator: Dr. Pamela Zeller
Dates: Aug. 1, 2001, to July 31, 2002

This was a Technology Literacy Challenge Grant awarded to the Hamtramck school system by the Michigan Department of Education. The project was designed to create and implement a series of professional development workshops and activities based on state and national standards, and was based on the Training of Trainers Models. Teachers and media specialists were identified from schools throughout the Hamtramck and Plymouth-Canton districts. Project staff trained the educators during three Saturday sessions. Training provided the participants with technology skills for classroom instruction with exercises in incorporating the Michigan Department of Education Standards and Benchmarks. In turn, those participants were required to train teachers and media specialists from their buildings. The process and outcome evaluation for this survey included documentation of project work, discussion group sessions and workshop surveys.

Healthier Communities

Sponsor: Sarah Bush Lincoln Health System
Principal investigator: Dr. Liesel Ritchie
Dates: March 15 to Sept. 15, 2006

This project was a needs assessment for the Sarah Bush Lincoln Health System in Illinois to determine interest in and possible use of an Interactive Health Education Facility for its Healthier Communities Initiative. The study involved an on-line survey of educators in the region, as well as a household telephone survey targeting homes with children ages 5 to 17.

Heifer Learning Centers

Sponsor: Heifer Project International
Staff: Dr. Michael Scriven, principal investigator; Stephanie Evergreen, project manager; Lee Balcom; Todd Harcek; Krystin Martens; Robert McCowen; Lindsay Noakes; Kristin Kaylor Richardson; Kelly Robertson; and Diane Rogers
Dates: April 1, 2009, to July 31, 2010

This evaluation:

• Documented the impact of Heifer’s educational programs.
• Helped provide a comprehensive assessment of Heifer’s public education programs and their alignment with and support of Heifer’s organization-wide goals and board ends.
• Provided new insights and developed a complete picture of the impact of Heifer International’s Public Education programs as a major component of Heifer’s program portfolio.

Heifer Project International

Sponsor: Heifer International
Principal investigator: Dr. Michael Scriven
Date: March 1, 2005, to Dec. 31, 2009

The Evaluation Center began working with Heifer in 2005 to evaluate some of the countries associated with its international program. Teams made up of two individuals visited each country to evaluate group and community values, behavior, finances, social capital and group cohesion resulting from HPI’s work. As part of these tasks, teams reviewed and analyzed documents, reports and other materials related to the projects selected for the impact evaluation. Teams also worked with local staff to design and implement participatory assessments of the specific projects being evaluated. A meta-analysis was conducted of all five rounds of impact evaluation, and a tool kit developed for HPI use in the future. The countries involved in the evaluations were:

• 2005: South Central U.S. and Peru.
• 2006: Albania, Nepal and Thailand.
• 2007: Cameroon, China, Kenya and Tanzania.
• 2008: Cambodia, Ghana, Guatemala, Honduras and Vietnam.
• 2009: Armenia, Indonesia, the Philippines and the Baltic states (Latvia, Lithuania, Estonia).

High/Scope

Sponsor: W.K. Kellogg Foundation
Principal investigator: Dr. Pamela Zeller
Dates: Aug. 8, 2003, to Dec. 21, 2006

The Helping Schools Get Ready for All Children (Ready Schools) project was a three-year project funded by the W.K. Kellogg Foundation and implemented through the High/Scope Educational Research Foundation. The project’s principal goals were to create a Ready School Assessment and Improvement Plan, pilot test the Ready School assessment, and provide public communication and widespread dissemination of the Ready School assessment. Evaluators provided formative and summative evaluations.

Illinois Charter Schools

Sponsor: Illinois Department of Education
Principal investigator: Dr. Gary Miron
Dates: Feb. 29, 2000, to June 29, 2002

The effectiveness of charter schools for the Illinois State Board of Education was evaluated. Both quantitative and qualitative data were collected through surveys, interviews, document review, focus groups and case studies. Gains in test scores on standardized tests were analyzed and compared with local districts and comparison schools to determine if future policy changes were needed.

IMPROVING TEACHER QUALITY GRANT AT CMU

International Labour Organization

Sponsor: International Labour Organization
Principal investigator: Dr. Daniela Schroeter
Dates: April 1 to June 30, 2009

This project revised ILO’s evaluation appraisal tool, specifically reflecting the ILO declaration on social justice for a fair globalization; appraised ILO’s 2008 evaluation reports (roughly 40 reports); surveyed evaluators’ regarding compliance with evaluation processes and results; and reported finding back to ILO. The final report included both findings from each evaluation and synthesized findings across the evaluations.

International Labour Organization

Sponsor: International Labour Organization
Principal investigator: Dr. Daniela Schroeter, Kelly Robertson
Dates: Sept. 10, 2012, to July 31, 2013

The Evaluation Center was contracted by the International Labour Organization’s Evaluation Unit to conduct an independent appraisal of a sample of ILO evaluation reports that were conducted between 2009 and 2011 against ILO evaluation guidelines. Additionally, the center conducted an appraisal of a sample of ILO evaluation reports from 2011 against the UN SWAP Evaluation Score card.

Kalamazoo Nonprofit Capacity Coalition

Date: Dec. 31, 2000

Provide technical assistance to the Nonprofit Capacity Coalition.

Kalamazoo Promise

Sponsor: U.S. Department of Education
Staff: Dr. Gary Miron, principal investigator, and Stephanie Evergreen, project manager
Dates: Jan. 1, 2007, to Dec. 31, 2008

Funding from the U.S. Department of Education enabled The Evaluation Center to form a three-way partnership to study the impact of the Kalamazoo Promise. The partnership among WMU, Kalamazoo Public Schools and the W.E. Upjohn Institute sought to asses the short-term and intermediate outcomes of the Kalamazoo Promise. The promise is a scholarship program announced in November 2005 that provides up to four years of tuition and fees at any two-year or four-year public college or university in Michigan for students who graduate from Kalamazoo Public Schools.

Kalamazoo Public Schools Middle School Summer Enrichment Program

Sponsor: Kalamazoo Public Schools
Principal investigators: Dr. Chris Coryn and Dr. Arlen Gullickson
Dates: June 1, 2004, to Aug. 30, 2007

The center evaluated the Kalamazoo Public Schools’ Summer Enrichment program for three consecutive years. The evaluation, conducted by interdisciplinary evaluation graduate students, included a goal-free evaluation component and was structured around Michael Scriven’s key evaluation checklist.

Kalamazoo Public Schools Title I Behavioral Program

Sponsor: Kalamazoo Public Schools
Staff: Dr. Chris Coryn, principal investigator, and Lindsay Noakes, co-principal investigator
Dates: May 10 to Dec. 15, 2010

This evaluation determined the perceived effectiveness of Title 1, Part A elementary support positions and professional development initiatives and their potential for impact on student achievement. The evaluation was primarily formative, that is, for the purpose of improvement. However, it was also summative in that the information obtained gives an overall measure of perceived effectiveness over the 2009‐10 school year.

Kalamazoo Public Schools Title I Jail Program

Sponsor: Kalamazoo Public Schools
Staff: Dr. Chris Coryn, principal investigator; Kelly Robertson, co-principal investigator; and Kurt Wilson, co-principal investigator
Dates: May 10, 2010, to June 3, 2011

This evaluation determined the impact of KPS’s Office of Title I and School Improvement GED services at the Kalamazoo County Jail, making suggestions for improvements to the GED services and evaluating the overall impact of this service and intervention.

Kalamazoo Public Schools Title I Juvenile Program

Sponsor: Kalamazoo Public Schools
Staff: Dr. Chris Coryn, principal investigator, and Brooke Isham, co-principal investigator
Dates: May 10, 2010, to Jan. 31, 2011

This evaluation assessed the impact of the Title I Part D funded supplemental educational services on jail residents’ high school diploma and GED attainment to learn how the services can be improved. The rationale for conducting the evaluation was to partially address Title I Part D funding requirements, as well as to determine the impact and learn how to improve the services. Further, this evaluation was needed since research on similar services has yielded variable findings and most has been conducted with prison offenders. Findings of this evaluation should help improve the services in the future and increase the number of jail residents who receive a high school diploma or GED, which is thought to lead to reduced recidivism and increased post-incarceration education and employment.

Kalamazoo Symphony Orchestra Marvelous Music Program

Sponsor: Kalamazoo Symphony Orchestra
Principal investigator: Dr. Chris Coryn
Dates: Sept. 1, 2010, to Aug. 31, 2013

In year one KSO piloted the Marvelous Music! program (aimed at preschool children and their parents). Formative evaluation examined implementation of the program and its design. Year two was primarily formative and year three was summative and included an outcome and costs evaluation.

Kalamazoo United Way

Principal investigator: Dr. James Sanders
Date: Dec. 31, 2000

This project produced an evaluation manual to be used within the Greater Kalamazoo community as a guide for using evaluation in community organizations. A newsletter and technical assistance in evaluation were provided to community nonprofit organizations to enable them to develop their evaluation capacity.

Kamehameha Schools’ Aina Ulu Intitiative

Sponsor: Kamehameha Schools
Principal investigator: Dr. Gary Miron
Date: April 5 to Oct. 30, 2005

The Evaluation Center proposes to provide technical assistance and program evaluation for Kamehameha Schools’ Anina Ulu Initiative. The two main goals of the proposal were to conduct a preliminary evaluation of the Aina Ulu Initiative and develop a program monitoring and evaluation system for regular reporting purposes and future program evaluation of the initiative.

Kamehameha Schools’ Early Childhood Education

Sponsor: Kamehameha Schools
Principal investigator: Dr. Gary Miron
Dates: April 1, 2003, to June 30, 2005

The Evaluation Center executed a pilot study and evaluation of the Kamehameha Schools Preschool Program. Additional tasks included a review of assessment and accountability activities. At the close of the project, a detailed evaluation plan and an expanded database were in place to assist program staff in conducting a larger scale evaluation of the entire program.

Kamehameha Schools’ E Ola Pono

Sponsor: Kamehameha Schools
Principal investigator: Dr. Gary Miron
Dates: April 26, 2005, to Feb. 27, 2006

The Evaluation Center conducted an evaluation of the Kamehameha schools’ E Ola Pono Middle School Health Curriculum Pilot Project. The main goals of this evaluation were planning, instrument development, data collection and analysis from teacher training session on E Ola Pono curriculum, monitoring curriculum implementation, and data collection and analysis of learner outcomes.

Kamehameha Schools’ Extension Education programs

Sponsor: Kamehameha Schools
Principal investigator: Dr. Gary Miron
Dates: April 1, 2003, to Sept. 24, 2004

The Evaluation Center provided technical assistance in program evaluation for the Kamehameha Schools Extension Education Division. The two main goals were to further build capacity and knowledge regarding evaluation and monitoring within EED, and promote the growth and development of EED as a learning organization. While initially envisioned as a formative evaluation, this project was revised to focus on the provision of technical assistance to program staff in the Extension Education Division. Members of the project team worked collaboratively with EED staff to develop logic models, create data collection instruments and analyze data. We also worked with staff to create short evaluation snapshots and reports that highlight monitoring and evaluation data. Evaluation Center staff conducted workshops and training sessions, provided resource materials and regularly corresponded with KS EED staff to provide technical assistance and evaluation capacity building. At the end of the project staff from each of the eight departments were expected to be able to collect, analyze and report monitoring and evaluation data. EED was expected to increasingly shift toward a more focused learning organization that uses data to drive decision making. To this end, we examined self-reported data from EED staff and incorporated indicators to monitor progress Evaluation of Kamehameha Schools’ Extension Education Programs.

Kamehameha Schools’ FADC

Sponsor: Kamehameha Schools
Principal investigator: Dr. Gary Miron
Dates: April 4, 2005, to Sept. 30, 2006

The Evaluation Center worked with the financial aid director and Ho’oulu data center manager, post-high counseling staff, and PASE research staff to:

• Develop and use the existing database for tracking scholarship recipients.
• Develop a program monitoring and evaluation system for regular reporting purposes and future program evaluation.
• Evaluate the operation of the post-high counseling program together with the post-high financial aid program and their program outcomes.
• Work with the department to coordinate data flow and tracking mechanisms for the program with emphasis on keeping things simple, consistent and user friendly.

Kamehameha Schools’ Hi’ilani Program

Sponsor: Kamehameha Schools
Principal investigator: Dr. Gary Miron
Dates: May 10, 2005, to Sept. 30, 2006

This project evaluated the Hi’ilani Program.

Kamehameha Schools’ Ho’olako Like Schools

Sponsor: Kamehameha Schools
Principal investigator: Dr. Gary Miron
Dates: May 6, 2005, to Feb. 28, 2007

The Evaluation Center provided technical support and data analysis to Kamehameha Schools for the Ho’olako Like Schools along with the following services:

• Assist schools with database navigation, provide advice regarding database input and maintenance, and act as liaison with PASE, the HL liaison and the database developer in instances where database enhancements or repairs are required.
• Create an inventory and master set of data collection tools and methods currently in place and identify where new tools and methods need to be developed or existing tools and methods require revision.
• Develop tools and methods for data collection.
• Identify exemplary practices already in place with the objective of standardizing tools across all Hoolako Like schools when this is consistent with individual school goals and characteristics.
• Identify measures for reporting and integrate them into the existing database.
• Monitor preliminary data entry and perform baseline analyses of initial data relative to program objectives: specifically, numbers of learners directly involved in programs, levels of achievement and individual improvement, community participation, and returns to culturally relevant educational practices Evaluation of Ho’olako Like Schools.
• Work with the HL schools, PASE, and the KS Hoolako Like liaison to create a master template for reporting findings for the current school year.

Kamehameha Schools’ Literacy Enhancement

Sponsor: Kamehameha Schools
Principal investigator: Dr. Gary Miron
Dates: May 4, 2005, to June 30, 2006

The project evaluated the literacy enhancement program.

Kamehameha Schools’ Pauahi Keiki Scholars Program

Sponsor: Kamehameha Schools
Principal investigator: Dr. Liesel Ritchie
Dates: April 4, 2004, to June 30, 2005

The Kamehameha Schools’ Pauahi Keiki Scholars program provided need-based vouchers or scholarships for three- and four-year-olds to attend eligible private preschools. The evaluation of this program reviewed the implementation of the PKS program and assessed the program’s impact on children, families and preschools. Data were collected from site visits (through interviews and the use of classroom assessment tools), parent surveys and review of program and school level documentation. Evaluators also analyzed achievement data from KS staff. The results suggested that families were quite satisfied and that most preschools were having a noticeable impact on student performance as measured by a standardized test (i.e., PPVT). The multiyear evaluations provided sound recommendations and feedback to program administrators for future program planning and improvement.

Kamehameha Schools’ Preschool and Beyond

Sponsor: Kamehameha Schools
Principal investigator: Dr. Gary Miron
Dates: Oct. 1, 2003, to June 30, 2005

This project evaluated KSPABS.

Kamehameha Schools’ Service Learning Program

Sponsor: Kamehameha Schools
Principal investigator: Dr. Gary Miron
Dates: May 6, 2005, to June 30, 2006

This project evaluated the service-learning program.

Kamehameha Schools’ Successful Schools for Hawaiians Study

Sponsor: Hawaii Department of Education
Principal investigators: Dr. Chris Coryn and Dr. Gary Miron
Dates: Jan. 1, 1999, to March 30, 2008

The Successful Schools for Hawaiians Study was a large-scale, mixed-method, multicase study conducted to examine school-level factors that influence academic achievement and performance of Native Hawaiian students in public schools in the state of Hawaii. The study particularly focused on school-level instructional strategies, curricula and policies that distinguished more successful schools from less successful schools in terms of their Native Hawaiian students’ academic performance. Individual schools were compared using cross-case techniques intended to identify the success factors present and operating in the schools sampled. The cross-case strategy was used, not only to make comparisons within like cases (i.e., within low growth schools and within high growth schools), but also between dislike cases (i.e., low and high growth schools). The results of the study concluded that successful schools were those that could be characterized as having collaborative school governance structures; that linked decision structures to data; that had a well-established, dedicated teaching force; that had focused learning communities; that had strong, engaged leaders; that shared accountability for their students’ learning; that were committed to continuous learning; and that provided effective supplementary and after-school programming.

Kamehameha Schools’ Summer School Evaluation

Sponsor: Kamehameha Schools
Principal investigators: Dr. Chris Coryn
Dates: Dec. 31, 2007

This evaluation of summer school programs on Big Island and Maui involved surveys of key stakeholders as well as impact on student achievement.

Kellogg Summer Institute

Sponsor: W.K. Kellogg Foundation
Principal investigators: Dr. James Sanders
Dates: June 30, 2001

The Kellogg Summer Institute in Evaluation fostered the development of evaluation expertise in Latin America through the training of a group of professionals affiliated with institutions that had the potential to establish education programs in evaluation in Latin America.

Latino/Hispanic Community Project

Sponsor: Battle Creek Community Foundation and W.K. Kellogg Foundation
Principal investigator: Dr. Chris Coryn and Stephanie Evergreen, project manager
Dates: June 31, 2008, to March 24, 2011

The vision of LHCP was to create support systems that contribute to improving the quality of life for the Latino/Hispanic community in Battle Creek. The program goal was that the Latinos/Hispanics in the Greater Battle Creek area would become recognized leaders because of their quality of services, engagement and participation in the social and civic life of the community.

Long-Term Care Screening Tool Evaluation

Sponsor: Trinity/Integrated Health Partners
Principal investigator: Dr. Chris Coryn and P. Cristian Gugiu, project manager
Dates: Oct. 1, 2001, to Sept. 30, 2003

This project evaluated a long-term care screening tool.

Metaevaluation and Checklists for the Centers for Disease Control

Sponsor: Centers for Disease Control and Prevention with Deloitte
Principal investigator: Dr. Lori Wingate
Dates: Aug. 15, 2012, to March 31, 2014

This project:

• Developed evaluation checklists related to the metaevaluation work.
• Prepared a publishable manuscript based on a metaevaluation previously conducted by the CDC.

Michigan Charter Schools

Sponsor: Michigan Department of Education
Principal investigator: Dr. Gary Miron
Dates: June 30, 2000, to July 15, 2002

The Evaluation Center evaluated the charter school initiative in Michigan through a project sponsored by the Michigan Department of Education. Fifty-one schools were visited and various types of school-specific data were collected from each of them. Data and information was collected from authorizing agencies, management companies, MDE officials and representatives of traditional public schools and intermediate school districts.

Michigan Comprehensive Oral Health Evaluation No. 2

Sponsor: Michigan Department of Community Health
Principal investigator: Dr. Liesel Ritchie
Dates: Oct. 1, 2007, to Sept. 30, 2008

The Evaluation Center developed and conducted the evaluation of the Michigan Oral Health program to enhance understanding of and approaches to evaluation.

Michigan Saves: Evaluability Assessment and Process Evaluation

Sponsor: Public Sector Consultants Inc.
Staff: Dr. Daniela Schroeter, principle investigator; Dr. Anne Cullen, co-principal investigator; Dr. Chris Coryn, methodologist; Kelly Robertson, project manager; and Gil Peach, consultant
Dates: Oct. 5, 2009, to Sept. 30, 2011

Michigan Saves, an innovative statewide energy efficiency and distributed renewable financing program, was implemented by Public Sector Consultants Inc. in partnership with Delta Institute. The Evaluation Center served as the program’s external evaluator tasked with conducting an evaluability assessment and process evaluation. After completing the process evaluation of the Cherryland pilot project, a statewide process evaluation of residential programming was planned.

Manuscript: Schroeter, D. C., Coryn, C. L. S., Cullen, A., Robertson, K. N., and Alyami, M. Using concept mapping for planning and evaluation of a state-wide energy efficiency initiative. [Target journal: Energy Efficiency].

Presentation: Michigan Saves: Evaluability Assessment and Process Evaluation of an Innovative Energy Program. Presentation given at The Evaluation Center Evaluation Cafe Series at Western Michigan University. [with K. N. Robertson, A. Cullen, and M. Alyami]. Kalamazoo, Michigan. March 29, 2010.

Reports and briefing papers:

• Evaluability Assessment of Michigan Saves! (May 2010).
• Michigan Saves! Cherryland Evaluation Plan (March 2010).
• Michigan Saves! Cherryland Pilot Project Evaluation Report (October 2010).
• Michigan Saves! Management Plan: Status of March 2010.

Milwaukee Mathematics Partnership

Sponsor: University of Wisconsin at Milwaukee
Principal investigator: Dr. Carl Hanssen
Dates: Oct. 1, 2005, to Aug. 31, 2006

The Evaluation Center prepared an external evaluation plan for this project. The plan called for The Evaluation Center staff to collaborate with MMP’s internal evaluator and to coordinate a series of targeted studies designed to examine specific elements of the MMP’s activities. The Milwaukee Math Partnership was one of about 30 math and science partnerships funded by the National Science Foundation. MMP was a five-year, $20 million effort to improve mathematics teaching and learning in the Milwaukee K-20 education system.

Muskegon County Jail Assessment Process

Sponsor: Muskegon County Community Mental Health Services
Principal investigator: Dr. Stephen Magura and Stephanie Evergreen, project manager
Dates: Sept. 1, 2008, to Jan. 31, 2010

This evaluation served two primary purposes:

• To provide an account of the process’ impact on jailing and recidivism rates for persons with mental health or substance abuse problems.
• To provide frequent formative feedback to improve the implementation of the jail assessment process.

Information was gathered through focus groups with the booking staff, screening staff, assessment staff and other key stakeholders. The focus groups took place when the program was implemented, at six months after implementation, and one year after implementation. The impact of the Muskegon County Jail assessment process was assessed regarding jailing rates in general, jailing rates for persons with mental health or substance abuse problems and recidivism rates to determine if the program was effective and should be implemented on a larger scale. Quality of professional development was assessed via surveys. Findings were reported to the Department of Education’s Office of Vocational and Adult Education.

NASA Education Services Program

Sponsor: Oklahoma State University
Principal investigator: Dr. Jerry Horn
Dates: Nov. 1, 2001, to Oct. 31, 2004

The Evaluation Center evaluated the program’s goals, structure and process.

No Disposable Kids

Sponsor: Starr Commonwealth and Kalamazoo Public Schools
Principal investigator: Dr. Gary Miron
Dates: Aug. 1, 2004, to June 30, 2007

The No disposable Kids program was implemented by Starr Commonwealth at six Kalamazoo Public Schools to improve relationships among staff and students and reduce racism and bullying. The center evaluated program implementation and impacts on school climate, student behavior and teacher perceptions.

NRCCTE’s Effectiveness and Performance on GPRA Measures

Sponsor: The National Research Center for Career and Technical Education, University of Louisville
Staff: Dr. Daniela Schroeter, principal investigator; and Dr. Richard Zinser, co-principal investigator
Dates: Aug. 1, 2009, to Feb. 28, 2013

This external evaluation assessed NRCCTE’s effectiveness and performance on the Government Performance and Results Act measures. Research relevance and product quality were assessed via expert panels.

ONEplace at Kalamazoo Public Library

Operation Frontline

Sponsor: Share Our Strength
Principal investigator: Dr. Daniela Schroeter
Dates: Sept. 1, 2008, to April 30, 2009

The Evaluation Center was in the beginning stages of conducting a process evaluation to measure the level of program implementation and developed a monitoring plan for Share Our Strength, the project sponsor. The evaluation team selected for evaluating this project combined utilization-focused and consumer-oriented evaluation models and approaches. Data was gathered through interviews, observations and surveys.

Oral Health Evaluation Plan

Sponsor: Michigan Department of Community Health
Principal investigator: Dr. Liesel Ritchie
Dates: Feb. 15 to Sept. 1, 2007

The Evaluation Center developed a comprehensive evaluation plan for its oral health program. The Department of Community Health provided technical assistance to local health departments and community agencies and coordinated statewide programming around oral health issues such as water fluoridation, tobacco cessation, school-based dental programs and dental care for nursing home residents.

Parental Information and Resource Center

Sponsor: Bay-Arenac Intermediate School District
Principal investigator: Dr. Pamela Zeller and Cheryl Ririe-Kurtz, project manager
Dates: July 1, 2006, to April 30, 2009

This project conducted a comprehensive evaluation of PIRC.

Partnership for Comprehensive Equity

Sponsor: University of Montana
Principal investigator: Dr. Arlen Gullickson
Dates: Aug. 1, 2003, to Aug. 31, 2008

The University of Montana’s Partnership for Comprehensive Equity was an alliance of central administrators, deans, department heads and chairs, and faculty to bring about lasting change in the status and role of women faculty in science and mathematics. The Evaluation Center evaluated the effort, focusing on the extent to which the project’s objectives were met.

Pennsylvania Charter Schools

Sponsor: Pennsylvania Department of Education
Principal investigator: Dr. Gary Miron
Dates: April 12, 2001, to Sept. 30, 2003

The Evaluation Center conducted two separate evaluations for the Pennsylvania Department of Education. In the first phase of work, the staff conducted an initial study that included the first 31 charter schools operating in the state. The purpose of the initial study was to:

• Provide constructive feedback to charter schools to help them implement improvements before the charters came up for renewal.
• Provide feedback to state policymakers so that improvements could be made in the legislative and regulatory framework. Following the initial study, the center conducted a three-year follow-up which encompassed the legislatively mandated summative evaluation. Both quantitative and qualitative data were collected through surveys, interviews, document review, focus groups, direct observation and case studies. Additionally, gains on the state assessment test were analyzed and compared with local districts and comparison schools. Results from the project provided the legislature with information to determine if the charter school movement was meeting its statutory objectives.

Plymouth-Canton Schools

Sponsor: Plymouth-Canton Intermediate School District
Principal investigator: Dr. Pamela Zeller and Cheryl Ririe-Kurtz, project manager
Dates: July 1, 2001, to June 30, 2002

Provide Technical Assistance for the Project Real Education Applications and Learning. A Technology Literacy Challenge Grant.

Project MTS

Sponsor: National Science Foundation
Principal investigator: Dr. Arlen Gullickson
Dates: May 1, 1995  to Dec. 31, 2005

The objectives of Project MTS were to enhance evaluation capacity in the science, mathematics, engineering and technology education communities through materials development, training and support services. An additional goal was to train NSF intern evaluators to directly assist the evaluation needs of other NSF projects and gather information and materials about current science and math evaluation efforts. It was originally aimed at improving the nation’s evaluation capacity in science and mathematics through identification of strengths and weaknesses of current evaluation practices through project metaevaluations; training and direct instruction in evaluation methodology through institutes, conferences and internships; and service to individuals and organizations that conduct evaluations through provision of information and materials. The project has evolved to focus on evaluation techniques for developing useful chains of information and evidence. The persons involved in developing these techniques also served in the project’s training program in the annual summer institute and workshop training sessions at regional conferences and the National Evaluation Institute.

The Government Performance and Results Act mandates that projects funded by the National Science Foundation must establish what results and impact the funding process has yielded. For example, teacher enhancement projects must show that their efforts to improve the quality of teaching did in fact change or improve the ways in which teachers conduct their work. The general strategy being employed to assist evaluators in conducting evaluations that encourage and enable the necessary chains of evidence is called work sample methodology. This technique is a means to collect information and materials (evidence) of teaching and learning practices in ways that are concrete, manageable and directly focus on changes in teaching practices or other matters of direct interest to the project.

Annual three-week institutes were held at The Evaluation Center to provide direct instruction to novice evaluators; assist evaluators with some previous training and experience in evaluation to improve their expertise; and engage collaborating evaluation scholars (those working with the center in the design of new evaluation techniques) to present, refine and pilot test those methods.

Several institute participants were selected each year to serve as interns with the Advanced Technological Education projects. Working plans were formalized to indicate the expectations for the interns and the collaborating ATE project and the intended outcomes for the intern effort.

Workshops helped develop strong evaluation skills among educators engaged in science and math programs and were held in collaboration with three regional laboratories: SERVE, NCREL and PREL. Program sessions for science and math presentations and workshops were also presented at the annual National Evaluation Institute cosponsored by the Consortium for Research on Educational Accountability and Teacher Evaluation and Project MTS.

Research Paper Development

Sponsor: Advantage Performance Group Inc.
Principal investigator: Dr. Daniela Schroeter
Dates: Sept. 1, 2013, to April 30, 2014

This project supported one student in the development of a publishable piece.

USE OF RESTORATIVE PRACTICES TO REDUCE SCHOOL TRUANCY IN MICHIGAN

Rural Systemic Initiative

Sponsor: National Science Foundation
Principal investigator: Dr. Jerry Horn
Dates: April 1, 2001, to Dec. 31, 2004

The Evaluation Center evaluated the National Science Foundation’s Rural Systemic Initiative program, which sought to stimulate system-wide educational reform of science, mathematics and technology in rural, economically disadvantaged regions of the nation. The evaluation operationalized and validated the drivers of educational systemic reform identified by NSF, showed how context influenced the indicator systems and suggested how modifications taking contextual factors into account could make the RSI program successful.

SRSLY STOCKBRIDGE AND SRSLY DEXTER

Strategic Evaluation on Research Excellence

Sponsor: International Development Research Centre
Principal investigators: Dr. Chris Coryn and Dr. Daniela Schroeter (co-principle investigator)
Dates: Jan. 1 to Dec. 31, 2012

The Evaluation Center defined and articulated research excellence, analyzed tools and approaches for potential use in evaluating the research excellence of international development projects, and developed and proposed frameworks and approaches for evaluating research excellence of International Development Research Centre supported research.

SERVE

Sponsor: U.S. Department of Education
Principal investigators: Dr. Arlen Gullickson and Dale Farland, project manager
Dates: Jan. 1, 2001, to Nov. 30, 2005

This project provided external evaluation assistance to assess SERVE’s developmental and accountability needs. Then integrated evaluation activities at SERVE and the SouthEast Initiates Regional Technology in Education Consortium.

Strategic Planning and Implementation, Research and Evaluation

Sponsor: Kamehameha Schools
Principal investigator: Dr. Liesel Ritchie
Dates: April 30, 2007, to June 30, 2007

Success in American Charter Schools

Sponsor: U.S. Department of Education
Principal Investigator: Dr. Gary Miron
Dates: Oct. 1, 2001, to Sept. 30, 2004

This project explored the correlates of Success in American Charter Schools and provided a research base for improvement.

Swift Worksite Assessment and Translation

Sponsor: Center for Disease Control and Prevention
Principal investigator: Dr. Carl Hanssen
Dates: June 1, 2003, to Dec. 15, 2006

This project examined the development of a new methodology called SWAT, intended as a middle ground evaluation strategy to identify worksites with promising practices. The Evaluation Center, in collaboration with Dr. Frances Lawrenz at the University of Minnesota, conducted formative and summative evaluation of the methodology.

Systemic Initiative in Education

Sponsor: The Rapides Foundation
Principal Investigator: Dr. Gary Miron
Dates: Sept. 19, 2005, to Nov. 30, 2010

The Evaluation Center is analyzing the Systemic Initiative in Education in cooperation with the Gordon A. Cain Center at Louisiana State University. The evaluation will continue through September 2010, a year after the initiative has been completed. The evaluation includes a comparison of actual student performance and predicted performance based on demographic and background characteristics—an innovative method referred to as residual gain analysis.

Target Plus

Principal investigator: Dr. Pamela Zeller
Dates: Aug. 1, 2003, to Sept. 30, 2004

This project evaluated Target Plus.

TOOLBOX IMPACT EVALUATION

October 2018 to September 2019

Following the occurrence of two major tragic events in February and June 2016, the Kalamazoo-Battle Creek Resiliency Project was formed to support the impacted survivors, witnesses, first responders, and community members. The Evaluation Center is working with the project to compile feedback regarding the use and utility of the wide array of programming and support efforts that have been developed and funded during the past three years. Results from the survey will be used to gauge how the efforts of the Resiliency Project have helped the community, while also identifying areas of continued need.

Tsunami Hazards

Sponsor: University of Hawaii and the National Science Foundation
Principal investigator: Dr. Liesel Ritchie
Dates: Sept. 1, 2005, to Aug. 31, 2008

This study examined factors that influence the extent to which people prepare for tsunamis and how they respond to different tsunami warnings. Study sites included communities in eight states and territories (Alaska, Washington, Oregon, California, North Carolina, Puerto Rico, Florida and Hawaii). In each community, residents were asked about their experiences, attitudes and knowledge with regard to tsunamis. Findings were used to inform policy decisions and develop and assess tsunami education and awareness programs.

Ujima Evaluations

Sponsor: Ujima Enterprises Incorporated
Principal investigator: Dr. Stephanie Evergreen
Dates: May 2, 2011, to April 21, 2012

Interviews were conducted with the UPAT parent educators to understand the growth they witnessed in the parent participants. UPAT has the benefit of the inclusion of many quantitative instruments that assess parent knowledge gains. Qualitative data resulting from the parent educator interviews complemented the questionnaire data and strengthened the overall findings about parent knowledge produced through UPAT.

Sponsor: CLEAResults Consulting, Inc.
Principal Investigator: Dr. Chris Coryn
January 2019 to December 2019

Urban Core Collaborative

Sponsor: W.K. Kellogg Foundation
Principal investigator: Kelly Robertson
Dates: April 13, 2012, to Oct. 15, 2014

This external evaluation used a developmental evaluation approach to asses the launch and growth of the Urban Core Collaborative, a community-based collaborative funded by the W.K. Kellogg Foundation that is working to increase the capacity of local organizations to enact systemic change throughout neighborhoods of Grand Rapids, Michigan. The evaluation transitioned to an impact assessment to determine the extent to which UCC had increased the capacity of local organizations and cultivated leaders in communities of color. Visit their Facebook page.

Whirlpool

Sponsor: Whirpool Incorporated
Principal investigator: Dr. Liesel Ritchie
Dates: April. 1 to Aug. 31, 2005

This project investigated key drivers for employee engagement.