return to
Checklists

THE CHECKLISTS DEVELOPMENT CHECKLIST (CDC)
pdf

Daniel L. Stufflebeam
This checklist is intended to provide practical guidance to persons desiring to develop a checklist as a tool for evaluating in a particular area. The guidelines presented are based on the author’s 30+ years’ experience in developing and applying evaluation checklists.  The presented guidelines are divided into 12 main checkpoints, with each further divided into several more specific checkpoints.  At this point in the development of the CDC, no specific scoring procedure is provided or deemed necessary. 

This is the first, very preliminary edition of the CDC.  It is hoped that the presented draft guidelines, even in their primitive form, will be useful to persons needing to develop and apply evaluation checklists.  Of course, the CDC itself needs fuller processing through all the CDC steps.  Users and reviewers of this first draft can facilitate the CDC's further development and validation of the CDC by sending in their criticisms and suggestions to Daniel.Stufflebeam@wmich.edu.  All such input will be appreciated and considered in the further development of the CDC.  The ultimate test of the CDC will be its impact on helping evaluators to develop and employ outstanding checklists.

For supporting definitions and justifications related to the main checkpoint categories, click on the numbered headings. 

1.  Focus the checklist task 
Define the content area of interest
Define the checklist's intended uses 
Reflect on and draw upon pertinent training and experience
Study the relevant literature
Engage and have conversations with experts in the content area
Clarify and justify the criteria to be met by the checklist (e.g., pertinence, comprehensiveness, clarity, concreteness, ease of use, parsimony, applicability to the full range of intended uses, and fairness)
2.  Make a candidate list of checkpoints
List descriptors for well-established criteria of merit
Briefly define each of the initial checkpoints
Add descriptors for checkpoints needed to round out a definition of merit for the content area
Provide definitions for each of the added descriptors
3.  Classify and sort the checkpoints
Write each descriptor and definition on a separate 4" x 6" card
Sort the cards in search of categories
Identify the main candidate categories and label each category
4.  Define and flesh out the categories
Define each category and its key concepts and terms
Write a rationale for each category
Present relevant warnings about being overzealous in applying the checkpoint
Review the checkpoints in each category for inclusiveness, clarity, and parsimony
Add, subtract, and rewrite checkpoints as appropriate
5.  Determine the order of categories
Decide if order is an important consideration regarding the intended uses of the checklist
If so, write a rationale for the preferred order
Provide an ordering of the categories
6.  Obtain initial reviews of the checklist
Prepare a review version of the checklist
Engage potential users to review and critique the checklist
Interview the critics to gain an in-depth understanding of their concerns and suggestions
List the issues in need of attention
7.  Revise the checklist content
Examine and decide how to address the identified issues
Rewrite the checklist content
8.  Delineate and format the checklist to serve the intended uses
Determine with potential users whether category and/or total scores are needed or desired
Determine with users what needs exist regarding differential weighting of categories and/or individual checkpoints
Determine with users any checkpoints or categories of checkpoints that must be passed for a satisfactory score on the overall checklist
Determine with users what needs exist regarding profiling of checklist results
Format the checklist based on the above determinations
9.  Evaluate the checklist
Obtain reviews of the checklist from intended users and relevant experts
Engage intended users to field-test the checklist
Generally, assess whether the checklist meets the requirements of pertinence, comprehensiveness, clarity, applicability to the full range of intended uses, concreteness, parsimony, ease of use, and fairness
10.  Finalize the checklist
Systematically consider and address the review and field-test findings
Print the finalized checklist
11.  Apply and disseminate the checklist
Apply the checklist to its intended use
Make the checklist available via such means as journals, professional papers, web pages, etc.
Invite users to provide feedback to the developer
12.  Periodically review and revise the checklist
Use all available feedback to review and improve the checklist at appropriate intervals
 
This checklist is being provided as a free service to the user. The provider of the checklist has not modified or adapted the checklist to fit the specific needs of the user and the user is executing his or her own discretion and judgment in using the checklist. The provider of the checklist makes no representations or warranties that this checklist is fit for the particular purpose contemplated by user and specifically disclaims any such warranties or representations.