| Participants |
| 1* | Participants were described with sufficient detail to allow others to select individuals with similar characteristic [Age, disability, gender et al.] |
| 2* | The process for selecting participants was described with replicable precision. |
| Setting |
| 3* | Critical features of the physical setting were described with sufficient precision to allow replication. |
| Dependent Variable/Measure |
| 4* | All dependent variables were described with operational precision. |
| 5* | Each dependent variable was measured with a procedure that generates a quantifiable index. |
| 6* | The measurement process was described with replicable precision. |
| 7* | Dependent variables were measured repeatedly over time. |
| 8* | Data were collected on the reliability or inter-observer agreement (IOA) associated with each dependent variable, and IOA levels met minimal standards (e.g., IOA = 80%; Kappa = 60%). |
| Independent Variable/ Intervention |
| 9* | Independent variable was described with replicable precision. |
| 10* | Independent variable was systematically manipulated and under the control of the experimenter. |
| 11* | Overt measurement of the fidelity of implementation for independent variable. |
| Procedures |
| 12* | A baseline phase provided repeated measurement of a dependent variable and established a pattern of responding that can be used to predict the pattern of future performance, if introduction or manipulation of the independent variable did not occur. |
| 13* | The procedural characteristics of the baseline conditions were described with replicable precision. |
| Design/Graph/Results |
| 14* | The design provides at least three demonstrations of experimental effect at different points in time. |
| 15* | The design controls for common threats to internal validity (e.g., permits elimination of rival hypotheses). |
| 16* | Experimental effects were replicated across participants, settings, or materials to establish external validity. |
| Social Validity |
| 17 | The dependent variable is socially important. |
| 18 | The magnitude of change in the dependent variables resulting from the intervention is measured as socially important. |
| 19 | Implementation of the independent variable was described by author as practical and cost effective. |
| 20 | Social validity is enhanced by implementation of the independent variable over extended time periods, by typical intervention agents, in typical physical and social contexts. |
| Overall Quality DeterminationHigh Quality (Must meet all 20 indicators), AccepTable Quality (Must meet Indicators 1-16 and at least one of 17-20), Did not Meet Quality |