RE-AIM Scoring Instrument

Each item listed below is scored "Yes" if the information necessary to answer the item was reported in the main outcome study (or studies). If the information was not reported, the item is scored "No." Some items may be scored "N/A" (not applicable) if the item does not pertain to the design of the study.

Dimensions Items
Reach
Reach refers to the absolute number, proportion, and representativeness of individuals who are willing to participate in a given initiative, intervention, or program
Exclusion Criteria (percentage and characteristics) 1) How many potential participants were approached?
2) How many participants were deemed ineligible to participate?
3) Of the participants meeting selection criteria, how many participants actually participated?
Percentage on the Valid Denominator 4) Was the percentage of all eligible invited participants who accepted participation reported? If not, can the percentage be calculated?
Characteristics of Participants Compared With Nonparticipants 5) Were the characteristics of those subjects choosing to participate and those unwilling to participate described? If yes, what was the representativeness of those who participated versus those who did not? Comparisons can be made with either nonparticipants or available resource data.
Effectiveness
Effectiveness refers to the impact of an intervention on important outcomes, including potential negative effects, quality of life, and economic outcomes.
Measure of the Effect Size 6) Were effect sizes for significant outcomes provided or can they be calculated?
Measure of Quality of Life or Potential Negative Outcome 7) Were there any qualitative or quantitative measures of quality of life or potential negative outcome?
Measure of Robustness Across Subgroups 8) Were any within-groups analyses conducted that allowed researchers to draw conclusions about how different subpopulations responded to an arm of the design?
Adoption
Adoption refers to the absolute number, proportion, and representativeness of settings and intervention agents (people who deliver the program) who are willing to initiate a program.
Setting Exclusion (percentage and reasons) 9) How many settings in a given population were actually qualified to host the intervention?
10) Among the settings that were approached about hosting the intervention, how many settings were interested in participating?
11) How many settings were not appropriate for the study?
12) How many settings met criteria and chose to participate?
Percentage of Settings Approached (Valid Denominator) 13) What percentage of the total number of available settings actually participated?
Characteristics of Participating Settings Compared With Nonparticipating Settings 14) Were the characteristics of those settings choosing to participate and those unwilling to participate described? If yes, what was the representativeness of those that participated versus those that did not? Comparisons can be made with either nonparticipating settings or available resource data.
Implementation
At the setting level, implementation refers to the intervention agents' fidelity to the various elements of an intervention's protocol, including consistency of delivery as intended and the time and cost of the intervention. At the individual level, implementation refers to clients' use of the intervention strategies.
Percent of Perfect Delivery
(Implementation Fidelity)
15) Were there measures (preferably statistical but also observational) indicating that Agent A and Agent B delivered the same amount/type of intervention?
16) Were the methods of intervention delivery described?
17) Were there any measures of the actual number of intervention pieces that were delivered (e.g., an average or percentage)?
Adaptation 18) Was the intervention changed or modified in any way during the course of the study?
Cost of Intervention 19) Was any information provided on the total time commitment required to implement the intervention?
20) Was any information provided on the type of staff needed to implement the intervention?
21) Was any information provided on the cost of the intervention? Was information provided on the actual or estimated cost difference between the intervention and the control condition?
22) Was any cost-effectiveness or cost-benefit analysis done to determine the economic soundness of the intervention?
Last Modified: 09/04/2013