View definitions of terms used throughout Pathways to Work.
E
Effectiveness rating
The assessment of the Pathways to Work Evidence Clearinghouse, based on the existing evidence from impact studies, of the extent to which a given program improves a specific type of outcome. The effectiveness rating indicates whether the program is likely to produce favorable results if faithfully replicated with a similar population. After we review research on a program, we assign effectiveness ratings to indicate how effective the program is at improving each of four types of outcomes: employment, earnings, public benefit receipt, and education and training. The ratings depend on (1) the quality of the impact study or studies conducted of the program and (2) the favorability (or lack thereof), statistical significance, and consistency of the study findings for that type of outcome.
Well-supported. We have strong and consistent evidence that the program produces favorable results for a specific outcome, such as short-term earnings. Well-supported programs have at least two impact studies of moderate or high quality that show evidence of statistically significant and favorable findings within the outcome.
Supported. We have some evidence that the program produces favorable results for a given outcome. Supported programs have at least one study of moderate or high quality that shows evidence of statistically significant and favorable findings within the outcome, but the evidence is less conclusive than that for well-supported programs.
Not supported. We have evidence from impact studies of moderate or high quality that the program is unlikely to improve a given outcome. Studies of these programs have found only a pattern of null and/or unfavorable findings.
Mixed support. We have some evidence from impact studies of moderate or high quality that indicates the program improves a given outcome, and some evidence that indicates it worsens that outcome.
Insufficient evidence to assess support. We have evidence from a single impact study of moderate or high quality that studied the program’s effect on a given outcome, but the effect was not statistically significant.
Cannot assess support. We did not find any studies of moderate or high quality that studied the program’s effect on a given outcome. These programs require further study to support conclusions about their effectiveness.