Study Details | Pathways to Work

3313.3091.03-Study of Indiana Wel

Study quality: High

High

Reason for the rating: This study received a high study quality rating because it is a randomized controlled trial with low attrition, suggesting the findings can be attributed to the program.

Program: Indiana Welfare Reform Initiative

Characteristics of study participants:

Cash assistance recipients, Parents, Public benefits recipients

Services provided:

Case management, Childcare and/or early education, Earned income disregards, Job placement, Job readiness, Job search assistance, Paid work experience/internships, Post-employment participant follow-up, Soft skills training, Transportation assistance, Work supports

Setting: Tested in multiple settings

Methods and Standards Protocol version used for review: Version 1.0

Learn about our protocol

Study design

Design:

Randomized controlled trial

Study group formation:

The study reported findings for two cohorts and two types of households. This review focuses on findings for the early cohort of two-parent families; other reviews on this site focus on findings for the early and late cohorts of single parents, respectively. For the early cohort, evaluators randomly assigned families who had received welfare at some time during the year after the program began (between May 1995 and April 1996) to the Welfare Reform or Traditional Welfare group. Most were welfare clients already on welfare when welfare reform began. Indiana's welfare eligibility computer system assigned clients randomly to groups, and caseworkers informed clients of their assignment. New applicants were randomly assigned at the point that they were determined to be eligible for cash assistance.

Time period of study:

The early cohort includes all two-parent families who received welfare at some point during the first year of the Welfare Reform program, between May 1995 and April 1996. Evaluators measured impacts during the five years after random assignment, between May 1995 and June 2001.

Primary outcome domains examined:

Increase short-term earnings, Increase long-term earnings, Increase short-term employment, Increase long-term employment, Decrease short-term benefit receipt, Decrease long-term benefit receipt

Other outcome domains examined:

None

Study funded by:

The U.S. Department of Health and Human Services, Administration for Children and Families

Results

View table definitions

Scroll to the right to view the rest of the table columns

Outcome domain	Measure	Timing	Study quality by finding	Comparison group mean	Program group mean	Impact	Units	Sample size
Increase short-term earnings	Annual earnings	Year 1	High	6,407.00	6,807.00	400.00	1996 dollars	3,442
Increase long-term earnings	Annual earnings	Year 5	High	11,974.00	13,487.00	1,513.00	2000 dollars	3,442
Increase short-term employment	Either parent ever employed, quarterly	Quarter 4	High	61.00	65.10	4.10	percentage points	3,442
Increase long-term employment	Either parent ever employed, quarterly	Quarter 20	High	60.20	63.90	3.70	percentage points	3,442
Decrease short-term benefit receipt	Amount of AFDC/TANF benefits, annual	Year 1	High	1,627.00	1,521.00	-106.00	1996 dollars	3,444
Decrease short-term benefit receipt	Amount of Food Stamps/SNAP benefits, annual	Year 1	High	2,696.00	2,451.00	-245.00	1996 dollars	3,444
Decrease short-term benefit receipt	Received AFDC/TANF, quarterly	Quarter 4	High	26.80	24.60	-2.20	percentage points	3,444
Decrease short-term benefit receipt	Received Food Stamps/SNAP benefits, quarterly	Quarter 4	High	59.00	51.40	-7.60	percentage points	3,444
Decrease long-term benefit receipt	Amount of AFDC/TANF benefits, annual	Year 5	High	290.00	175.00	-115.00	2000 dollars	3,444
Decrease long-term benefit receipt	Amount of Food Stamps/SNAP benefits, annual	Year 5	High	797.00	654.00	-143.00	2000 dollars	3,444
Decrease long-term benefit receipt	Received AFDC/TANF, quarterly	Quarter 20	High	7.00	6.80	-0.20	percentage points	3,444
Decrease long-term benefit receipt	Received Food Stamps/SNAP benefits, quarterly	Quarter 20	High	22.80	20.50	-2.30	percentage points	3,444

Short-term outcomes are those measured 18 months or fewer after participants are first offered services. Long-term outcomes are those measured between 18 months and 5 years after participants are first offered services. Very long-term outcomes are those measured 5 years or more after participants are first offered services.

Means are not displayed when not reported or not aligned with the impact estimates. For example, if the impact estimate is regression-adjusted but only unadjusted means are reported in the study, the unadjusted means are not displayed as they are not aligned with the adjusted impact estimate.

Impact estimates are not shown when the estimate units cannot be converted to natural units.

Findings quality key:

High
Moderate

Study quality terms?

The findings quality describe our confidence that a given study’s finding is because of the program. We do not display findings that rate low.

Findings key:

A moderate-to-large favorable finding that is unlikely to be due to chance
A moderate-to-large favorable finding that might to be due to chance
A small favorable finding that is unlikely to be due to chance
A small favorable finding that might be due to chance
A favorable finding that is unlikely to be due to chance, but we cannot determine the standardized effect size
A favorable finding that might be due to chance, but we cannot determine the standardized effect size
A moderate-to-large unfavorable finding that is unlikely to be due to chance
A moderate-to-large unfavorable finding that might to be due to chance
A small unfavorable finding that is unlikely to be due to chance
A small unfavorable finding that might be due to chance
An unfavorable finding that is unlikely to be due to chance, but we cannot determine the standardized effect size
An unfavorable finding that might be due to chance, but we cannot determine the standardized effect size
A finding that is unlikely to be due to chance, but we cannot determine the standardized effect size or direction
A finding of no effect that might be due to chance

Favorable findings are impacts in a direction that is socially desirable. Statistical significance indicates the likelihood that a study finding is due to the program, rather than due to chance. Findings are described as moderate-to-large if the program produced a sufficiently large change in the outcome. An impact receives this designation if the standardized effect size is equal to or greater than 0.25 or equal to or less than -0.25.

Sample characteristics

The report did not present detailed characteristics of the evaluation sample of two-parent families, which accounted for about 5 percent of Indiana’s TANF caseload.

Family status

Parents

100%

Employment and public benefit status

Public benefits recipients	100%
Had low incomes	100%
Cash assistance recipients	100%

Program implementation

Implementing organization:

Indiana Family and Social Services Administration

Program history:

The study began at the same time that welfare reform policies were initiated in Indiana.

Program services:

The Welfare Reform group was subject to new welfare reform policies. Members of this group were required to participate in employment and training services that emphasized job search; faced a 24-month time limit on Temporary Assistance for Needy Families (TANF) receipt and a provision that held the TANF grant amount constant if a child was born 10 months or more after the family began receiving TANF; and were required to sign a personal responsibility agreement to obtain immunizations for their children, ensure school attendance, and have minor parents on assistance live at home or with a responsible adult. They could face sanctions if they did not participate in work activities for at least 20 hours per week and if they did not uphold the terms of the personal responsibility agreement. This group could also receive work incentives in the form of continued eligibility for Medicaid, child care subsidies, and other supportive services at higher earnings levels; in addition, a policy required the welfare grant amount to remain constant when earnings increased.

Mandatory services:

A subset of the program group was mandated to work and could be sanctioned for noncompliance.

Comparison services:

The Traditional Welfare group was subject to pre-reform welfare policies. Members of this group were required to participate in work activities but were less likely to be referred to the work component of the state's welfare program. Staff rarely enforced sanctions for noncompliance with work requirements for Traditional Welfare clients. These clients did not face a time limit on TANF receipt or have to sign a personal responsibility agreement.

Service receipt duration:

Clients in the Welfare Reform group could remain enrolled in TANF for up to 24 months, whereas clients in the Traditional Welfare group were not subject to a time limit.

Program funding:

Indiana Family and Social Services Administration.

Study publications

Beecroft, Erik, Kevin Cahill, and Barbara Goodson (2002). The impacts of welfare reform on children: The Indiana Welfare Reform evaluation, Washington, DC: Administration for Children and Families, U.S. Department of Health and Human Services. Available at https://www.acf.hhs.gov/sites/default/files/opre/indiana_welfare_reform.pdf.

Beecroft, Erik, Wang Lee, David Long, Pamela Holcomb, Terri Thompson, Nancy Pindus, Carolyn O'Brien, and Jenny Bernstein (2003). The Indiana Welfare Reform evaluation: Five-year impacts, implementation, costs and benefits, Washington, DC: Administration for Children and Families, U.S. Department of Health and Human Services. Available at https://www.acf.hhs.gov/sites/default/files/opre/indiana_5yr_rpt.pdf.

Fein, David, Erik Beecroft, William Hamilton, Wang Lee, Pamela Holcomb, Terri Thompson, and Caroline Ratcliffe (1998). The Indiana Welfare Reform evaluation: Program implementation and economic impacts after two years, Washington, DC: Office of Planning, Research, and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.

View the glossary for more information about these and other terms used on this page.

Pathways to Work refers to programs by the names used in study reports or manuscripts. Some program names may use language that is not consistent with our style guide, preferences, or the terminology we use to describe populations.

Study of Indiana Welfare Reform Initiative—Early cohort, two parents