Study Details | Pathways to Work

3.3094.03-Riverside, Californi

Study quality: High

High

Reason for the rating: This study received a high study quality rating because it is a low-attrition randomized controlled trial with no known issues that suggest the findings cannot be attributed to the intervention.

Intervention: Training Focused Program

Population and employment barriers:

Cash assistance recipients, Employment status and income level (Employed), Parents (Single parents)

Services provided:

Case management, Education, Health services (Substance use disorder treatment and mental health services), Supportive services, Training

Setting: Tested in multiple settings

Study design

Design:

Randomized controlled trial

Study group formation:

Clients who had participated in a Phase 1 (pre-employment) Riverside County Department of Public Social Services (DPSS) program, who also had reported obtaining a job and met a series of eligibility requirements, were eligible for random assignment into Phase 2 (postemployment). These eligibility criteria included working 20 or more hours for at least one week over the past 30 days, earning an hourly wage greater than or equal to the state minimum ($6.75), and an expectation to work an average of 20 or more hours per week for at least 30 days. The evaluation excluded clients who (1) were already enrolled in Phase 2 at the time of random assignment, (2) were New Visions (another evaluation) sample members, and (3) were Post-Assistance Self-Sufficiency members from random assignment. This review focuses on single-parent families, and another review discusses results for two-parent families. Among the people eligible for random assignment, 72 percent were placed in a non-research group, 7 percent were placed in each of the Training Focused and comparison (Work Focused) groups, and 14 percent were placed in the Work Plus group. Sample members were enrolled from January 2001 to October 2003. Participants were eligible for a 12-month survey if they were randomly assigned from October 2001 to December 2002, were 18 years or older at the time of random assignment, and spoke English or Spanish. The survey was administered to a random subset of 911 eligible sample members; 311 in the Work Plus group, 302 in the Training Focused group, and 298 in the Work Focused group. This review focuses on the contrast between Training Focused and Work Focused group members for single parent families. Other reviews on this site examine the contrast of Work Plus and Work Focused as well as of Work Plus and Training Focused and contrasts for two-parent families.

Time period of study:

Random assignment began in January 2001 and concluded in October 2003. Outcome data were collected for four years after random assignment.

Primary outcome domains examined:

Increase short-term earnings, Increase long-term earnings, Increase short-term employment, Increase long-term employment, Decrease short-term benefit receipt, Decrease long-term benefit receipt

Other outcome domains examined:

None

Study funded by:

The Office of Planning, Research, and Evaluation in ACF at the U.S. Department of Health and Human Services funded the study, with support from the U.S. Department of Labor.

Results

View table help Need more context or definitions for the table below? View the table help to get insight into terms, measures, and definitions.

Scroll to the right to view the rest of the table columns

Outcome domain	Measure	Timing	Study quality by finding	Comparison group mean	Intervention group mean	Impact	Units	Sample size
Increase short-term earnings	Annual earnings	Year 1	High	8,344.00	8,080.00	-264.00	2002 dollars	1,497
Increase short-term earnings	Weekly earnings	12 months	High	200.00	190.00	-10.00	2002 dollars	475
Increase long-term earnings	Annual earnings	Year 4	High	9,736.00	9,958.00	222.00	2005 dollars	1,497
Increase short-term employment	Currently employed	12 months	High	63.00	58.80	-4.20	percentage points	475
Increase short-term employment	Employed for four consecutive quarters	Year 1	High	51.90	47.30	-4.60	percentage points	1,497
Increase short-term employment	Ever employed, annual	Year 1	High	89.50	87.30	-2.20	percentage points	1,497
Increase long-term employment	Employed for four consecutive quarters	Year 4	High	42.80	43.30	0.50	percentage points	1,497
Increase long-term employment	Ever employed, annual	Year 4	High	69.30	70.50	1.20	percentage points	1,497
Decrease short-term benefit receipt	Amount of AFDC/TANF benefits, annual	Year 1	High	3,079.00	3,271.00	192.00	2002 dollars	1,441
Decrease short-term benefit receipt	Amount of food stamps/SNAP benefits, follow-up period	Year 1	High	1,393.00	1,428.00	35.00	2002 dollars	1,441
Decrease short-term benefit receipt	Received AFDC/TANF, annual	12 months	High	42.40	40.60	-1.80	percentage points	475
Decrease short-term benefit receipt	Received AFDC/TANF, annual	Year 1	High	84.10	86.60	2.50	percentage points	1,497
Decrease short-term benefit receipt	Received any public assistance benefits, annual	12 months	High	61.90	60.30	-1.60	percentage points	475
Decrease short-term benefit receipt	Received food stamps/SNAP, annual	Year 1	High	80.30	81.70	1.40	percentage points	1,497
Decrease short-term benefit receipt	Received food stamps/SNAP, annual	12 months	High	51.30	50.10	-1.20	percentage points	475
Decrease short-term benefit receipt	Received SSI or disability income, annual	12 months	High	16.30	12.70	-3.60	percentage points	475
Decrease long-term benefit receipt	Average annual AFDC/TANF received, follow-up period	Years 1-4	High	2,020.00	2,195.00	175.00	2004 dollars	1,497
Decrease long-term benefit receipt	Average annual food stamps/SNAP received, follow-up period	Years 1-4	High	1,205.00	1,235.00	30.00	2004 dollars	1,497
Decrease long-term benefit receipt	Received AFDC/TANF, annual	Year 4	High	29.00	29.60	0.60	percentage points	1,497
Decrease long-term benefit receipt	Received food stamps/SNAP, annual	Year 4	High	37.30	37.70	0.40	percentage points	1,497

Short-term outcomes are those measured 18 months or fewer after participants are first offered services. Long-term outcomes are those measured between 18 months and 5 years after participants are first offered services. Very long-term outcomes are those measured 5 years or more after participants are first offered services.

Findings quality key:

High
Moderate

Study quality terms?

The findings quality describe our confidence that a given study’s finding is because of the intervention. We do not display findings that rate low.

Findings key:

A moderate-to-large favorable finding that is unlikely to be due to chance
A moderate-to-large favorable finding that might to be due to chance
A small favorable finding that is unlikely to be due to chance
A small favorable finding that might be due to chance
A favorable finding that is unlikely to be due to chance, but we cannot determine the standardized effect size
A favorable finding that might be due to chance, but we cannot determine the standardized effect size
A moderate-to-large unfavorable finding that is unlikely to be due to chance
A moderate-to-large unfavorable finding that might to be due to chance
A small unfavorable finding that is unlikely to be due to chance
A small unfavorable finding that might be due to chance
An unfavorable finding that is unlikely to be due to chance, but we cannot determine the standardized effect size
An unfavorable finding that might be due to chance, but we cannot determine the standardized effect size
A finding that is unlikely to be due to chance, but we cannot determine the standardized effect size or direction
A finding of no effect that might be due to chance

Favorable findings are impacts in a direction that is socially desirable. Statistical significance indicates the likelihood that a study finding is due to the intervention, rather than due to chance. Findings are described as moderate-to-large if the intervention produced a sufficiently large change in the outcome. An impact receives this designation if the standardized effect size is equal to or greater than 0.25 or equal to or less than -0.25.

Sample characteristics

Clients were single-parent recipients of TANF benefits who worked 20 or more hours a week but earned too little to leave public assistance. Across the Work Plus, Work Focused, and Training Focused groups, and among those randomly assigned from January 2001 to September 2003, clients were predominantly female (92 percent). The average age was 30 years, and 42 percent lacked a high school diploma or equivalent. Almost half (45 percent) were Hispanic, 21 percent were Black, and 31 percent were White.

Age

Mean age

30 years

Sex

Female	92%
Male	8%

Participant race and ethnicity

Black or African American	20%
White, not Hispanic	31%
Asian	2%
American Indian or Alaska Native	1%
Hispanic or Latino of any race	45%

The race and ethnicity categories may sum to more than 100 percent if the authors reported race and ethnicity separately; in these cases, we report the category White, rather than White, not Hispanic.

Family status

Parents	100%
Single parents	100%

Participant employment and public benefit status

Were employed	100%
Were eligible for or receiving cash assistance	100%

Participant education

Had some postsecondary education	7%
Had a high school diploma or GED	58%
Did not have a high school diploma or GED	42%

Intervention implementation

Implementing organization:

The Training Focused condition was implemented by the Riverside County Economic Development Agency (workforce development agency) in California.

Program history:

In 1998, DPSS created a postemployment program focused on encouraging clients to attend training or education courses outside of work. In subsequent years, DPSS staff worked with education and training providers to create variations of the this postemployment program (one of which is Training Focused). The Training Focused program started in September 2000.

Intervention services:

Training Focused Program clients could receive intensive case management and enhanced support services, aimed at encouraging employment stability. To continue to receive benefits, participants were required to engage in employment-related activities for 32 hours per week. Program staff allowed Training Focused participants to decrease work hours per week to zero hours to pursue education and training activities, with the philosophy that eliminating the requirement to engage in work would allow participants to access the most useful education and training programs. Participation in education and training was voluntary, but if participants chose not to pursue education and training, they were required to participate in other permitted activities—including work—for at least 32 hours per week. The program also provided clients with support services (for example, child care, transportation, and ancillary payments to participate in program activities), social services (for example, mental health, domestic violence, and substance abuse), referrals to public assistance programs (for example, TANF, Food Stamps, and Medi-Cal), and job search services.

Mandatory services:

Participants had to meet requirements for hours of work or other authorized activities per week; otherwise, they could be sanctioned.

Comparison services:

The comparison condition was known as Work Focused. Clients in this condition were eligible to receive TANF, Food Stamps, child care and transportation assistance (only if the client self-enrolled in an eligible program), and Medi-Cal. They also received limited and reactive case management.

Service receipt duration:

The authors did not explicitly state how long a typical participant received Training Focused services, but eligibility ended when a client left TANF (most did so within one year of random assignment). Long-term vocational training courses could last up to two years.

Intervention funding:

U.S. Department of Health and Human Services; U.S. Department of Labor.

Study publications

Bloom, Dan, Richard Hendra, Karin Martinson, and Susan Scrivener (2005). The Employment Retention and Advancement Project: Early results from four sites, Washington, DC: Office of Planning, Research, and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [Training Focused—Riverside, CA.] Available at https://www.acf.hhs.gov/sites/default/files/opre/early_results.pdf.

Hendra, Richard, Keri-Nicole Dillman, Gayle Hamilton, Erika Lundquist, Karin Martinson, Melissa Wavelet, Aaron Hill, and Sonya Williams (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase Employment Retention and Advancement? Final impacts for twelve models, Washington, DC: Office of Planning, Research, and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [Training Focused—Riverside, California.] Available at https://www.acf.hhs.gov/opre/resource/the-employment-retention-and-advancement-project-how-effective-are.

Navarro, David, Stephen Freedman, and Gayle Hamilton (2007). The Employment Retention and Advancement project: Results from two education and training models for employed welfare recipients in Riverside, California, Washington, DC: Office of Planning, Research, and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [Training-Focused.] Available at https://www.acf.hhs.gov/sites/default/files/opre/riverside_phase2.pdf.

View the glossary for more information about these and other terms used on this page.

The Pathways Clearinghouse refers to interventions by the names used in study reports or manuscripts. Some intervention names may use language that is not consistent with our style guide, preferences, or the terminology we use to describe populations.

Study of Training Focused Program—Single Parents