Performance Accountability, Eligible Training Providers, LMI, & Evaluation Regulations

This report focuses on implementation of changes to requirements on performance accountability, ETPs, LMI, and evaluation research under WIOA. Findings in the report are based primarily on site visit interviews conducted in early 2019 with administrators, workforce boards, and front-line staff in 14 states and 28 local areas, and addressed the significant changes to the Act. Specifically, the law:

• Creates six new, common performance indicators for the six core programs, including a new indicator on programs’ effectiveness in serving employers.
• Requires all six core programs to collect data using a standardized set of data elements.
• Requires the development of a statistical adjustment model (SAM) to be used for developing negotiated state and local performance goals.
• Requires ETPs—whose training programs have met state criteria to receive funds from Title I individual training accounts—to submit performance information for all of their participants, not just Title I participants.
• Requires states to submit annual reports on ETP program performance.
• Requires the use of labor market information to inform state and regional plans and identify in demand occupations to support ETP eligibility determinations, and for LMI to be available for program participants.
• Emphasizes integrated reporting systems.
• Strengthens requirements for states to conduct evaluations of activities under Title I core programs.

The researchers highlighted the following findings organized by performance accountability topics.
Primary indicators of performance for core programs:

Some respondents reported credential attainment was relatively easy to implement while others described it as challenging.

• States and local areas reported having many questions about the range of ways to assess and record measurable skill gains (MSGs).
• Effectiveness in serving employers was viewed as particularly challenging to measure fairly.

Negotiating performance targets for indicators using the statistical adjustment model:

• Concerns about perceived expectations for higher performance targets under WIOA vs. the Workforce Innovation Act (WIA).
• States desired assistance with adapting the (SAM) for use with local area negotiations: Use of the Participant Individual Record Layout (PIRL) and Workforce Integrated Performance System (WIPS) by Titles I and III programs.
• Respondents described updating state administrative data systems to meet the requirements of PIRL and WIPS as challenging.
• Some respondents expressed concerns about the amount of new data required from some customers in order for the state to submit complete records.

Integrated reporting across WIOA core programs:

• Some core programs used shared management information systems.
• States initiated some efforts to start or increase data sharing across the core programs.

Key Findings on ETP, LMI, and evaluations:

• ETP requirements: Many respondents reported that training providers’ inability to provide the required data caused the number of programs on their ETP lists to decrease.
• Collection and use of LMI. Under WIOA, state and local access to and use of LMI expanded.
• Evaluation requirement. States reported several challenges in conducting evaluations: lack of staff capacity; insufficient financial resources; and lack of clarity about the evaluation requirement.

The researchers offer the following recommendations:

• Develop a stronger understanding of Credential Attainment and MSG indicators.
• Provide continued support to adapt the federal level SAM for negotiations with local workforce development boards.
• Develop a stronger understanding of the importance, legality, and best practices for collecting and reporting on new PIRL data elements related to disability.
• Leverage effective strategies and best practices for sharing data across different systems.
• Develop a stronger understanding of WIOA’s evaluation requirements.

• Last Updated:
• Created:
• Resource Publication Date: 2020
• Author(s): Mack, M.; Dunham, K.
• Funding Source: U.S. Department of Labor, Employment and Training Administration
• Resource Availability: Publicly available
• Posted by: Wesley Peterson
• Posted in: Workforce System Strategies