Resource Evidence-Based Policymaking Scan Highlights

Agree Upon and Codify Standards and Terms Used to Describe Evidence

Having clear definitions for evidence-based policymaking terms provides a framework for making budget decisions based on program effectiveness. As described in the EBP scan, some states (Colorado and Mississippi) have defined terms in legislation, while others (Minnesota, New York and North Carolina) have defined evidence terms through less formal approaches. For example, Minnesota Management and Budget’s “What is Evidence?” webpage defines evidence and qualifying evaluations, and links to the department’s evaluation policy.

Build Consensus Across Branches of Government.

To engage stakeholders and facilitate buy-in among legislative and executive branch stakeholders, some states have established cross-branch offices or advisory groups to identify priority areas for evidence-based reforms and to evaluate the performance of state programs and investments. For example:

• Alabama lawmakers passed legislation in 2019 to create a Commission on the Evaluation of Services. Co-chaired by executive and legislative branch leaders, the commission evaluates state services and advises the legislature and governor on program evaluation and resource allocation.
• In 2018, North Carolina Governor Roy Cooper created the Advisory Committee on Performance Management. Comprised of government employees, legislators and outside experts, the committee is tasked with advising the governor on new performance management initiatives and legislation, and strategies for increasing evidence-based policy efforts.
• The Legislative Finance Committee in New Mexico launched a "LegisStat" initiative to engage legislative leadership and state agencies in ongoing, data-driven performance reviews.

Commit Resources to Generating and Using Quality Data and Research.

States have taken steps to improve access to reliable data, share data across state agencies and increase staff capacity to analyze and distill meaningful data for policymakers. Among these steps, some have established a centralized and nonpartisan staff or government unit with knowledge about research methods and evidence-based budgeting, while others have created and funded positions, such as chief data officers. For example:

• In 2019, Arkansas lawmakers created the Data-Sharing and Data-Driven Decision-Making Task Force, comprised of legislator members, and created a chief data officer position. 
• Connecticut lawmakers in 2018 created the Data Analysis Technology Advisory Board and established the position of Chief Data office within the Office of Policy and Management.
• Iowa lawmakers in 2019 appropriated funds to the Office of the Chief Information Officer to develop a dashboard that serves as single source of agency performance measures. Agencies post departmental performance plans and strategic plans along with other state data.
• Minnesota’s 2022 budget funds impact evaluations for opiate epidemic response grants.
• Established in 2019, Tennessee’s Office of Evidence and Impact uses data to inform decision-makers.

Direct Resources to Programs, Policies and Practices That Are Backed By Research—and Encourage Promising Ones to Build a Research Base.

Several states have developed tiered grant programs (Colorado, New York and North Carolina), an evidence continuum (Colorado, Tennessee, and Minnesota as discussed above) or other frameworks that give preference to programs with strong evidence while also providing an opportunity for new or untested programs to develop research that demonstrates their results. For example:

• Colorado’s evidence continuum and Tennessee’s Office of Evidence and Impact’s evidence framework provides a process for describing the evidence supporting a program currently, and how a program can move along the continuum with evaluation and implementation support.
• In 2021, the North Carolina General Assembly created a $500,000 grant program state agencies can use to conduct research to inform policy and program decisions or to partner with the Office of State Budget and Management or a third party to evaluate program success. 

In recent months, some states have allocated, or announced plans to allocate, ARPA funds to evaluate programs. For example, Connecticut’s state recovery plan specifies that the state’s evidence-building strategy will support the allocation of resources for evaluation and data analysis.

Embed Evidence Into State Budgeting Processes and Decisions.

For decades, states have enacted policies that incorporate evidence and performance information into the budgeting process. For example, since 1983, the Washington State Institute for Public Policy, a nonpartisan public research group, has conducted policy research for the state legislature. The institute works with legislators, legislative and state agency staff, and policy experts to ensure that studies answer pertinent policy questions. 

States continue to implement evidence-based budgeting practices, including use of evidence guidelines, to share critical information with policymakers about a program’s effectiveness and to improve procedures for prioritizing funds. For example: 

• In 2021, Colorado lawmakers passed SB 284, which requires agencies and the Office of State Planning and Budgeting to use consistent evidence definitions in budget requests. The legislation appropriated funds to add legislative staff to review agency budget proposals and established procedures to incorporate evidence-based research into the state budget process. 

• In 2021, Minnesota lawmakers required agencies to include performance data in budget proposals. New and increased funding proposals must present proposed performance measures that can be used to assess if the funding accomplishes its goals. 
• Rhode Island’s evidence guidelines integrate an evidence scale ranking into the budget process, and points to clearinghouse tools, such as the Pew Results First Clearinghouse and Social Programs That Work, for determining whether the initiative has been rigorously evaluated. 
• In 2021, Utah lawmakers passed HB 326 which requires the Office of the Legislative Fiscal Analyst and the Governor’s Office of Budget and Planning to develop performance standards and recommend them as part of the state budget for the legislature’s approval.
• In 2014, Mississippi lawmakers passed HB 677 which requires agencies to measure all of their programs on an evidence scale as part of the budget process. They recommend consulting with guidelines from the Washington State Institute for Public Policy.

Foster a Culture of Continued Learning.

By clearly defining terms, engaging stakeholders, and embedding evidence into the policy and budget process, state leaders are taking steps to build a culture of evidence and continued learning. Tennessee’s Office of Evidence and Impact was created to foster “a culture of data and evidence-based policymaking and budgeting,” a mission it seeks to accomplish through evidence-based budgeting, a program inventory, and enterprise data analytics.

Other state efforts focus on delivering evidence training for legislative and executive branch stakeholders. For example, North Carolina’s Office of Strategic Partnerships, housed in the Office of State Budget and Management, hosts “Monthly Connects,” a series of virtual panel discussions on a range of topics, such as strategies for building equity into partnerships. 

Garner Support Through Clear Communication and Messaging.

States have taken a variety of steps, including development of real-time dashboards and agency report cards, to ensure that research findings are accessible and meaningful to policymakers and address key policy objectives. 

• The District of Columbia registered a pre-analysis plan for evaluating its police body-worn camera program and presented the plan for feedback across a diverse set of public meetings and with an interactive website designed for lay audiences
• Minnesota Management and Budget’s inventory of programs assigns color-coded ratings of effectiveness for over 400 publicly funded programs and services. Users can filter data by area of interest (e.g., criminal justice or early childhood), outcome measured, population and rating type (e.g., proven effective, promising and theory-based).
• New Mexico’s Legislative Finance Committee created a dashboard report and agency report cards  to synthesize performance data and facilitate focused discussions on evidence-based initiatives.