Skip to Page Content
Home  |  Contact Us  |  Press Room  |  Site Overview  |  Help  |  Login  |  Register
Add to MyNCSL
NLPES Site Map

2002 NLPES Fall Training Conference Notes

  
AZ backdrop
The Changing Climate of Evaluation: Responding to Demands
September 18-21, 2002
Phoenix/Scottsdale, Arizona
Hosted by the Arizona Office of The Auditor General

 Co-sponsored by the
Arizona Evaluation Network
(an affiliate of the American Evaluation Association)

   

 
Wednesday, September 18

Award-Winning Reports
Representatives of states that won this year’s two major NLPES awards will describe their award winning projects.

Moderator:
Martha Carter NE

Speakers:
Kate Wade, WI
Wisconsin Works (W-2) Program

Mike Clark , KY
An Analysis of Kentucky's Prevailing Wage Laws and Procedures

Thursday, September 19th

Keynote Address: Deborah Merritt
Evaluation is essential to effective government programs.  High quality program evaluation shows legislators how to spend tax dollars efficiently, how to improve citizen well-being, and how to avoid unwanted outcomes of public policies.  Ms. Merritt’s topic “Reconnecting Government and Citizens Through Evaluation” will review Americans’ increasing dissatisfaction with traditional forms of political participation and describe how program evaluation can hold the key to reengaging Americans with their government.

Introduction:
Debbie Davenport, Arizona Auditor General

Speaker:
Deborah Merritt, Director of the John Glenn Institute for Public Service and Public Policy at Ohio State University

Database Workshop
Information Technology System experts will discuss the process for requesting and using agency data from initial assessment to data analysis.
Co-Instructors:
Maureen Tonn, AZ

John Curran, KS

Roundtable: The State and Federal Budget Crisis
A facilitator will guide participants as they explore how the current budget crisis affects their own agencies and the agencies they audit or evaluate, and share the strategies they have developed to cope with the challenges.
Facilitator:
Martha Carter, NE
Effective Reviewing
Participants will learn techniques for reviewing report drafts and providing feedback in a manner that helps new writers to develop their skills.
Co-Instructors:
Wade Melton, FL

Tim Osterstock, UT

AzENet Workshop: Methods for Evaluating Behavioral Health Programs
Workshop on design and methods focusing on two current evaluation efforts at Arizona’s Division of Behavioral Health Services.  State officials will discuss overall design and methods issues and regional contractor evaluation staff will discuss how they are measuring success at the program level.  Methods to be discussed may include baseline/time series studies; fidelity assessment; surveys; focus groups; penetration studies; and some of the challenges associated with measuring a variety of outcomes.
Moderator:
Lois Sayrs, Methodologist, AZ Office of the Auditor General

Panelists:
Mike Franczak, AZ Div. of Behavioral Health Services

Bernadette Phelan, AZ Div. of Behavioral Health Services

Michael Funk, Northern AZ Regional Behavioral Health Authority

Michael Berren, Community Partnership of Southern Arizona

Karen Tiggs, AZ, ValueOptions

Evolving Social Welfare Policy
This session will examine recent changes in social welfare policy, such as efforts to encourage marriage and move welfare recipients into the workforce.  Panelists will also discuss their states’ experience in attempting to build community capacity and respond to changing demographics.  In addition, panelists will discuss how these changes have affected their audits/evaluations of social service agencies and programs.
Moderator:
Kathy Snider, SC

Panelists:
Joshua Smith, WI

Drucilla Carpenter, FL

John Patterson, MN

Using the Web and Email to Get the Message Out
This session will explore how states are using the power of the Internet and email to expand their audience, and bridge the gap between auditors/evaluators and citizens as well as more traditional audiences for our products.
Moderator:
Joel Alter, MN

Panelists:
Randy Roberts, AZ

Kent Hutchinson, FL

Craig Kinton, TX

AzENet Methods Workshop Part 2
 

Changing Expectations and Demands
Several trends in governing (covered in a Friday morning session) are placing changing demands on program evaluation/audit organizations.  These include the need to respond to increasingly frequent legislative requests to investigate specific issues within drastically reduced timeframes, and legislative expectations to identify and quantify cost savings during projects.  At the same time, evaluation offices have not escaped cuts from the budget shortfalls affecting many states, resulting in the need to do more with less.  This panel will explore how offices are coping with these changing and increasing demands, strategies they are developing for producing new types of products, and lessons learned.

Moderator:
Gary VanLandingham, FL

Panelists:
Greg Rest, VA

Jane Thesing, SC

Legislative Perspectives on Audits/Evaluations
A panel of legislators will discuss their perspective on performance audits and program evaluations.  What do they look for in our reports, and how can we communicate our message to them most effectively?  When we meet with them to discuss their concerns or brief them on our findings, how do they like to interact with us?  And how useful are our presentations in legislative hearings?
Moderator:
Heather Moritz, CO

Panelists:
Senator Altamirano, NM

Representative Voss, AZ

Senator Smith, AZ

Senator Campos, NM

Friday, September 20th

Plenary Session: Michael Quinn Patton
War Games - Thinking Strategically in Evaluation.  Dr. Patton will introduce what it means to think strategically by using military battle plan development as a model.  He’ll describe how to develop a strategic framework for legislative program evaluation even when program missions are ambiguous, and discuss ways to use recent research on cognition to help frame information so it is most meaningful to evaluation report users.

Introduction:
Carol Cullen, AZ

Speaker:
Michael Quinn Patton, Consultant, Independent Organizational Development and Evaluation

Crosscutting  Issues
This session will focus on evaluations that cut across agency lines, such as statewide procurement, behavioral health services, and health care regulation.  Panelists will discuss policy implications, issue selection, and the challenges of working with several agencies at once.
Moderator:
Jane Thesing, SC

Panelists:
Ned Parrish, ID

Gary Brown, MI

Jane Bailey, NV

Emerging Issues in Governing
From think tanks bombarding legislators with propaganda to the continuing changes demanded by balanced budget requirements, prescription drug needs, and welfare reform, states are facing a number of issues as we approach the 2003 legislative session.  Learn what forces and issues may shape legislative activity and our own work in the coming year.  Panelists will discuss emerging and evolving policy concerns that face their states, as well as important changes in the policy making environment that affect evaluators and auditors.
Moderator:
Max Arinder, MS

Panelists:
Gary VanLandingham, FL

Craig Kinton, TX

Sherry Hayashi, HI

Brian Armentrout, WV

Delivering the Message to the Agency
This session will focus on effective ways to work with agencies throughout the audit and report-delivery process.
Moderator:
Shan Hays, AZ

Panelists:
Phil Durgin, PA

Lisa Eddy, AZ

Terry Stewart, Director, AZ Dept of Corrections

Cathy Eden, Director, AZ Dept of Health Services

Saturday, September 21th

Measuring Outcomes and Agency Effectiveness
This session will present information on how performance auditors/evaluators have responded to legislative demands to know what programs are actually accomplishing.  Using case examples from their own work, panelists will discuss constraints and barriers faced, how they decided which issues to pursue, and the nuts and bolts of planning and implementing the audit/evaluation.

Moderator:
Manu Patel, NM

Panelists:
Ron Sissel, NM

Gerald Hoppman, KY

Cathleen Akers, AZ

Privatization: Where are we now?
The goal of privatization is to allow private businesses to provide services and products in partnership with government to make government more efficient and cost-effective.  Has this initiative stalled?  Explore the current status of privatization and states’ experiences.  Panelists will also discuss approaches to auditing and evaluating agency privatization efforts.
Moderator:
James Barber, MS

Panelists:
Heather Moritz, CO

Gary VanLandingham, FL

Leo Hafner, KS

Larry Whiting, MS

Using Graphics to Tell the Story
This session will focus on using graphics to maximize the effectiveness of the report.  An expert will discuss how to select the most appropriate graphical presentation, when to use and when not to use graphics, and how to ensure your graphics convey the message you want to send.
Introduction:
Natalie Coombs, AZ

Speakers:
Jay Thurston, Art Director, Bold Impressions

Roundtable: Lessons Learned from Performance Measurement Systems
This session will focus on what participants and their states have learned over time from using accountability systems, such as benchmarking or performance based budgeting, to assess agency performance.  Topics of discussion will include implications of ambitious performance objectives, the impact of external factors (e.g. the economy) on agency performance.
Facilitator:
Judy Zelio, CO
Evaluating Sacred Cows
Do sports facilities create an economic boom?  Does DARE reduce drug use?  Discuss the risks and challenges of evaluating popular programs with powerful supporters.  From university athletic programs to welfare-to-work programs, learn how to make a strong case for change when perceptions may not be reality
Moderator:
Kate Wade, WI

Panelists:
Dot Reinhard, AZ

Dave Greer, LA

The Competing Needs of Media and Evaluators: Panel Discussion
In this session, panelists will discuss the inherent conflicts as well as common interests between the news media and the legislative program evaluation agency.  They will explore how confidentiality affects agencies’ ability to work effectively with the media, and the way deadlines and competing priorities affect news coverage of our findings.  Conference attendees will be invited to submit written questions in advance for the panelists to address.
Moderator:
Ken Levine, TX

Panelists:
Bill Thompson, AZ

Sabrina Hartley, FL

Richard de Uriarte, AZ Republic Newspaper

Mark Flatten, AZ East Valley Tribune

Paul Atkinson, KAET TV

cactus

Visitor counts for this page.