2018 NLPES PDS Preliminary Agenda

9/14/2018

LouisianaJazz Up Your Evaluation Skills
Sept. 9-12, 2018 | New Orleans, La.

Each fall, the National Legislative Program Evaluation Society (NLPES) sponsors a national training seminar designed exclusively for state legislative staff who work in program evaluation. The meeting offers professional development opportunities for program evaluators at all skill levels. The Louisiana Legislative Auditor hosted this year's seminar.

Location: Hotel Monteleone, New Orleans, La.

All meetings were held at the Hotel Monteleone unless otherwise indicated. To request a copy of a PowerPoint presentation or handout from any session held during the 2018 conference, please contact Brenda Erickson, the NCSL liaison to NLPES.

 

sunDay, Sept. 9
Time Sessions

8:30 a.m.-4 p.m.

NLPES Executive Committee Meeting
Hotel Monteleone, Second Floor—Orleans D

 

Presiding: Shunti Taylor, Georgia Department of Audits and Accounts and Incoming NLPES Chair

5-7 p.m.

Registration/Information Desk

Hotel Monteleone, Mezzanine Level—Queen Anne Mezzanine

Evening Optional "Dutch-treat" Tours or Dinner on Your Own
monDay, sept. 10
7:30 a.m.-4:30 p.m.

Registration/Information Desk  

Hotel Monteleone, Mezzanine Level—Queen Anne Mezzanine
8:30-8:45 a.m.

Welcome 
Hotel Monteleone, Mezzanine Level—Queen Anne Ballroom & Parlor

 

Welcomes from the Louisiana Host Office.

8:45-10 a.m.

Plenary Session 1—Auditing and Evaluations in Canada and Beyond
Hotel Monteleone, Mezzanine Level—Queen Anne Ballroom & Parlor

 

Learn about auditing and evaluation in Canada, including how topics are selected, what standards are followed, challenges experienced and the impact of their reports. 

 

Speakers: Jeremy Walton,  Louisiana Legislative Auditor’s Office

Malcolm Gaston, Office of the Auditor General of British Columbia, Canada

 

10:15-11:30 a.m.

Concurrent Session 1—Creative Data Analytics  

Hotel Monteleone, Ground Floor—Royal Salon

 

Staff from Louisiana will present examples of how data analystics can be used in audits and evaluations—beyond just looking at compliance and improper payments. Panelists also will discuss different tools, challenges and lessons learned based on their experiences of using different data sets.

 

Moderator: Chris Magee, Louisiana Legislative Auditor’s Office

 

Panelists: Brent McDougall, Louisiana Legislative Auditor’s Office

Kristen Jacobs, Louisiana Legislative Auditor’s Office
Julie Floyd, Louisiana Legislative Auditor’s Office

10:15-11:30 a.m.

Concurrent Session 2— Evaluating Economic Development Programs, and Tax Exemptions, Credits and Incentives

Hotel Monteleone, Ground Floor—Royal CD 

 

Panelists will present methods to evaluate the impact of economic development programs and tax incentives, credits and exemptions, including ideas for calculating return on investment.

 

Moderator: Patricia Berger, Pennsylvania Legislative Budget and Finance Committee

 

Panelists: Eric Thomas, Washington Joint Legislative Audit and Review Committee

Nick Hill, Montana Legislative Audit Division

Brian Dean, Utah Office of the Legislative Auditor General

Dean Swenson, Wisconsin Legislative Audit Bureau

 

11:30 a.m.-1 p.m.

Networking Lunch and Plenary Session 2
Hotel Monteleone, Mezzanine Level—Queen Anne Ballroom & Parlor

 

Network with your colleagues from across the country. Hear from a Louisiana Senator Fred Mills, who will discuss the impact of legislative program evaluation and performance audits.

 

Speakers: Daryl Purpera, Louisiana Legislative Auditor
Senator Fred Mills, Louisiana

 

1:15-2:30 p.m.

Concurrent Session 3—Hiring and Retaining Employees  

Hotel Monteleone, Ground Floor—Royal Salon

 

This session will explore states’ experiences and success stories with hiring and retaining good employees. 

 

Moderator: Emily Dixon, Louisiana Legislative Auditor's Office

 

Panelists: Heidi Zimmerman, Kansas Division of Legislative Post Audit

Lisa Kieffer, Georgia Department of Audits and Accounts, Performance Audit Division

Jenny Page, Colorado Office of the State Auditor

Keenan Konopaski, Washington Joint Legislative Audit and Review Committee

 

1:15-2:30 p.m.

Concurrent Session 4—Selecting Meaningful Audit Topics: Evaluations that Help Identify Cost-Savings and Generate Revenue 

Hotel Monteleone, Ground FloorRoyal CD

 

This panel will discuss provide examples and suggestions for selecting meaningful topics, such as audits that either identify cost-savings or generate revenue.

 

Moderator: Marcia Lindsay, South Carolina Legislative Audit Council

 

Panelists: Kristen Jabobs, Louisiana Legislative Auditor's Office

Jon Courtney, New Mexico Legislative Finance Committee

Trey Standley, Colorado Office of the State Auditor

 

2:45-4 p.m.

Concurrent Session 5—Obtaining Stakeholder Input  

Hotel Monteleone, Ground FloorRoyal Salon

 

Panelists will discuss approaches they have used to efficiently obtain input from stakeholders. They also will discuss how to design effective surveys and lessons learned. 

 

Moderator: Kiernan McGorty, North Carolina Program Evaluation Division

 

Panelists: Misty Perry, Louisiana Legislative Auditor's Office

Melinda Hamilton, Michigan Office of the Auditor General

Maria Toniolo, Wisconsin Legislative Audit Bureau

Zack Freeman, Washington Joint Legislative Audit and Review Committee

 

2:45-4 p.m.

Concurrent Session 6—Trends in Research Methodologies  

Hotel Monteleone, Ground FloorRoyal CD

 

Research methodologists from different states will discuss use of methodologies. The winner of the NLPES Excellence in Research Methods will present its award-winning methodology.  

 

Moderator: Jon Courtney, New Mexico Legislative Finance Office

 

Panelists: Edward Seyler, Louisiana Legislative Auditor's Office

Ryan McCord, Washington Joint Legislative Audit and Review Committee

Steve Grady, New Hampshire Office of Legislative Budget Assistant, Audit Division

 

4-5 p.m.

Plenary Session 3—Impact Award Information Fair  

Hotel Monteleone, Rooftop LevelRiverview Room

 

Representatives from the states that received 2018 NLPES Certificates of Impact will present summaries of their reports.

 

5-6 p.m. Networking Reception
Hotel Monteleone, Rooftop LevelRiverview Room
Evening Dinner on Your Own
tuesDay, sept. 11
8 a.m.-4:30 p.m. Registration/Information Desk
Hotel Monteleone, Mezzanine LevelQueen Anne Mezzanine
8:30-10 a.m.

Plenary Session 4—GUMBO: Recipe for Leadership Success
Hotel Monteleone, Mezzanine Level Queen Anne Ballroom & Parlor

Today’s leaders are expected to do more with less, and since you can’t do it yourself, inspiring and engaging other is Job 1. Thus, it is crucial that you develop your ability to build rapport and gain buy-in from key stakeholders. Challenging times require you to leverage your strengths and enhance your leadership style to influence and engage team members to achieve results. In this insightful presentation, Ms. Ledet taps into her roots along the bayous of South Louisiana to deliver concrete, practical and actionable leadership guidance, moxed with flavorful vignettes from the Cajun culture. Sit down and enjoy as Ms. Ledet serves up her unique GUMBO leadership recipe, seasoned with her fun and engaging style—and some Cajun spice, of course!.

 

Speaker: Jennifer Ledet, Ledet Management Consulting, Louisiana

 

10:15-11:30 a.m. 

Concurrent Session 7—Evaluating Medicaid: Beyond Improper Payments  

Hotel Monteleone, Ground FloorRoyal Salon

 

Panelists will discuss examples of audits on Medicaid, including evaluating methods to reduce Medicaid expenditures for long-term care, auditing the impact of managed care on costs and outcomes, and evaluating the effectiveness of vital program integrity functions.

 

Moderator: Karen Leblanc, Louisiana Legislative Auditor's Office

 

Panelists: Jodie Debetz, Louisiana Legislative Auditor's Office

Matt Etzel, Kansas Legislative Division of Post Audit

Amber Robbins, Montana Legislative Audit Division

 

10:15-11:30 a.m. 

Concurrent Session 8—Emerging Policy Issues  

Hotel Monteleone, Ground FloorRoyal CD

 

Panelists will discuss current and emerging policy areas, such as sexual harassment, opioids, etc.

 

Moderator: Gina Brown, Louisiana Legislative Auditor's Office

 

Panelists: Malcolm Gaston, Office of the Auditor General of British Columbia, Canada

Rebecca Connolly, Washington Joint Legislative Audit and Review Committee

Eric Thomas, Washington Joint Legislative Audit and Review Committee

Tamara Schiff, Texas Sunset Advisory Commission

 

11:30 a.m.-1 p.m.

NLPES Awards Lunch

Hotel Monteleone, Mezzanine LevelQueen Anne Ballroom & Parlor

 

Presiding: Shunti Taylor, Georgia Department of Audits and Accounts and Incoming NLPES Chair

 

1:15-2:30 p.m.

Concurrent Session 9—Evaluating the Evaluation: What Worked, What Didn't and What We Learned

Hotel Monteleone, Ground FloorRoyal Salon

 

Panelists will discuss both formal and informal methods they use to evaluate an audit or evaluation, including debriefing meetings, checklists, etc. This session is designed for auditors with more than five years of experience. 

 

Moderator: Emily Johnson, Texas Sunset Advisory Commission

 

Panelists: Morgan Constantino, Texas Sunset Advisory Commission

Gina Brown, Louisiana Legislative Auditor's Office

Kristen Rottinghaus, Kansas Legislative Division of Post Audit

 

1:15-2:30 p.m.

Concurrent Session 10—Core Competencies for Auditors and Evaluators  

Hotel Monteleone, Ground FloorRoyal CD

 

Panelists will discuss what knowledge, skills and abilities make auditors and evaluators successful and effective.  This session is designed for auditors with less than five years of experience.

 

Moderator: Jennifer Sebren, Mississippi Joint Legislative Performance Evaluation and Expenditure Review Committee

 

Panelists: Amanda Schlumpberger, Kansas Legislative Division of Post Audit

Melinda Hamilton, Michigan Office of the Auditor General

Julie Floyd, Louisiana Legislative Auditor's Office

 

2:45-3:45 p.m.

Concurrent Session 11—Obtaining Relevant and Sufficient Audit Evidence: How Much is Enough?  

Hotel Monteleone, Ground FloorRoyal Salon

 

Panelists and audience members will discuss methods to ensure relevant and sufficient evidence is obtained, including considerations on how much and what kind of evidence is enough.

 

Moderator: Madison Hoover, Louisiana Legislative Auditor's Office

 

Panelists: Wayne Kidd, Utah Office of the Legislative Auditor General

Michelle Colin, Colorado Office of the State Auditor

 

2:45-3:45 p.m.

Concurrent Session 12—Investigative Techniques in Audits and Evaluations  

Hotel Monteleone, Ground FloorRoyal CD

 

Panelists will discuss investigative techniques that can be used to enhance performance audits and evaluations.

 

Moderator: Christopher Magee, Louisiana Legislative Auditor's Office

 

Panelists: Brent McDougall, Louisiana Legislative Auditor's Office

Jake Dinsdale, Utah Office of the Legislative Auditor General

Patricia Berger, Pennsylvania Legislative Budget and Finance Committee

 

3:45-4:45 p.m.

Concurrent Session 13—IT Issues: Data Reliability and Access  

Hotel Monteleone, Ground FloorRoyal Salon

 

Panelists will present suggestions for assessing data reliability, discuss challenges to related access, and provide examples of how the impact of "bad data" can become its own audit or evaluation. 

 

Moderator: Irina Hampton, Louisiana Legislative Auditor's Office

 

Panelists: Lauren Pendas, Louisiana Legislative Auditor's Office

Greg Fugate, Colorado Office of the State Auditor

Amanda Sayler, Montana Legislative Audit Division

 

3:45-4:45 p.m.

Concurrent Session 14—Visualizing Report Findings  

Hotel Monteleone, Ground FloorRoyal CD

 

Panelists will share examples and suggestions on how to effectively use graphics, maps and other visuals to present findings and enhance reports.

 

Moderator: Eric Thomas, Washington Joint Legislative Audit and Review Committee

 

Panelists: Will Leonards, Louisiana Legislative Auditor's Office

Erik Beecroft, Virginia Joint Legislative Audit and Review Commission

Rebecca Connolly, Washington Joint Legislative Audit and Review Committee

 

5-6 p.m.

Networking Reception

Hotel Monteleone, Rooftop LevelRiverview Room  

Evening Dinner on Your Own 
wednesDay, sept. 12
8-Noon Registraion/Information Desk 
Hotel Monteleone, Mezzanine LevelQueen Anne Mezzanine   
9-10:15 a.m.

Concurrent Session 15—Measuring the Impact of Reports  

Hotel Monteleone, Ground FloorRoyal Salon

 

This panel will discuss methods states use to measure the impact of their work, including follow-up processes, etc.

 

Moderator: Linda Triplett, Mississippi Joint Legislative Performance Evaluation and Expenditure Review Committee

 

Panelists: Kiernan McGorty, North Carolina Program Evaluation Division

Krista Baker-Hernandez, Louisiana Legislative Auditor's Office

Darin Underwood, Utah Office of the Legislative Auditor General

 

9-10:15 a.m.

Concurrent Session 16—Human Resources Roundtable  

Hotel Monteleone, Ground FloorRoyal CD

 

This interactive, but structured, roundtable session will focus on human resource issues, including dealing with generational issues, providing timely and constructive feedback, providing cost-effective training ideas.

 

Moderator: Lizzie Scott, Louisiana Legislative Auditor's Office

 

Panelists: Katie Foster, Louisiana Legislative Auditor's Office

Gina Brown, Louisiana Legislative Auditor's Office

Jenny Page, Colorado Office of the State Auditor

Emily Johnson, Texas Sunset Advisory Commission

10:30 a.m.-Noon

Plenary Session 5—Team Building

Hotel Monteleone, Mezzanine LevelQueen Anne Ballroom & Parlor

 

Participants in this session will participate in a team building activity as well as obtain ideas on how to encourage team building in your own offices. 

 

Speakers: Nina Grant, Colorado Office of the State Auditor
Greg Fugate, Colorado Office of the State Auditor

Melinda Hamilton, Michigan Office of the Auditor General

 

  2018 NLPES Professional Development Seminar Concludes