|REPORT RELEASE PRACTICES
||What are your agency´s practices for releasing program evaluation reports to the press and public?
|RECENT STAFFING TRENDS
||What were your office's number of permanent, full-time staff in the most recent three years (2004-05, 2005-06, and 2006-07) in each of the following areas: (a) program evaluation/ performance auditing, (b) financial auditing, and (c) support staff.
|CONTRACTING FOR PROGRAM EVALUATIONS
||Has your office contracted out any of its performance audit work to private firms? (Why or why not? If you have contracted, what types of work have you contracted for? How have you identified potential bidders for RFPs? How have you monitored the work and workpapers of the contractors?)
|INTEREST IN WEBCAST TRAINING
||What would be the potential benefits if ncsl were to produce "webcasts" or "podcasts" for your staff's professional development, and what concerns/questions about this approach do you have?
|FOLLOW-UP ON PAST REPORTS
||How does your agency follow up on the recommendations of previous reports?
|QUALITY CONTROL PROCEDURES
||What quality control procedures does your office use to ensure the accuracy of your reports?
|EVALUATING CONTRACTING PRACTICES
||Has your office developed standards for evaluating state agencies' contract management practices?
|USE OF GIS FOR EVALUATION PURPOSES
||How can geographic information system (GIS) tools be used in program evaluation work?
|CHALLENGES TO DATA ACCESS
||How have you addressed situations where your access to evaluation data has been challenged?
|INTERVIEW QUESTIONS FOR JOB APPLICANTS
||When hiring new staff, what are some examples of interview questions that have been effective in helping you identify great candidates?
||January March 2005
|CONFIDENTIALITY OF SURVEY RESPONSES
||When conducting surveys, do you promise confidentiality to potential respondents? (If so, in what circumstances do you do so? And how do you word your pledge of confidentiality? If you don't promise confidentiality, why don't you do this?)
|DEALING WITH THE PRESS
||What suggestions do you have for dealing with the press? (What bad experiences have you had, and what lessons have you learned? Do you have suggestions for ensuring that the press accurately conveys the messages in your reports?)
||What’s been your experience with online surveys? (Have you conducted surveys online? If so, what lessons have you learned? If not, why haven’t you done so, and would you consider doing online surveys? Do you have any observations about the components of a well-designed online survey?
||How do you ensure that sensitive information collected for your evaluations is not exposed to public view? (Does state law allow you to keep certain work papers confidential? Do you redact documents that you think should not be available for public review? How do you determine which work papers will not be public?)
|REVIEWING AUDITEES' E-MAILS OR HARD DRIVES
||"Do you have tips for accessing auditees' e-mails or hard drives, in cases where review of this information is necessary?"
|FINANCIAL AUDITORS IN EVALUATION PROCESS
||How, if at all, does your program evaluation staff use the expertise of financial auditors during the evaluation process?
||Do you have any suggestions for ways that nlpes offices could improve the recruitment of minorities for program evaluation positions?
|WRITING EXERCISES FOR JOB APPLICANTS
||What's your opinion about requiring job applicants to complete a writing exam or writing exercise?
|IMPACT OF STATE BUDGET CUTS
||Have state budget problems had a direct effect on your office or day-to-day work this year-and what specific impacts do you anticipate in coming months?
|POLICIES FOR DISTRIBUTING HARD COPIES OF REPORTS
||What are your office's policies for distributing hard-copy versions of your reports?
|AGENCY WEB SITES
||How has your agency's web site improved your work and your ability to serve the public?
||How does your office retain its workpapers?
|TAPE RECORDING AUDIT-RELATED INTERVIEWS
||Do you ever tape record interviews during your program evaluations/audits--and, if so, in what circumstances?
|DESKTOP PUBLISHING SOFTWARE
||Based on your agency's experience, what are the pros and
Cons of various desktop publishing programs (such as Microsoft Publisher, Adobe Pagemaker, Ventura, etc.)?
|COST SAVINGS REPORTS
||How, if at all, does your office report estimates of cost Savings that have resulted from your recommendations?
|IMPROVING RELATIONSHIPS WITH AGENCIES EVALUATED
||What steps does your office take to improve working relationships with the agencies you're evaluating?
||What do your office's written reports look like, and what are you trying to accomplish with your format(s)?
||Does your office have internships--and, if so, how have you incorporated interns into your evaluation and performance audit work?
|RESPONDING TO POLICY QUESTIONS
||When your legislators ask you, as an audit or program evaluation office, for answers to policy questions, how do you respond?
|WORK ATTRACTIONS & CHALLENGES
||Based on your experience in legislative program evaluation so far, what are the most significant attractions and the most difficult challenges of your daily work? (This is intended for staff who have been working in a legislative program evaluation office for 5 years or less)
|FLEXIBLE WORK OPTIONS
||What flexible work schedule options does your office offer, and how important have they been in helping you attract and retain employees?
|INTERNET RESEARCH TOOLS
||What tools or resources for program evaluation research have you found on the Internet that might be useful to colleagues in other states?
||What approaches has your office used to screen and hire the best candidates for employment as evaluators?
|EVALUATIONS OF THE JUDICIAL BRANCH
||What role, if any, has your office had in evaluating services provided by your state's judicial branch of government, and are there legal or other impediments to doing such studies in your state?
|TIMELY COMPLETION OF PROJECTS
||What steps does your office take to ensure that projects finish on time?
|TRAITS OF AN OUTSTANDING PROGRAM EVALUATOR
||Beyond the skills acquired through formal education, what are the most important traits of an outstanding program evaluator (or performance auditor)?
|WEBPAGE IMPACT ON REPORT WRITING, DISTRIBUTION
||How, if at all, has the development of your agency's web page changed the way that you write reports, distribute reports, or present information to your audience?
|WAYS TO IMPROVE SURVEY RESPONSE RATES
||What approaches has your office used to try to increase response rates for surveys--and do you have any benchmarks for minimally-acceptable survey response rates?
|WAYS TO IMPROVE TEAMWORK AND COLLEGIALITY
||What interesting approach (or approaches) has your office used to improve teamwork and collegiality among staff?