Case Study Tools
  • RAINN Affiliates and Partners
  • Evaluation Instruments
  • Organization Chart
  • Ecomap
  • Data Files
  • My Values
  • Notebook

Intervention Evaluation

Purpose of RAINN Evaluation Data

It provides evidence that the online hotline is meeting its goals.

  • 72% of users report high overall satisfaction and 16% report low satisfaction; the mean rating for each evaluation question is above 4.0.
  • 91% of users find the NSAOH easy to use.
  • 2011 consumer satisfaction was significantly higher that 2010 consumer satisfaction for each evaluation question.

It provides information for program improvement. The evaluator meets with RAINN administration to discuss the evaluation results and their implications.

  • Why are 20% of sessions shorter than 10 minutes? Do some topics require longer sessions than others?”
  • What can be done to identify and train volunteers who receive ratings lower than 3.0 in “volunteer knowledge and skills”?
  • Only one visitor session resulted in mandatory reporting. Why is that, since 12% of calls involve incidents related to a minor?

Provides information for future training.

  • The staff/volunteer needed help from a supervisor with a suicidal user in 18% of sessions. Is more or different training needed in this area?
  • Seven staff/volunteers provided qualitative comments that they were uncomfortable dealing with issues of gang rape. This suggests that training in that area needs to be included.

Provides insights about the nature of online hotline users.

  • 86% of visitors are not in an immediate crisis.
  • Examination of the timeframe of the assault show that only 14% discussed an incident that occurred during the past few days and only 1 percent required a referral to 911.

Provides accountability to constituents.

  • The evaluation report is made available to board members, staff and funders.
  • Results of the evaluation were published in an academic journal to inform the larger human service community about RAINN (Finn, Garner, & Hughes, 2009).

Answer the following questions

  • List two examples from the data above that provide process evaluation?

  • What evidence from the user satisfaction data suggests that the online hotline is meeting its goals?

  • Some volunteers are rated low in “knowledge and skills”. Given that information, would you fire those volunteers? Why? If not, what would you do instead?

Log in or sign up to take notes!

Review my Notebook

Notebook

View, email, edit and print all of the notes you have taken about this case study.