Case Study Tools
  • RAINN Affiliates and Partners
  • Evaluation Instruments
  • Organization Chart
  • Ecomap
  • Data Files
  • My Values
  • Notebook

Phase 4: Evaluate and Review Your Work

Learn about the types of evaluation below, and then begin by reviewing your Notebook.

Evaluation of the online hotline focuses on both process evaluation, how and what services are delivered, and outcomes evaluation, how useful or effective were the services.

Process Evaluation

A process (formative) evaluation includes collecting information about the number of visitors, length of sessions, technical difficulties, types of situations discussed, types of services provided, and demographic information about users and perpetrators.

Outcome Evaluation

Outcome (summative) evaluation includes user, staff and supervisors perceptions of the usefulness of the online hotline, user satisfaction with the services and users’ intention to use services to which they were referred.

In addition, qualitative information from Focus Groups provides information from volunteer staff about their perceptions of training, training needs, experience with use of the technology, and general feedback about the program.

Answer the following questions

  • Write two Process Evaluation questions that can be answered from RAINN system data.

  • Write two Outcome Evaluation questions that can be answered from the Online User Survey.

  • Why is it important to have both Process and Outcomes data in evaluating a program?

  • If you were a policy maker deciding how to spend scarce treatment dollars, what kind of actions might you take to make sure that as more programs like RAINN are implemented, it is not at the expense of treatment availability for low-income or older people or other groups without access to private online computers? What could you learn from other experiments with online service delivery to inform your evaluation? For example, in some states, the Medicaid agency as well as other agencies serving Medicaid recipients are putting more of their applications and resources primarily online when many of the Medicaid population do not have access to those resources. What questions should advocates engaged in policy practice be asking about these latest cost savings measures and about the impact of these moves on reducing costs and affecting access?

Log in or sign up to take notes!

My Intervention Tasks

  • Use the Excel or SPSS data files to develop and answer research questions based on the Visitor and Volunteer data.
  • Describe the limitations of the RAINN data. What questions cannot be answered from the available data? Can RAINN be considered successful given these limitations? Why?
  • Provide a summary of the evaluation. Given the evaluation data, write a brief summary about the effectiveness of the online hotline and what can be done to improve the program.