captUS Home CSAP's Centers for the Application of Prevention Technologies
National CAPT Central CAPT Northeast CAPT Southeast CAPT Southwest CAPT Western CAPT
Western
Calendar Site Map Contact Staff Login
Western CAPT
  Planning and Best Practices
  Tip of the CAPT
  Prevention Talk
  Prevention Materials
  PowerPoint Presentations
  Grant Information
  Resource Links
  Research Links

Western > Resources > Planning and Best Practices > Step 7 > Evaluation 10L

print page

X. Evaluation Tools & Measures

L. Measuring Goal Importance

Adapted From the Community Tool Box Chapter 31, Section 5

Community Survey of Goal Importance

Contributed by Aimee Wittman
Edited by Jerry Schultz

Topics:
What is a constituent survey of goal importance?
Why should we use a constituent survey of goal importance?
When should we conduct this survey?
How do we conduct this survey?
Examples
Resources
Related Topics
Tools
Checklist
Overheads

What is a constituent survey of goals?

A constituent survey of outcomes will help you to examine the greater impact of your group's work. It poses questions to members of the initiative and experts in the community. The people who fill out the survey will express their opinions about the importance of the group's accomplishments for the community as a whole, and for the mission of the initiative.

If your group's focus is on reducing the risk of cardiovascular disease in your community, one of your goals might be to sponsor an employee health fair at the local public schools where you offer free screening and information to reduce the risk for heart disease.

On the survey of outcomes, you might ask respondents to rate this objective as being either "Very Important," or "Very Unimportant." Then, after averaging the responses, you would have a better idea of how this action benefited the community, in the eyes of community members.

Why should you conduct this survey?

As with the constituent survey of process, this survey gives members of the community and of the initiative an opportunity to voice their opinions and express their ideas about the outcome of your group's work. Additionally, the survey gives those who are close to the group more chances to offer suggestions for improvement.

If the group hoping to raise awareness of heart disease found out from its survey that many people benefited from the campaign to reach school employees, it could continue on with this type of community outreach. But, if another goal didn't produce the same type of positive feedback, then the group could think about re-adjusting its action plans to incorporate another type of outreach.

As with all of the aspects of the evaluation, the constituent survey of outcomes is a useful way to get a more objective, unbiased opinion about the work your group is pursuing.

When should you conduct the constituent survey of outcomes?

We recommend conducting this survey every several years, this will increase your feedback and allow you to revise your vision as necessary. The last year of the grant period might be a good time, as well. Sometimes the place that you are receiving funding from will require you to do this survey.

How do you conduct a constituent survey of outcomes?

If you've already conducted the constituent surveys of goals and process, you probably feel like an old pro by now. You'll be happy to hear that you can continue to practice your finely tuned surveying skills with the constituent survey of outcomes! The constituent survey of outcomes involves four different steps.

1. Develop a survey.

Remember the folks who put together the constituent survey of goals and the constituent survey of process? you'll need their expertise and creativity once again. These individuals should design a survey that lists the accomplishments that your group has proudly achieved. Looking back through event logs and the goal attainment report will help refresh your memory. See Chapter 31, Section 2: Gathering Information: Monitoring your Progress. Also, see Chapter 31, Section 6: Reaching Your Goals: The Goal Attainment Report. Check out an example of a constituent survey of outcomes later in this section!

2. Conduct a survey of constituents

Are you ready to distribute the surveys? Great! you'll want to share these surveys with members who have some knowledge of the group and the areas you are evaluating and with outside experts with specialized knowledge in the area. Once you have determined who should receive the questionnaires, they should be mailed, or perhaps distributed at a general meeting of your initiative. Don't forget to clearly state a return address!

3. Use the data to determine which changes have had the greatest effect on the community.

Once you have collected all of the surveys, you will want to find the means the respondents' answers. If, for each of the questions, you asked the respondent to answer "1" for "Very Unimportant" and "5" for "Very Important" to describe the impact on the community, you would determine an average for the numbers, and then find a range of the numbers.

To find the mean, or the average, response, simply add together all of the numbers, then divide by the total number of respondents. If, for one of the questions, ten people respond with ratings of 3, 4, 4, 5, 3, 2, 5, 4, 4, 3, you would add up all of these numbers and then divide that total by ten. The mean response in this case would be 3.70 (or 37)10). The range of numbers runs from 2-5, two being the lowest and five the highest score.

4. Use the survey results to refine the group's choices for action.

Okay, so now you have a whole batch of numbers. Where do you go from there? That answer, in most situations, lies in your hands. The results of this survey may encourage you to continue on in the same direction, or it may challenge you to rethink some of your plans. In either case, the survey of outcomes is yet another tool to help you work better in your group and in the community.

Tool #1: Cover Letter


This is a good beginning to your survey, it informs the person filling it out what your intentions are.

Sample Cover Letter
for Constituent Survey of Outcomes

Date

Dear Members of (the initiative):

The purpose of the attached outcome survey is to get your feedback on how (the initiative) is doing. As you know, the mission of (the initiative) is to ______________________________ in ___________________________(city/county).

Please complete each question by circling the number that illustrates how important each community change is to the mission of (the initiative).

To protect anonymity, please use the enclosed self-addressed envelope and return your completed survey to our evaluators, the (name them).

Thanks in advance for your valuable advice and feedback.

Best regards,

______________________
Executive Director

Enclosure

Tool #2: Generic Goal Importance Survey This survey skeleton can give you an idea of how to set up your own.

Please Return By _____________________

Generic Goal Importance Survey (Date)

Staff and members of(the initiative) have been involved in efforts that resulted in a variety of community changes related to the mission of .______________________. This survey lists XX community changes that resulted from the initiative's efforts. For each survey item, please circle the number that best describes how important each community change is to the initiative's mission of ____________________________

Use the following scale to rate your answers.

1

2

3

4

5

Very Unimportant

Unimportant

Neither Unimportant nor Important

Important

Very Important


Community Changes
(Date Accomplished)

Importance of the Community Changes to the Mission of ________________________ .

 

Very Unimportant

Neither Unimportant nor Important

Very Important

1 __________________________
(Date)
____________________________
____________________________

1

2

3

4

5

2___________________________
(Date)
____________________________
____________________________

1

2

3

4

5

3___________________________
(Date)
____________________________
____________________________

1

2

3

4

5

Taken together, how important are the above community changes in accomplishing the mission of __________________________________?

Checklist

Here, you'll find a checklist that summarizes the major points contained in the text.

___ You have decided who you will distribute the survey to.


___ You have determined that it is a good time to receive feedback.


___ A survey has been developed.


___ This survey lists all community changes that the initiative has helped create.


___ You have mailed or distributed your survey that has a return address or envelope.


___ The data from the returned surveys has been compiled.


___ You have performed basic statistics, the mean and the range, that demonstrate early on simple trends.


___ You have had your results analyzed.


___ You have used the survey to refine and rewrite choices for action if necessary.

Back

Privacy Policy | Site Disclaimer | Site Accessibility

U.S. Department of Health and Human Services
SAMHSA | NCADI | National Mental Health Information Center | USA.gov

Page last updated: 08/17/2006