Guidelines for Measuring
Choosing Our Measures
What we measure is what we do. The process of measuring focuses our attention on how our
chosen action is changing the world around us. It makes a great deal of difference what we choose to measure, because
what we measure is what we pay attention to.
For example, if our goal is economic security, one indicator is more jobs available in the community. We could
measure the number of jobs created, which would reflect a focus on creating jobs. However, if what we really mean
by economic security is better employment options for low-income people, then we would want to measure how many
new jobs employ low-income people at an adequate pay rate. New jobs may have been created, but perhaps only a small
number have gone to low-income people in our community. Different actions than simply creating jobs may be needed
to create better employment options for low-income people that increase their financial security. For example,
we might invest in training, develop a mentoring program, and establish childcare and transportation services.
What we choose to measure matters, because what we choose to measure will help shape our actions and help us understand
more about the real problem or opportunity we are trying to address.
Measuring 'Goods' Versus 'Bads'
Measures can focus on good things or bad things. For example, we could count the number
of people who are unemployed (a bad), or we could count the number of people who are employed (a good). By focusing
on a good, we acknowledge the strengths and assets of our community and create a positive base from which to build.
Our actions will tend to focus on increasing the number of people who are employed, rather than reducing the number
who are unemployed.
This is an important distinction, since official unemployment rates don't include people who are no longer looking
for work. Therefore, more people could become employed without necessarily reducing the number who are counted
as unemployed. Whenever we have a choice between focusing our measures on a good or a bad, choosing the good will
give us a stronger, more positive, foundation.
Measuring Progress
Toward Community Goals
Versus Measuring Actions
Typically, when we are asked to measure our progress, what we are really being asked to
do is count the number of times we have performed some action. When we measure progress toward community goals,
we are not counting actions, nor are we interested in whether the action was a success in itself-what we want to
know is if the action (whether a success or a failure) moved our community closer to its goals.
This is a community-centered process, not a government-centered process. Communities may and do work with a broad
array of partners. The question is whether the way that all these resources are engaged is actually helping a community
reach its goals.
What Can and Should be Measured
The following guidelines will help you in deciding what to measure with respect to each
of the five outcomes.
- Measure only those things that will give needed information.
There is no use wasting time and resources collecting statistics which will serve no useful
purpose.
- Concentrate on those indicators that have the most potential to help
redirect activities.
What information will be most useful in making decisions concerning the community's plan?
- Where direct measurement of important factors seems impossible or prohibitive,
select proxy indicators.
Choose an indicator that seems close to the information sought.
- Balance the need to know with the ability to find out.
Attempt to measure only what the available skills and resources can reasonably be expected
to measure.
Adapted from Self-Evaluation: Ideas
for Participatory Evaluation of Rural Community Development Projects, Jim
Rugh, World Neighbors, 1992.
|
