Cover Image
close this bookCreative Training - A User's Guide (IIRR, 1998, 226 pages)
close this folderEvaluation techniques
View the document(introduction...)
View the documentPurpose
View the documentMethod
View the documentAre we on target?
View the documentTell me...
View the documentComplete the sentence
View the documentOther methods
View the documentDeveloping questionnaires

(introduction...)

Evaluation involves measuring the results of a workshop or other learning activity against the objectives. Creative education should incorporate evaluation at all key stages of the education cycle. Evaluation is an ongoing process for the benefit of the facilitator and participants.


Figure

Note

· Whatever evaluation technique you use, beware of irrelevant responses.

· Post-training impact evaluations require other information not covered by this activity sheet.

Purpose

Evaluation techniques are used to find out:

· How much learning took place
· How effective the training methods used were
· How effective and useful each of the different sessions during the training were.
· How the facilitators can improve themselves
· If the objectives were appropriate If the participants enjoyed themselves
· If the learning can be applied in the participants' job or other situations
· If the training facilities were satisfactory

Method

For successful evaluation, you need to address four basic questions:

· What are you trying to find out?
· How could you go about finding it out?
· When is the best time to find this out?
· What are you going to do with the information?

Major points to consider in using evaluation methods:

· Literacy level of the participants
· Time available for the exercise
· How the information gathered will be used

Are we on target?

Materials

· easel, board or wall manila paper
· colored pens
· push pins

People

up to 40

Time requirement

10 minutes


Figure

Suggested approach

1. Draw five concentric circles on a manila paper (similar to a dart board).

Make several pie-like divisions for content, methodology, facilitators, etc., depending on the training aspects you wish to evaluate.

2. During evaluation time, ask the participants to place a pin on each pie to reflect their rating (e.g., if one is really impressed by the methods, then they should choose the bull's eye, if not, then anywhere farther from the bull's eye depending on their perception).

3. After all the participants have made their evaluations, take note of the general placement of the pins and investigate any pins that fall outside of the general choice of position.

4. Give a summary of the results to the group.

Strength

Enjoyable and requires little time to accomplish.

Limitation

It is not very helpful if you desire a detailed qualitative evaluation.

Variations

Use specific colors of pins for each aspect to be evaluated.

Tell me...

Materials

small cards

People

up to 20


Figure

Tip

If pressed for time, ask fewer participants to present their evaluation/responses.

Time requirement

15 to 20 minutes

Suggested approach

1. Distribute the cards.

2. Ask the participants to write down a key lesson learned on the topic or during the activities.

3. Ask some of the participants to read what they have written.

4. After each participant has read their evaluation, ask them to post it on a designated part of the wall.

5. When a substantial number of participants have already read their evaluation, ask the rest to post their evaluations on the wall.

6. Summarize the main points written by the participants.

Strength

Can be used to summarize a session or day's activity, or to review the previous day's session at the start of the day.

Limitation

Cannot be used effectively when there are more than 20 participants.

Variations

For extended workshops, a different color or shape may be used each day to show progress (e.g., leaves for day 1, flowers for day 2 and fruits for day 3, and so on). A dry branch of a bush could be used to hang the cards on.

Complete the sentence

Materials

· manila paper
· marking pens

People

up to 40

Time requirement

10 to 15 minutes

Steps

1. On a manila paper, write open-ended sentences directed at the training aspects you want to be evaluated, e.g.,

· I find the training effective because...
· The training could be improved by...
· The facilitators could be more effective if...

2. Distribute sheets of paper for participants to write responses.

3. Ask a few volunteers to read their responses.

4. Collect all sheets after some participants have read their responses.

Strength

Open-ended questions elicit wider-ranging responses.

Limitation

Literacy level of participants.

Other methods

Song and skits

Break up the participants into groups and ask each group to compose a song or make a skit portraying key lessons from each of the major aspects of the training.

Demonstrations

Whenever possible, ask the participants to demonstrate newly-learned skills (e.g., how to use overhead projectors, develop visual aids, sew a dress, etc.).


Figure

Developing questionnaires

Questionnaires are the most commonly used evaluation tools. However, experiences show varied results. Use creative questionnaires when you need to evaluate many elements of the training, e.g., content, facilitators, venue, etc. Appropriate graphics can increase interest.

Daily feedback sheets, asking for minimal information as the workshop progresses, enable facilitators to make appropriate adjustments. Evaluations intended for the entire workshop can combine rating scales, boxes and blank lines for responses (see example).

In WESAMAR program in the Philippines, evaluators use rating scales with even numbers. This is because there is a tendency for participants to opt for a mid-point to avoid hurting the feelings of facilitators.

Note

The attached samples are just guides, adjustments may be necessary to satisfy your requirements.

Workshop Evaluation Sheet

Workshop:

Name:

(optional)

Date:

Venue:

1. Content

Not useful

Partly useful

Mostly useful

Very useful

2. Duration

Much too short

A bit too short

A bit too long

Much too long

3. Learning environment

Unpleasant

Sometimes unpleasant

Pleasant

Very pleasant

4. My learning was facilitated by...

5. My learning was hindered by...

6. How will you use what you have learned?

7. What are your difficulties (include fears) in applying what you hove learned...

Any other comment...

Over all I feel...





The above sample is widely used in WESAMAR-sponsored workshops in the Philippines and has been effective, especially when participants have been told beforehand that their comments are essential to help improve the workshops for the future.