Program evaluation

From Wilderdom

(Difference between revisions)
Jump to: navigation, search
(New page: ==Recommended links== * [http://wilderdom.com/evaluation.html Program Evaluation in outdoor education, adventure education, & other experiential intervention programs] * [Basic guide to pr...)
Line 1: Line 1:
-
==Recommended links==
+
=Program Evaluation in outdoor education, adventure education, & other experiential intervention programs=
-
* [http://wilderdom.com/evaluation.html Program Evaluation in outdoor education, adventure education, & other experiential intervention programs]
+
-
* [Basic guide to program evaluation] - an extensive knowledge base of program evaluation resources (McNamara, 1999)
+
-
* [[Neill 2010 Program evaluation and outdoor education: An overview|Program evaluation and outdoor education: An overview]] (Neill, 2010)
+
 +
==Starting Points for Program Evaluation in Outdoor & Experiential Education==
 +
 +
* [#Why Why program evaluation?] - it has become increasingly important for outdoor and experiential education organizations to demonstrate clear evidence of effectiveness...
 +
* [tools.html Tools, instruments, & questionnaires] - a list and details of instruments recommended for use in outdoor and experiential education program evaluations
 +
* [/html/NeillGass2001EvaluationNeedsAssessmentforAEE6pageversion.doc Needs assessment for program evaluations] (.doc) - to get underway, if you complete this, it will help to focus and plan your program evaluation efforts
 +
* [/research/effectsizes.html Why use effect sizes instead of significance testing for program evaluation?]<span style="font-weight: 400"> - Effect sizes are underutilized in program evaluation; significance testing is overutilized</font></span>
 +
* [JamesNeillpublicationsTopic.htm#ProgramEvaluations Example evaluations] - downloadable examples of outdoor education program evaluation reports by James Neill
 +
* [#Resources Program evaluation references]
 +
 +
==Recommended Resources==
 +
* [http://www.mapnp.org/library/evaluatn/fnl_eval.htm Basic guide to program evaluation] - an extensive knowledge base of program evaluation resources (McNamara, 1999)]
 +
* [http://reviewing.co.uk/evaluation/methods1.htm Course evaluation methods] - evaluative questions & tasks for participants near the end of a residential course (more qualitative; Greenaway)
 +
* [http://ericae.net/ ERIC Clearinghouse for assessment, evaluation, & research information].
 +
* [http://www.wmich.edu/evalctr/ The Evaluation Center]
 +
* [http://oerl.sri.com/index.html Online Evaluation Resource Library]
 +
 +
== Why Program Evaluation?==
 +
 +
It has become increasingly important for outdoor and experiential education organizations to demonstrate clear evidence of effectiveness in achieving desired goals for two main reasons: necessity and morality.
 +
 +
Conducting program evaluation does not guarantee the quality of a program, but high quality programs are more likely to be engaged in program evaluation.
 +
 +
===Reason #1: Necessity - Because you have to!===
 +
 +
State, federal and even private funding for intervention programs increasingly requires rigorous program evaluations to be conducted. Thus, conducting program evaluations is becoming a necessity for many programs.
 +
 +
===Reason #2: Morality - Because you want to!===
 +
 +
There is also a moral argument that it is a responsibility of those who design and conduct the programs to be rigorous in ensuring the best possible experiences are provided for participants. Just as with safety, for which an outdoor organization is expected to provide best-practice management of risk, so too there is a psycho-educational responsibility for providing high quality experiences for participants. In this day and age, this should probably include the conduct of peer-reviewed research and formal program evaluation.
 +
 +
There are several other motivations for research and evaluation (see [researchresearch.html#Hierarchy 7 stage hierarchy]), but necessity (external motivation) and morality (internal motivation) are the two major ends of the motivational spectrum underlying efforts to conduct program evaluation.
 +
 +
==References==
 +
 +
Greenaway, R. ''[http://www.reviewing.co.uk/reviews/evaluation-transfer.htm#evaluation  Evaluation of training/learning books & reviews]. ''Active Reviewing.
 +
 +
Hendricks, B. (no date). ''[http://www.ericfacility.net/databases/ERIC_Digests/ed376998.html Improving evaluation in experiential education]''. ERIC Clearinghouse on Rural Education and Small Schools.
 +
 +
Neill, J. T. (2010). ''[[Neill 2010 Program evaluation and outdoor education: An overview|Program evaluation and outdoor education: An overview]]''. Presentation to the 16th National Outdoor Education Conference, Notre Dame University, Fremantle, Western Australia, January 10-13.''
 +
 +
Priest, S. (2001). [http://www.findarticles.com/p/articles/mi_qa3907/is_200104/ai_n8942758 A program evaluation primer]. '' Journal of Experiential Education'', ''24''(1), 34-40.
 +
 +
Watters, R. (1988). [http://www.isu.edu/outdoor/bencost.htm Benefit cost analysis of non-commercial outdoor programs]. In ''Proceedings of the 1986 Conference on Outdoor Recreation''.
 +
 +
Watters, R. (1991). ''[http://www.isu.edu/outdoor/Hogcb.htm Cost benefit analysis of recreation programs for the disabled]''. Idaho State University Outdoor Program, Pocatello, ID.
 +
 +
[[Category:Experiential education]]
 +
[[Category:Outdoor education]]
[[Category:Program evaluation]]
[[Category:Program evaluation]]

Revision as of 23:21, 11 January 2010

Contents

Program Evaluation in outdoor education, adventure education, & other experiential intervention programs

Starting Points for Program Evaluation in Outdoor & Experiential Education

  • [#Why Why program evaluation?] - it has become increasingly important for outdoor and experiential education organizations to demonstrate clear evidence of effectiveness...
  • [tools.html Tools, instruments, & questionnaires] - a list and details of instruments recommended for use in outdoor and experiential education program evaluations
  • [/html/NeillGass2001EvaluationNeedsAssessmentforAEE6pageversion.doc Needs assessment for program evaluations] (.doc) - to get underway, if you complete this, it will help to focus and plan your program evaluation efforts
  • [/research/effectsizes.html Why use effect sizes instead of significance testing for program evaluation?] - Effect sizes are underutilized in program evaluation; significance testing is overutilized</font>
  • [JamesNeillpublicationsTopic.htm#ProgramEvaluations Example evaluations] - downloadable examples of outdoor education program evaluation reports by James Neill
  • [#Resources Program evaluation references]

Recommended Resources

Why Program Evaluation?

It has become increasingly important for outdoor and experiential education organizations to demonstrate clear evidence of effectiveness in achieving desired goals for two main reasons: necessity and morality.

Conducting program evaluation does not guarantee the quality of a program, but high quality programs are more likely to be engaged in program evaluation.

Reason #1: Necessity - Because you have to!

State, federal and even private funding for intervention programs increasingly requires rigorous program evaluations to be conducted. Thus, conducting program evaluations is becoming a necessity for many programs.

Reason #2: Morality - Because you want to!

There is also a moral argument that it is a responsibility of those who design and conduct the programs to be rigorous in ensuring the best possible experiences are provided for participants. Just as with safety, for which an outdoor organization is expected to provide best-practice management of risk, so too there is a psycho-educational responsibility for providing high quality experiences for participants. In this day and age, this should probably include the conduct of peer-reviewed research and formal program evaluation.

There are several other motivations for research and evaluation (see [researchresearch.html#Hierarchy 7 stage hierarchy]), but necessity (external motivation) and morality (internal motivation) are the two major ends of the motivational spectrum underlying efforts to conduct program evaluation.

References

Greenaway, R. Evaluation of training/learning books & reviews. Active Reviewing.

Hendricks, B. (no date). Improving evaluation in experiential education. ERIC Clearinghouse on Rural Education and Small Schools.

Neill, J. T. (2010). Program evaluation and outdoor education: An overview. Presentation to the 16th National Outdoor Education Conference, Notre Dame University, Fremantle, Western Australia, January 10-13.

Priest, S. (2001). A program evaluation primer. Journal of Experiential Education, 24(1), 34-40.

Watters, R. (1988). Benefit cost analysis of non-commercial outdoor programs. In Proceedings of the 1986 Conference on Outdoor Recreation.

Watters, R. (1991). Cost benefit analysis of recreation programs for the disabled. Idaho State University Outdoor Program, Pocatello, ID.

Personal tools