Program evaluation

From Wilderdom

(Difference between revisions)
Jump to: navigation, search
m (Starting points)
Current revision (22:25, 11 March 2013) (view source)
m
 
(25 intermediate revisions not shown.)
Line 1: Line 1:
 +
<!-- Earlier html version of this page: http://wilderdom.com/evaluation.html (can be redirected) -->
;Program evaluation in outdoor education, adventure education, & other experiential intervention programs
;Program evaluation in outdoor education, adventure education, & other experiential intervention programs
==Starting points==
==Starting points==
-
 
+
* [[Why program evaluation?]] - it has become increasingly important for [[outdoor education]] and [[experiential education]] organisations to demonstrate clear evidence of effectiveness, but motivations for organisations to engage in evaluation vary
-
* [[#Why program evaluation?|Why program evaluation]] - it has become increasingly important for outdoor and experiential education organizations to demonstrate clear evidence of effectiveness...
+
* [[/Common practices in program evaluation/]] - what types of program evaluation are conducted? Summarises survey results about outdoor education program evaluation foci, source, and type
-
* [http://wilderdom.com/tools.html Tools, instruments, & questionnaires] - a list and details of instruments recommended for use in outdoor and experiential education program evaluations
+
* [http://wilderdom.com/tools.html Tools, instruments, & questionnaires] - a list of instruments recommended for use in outdoor and experiential education program evaluations
-
* [http://wilderdom.com/html/NeillGass2001EvaluationNeedsAssessmentforAEE6pageversion.doc Needs assessment for program evaluations] (.doc) - to get underway, if you complete this, it will help to focus and plan your program evaluation efforts
+
* [[Program evaluation/Needs assessment|Needs assessment for program evaluations]] - to get underway with designing an evaluation, complete this needs assessment. It will help to focus and plan your program evaluation efforts.
-
* [http://wilderdom.com/research/effectsizes.html Why use effect sizes instead of significance testing for program evaluation?] - Effect sizes are underutilized in program evaluation; significance testing is overutilized
+
* Handling results and benchmarking - [http://wilderdom.com/research/effectsizes.html Why use effect sizes instead of significance testing for program evaluation?] - Effect sizes are underutilised in program evaluation; significance testing is overutilised
-
* [http://wilderdom.comJamesNeillpublicationsTopic.htm#ProgramEvaluations Example evaluations] - downloadable examples of outdoor education program evaluation reports by James Neill
+
* [[James Neill's Publications by Topic#Program Evaluations|Example evaluations]] - downloadable examples of outdoor education program evaluation reports by James Neill
-
* [[#Resources program evaluation references|Resources program evaluation references]]
+
==Recommended resources==
==Recommended resources==
-
* [http://www.mapnp.org/library/evaluatn/fnl_eval.htm Basic guide to program evaluation] - an extensive knowledge base of program evaluation resources (McNamara, 1999)]
+
* [http://www.mapnp.org/library/evaluatn/fnl_eval.htm Basic guide to program evaluation] - a knowledge base of program evaluation resources (McNamara, 1999)
-
* [http://reviewing.co.uk/evaluation/methods1.htm Course evaluation methods] - evaluative questions & tasks for participants near the end of a residential course (more qualitative; Greenaway)
+
<!-- * [http://ericae.net/ ERIC Clearinghouse for assessment, evaluation, & research information]. -->
-
* [http://ericae.net/ ERIC Clearinghouse for assessment, evaluation, & research information].
+
* [http://www.wmich.edu/evalctr/ The Evaluation Center] - Western Michigan University
-
* [http://www.wmich.edu/evalctr/ The Evaluation Center]
+
* [http://oerl.sri.com/index.html Online Evaluation Resource Library] - online library for professionals seeking to design, conduct, document, or review project evaluations
-
* [http://oerl.sri.com/index.html Online Evaluation Resource Library]
+
* [http://delicious.com/jtneill/programevaluation #programevaluation] - jtneill's bookmarks on delicious
-
 
+
-
== Why program evaluation?==
+
-
 
+
-
It has become increasingly important for outdoor and experiential education organizations to demonstrate clear evidence of effectiveness in achieving desired goals for two main reasons: necessity and morality.
+
-
 
+
-
Conducting program evaluation does not guarantee the quality of a program, but high quality programs are more likely to be engaged in program evaluation.
+
-
 
+
-
===Reason #1: Necessity - Because you have to!===
+
-
 
+
-
State, federal and even private funding for intervention programs increasingly requires rigorous program evaluations to be conducted. Thus, conducting program evaluations is becoming a necessity for many programs.
+
-
 
+
-
===Reason #2: Morality - Because you want to!===
+
-
 
+
-
There is also a moral argument that it is a responsibility of those who design and conduct the programs to be rigorous in ensuring the best possible experiences are provided for participants. Just as with safety, for which an outdoor organization is expected to provide best-practice management of risk, so too there is a psycho-educational responsibility for providing high quality experiences for participants. In this day and age, this should probably include the conduct of peer-reviewed research and formal program evaluation.
+
-
 
+
-
There are several other motivations for research and evaluation (see [researchresearch.html#Hierarchy 7 stage hierarchy]), but necessity (external motivation) and morality (internal motivation) are the two major ends of the motivational spectrum underlying efforts to conduct program evaluation.
+
-
 
+
-
==Common practices in program evaluation==
+
-
See http://wilderdom.com/evaluation.html
+
==References==
==References==
Line 46: Line 27:
Neill, J. T. (2010). ''[[Neill 2010 Program evaluation and outdoor education: An overview|Program evaluation and outdoor education: An overview]]''. Presentation to the 16th National Outdoor Education Conference, Notre Dame University, Fremantle, Western Australia, January 10-13.''
Neill, J. T. (2010). ''[[Neill 2010 Program evaluation and outdoor education: An overview|Program evaluation and outdoor education: An overview]]''. Presentation to the 16th National Outdoor Education Conference, Notre Dame University, Fremantle, Western Australia, January 10-13.''
-
Priest, S. (2001). [http://www.findarticles.com/p/articles/mi_qa3907/is_200104/ai_n8942758 A program evaluation primer]. '' Journal of Experiential Education'', ''24''(1), 34-40.
+
Priest, S. (2001). [http://academic.evergreen.edu/curricular/atpsmpa/Priest.pdf A program evaluation primer]. '' Journal of Experiential Education'', ''24''(1), 34-40.
Watters, R. (1988). [http://www.isu.edu/outdoor/bencost.htm Benefit cost analysis of non-commercial outdoor programs]. In ''Proceedings of the 1986 Conference on Outdoor Recreation''.
Watters, R. (1988). [http://www.isu.edu/outdoor/bencost.htm Benefit cost analysis of non-commercial outdoor programs]. In ''Proceedings of the 1986 Conference on Outdoor Recreation''.
Line 54: Line 35:
[[Category:Experiential education]]
[[Category:Experiential education]]
[[Category:Outdoor education]]
[[Category:Outdoor education]]
-
[[Category:Program evaluation]]
+
[[Category:Program evaluation| ]]

Current revision

Program evaluation in outdoor education, adventure education, & other experiential intervention programs

Starting points

Recommended resources

References

Gass, M., & Neill, J. T. (2001). Introduction to program evaluation. Presentation to the 29th Annual International Conference of the Association for Experiential Education, 2 November.

Greenaway, R. Evaluation of training/learning books & reviews. Active Reviewing.

Hendricks, B. (no date). Improving evaluation in experiential education. ERIC Clearinghouse on Rural Education and Small Schools.

Neill, J. T. (2010). Program evaluation and outdoor education: An overview. Presentation to the 16th National Outdoor Education Conference, Notre Dame University, Fremantle, Western Australia, January 10-13.

Priest, S. (2001). A program evaluation primer. Journal of Experiential Education, 24(1), 34-40.

Watters, R. (1988). Benefit cost analysis of non-commercial outdoor programs. In Proceedings of the 1986 Conference on Outdoor Recreation.

Watters, R. (1991). Cost benefit analysis of recreation programs for the disabled. Idaho State University Outdoor Program, Pocatello, ID.

Personal tools