Last changed 8 Oct 1998 ............... Length about 900 words (6000 bytes).
This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/mant/mantchiEval.html.

Web site logical path: [ www.psy.gla.ac.uk] [~steve] [mant] [this page]

MANTCHI overall evaluation report

I have written a long (9,000 word) paper overviewing the educational evaluation done on MANTCHI. It should be regarded as a draft, and comments of all kinds are welcome.

Title: "Evaluating remote collaborative tutorial teaching in MANTCHI"
Authors: Steve Draper & Margaret Brown

Abstract

This chapter overviews the integrative evaluation studies done during the MANTCHI project. About 20 studies were done of the many deliveries. In this chapter, some main conclusions each drawing on evidence from multiple studies are presented, together with discussion on the strengths and weaknesses of the method employed. Overall, the evaluation studies provided both formative and summative results. The formative information for improving the overall delivery of the material is exemplified by a selection of issues and recommendations, and a sample of the evidence on which they were based. The summative evidence on learning outcomes and quality suggests that the project materials are at least as effective as other material, although by no means always preferred by students. Our studies suggest however that the main gains are in improved curriculum content and in staff development (expanding the range of topics a teacher is confident of delivering), but that different evaluation methods must be developed and applied to study that properly.

Status

I expect to be using this for other things as well: in all

The ELT conference which will also publish a book / proceedings.
M.Oliver (1998) (ed.) Innovation in the evaluation of learning technology (London: University of North London)
A chunk /chapter in the project final report (I missed the interim report)
Project deliverable item number 15 "Summative Project evaluation".

Below are links to a version sent to the ELT conference. The last 4 pages are a reproduction of a questionnaire, and the format may get screwed up.

Postscript (if you click, you get a file you have to able to send to a postscript printer. Beware: probably only works on A4 paper.)

rtf (if you click you get a file. Open this from INSIDE Word, and you will probably get a good version).

Web form of an earlier version (part of a bigger report)

Web site logical path: [ www.psy.gla.ac.uk] [~steve] [mant] [this page]