How to combine objectives and methods of evaluation in iterative ILE design: lessons learned from designing Ambre-add

Abstract : This paper deals with evaluating an Interactive Learning Environment during the iterative design process. Various aspects of the system must be assessed and a number of evaluation methods are available. In designing the interactive learning environment AMBRE-add, several techniques were combined to test and refine the system. In particular, we point out the merits of combining measures of the ILE's impact on learning with analyses of the learner's activity. In this paper, the approach used to evaluate AMBRE-add is described and analyzed, and its advantages and disadvantages are discussed. Then a general procedure for evaluating ILEs during iterative design is proposed.