A methodological approach for university teaching evaluation: the multilevel Rasch model

In this paper a generalization of the Rating Scale Model (RSM) with a hierarchical data structure will be presented. Having shown how the RSM, as with other Rasch models, may be read in terms of a Generalized Linear Mixed Model (GLMM) with two aggregation levels, a presentation will be given of an extension to the case of measuring the latent trait of individuals aggregated in groups. The use of this model will be illustrated via reference to the evaluation of university teaching by students following the courses. The aim is to generate a ranking of teaching on the basis of student satisfaction, so as to give teachers, and those responsible for organizing study courses, a background of information that takes the opinions of the direct target group for university teaching (that is, the students) into account, in the context of improving the teaching programmes available.