next up previous index
Next: Question type Up: Baseline model performance Previous: Discussion

Repeated questions across evaluators

In addition to the straightforward numerical scores which the judges scored each participant at, there are some additional information that can be gathered from the data. For instance, it is interesting to note that several questions were repeated across the judges. Consider the case of Lycanthrope: This provides further support that the evaluators have a core set of ideas concerning what questions a reader should be able to answer, if they comprehended the stories.



Kenneth Moorman
11/4/1997