Next: Question type
Up: Baseline model performance
Previous: Discussion
In addition to the straightforward numerical
scores which the judges scored each
participant at, there are some additional
information that can be gathered from the
data. For instance, it is interesting to note that several
questions were repeated across the judges.
Consider the case of Lycanthrope:
- Who is the narrator?
- What is lycanthropy?
- What determines what form a lycanthrope will take?
- What does Ed turn into?
This provides further support that the evaluators
have a core set of ideas concerning what questions
a reader should be able to answer, if they comprehended
the stories.
Kenneth Moorman
11/4/1997