1. Understanding
the stimulus is the key to answering any question, and reading the question
stem first tends to undermine the ability of students to fully comprehend
the information in the stimulus. On easy questions this distraction
tends not to have a significant negative impact, but on more difficult
questions the student often is forced to read the stimulus twice in
order to get full comprehension, thus wasting valuable time. Literally,
by reading the question stem first, students are forced to juggle two
things at once: the question stem and the information in the stimulus.
That is a difficult task when under time pressure.
The bottom line
is that any viable strategy must be effective against questions at all
difficulty levels, but when you read the question stem first you cannot
perform optimally. True, the approach works with the easy questions,
but those questions could very likely have been answered correctly regardless
of the strategy used.
2. Reading the question
stem first often wastes valuable time since the typical student will
read the stem, then read the stimulus, and then read the stem again.
Unfortunately, there simply is not enough time to read every question
stem twice.
3. Some question
stems refer to information given in the stimulus, or add new conditions
onto the stimulus information. Thus, reading the stem first is of little
value and often confuses or distracts the student when they go to read
the stimulus.
4. On stimuli with
two questions, reading one stem biases the reader to look for that specific
information, possibly causing problems while doing the second question,
and reading both stems wastes entirely too much time and leads to confusion.
5. For truly knowledgeable
test takers there are situations that arise where the question stem
is fairly predictable. One easy example-and there are others-is with
Resolve the Paradox questions. Usually, when you read the stimulus that
accompanies these questions, an obvious paradox or discrepancy is presented.
Reading the question stem beforehand does not add anything to what you
would have known just from reading the stimulus.
6. Finally, it strikes
us that one of the principles underlying the read-the-question-first
approach is flawed. Many advocates of the approach claim that it helps
the test taker avoid the "harder" questions, such as Parallel
Reasoning or Method of Reasoning. In our experience, and supported by
test data, questions of any type can be hard or easy. Some Method of
Reasoning questions are phenomenally easy whereas some Method of Reasoning
questions are extremely difficult. In short, the question stem is a
poor indicator of difficulty because question difficulty is more directly
related to the complexity of the stimulus and the corresponding answer
choices.