Following a Non-Significant Finding (1 of 3)

next
An experimenter wishes to test the hypothesis that sleep deprivation increases reaction time. An experiment is conducted comparing the reaction times of 10 people who have missed a night's sleep with 10 control subjects. although the sleep-deprived subjects react more slowly, the difference is not significant, p = 0.10, two tailed. Should the experimenter be more or less certain that sleep deprivation increases reaction time than he or she was before the experiment was conducted. The naive approach is to argue that there was no significant difference between the sleep-deprived and the control group so the experimenter should now be less confident that sleep deprivation increases reaction time. This argument implicitly assumes that the null hypothesis should be accepted when it is not rejected. A more straightforward and more correct approach is to consider that the experimenter expected the sleep-deprived group to have slower reaction time, and they did. The experimenter's prediction was correct. It is just that the difference was not large enough to rule out chance as an explanation.
next