Ruling out Chance as an Explanation (1 of 5)
When an
independent variable appears to
have an effect, it is very important to be able to state with
confidence that the effect was really due to the variable and not
just due to chance. For instance, consider a hypothetical experiment
on a new antidepressant drug. Ten people suffering from depression
were sampled and treated with the new drug (the experimental group);
an additional 10 people were sampled from the same population and
were treated only with a placebo (the control group). After 12 weeks,
the level of depression in all subjects was measured and it was found
that the mean level of depression (on a 10-point scale with higher
numbers indicating more depression) was 4 for the experimental group
and 6 for the control group. The most basic question that can be
asked here is: "How can one be sure that the drug treatment rather
than chance occurrences were responsible for the difference between
the groups?" It could be, that by chance, the people who were
randomly assigned to the treatment group were initially somewhat less
depressed than those randomly assigned to the control group.