Ruling out Chance as an Explanation (1 of 5)

next
When an independent variable appears to have an effect, it is very important to be able to state with confidence that the effect was really due to the variable and not just due to chance. For instance, consider a hypothetical experiment on a new antidepressant drug. Ten people suffering from depression were sampled and treated with the new drug (the experimental group); an additional 10 people were sampled from the same population and were treated only with a placebo (the control group). After 12 weeks, the level of depression in all subjects was measured and it was found that the mean level of depression (on a 10-point scale with higher numbers indicating more depression) was 4 for the experimental group and 6 for the control group. The most basic question that can be asked here is: "How can one be sure that the drug treatment rather than chance occurrences were responsible for the difference between the groups?" It could be, that by chance, the people who were randomly assigned to the treatment group were initially somewhat less depressed than those randomly assigned to the control group.
next