How we change what others think, feel, believe and do 
Experimental Effect
Explanations > Social Research > Statistical principles > Experimental Effect Description  Example  Discussion  See also
DescriptionThe effect, or effect size, is an indication of the practical importance of an experimental result. In essence, 'effect' is the gap between two measures, although it must be measured with a statistical value. A big effect means the two measures are very different, not just 'different' (which is what 'statistically significant' means). Experimenters hence seek not only statistical significance but also a large effect. Sadly, they do not always find both in the same place. MeasuresThe most common measure of effect is the Pearson correlation, r. r = SQRT( SS_{M} / SS_{T}) Where SS_{M} is the betweengroups sum of the squares, and SS_{T} is the total sum of squares. A slightly more complex measure used to reduce bias due to sampling (as opposed to using a population) is omega, w. This is calculated as: w = SQRT( (MS_{M}  MS_{R}) / (MS_{M} + ((n1) x MS_{R})) ) Where MS_{X} is the mean sum of the squares (SS/df), with M being between groups and R being within groups. 'df' is the degrees of freedom. Omega is typically used for ANOVA effect calculation (where MS is already used in the Fratio). Effect sizeCohen (1988) gives the rules of thumb for effect size for r (or omega):
Note that r is nonlinear, and doubling it does not double the effect size. ExampleA measure of men and women in a study shows a statistically significant difference in their body mass index (BMI). r is calculated as 0.05 which is not that big an effect and considered not worth reporting. However, when the data is segmented based on age, it is found that r is 0.43. The statistical significance is not as high, but the effect is much greater than for gender difference and considered to be carried forward as the main findings of the report. DiscussionAn experiment can report a statistically significant result, but this just says that the experiment has shown that there is a difference between two conditions, not that it is 'significant' in the usual sense of meaning 'big' and 'important' or otherwise earthshattering in any way. It is important in reporting experiments to indicate the effect as well as the significance. The American Psychological Association (APA) now recommends that all experimental reports include an indication of effect. See alsoConfidence, Two error types, Experimental power

Site Menu 
 Home  Top  Quick Links  Settings  
Main sections:  Disciplines  Techniques  Principles  Explanations  Theories  
Other sections:  Blog!  Quotes  Guest articles  Analysis  Books  Help  
More pages:  Contact  Caveat  About  Students  Webmasters  Awards  Guestbook  Feedback  Sitemap  Changes  
Settings:  Computer layout  Mobile layout  Small font  Medium font  Large font  Translate  
 Home  Top  Menu  Quick Links  
© Changing Works 2002 