changingminds.org

How we change what others think, feel, believe and do

| Menu | Quick | Books | Share | Search | Settings |

Measurement error

 

Explanations > Social ResearchMeasurement > Measurement error

Random error | True score | Systematic error | Measurement error | Residual variance | See also

 

Things vary, and few more so than people. Variation is the bane of the experimenter who seeks to identify clear correlation.

Random error

Random error is that which causes random and uncontrollable effects in measured results across a sample, for example where rainy weather may depress some people.

The effect of random error is to cause additional spread in the measurement distribution, causing an increase in the standard deviation of the measurement. The average should not be affected, which is good news if this is being quoted in results.

The stability of the average is due to the effect of regression to the mean, whereby random effects makes a high score as likely as a low score, so in a random sample they eventually cancel one another out.

True score

The true score is that which is sought. It is not the same as the observed score as this includes the random error, as follows:

Observed score = True score + random error

When the random error is small, then the observed score will be close to the true score and thus be a fair representation. If, however, the random error is large, the observed score will be nothing like the true score and has no value.

The effect of random error is that repeated measurements will give a result across a range of measures, often with the true score in the middle. This is one reason why means are used (to cause regression to the mean).

Another effect is that if a test score is near a boundary it may incorrectly cross the boundary. For example a school exam result is close to the A/B grade level, then the grade given may not be a reflection of the actual ability of the student.

Assuming an observed score is that true score is a dangerous trap, particularly if you have no real idea of how big the random error may be.

Systematic error

In addition to natural error, additional variation from the true score may be introduced when there is some error caused by problems in the measurement system, such as when bad weather affects everyone in the study or when poor questions results in answers which do not reflect true opinions.

There are many ways of allowing or introducing systematic error and elimination of this is a critical part of experimental design, as well as assessment of the context environment at the time of the experiment.

The effect of systematic error is often to shift the mean of the measurement distribution, which can be particularly pernicious if this is to be quoted in results.

Measurement error

Measurement error is the real variation from the true score, and includes both random error and systematic error.

Observed score = True score + random error + systematic error

Measurement error can be reduced by such as:

  • Testing questions in a range of settings.
  • Asking respondents afterwards whether they felt inappropriately encouraged at any time.
  • Carefully training the research associates who are helping implementation of your experiment.
  • Double-entry of data (type in in twice).
  • Double-checking formulae in spreadsheets.

Residual variance

When measuring variance in analysis of data, for example using the F-ratio, the model variance is the variance that can be explained by the experiment, and this thus 'good' variance. Residual variance is that which cannot be explained by the model being used and is hence undesirable.

A test statistic may thus, for example, be based on the ratio of the model variance to the residual variance. The F-ratio is calculated as MSM/MSR, where MS is the mean square.

See also

Sampling error, Test statistic, Two error types

Variation chapter in 'Toolbook'

 

Site Menu

| Home | Top | Quick Links | Settings |

Main sections: | Disciplines | Techniques | Principles | Explanations | Theories |

Other sections: | Blog! | Quotes | Guest articles | Analysis | Books | Help |

More pages: | Contact | Caveat | About | Students | Webmasters | Awards | Guestbook | Feedback | Sitemap | Changes |

Settings: | Computer layout | Mobile layout | Small font | Medium font | Large font | Translate |

 

You can buy books here

More Kindle books:

And the big
paperback book


Look inside

 

Please help and share:

 

Quick links

Disciplines

* Argument
* Brand management
* Change Management
* Coaching
* Communication
* Counseling
* Game Design
* Human Resources
* Job-finding
* Leadership
* Marketing
* Politics
* Propaganda
* Rhetoric
* Negotiation
* Psychoanalysis
* Sales
* Sociology
* Storytelling
* Teaching
* Warfare
* Workplace design

Techniques

* Assertiveness
* Body language
* Change techniques
* Closing techniques
* Conversation
* Confidence tricks
* Conversion
* Creative techniques
* General techniques
* Happiness
* Hypnotism
* Interrogation
* Language
* Listening
* Negotiation tactics
* Objection handling
* Propaganda
* Problem-solving
* Public speaking
* Questioning
* Using repetition
* Resisting persuasion
* Self-development
* Sequential requests
* Storytelling
* Stress Management
* Tipping
* Using humor
* Willpower

Principles

* Principles

Explanations

* Behaviors
* Beliefs
* Brain stuff
* Conditioning
* Coping Mechanisms
* Critical Theory
* Culture
* Decisions
* Emotions
* Evolution
* Gender
* Games
* Groups
* Habit
* Identity
* Learning
* Meaning
* Memory
* Motivation
* Models
* Needs
* Personality
* Power
* Preferences
* Research
* Relationships
* SIFT Model
* Social Research
* Stress
* Trust
* Values

Theories

* Alphabetic list
* Theory types

And

About
Guest Articles
Blog!
Books
Changes
Contact
Guestbook
Quotes
Students
Webmasters

 

| Home | Top | Menu | Quick Links |

© Changing Works 2002-
Massive Content — Maximum Speed

Site Menu

| Home | Top | Quick Links | Settings |

Main sections: | Disciplines | Techniques | Principles | Explanations | Theories |

Other sections: | Blog! | Quotes | Guest articles | Analysis | Books | Help |

More pages: | Contact | Caveat | About | Students | Webmasters | Awards | Guestbook | Feedback | Sitemap | Changes |

Settings: | Computer layout | Mobile layout | Small font | Medium font | Large font | Translate |

 

 

Please help and share:

 

Quick links

Disciplines

* Argument
* Brand management
* Change Management
* Coaching
* Communication
* Counseling
* Game Design
* Human Resources
* Job-finding
* Leadership
* Marketing
* Politics
* Propaganda
* Rhetoric
* Negotiation
* Psychoanalysis
* Sales
* Sociology
* Storytelling
* Teaching
* Warfare
* Workplace design

Techniques

* Assertiveness
* Body language
* Change techniques
* Closing techniques
* Conversation
* Confidence tricks
* Conversion
* Creative techniques
* General techniques
* Happiness
* Hypnotism
* Interrogation
* Language
* Listening
* Negotiation tactics
* Objection handling
* Propaganda
* Problem-solving
* Public speaking
* Questioning
* Using repetition
* Resisting persuasion
* Self-development
* Sequential requests
* Storytelling
* Stress Management
* Tipping
* Using humor
* Willpower

Principles

+ Principles

Explanations

* Behaviors
* Beliefs
* Brain stuff
* Conditioning
* Coping Mechanisms
* Critical Theory
* Culture
* Decisions
* Emotions
* Evolution
* Gender
* Games
* Groups
* Habit
* Identity
* Learning
* Meaning
* Memory
* Motivation
* Models
* Needs
* Personality
* Power
* Preferences
* Research
* Relationships
* SIFT Model
* Social Research
* Stress
* Trust
* Values

Theories

* Alphabetic list
* Theory types

And

About
Guest Articles
Blog!
Books
Changes
Contact
Guestbook
Quotes
Students
Webmasters

 

| Home | Top | Menu | Quick Links |

© Changing Works 2002-
Massive Content — Maximum Speed