Diff for "FAQ/RegressionOutliers" - CBU statistics Wiki
location: Diff for "FAQ/RegressionOutliers"
Differences between revisions 3 and 21 (spanning 18 versions)
Revision 3 as of 2006-06-30 22:57:01
Size: 974
Editor: Scripting Subsystem
Comment:
Revision 21 as of 2013-09-19 11:26:55
Size: 1538
Editor: PeterWatson
Comment:
Deletions are marked like this. Additions are marked like this.
Line 3: Line 3:

Leverage is also related to the i-th observation's [[FAQ/mahal|Mahalanobis distance]], MD(i), such that for sample size, N

Leverage for observation i = MD(i)/(N-1) + 1/N

so

Critical MD(i) = (2(p+1)/N - 1/N)(N-1)

(See Tabachnick and Fidell)

Other outlier detection methods using boxplots are in the Exploratory Data Analysis Graduate talk located [[StatsCourse2009|here]] or by using z-scores using tests such as Grubb's test - further details and an on-line calculator are located [[http://www.graphpad.com/quickcalcs/Grubbs1.cfm|here.]]
Line 8: Line 20:
'''Hair, J., Anderson, R., and Tatham, R. (1992).''' Multivariate Data Analysis (third edition). Englewood Cliffs, NJ: Prentice-Hall. '''Hair, J., Anderson, R., Tatham, R. and Black W. (1998).''' Multivariate Data Analysis (fifth edition). Englewood Cliffs, NJ: Prentice-Hall.
Line 12: Line 24:
[wiki:FAQ Return to Statistics FAQ page] [[FAQ|Return to Statistics FAQ page]]
Line 14: Line 26:
[wiki:CbuStatistics Return to Statistics main page] [[CbuStatistics|Return to Statistics main page]]
Line 16: Line 28:
[http://www.mrc-cbu.cam.ac.uk/ Return to CBU main page] [[http://www.mrc-cbu.cam.ac.uk/|Return to CBU main page]]
Line 18: Line 30:
These pages are maintained by [mailto:ian.nimmo-smith@mrc-cbu.cam.ac.uk Ian Nimmo-Smith] and [mailto:peter.watson@mrc-cbu.cam.ac.uk Peter Watson]
These pages are maintained by [[mailto:ian.nimmo-smith@mrc-cbu.cam.ac.uk|Ian Nimmo-Smith]] and [[mailto:peter.watson@mrc-cbu.cam.ac.uk|Peter Watson]]

Checking for outliers in regression

According to Hoaglin and Welsch (1978) leverage values above 2(p+1)/n where p predictors are in the regression on n observations (items) are influential values. If the sample size is < 30 a stiffer criterion such as 3(p+1)/n is suggested.

Leverage is also related to the i-th observation's Mahalanobis distance, MD(i), such that for sample size, N

Leverage for observation i = MD(i)/(N-1) + 1/N

so

Critical MD(i) = (2(p+1)/N - 1/N)(N-1)

(See Tabachnick and Fidell)

Other outlier detection methods using boxplots are in the Exploratory Data Analysis Graduate talk located here or by using z-scores using tests such as Grubb's test - further details and an on-line calculator are located here.

Hair, Anderson, Tatham and Black (1998) suggest Cook's distances greater than 1 are influential.

References

Hair, J., Anderson, R., Tatham, R. and Black W. (1998). Multivariate Data Analysis (fifth edition). Englewood Cliffs, NJ: Prentice-Hall.

Hoaglin, D. C. and Welsch, R. E. (1978). The hat matrix in regression and ANOVA. The American Statistician 32, 17-22.

Return to Statistics FAQ page

Return to Statistics main page

Return to CBU main page

These pages are maintained by Ian Nimmo-Smith and Peter Watson

None: FAQ/RegressionOutliers (last edited 2015-05-06 16:06:06 by PeterWatson)