Frequently Asked Questions

  1. Questions about distributions of random variables

  2. Questions involving analysis of variance and t-tests

  3. Questions about graphics and file handling

  4. Questions about correlations

  5. Questions about regression

  6. Questions about categorical data analysis

  7. Questions about p-values, significance, or power of tests

  8. Questions about nonparametric tests

  9. Questions about multivariate analyses

  10. Questions about time series

The FAQs below will be divided into categories including those above. Some of the FAQs have a few mathematical formulae which may be seen using mathplayer which may be downloaded for free from here. Computer code is featured in some of the FAQs and is highlighted in a (peach coloured) text box. This code can be copied directly to your personal PC file (e.g. into a SPSS syntax file) however you also need to copy any small piece of text immediately outside the text box when you copy the code in order to copy over the linebreaks or else you will find the text is copied over as a single line!

If you wish to search for a particular word and are using Internet Explorer just press Control-f and a 'find' slot will appear above the page in your browser. Also please note that macros in the EXCEL spreadsheets will not work (by default) unless they are enabled.

  1. Why are the degrees of freedom not whole numbers?

  2. Why does SPSS give a row of asterisks instead of a mean in the outputted pivot table?

  3. What does a number containing an 'E' signify and how do I remove it?

  4. What is an intention to treat analysis?

  5. How do I evaluate a number to a general power in SPSS?

  6. What is the relationship between the Pearson zero-order correlation and a simple regression estimate?

  7. What is the relationship between predictor variable correlations and the presence of a suppressor variable?

  8. How do I check for outliers in a simple regression with one predictor variable?

  9. How do I explain adding 0.5 to the cells for the odds ratio, d' or logit transform?

  10. What is heterogeneity of variance in SPSS Probit and Logit procedures?

  11. When should I use a logit analysis as opposed to an arcsine transformed ANOVA?

  12. Why don't I see fiducial confidence intervals doing a probit analysis in version 16 of SPSS?

  13. Meta-analysis issues: 1) How do I measure publication bias? 2) How do I obtain a confidence interval for pooled estimates from sets of log odds, Cohen's d and Pearson correlations using meta-analysis?

  14. How do I do a matched pairs comparison on dichotomous data using covariates in SPSS?

  15. How do I handle messy data in SPSS to produce duration times from dates and frequencies from strings?

  16. How do I compare a mean to a constant in EXCEL (one-sample t)?

  17. How do I calculate a 95% confidence interval for the group means from one-way ANOVAs (using either a within or between subjects factor)?

  18. How do I compute a t-test and F ratio using only summary measures in 2x2 between and within subjects ANOVAs?

  19. How do I work out degrees of freedom for terms in an ANOVA?

  20. In ANOVA and Regression, what do the various different types of Sums of Squares mean, and does the choice matter?

  21. Can I use subjects as a random or fixed factor in an ANOVA?

  22. Sums of squares used by R in lm, lmer and aov

  23. A note about unequal group sizes in ANOVA

  24. A note about different sums of squares in unbalanced factorial ANOVAs

  25. A note on comparing confidence intervals and statistical significance

  26. How do I obtain a pooled standard error of the mean?

  27. How do I obtain the standard deviation from the standard error of the mean (s.e.m.)?

  28. What is the variance of the mean of my transformed data and the variance of combinations of means?

  29. What is the value of the error variance for raw data using that of its scalar transformed data?

  30. What is the relationship between the mean and the median from a sample?

  31. A quick approximation for Normally distributed expected order statistics

  32. How do I derive an expected total for a subset of items based on the expected overall total?

  33. How do I compute a difference in errors adjusted for overall number of errors when the errors have different signs?

  34. How do I format data for input into a repeated measures analysis in SPSS?

  35. What does the TRANSPOSE ALL DATA option in the RESTRUCTURE menu do in SPSS?

  36. Using the VARSTOCASES command in SPSS to convert repeated measures formatted data to a random effects (including multilevel) model format (and the CASESTOVARS command for the reverse operation).

  37. How do I perform a repeated measures analysis of variance in SPSS?

  38. How do I perform a repeated measures analysis of variance in SPSS involving repeated measures factors with more than 99 levels?

  39. How do I perform a repeated measures analysis of variance in R including correcting for sphericity?

  40. How do I perform a repeated measures analysis of variance in GENSTAT (and R)?

  41. How do I perform a repeated measures analysis of variance in MINITAB (and use an analogous procedure in SPSS to produce post-hocs on a repeated measures factor)?

  42. How do I perform a non-standard comparison of means in a repeated measures anova in SPSS?

  43. How do I work out the meaning of a significant interaction?

  44. How do I interpret a four-way interaction?

  45. What is the effect of dropping a between by within subjects interaction on other terms in a mixed anova?

  46. How do I test for an interaction involving a continuous variable (moderation analysis)?

  47. What is the difference between a hierarchical and a stepwise regression?

  48. How do I perform a stepwise regression in SPSS involving interactions?

  49. Aspects of ANCOVA (Analysis of Covariance)

  50. Can I do an analysis of covariance using a regression (including computation of covariate adjusted means) and use this to adjust for regression to the mean?

  51. Inappropriate use of a constant covariate in repeated measures ANCOVA

  52. How do I adjust for varying covariates in a repeated measures ANOVA in SPSS?

  53. How do I obtain an interaction in SPSS to describe how a fixed covariate influences a repeated measures interaction?

  54. What summary measures can I use to describe repeated measures?

  55. How do I test for a trend between group means representing different subjects?

  56. Interpreting the intercept term in a regression when covarying out predictors of within-subject difference scores

  57. What is the importance of including an intercept term in the SPSS (between subjects ANOVA) univariate procedure?

  58. How do I obtain covariance terms involving the intercept term in a linear regression using SPSS?

  59. How do I compute linear trend coefficients for single cases?

  60. How do I compare a within subjects group difference to that of a single case?

  61. How do I interpret subsets in Tukey's HSD output?

  62. How do I compare all pairwise comparisons in a between subjects anova (and in a repeated measures anova)?

  63. Why won't SPSS let me do post hoc tests involving a within-subjects factor?

  64. How do I do a simple effects analysis in SPSS?

  65. How do I test whether one independent variable has an influence on a dependent variable other than via the mediation of a second independent variable? (Sobel Test)

  66. Can I fit two-way links between variables in a path model?

  67. How do I get SPSS to do a Chi-squared analysis of a two-way frequency table?

  68. How do I compare a list of observed frequencies with a list of my own expected frequencies?

  69. Using a chi-square to see if two or more proportions are equal

  70. How do I know which elements contribute to a relationship in a two-way frequency table?

  71. When do I use Fisher's exact test instead of chi-square?

  72. How do I obtain Fisher's exact test and chi-square for a two-way table in EXCEL or a 2x2 table on the web?

  73. When do I use the correction for continuity when performing a chi-square analysis on a 2x2 table?

  74. How do I do a linear trend of proportions in a Chi-squared analysis in SPSS?

  75. How do I test for a strictly increasing or decreasing series on a set of individuals (not necessarily linear)?

  76. How do I test for the presence of an unknown ordering across subjects using 2 Dimensional data?

  77. Repeated measures, Mixed models and Split-plot designs: A Rant

  78. What is the formula for Mauchly's W used for testing sphericity in univariate repeated measures anova?

  79. Why do I get a NAME? appearing in cells when I try to run an EXCEL spreadsheet program?

  80. How do I split comma delimited data occurring in a single cell into separate columns in EXCEL?

  81. How do I make bibliographic citations of a SPSS/PASW procedure?

  82. How do I copy a SPSS window into a document?

  83. Why does SPSS give me a file definition error message when I run syntax?

  84. How do I get my SPSS output file to open in a new version of SPSS?

  85. How do I e-mail a SPSS output file?

  86. How do I e-mail a SPSS data file created on a PC so that it is readable on a MAC (and vice-versa)?

  87. How do I read R syntax code into a R session and obtain primers on other issues to get started with R?

  88. How do I download R libraries?

  89. A primer on producing plots (and pdf copies) in R.

  90. How to avoid "$ operator is invalid for atomic vectors" in R

  91. How do I read a SPSS data file into SAS?

  92. How do I convert a Microsoft file application (e.g. powerpoint) into a pdf file?

  93. How do I recode ACE-R scores (prior to summing) in EXCEL?

  94. How do I put error bars on an EXCEL bar and line graphs?

  95. How do I plot boxplots in EXCEL?

  96. How do I scatterplot observations which have the same set of co-ordinates?

  97. How can I distinguish groups on a scatterplot in Excel?

  98. How do I do a multiple line plot of cluster profiles for different factors in SPSS?

  99. How do I produce a bar chart including one with empty categories in SPSS?

  100. Improved Confidence Limits for a binomial proportion and differences in binomial proportions

  101. How do I compare observed numbers correct to those expected by chance in a multi-choice task?

  102. How do I produce an interactive bar chart of percentages in SPSS?

  103. How do I put one or more regression lines on a scatterplot in SPSS Version 12.0 and above and in R?

  104. How do I plot user defined regression lines (such as those from ANCOVA) in R?

  105. Why does the R-squared change when I fix the intercept in my regression line from its least squares value?

  106. How do I produce a clustered boxplot and other more advanced graphics in SPSS?

  107. How do I convert a pdf file into a MSWord or MSPowerpoint file?

  108. How do I convert a powerpoint show file so it can print handouts?

  109. How do I activate a hypertext link in powerpoint?

  110. How do I add in the analysis toolkit into EXCEL?

  111. How should I deal with outliers when doing correlations?

  112. How do I correlate change in score with score at baseline?

  113. How do I measure agreement to see if two measures are measuring the same thing (Bland and Altman plots)?

  114. Can I do a correlation between two variables where one variable is less than or equal to the other?

  115. How do I produce nonparametric Spearman partial correlations using SPSS?

  116. What is Collinearity in multiple regression, and what do I do about it?

  117. How do I find the condition number of a matrix using R?

  118. How do I convert a factor variable into a numeric in R?

  119. How do I perform a regression with a categorical outcome?

  120. How do I look for the best fitting model with an unknown changepoints on ordered data?

  121. Regression diagnostics for categorical variables

  122. How can I design an experiment so that conditions are counterbalanced for order?

  123. What is the Wald statistic?

  124. How do I compute the standard error of X1 in a regression also featuring X2?

  125. What is the relationship between regressions involving variables A and B to those involving B-A and A+B in predicting an outcome?

  126. How do I test to see if a mean adjusted for a covariate equals zero in a single group?

  127. How do I compute the standard error of ''beta'' in a linear regression in SPSS?

  128. Residuals and (Non-)Normality

  129. How do I check Normality assumptions in repeated measures analyses in SPSS?

  130. What is the difference between within subjects effects and within subjects contrasts in SPSS?

  131. When should I use a Multivariate Analysis of Variance (MANOVA)?

  132. Testing normality including rules of thumb for skew, kurtosis in SPSS

  133. Methods of handling outliers.

  134. How do I compare a specific pair of groups post-hoc in SPSS using the Kruskal-Wallis test?

  135. How do I compare the distributions and magnitudes of a set of positive and negative values (including accessing results from nonparametric tests in SPSS 19 and later)?

  136. Post-hoc nonparametric pairwise comparisons of a one-way within subjects factor

  137. How do I know whether to use an exact or asymptotic p-value with a Mann-Whitney or Kruskal-Wallis test?

  138. Is there such a thing as a nonparametric regression?

  139. A note about using ranked outcomes in t-tests and ANOVAs

  140. Performing randomisation tests using nonparametric methods

  141. What is the expected total discrepancy score in a R choice task?

  142. How do I adjust p-values for number of comparisons using SPSS?

  143. What are adjusted p-values in SPSS?

  144. Combining p-values by Fisher's and Stouffer's methods

  145. Summing z values and summing t values

  146. Why does the value of one in the F distribution have a p-value which is less than 1?

  147. Improved Confidence Limits for a binomial proportion

  148. Is there an optimal ratio of cases to predictor variables I should have before doing a multivariate analysis?

  149. What is the relationship between significance tests of regression coefficients and of correlation coefficients?

  150. How do I compare two squared (semi-partial) correlation coefficients (R-squareds) from different samples?

  151. How do I compare two squared (semi-partial) correlation coefficients from the same sample?

  152. How do I adjust R-squareds for the number of predictors in a model?

  153. What are random effect and multilevel models and when do I use them?

  154. Where can I find out about using random effects (including multilevel) models in R (including obtaining proportion of variance explained by a variable) & in SPSS?

  155. What does 's' denote in describing a General Linear Model (GLM) and a note on Generalized Linear Models in SPSS?

  156. How do I perform all possible subsets regression in SPSS?

  157. How well does a regression line fit?

  158. How do I construct dummy variables for use in SPSS linear regression?

  159. Checking for outliers in regression

  160. What is the role of a Part or Semi-Partial Correlation in a regression?

  161. How do I obtain an average correlation?

  162. How do I test if a correlation is zero and compute its confidence interval?

  163. How many degrees of freedom are associated with a test of whether a zero-order or multiple correlation equals zero?

  164. How do I estimate a pooled correlation using multiple scores from a set of subjects?

  165. How do I adjust p-values to test if more than one correlation is zero?

  166. How do I obtain a 95% confidence interval for a correlation (or slope in a simple regression) in SPSS?

  167. How do I adjust a correlation for group differences?

  168. How do I compare a pair of correlations?

  169. How do I work out reliability for three or more items? (Cronbach's alpha, composite reliability and Raykov's rho)

  170. Can I combine pilot data with main study data?

  171. When and how do I evaluate a one-sided p-value?

  172. What sample sizes do I need for doing tests with a given power?

  173. What are polychoric correlations and how do I compute them and use in SPSS?

  174. Which matrix of loadings do I use doing a principal components extraction or non-PC analysis with a direct oblimin rotation when doing a factor analysis?

  175. What thresholds should I use for factor loading cut-offs?

  176. How do I compare a pair of factor loadings?

  177. How do I assess the importance of variables in a Normal Discriminant analysis?

  178. What is the difference between principal components analysis, principal axis analysis and other factor extraction methods?

  179. How do I interpret variables which load on more than one factor?

  180. How many factors/components should I retain in a factor/principal components analysis?

  181. A note on Cronbach's Alpha.

  182. How do I interpret variables which load on more than one factor?

  183. What is canonical correlation and where can I use it?

  184. What is multidimensional scaling and how do I do it?

  185. How do I handle missing data in multivariate analyses in SPSS?

  186. How do I find complete cases in SPSS and R?

  187. How can I detect identical cases in SPSS without having an ID number?

  188. How do I produce truncated exponential random variables using MATLAB?

  189. How do I obtain parameter estimates for finite Normal mixture distributions using SPSS and BMDP?

  190. How do I generate a random sample in EXCEL?

  191. Some thoughts on testing for randomness

  192. How do I find out how many people have a score above a certain value?

  193. How do I compute percentile thresholds for exponential data and use these in outlier detection?

  194. Additional kappa statistic evaluation in SPSS, benchmarks on size and a measure of inter-rater agreement based on Euclidean distances

  195. What is an intraclass correlation and how do I use it?

  196. A note on correcting for restriction of ranges which underestimate Pearson correlations

  197. How do I sum rescored scales in SPSS?

  198. How do I obtain sums and means of partially complete cases in SPSS?

  199. How do I obtain the mean of several variables, each minus the same constant?

  200. How do I compute z-scores in SPSS and what is their relationship to comparing group means?

  201. Why does my t-statistic have a negative sign?

  202. How do I use cumulative distribution functions to compute p-values in SPSS, EXCEL and R?

  203. How do I adjust for age in comparing survival times of two different groups?

  204. What is the relationship between intercept and slope for scores at two time points?

  205. Arctan functions in EXCEL.

  206. How do I obtain statistical distributions in MATLAB?

  207. How do I produce random variables which follow a negative skew distribution?

  208. Simulations sampling from data with replacement (bootstrapping)

  209. Bootstrapping without replacement (Secret Santa) in R

  210. Generating multivariate data with a required correlation matrix

  211. How do I obtain the formulae behind statistics outputted by SPSS algorithms?

  212. How do I summarise a fit for a logistic regression model?

  213. Why are the standard errors so large in logistic regression?

  214. How do I choose between different logistic regression models?

  215. Using an Odds Ratio to summarise a 2x2 frequency table

  216. How do I test an odds ratio?

  217. How do I combine proportions?

  218. Which discriminant analysis should I use to obtain thresholds to indicate levels of abnormality using a single variable?

  219. How do I plot and interpret a ROC curve in assessing strength in two group prediction?

  220. Can you recommend any two group discriminant diagnostics?

  221. Which output criteria should I use when using the casewise results option with the Normal discriminant method in SPSS?

  222. How do I compute signal detection diagnostics?

  223. Structural equation modelling in R

  224. What is Euclidean distance and how do I compute it?

  225. How do I detect multivariate outliers?

  226. Can you recommend any statistical textbooks?

  227. How do I check for multivariate normality?

  228. What do I do if I have unequal group covariance matrices when doing a MANOVA?

  229. How do I find p-values using critical values as input in SPSS?

  230. Adjusted p-values

  231. How do I do False Discovery Rate (FDR) corrections for multiple tests?

  232. How do I calculate and interpret conditional probabilities?

  233. What is a p-value?

  234. How do I produce equations using MS Word?

  235. A guide to magnitudes of effect size

  236. Problems using p-rep, the Probability of Replication

  237. A quick guide to choice of sample sizes for Cohen's effect sizes

  238. A note on comparing z and t statistics and their p-values?

  239. How do I convert a t-statistic into an effect size?

  240. How do I compute Cohen's d in SPSS?

  241. How do I compute Mean Square Error (MSE) in EXCEL or SPSS?

  242. A guide to obtaining confidence intervals for effect sizes

  243. How do I compute effect sizes?

  244. How do I do power calculations in SPSS, EXCEL, R and using web freeware?

  245. How do I compute statistical tests of equivalence?

  246. Computing Power for ANOVAs using the SPSS GLM procedure

  247. Computing Power for ANOVAs using the SPSS MANOVA procedure

  248. Jonckheere's and Page's L Trend Tests

  249. Fitting linear orthogonal polynomials

  250. How do I compare group means in a non-standard post-hoc contrast?

  251. How do I compare a set of group means with a control group mean?

  252. How do I manually compute t-statistics to compare means in a repeated measures ANOVA having 3 or more groups?

  253. Formulae for interaction sums of squares in balanced designs

  254. Information about Granger Causality

Return to Statistics main page

Return to CBU main page

These pages are maintained by Ian Nimmo-Smith and Peter Watson (/center)

[Last updated on 1 July 2006]