[eli5] How do you test if your Analysis of Variance (ANOVA) results are valid?

435 views

If you do a Likert scale of confidence that X is linked to Y eg whether the sample believes that, say, socioeconomic status has an effect on health outcomes, from no-effect (1) to most-effect (10).

And since there are many such questions that link ANOVA rather than T-tests are suitable. But how d’you know if you can trust your ANOVA p-values and findings’ reliability? Some of the associations are null, so serve as a control comparison of guessed confidence btw.

Some say the residuals have to be normally distributed for ANOVA to be ‘robust’; others say it doesn’t matter. So, if it matters how d’you determine the residuals? Anyway, ultimately, how does one test/assess if ANOVA results are valid or not? Please explain like I’m a weird precocious five-year-old.

In: Other

2 Answers

Anonymous 0 Comments

Well for a start, a fixed scale from 0-10 is not really a good way to determine if two samples choose different numeric values on the scale. It’s just too coarse, no? Ppl choose extreme values in that scale, rather than being normal distributed around, say, 5.
If i face such weird distributions i never base it on t-Tests, but use Wilcox test. Im not an expert in likert scale Analysis, but you should be able to find cons and pros for using Wilcoxon for these kind of questions?

You are viewing 1 out of 2 answers, click here to view all answers.