What is the right Bonferroni adjustment?All vs all post-hoc after Aligned Friedman (k classifiers over multiple datasets)Appropriate non-parametric post-hoc test for baseline comparisons?Bonferroni adjustment according to which families?Friedman's test is very significant, but its post hoc comparisons (SPSS) are not significantSome new questions re the Bonferroni correctionHow many comparisons should I use when applying the Bonferroni Correction?Level of Bonferroni Correction for Post-hoc Wilcoxon Signed RankBonferroni correction vs Adjusted Bonferroni p valueBonferroni correction for Wilcoxon signed rank test with 6 related samples?Bonferroni for Wilcoxon signed rank?
Drawing arrowtips at the end of each segment in a polygonal path
Are the related objects in an SOQL query shared?
Getting Lost in the Caves of Chaos
Why are there yellow dot stickers on the front doors of businesses in Russia?
How do the surviving Asgardians get to Earth?
C# TCP server/client class
Formal mathematical definition of renormalization group flow
A verb for when some rights are not violated?
Can I enter a rental property without giving notice if I'm afraid a tenant may be hurt?
Why do dragons like shiny stuff?
How do I know when and if a character requires a backstory?
How to increase Solr JVM memory
Why is it to say 'paucis post diebus'?
How to check a file was encrypted (really & correctly)
Why did the US Airways Flight 1549 passengers stay on the wings?
The Game of the Century - why didn't Byrne take the rook after he forked Fischer?
Can the Cauchy product of divergent series with itself be convergent?
Why wasn't interlaced CRT scanning done back and forth?
Why does putting a dot after the URL remove login information?
Is there a command-line tool for converting html files to pdf?
Is the first page of a novel really that important?
How easy is it to get a gun illegally in the United States?
Repeated! Factorials!
Probably terminated or laid off soon; confront or not?
What is the right Bonferroni adjustment?
All vs all post-hoc after Aligned Friedman (k classifiers over multiple datasets)Appropriate non-parametric post-hoc test for baseline comparisons?Bonferroni adjustment according to which families?Friedman's test is very significant, but its post hoc comparisons (SPSS) are not significantSome new questions re the Bonferroni correctionHow many comparisons should I use when applying the Bonferroni Correction?Level of Bonferroni Correction for Post-hoc Wilcoxon Signed RankBonferroni correction vs Adjusted Bonferroni p valueBonferroni correction for Wilcoxon signed rank test with 6 related samples?Bonferroni for Wilcoxon signed rank?
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty margin-bottom:0;
$begingroup$
I am trying to test a hypothesis for my Masters Thesis.
There are 3 conditions (I will name them X, Y, Z), in each of which the data isn't normally distributed, and measures the improvement for each condition. I ran a Friedman test as a repeated measure, and in post-hoc I ran a Wilcoxon test with the Bonferroni adjustment.
My problem is that I want to compare only X vs Y and X vs Z (and not Y vs Z).
My question is this: for the Bonferroni correction do I need to divide by 2 or 3?
On one hand, there are 3 comparisons done in the SPSS test, but on the other I'm only interested in 2 of them.
Does this even count as a repeated measure?
Thank you!
hypothesis-testing repeated-measures nonparametric bonferroni friedman-test
New contributor
$endgroup$
add a comment |
$begingroup$
I am trying to test a hypothesis for my Masters Thesis.
There are 3 conditions (I will name them X, Y, Z), in each of which the data isn't normally distributed, and measures the improvement for each condition. I ran a Friedman test as a repeated measure, and in post-hoc I ran a Wilcoxon test with the Bonferroni adjustment.
My problem is that I want to compare only X vs Y and X vs Z (and not Y vs Z).
My question is this: for the Bonferroni correction do I need to divide by 2 or 3?
On one hand, there are 3 comparisons done in the SPSS test, but on the other I'm only interested in 2 of them.
Does this even count as a repeated measure?
Thank you!
hypothesis-testing repeated-measures nonparametric bonferroni friedman-test
New contributor
$endgroup$
$begingroup$
We need more information for the "repeated measure" part of the question. Is this one group of subjects measured three times, or three different groups of subjects each measured once?
$endgroup$
– TPM
8 hours ago
$begingroup$
Note that "repeated measure" has a technical meaning in statistics, representing multiple measurements on the same individual under different conditions or over time. I think that what you're asking about is really multiple comparisons. If I'm correct, please change the tag and edit your question so that future visitors to this page won't be confused. If there is a repeated measures issue, please address the comment from @TPM.
$endgroup$
– EdM
8 hours ago
add a comment |
$begingroup$
I am trying to test a hypothesis for my Masters Thesis.
There are 3 conditions (I will name them X, Y, Z), in each of which the data isn't normally distributed, and measures the improvement for each condition. I ran a Friedman test as a repeated measure, and in post-hoc I ran a Wilcoxon test with the Bonferroni adjustment.
My problem is that I want to compare only X vs Y and X vs Z (and not Y vs Z).
My question is this: for the Bonferroni correction do I need to divide by 2 or 3?
On one hand, there are 3 comparisons done in the SPSS test, but on the other I'm only interested in 2 of them.
Does this even count as a repeated measure?
Thank you!
hypothesis-testing repeated-measures nonparametric bonferroni friedman-test
New contributor
$endgroup$
I am trying to test a hypothesis for my Masters Thesis.
There are 3 conditions (I will name them X, Y, Z), in each of which the data isn't normally distributed, and measures the improvement for each condition. I ran a Friedman test as a repeated measure, and in post-hoc I ran a Wilcoxon test with the Bonferroni adjustment.
My problem is that I want to compare only X vs Y and X vs Z (and not Y vs Z).
My question is this: for the Bonferroni correction do I need to divide by 2 or 3?
On one hand, there are 3 comparisons done in the SPSS test, but on the other I'm only interested in 2 of them.
Does this even count as a repeated measure?
Thank you!
hypothesis-testing repeated-measures nonparametric bonferroni friedman-test
hypothesis-testing repeated-measures nonparametric bonferroni friedman-test
New contributor
New contributor
New contributor
asked 8 hours ago
IzzyIzzy
211 bronze badge
211 bronze badge
New contributor
New contributor
$begingroup$
We need more information for the "repeated measure" part of the question. Is this one group of subjects measured three times, or three different groups of subjects each measured once?
$endgroup$
– TPM
8 hours ago
$begingroup$
Note that "repeated measure" has a technical meaning in statistics, representing multiple measurements on the same individual under different conditions or over time. I think that what you're asking about is really multiple comparisons. If I'm correct, please change the tag and edit your question so that future visitors to this page won't be confused. If there is a repeated measures issue, please address the comment from @TPM.
$endgroup$
– EdM
8 hours ago
add a comment |
$begingroup$
We need more information for the "repeated measure" part of the question. Is this one group of subjects measured three times, or three different groups of subjects each measured once?
$endgroup$
– TPM
8 hours ago
$begingroup$
Note that "repeated measure" has a technical meaning in statistics, representing multiple measurements on the same individual under different conditions or over time. I think that what you're asking about is really multiple comparisons. If I'm correct, please change the tag and edit your question so that future visitors to this page won't be confused. If there is a repeated measures issue, please address the comment from @TPM.
$endgroup$
– EdM
8 hours ago
$begingroup$
We need more information for the "repeated measure" part of the question. Is this one group of subjects measured three times, or three different groups of subjects each measured once?
$endgroup$
– TPM
8 hours ago
$begingroup$
We need more information for the "repeated measure" part of the question. Is this one group of subjects measured three times, or three different groups of subjects each measured once?
$endgroup$
– TPM
8 hours ago
$begingroup$
Note that "repeated measure" has a technical meaning in statistics, representing multiple measurements on the same individual under different conditions or over time. I think that what you're asking about is really multiple comparisons. If I'm correct, please change the tag and edit your question so that future visitors to this page won't be confused. If there is a repeated measures issue, please address the comment from @TPM.
$endgroup$
– EdM
8 hours ago
$begingroup$
Note that "repeated measure" has a technical meaning in statistics, representing multiple measurements on the same individual under different conditions or over time. I think that what you're asking about is really multiple comparisons. If I'm correct, please change the tag and edit your question so that future visitors to this page won't be confused. If there is a repeated measures issue, please address the comment from @TPM.
$endgroup$
– EdM
8 hours ago
add a comment |
1 Answer
1
active
oldest
votes
$begingroup$
To the best of my knowledge, the Bonferroni correction is based on the number of tests you actually perform, not on the total number of pairwise tests that you could perform. So if you set out to perform two pairwise comparisons, you should divide by two.
$endgroup$
1
$begingroup$
This is correct. One point to consider is that if the p-value for the YZ comparison turns out to be significant, it still shouldn't be considered significant. It should be as if you never calculated that p-value, since its calculation is just a matter of the software doing it by default (and this most likely can be changed).
$endgroup$
– Dave
8 hours ago
add a comment |
Your Answer
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "65"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Izzy is a new contributor. Be nice, and check out our Code of Conduct.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstats.stackexchange.com%2fquestions%2f420727%2fwhat-is-the-right-bonferroni-adjustment%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
To the best of my knowledge, the Bonferroni correction is based on the number of tests you actually perform, not on the total number of pairwise tests that you could perform. So if you set out to perform two pairwise comparisons, you should divide by two.
$endgroup$
1
$begingroup$
This is correct. One point to consider is that if the p-value for the YZ comparison turns out to be significant, it still shouldn't be considered significant. It should be as if you never calculated that p-value, since its calculation is just a matter of the software doing it by default (and this most likely can be changed).
$endgroup$
– Dave
8 hours ago
add a comment |
$begingroup$
To the best of my knowledge, the Bonferroni correction is based on the number of tests you actually perform, not on the total number of pairwise tests that you could perform. So if you set out to perform two pairwise comparisons, you should divide by two.
$endgroup$
1
$begingroup$
This is correct. One point to consider is that if the p-value for the YZ comparison turns out to be significant, it still shouldn't be considered significant. It should be as if you never calculated that p-value, since its calculation is just a matter of the software doing it by default (and this most likely can be changed).
$endgroup$
– Dave
8 hours ago
add a comment |
$begingroup$
To the best of my knowledge, the Bonferroni correction is based on the number of tests you actually perform, not on the total number of pairwise tests that you could perform. So if you set out to perform two pairwise comparisons, you should divide by two.
$endgroup$
To the best of my knowledge, the Bonferroni correction is based on the number of tests you actually perform, not on the total number of pairwise tests that you could perform. So if you set out to perform two pairwise comparisons, you should divide by two.
answered 8 hours ago
ZombiePlan37ZombiePlan37
938 bronze badges
938 bronze badges
1
$begingroup$
This is correct. One point to consider is that if the p-value for the YZ comparison turns out to be significant, it still shouldn't be considered significant. It should be as if you never calculated that p-value, since its calculation is just a matter of the software doing it by default (and this most likely can be changed).
$endgroup$
– Dave
8 hours ago
add a comment |
1
$begingroup$
This is correct. One point to consider is that if the p-value for the YZ comparison turns out to be significant, it still shouldn't be considered significant. It should be as if you never calculated that p-value, since its calculation is just a matter of the software doing it by default (and this most likely can be changed).
$endgroup$
– Dave
8 hours ago
1
1
$begingroup$
This is correct. One point to consider is that if the p-value for the YZ comparison turns out to be significant, it still shouldn't be considered significant. It should be as if you never calculated that p-value, since its calculation is just a matter of the software doing it by default (and this most likely can be changed).
$endgroup$
– Dave
8 hours ago
$begingroup$
This is correct. One point to consider is that if the p-value for the YZ comparison turns out to be significant, it still shouldn't be considered significant. It should be as if you never calculated that p-value, since its calculation is just a matter of the software doing it by default (and this most likely can be changed).
$endgroup$
– Dave
8 hours ago
add a comment |
Izzy is a new contributor. Be nice, and check out our Code of Conduct.
Izzy is a new contributor. Be nice, and check out our Code of Conduct.
Izzy is a new contributor. Be nice, and check out our Code of Conduct.
Izzy is a new contributor. Be nice, and check out our Code of Conduct.
Thanks for contributing an answer to Cross Validated!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstats.stackexchange.com%2fquestions%2f420727%2fwhat-is-the-right-bonferroni-adjustment%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
$begingroup$
We need more information for the "repeated measure" part of the question. Is this one group of subjects measured three times, or three different groups of subjects each measured once?
$endgroup$
– TPM
8 hours ago
$begingroup$
Note that "repeated measure" has a technical meaning in statistics, representing multiple measurements on the same individual under different conditions or over time. I think that what you're asking about is really multiple comparisons. If I'm correct, please change the tag and edit your question so that future visitors to this page won't be confused. If there is a repeated measures issue, please address the comment from @TPM.
$endgroup$
– EdM
8 hours ago