What is the right Bonferroni adjustment?All vs all post-hoc after Aligned Friedman (k classifiers over multiple datasets)Appropriate non-parametric post-hoc test for baseline comparisons?Bonferroni adjustment according to which families?Friedman's test is very significant, but its post hoc comparisons (SPSS) are not significantSome new questions re the Bonferroni correctionHow many comparisons should I use when applying the Bonferroni Correction?Level of Bonferroni Correction for Post-hoc Wilcoxon Signed RankBonferroni correction vs Adjusted Bonferroni p valueBonferroni correction for Wilcoxon signed rank test with 6 related samples?Bonferroni for Wilcoxon signed rank?

Drawing arrowtips at the end of each segment in a polygonal path

Are the related objects in an SOQL query shared?

Getting Lost in the Caves of Chaos

Why are there yellow dot stickers on the front doors of businesses in Russia?

How do the surviving Asgardians get to Earth?

C# TCP server/client class

Formal mathematical definition of renormalization group flow

A verb for when some rights are not violated?

Can I enter a rental property without giving notice if I'm afraid a tenant may be hurt?

Why do dragons like shiny stuff?

How do I know when and if a character requires a backstory?

How to increase Solr JVM memory

Why is it to say 'paucis post diebus'?

How to check a file was encrypted (really & correctly)

Why did the US Airways Flight 1549 passengers stay on the wings?

The Game of the Century - why didn't Byrne take the rook after he forked Fischer?

Can the Cauchy product of divergent series with itself be convergent?

Why wasn't interlaced CRT scanning done back and forth?

Why does putting a dot after the URL remove login information?

Is there a command-line tool for converting html files to pdf?

Is the first page of a novel really that important?

How easy is it to get a gun illegally in the United States?

Repeated! Factorials!

Probably terminated or laid off soon; confront or not?



What is the right Bonferroni adjustment?


All vs all post-hoc after Aligned Friedman (k classifiers over multiple datasets)Appropriate non-parametric post-hoc test for baseline comparisons?Bonferroni adjustment according to which families?Friedman's test is very significant, but its post hoc comparisons (SPSS) are not significantSome new questions re the Bonferroni correctionHow many comparisons should I use when applying the Bonferroni Correction?Level of Bonferroni Correction for Post-hoc Wilcoxon Signed RankBonferroni correction vs Adjusted Bonferroni p valueBonferroni correction for Wilcoxon signed rank test with 6 related samples?Bonferroni for Wilcoxon signed rank?






.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty margin-bottom:0;








4












$begingroup$


I am trying to test a hypothesis for my Masters Thesis.



There are 3 conditions (I will name them X, Y, Z), in each of which the data isn't normally distributed, and measures the improvement for each condition. I ran a Friedman test as a repeated measure, and in post-hoc I ran a Wilcoxon test with the Bonferroni adjustment.



My problem is that I want to compare only X vs Y and X vs Z (and not Y vs Z).



My question is this: for the Bonferroni correction do I need to divide by 2 or 3?



On one hand, there are 3 comparisons done in the SPSS test, but on the other I'm only interested in 2 of them.



Does this even count as a repeated measure?



Thank you!










share|cite|improve this question







New contributor



Izzy is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.






$endgroup$













  • $begingroup$
    We need more information for the "repeated measure" part of the question. Is this one group of subjects measured three times, or three different groups of subjects each measured once?
    $endgroup$
    – TPM
    8 hours ago










  • $begingroup$
    Note that "repeated measure" has a technical meaning in statistics, representing multiple measurements on the same individual under different conditions or over time. I think that what you're asking about is really multiple comparisons. If I'm correct, please change the tag and edit your question so that future visitors to this page won't be confused. If there is a repeated measures issue, please address the comment from @TPM.
    $endgroup$
    – EdM
    8 hours ago

















4












$begingroup$


I am trying to test a hypothesis for my Masters Thesis.



There are 3 conditions (I will name them X, Y, Z), in each of which the data isn't normally distributed, and measures the improvement for each condition. I ran a Friedman test as a repeated measure, and in post-hoc I ran a Wilcoxon test with the Bonferroni adjustment.



My problem is that I want to compare only X vs Y and X vs Z (and not Y vs Z).



My question is this: for the Bonferroni correction do I need to divide by 2 or 3?



On one hand, there are 3 comparisons done in the SPSS test, but on the other I'm only interested in 2 of them.



Does this even count as a repeated measure?



Thank you!










share|cite|improve this question







New contributor



Izzy is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.






$endgroup$













  • $begingroup$
    We need more information for the "repeated measure" part of the question. Is this one group of subjects measured three times, or three different groups of subjects each measured once?
    $endgroup$
    – TPM
    8 hours ago










  • $begingroup$
    Note that "repeated measure" has a technical meaning in statistics, representing multiple measurements on the same individual under different conditions or over time. I think that what you're asking about is really multiple comparisons. If I'm correct, please change the tag and edit your question so that future visitors to this page won't be confused. If there is a repeated measures issue, please address the comment from @TPM.
    $endgroup$
    – EdM
    8 hours ago













4












4








4





$begingroup$


I am trying to test a hypothesis for my Masters Thesis.



There are 3 conditions (I will name them X, Y, Z), in each of which the data isn't normally distributed, and measures the improvement for each condition. I ran a Friedman test as a repeated measure, and in post-hoc I ran a Wilcoxon test with the Bonferroni adjustment.



My problem is that I want to compare only X vs Y and X vs Z (and not Y vs Z).



My question is this: for the Bonferroni correction do I need to divide by 2 or 3?



On one hand, there are 3 comparisons done in the SPSS test, but on the other I'm only interested in 2 of them.



Does this even count as a repeated measure?



Thank you!










share|cite|improve this question







New contributor



Izzy is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.






$endgroup$




I am trying to test a hypothesis for my Masters Thesis.



There are 3 conditions (I will name them X, Y, Z), in each of which the data isn't normally distributed, and measures the improvement for each condition. I ran a Friedman test as a repeated measure, and in post-hoc I ran a Wilcoxon test with the Bonferroni adjustment.



My problem is that I want to compare only X vs Y and X vs Z (and not Y vs Z).



My question is this: for the Bonferroni correction do I need to divide by 2 or 3?



On one hand, there are 3 comparisons done in the SPSS test, but on the other I'm only interested in 2 of them.



Does this even count as a repeated measure?



Thank you!







hypothesis-testing repeated-measures nonparametric bonferroni friedman-test






share|cite|improve this question







New contributor



Izzy is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.










share|cite|improve this question







New contributor



Izzy is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.








share|cite|improve this question




share|cite|improve this question






New contributor



Izzy is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.








asked 8 hours ago









IzzyIzzy

211 bronze badge




211 bronze badge




New contributor



Izzy is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.




New contributor




Izzy is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
















  • $begingroup$
    We need more information for the "repeated measure" part of the question. Is this one group of subjects measured three times, or three different groups of subjects each measured once?
    $endgroup$
    – TPM
    8 hours ago










  • $begingroup$
    Note that "repeated measure" has a technical meaning in statistics, representing multiple measurements on the same individual under different conditions or over time. I think that what you're asking about is really multiple comparisons. If I'm correct, please change the tag and edit your question so that future visitors to this page won't be confused. If there is a repeated measures issue, please address the comment from @TPM.
    $endgroup$
    – EdM
    8 hours ago
















  • $begingroup$
    We need more information for the "repeated measure" part of the question. Is this one group of subjects measured three times, or three different groups of subjects each measured once?
    $endgroup$
    – TPM
    8 hours ago










  • $begingroup$
    Note that "repeated measure" has a technical meaning in statistics, representing multiple measurements on the same individual under different conditions or over time. I think that what you're asking about is really multiple comparisons. If I'm correct, please change the tag and edit your question so that future visitors to this page won't be confused. If there is a repeated measures issue, please address the comment from @TPM.
    $endgroup$
    – EdM
    8 hours ago















$begingroup$
We need more information for the "repeated measure" part of the question. Is this one group of subjects measured three times, or three different groups of subjects each measured once?
$endgroup$
– TPM
8 hours ago




$begingroup$
We need more information for the "repeated measure" part of the question. Is this one group of subjects measured three times, or three different groups of subjects each measured once?
$endgroup$
– TPM
8 hours ago












$begingroup$
Note that "repeated measure" has a technical meaning in statistics, representing multiple measurements on the same individual under different conditions or over time. I think that what you're asking about is really multiple comparisons. If I'm correct, please change the tag and edit your question so that future visitors to this page won't be confused. If there is a repeated measures issue, please address the comment from @TPM.
$endgroup$
– EdM
8 hours ago




$begingroup$
Note that "repeated measure" has a technical meaning in statistics, representing multiple measurements on the same individual under different conditions or over time. I think that what you're asking about is really multiple comparisons. If I'm correct, please change the tag and edit your question so that future visitors to this page won't be confused. If there is a repeated measures issue, please address the comment from @TPM.
$endgroup$
– EdM
8 hours ago










1 Answer
1






active

oldest

votes


















6












$begingroup$

To the best of my knowledge, the Bonferroni correction is based on the number of tests you actually perform, not on the total number of pairwise tests that you could perform. So if you set out to perform two pairwise comparisons, you should divide by two.






share|cite|improve this answer









$endgroup$










  • 1




    $begingroup$
    This is correct. One point to consider is that if the p-value for the YZ comparison turns out to be significant, it still shouldn't be considered significant. It should be as if you never calculated that p-value, since its calculation is just a matter of the software doing it by default (and this most likely can be changed).
    $endgroup$
    – Dave
    8 hours ago













Your Answer








StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "65"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);

else
createEditor();

);

function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);



);






Izzy is a new contributor. Be nice, and check out our Code of Conduct.









draft saved

draft discarded


















StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstats.stackexchange.com%2fquestions%2f420727%2fwhat-is-the-right-bonferroni-adjustment%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown

























1 Answer
1






active

oldest

votes








1 Answer
1






active

oldest

votes









active

oldest

votes






active

oldest

votes









6












$begingroup$

To the best of my knowledge, the Bonferroni correction is based on the number of tests you actually perform, not on the total number of pairwise tests that you could perform. So if you set out to perform two pairwise comparisons, you should divide by two.






share|cite|improve this answer









$endgroup$










  • 1




    $begingroup$
    This is correct. One point to consider is that if the p-value for the YZ comparison turns out to be significant, it still shouldn't be considered significant. It should be as if you never calculated that p-value, since its calculation is just a matter of the software doing it by default (and this most likely can be changed).
    $endgroup$
    – Dave
    8 hours ago















6












$begingroup$

To the best of my knowledge, the Bonferroni correction is based on the number of tests you actually perform, not on the total number of pairwise tests that you could perform. So if you set out to perform two pairwise comparisons, you should divide by two.






share|cite|improve this answer









$endgroup$










  • 1




    $begingroup$
    This is correct. One point to consider is that if the p-value for the YZ comparison turns out to be significant, it still shouldn't be considered significant. It should be as if you never calculated that p-value, since its calculation is just a matter of the software doing it by default (and this most likely can be changed).
    $endgroup$
    – Dave
    8 hours ago













6












6








6





$begingroup$

To the best of my knowledge, the Bonferroni correction is based on the number of tests you actually perform, not on the total number of pairwise tests that you could perform. So if you set out to perform two pairwise comparisons, you should divide by two.






share|cite|improve this answer









$endgroup$



To the best of my knowledge, the Bonferroni correction is based on the number of tests you actually perform, not on the total number of pairwise tests that you could perform. So if you set out to perform two pairwise comparisons, you should divide by two.







share|cite|improve this answer












share|cite|improve this answer



share|cite|improve this answer










answered 8 hours ago









ZombiePlan37ZombiePlan37

938 bronze badges




938 bronze badges










  • 1




    $begingroup$
    This is correct. One point to consider is that if the p-value for the YZ comparison turns out to be significant, it still shouldn't be considered significant. It should be as if you never calculated that p-value, since its calculation is just a matter of the software doing it by default (and this most likely can be changed).
    $endgroup$
    – Dave
    8 hours ago












  • 1




    $begingroup$
    This is correct. One point to consider is that if the p-value for the YZ comparison turns out to be significant, it still shouldn't be considered significant. It should be as if you never calculated that p-value, since its calculation is just a matter of the software doing it by default (and this most likely can be changed).
    $endgroup$
    – Dave
    8 hours ago







1




1




$begingroup$
This is correct. One point to consider is that if the p-value for the YZ comparison turns out to be significant, it still shouldn't be considered significant. It should be as if you never calculated that p-value, since its calculation is just a matter of the software doing it by default (and this most likely can be changed).
$endgroup$
– Dave
8 hours ago




$begingroup$
This is correct. One point to consider is that if the p-value for the YZ comparison turns out to be significant, it still shouldn't be considered significant. It should be as if you never calculated that p-value, since its calculation is just a matter of the software doing it by default (and this most likely can be changed).
$endgroup$
– Dave
8 hours ago










Izzy is a new contributor. Be nice, and check out our Code of Conduct.









draft saved

draft discarded


















Izzy is a new contributor. Be nice, and check out our Code of Conduct.












Izzy is a new contributor. Be nice, and check out our Code of Conduct.











Izzy is a new contributor. Be nice, and check out our Code of Conduct.














Thanks for contributing an answer to Cross Validated!


  • Please be sure to answer the question. Provide details and share your research!

But avoid


  • Asking for help, clarification, or responding to other answers.

  • Making statements based on opinion; back them up with references or personal experience.

Use MathJax to format equations. MathJax reference.


To learn more, see our tips on writing great answers.




draft saved


draft discarded














StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstats.stackexchange.com%2fquestions%2f420727%2fwhat-is-the-right-bonferroni-adjustment%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown





















































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown

































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown







Popular posts from this blog

Invision Community Contents History See also References External links Navigation menuProprietaryinvisioncommunity.comIPS Community ForumsIPS Community Forumsthis blog entry"License Changes, IP.Board 3.4, and the Future""Interview -- Matt Mecham of Ibforums""CEO Invision Power Board, Matt Mecham Is a Liar, Thief!"IPB License Explanation 1.3, 1.3.1, 2.0, and 2.1ArchivedSecurity Fixes, Updates And Enhancements For IPB 1.3.1Archived"New Demo Accounts - Invision Power Services"the original"New Default Skin"the original"Invision Power Board 3.0.0 and Applications Released"the original"Archived copy"the original"Perpetual licenses being done away with""Release Notes - Invision Power Services""Introducing: IPS Community Suite 4!"Invision Community Release Notes

Canceling a color specificationRandomly assigning color to Graphics3D objects?Default color for Filling in Mathematica 9Coloring specific elements of sets with a prime modified order in an array plotHow to pick a color differing significantly from the colors already in a given color list?Detection of the text colorColor numbers based on their valueCan color schemes for use with ColorData include opacity specification?My dynamic color schemes

Ласкавець круглолистий Зміст Опис | Поширення | Галерея | Примітки | Посилання | Навігаційне меню58171138361-22960890446Bupleurum rotundifoliumEuro+Med PlantbasePlants of the World Online — Kew ScienceGermplasm Resources Information Network (GRIN)Ласкавецькн. VI : Літери Ком — Левиправивши або дописавши її