What is the right Bonferroni adjustment?All vs all post-hoc after Aligned Friedman (k classifiers over multiple datasets)Appropriate non-parametric post-hoc test for baseline comparisons?Bonferroni adjustment according to which families?Friedman's test is very significant, but its post hoc comparisons (SPSS) are not significantSome new questions re the Bonferroni correctionHow many comparisons should I use when applying the Bonferroni Correction?Level of Bonferroni Correction for Post-hoc Wilcoxon Signed RankBonferroni correction vs Adjusted Bonferroni p valueBonferroni correction for Wilcoxon signed rank test with 6 related samples?Bonferroni for Wilcoxon signed rank?

Drawing arrowtips at the end of each segment in a polygonal path

Are the related objects in an SOQL query shared?

Getting Lost in the Caves of Chaos

Why are there yellow dot stickers on the front doors of businesses in Russia?

How do the surviving Asgardians get to Earth?

C# TCP server/client class

Formal mathematical definition of renormalization group flow

A verb for when some rights are not violated?

Can I enter a rental property without giving notice if I'm afraid a tenant may be hurt?

Why do dragons like shiny stuff?

How do I know when and if a character requires a backstory?

How to increase Solr JVM memory

Why is it to say 'paucis post diebus'?

How to check a file was encrypted (really & correctly)

Why did the US Airways Flight 1549 passengers stay on the wings?

The Game of the Century - why didn't Byrne take the rook after he forked Fischer?

Can the Cauchy product of divergent series with itself be convergent?

Why wasn't interlaced CRT scanning done back and forth?

Why does putting a dot after the URL remove login information?

Is there a command-line tool for converting html files to pdf?

Is the first page of a novel really that important?

How easy is it to get a gun illegally in the United States?

Repeated! Factorials!

Probably terminated or laid off soon; confront or not?



What is the right Bonferroni adjustment?


All vs all post-hoc after Aligned Friedman (k classifiers over multiple datasets)Appropriate non-parametric post-hoc test for baseline comparisons?Bonferroni adjustment according to which families?Friedman's test is very significant, but its post hoc comparisons (SPSS) are not significantSome new questions re the Bonferroni correctionHow many comparisons should I use when applying the Bonferroni Correction?Level of Bonferroni Correction for Post-hoc Wilcoxon Signed RankBonferroni correction vs Adjusted Bonferroni p valueBonferroni correction for Wilcoxon signed rank test with 6 related samples?Bonferroni for Wilcoxon signed rank?






.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty margin-bottom:0;








4












$begingroup$


I am trying to test a hypothesis for my Masters Thesis.



There are 3 conditions (I will name them X, Y, Z), in each of which the data isn't normally distributed, and measures the improvement for each condition. I ran a Friedman test as a repeated measure, and in post-hoc I ran a Wilcoxon test with the Bonferroni adjustment.



My problem is that I want to compare only X vs Y and X vs Z (and not Y vs Z).



My question is this: for the Bonferroni correction do I need to divide by 2 or 3?



On one hand, there are 3 comparisons done in the SPSS test, but on the other I'm only interested in 2 of them.



Does this even count as a repeated measure?



Thank you!










share|cite|improve this question







New contributor



Izzy is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.






$endgroup$













  • $begingroup$
    We need more information for the "repeated measure" part of the question. Is this one group of subjects measured three times, or three different groups of subjects each measured once?
    $endgroup$
    – TPM
    8 hours ago










  • $begingroup$
    Note that "repeated measure" has a technical meaning in statistics, representing multiple measurements on the same individual under different conditions or over time. I think that what you're asking about is really multiple comparisons. If I'm correct, please change the tag and edit your question so that future visitors to this page won't be confused. If there is a repeated measures issue, please address the comment from @TPM.
    $endgroup$
    – EdM
    8 hours ago

















4












$begingroup$


I am trying to test a hypothesis for my Masters Thesis.



There are 3 conditions (I will name them X, Y, Z), in each of which the data isn't normally distributed, and measures the improvement for each condition. I ran a Friedman test as a repeated measure, and in post-hoc I ran a Wilcoxon test with the Bonferroni adjustment.



My problem is that I want to compare only X vs Y and X vs Z (and not Y vs Z).



My question is this: for the Bonferroni correction do I need to divide by 2 or 3?



On one hand, there are 3 comparisons done in the SPSS test, but on the other I'm only interested in 2 of them.



Does this even count as a repeated measure?



Thank you!










share|cite|improve this question







New contributor



Izzy is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.






$endgroup$













  • $begingroup$
    We need more information for the "repeated measure" part of the question. Is this one group of subjects measured three times, or three different groups of subjects each measured once?
    $endgroup$
    – TPM
    8 hours ago










  • $begingroup$
    Note that "repeated measure" has a technical meaning in statistics, representing multiple measurements on the same individual under different conditions or over time. I think that what you're asking about is really multiple comparisons. If I'm correct, please change the tag and edit your question so that future visitors to this page won't be confused. If there is a repeated measures issue, please address the comment from @TPM.
    $endgroup$
    – EdM
    8 hours ago













4












4








4





$begingroup$


I am trying to test a hypothesis for my Masters Thesis.



There are 3 conditions (I will name them X, Y, Z), in each of which the data isn't normally distributed, and measures the improvement for each condition. I ran a Friedman test as a repeated measure, and in post-hoc I ran a Wilcoxon test with the Bonferroni adjustment.



My problem is that I want to compare only X vs Y and X vs Z (and not Y vs Z).



My question is this: for the Bonferroni correction do I need to divide by 2 or 3?



On one hand, there are 3 comparisons done in the SPSS test, but on the other I'm only interested in 2 of them.



Does this even count as a repeated measure?



Thank you!










share|cite|improve this question







New contributor



Izzy is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.






$endgroup$




I am trying to test a hypothesis for my Masters Thesis.



There are 3 conditions (I will name them X, Y, Z), in each of which the data isn't normally distributed, and measures the improvement for each condition. I ran a Friedman test as a repeated measure, and in post-hoc I ran a Wilcoxon test with the Bonferroni adjustment.



My problem is that I want to compare only X vs Y and X vs Z (and not Y vs Z).



My question is this: for the Bonferroni correction do I need to divide by 2 or 3?



On one hand, there are 3 comparisons done in the SPSS test, but on the other I'm only interested in 2 of them.



Does this even count as a repeated measure?



Thank you!







hypothesis-testing repeated-measures nonparametric bonferroni friedman-test






share|cite|improve this question







New contributor



Izzy is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.










share|cite|improve this question







New contributor



Izzy is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.








share|cite|improve this question




share|cite|improve this question






New contributor



Izzy is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.








asked 8 hours ago









IzzyIzzy

211 bronze badge




211 bronze badge




New contributor



Izzy is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.




New contributor




Izzy is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
















  • $begingroup$
    We need more information for the "repeated measure" part of the question. Is this one group of subjects measured three times, or three different groups of subjects each measured once?
    $endgroup$
    – TPM
    8 hours ago










  • $begingroup$
    Note that "repeated measure" has a technical meaning in statistics, representing multiple measurements on the same individual under different conditions or over time. I think that what you're asking about is really multiple comparisons. If I'm correct, please change the tag and edit your question so that future visitors to this page won't be confused. If there is a repeated measures issue, please address the comment from @TPM.
    $endgroup$
    – EdM
    8 hours ago
















  • $begingroup$
    We need more information for the "repeated measure" part of the question. Is this one group of subjects measured three times, or three different groups of subjects each measured once?
    $endgroup$
    – TPM
    8 hours ago










  • $begingroup$
    Note that "repeated measure" has a technical meaning in statistics, representing multiple measurements on the same individual under different conditions or over time. I think that what you're asking about is really multiple comparisons. If I'm correct, please change the tag and edit your question so that future visitors to this page won't be confused. If there is a repeated measures issue, please address the comment from @TPM.
    $endgroup$
    – EdM
    8 hours ago















$begingroup$
We need more information for the "repeated measure" part of the question. Is this one group of subjects measured three times, or three different groups of subjects each measured once?
$endgroup$
– TPM
8 hours ago




$begingroup$
We need more information for the "repeated measure" part of the question. Is this one group of subjects measured three times, or three different groups of subjects each measured once?
$endgroup$
– TPM
8 hours ago












$begingroup$
Note that "repeated measure" has a technical meaning in statistics, representing multiple measurements on the same individual under different conditions or over time. I think that what you're asking about is really multiple comparisons. If I'm correct, please change the tag and edit your question so that future visitors to this page won't be confused. If there is a repeated measures issue, please address the comment from @TPM.
$endgroup$
– EdM
8 hours ago




$begingroup$
Note that "repeated measure" has a technical meaning in statistics, representing multiple measurements on the same individual under different conditions or over time. I think that what you're asking about is really multiple comparisons. If I'm correct, please change the tag and edit your question so that future visitors to this page won't be confused. If there is a repeated measures issue, please address the comment from @TPM.
$endgroup$
– EdM
8 hours ago










1 Answer
1






active

oldest

votes


















6












$begingroup$

To the best of my knowledge, the Bonferroni correction is based on the number of tests you actually perform, not on the total number of pairwise tests that you could perform. So if you set out to perform two pairwise comparisons, you should divide by two.






share|cite|improve this answer









$endgroup$










  • 1




    $begingroup$
    This is correct. One point to consider is that if the p-value for the YZ comparison turns out to be significant, it still shouldn't be considered significant. It should be as if you never calculated that p-value, since its calculation is just a matter of the software doing it by default (and this most likely can be changed).
    $endgroup$
    – Dave
    8 hours ago













Your Answer








StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "65"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);

else
createEditor();

);

function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);



);






Izzy is a new contributor. Be nice, and check out our Code of Conduct.









draft saved

draft discarded


















StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstats.stackexchange.com%2fquestions%2f420727%2fwhat-is-the-right-bonferroni-adjustment%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown

























1 Answer
1






active

oldest

votes








1 Answer
1






active

oldest

votes









active

oldest

votes






active

oldest

votes









6












$begingroup$

To the best of my knowledge, the Bonferroni correction is based on the number of tests you actually perform, not on the total number of pairwise tests that you could perform. So if you set out to perform two pairwise comparisons, you should divide by two.






share|cite|improve this answer









$endgroup$










  • 1




    $begingroup$
    This is correct. One point to consider is that if the p-value for the YZ comparison turns out to be significant, it still shouldn't be considered significant. It should be as if you never calculated that p-value, since its calculation is just a matter of the software doing it by default (and this most likely can be changed).
    $endgroup$
    – Dave
    8 hours ago















6












$begingroup$

To the best of my knowledge, the Bonferroni correction is based on the number of tests you actually perform, not on the total number of pairwise tests that you could perform. So if you set out to perform two pairwise comparisons, you should divide by two.






share|cite|improve this answer









$endgroup$










  • 1




    $begingroup$
    This is correct. One point to consider is that if the p-value for the YZ comparison turns out to be significant, it still shouldn't be considered significant. It should be as if you never calculated that p-value, since its calculation is just a matter of the software doing it by default (and this most likely can be changed).
    $endgroup$
    – Dave
    8 hours ago













6












6








6





$begingroup$

To the best of my knowledge, the Bonferroni correction is based on the number of tests you actually perform, not on the total number of pairwise tests that you could perform. So if you set out to perform two pairwise comparisons, you should divide by two.






share|cite|improve this answer









$endgroup$



To the best of my knowledge, the Bonferroni correction is based on the number of tests you actually perform, not on the total number of pairwise tests that you could perform. So if you set out to perform two pairwise comparisons, you should divide by two.







share|cite|improve this answer












share|cite|improve this answer



share|cite|improve this answer










answered 8 hours ago









ZombiePlan37ZombiePlan37

938 bronze badges




938 bronze badges










  • 1




    $begingroup$
    This is correct. One point to consider is that if the p-value for the YZ comparison turns out to be significant, it still shouldn't be considered significant. It should be as if you never calculated that p-value, since its calculation is just a matter of the software doing it by default (and this most likely can be changed).
    $endgroup$
    – Dave
    8 hours ago












  • 1




    $begingroup$
    This is correct. One point to consider is that if the p-value for the YZ comparison turns out to be significant, it still shouldn't be considered significant. It should be as if you never calculated that p-value, since its calculation is just a matter of the software doing it by default (and this most likely can be changed).
    $endgroup$
    – Dave
    8 hours ago







1




1




$begingroup$
This is correct. One point to consider is that if the p-value for the YZ comparison turns out to be significant, it still shouldn't be considered significant. It should be as if you never calculated that p-value, since its calculation is just a matter of the software doing it by default (and this most likely can be changed).
$endgroup$
– Dave
8 hours ago




$begingroup$
This is correct. One point to consider is that if the p-value for the YZ comparison turns out to be significant, it still shouldn't be considered significant. It should be as if you never calculated that p-value, since its calculation is just a matter of the software doing it by default (and this most likely can be changed).
$endgroup$
– Dave
8 hours ago










Izzy is a new contributor. Be nice, and check out our Code of Conduct.









draft saved

draft discarded


















Izzy is a new contributor. Be nice, and check out our Code of Conduct.












Izzy is a new contributor. Be nice, and check out our Code of Conduct.











Izzy is a new contributor. Be nice, and check out our Code of Conduct.














Thanks for contributing an answer to Cross Validated!


  • Please be sure to answer the question. Provide details and share your research!

But avoid


  • Asking for help, clarification, or responding to other answers.

  • Making statements based on opinion; back them up with references or personal experience.

Use MathJax to format equations. MathJax reference.


To learn more, see our tips on writing great answers.




draft saved


draft discarded














StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstats.stackexchange.com%2fquestions%2f420727%2fwhat-is-the-right-bonferroni-adjustment%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown





















































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown

































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown







Popular posts from this blog

Invision Community Contents History See also References External links Navigation menuProprietaryinvisioncommunity.comIPS Community ForumsIPS Community Forumsthis blog entry"License Changes, IP.Board 3.4, and the Future""Interview -- Matt Mecham of Ibforums""CEO Invision Power Board, Matt Mecham Is a Liar, Thief!"IPB License Explanation 1.3, 1.3.1, 2.0, and 2.1ArchivedSecurity Fixes, Updates And Enhancements For IPB 1.3.1Archived"New Demo Accounts - Invision Power Services"the original"New Default Skin"the original"Invision Power Board 3.0.0 and Applications Released"the original"Archived copy"the original"Perpetual licenses being done away with""Release Notes - Invision Power Services""Introducing: IPS Community Suite 4!"Invision Community Release Notes

Canceling a color specificationRandomly assigning color to Graphics3D objects?Default color for Filling in Mathematica 9Coloring specific elements of sets with a prime modified order in an array plotHow to pick a color differing significantly from the colors already in a given color list?Detection of the text colorColor numbers based on their valueCan color schemes for use with ColorData include opacity specification?My dynamic color schemes

Tom Holland Mục lục Đầu đời và giáo dục | Sự nghiệp | Cuộc sống cá nhân | Phim tham gia | Giải thưởng và đề cử | Chú thích | Liên kết ngoài | Trình đơn chuyển hướngProfile“Person Details for Thomas Stanley Holland, "England and Wales Birth Registration Index, 1837-2008" — FamilySearch.org”"Meet Tom Holland... the 16-year-old star of The Impossible""Schoolboy actor Tom Holland finds himself in Oscar contention for role in tsunami drama"“Naomi Watts on the Prince William and Harry's reaction to her film about the late Princess Diana”lưu trữ"Holland and Pflueger Are West End's Two New 'Billy Elliots'""I'm so envious of my son, the movie star! British writer Dominic Holland's spent 20 years trying to crack Hollywood - but he's been beaten to it by a very unlikely rival"“Richard and Margaret Povey of Jersey, Channel Islands, UK: Information about Thomas Stanley Holland”"Tom Holland to play Billy Elliot""New Billy Elliot leaving the garage"Billy Elliot the Musical - Tom Holland - Billy"A Tale of four Billys: Tom Holland""The Feel Good Factor""Thames Christian College schoolboys join Myleene Klass for The Feelgood Factor""Government launches £600,000 arts bursaries pilot""BILLY's Chapman, Holland, Gardner & Jackson-Keen Visit Prime Minister""Elton John 'blown away' by Billy Elliot fifth birthday" (video with John's interview and fragments of Holland's performance)"First News interviews Arrietty's Tom Holland"“33rd Critics' Circle Film Awards winners”“National Board of Review Current Awards”Bản gốc"Ron Howard Whaling Tale 'In The Heart Of The Sea' Casts Tom Holland"“'Spider-Man' Finds Tom Holland to Star as New Web-Slinger”lưu trữ“Captain America: Civil War (2016)”“Film Review: ‘Captain America: Civil War’”lưu trữ“‘Captain America: Civil War’ review: Choose your own avenger”lưu trữ“The Lost City of Z reviews”“Sony Pictures and Marvel Studios Find Their 'Spider-Man' Star and Director”“‘Mary Magdalene’, ‘Current War’ & ‘Wind River’ Get 2017 Release Dates From Weinstein”“Lionsgate Unleashing Daisy Ridley & Tom Holland Starrer ‘Chaos Walking’ In Cannes”“PTA's 'Master' Leads Chicago Film Critics Nominations, UPDATED: Houston and Indiana Critics Nominations”“Nominaciones Goya 2013 Telecinco Cinema – ENG”“Jameson Empire Film Awards: Martin Freeman wins best actor for performance in The Hobbit”“34th Annual Young Artist Awards”Bản gốc“Teen Choice Awards 2016—Captain America: Civil War Leads Second Wave of Nominations”“BAFTA Film Award Nominations: ‘La La Land’ Leads Race”“Saturn Awards Nominations 2017: 'Rogue One,' 'Walking Dead' Lead”Tom HollandTom HollandTom HollandTom Hollandmedia.gettyimages.comWorldCat Identities300279794no20130442900000 0004 0355 42791085670554170004732cb16706349t(data)XX5557367