What are examples of experiments or studies where pre-registration would not be feasible?
What makes a smart phone "kosher"?
Asked to Not Use Transactions and to Use A Workaround to Simulate One
Would it be unbalanced to increase Wild Shape uses based on level?
The Planck constant for mathematicians
Are there any “Third Order” acronyms used in space exploration?
Ambiguity in notation resolved by +
Planar regular languages
sed replacing character in a file
Is a suit against a University Dorm for changing policies on a whim likely to succeed (USA)?
What 68-pin connector is this on my 2.5" solid state drive?
What exactly is a marshrutka (маршрутка)?
Can druids change their starting cantrips each day?
Are there any rules about taking damage whilst holding your breath in combat?
Is using gradient descent for MIP a good idea?
Telling my mother that I have anorexia without panicking her
simjacker: which SIMs are vulnerable?
What do the French say for “Oh, you shouldn’t have”?
Why is the Digital 0 not 0V in computer systems?
Why is my fire extinguisher emptied after one use?
Permutations in Disguise
Should you only use colons and periods in dialogues?
Why are some files not movable on Windows 10?
In what sequence should an advanced civilization teach technology to medieval society to maximize rate of adoption?
What made 4/4 time the most common time signature?
What are examples of experiments or studies where pre-registration would not be feasible?
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty margin-bottom:0;
The incoming editor of Psychological Science mentions in an interview that pre-registration isn't feasible for all submissions to the journal:
In instances in which preregistration is feasible... we will continue to encourage authors to take these steps. Yet we must be fully cognizant that in some areas of the broad discipline of psychological science, these actions may not be possible or may be ill-advised.
What are examples or types of experiments or studies (in psychology or elsewhere) where pre-registration wouldn't be possible or would be ill-advised?
experiment-design pre-registration
edited 10 hours ago
Anyon
11.9k4 gold badges46 silver badges53 bronze badges
asked 13 hours ago
Curt J. SampsonCurt J. Sampson
4232 silver badges7 bronze badges
add a comment
|
The incoming editor of Psychological Science mentions in an interview that pre-registration isn't feasible for all submissions to the journal:
In instances in which preregistration is feasible... we will continue to encourage authors to take these steps. Yet we must be fully cognizant that in some areas of the broad discipline of psychological science, these actions may not be possible or may be ill-advised.
What are examples or types of experiments or studies (in psychology or elsewhere) where pre-registration wouldn't be possible or would be ill-advised?
experiment-design pre-registration
edited 10 hours ago
Anyon
11.9k4 gold badges46 silver badges53 bronze badges
asked 13 hours ago
Curt J. SampsonCurt J. Sampson
4232 silver badges7 bronze badges
add a comment
|
The incoming editor of Psychological Science mentions in an interview that pre-registration isn't feasible for all submissions to the journal:
In instances in which preregistration is feasible... we will continue to encourage authors to take these steps. Yet we must be fully cognizant that in some areas of the broad discipline of psychological science, these actions may not be possible or may be ill-advised.
What are examples or types of experiments or studies (in psychology or elsewhere) where pre-registration wouldn't be possible or would be ill-advised?
experiment-design pre-registration
edited 10 hours ago
Anyon
11.9k4 gold badges46 silver badges53 bronze badges
asked 13 hours ago
Curt J. SampsonCurt J. Sampson
4232 silver badges7 bronze badges
The incoming editor of Psychological Science mentions in an interview that pre-registration isn't feasible for all submissions to the journal:
In instances in which preregistration is feasible... we will continue to encourage authors to take these steps. Yet we must be fully cognizant that in some areas of the broad discipline of psychological science, these actions may not be possible or may be ill-advised.
What are examples or types of experiments or studies (in psychology or elsewhere) where pre-registration wouldn't be possible or would be ill-advised?
experiment-design pre-registration
experiment-design pre-registration
edited 10 hours ago
Anyon
11.9k4 gold badges46 silver badges53 bronze badges
asked 13 hours ago
Curt J. SampsonCurt J. Sampson
4232 silver badges7 bronze badges
edited 10 hours ago
Anyon
11.9k4 gold badges46 silver badges53 bronze badges
asked 13 hours ago
Curt J. SampsonCurt J. Sampson
4232 silver badges7 bronze badges
edited 10 hours ago
Anyon
11.9k4 gold badges46 silver badges53 bronze badges
edited 10 hours ago
Anyon
11.9k4 gold badges46 silver badges53 bronze badges
edited 10 hours ago
Anyon
11.9k4 gold badges46 silver badges53 bronze badges
11.9k4 gold badges46 silver badges53 bronze badges
asked 13 hours ago
Curt J. SampsonCurt J. Sampson
4232 silver badges7 bronze badges
asked 13 hours ago
Curt J. SampsonCurt J. Sampson
4232 silver badges7 bronze badges
asked 13 hours ago
Curt J. SampsonCurt J. Sampson
4232 silver badges7 bronze badges
4232 silver badges7 bronze badges
add a comment
|
add a comment
|
1 Answer
1
active
oldest
votes
Examples are areas where a study takes advantage of a sudden, unexpected event. For example, there have been studies about human memory related to unexpected tragedies. There was an idea that lots of Americans remembered exactly where they were when they found out that President Kennedy was shot. After the Challenger disaster, a study was done where they asked people where they were when they found out, and then asked them different amounts of time later (e.g. a year, 5 years and then ten years out), and they found that despite people being very certain of their memories, many people had recollections which changed drastically in the intervening time. Similar studies were done later for the Columbia disaster and 9/11. See summary [here], and 10 year followup to 9/11 [here]. These would be extremely hard to preregister without substantial ethical problems; I suspect that most journals and the public would frown on psychologists deliberately causing large-scale national catastrophes in order to preregister their studies.
The World Trade Center attack also provides also an example from another field: Right after 9/11 airplanes were grounded throughout the US. Multiple studies used this as an opportunity to study the impact of airplanes on the atmosphere. See here.
Editorial remark: The set of studies where preregistration is not feasible is a very tiny fraction of all studies, and the fact that such studies do exist should not in general be taken as an argument against broad requirements for preregistration.
answered 10 hours ago
JoshuaZJoshuaZ
2,7828 silver badges16 bronze badges
2
While one of course can't register a study for a future disaster on a specific date, it would seem to me possible either to register a study for a not-yet-specified disaster and date (giving a specification for what kind of disasters would qualify) or at least to register at the start of the study, before significant (or ideally, any) investigative work has been done. Do you have any thoughts on this?
– Curt J. Sampson
10 hours ago
@CurtJ.Sampson That certainly seems plausible, but I'm not an expert. Obvious issues would be that any disaster that meets the criteria might be too rare for this to be practical. As for the second suggestion of partial preregistration, that seems plausible, but my impression is that this class of study requires extremely fast reaction time already for both logistics and IRB reasons, so even some form of partial preregistration at the start would pose a potentially significant additional burden.
– JoshuaZ
10 hours ago
add a comment
|
Your Answer
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "415"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/4.0/"u003ecc by-sa 4.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
noCode: true, onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2facademia.stackexchange.com%2fquestions%2f137076%2fwhat-are-examples-of-experiments-or-studies-where-pre-registration-would-not-be%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
Examples are areas where a study takes advantage of a sudden, unexpected event. For example, there have been studies about human memory related to unexpected tragedies. There was an idea that lots of Americans remembered exactly where they were when they found out that President Kennedy was shot. After the Challenger disaster, a study was done where they asked people where they were when they found out, and then asked them different amounts of time later (e.g. a year, 5 years and then ten years out), and they found that despite people being very certain of their memories, many people had recollections which changed drastically in the intervening time. Similar studies were done later for the Columbia disaster and 9/11. See summary [here], and 10 year followup to 9/11 [here]. These would be extremely hard to preregister without substantial ethical problems; I suspect that most journals and the public would frown on psychologists deliberately causing large-scale national catastrophes in order to preregister their studies.
The World Trade Center attack also provides also an example from another field: Right after 9/11 airplanes were grounded throughout the US. Multiple studies used this as an opportunity to study the impact of airplanes on the atmosphere. See here.
Editorial remark: The set of studies where preregistration is not feasible is a very tiny fraction of all studies, and the fact that such studies do exist should not in general be taken as an argument against broad requirements for preregistration.
answered 10 hours ago
JoshuaZJoshuaZ
2,7828 silver badges16 bronze badges
2
While one of course can't register a study for a future disaster on a specific date, it would seem to me possible either to register a study for a not-yet-specified disaster and date (giving a specification for what kind of disasters would qualify) or at least to register at the start of the study, before significant (or ideally, any) investigative work has been done. Do you have any thoughts on this?
– Curt J. Sampson
10 hours ago
@CurtJ.Sampson That certainly seems plausible, but I'm not an expert. Obvious issues would be that any disaster that meets the criteria might be too rare for this to be practical. As for the second suggestion of partial preregistration, that seems plausible, but my impression is that this class of study requires extremely fast reaction time already for both logistics and IRB reasons, so even some form of partial preregistration at the start would pose a potentially significant additional burden.
– JoshuaZ
10 hours ago
add a comment
|
Examples are areas where a study takes advantage of a sudden, unexpected event. For example, there have been studies about human memory related to unexpected tragedies. There was an idea that lots of Americans remembered exactly where they were when they found out that President Kennedy was shot. After the Challenger disaster, a study was done where they asked people where they were when they found out, and then asked them different amounts of time later (e.g. a year, 5 years and then ten years out), and they found that despite people being very certain of their memories, many people had recollections which changed drastically in the intervening time. Similar studies were done later for the Columbia disaster and 9/11. See summary [here], and 10 year followup to 9/11 [here]. These would be extremely hard to preregister without substantial ethical problems; I suspect that most journals and the public would frown on psychologists deliberately causing large-scale national catastrophes in order to preregister their studies.
The World Trade Center attack also provides also an example from another field: Right after 9/11 airplanes were grounded throughout the US. Multiple studies used this as an opportunity to study the impact of airplanes on the atmosphere. See here.
Editorial remark: The set of studies where preregistration is not feasible is a very tiny fraction of all studies, and the fact that such studies do exist should not in general be taken as an argument against broad requirements for preregistration.
answered 10 hours ago
JoshuaZJoshuaZ
2,7828 silver badges16 bronze badges
2
While one of course can't register a study for a future disaster on a specific date, it would seem to me possible either to register a study for a not-yet-specified disaster and date (giving a specification for what kind of disasters would qualify) or at least to register at the start of the study, before significant (or ideally, any) investigative work has been done. Do you have any thoughts on this?
– Curt J. Sampson
10 hours ago
@CurtJ.Sampson That certainly seems plausible, but I'm not an expert. Obvious issues would be that any disaster that meets the criteria might be too rare for this to be practical. As for the second suggestion of partial preregistration, that seems plausible, but my impression is that this class of study requires extremely fast reaction time already for both logistics and IRB reasons, so even some form of partial preregistration at the start would pose a potentially significant additional burden.
– JoshuaZ
10 hours ago
add a comment
|
Examples are areas where a study takes advantage of a sudden, unexpected event. For example, there have been studies about human memory related to unexpected tragedies. There was an idea that lots of Americans remembered exactly where they were when they found out that President Kennedy was shot. After the Challenger disaster, a study was done where they asked people where they were when they found out, and then asked them different amounts of time later (e.g. a year, 5 years and then ten years out), and they found that despite people being very certain of their memories, many people had recollections which changed drastically in the intervening time. Similar studies were done later for the Columbia disaster and 9/11. See summary [here], and 10 year followup to 9/11 [here]. These would be extremely hard to preregister without substantial ethical problems; I suspect that most journals and the public would frown on psychologists deliberately causing large-scale national catastrophes in order to preregister their studies.
The World Trade Center attack also provides also an example from another field: Right after 9/11 airplanes were grounded throughout the US. Multiple studies used this as an opportunity to study the impact of airplanes on the atmosphere. See here.
Editorial remark: The set of studies where preregistration is not feasible is a very tiny fraction of all studies, and the fact that such studies do exist should not in general be taken as an argument against broad requirements for preregistration.
answered 10 hours ago
JoshuaZJoshuaZ
2,7828 silver badges16 bronze badges
Examples are areas where a study takes advantage of a sudden, unexpected event. For example, there have been studies about human memory related to unexpected tragedies. There was an idea that lots of Americans remembered exactly where they were when they found out that President Kennedy was shot. After the Challenger disaster, a study was done where they asked people where they were when they found out, and then asked them different amounts of time later (e.g. a year, 5 years and then ten years out), and they found that despite people being very certain of their memories, many people had recollections which changed drastically in the intervening time. Similar studies were done later for the Columbia disaster and 9/11. See summary [here], and 10 year followup to 9/11 [here]. These would be extremely hard to preregister without substantial ethical problems; I suspect that most journals and the public would frown on psychologists deliberately causing large-scale national catastrophes in order to preregister their studies.
The World Trade Center attack also provides also an example from another field: Right after 9/11 airplanes were grounded throughout the US. Multiple studies used this as an opportunity to study the impact of airplanes on the atmosphere. See here.
Editorial remark: The set of studies where preregistration is not feasible is a very tiny fraction of all studies, and the fact that such studies do exist should not in general be taken as an argument against broad requirements for preregistration.
answered 10 hours ago
JoshuaZJoshuaZ
2,7828 silver badges16 bronze badges
edited 10 hours ago
answered 10 hours ago
JoshuaZJoshuaZ
2,7828 silver badges16 bronze badges
answered 10 hours ago
JoshuaZJoshuaZ
2,7828 silver badges16 bronze badges
answered 10 hours ago
JoshuaZJoshuaZ
2,7828 silver badges16 bronze badges
2,7828 silver badges16 bronze badges
2
While one of course can't register a study for a future disaster on a specific date, it would seem to me possible either to register a study for a not-yet-specified disaster and date (giving a specification for what kind of disasters would qualify) or at least to register at the start of the study, before significant (or ideally, any) investigative work has been done. Do you have any thoughts on this?
– Curt J. Sampson
10 hours ago
@CurtJ.Sampson That certainly seems plausible, but I'm not an expert. Obvious issues would be that any disaster that meets the criteria might be too rare for this to be practical. As for the second suggestion of partial preregistration, that seems plausible, but my impression is that this class of study requires extremely fast reaction time already for both logistics and IRB reasons, so even some form of partial preregistration at the start would pose a potentially significant additional burden.
– JoshuaZ
10 hours ago
add a comment
|
2
While one of course can't register a study for a future disaster on a specific date, it would seem to me possible either to register a study for a not-yet-specified disaster and date (giving a specification for what kind of disasters would qualify) or at least to register at the start of the study, before significant (or ideally, any) investigative work has been done. Do you have any thoughts on this?
– Curt J. Sampson
10 hours ago
@CurtJ.Sampson That certainly seems plausible, but I'm not an expert. Obvious issues would be that any disaster that meets the criteria might be too rare for this to be practical. As for the second suggestion of partial preregistration, that seems plausible, but my impression is that this class of study requires extremely fast reaction time already for both logistics and IRB reasons, so even some form of partial preregistration at the start would pose a potentially significant additional burden.
– JoshuaZ
10 hours ago
2
2
While one of course can't register a study for a future disaster on a specific date, it would seem to me possible either to register a study for a not-yet-specified disaster and date (giving a specification for what kind of disasters would qualify) or at least to register at the start of the study, before significant (or ideally, any) investigative work has been done. Do you have any thoughts on this?
– Curt J. Sampson
10 hours ago
While one of course can't register a study for a future disaster on a specific date, it would seem to me possible either to register a study for a not-yet-specified disaster and date (giving a specification for what kind of disasters would qualify) or at least to register at the start of the study, before significant (or ideally, any) investigative work has been done. Do you have any thoughts on this?
– Curt J. Sampson
10 hours ago
@CurtJ.Sampson That certainly seems plausible, but I'm not an expert. Obvious issues would be that any disaster that meets the criteria might be too rare for this to be practical. As for the second suggestion of partial preregistration, that seems plausible, but my impression is that this class of study requires extremely fast reaction time already for both logistics and IRB reasons, so even some form of partial preregistration at the start would pose a potentially significant additional burden.
– JoshuaZ
10 hours ago
@CurtJ.Sampson That certainly seems plausible, but I'm not an expert. Obvious issues would be that any disaster that meets the criteria might be too rare for this to be practical. As for the second suggestion of partial preregistration, that seems plausible, but my impression is that this class of study requires extremely fast reaction time already for both logistics and IRB reasons, so even some form of partial preregistration at the start would pose a potentially significant additional burden.
– JoshuaZ
10 hours ago
add a comment
|
Thanks for contributing an answer to Academia Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2facademia.stackexchange.com%2fquestions%2f137076%2fwhat-are-examples-of-experiments-or-studies-where-pre-registration-would-not-be%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
