'Second pretest for text-picture validation study (longer text segments)'
(AsPredicted #87,271)
Download PDF

---

---

1) Have any data been collected for this study already?
No, no data have been collected for this study yet.

2) What's the main question being asked or hypothesis being tested in this study?
The aim of this pre-study is to create a stimulus set consisting of story-picture pairs, where one story matches the picture well and one story does not match the picture well.
The stimulus set used in this pre-study consists of 92 story-picture pairs. Each story-picture pair consists of one schematic drawing and either a story supposed to match, or a story supposed to mismatch the picture. Each story consists of four sentences and the two stories only differ in their last word.

3) Describe the key dependent variable(s) specifying how they will be measured.
Verification time per matching story-picture combination: Mean reaction time to judge a matching combination as correct; calculated per item and averaged over all participants.
Falsification time per mismatching story-picture combination: Mean reaction time to rate a mismatched combination as false (falsification time); calculated per item and averaged over all participants.
Wrong classification/error rate per item: Counting how often the items are assigned incorrectly (matching story-picture combinations rated as false; mismatched story-picture combinations rated as correct).

4) How many and which conditions will participants be assigned to?
Two randomized list of items: Every list includes one story-picture combination of every pair. This means every participant rates the validity of 92 story-picture combinations. In addition, 24 attention-check items are included. Twelve attention-check items ask a short yes-no comprehension question about the story's content. Twelve items ask if the participant has just seen that picture.

5) Specify exactly which analyses you will conduct to examine the main question/hypothesis.
Overall, we aim for a homogeneous item set in terms of reaction times and error rates.
Reaction time analysis: We will analyse the mean verification time per matching story-picture combination and the mean falsification time per mismatched story-picture combination.  
Error rate analysis: Based on the mean error rate for all participant, the average number of times an item is randomly assigned incorrectly is calculated. Items that are incorrectly assigned more often than expected based on this error rate will be analysed further. It will be checked whether only participants with low data quality misassigned the item, or whether several participants with high data quality also misassigned the item. Data quality is measured via the error rate of each participant and a self-assessment at the end of the questionnaire.

6) Describe exactly how outliers will be defined and handled, and your precise rule(s) for excluding observations.
Participants who do not agree to have their data processed will be deleted.
Subjects with an error rate of more than 25% in the trial run (before the experimental phase) must repeat the trial run. Participants who have to repeat the trial run three or more times will be excluded.
In addition, we will exclude participants who answer twelve or more of our 24 attention check items incorrectly.
Participants with an error-rate above 3 SDs compared to the error rate of the other participants will be excluded.
Furthermore, trials with a reaction time above 25.000ms will be excluded. However, this will only be the case if 25.000ms is more than 3 SD higher than the average reaction time of the respective participant.
Finally, for the reaction time analyses only those trials with correct classification will be included.

7) How many observations will be collected or what will determine sample size?
No need to justify decision, but be precise about exactly how the number will be determined.
50 participants will be assessed (25 per condition).

8) Anything else you would like to pre-register?
(e.g., secondary analyses, variables collected for exploratory purposes, unusual analyses planned?)
Participants will be recruited via Prolific. Screening criteria will be language (first language = German, German as a fluent language, Germany as current place of residence), age (between 18 and 35), no reading related disorder, right-handedness and no participation in the previous studies on that topic.