#115,948 | AsPredicted

'Online knowledge revision study 3'
(AsPredicted #115,948)


Author(s)
Pauline Frick ( Leibniz-Institut für Wissensmedien) - pauline.frick@uni-tuebingen.de
Panayiota Kendeou (University of Minnesota) - kend0040@umn.edu
Anne Schüler (Leibniz-Institut für Wissensmedien Tübingen) - a.schueler@iwm-tuebingen.de
Pre-registered on
2022/12/09 04:16 (PT)

1) Have any data been collected for this study already?
No, no data have been collected for this study yet.

2) What's the main question being asked or hypothesis being tested in this study?
The aim of this study is to investigate how pictures potentially influence knowledge revision processes during reading.
Participants will read 12 text passages (used in Study #110454). Importantly, all of the text passages contain information that is revised later in the text. Reading time for a target sentence, referring to this revised information, is measured. Additionally, we measure the reading time for the sentence following the target sentence (i.e., spillover sentence).
We will vary how the texts are presented: texts are either presented without pictures, with a picture showing the information that is consistent with the subsequent target sentence (i.e., the picture shows the revised information), or with a picture showing the information that is inconsistent with the subsequent target sentence (i.e., the picture shows the old/outdated information).
We are primarily interested in the difference between the two picture conditions (i.e., picture shows revised information vs. old/outdated information). We expect slower reading times for the target and spillover sentences when the picture shows the old information compared to when the picture shows the revised information.
Additionally, we expect slower reading times in the without picture condition compared to the condition with a picture showing the revised information. However, our previous studies (#110454 and #100923) suggest this is a small effect and not the main focus of this study.

3) Describe the key dependent variable(s) specifying how they will be measured.
Reading time for the target sentence and the spillover sentence in milliseconds.

4) How many and which conditions will participants be assigned to?
There are three within-subjects conditions: text is presented without pictures, text is presented with a picture showing the revised information, text is presented with a picture showing the old information.
We will use three lists of texts so that all texts appear in all three conditions across participants. Every list consists of 4 texts without pictures, 4 texts with a picture showing the revised information, and 4 text with a picture showing the old information. Within each list, the order of text passages is randomized. Participants are randomly assigned to one of these 3 lists.

5) Specify exactly which analyses you will conduct to examine the main question/hypothesis.
Reading times for the target sentences and the spillover sentences will be analyzed with linear mixed effects models. Text passages (items) and participants will be included as random effects, text condition (without picture, with a picture showing revised information, with a picture showing old information) will be included as fixed effect.

6) Describe exactly how outliers will be defined and handled, and your precise rule(s) for excluding observations.
Exclusions of participants: Participants who do not agree to have their data processed will be deleted. Participants who do not speak English fluently or who report serious technical issues during participation will be excluded. Moreover, after every text passage, participants have to answer a yes-no comprehension question about text's content. After all 12 text passages, participants complete an old/new picture memory task. Participants with 5 or more wrong answers in the comprehension questions and/or 5 or more wrong answers in the picture memory task (equals ca. 40%) will be excluded.
Exclusion of target and spillover sentences' reading times: Per participant, target and spillover sentences' reading times below 500ms or above 7000ms will be excluded. Additionally, we will exclude spillover sentences' reading times that follow after excluded target sentences.

7) How many observations will be collected or what will determine sample size?
No need to justify decision, but be precise about exactly how the number will be determined.

We aim for 420 participants. Due to the possible exclusion of participants, we will assess 470 participants.
We conducted a power simulation for the difference between the two with pictures conditions (i.e., pictures shows revised information vs. old information).
Parameters were estimated based on our previous study, using the same text and picture material (see as.predicted #110454).
With 420 participants, we can detect an effect between the two picture conditions of 70ms with sufficient power (1-β >/= .8).
The parameters were set as follows:
Fixed effects: estimate intercept = 1400, estimate consistent picture vs. without picture = 40
SD of random effects: SD participant = 600, SD text version = 200, SD residual = 700

8) Anything else you would like to pre-register?
(e.g., secondary analyses, variables collected for exploratory purposes, unusual analyses planned?)

Participants will be recruited via Prolific. Screening criteria will be previous study-participation (no participation in our related studies), language (first language = English, English as a fluent language), no language-related disorder, current country of residence (United States of America), and age (between 18 and 35).
Transformation of data: If the reading times variable is not normally distributed, the data will be log transformed. If this transformation is not adequate, another or no transformation will be chosen.
In line with the analysis procedure by O'Brien et al. (2010), we will conduct the same analyses with a different outlier exclusion. First, we will exclude target and spillover sentences' reading times below 750 ms and above 7500 ms per participant. Then, target and spillover sentences' reading times above/below 2.5 SD from the condition mean will be excluded.
We will also analyze whether the error rate for the comprehension questions varies as a function of condition. If so, we may increase the allowed error rate.
Moreover, we will check whether the processing time for sentences varies as a function of picture presentation. Therefore, we will compare those sentences presented with a picture in the condition with pictures to the same sentences in the condition without pictures. The focus will be mainly on the second picture, as this picture illustrates the content relevant to the target sentence. We expect longer processing times for sentences provided with pictures compared to sentences without pictures.

Version of AsPredicted Questions: 2.00