'Material-Test for Stories IV' (AsPredicted #108,690)
Author(s) Pauline Frick ( Leibniz-Institut für Wissensmedien) - pauline.frick@uni-tuebingen.de Panayiota Kendeou (University of Minnesota) - kend0040@umn.edu Anne Schüler (Leibniz-Institut für Wissensmedien Tübingen) - a.schueler@iwm-tuebingen.de
Pre-registered on 2022/10/05 08:54 (PT)
1) Have any data been collected for this study already? No, no data have been collected for this study yet.
2) What's the main question being asked or hypothesis being tested in this study? This study is closely related to "Online knowledge revision study 1" (see as.predicted file #100923). In this previous study participants read 16 text passages, which were presented sentence by sentence. Each text passage existed in two text versions (one called "consistent", the other called "outdated"). Additionally, we varied whether three of the sentences were illustrated by pictures or not. Originally, we expected that pictures in the outdated condition should influence reading time of a later target sentence. In contrast, we did not expect an effect of picture presentation in the consistent condition. The latter assumption was built on previous studies (#81719, #79275, #75834), where we did not find any picture effect with consistent text versions.
Surprisingly, in the "Online knowledge revision study 1", a main effect of picture presentation was observed, that is, pictures influenced reading time of the target sentence also in the consistent condition.
The aim of the current study is to test a possible explanation for this unexpected finding. We assume that the effect of picture presentation in the consistent condition is due to the fact that the critical picture did not perfectly match with the sentence presented with but matched better with information presented already beforehand in the text. If this is true, the picture repeated information that was presented before verbally. Hence, the picture's influence on the target sentence's reading time could be a "repetition effect" as readers got the information twice. In the outdated condition, we assume other cognitive processes underlying the main effect of picture presentation (see as.predicted file #100923). In other words, we hypothesize that within the consistent text versions, another sentence would fit equally well or better with the picture than the sentence which was originally combined with that picture. Within the outdated condition, we expect that the picture and the sentence it was originally combined with match best.
Therefore, we will present the elaboration section of each text passage (which is the passage the critical picture was meant for) sentence by sentence and ask participants how well the picture fits each sentence. Importantly, all sentence-picture combinations will be presented randomly; the sentences will not be ordered within text passages or text versions.
3) Describe the key dependent variable(s) specifying how they will be measured. Matching score: We measure on a 7-point Likert scale (ranging from 1 [picture does not match at all] to 7 [picture matches perfectly]) how well the picture matches the sentence.
4) How many and which conditions will participants be assigned to? Within participants, sentences from the consistent version and the outdated version are presented.
5) Specify exactly which analyses you will conduct to examine the main question/hypothesis. First, we want to test whether the matching score of the original sentence-picture combination differs between the consistent and outdated text versions. We will perform a two-sided paired t-test and compare the mean ratings for the consistent and outdated text version of the sentences the picture was originally combined with.
Second, we assume that within the consistent condition, another sentence will match the picture equally or better than the sentence it was originally combined with. Within the outdated condition, we do not expect such an effect. To test this assumption, we will run two different analyses. First, we will focus on the individual text passages and will perform for each text version and for each text passage individual paired t-tests (i.e., 32 t-tests) on the mean ratings for the sentence the picture was originally combined with and the sentence which will receive the highest ratings. If the sentence the picture was originally combined with receives the highest ratings, we will select the sentence with the second highest ratings. We will focus on the individual text passages (i.e., individual testing). Second, we will compute a 2*2 ANOVA with the factors text version (outdated vs. consistent) and sentence type (sentence which was originally combined with the picture vs. sentence with the highest rating – again, if the sentence the picture was originally combined with receives the highest ratings, we will select the sentence with the second highest ratings) across all text passages. Additionally, we will compute single comparisons and compare within the factor text version the ratings for the two sentence types.
6) Describe exactly how outliers will be defined and handled, and your precise rule(s) for excluding observations. Exclusions of participants: Participants who do not agree to have their data processed will be deleted. Participants who do not speak English fluently or who report serious technical issues during participation will be excluded.
We will exclude participants who incorrectly answer at least four of our ten attention check questions (e.g., "This is an attention check, please rate this sentence with a two.").
If participants require on average less than one second per response, their response behavior will be analyzed further. If there are further indicators of unclean processing (e.g., an SD across all ratings, which is 2SD lower than that of the other participants), the participant will be excluded.
7) How many observations will be collected or what will determine sample size? No need to justify decision, but be precise about exactly how the number will be determined. Based on a power-analysis conducted with g-power for a two-sided paired t-test (d = 0.3, α = 0.05, 1-β = 0.8) 90 participants are required. Due to possible drop-out, 120 participants will be assessed. This sample size is also sufficient for the 2*2 ANOVA.
8) Anything else you would like to pre-register? (e.g., secondary analyses, variables collected for exploratory purposes, unusual analyses planned?) Participants will be recruited via Prolific. Screening criteria will be study participation (no participation in previous related studies), language (first language = English, English as a fluent language), no language-related disorder, current country of residence (United States of America), and age (between 18 and 35).