'Covid-19 text messages study'
Created: 02/24/2021 11:00 AM (PT)
This is an anonymized version of the pre-registration. It was created by the author(s) to use during peer-review.
A non-anonymized version (containing author names) should be made available by the authors when the work it supports is made public.
1) Have any data been collected for this study already?
No, no data have been collected for this study yet.2) What's the main question being asked or hypothesis being tested in this study?
We plan to run an online experiment with a sample of Americans to measure the effect of 4 different text messages aimed at encouraging individuals to schedule a COVID-19 vaccination appointment at their local healthcare provider. In particular, we will ask participants to imagine being a hospital patient and receiving a text message about their eligibility to get the COVID vaccine. In a 2x2 design, we vary whether the messages contain the link to a video providing information about COVID-19 (e.g., the prevalence of COVID-19 and the effectiveness of the COVID-19 vaccine) and whether the messages use enhanced language aimed at facilitating people with follow-through. We will investigate the perceived persuasiveness of the messages and the extent to which these messages affect people’s likelihood of scheduling a COVID-19 vaccination appointment. We will explore the underlying mechanisms.3) Describe the key dependent variable(s) specifying how they will be measured.
How persuasive do you think the message is? (1 = not at all persuasive, 7 = very persuasive)
How likely would you be to schedule a vaccination appointment after receiving this message from your healthcare provider? (1 = not at all likely, 7= very likely)4) How many and which conditions will participants be assigned to?
Participants will be randomly assigned to one of four conditions.
In the simple text condition, the message is, "[Your first name], you can get the COVID-19 vaccine at our clinics. Make a vaccination appointment here: [link to the appointment website]"
In the Simple Text+Video, the message is, "[Your first name], you can get the COVID-19 vaccine at our clinics. Please watch this important 2 min video: [Link to the video]. Make a vaccination appointment here: [Link to the appointment website]"
In the Enhanced Text, the message is, "[Your first name], a COVID-19 vaccine has just been made available to you at our clinics. Claim your dose today by making a vaccination appointment here: [link to the appointment website]". People will watch an educational video about covid-19.
In the Enhanced Text+Video, the message is, "[Your first name], a COVID-19 vaccine has just been made available to you at our clinics. Please take 2 simple steps: 1. Watch this important 2 min video: [Link to the video]. 2. Claim your dose today by making a vaccination appointment here: [Link to the appointment website]". People will watch an educational video about covid-19.5) Specify exactly which analyses you will conduct to examine the main question/hypothesis.
For the main analysis, we will run an ordinary least squares regression (OLS) to predict (1) perceived persuasiveness (1-7) and (2) likelihood of scheduling a vaccination appointment (1-7). The predictor variables will include (1) an indicator for random assignment to the message with the Video, (2) an indicator for random assignment to the message with Enhanced Text, and 3) the interaction between these indicators.
We will include the following control variables:
Indicators for participant gender (male, female, other/unknown)
Indicators for participant race/ethnicity (Black non-Hispanic, Hispanic, Asian, white non-Hispanic, other/unknown)6) Describe exactly how outliers will be defined and handled, and your precise rule(s) for excluding observations.
A Captcha question will be used to filter out bots from taking the study. Participants recruited through Prolific Academic (18 or older) based in the United States will be included in our data analysis if they satisfy the following criteria:
Pass an attention check question assessing whether participants are reading instructions closely
Have not already received the COVID-19 vaccine or had an appointment
Answer our primary dependent variables (Section 3).
Reporting identifying with either the democratic party or the republican party
Report having no problems with watching the video
Report either having not taken a similar study on MTurk or that they cannot remember (i.e., excluding people who report having taken a similar study)
We will use Prolific Academic to recruit 400 republicans and 400 democrats. We will also include a question in the survey asking which political party participants identify the most with (the Democratic party, the Republican party, and independent; those who choose independent will be asked further whether they identify relatively more with the Democratic or Republican party or equally between the two parties). Only participants who identify with either the Democratic party or the Republican party (including those who initially select independent but then choose one of the two parties in the follow-up question) will be included in the analysis7) How many observations will be collected or what will determine sample size?
No need to justify decision, but be precise about exactly how the number will be determined.
We plan to recruit 800 people who satisfy our criteria in Section 6. We will launch the study to a larger sample size since we will exclude some people from the analysis (as explained in Section 6)8) Anything else you would like to pre-register?
(e.g., secondary analyses, variables collected for exploratory purposes, unusual analyses planned?)
For robustness, we will conduct the same OLS regression analyses specified above but include participants who reported having problems with watching the video or that reported having taken a similar study on MTurk or that they cannot remember whether they took a similar study in the past.
We will collect the following measures:
1) Participants’ belief in how likely they would catch the COVID-19 with (1a) versus without (1b) COVID-19 vaccine (ranging from -100% to 100%) and the difference between these measures (1c)
2) Participants’ belief in how likely they would develop symptomatic COVID-19 with (2a) versus without (2b) COVID-19 vaccine (ranging from -100% to 100%) and the difference between these measures (2c)
3) Anticipated regret for not taking the COVID-19 vaccine (1-7 scale);
4) How worried participants are about passing COVID-19 to other people (1-7 scale);
5) Perceptions of trust in the vaccine (concerns about side effects, worries about long term impact, concerns about the vaccine being authorized too quickly, trust in the research and development of the vaccine, safety of the vaccine)
6) Extent to which patients feel that the vaccine is already theirs (1-7 scale)
7) Extent at which the message makes participants feel that getting the COVID-19 vaccine is easy (1-7 scale)
We will use the same OLS regression as described in Section 5 to predict variables 1a-7. We will conduct mediation analyses and see which items predict intentions to get the COVID-19 vaccine.
We will explore the following moderators:
Whether the participant received a flu shot either in 2019-20 flu season or the 2020-2021 flu season
The political party that the participant identifies with (democratic vs. republican)
Education (Below bachelor or bachelor/above bachelor)
How often the participant wears masks when going outside (above vs. below median)
How often the participant washes hands when coming back home (above vs. below median)
Whether the participant has children under 18