We examine how salience of extreme actions to gain access to vaccines affect general vaccine preferences using a survey experiment conducted shortly after a limited supply of COVID-19 vaccines were made available to prioritized groups. We document that learning about people who jump the line (jostlers) or people who go through great lengths to secure left-over vaccine doses (hunters) is off-putting, and has a meaningful, negative effect on people’s vaccine preferences. Most people, however, predict the opposite—that news about extreme behavior would help the vaccination effort. If policy makers or public health authorities share these incorrect beliefs, they run the risk of implementing information policies that backfire in their effort to signal desirability of the vaccine.
The rapid development of COVID-19 vaccines is a phenomenal scientific achievement. The existence and availability of COVID-19 vaccines are crucial; nevertheless, the extent to which the vaccines will protect public health depends on their uptake in the population. While many people are enthusiastic about getting a COVID-19 vaccine, others remain hesitant1,2,3,4,5,6,7,8. A highly active research agenda therefore explores factors and policies that may encourage vaccinations9,10,11,12,13,14.
Several recent studies document that learning about other people’s behavior and attitudes can affect vaccine uptake. Vaccine uptake increases as a result of celebrity endorsement15, endorsement from one’s own party’s political elite16, and social norms17. Nevertheless, people do not only face information about the behavior of peers or authorities. While saliency of the behavior of authorities is generally covered by media, behavior of individuals among the general public typically needs to be more sensational to become salient.
As one of the most significant global health crises in our life-time, the COVID-19 pandemic offers a setting conducive to extreme behavior, in pursuit of protecting one’s own health. The perceived health threat of COVID-19 caused many people considerable anxiety, worry and stress18,19,20. The heightened health anxiety from COVID-19 could lead some people to engage in extreme, and sometimes disruptive behavior, which is harmful both to themselves and their communities21. At the same time, COVID-19 vaccines—widely regarded as the most effective means to control and protect from COVID-19—were initially in short supply. In this environment (in early 2021), media stories circulated about people taking extreme actions to secure a COVID-19 vaccine. In particular, the media reported stories about vaccine hunters (people not yet eligible to sign up for vaccination trying to secure left over doses22,23,24) and of rich and/or famous jostlers who used their wealth and/or influence to get vaccinated early25,26,27.
While the absolute number of hunters and jostlers is low in relation to the population, their actions got ample media attention. We are interested in whether vaccine hunters and jostlers may have impacted others’ preferences for, and enthusiasm about, the COVID-19 vaccines. On the one hand, the urgency with which hunters and jostlers wanted to get vaccinated indicated scarcity and that the vaccine was (at least to some) a highly valued good. These two factors may help increase general demand. On the other hand, the mere existence of hunters and jostlers could cause people to believe that it is so hard to get vaccinated that there is no use in even trying, thus decreasing demand. The vaccine hunters and jostlers may also be perceived as morally condemnable, and hence as people to denounce rather than copy.
To examine the effect hunters and jostlers may have on vaccinations, we conducted two pre-registered and monetary incentivized survey experiments—a “main study” and a “follow-up study”.
Data for the main study were collected on the Prolific platform at a time (March 22–24 of 2021) when COVID-19 vaccines were still unavailable to large groups of the adult U.S. population. We recruited a sample of Americans, representative of the population on age, gender and race/ethnicity. The survey experiment was pre-registered in the AEA registry for RCTs as AEARCTR-0007285. Informed consent was obtained from all participants, the experiment was conducted in accordance with relevant guidelines and regulations, and the experimental protocol was approved by the George Mason IRB (#1724890).
Participants were paid $1 for completion, plus any incentives earned as part of the survey. While a total of 1,503 participants answered the survey, we here focus on those (N = 1,117) who were randomized into the following treatments: i) a control treatment (participants received information about the existence of COVID-19 vaccines); ii) a “hunters” treatment (participants were additionally provided brief information that described how vaccine hunters went through great lengths to secure left-over vaccine doses); and iii) a “jostlers” treatment (providing corresponding information about how some privileged people jumped the vaccine line). The remaining 386 of participants of the total sample (N = 1,503) were randomized into a “safe” treatment. The safe treatment emphasized the safety of COVID-19 vaccines and was included to provide a benchmark for the size of any treatment effects in the hunters and the jostlers treatment. The safe treatment did, however, not impact the enthusiasm about the vaccines (most likely because our sample already have very high trust in the safety of the vaccines—more than 85% of participants believed vaccines were safe). Details on the safe treatment, its (null-)results, as well as on our participants’ trust in the vaccines, are provided in the Supplementary Information.
Specifically, participants in the control group were shown information about the existence of COVID-19 vaccines, among other things saying that “[t]he COVID-19 vaccines will decrease your risk of getting COVID-19 and of becoming seriously ill or dying […]. As the COVID-19 vaccines prevent the coronavirus from spreading and replicating, they will also help in preventing additional mutations of the virus”.
In addition to the information given in the control group, participants in the hunters and jostlers treatments saw information that described the respective phenomenon. We took care to ensure that the information contained language similar to that used in news media reporting, e.g., how vaccine supply shortages in the early spring of 2021 fueled the behavior of hunters and jostlers. Participants randomized into the hunters treatment read: “Even though the vaccines have been approved, the supply is still too low to meet the demand. This has led to the global rise of so called ‘vaccine hunters’ […]. The vaccine hunters wait for entire days outside for example grocery store pharmacies in hopes of securing left over vaccine doses (that would otherwise be discarded) at the end of the day.” Those randomized into the jostlers treatment read: “Even though the vaccines have been approved, the supply is still too low to meet the demand. This has led to a situation where, globally, the wealthy are trying to jump the line to get a COVID-19 vaccine […]. One example of this is the Canadian billionaire Rod Baker who, together with his wife, chartered a private plane and traveled to a remote region in Yukon to pose as a motel worker in order to feign being eligible for the vaccine.” Immediately after the treatment information, participants answered a short question about the main message of the paragraph. This was done to identify participants who might not be paying adequate attention, or misunderstanding the text. Such limited attention/misunderstandings were, however, uncommon: only 2.95% of participants provided an incorrect answer and our results are robust to excluding these.
Four outcome measures were assessed immediately after the treatment. First, we asked participants to state their (1) willingness to get vaccinated immediately [VAXTODAY], and (2) in two months [VAX2MONTHS] on a 1–10 scale (from definitely not being willing to definitely being willing). If participants had already received at least their first vaccine dose, these measures assessed their willingness to recommend vaccination to friends and family, using the same scale. Thereafter participants were asked whether they (3) wanted (yes/no) to get a link to general vaccine eligibility and sign-up information (for the use to self, or to friends and family) in the post survey confirmation email [VAXINFO].
The last outcome variable, which was only asked of participants who had not yet received at least a first COVID-19 vaccine dose, measured their (4) monetary valuation of a vaccine sign-up service that facilitated access to a COVID-19 vaccine. Specifically, the service provided individualized help with identifying, and signing up for, a COVID-19 vaccine appointment in the participant’s geographical vicinity once the participant became eligible (at the point of data collection, in March 2021, most adults in the U.S. were still not eligible, and many people were eager to get their vaccines as soon as they became eligible). Additional information about the vaccine sign-up service, and how it was made available to participants, is available in the Supplementary Information.
Willingness to pay for the vaccine sign-up service was elicited using a multiple-price-list, MPL28—participants were presented with a list of eight choice pairs. In each choice pair, participants had to decide between either getting access to the vaccine sign-up service, or instead receiving a monetary prize ($2, $5, $10, $25, $50, $75, $100 and $200 in the eight choice pairs, respectively). Participants were informed that 15 survey participants would be randomly selected and that their preferred alternative in a randomly chosen choice pair out of the eight would be implemented (i.e. they would either receive the monetary prize, or access to the vaccine sign-up service, depending on their chosen alternative in a randomly selected choice pair). Choice pairs were ordered from lowest to highest monetary amount, such that we can use the number of times a participant selected the vaccine sign-up service before switching to the monetary prize as a measure of the willingness to pay for the service [VAXHELP]. The last part of the survey assessed participants’ demographic information.
Of the 15 people randomly selected to receive their preferred alternative in the MPL, 3 participants preferred the vaccine sign-up service in the randomly selected choice pair, and 12 participants were paid a monetary price (which averaged $62).
While the sample is, by design, quota representative of the U.S. population on gender, age and race/ethnicity, it is not necessarily representative in other respects. Notably, close to 60 percent (59.4 percent, SE = 1.3) of our sample have completed at least a four year college degree, which is a higher proportion than in the general U.S. population. As education correlates positively with beliefs about vaccines in general being safe1,2,3,4,5,6,7,8,9, this might (at least partly) explain the large share of our participants believing that COVID-19 vaccines are safe.
The willingness to get vaccinated is generally high in our sample. In the control treatment, 82.6, SE = 1.9, (84.6, SE = 1.8) percent were more willing than unwilling to receive/recommend the vaccine immediately (in two months). This is at least weakly higher than corresponding shares observed in most studies who estimate willingness to get vaccinated against COVID-19 in the U.S.1,2,3. Of participants in the control treatment, 42 percent (SE = 2.49) stated that they wanted to receive information about eligibility and sign-up for COVID-19 vaccines. The willingness to pay for the vaccine sign-up service is low, however: the average participant in the control group only choose the vaccine service over the monetary prize in 0.85 (SE = 0.11) of the 8 questions, which indicates a mean WTP of less than $2.
We examined the balance of demographic and attitude variables across treatment groups by conducting 36 pairwise t-tests (two-sided) of equality of means. One test was statistically significant (p < 0.05): we find that the share of female participants is higher in the hunters than in the control treatment group. While this is not surprising with 36 pairwise tests, we therefore include the variable ‘female’ as a control variable in our main regression specifications reported in Fig. 1 and Table 1 (excluding this control variable does, however, not impact the results reported, or conclusions drawn).
To better understand the effect on willingness to vaccinate from the hunters and jostlers treatments that we observed in the main study, we next conducted a “follow-up study.” Data collection took place on May 19, 2021, on Prolific, and participants were 800 Americans, distinct from those who responded to the first survey. They were paid $1 for completion, plus any incentives earned as part of the study. The experimental survey used in the follow-up study elicited participants’ emotional response to the control and treatment information in the “main study,” as well as their incentivized predictions about the treatment information’s effect on the willingness to get vaccinated. This study was pre-registered in the AEA registry for RCTS as AEARCTR-0007656. Informed consent was obtained from all participants, the experiment was conducted in accordance with relevant guidelines and regulations, and the experimental protocol was approved by the George Mason IRB (#1756922-1).
We investigate the impact of information about hunters and jostlers on a total of five outcome variables. Before analyzing the effect of the treatments on our outcome variables, we standardized the outcome variables to have a mean of zero and a standard deviation of one. The first variable, VAXTODAY, measured participants’ willingness to get vaccinated as soon as a vaccine becomes available to them (or, for those who had already received at least one dose of the vaccine, the willingness to recommend friends and family to be vaccinated as soon as possible).
Our second outcome variable, VAX2MONTHS, measures the willingness to get vaccinated two months after a vaccine becomes available. Our third outcome variable, VAXINFO, assesses preferences for getting information about general vaccine eligibility and how to proceed to get a vaccine. (If participants had already received at least their first vaccine dose, we instead assessed their willingness to recommend vaccination to friends and family, as well as preferences for eligibility and sign-up information on behalf of friends and family). Finally, for our forth outcome variable, VAXHELP, participants who had not yet been vaccinated answered an incentivized question that elicited their monetary valuation of a vaccine sign-up service that would facilitate their access to a COVID-19 vaccine.
Our last outcome variable is an equally weighted index (INDEX) consisting of all applicable outcome variables. The index includes VAXTODAY, VAX2MONTHS and VAXINFO for all participants, as well as VAXHELP for the approximately 70 percent of participants who had not yet received at least the first dose of the vaccine at the time of the survey experiment. A higher value of the index indicates a higher vaccine enthusiasm for unvaccinated participants and a higher enthusiasm for others to get the vaccine for participants who already had at least a first dose of a vaccine.
Figure 1 visually depicts the effect of both the hunters and the jostlers treatment (as compared to the control), on one of our outcome variables—VAXTODAY. Table 1 shows the effect of the hunters and jostlers treatments (as compared to the control) on all five outcome variables. Panel A show the results for all participants, while panel B is restricted to participants who had not yet received at least one shot of the vaccine at the time of the survey. The results depicted in Fig. 1 and Columns (1) in panel A and B of Table 1 show that the treatments have consistently negative effects on VAXTODAY. Table 1 further shows that both treatments also have consistently negative effects on VAX2MONTHS and INDEX, while the effect on VAXINFO is close to zero and statistically insignificant. The effect on VAXHELP is also negative, and similar to the two first outcome variables in magnitude, but with less consistent statistical significance.
The results from our main study therefore imply that salience of the extreme behavior of hunters and jostlers to gain early access to a COVID-19 vaccine reduced participants’ willingness to get vaccinated and their overall enthusiasm about the vaccine. We also see indications of a similar effect on the value they ascribe to getting individualized help with securing a vaccine.
To examine whether the treatment effects are meaningful in magnitude we use the well-documented positive association between higher education and vaccine intentions (1–8) as a basis for comparison. We estimate the effect on vaccine intentions from education for our participants by running the models with the INDEX as outcome variable (model (4) in Table 1, panel A, and model (5) in Table 1, panel B), but replacing the two treatment variables with the variable “college” that takes the value 1 if the participant has completed at least four years of college, and 0 otherwise. When we base the model on the sample in panel A, the estimated coefficient for “college” is 0.343 (SE = 0.057, p < 0.01), and when we base it on the sample in Panel B, it is 0.328 (SE = 0.045, p < 0.01). Comparing the size of the estimated college coefficient to the estimated coefficients for the hunters and jostlers treatments in Table 1, we conclude that the negative effect on willingness to vaccinate by the hunters and jostlers treatments range from 31–55% of the size of the relation between higher education and the willingness to get vaccinated.
In our follow-up study, respondents first stated their experienced intensity of a given emotion (out of nine positive and negative emotions) from reading the control treatment information, and thereafter from reading either the hunter treatment or the jostler treatment information. Their emotional intensity was measured on a 1–7 Likert scale, ranging from “not at all” to “very much.” The largest changes in emotions from both the hunters and the jostlers treatment information were a decrease in happiness ( − 3.18, SE = 0.096 in the hunters, and − 3.67, SE = 0.101 in the jostlers treatment), an increase in anger (1.58, SE = 0.096, and 3.62, SE = 0.107, respectively), and an increase in sadness (1.70, SE = 0.097, and 2.28, SE = 0.109, respectively). In addition, the jostlers treatment triggered a prominent increase in feeling disgusted (3.84, SE = 0.109). This decrease in happiness and increase in negative emotions could potentially explain, at least in part, the drop in willingness to get vaccinated caused by the treatments.
Participants in the follow-up study were then introduced to the set-up of our main study and asked to make an incentivized prediction about the directional effect of the treatments on vaccine enthusiasm. Interestingly, the most common prediction was that the willingness to get vaccinated would increase, with 52.7% (51.0%) predicting this result for the hunters (jostlers) treatment. Only 9.5% (9.3%) predicted, accurately, that the willingness to get vaccinated would decrease from the treatments. To the extent that actual vaccine hunters and jostlers share in our participants’ predictions, our results indicate that the negative spillover effect from their extreme vaccine efforts might have been unexpected to them. Indeed, hustlers and jostlers may have actually believed that their actions could help increase the general willingness to get vaccinated (perhaps by signaling vaccine desirability), while failing to account for a counteracting, negative effect on vaccine intentions.
While previous studies show that behavior and attitudes of celebrities, endorsed elites and peers may affect public health efforts in a major health crisis15,16,17, our results show that behavior by single individuals amongst the general public may similarly matter, when their efforts to self-protect are rather extreme and thus become salient to others, e.g., gain attention from media. We find that individual extreme efforts to self-protect can evoke immediate negative emotions in others and therefore may deter others from engaging in the same type of self-protection. More precisely, we find that salience of extreme actions of some individuals, i.e., hunters and jostlers, to secure a COVID-19 vaccine might have negatively affected other people’s enthusiasm for getting vaccinated and/or willingness to recommend others to get a COVID-19 vaccine. We encourage future research to examine the robustness of our results across samples, contexts and types of public health efforts.
All data, code and experimental survey instruments developed for this study are publicly available at openICPSR under Number 150081.
Daly, M. & Robison, E. Willingness to vaccinate against COVID-19 in the U.S.: Representative longitudinal evidence from April to October 2020. Am. J. Prev. Med. 60, 766–773 (2021).
Guidry, J. P. D. Willingness to get the COVID-19 vaccine with and without emergency use authorization. Am. J. Infect. Control 49, 137–142 (2021).
Latkin, C. COVID-19 vaccine intentions in the United States, a social-ecological framework. Vaccine 39, 2288–2294 (2021).
Neumann-Bohme, S. et al. Once we have it, will we use it? A European survey on willingness to be vaccinated against COVID-19. Eur. J. Health Econ. 21, 977–982 (2020).
Caserotti, M. et al. Associations of COVID-19 risk perception with vaccine hesitancy over time for Italian residents. Soc. Sci. Med. 272, 113688 (2021).
Ward, J. K., Alleaume, C. & Peretti-Watel, P. COCONEL Group. The French public’s attitudes to a future COVID-19 vaccine: The politicization of a public health issue. Soc. Sci. Med. 265, 113414 (2020).
Chen, M. et al. An online survey of the attitude and willingness of Chinese adults to receive COVID-19 vaccination. Hum. Vacc. Imm. https://doi.org/10.1080/21645515.2020.1853449 (2021).
Thunström, L., Ashworth, M., Finnoff, D. & Newbold, S. Hesitancy toward a COVID-19 vaccine. EcoHealth https://doi.org/10.1007/s10393-021-01524-0 (2021).
Dai, H., et al. Behavioral nudges increase COVID-19 vaccinations: Two randomized controlled trials. SSRN 3817832 (2021).
Duquette, N. “Heard” immunity: Messages emphasizing the safety of others increase intended uptake of a COVID-19 vaccine in some groups1. Covid Econ. 39 (2020).
Loomba, S., de Figueiredo, A., Piatek, S. J., de Graaf, K. & Larson, H. J. Measuring the impact of COVID-19 vaccine misinformation on vaccination intent in the UK and USA. Nat. Hum. Behav. 5, 337–348 (2021).
Robertson, C. T., Bentele, K., Meyerson, B., Salwa, J. & Wood, A. Effects of political versus expert messaging on vaccination intentions of trump voters. SSRN 3840933 (2021).
Serra-Garcia, M. & Szech, N. Choice architecture and incentives increase COVID-19 vaccine intentions and test demand. SSRN 3818182 (2021).
Van Bavel, J. J. et al. Using social and behavioural science to support COVID-19 pandemic response. Nat. Hum. Behav. 4, 460–471 (2020).
Alatas, V., Chandrasekhar, A. G., Mobius, M., Olken, B. A. & Paladines, C. When celebrities speak: A nationwide twitter experiment promoting vaccination in Indonesia, National Bureau of Economic Research. w25589 (2019).
Pink, S., Chu, J., Druckman, J., Rand, D. & Willer, R. Elite Party Cues Increase Vaccination Intentions among Republicans. Proc. Natl. Acad. Sci. USA. 118, https://doi.org/10.1073/pnas.2106559118 (2021)
Moehring, A. et al. Surfacing norms to increase vaccine acceptance. SSRN 3782082 (2021).
Ahorsu, D. K. et al. The fear of COVID-19 scale: Development and initial validation. Int. J. Ment. Health Addict. https://doi.org/10.1007/s11469-020-00270-8 (2020).
Silva, W. A. D., de Sampaio Brito, T. R. & Pereira, C. R. COVID-19 anxiety scale (CAS): Development and psychometric properties. Curr. Psychol. https://doi.org/10.1007/s12144-020-01195-0 (2020).
Taylor, S. et al. Development and initial validation of the COVID Stress Scales. J. Anxiety Disord. 72, 102232 (2020).
Asmundson, G. J. & Taylor, S. How health anxiety influences responses to viral outbreaks like COVID-19: What all decision-makers, health authorities, and health care professionals need to know. J. Anxiety Disord. 71, 102211 (2020).
https://abc7.com/leftover-covid-vaccines-los-angeles-vaccine-hunter-coronavirus/10401233/ (retrieved on 9/15/2021).
https://www.nbcmiami.com/responds/covid-vaccine-hunters-tracking-down-leftover-doses/2398001/ (retrieved on 9/15/2021).
https://abcnews.go.com/Health/leftover-covid-19-vaccine/story?id=76092299 (retrieved on 9/15/2021).
https://www.theguardian.com/world/2021/jan/28/canada-couple-covid-vaccine-indigenous-people-jail-time (retrieved on 9/15/2021).
https://www.cnn.com/2021/01/26/americas/canada-exec-yukon-coronavirus-vaccine-trnd/index.html (retrieved on 9/15/2021).
https://www.nationalgeographic.com/travel/article/traveling-across-borders-for-a-vaccine (retrieved on 9/15/2021).
Andersen, S., Harrison, G. W., Lau, M. I. & Rutström, E. E. Elicitation using multiple price list formats. Exp. Econ. 9, 383–405 (2006).
We thank Dan Houser, Jason F. Shogren and Christoph Wollersheim for helpful comments and suggestions.
The authors declare no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Mollerstrom, J., Thunström, L. Vaccine hunters and jostlers may have hurt the COVID-19 vaccination effort. Sci Rep 12, 6382 (2022). https://doi.org/10.1038/s41598-022-10348-z