PLoS ONE plos plosone PLOS ONE 1932-6203 Public Library of Science San Francisco, CA USA 10.1371/journal.pone.0241473 PONE-D-20-28526 Research Article Facilitators and barriers to engagement with contact tracing during infectious disease outbreaks: A rapid review of the evidence What factors influence engagement with contact tracing? https://orcid.org/0000-0002-2152-0721 Megnin-Viggars Odette Conceptualization Formal analysis Methodology Validation Writing – original draft Writing – review & editing 1 * Carter Patrice Conceptualization Formal analysis Methodology Validation Writing – review & editing 1 Melendez-Torres G. J. Writing – review & editing 2 Weston Dale Writing – review & editing 3 Rubin G. James Conceptualization Supervision Validation Writing – review & editing 4 Research Department of Clinical, Centre for Outcomes Research and Effectiveness, Educational & Health Psychology, University College London, London, United Kingdom Peninsula Technology Assessment Group, University of Exeter Medical School, Exeter, United Kingdom Emergency Response Department Science & Technology, Behavioural Science Team, Public Health England, Porton Down, Salisbury, United Kingdom Department of Psychological Medicine, Institute of Psychiatry, Psychology & Neuroscience, King’s College London, London, United Kingdom Soundy Andrew Editor University of Birmingham, UNITED KINGDOM

The authors have declared that no competing interests exist.

 * E-mail: o.megnin@ucl.ac.uk 29 10 2020 2020 15 10 e0241473 11 9 2020 15 10 2020 2020 Megnin-Viggars et al This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Background

Until a vaccine is developed, a test, trace and isolate strategy is the most effective method of controlling the COVID-19 outbreak. Contact tracing and case isolation are common methods for controlling infectious disease outbreaks. However, the effectiveness of any contact tracing system rests on public engagement. Numerous factors may influence an individual’s willingness to engage with a contact tracing system. Understanding these factors has become urgent during the COVID-19 pandemic.

 Objective

To identify facilitators and barriers to uptake of, and engagement with, contact tracing during infectious disease outbreaks.

 Method

A rapid systematic review was conducted to identify papers based on primary research, written in English, and that assessed facilitators, barriers, and other factors associated with the uptake of, and engagement with, a contact tracing system.

 Principal findings

Four themes were identified as facilitators to the uptake of, and engagement with, contact tracing: collective responsibility; personal benefit; co-production of contact tracing systems; and the perception of the system as efficient, rigorous and reliable. Five themes were identified as barriers to the uptake of, and engagement with, contact tracing: privacy concerns; mistrust and/or apprehension; unmet need for more information and support; fear of stigmatization; and mode-specific challenges.

 Conclusions

By focusing on the factors that have been identified, contact tracing services are more likely to get people to engage with them, identify more potentially ill contacts, and reduce transmission.

 Go-Science https://orcid.org/0000-0002-2152-0721 Megnin-Viggars Odette Go-Science Carter Patrice National Institute for Health Research Health Protection Research Unit (NIHR HPRU) in Emergency Preparedness and Response Rubin G. James National Institute for Health Research Health Protection Research Unit (NIHR HPRU) in Emergency Preparedness and Response Weston Dale National Institute for Health Research Health Protection Research Unit (NIHR HPRU) in Behaviour Change and Evaluation Weston Dale PC and OMV were funded by Go-Science; the review was conducted at the request of the Scientific Pandemic Influenza Group on Behaviours (SPI-B), a behavioural science advisory group for the Scientific Advisory Group for Emergencies (SAGE): Coronavirus (COVID-19) response team, who provide scientific and technical advice to support UK government decision makers. GJR and DW were funded by the National Institute for Health Research Health Protection Research Unit (NIHR HPRU) in Emergency Preparedness and Response, a partnership between Public Health England, King’s College London and the University of East Anglia. DW is also supported by the National Institute for Health Research Health Protection Research Unit (NIHR HPRU) in Behaviour Change and Evaluation, a partnership between Public Health England and the University of Bristol. Data Availability All relevant data are within the manuscript and its Supporting Information files. Outbreaks COVID-19 Introduction

The current coronavirus disease 2019 (COVID-19) pandemic represents a major global public health disaster. COVID-19 is caused by the SARS-CoV-2 virus, and is transmitted through respiratory droplets (e.g. coughing or sneezing) or through contact routes (direct contact with an infected person or indirect contact with surfaces or objects that an infected person has made contact with). As of 3rd August 2020, just under 18 million cases had been reported globally, resulting in more than 686,000 deaths [1]. COVID-19 cannot be treated effectively with antiviral drugs and there is currently no vaccine available.

Until a vaccine is developed, a test, trace and isolate strategy is the most effective method of controlling the COVID-19 outbreak [2–4]. This system is heavily reliant on members of the public engaging with it. There are multiple stages where this engagement could be less than optimal, from the decision to report symptoms [5], through to whether people remain in isolation or quarantine for the full period recommended [6]. One critical area that requires specific attention is engagement with the contact tracing element of the system. Different countries approach this in different ways, but the core elements are similar. Contact tracing aims to prevent onward transmission of an infectious disease by identifying, assessing and managing people who have been in close contact with an infected individual. Within England, people who test positive for COVID-19 are contacted by a dedicated service and asked to provide the names and contact details of the people that they live with or have had close contact with recently, as well as any places they have been recently such as a restaurant or workplace. ‘Recently’ in this context is defined as starting 48 hours before their symptoms began. Armed with this information, the service then attempts to get in touch with these contacts and asks them to enter quarantine, preventing onward transmission of the virus. Unfortunately, there is evidence that some people are declining to provide any details of their contacts to the service or are not providing full details of how to get in touch with them [7]. Deficiencies in the national service have led some local regions to set up their own services, to complement the national endeavour [8].

In addition to manual contact tracing systems, many countries (including the UK) have, or are in the process of, developing digital contact tracing applications. Digital contact tracing systems largely use smartphones to measure the proximity of devices to each other and use this as a proxy for contact between people. These data are then analysed by an algorithm that quantifies risk (using parameters including duration and number of contacts with positive cases) and generates an alert where risk is sufficiently high that action should be taken. However, there are also limitations associated with digital contact tracing systems including: imprecision in detecting contact and distance; vulnerability to fraud and abuse; unestablished effectiveness; reliance on a high level of accuracy of diagnostic testing and a high level of uptake of the application; the need to win public trust and confidence; potentially harmful behavioural impacts; and potential exacerbation of inequalities [9]. In an attempt to improve engagement, some apps may include additional features specifically designed to provide personal benefit, such as information about current levels of infection and ways to protect oneself, however, the impact of these measures on uptake and engagement is unknown.

Contact tracing is not unique to the COVID-19 pandemic. It has been used extensively in previous emerging infectious disease outbreaks [10]. In this paper, we report a rapid review of contact tracing to identify factors that are associated with greater engagement by patients, defined as greater likelihood of providing full details of all relevant contacts, or of downloading and using an application-based contact tracing system.

 Methods

Following the PRISMA guidelines [11] we developed a protocol for a rapid review to identify factors that influence engagement with contact tracing during major health incidents, unfortunately time restrictions did not allow for the registration of this protocol. This rapid systematic review satisfied all of the PRISMA checklist items.

Search strategy

A search strategy was developed that included medical subject headings and free text terms. Key words for the search included terms for epidemics/pandemics (including coronavirus, avian influenza, Ebola, Middle East respiratory syndrome, severe acute respiratory syndrome, swine flu) and terms for contact tracing and isolation/quarantine.

Four electronic databases (MEDLINE, Embase, PsycINFO, ProQuest (Coronavirus Research Database, Public Health Database, Social Science Database, Sociology Database and Internal Bibliography of the Social Science [IBSS]) were searched from inception to July 2020. Additionally the pre-print database, Medrxiv was searched on the 15th July 2020. The full list of search terms can be found in S1 Table.

 Selection criteria

To be included in this review, studies had to: report on primary research; be written in English; include factors associated with contact tracing and include participants with experience of a major health incident. Studies were excluded if the major health incident was not viral and contagious, and if the disease was sexually transmitted.

Citations from each database search were downloaded into EndNote and duplicates removed. Titles and abstracts of identified studies were independently screened by two reviewers for inclusion against criteria, and good inter-rater reliability was observed (percentage agreement =>90%). All primary-level studies included after the first screen of citations were acquired in full and re-evaluated for eligibility at the time data was being entered into an Excel-based study database (see S2 Table for studies that were excluded at full-text review).

 Data extraction and synthesis

Data extraction and synthesis were conducted by two reviewers, and discrepancies with coding were resolved through discussion. Quality of each included study was assessed using the CASP (Critical Appraisals Skills Programme) Qualitative checklist for qualitative studies [12] or the BMJ Critical appraisal checklist for survey studies [13]. A quality rating was assigned to each study, where ++ indicates that most (≥75%) or all of the checklist criteria have been met, + indicates that the checklist criteria have been partially met (≥50%-75%), and—indicates that the majority of checklist criteria have not been met (<50%). Thematic synthesis and thematic network analysis [14, 15] was used to combine the results of included studies. Emerging themes were derived from the data presented within the included studies, and were placed into a thematic map representing the relationship between themes, subthemes and overarching categories, in order to inductively identify common themes across studies.

 Results

The systematic search of electronic databases and the MedRxiv pre-print server generated a total of 3,009 references, after removal of duplicates 2,827 relevant abstracts were assessed for eligibility. Of these, 17 papers were reviewed in full-text (including two papers that was identified through hand searching). Twelve studies met the eligibility criteria and were included in the review (see Fig 1 for flow chart of study search and selection process).

10.1371/journal.pone.0241473.g001 PRISMA flowchart. Included studies

The characteristics of the included studies are summarised in Table 1. Six of the included studies investigated people’s attitudes to contact tracing systems for COVID-19 [16–21], five explored people’s experience of contact tracing during Ebola outbreaks [22–26], and one study investigated hypothetical scenarios including scabies, shigella and mumps [27]. Five studies included participants with direct experience of contact tracing (with participants including contact tracers, community leaders, healthcare providers, and selected households living in affected/unaffected communities), one study examined experiences of using a pilot contact tracing app (participants were healthcare workers), and six studies explored the acceptability of digital (predominantly application-based) contact tracing systems (with participants including the general population and public health professionals).

10.1371/journal.pone.0241473.t001 Characteristics of included studies.
Author, country and reference Study design Infectious disease Participants Study aim Sample size Percentage female Percentage BAME (non-white) Included Themes Study qualitya
Altmann 2020 Online—quantitative survey COVID-19 General population To measure the acceptability of an app-based contact tracing system 5, 995 52.3 NR

Facilitators of contact tracing

Collective responsibility

Personal benefit

Barriers to contact tracing

Privacy concerns

Mistrust and/or apprehension

Mode-specific challenges

+
France, Germany, Italy, UK & US
Bachtiger 2020 Online—quantitative survey COVID-19 Individuals with a previous healthcare event or encounter To measure the determinants of willingness to participate in an app-based NHSb contact tracing programme 9,512 57.0 NR

Facilitators of contact tracing

Personal benefit

Co-production of contact tracing systems

Barriers to contact tracing

Privacy concerns

Mistrust and/or apprehension

Unmet need for more information and support

Mode-specific challenges

+
UK
Barker 2020 Qualitative (in-depth interviews and focus groups) Ebola Health care providers To understand views on facilitators and barriers to health system resilience and links to community engagement in a localised context 92 interviews and 16 focus groups NR NR

Facilitators of contact tracing

Co-production of contact tracing systems

-
Liberia
Caleo 2018 Qualitative interviews Ebola Household members and community informants To explore transmission dynamics and community compliance with control measures 38 52.7 NR

Facilitators of contact tracing

Collective responsibility

Barriers to contact tracing

Privacy concerns

Mistrust and/or apprehension

+
Sierra Leone
Filer 2020 Online—quantitative survey COVID-19 NHS Staff To assess uptake, use and difficulties encountered using an NHS contact tracing app 462 NR NR

Barriers to contact tracing

Unmet need for more information and support

Mode-specific challenges

-
UK
Greiner 2015 Qualitative interviews Ebola CDCc staff To explore challenges encountered by CDC staff assisting West African ministries of health to conduct contact tracing 12 NR NR

Facilitators of contact tracing

Collective responsibility

Personal benefit

Co-production of contact tracing systems

Perception of system as efficient, rigorous and reliable

Barriers to contact tracing

Mistrust and/or apprehension

Fear of stigmatization

Mode-specific challenges

-
Sierra Leone, Guinea, Liberia, Malia Senegal, & Nigeria
Helms 2020 Mixed methods study (qualitative interviews and online quantitative survey) Scabies, mumps and Shigella Public health professionals To assess anticipated advantages and challenges of online respondent driven (online-RDD), and intention to apply online-RDD for contact tracing 12 interviews and 70 online survey responses 67.7 NR

Facilitators of contact tracing

Perception of system as efficient, rigorous and reliable

Barriers to contact tracing

Mistrust and/or apprehension

Unmet need for more information and support

Mode-specific challenges

++ (qualitative interviews)- (online survey)
Netherlands
Ilesanmi 2015 Qualitative interviews Ebola Contact tracers To identify challenges faced by contact tracers 12 NR NR

Facilitators of contact tracing

Co-production of contact tracing systems

Barriers to contact tracing

Mistrust and/or apprehension

Mode-specific challenges

-
Sierra Leone
Jansen-Kosternick 2020 Online quantitative survey COVID-19 General population To identify acceptance of a mobile application for COVID-19 symptom recognition monitoring and contact tracing 238 59.2 NR

Facilitators of contact tracing

Collective responsibility

Personal benefit

Barriers to contact tracing

Privacy concerns

Mistrust and/or apprehension

Mode-specific challenges

+
Netherlands
Olu 2016 Qualitative interviews Ebola Contact tracers, and contact tracing supervisors To understand the characteristics, effectiveness and challenges of contact tracing in Waa and to propose appropriate recommendations for improving contact tracing during future outbreaks. 10 NR NR

Facilitators of contact tracing

Co-production of contact tracing systems

Barriers to contact tracing

Mistrust and/or apprehension

Fear of stigmatization

-
Sierra Leone
Thomas 2020 Online quantitative survey COVID-19 General population To explore a) reasons for choosing not to download a mobile application and b) Australians understanding about the app’s purpose and capabilities 1500 50.0 NR

Facilitators of contact tracing

Personal benefit

Perception of system as efficient, rigorous and reliable

Barriers to contact tracing

Privacy concerns

Mistrust and/or apprehension

Unmet need for more information and support

Mode-specific challenges

-
Australia
Williams 2020 Online qualitative focus groups COVID-19 General population To explore attitudes towards the UK proposed contact tracing mobile application 22 45.0 18.0

Facilitators of contact tracing

Collective responsibility

Personal benefit

Barriers to contact tracing

Privacy concerns

Mistrust and/or apprehension

Unmet need for more information and support

Fear of stigmatization

Mode-specific challenges

++
UK

a Study quality: Assessed using relevant tool; CASP for qualitative studies and BMJ survey checklist for quantitative surveys: Scores = ++ most of checklist criteria met; + some of checklist criteria met;—insufficient checklist criteria met.

bNHS: National Health Service

cCDC: United States Centres for Disease Control and Prevention

 Quality assessment of included studies

Five studies used qualitative methods to investigate views/experiences of contact tracing, five studies were survey-based, and two studies used mixed methods. Only two of the included studies were considered high quality, meeting most of the quality assessment criteria [21, 27], four studies met some of the checklist criteria [16, 17, 19, 22] while six met very few criteria [18, 20, 23–26]. One study included both a qualitative study that met most of the assessment criteria; however, the online survey section of this study met very few of the criteria [27]. See S3 Table for quality appraisal of individual studies.

 Identified themes

The review identified four themes that acted as facilitators to contact tracing: collective responsibility; personal benefit; co-production of contact tracing systems; and the perception of the system as efficient, rigorous and reliable. The review also identified five barriers to contact tracing: privacy concerns; mistrust and/or apprehension; unmet need for more information and support; fear of stigmatization; and mode-specific challenges. See Figs 2 and 3 for theme maps of facilitators and barriers to contact tracing. These themes and their sub-themes are explored in detail below.

10.1371/journal.pone.0241473.g002 Facilitators of contact tracing theme map. 10.1371/journal.pone.0241473.g003 Barriers to contact tracing theme map. Facilitators of contact tracing Collective responsibility

Participants reported that their intentions to use a contact tracing app were strongly influenced by a sense of collective responsibility [16, 19, 21], and their desire to help reduce the deaths of others, particularly those who are vulnerable [16, 19]. Many viewed contact tracing as a means of ending an epidemic, and embraced their role in this [16, 22] even where participants had some concerns over using a contact tracing app they viewed it as the “only way out” and this collective responsibility was prioritised over personal doubts [21]:

“I would really support it, I know privacy is really important … anything that would help, it doesn’t make sense why people wouldn’t participate; people are dying all over the world, what’s more important at the moment, to try and stop this or people knowing what’s happened on your phone”

(Williams 2020; pg. 15)

Some participants described how creating a positive image of contact tracers (“as heroes”) had helped to emphasise collective responsibility [23].

 Personal benefit

Although collective responsibility emerged as a prominent theme in motivating uptake of contact tracing apps, participants also emphasised personal benefit as a facilitator of engagement with contact tracing. Participants were positive about the potential of a contact tracing app to provide information about the risk of infection, and help them gain more insight into the symptoms and spread of the COVID-19 virus [16, 19]. Participants were also motivated by being able to protect their own health [16, 19] and the health of their family and friends [16], and this was particularly compelling for those who feared the virus [19]. Moreover, participants emphasised the peace of mind that a contact tracing app could convey [16, 19].

Conversely, a prominent reason for not intending to use a contact tracing app was that there was no perceived personal benefit which led people to doubt their usefulness [16, 17, 19–21]: some participants felt that existing interventions (such as social distancing) were sufficient and rendered the app unnecessary [20]; some did not believe they would get infected [16, 17]; for others there was the potential for an app to create an over-awareness of the risks and increase stress [19]; and some questioned the acceptability of a contact tracing app in the UK which was perceived as less collectivist and more sceptical of state intervention than other countries which have more widely implemented contact tracing [21].

“The issue here is will society take it on board and actually do it. I think one of the reasons why places like China, South Korea, Singapore, those Asian countries can successfully manage those situations is because they have a relatively compliant society, people tend to work together or maybe its just because they are used to having their civil liberties curbed to a degree”

(Williams 2020; pg. 14)

The results showed that where personal benefit may not be initially perceived, uptake could be increased with specific measures; for example, participants who had conducted contact tracing during the Ebola outbreak reflected on lessons learnt and highlighted that financial support provided to contacted persons was used as a means of incentivizing engagement [23].

 Co-production of contact tracing systems

Participants highlighted the importance of healthcare systems partnering with communities in order to understand local needs [23–26] which was crucial in enabling implementation of contact tracing, and cultivating trust and engagement [23] during the Ebola epidemic. The potential benefit of co-production as a means of building understanding and trust is also highlighted by the association between understanding of government advice and intention to use a contact tracing app [17]. Participants reflected on how community co-production of contact tracing systems can help in a practical way, as local knowledge can facilitate in locating contacts [23], but can also help with acceptance of contact tracing if community engagement can be used as a means of combatting stigma around contact tracing [23, 24].

 Perception of the system as efficient, rigorous and reliable

Participants considering the advantages of digital contact tracing systems identified the capability of reaching contact persons efficiently and effectively as a potential benefit [20, 27]. Participants were also positive about how digital systems can empower the individual as ‘holder’ and ‘sharer’ of their own anonymised data [27]:

“I think you can take away many barriers by having the index [patient] forward this [the online contact tracing questionnaire]. Especially if it is possible to do so anonymously…."

(Helms 2020, pg. 10)

 Barriers to contact tracing Privacy concerns

A prominent barrier to using a contact tracing app was concern over government surveillance. Participants were worried that their personal information would be used by government to keep watch on them during and after the pandemic [16, 19–21]:

“Contact tracing seems quite Big Brotherly. I don’t think I am willing to submit all my data and all of my contacts for the government to scrutinise who I see regularly. I don’t think I will be willing to join the contact tracing apps”

(Williams 2020; pg. 11)

Participants also mentioned more general privacy and data protection concerns [17, 20, 21], and worries about a contact tracing app not being secure and opening up their phone to hacking [16, 19, 21].

In addition to concerns around privacy associated with a contact tracing app, another emerging theme was the desire to protect ‘private’ life with contact tracing being seen as an intrusion into that domain [22]:

“Invasion of privacy—it was not their business to investigate our household”

(Caleo 2018; pg. 8)

 Mistrust and/or apprehension

A predominant barrier to engaging with contact tracing was mistrust, of government [16, 20, 22] of contact tracing personnel [23, 24, 26], and of technology. Technology was a particular issue for older people [17, 19].

Participants with experience of contact tracing during the Ebola outbreak, also recollected feelings of apprehension about the behaviours that might be required of them, for example, having to self-isolate and/or refrain from routine activities and worries about the financial and social pressures that this may bring [22, 23].

Some of the mistrust and apprehension around the use of digital contact tracing systems was linked to participants questioning the effectiveness of the system [20, 21, 27]. Participants expressed particular concerns around whether people would be motivated to use a system that did not involve a human interface [27], and if uptake was limited there was the potential for a detrimental effect on the actual (as well as perceived) validity of the system [21].

 Unmet need for more information and support

Themes of mistrust and apprehension were also associated with gaps in information. These gaps were experienced at the macro level, with participants admitting that they did not understand why contact tracing is needed [17, 20, 21], and questioning whether information could be adequately conveyed through a digital system [27]. Gaps in information provision were also identified at a micro level, with health service staff who had trialled a COVID-19 contact tracing app, highlighting that it was not clear what to do when they were alerted by the app, and there was conflicting advice between the app and a government website [18].

Limited opportunities for support were also identified as potential barriers to engaging with digital contact tracing systems, as participants described how information and warnings may be experienced as more severe because they were not coming from another person, and this also limited the opportunity to provide reassurance and/or support as needed [27].

 Fear of stigmatization

A salient barrier to the uptake of a contact tracing app was fear of being “branded”, concern over the stigmatizing potential of an app were related to concerns around privacy and worries that using the app would enable the identification of individuals with COVID-19 [21]:

“I actually think that [the contact tracing app] is a terrifying concept… it’s like being branded with a horrendous black mark. … I could look and be like my friend, my neighbour has got Covid.”

(Williams 2020; pg. 13)

There was also a perceived potential for stigmatization associated with being a contact person [21, 26]. Participants described how restrictions imposed through the contact tracing system could ostracize people because they are not able to maintain routine activities [23], and fears that stigmatization around contact tracing could lead to discrimination [21].

 Mode-specific challenges

In addition to the general and conceptual barriers to engaging with any contact tracing system, as outlined above, there are also mode-specific barriers to engaging with both digital and manual contact tracing systems, and each mode has its own specific challenges.

Practical and salient barriers to using a contact tracing app included: people not having appropriate devices [17–21]; problems with downloading or installing the app [18]; the impact on other phone applications, and on reducing battery life [18]; and the need for greater app interactivity as participants reported that there were not adequate options for reporting symptoms or test results [18]. In addition to the potential for these actual technical difficulties to create a barrier to uptake of, or engagement with, a contact tracing app, there were also psychological barriers to engaging with technology, as participants lacked confidence in technical proficiency [17, 27], doubted the ease of use [19], felt that it was too much hassle to install [16] and worried about the lack of coordination and oversight with digital systems [27].

Practical barriers were also associated with manual contact tracing systems, as participants described the logistical challenges inherent in identifying contacts [23]; and in recruiting, training and retaining contact tracers [23, 24].

 Discussion Principal finding

This review provides strong evidence that many people feel a collective responsibility to help combat infectious disease outbreaks, and that this can be a motivating factor to engage with contact tracing systems. However, engagement with contact tracing relies on these factors outweighing privacy concerns and potential mistrust in the government or public health officials, and on the perception of a personal as well as collective benefit. Providing clear, consistent information and rationale for any contact tracing system, providing support, and emphasising personal as well as collective benefit, is required in order to achieve widespread uptake and engagement.

 Interpretation of results

The review identified a number of higher order conceptual themes that act as facilitators or barriers to any contact tracing system, irrespective of mode of delivery, type of disease (COVID-19 and Ebola), and geographical region. A prominent theme that emerged was the strong sense of collective responsibility felt, and the perception of contact tracing systems as a means of acting on this collective responsibility to help end the infectious disease outbreak and to protect others, particularly those who are vulnerable. Interestingly, this theme was identified across a number of studies conducted in different countries, including the UK which has been perceived as less ‘collectivist’ than other countries where contact tracing systems have been successfully implemented.

However, although this review reinforced the importance of collective benefit in facilitating engagement with contact tracing, the need for some perceived personal benefit was not entirely superseded, and the evidence suggests that if contact tracing systems can deliver some benefits to the individual as well as the community to which they belong, engagement will be enhanced. The evidence in the review suggests that at the very least individuals should not feel personally disadvantaged from having engaged in contact tracing, and that information and support (including financial support) may help ameliorate this potential barrier. This finding is in line with established behaviour change models, that people need to have sufficient motivation, or health concern to take action [28], and providing clear information on the benefits of engaging and risks of not engaging should be clearly demonstrated so that people know why and how the system will benefit them personally.

Another theme identified, that describes a higher-order facilitator of engagement with contact tracing, is the importance of co-production of contact tracing systems, as demonstrated in the case of Ebola. Evidence synthesised in the review highlights the importance of healthcare systems partnering with communities in order to understand local needs, and how through this process trust and engagement can be cultivated, and effective implementation facilitated.

The need for any contact tracing system to be perceived as efficient, rigorous, and reliable, and the need for information that effectively communicates the purpose of the system as well as the specific actions required, is also highlighted in relation to both digital and manual contact tracing systems. Moreover, the evidence reviewed here suggests that gaps in information and support can foster mistrust and apprehension and act as a salient barrier to engagement. Mistrust of government appeared to arise more in relation to COVID-19, relative to Ebola, however this finding may reflect differences in the modes of delivery with manual contact tracing in Ebola juxtaposed against the COVID-19 studies included here which focused more on app-based contact tracing systems.

The desire to protect ‘private’ life and the perception of contact tracing as an intrusion into that domain, emerged as a barrier for both manual and digital contact tracing, however, it was particularly prominent in relation to contact tracing applications. Similarly, fear of stigmatization was described in relation to both manual and digital contact tracing, but appeared to be especially pertinent when considering the stigmatizing potential of an app as this was linked to concerns around privacy and data protection. Practical barriers were also identified for both manual and digital contact tracing but seemed particularly relevant to a digital contact tracing system, as a number of real and perceived technical difficulties were highlighted.

 Strengths & limitations

Despite this being a rapid review of the evidence, a comprehensive search was conducted across multiple databases, with screening conducted by two independent reviewers. Moreover, the review includes 12 studies providing a depth of evidence from across the globe, and supporting the generalisability of findings. However, potential limitations include: the possibility that other potentially relevant evidence exists which has not been identified; the moderate to low quality of the included evidence; the inclusion of studies from the pre-print server Medrxiv which have not been scrutinized via the peer review process; and the inclusion of studies that examine intention to engage with a contact tracing system rather than restricting focus to only actual (self-reported or observed) behaviour. Although these potential limitations encourage caution in interpreting the findings, the current relevance and urgency of the review necessitated some pragmatic decisions and the methods adopted helped ensure that the most recent and relevant research was captured.

 Conclusions

Findings from this review suggest that engagement with COVID-19 contact tracing systems could be facilitated by:

Clear communication about contact tracing that outlines why a system is needed, how it will work, and highlights personal and community benefit

Involvement of stakeholders in the development of contact tracing systems, particularly, digital applications in order to understand and address privacy concerns, the potential for stigmatization, and mistrust and apprehension

Evaluation and quality assurance of the contact tracing system in order to create and reinforce the perception of the system as rigorous and reliable

Supporting information Search strategies.

(DOCX)

 Excluded studies.

(DOCX)

 Quality appraisal of included studies.

(DOCX)

 <p>(DOC)</p> </caption> </supplementary-material> </sec> </body> <back> <ref-list> <title>References World Health Organization. Coronavirus disease (COVID-19): situation report– 196. 3 August 2020. https://www.who.int/emergencies/diseases/novel-coronavirus-2019/situation-reports Keeling MJ, Hollingsworth TD, Read JM. The efficacy of contact tracing for the containment of the 2019 novel coronavirus (COVID-19). MedRxiv [preprint]. 2020 medRxiv 20023036 [posted 2020 February 17]. https://www.medrxiv.org/content/10.1101/2020.02.14.20023036v1 Baraniuk C. Covid-19 contact tracing: a briefing. BMJ. 2020 May 13;369. Kucharski AJ, Klepac P, Conlan A, Kissler SM, Tang M, Fry H, et al. Effectiveness of isolation, testing, contact tracing and physical distancing on reducing transmission of SARS-CoV-2 in different settings. Lancet Infectious Diseases. 2020; 10: P1151–1160. doi: 10.1016/S1473-3099(20)30457-6 32559451 Carter P, Megnin-Viggars O, Rubin GJ. What factors influence symptom reporting during an emerging infectious disease outbreak? A rapid review of the evidence. MedRxiv [preprint]. 2020 medRxiv 20159897 [posted 2020 July 24]. https://www.medrxiv.org/content/10.1101/2020.07.23.20159897v1 Webster RK, Brooks SK, Smith LE, Woodland L, Wessely S, Rubin GJ. How to improve adherence with quarantine: rapid review of the evidence. Public Health. 2020; 182: 163–169. doi: 10.1016/j.puhe.2020.03.007 32334182 Department for Health and Social Care. Weekly NHS test and trace bulletin, England: 16–22 July 2020. https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/906300/test_and_trace_week_8.pdf Limb M. Covid-19: sandwell council in west midlands sets up contact tracing, citing failures of national scheme. BMJ. 2020; 370: m3065. doi: 10.1136/bmj.m3065 32737052 Ada Lovelace Institute. Exit through the app store? a rapid evidence review on the technical considerations and societal implications of using technology to transition from the COVID-19 crisis. 20 April 2020. https://www.adalovelaceinstitute.org/exit-through-the-app-store-how-the-uk-government-should-use-technology-to-transition-from-the-covid-19-global-public-health-crisis/ Saurabh S, Prateek S. Role of contact tracing in containing the 2014 Ebola outbreak: a review. African health sciences. 2017; 17(1): 225–36. doi: 10.4314/ahs.v17i1.28 29026397 Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. International Journal of Surgery. 2010; 8: 336–341. doi: 10.1016/j.ijsu.2010.02.007 20171303 CASP: Critical Appraisal Skills Programme. CASP Qualitative Checklist. 2018. https://casp-uk.net/wp-content/uploads/2018/01/CASP-Qualitative-Checklist-2018.pdf BMJ: Critical appraisal checklist for a questionaire study. BMJ 2004; 328. https://www.bmj.com/content/328/7451/1312/related. Attride-Stirling J. Thematic networks: an analytic tool for qualitative research. Qualitative research. 2001 Dec; 1(3): 385–405. Thomas J, Harden A. Methods for the thematic synthesis of qualitative research in systematic reviews. BMC medical research methodology. 2008 Dec 1; 8(1): 45. doi: 10.1186/1471-2288-8-45 18616818 Altmann S, Milsom L, Zillessen H, Blasone R, Gerdon F, Bach R, et al. Acceptability of app-based contact tracing for COVID-19: cross-country survey evidence. MedRxiv [preprint]. 2020 medRxiv 20091587 [posted 2020 May 08]. https://www.medrxiv.org/content/10.1101/2020.05.05.20091587v1. Bachtiger P, Adamson A, Quint JK, Peters NS. Belief of previous COVID-19 infection and unclear government policy are associated with reduced willingness to participate in app-based contact tracing: a UK-wide observational study of 13,000 patients. MedRxiv [preprint]. 2020 medRxiv 20120337 [posted 2020 June 06]. https://www.medrxiv.org/content/10.1101/2020.06.03.20120337v1. Filer J, Gheorghiu D. Test, track, and trace: how is the NHSX Covid app performing in a hospital setting? MedRxiv [preprint]. 2020 medRxiv 20116590 [posted 2020 June 03]. https://www.medrxiv.org/content/10.1101/2020.06.01.20116590v1 Jansen-Kosterink SM, Hurmuz M, den Ouden M, van Velsen L. Predictors to use mobile apps for monitoring COVID-19 symptoms and contact tracing: a survey among Dutch citizens. MedRxiv [preprint]. 2020 medRxiv 20113423 [posted 2020 June 02]. https://www.medrxiv.org/content/10.1101/2020.06.02.20113423v1 Thomas R, Michaleff Z, Greenwood H, Abukmail E, Glasziou P. More than privacy: Australians’ concerns and misconceptions about the COVIDSafe app: a short report. MedRxiv [preprint]. 2020 medRxiv 20126110 [posted 2020 July 29]. https://www.medrxiv.org/content/10.1101/2020.06.09.20126110v2 Williams SN, Armitage CJ, Tampe T, Dienes K. Public attitudes towards COVID-19 contact tracing apps: a UK-based focus group study. MedRxiv [preprint]. 2020 medRxiv 20102269 [posted 2020 May 18]. https://www.medrxiv.org/content/10.1101/2020.05.14.20102269v1 Caleo G, Duncombe J, Jephcott F, Lokuge K, Mills C, Looijen E, et al. The factors affecting household transmission dynamics and community compliance with Ebola control measures: a mixed-methods study in a rural village in Sierra Leone. BMC public health. 2018; 18: 248. doi: 10.1186/s12889-018-5158-6 29439682 Greiner AL, Angelo KM, McCollum AM, Mirkovic K, Arthur R, Angulo FJ. Addressing contact tracing challenges-critical to halting Ebola virus disease transmission. International Journal of Infectious Diseases. 2015; 41: 53–55. doi: 10.1016/j.ijid.2015.10.025 26546808 Ilesanmi OS. Learning from the challenges of Ebola Virus Disease contact tracers in Sierra Leone, February, 2015. Pan Afr Med J. 2015; 22 Suppl 1: 21. 26740849 Barker KM, Ling EJ, Fallah M, VanDeBogert B, Kodl Y, Macauley RJ, et al. Community engagement for health system resilience: evidence from Liberia’s Ebola epidemic. Health Policy and Planning. 2020; 35: 416–423. doi: 10.1093/heapol/czz174 32040166 Olu OO, Lamunu M, Nanyunja M, Dafae F, Samba T, Sempiira N, et al. Contact tracing during an outbreak of Ebola virus disease in the Western area districts of Sierra Leone: lessons for future Ebola outbreak response. Frontiers in Public Health. 2016 Jun 22; 4: 130. doi: 10.3389/fpubh.2016.00130 27446896 Helms YB, Hamdiui N, Eilers R, Hoebe C, Dukers-Muijrers N, van den Kerkhof H, et al. Online respondent-driven detection for enhanced contact tracing of close-contact infectious diseases: benefits and barriers for public health practice. MedRxiv [preprint]. 2020 medRxiv 20138024 [posted 2020 June 24]. https://www.medrxiv.org/content/10.1101/2020.06.24.20138024v1 Rosenstock IM, Strecher VJ, Becker MH. Social learning theory and the health belief model. 1988; 15: 175–183. 10.1371/journal.pone.0241473.r001 Decision Letter 0 Soundy Andrew Academic Editor 2020 Andrew Soundy This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Submission Version 0 Transfer Alert

This paper was transferred from another journal. As a result, its full editorial history (including decision letters, peer reviews and author responses) may not be present.

25 Sep 2020

PONE-D-20-28526

Facilitators and barriers to engagement with contact tracing during infectious disease outbreaks: A rapid review of the evidence

PLOS ONE

Dear Dr. Megnin-Viggars,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Can you consider the reviewer comments and respond. 

Editor request:

Can you either identify a checklist for reporting rapid reviews (couldn't see one on equator network) OR use reviews such as these to check reporting of methods meets a high standard e.g., https://systematicreviewsjournal.biomedcentral.com/articles/10.1186/s13643-016-0258-9 

https://bmcmedicine.biomedcentral.com/articles/10.1186/s12916-015-0465-6 

Please submit your revised manuscript by 8 October 2020. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Andrew Soundy

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please clearly state the exclusion criteria used.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: N/A

Reviewer #2: N/A

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: This study is a rapid review of contact tracing methods, to identify factors that are associated with greater engagement by patients. The research is interesting because it traces some facilitating elements and obstacles to contact tracing.

The manuscript is written in a clear and concise manner and provides agile information.

The authors refer to the PRISMA statement. However, these criteria apply to systematic reviews. The protocol they developed was not deposited on PROSPERO. Authors should say why they preferred to do a rapid review and which PRISMA criteria they did not follow.

Most of the retrieved studies concern Covid-19 and Ebola. The authors could tell us if there is a difference in the attitude of patients in these two diseases. For example, mistrust seems more frequent in Covid-19.

A few comments on the different geographical origin of the answers could also be interesting

Reviewer #2: This is a nice, concise and topical paper. Methods, recommendations and reporting are clear and relevant flow diagram and checklist for systematic review included. I support publication of this work.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Nicola Magnavita

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

 10.1371/journal.pone.0241473.r002 Author response to Decision Letter 0 Submission Version 1

30 Sep 2020

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

This has been done

2. Please clearly state the exclusion criteria used.

This has been clarified in the manuscript

Reviewer #1: This study is a rapid review of contact tracing methods, to identify factors that are associated with greater engagement by patients. The research is interesting because it traces some facilitating elements and obstacles to contact tracing.

The manuscript is written in a clear and concise manner and provides agile information.

The authors refer to the PRISMA statement. However, these criteria apply to systematic reviews. The protocol they developed was not deposited on PROSPERO. Authors should say why they preferred to do a rapid review and which PRISMA criteria they did not follow.

Thank you for your comment, this rapid systematic review satisfied all of the PRISMA checklist items, and this has now been clarified in the manuscript. We have also clarified in the manuscript that, unfortunately due to time restrictions, the protocol was not registered on PROSPERO.

Most of the retrieved studies concern Covid-19 and Ebola. The authors could tell us if there is a difference in the attitude of patients in these two diseases. For example, mistrust seems more frequent in Covid-19. Thank you for this interesting observation.

I think this is true, but interpretation may be confounded by the fact that most of the COVID-19 studies included here focus on app-based contact tracing systems and the Ebola studies on manual contact tracing, so it is possible that it is mode of delivery differences rather than disease differences but I have added some additional text on page 22 of the manuscript to highlight these differences.

A few comments on the different geographical origin of the answers could also be interesting

I agree this would be interesting, but unfortunately I do not think that the data allows such comparisons given that any geographical differences will be confounded by potential disease differences and mode of delivery differences. However, a prominent finding of this review was that there were a number of higher order conceptual themes that appeared to cut across studies. Previously we had conceptualized these as just cutting across mode of delivery, but I have now added some additional text to page 21 of the manuscript to highlight that these themes emerged irrespective of mode of delivery, type of disease (COVID-19 and Ebola), and geographical region.

Reviewer #2: This is a nice, concise and topical paper. Methods, recommendations and reporting are clear and relevant flow diagram and checklist for systematic review included. I support publication of this work.

Thank you for your comments

Submitted filename: Response to reviewers.docx

 10.1371/journal.pone.0241473.r003 Decision Letter 1 Soundy Andrew Academic Editor 2020 Andrew Soundy This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Submission Version 1

16 Oct 2020

Facilitators and barriers to engagement with contact tracing during infectious disease outbreaks: A rapid review of the evidence

PONE-D-20-28526R1

Dear Dr. Megnin-Viggars,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Andrew Soundy

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: N/A

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: none. authors have adequately addressed the comments raised in the previous round of review . the language articles must be clear, correct, and unambiguous.

The minimum character count is not useful in this section.

Reviewer #2: (No Response)

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Nicola Magnavita

Reviewer #2: No

 10.1371/journal.pone.0241473.r004 Acceptance letter Soundy Andrew Academic Editor 2020 Andrew Soundy This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

20 Oct 2020

PONE-D-20-28526R1

Facilitators and barriers to engagement with contact tracing during infectious disease outbreaks: A rapid review of the evidence

Dear Dr. Megnin-Viggars:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Andrew Soundy

Academic Editor

PLOS ONE