<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article
  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="discussion" dtd-version="3.0" xml:lang="EN">
<front>
<journal-meta><journal-id journal-id-type="nlm-ta">PLoS Med</journal-id><journal-id journal-id-type="publisher-id">plos</journal-id><journal-id journal-id-type="pmc">plosmed</journal-id><!--===== Grouping journal title elements =====--><journal-title-group><journal-title>PLoS Medicine</journal-title></journal-title-group><issn pub-type="epub">1549-1676</issn><publisher>
<publisher-name>Public Library of Science</publisher-name>
<publisher-loc>San Francisco, USA</publisher-loc></publisher></journal-meta>
<article-meta><article-id pub-id-type="publisher-id">08-PLME-ES-2741R2</article-id><article-id pub-id-type="doi">10.1371/journal.pmed.1000065</article-id><article-categories><subj-group subj-group-type="heading"><subject>Essay</subject></subj-group><subj-group subj-group-type="Discipline"><subject>Evidence-Based Healthcare</subject><subject>Public Health and Epidemiology</subject></subj-group></article-categories><title-group><article-title>Preventing Bias in Cluster Randomised Trials</article-title><alt-title alt-title-type="running-head">Essay</alt-title></title-group><contrib-group>
<contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Giraudeau</surname><given-names>Bruno</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref><xref ref-type="aff" rid="aff2"><sup>2</sup></xref><xref ref-type="aff" rid="aff3"><sup>3</sup></xref><xref ref-type="aff" rid="aff4"><sup>4</sup></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib>
<contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Ravaud</surname><given-names>Philippe</given-names></name><xref ref-type="aff" rid="aff4"><sup>4</sup></xref><xref ref-type="aff" rid="aff5"><sup>5</sup></xref><xref ref-type="aff" rid="aff6"><sup>6</sup></xref></contrib>
</contrib-group><aff id="aff1"><label>1</label><addr-line>INSERM, CIC 202, Tours, France</addr-line>       </aff><aff id="aff2"><label>2</label><addr-line>Université François Rabelais, Tours, France</addr-line>       </aff><aff id="aff3"><label>3</label><addr-line>CHRU de Tours, Tours, France</addr-line>       </aff><aff id="aff4"><label>4</label><addr-line>INSERM, U738, Paris, France</addr-line>       </aff><aff id="aff5"><label>5</label><addr-line>Assistance Publique–Hôpitaux de Paris, Hôpital Bichat, Département d'Epidémiologie, Biostatistique et Recherche Clinique, Paris, France</addr-line>       </aff><aff id="aff6"><label>6</label><addr-line>Université Paris 7–Denis Diderot, Paris, France</addr-line>       </aff><author-notes>
<corresp id="cor1">* E-mail: <email xlink:type="simple">giraudeau@med.univ-tours.fr</email></corresp>
<fn fn-type="con"><p><ext-link ext-link-type="uri" xlink:href="http://www.icmje.org/" xlink:type="simple">ICMJE</ext-link> criteria for authorship read and met: BG PR. Contributed to the writing of the paper: BG PR.</p></fn>
<fn fn-type="conflict"><p>The authors have declared that no competing interests exist.</p></fn></author-notes><pub-date pub-type="collection"><month>5</month><year>2009</year></pub-date><pub-date pub-type="epub"><day>5</day><month>5</month><year>2009</year></pub-date><volume>6</volume><issue>5</issue><elocation-id>e1000065</elocation-id><!--===== Grouping copyright info into permissions =====--><permissions><copyright-year>2009</copyright-year><copyright-holder>Giraudeau et al</copyright-holder><license><license-p>This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.</license-p></license></permissions><abstract abstract-type="toc">
<p>Bruno Giraudeau and Philippe Ravaud discuss the difficulties in preventing selection bias and applying intention-to-treat analysis in cluster randomized trials, and propose some solutions.</p>
</abstract><funding-group><funding-statement>The authors received no external funding for this work.</funding-statement></funding-group><counts><page-count count="6"/></counts></article-meta>
</front>
<body><boxed-text position="float"><sec id="s1a">
<title>Summary Points</title>
<list list-type="bullet"><list-item>
<p>In CRTs, the comparability of groups is challenged because groups of trial participants rather than the participants themselves are randomised.</p>
</list-item><list-item>
<p>The specific chronology of such trials compromises allocation concealment (i.e., clusters are recruited and randomised and then participants are recruited), which can induce differential recruitment and thus quantitative and qualitative imbalance between groups.</p>
</list-item><list-item>
<p>The principle of intention to treat is challenged in CRTs because of the lack of any statistical method to handle non-recruited participants.</p>
</list-item><list-item>
<p>Empty clusters (i.e., clusters with no data for participants), which are randomised units, are discarded from the analysis—a violation of the very principle of intention to treat.</p>
</list-item><list-item>
<p>Some CRTs may be better analysed as observational studies, with some form of adjustment used such as propensity-score methods.</p>
</list-item></list>
</sec></boxed-text><sec id="s2">
<title/>
<p>In randomised trials, internal validity is defined as “the extent to which the design and conduct of a study are likely to have prevented bias” <xref ref-type="bibr" rid="pmed.1000065-Campbell1">[1]</xref>,<xref ref-type="bibr" rid="pmed.1000065-Green1">[2]</xref>. In conducting such trials, trialists try to prevent selection bias through randomisation and allocation concealment (defined as “the process used to ensure that the person deciding to enter a participant into a randomised controlled trial does not know the comparison group into which that individual will be allocated” <xref ref-type="bibr" rid="pmed.1000065-Green1">[2]</xref>) and attrition bias through an intention-to-treat (ITT) analysis. ITT analysis has indeed been defined as one of the cornerstones of the analysis strategy of randomised trials because it allows for preserving the benefits of randomisation <xref ref-type="bibr" rid="pmed.1000065-Fisher1">[3]</xref>. With an ITT analysis, data for all randomised participants are analysed in the groups to which they were originally randomly allocated “regardless of their adherence with the entry criteria, regardless of the treatment they actually received, and regardless of subsequent withdrawal from treatment or deviation from the protocol” <xref ref-type="bibr" rid="pmed.1000065-Hollis1">[4]</xref>. ITT analysis entails the use of ad hoc statistical methods to handle missing outcome data when participants withdraw from the trial or are lost to follow-up <xref ref-type="bibr" rid="pmed.1000065-Hollis1">[4]</xref>,<xref ref-type="bibr" rid="pmed.1000065-Lachin1">[5]</xref>. The ITT principle is widely used in analysing data from individually randomised trials but is much more difficult in cluster randomised trials (CRTs), and this issue is not clearly covered in the main methodological textbooks on the topic <xref ref-type="bibr" rid="pmed.1000065-Donner1">[6]</xref>,<xref ref-type="bibr" rid="pmed.1000065-Murray1">[7]</xref>.</p>
<p>Here, we describe the difficulties in preventing selection bias and applying ITT analysis in CRTs (other biases are discussed in Puffer et al. <xref ref-type="bibr" rid="pmed.1000065-Puffer1">[8]</xref>) and propose some solutions to deal with these issues in this trial design.</p>
</sec><sec id="s3">
<title>CRTs: Randomising Clusters Rather Than Individuals</title>
<p>In CRTs, “intact social units, or clusters of individuals, rather than individuals themselves, are randomised” <xref ref-type="bibr" rid="pmed.1000065-Donner1">[6]</xref>. For example, hospitals, wards, or physicians can be randomised, as well as schools or geographical areas. Such a design is well adapted to assess organisational and behavioural interventions and health promotion programmes—interventions that are usually implemented at the level of health organisational units or geographical areas <xref ref-type="bibr" rid="pmed.1000065-Ukoumunne1">[9]</xref>. As well, randomisation of clusters rather than individuals could prevent contamination. As an example, to assess the impact of a screening programme, widespread publicity is needed to encourage participants to undergo screening. With individual randomisation, communication among participants would induce contamination, but with cluster randomisation, it may strengthen participant compliance.</p>
<p>Use of the CRT has greatly increased over the past 15 years <xref ref-type="bibr" rid="pmed.1000065-Bland1">[10]</xref> and has motivated the publication of an extension of the CONSORT Statement for this design <xref ref-type="bibr" rid="pmed.1000065-Campbell2">[11]</xref> because of its particular methodological issues. The main issue is that observations from the same cluster are more similar than observations from two different clusters. This situation requires the use of both an inflated sample size and adapted statistical analysis to take into account this concern <xref ref-type="bibr" rid="pmed.1000065-Donner1">[6]</xref>,<xref ref-type="bibr" rid="pmed.1000065-Murray1">[7]</xref>. Otherwise, for the recruitment process, we can distinguish two different designs: a whole CRT or a CRT with active recruitment. In the first design, once the person in charge of the cluster (the cluster guardian <xref ref-type="bibr" rid="pmed.1000065-Edwards1">[12]</xref>) has agreed to participate, every individual belonging to the cluster is automatically recruited for the trial; in the second design, the guardian (or someone other than the guardian but depending on the guardian) must select and include participants for the trial. Also, Murray distinguishes between cohort designs, whereby a sample of participants is included, followed up, and assessed repeatedly (as is usually done in individually randomised trials), and repeated cross-sectional designs, whereby a distinct sample of participants is assessed at each assessment time <xref ref-type="bibr" rid="pmed.1000065-Murray1">[7]</xref>. Such a distinction makes sense only in whole CRTs. The design is always a cohort one when it involves active recruitment.</p>
</sec><sec id="s4">
<title>The Challenge of Comparability of Groups in CRTs</title>
<p>In individually randomised trials, randomisation and allocation concealment aim to prevent selection bias and allow for the comparability of groups at the beginning of the study. The aim of ITT analysis is to maintain this comparability during analysis. In CRTs, the situation is more complex because (i) the design entails a hierarchical structure (cluster and individual levels) and (ii) recruitment and follow-up processes differ from those in individually randomised trials.</p>
<p>First, the hierarchical structure of CRTs requires the consideration of both the cluster and individual levels. When Elbourne et al. <xref ref-type="bibr" rid="pmed.1000065-Elbourne1">[13]</xref> appealed for an extension of the CONSORT Statement to CRTs, they explicitly stated that authors must report whether “[the ITT] principle applies to clusters, individuals or both”. Campbell defined ITT analysis in CRTs as taking into account all participants, regardless of whether non-adherence to the protocol occurred at the individual or cluster level <xref ref-type="bibr" rid="pmed.1000065-Campbell3">[14]</xref>. Indeed, in CRTs, participants lost to follow-up and protocol deviation can occur at the level of the cluster (cluster withdrawal or lost to follow-up, inactive cluster, merging of clusters) or the individual (participant withdrawal or lost to follow-up, or transfer from one cluster to another). Moreover, results of a CRT can be analysed by considering the individual or cluster as the statistical unit. Even in the latter case, a summary statistic is estimated from individual responses within each cluster. Therefore, the comparability of groups must be achieved at both the cluster (i.e., for randomised units) and individual levels.</p>
<p>Second, in a CRT, both recruitment and follow-up raise specific issues that may compromise the comparability of groups (<xref ref-type="fig" rid="pmed-1000065-g001">Figures 1</xref> and <xref ref-type="fig" rid="pmed-1000065-g002">2</xref>). The usual definition of an ITT analysis in CRTs is restrictive because it focuses only on follow-up issues. However, during the recruitment process, clusters may withdraw, or cluster guardians may not actively recruit participants; these situations lead to empty clusters, which should be taken into account to apply the ITT principle. Another important issue is differential recruitment between active clusters, which could be both quantitative (i.e., different number of participants recruited) and qualitative (i.e., participants with different characteristics recruited in both groups). As an example, in the UK BEAM trial, 71.4% of recruited participants were in the intervention group, even though the randomisation was 1∶1, and groups were not comparable on several clinically important criteria <xref ref-type="bibr" rid="pmed.1000065-Farrin1">[15]</xref>. Eldridge et al. concluded that “about a quarter [of CRTs] were potentially biased because of procedures surrounding recruitment and identification of patients” <xref ref-type="bibr" rid="pmed.1000065-Eldridge1">[16]</xref>, as previously acknowledged by Puffer et al. <xref ref-type="bibr" rid="pmed.1000065-Puffer1">[8]</xref>.</p>
<fig id="pmed-1000065-g001" position="float"><object-id pub-id-type="doi">10.1371/journal.pmed.1000065.g001</object-id><label>Figure 1</label><caption>
<title>Recruitment issues in cluster randomised trials.</title>
</caption><graphic mimetype="image" position="float" xlink:href="info:doi/10.1371/journal.pmed.1000065.g001" xlink:type="simple"/></fig><fig id="pmed-1000065-g002" position="float"><object-id pub-id-type="doi">10.1371/journal.pmed.1000065.g002</object-id><label>Figure 2</label><caption>
<title>Follow-up issues in cluster randomised trials.</title>
</caption><graphic mimetype="image" position="float" xlink:href="info:doi/10.1371/journal.pmed.1000065.g002" xlink:type="simple"/></fig></sec><sec id="s5">
<title>The Challenge of Applying ITT Analysis in CRTs</title>
<p>In CRTs, cluster withdrawal or loss to follow-up and participant withdrawal or loss to follow-up must be handled as is usually done in individually randomised trials, by use of ad hoc missing data methods <xref ref-type="bibr" rid="pmed.1000065-Taljaard1">[17]</xref>,<xref ref-type="bibr" rid="pmed.1000065-Hunsberger1">[18]</xref>. More specific to CRTs are participant switches from one cluster to another (e.g., patients who change physicians) and cluster merging (e.g., two medical practices that merge). These follow-up issues are not problematic per se and can be easily handled by keeping clusters as they were randomised. Thus, participants who switch from one cluster to another must be kept in their original cluster, and merged clusters must be split.</p>
<p>The major difference between individually randomised trials and CRTs in applying the ITT principle is that in the former, we know which participants were randomised and must be taken into account in the ITT analysis, whereas in CRTs, we know which clusters have been randomised but we frequently do not know exactly which participants within clusters should have been included in the trial. Whole CRTs and CRTs with active recruitment raise distinct issues, but for both, this dilemma is the real challenge of applying ITT analysis and preserving the comparability of groups.</p>
<sec id="s5a">
<title>Whole CRTs</title>
<p>In whole CRTs, empty clusters occur when cluster guardians withdraw just after the randomisation and before any data on participants are collected. The guardians make these decisions once they know the allocation result, which could influence the likelihood of withdrawal. So excluding such empty clusters from analysis (as is always done) is in essence post-randomisation exclusion. Furthermore, in CRTs, the number of randomised units is much lower than that in individually randomised trials, so any randomised unit has greater influence in a CRT than in an individually randomised trial. Also, in CRTs with empty clusters, although we know some cluster characteristics, often we do not know the number or characteristics of participants who should have been included in those clusters if they had been active. This scenario prevents the use of any statistical solution: knowing cluster characteristics does not allow in any way the derivation of participant characteristics. Such randomised clusters that lack any data on participants are then removed before analysis, which violates the very definition of the ITT (i.e., exclusion of randomised units). In CRTs, therefore, extreme vigilance is needed to ensure cluster guardians' adherence to the trial protocol, before the randomisation of the clusters they are in charge of, because currently, we lack statistical methods to limit the induced bias.</p>
</sec><sec id="s5b">
<title>CRTs with Active Recruitment</title>
<p>As emphasised, CRTs with active recruitment “first recruit the clusters, then randomise and finally recruit the participants: such an approach invites bias” <xref ref-type="bibr" rid="pmed.1000065-Torgerson1">[19]</xref>. In the extreme, some cluster guardians may be inactive (i.e., they do not recruit any participants), and these inactive guardians may moreover be more numerous in one group than in another. This situation is similar to “passive withdrawal”: guardians are inactive recruiters because they do not adhere to the allocation result (i.e., the cluster they are in charge of has not been randomised to the group they expected to be in). Actually, any time recruitment of participants occurs after randomisation, (i) participants are selected by someone who could be aware of the group to which the participants will be allocated, and (ii) participants consent not to random allocation but rather to participation in and allocation to a pre-determined group, which could induce differential recruitment or consent and selection bias <xref ref-type="bibr" rid="pmed.1000065-Puffer1">[8]</xref>,<xref ref-type="bibr" rid="pmed.1000065-Hahn1">[20]</xref>,<xref ref-type="bibr" rid="pmed.1000065-Jordhoy1">[21]</xref>. The only way to prevent differential recruitment is to ensure some form of allocation concealment during recruitment. Puffer et al. <xref ref-type="bibr" rid="pmed.1000065-Puffer1">[8]</xref> proposed the identification and complete inclusion of participants before the randomisation of a cluster, which allows for maintenance of the usual chronology of a randomised trial. Such a strategy thus prevents both empty randomised clusters and selection bias but cannot be systematically implemented for logistical reasons (e.g., in a trial including incident patients rather than prevalent cases). Two complementary solutions are (i) changing the time of randomisation by randomising clusters only when the first participant is identified (the index case concept) and (ii) blinding independent recruiters to the allocation group. The index case concept could prevent empty clusters but does not prevent differential recruitment.</p>
<p>Actually, some similarity exists between this potential differential recruitment in CRTs and survey non-response. Non-response is a source of bias because non-responders are not a random sample of surveyed people. In CRTs, participants included without allocation concealment are not a random sample of eligible participants. In the context of survey non-response, much work has been done to calibrate estimation, and methods such as weighting adjustments or imputations are classically used <xref ref-type="bibr" rid="pmed.1000065-Groves1">[22]</xref>,<xref ref-type="bibr" rid="pmed.1000065-Kessler1">[23]</xref>. In CRTs, the situation is more complex because contrary to surveys, the number of eligible participants is not known. However, the question remains as to whether all CRTs really benefit from randomisation and whether some trial results would be better analysed as observational studies with some form of adjustment used, such as propensity scores <xref ref-type="bibr" rid="pmed.1000065-Rosenbaum1">[24]</xref>,<xref ref-type="bibr" rid="pmed.1000065-Rosenbaum2">[25]</xref>. Some methodologists have resorted to such a solution <xref ref-type="bibr" rid="pmed.1000065-Ravaud1">[26]</xref>,<xref ref-type="bibr" rid="pmed.1000065-vanMarwijk1">[27]</xref>, which raises another issue: “how the levels of the individual subject and the cluster should be considered in the estimation and application of propensity scores” <xref ref-type="bibr" rid="pmed.1000065-Nicholas1">[28]</xref>. Further statistical research to transpose such methods specifically to CRTs is therefore warranted.</p>
<p>We provide some recommendations for the planning and analysis of data in CRTs to improve the comparability of groups in such trials in light of the issues of recruitment and ITT analysis (<xref ref-type="sec" rid="s5b1a">Box 1</xref>): some issues may be easily handled, whereas others remain without a solution.</p>
<boxed-text position="float"><sec id="s5b1a">
<title>Box 1: Recommendations for the Planning of and Analysis of Data in CRTs To Improve the Comparability of Groups</title>
<sec id="s5b1a1">
<title>Handling Recruitment Issues</title>
<p><bold>Cluster level:</bold></p>
<list list-type="bullet"><list-item>
<p>Monitor cluster guardians' adherence to the protocol before the randomisation of the cluster they are in charge of.                             <list list-type="bullet"><list-item>
<p>For whole CRTs, this monitoring will help prevent clusters withdrawing after randomisation and before the collection of data for participants.</p>
</list-item><list-item>
<p>For CRTs with active recruitment, this monitoring will help prevent empty clusters due to inactivity of guardians.</p>
</list-item></list>                         </p>
</list-item></list>
<p><bold>Individual level:</bold></p>
<p><bold><italic>Whole CRTs</italic></bold></p>
<list list-type="bullet"><list-item>
<p>Ensure the inclusion of all participants belonging to the randomised clusters.</p>
</list-item><list-item>
<p>For a cohort design (i.e., participants are included, followed up, and assessed):                             <list list-type="bullet"><list-item>
<p>Consider participants who migrate out of clusters (out-migrants) as being withdrawn or lost to follow-up.</p>
</list-item><list-item>
<p>Discard data for participants who migrate into a cluster (in-migrants).</p>
</list-item></list>                         </p>
</list-item></list>
<p><bold><italic>CRTs with active recruitment</italic></bold></p>
<list list-type="bullet"><list-item>
<p>Whenever possible, identify and completely include participants before randomising a cluster, to maintain the usual chronology of a randomised trial (recruitment followed by randomisation) and help prevent selection bias.</p>
</list-item></list>
<p>If complete inclusion of participants is not possible, the following two solutions can be used in combination:</p>
<list list-type="bullet"><list-item>
<p>If possible, randomise clusters only when the first participant is included (index case concept) to prevent empty clusters.</p>
</list-item><list-item>
<p>If possible, have blinded independent recruiters include participants, so that the inclusion process can be independent from the allocation process.</p>
</list-item></list>
</sec><sec id="s5b1a2">
<title>Analysis: Handling Follow-Up Issues</title>
<p><bold>Cluster level:</bold></p>
<list list-type="bullet"><list-item>
<p>Take into account any cluster that withdrew or was lost to follow-up by using ad hoc missing data methods for participants included in these clusters.</p>
</list-item><list-item>
<p>If two or more clusters merge during the trial, split the merged clusters so that the clusters analysed are those that were initially recruited.</p>
</list-item></list>
<p><bold>Individual level:</bold></p>
<list list-type="bullet"><list-item>
<p>Take into account any participant who withdrew or was lost to follow-up by using ad hoc missing data methods.</p>
</list-item><list-item>
<p>Keep any participant who transferred from one cluster to another in the original cluster.</p>
</list-item></list>
</sec><sec id="s5b1a3">
<title>Analysis: Handling Quantitative and Qualitative Imbalance between Intervention Groups</title>
<p><bold>Whole CRTs:</bold></p>
<list list-type="bullet"><list-item>
<p>Use adjustment methods to cope with potential imbalances in both cluster and individual characteristics, which are frequent when the number of randomised clusters is small.</p>
</list-item></list>
<p><bold>CRTs with active recruitment:</bold></p>
<list list-type="bullet"><list-item>
<p>Calibrate estimation by using weighting adjustments (e.g., propensity-score methods) to deal with quantitative and qualitative imbalance due to potential differential recruitment induced by lack of allocation concealment when including participants.</p>
</list-item></list>
</sec></sec></boxed-text></sec></sec><sec id="s6">
<title>Conclusion</title>
<p>The application of the ITT principle in analysis of data is much more complex in CRTs than in individually randomised trials because the principle must be applied at the level of both the cluster and the individual, and because of challenging issues surrounding the recruitment process in CRTs. These issues raise concerns regarding the internal validity of such trials.</p>
</sec></body>
<back>
<ack>
<p>The authors thank Agnes Dechartres for helpful comments.</p>
</ack>
<ref-list>
<title>References</title>
<ref id="pmed.1000065-Campbell1"><label>1</label><element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author">
<name name-style="western"><surname>Campbell</surname><given-names>DT</given-names></name>
</person-group>             <year>1957</year>             <article-title>Factors relevant to the validity of experiments in social settings.</article-title>             <source>Psychol Bull</source>             <volume>54</volume>             <fpage>297</fpage>             <lpage>312</lpage>          </element-citation></ref>
<ref id="pmed.1000065-Green1"><label>2</label><element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="editor">
<name name-style="western"><surname>Green</surname><given-names>S</given-names></name>
<name name-style="western"><surname>Higgins</surname><given-names>J</given-names></name>
</person-group>             <year>2005</year>             <article-title>Glossary. Cochrane handbook for systematic reviews of interventions 4.2.5.</article-title>             <comment>Available: <ext-link ext-link-type="uri" xlink:href="http://www.cochrane.org/resources/glossary.htm" xlink:type="simple">http://www.cochrane.org/resources/glossary.htm</ext-link>. Accessed 23 March 2009</comment>          </element-citation></ref>
<ref id="pmed.1000065-Fisher1"><label>3</label><element-citation publication-type="other" xlink:type="simple">             <person-group person-group-type="author">
<name name-style="western"><surname>Fisher</surname><given-names>LD</given-names></name>
<name name-style="western"><surname>Dixon</surname><given-names>DO</given-names></name>
<name name-style="western"><surname>Herson</surname><given-names>J</given-names></name>
<name name-style="western"><surname>Frankowski</surname><given-names>RK</given-names></name>
<name name-style="western"><surname>Hearon</surname><given-names>MS</given-names></name>
<etal/></person-group>             <year>1990</year>             <article-title>Intention to treat in clinical trials.</article-title>             <person-group person-group-type="editor">
<name name-style="western"><surname>Pearce</surname><given-names>KE</given-names></name>
</person-group>             <source>Statistical issues in drug research and development</source>             <publisher-loc>New York</publisher-loc>             <publisher-name>Marcel Dekker</publisher-name>             <fpage>331</fpage>             <lpage>350</lpage>          </element-citation></ref>
<ref id="pmed.1000065-Hollis1"><label>4</label><element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author">
<name name-style="western"><surname>Hollis</surname><given-names>S</given-names></name>
<name name-style="western"><surname>Campbell</surname><given-names>F</given-names></name>
</person-group>             <year>1999</year>             <article-title>What is meant by intention to treat analysis? Survey of published randomised controlled trials.</article-title>             <source>BMJ</source>             <volume>319</volume>             <fpage>670</fpage>             <lpage>674</lpage>          </element-citation></ref>
<ref id="pmed.1000065-Lachin1"><label>5</label><element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author">
<name name-style="western"><surname>Lachin</surname><given-names>JM</given-names></name>
</person-group>             <year>2000</year>             <article-title>Statistical considerations in the intent-to-treat principle.</article-title>             <source>Control Clin Trials</source>             <volume>21</volume>             <fpage>167</fpage>             <lpage>189</lpage>          </element-citation></ref>
<ref id="pmed.1000065-Donner1"><label>6</label><element-citation publication-type="other" xlink:type="simple">             <person-group person-group-type="author">
<name name-style="western"><surname>Donner</surname><given-names>A</given-names></name>
<name name-style="western"><surname>Klar</surname><given-names>N</given-names></name>
</person-group>             <year>2000</year>             <source>Design and analysis of cluster randomization trials</source>             <publisher-loc>London</publisher-loc>             <publisher-name>Arnold</publisher-name>             <fpage>178</fpage>          </element-citation></ref>
<ref id="pmed.1000065-Murray1"><label>7</label><element-citation publication-type="other" xlink:type="simple">             <person-group person-group-type="author">
<name name-style="western"><surname>Murray</surname><given-names>DM</given-names></name>
</person-group>             <year>1998</year>             <source>Design and analysis of group-randomized trials</source>             <publisher-loc>New York</publisher-loc>             <publisher-name>Oxford University Press</publisher-name>             <fpage>467</fpage>          </element-citation></ref>
<ref id="pmed.1000065-Puffer1"><label>8</label><element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author">
<name name-style="western"><surname>Puffer</surname><given-names>S</given-names></name>
<name name-style="western"><surname>Torgerson</surname><given-names>D</given-names></name>
<name name-style="western"><surname>Watson</surname><given-names>J</given-names></name>
</person-group>             <year>2003</year>             <article-title>Evidence for risk of bias in cluster randomised trials: Review of recent trials published in three general medical journals.</article-title>             <source>BMJ</source>             <volume>327</volume>             <fpage>785</fpage>             <lpage>789</lpage>          </element-citation></ref>
<ref id="pmed.1000065-Ukoumunne1"><label>9</label><element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author">
<name name-style="western"><surname>Ukoumunne</surname><given-names>OC</given-names></name>
<name name-style="western"><surname>Gulliford</surname><given-names>MC</given-names></name>
<name name-style="western"><surname>Chinn</surname><given-names>S</given-names></name>
<name name-style="western"><surname>Sterne</surname><given-names>JA</given-names></name>
<name name-style="western"><surname>Burney</surname><given-names>PG</given-names></name>
</person-group>             <year>1999</year>             <article-title>Methods for evaluating area-wide and organisation-based interventions in health and health care: A systematic review.</article-title>             <source>Health Technol Assess</source>             <volume>3</volume>             <fpage>iii-92</fpage>          </element-citation></ref>
<ref id="pmed.1000065-Bland1"><label>10</label><element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author">
<name name-style="western"><surname>Bland</surname><given-names>JM</given-names></name>
</person-group>             <year>2004</year>             <article-title>Cluster randomised trials in the medical literature: Two bibliometric surveys.</article-title>             <source>BMC Med Res Methodol</source>             <volume>4</volume>             <fpage>21</fpage>          </element-citation></ref>
<ref id="pmed.1000065-Campbell2"><label>11</label><element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author">
<name name-style="western"><surname>Campbell</surname><given-names>MK</given-names></name>
<name name-style="western"><surname>Elbourne</surname><given-names>DR</given-names></name>
<name name-style="western"><surname>Altman</surname><given-names>DG</given-names></name>
</person-group>             <year>2004</year>             <article-title>CONSORT statement: Extension to cluster randomised trials.</article-title>             <source>BMJ</source>             <volume>328</volume>             <fpage>702</fpage>             <lpage>708</lpage>          </element-citation></ref>
<ref id="pmed.1000065-Edwards1"><label>12</label><element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author">
<name name-style="western"><surname>Edwards</surname><given-names>SJ</given-names></name>
<name name-style="western"><surname>Braunholtz</surname><given-names>DA</given-names></name>
<name name-style="western"><surname>Lilford</surname><given-names>RJ</given-names></name>
<name name-style="western"><surname>Stevens</surname><given-names>AJ</given-names></name>
</person-group>             <year>1999</year>             <article-title>Ethical issues in the design and conduct of cluster randomised controlled trials.</article-title>             <source>BMJ</source>             <volume>318</volume>             <fpage>1407</fpage>             <lpage>1409</lpage>          </element-citation></ref>
<ref id="pmed.1000065-Elbourne1"><label>13</label><element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author">
<name name-style="western"><surname>Elbourne</surname><given-names>DR</given-names></name>
<name name-style="western"><surname>Campbell</surname><given-names>MK</given-names></name>
</person-group>             <year>2001</year>             <article-title>Extending the CONSORT statement to cluster randomized trials: For discussion.</article-title>             <source>Stat Med</source>             <volume>20</volume>             <fpage>489</fpage>             <lpage>496</lpage>          </element-citation></ref>
<ref id="pmed.1000065-Campbell3"><label>14</label><element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author">
<name name-style="western"><surname>Campbell</surname><given-names>MJ</given-names></name>
</person-group>             <year>2000</year>             <article-title>Cluster randomized trials in general (family) practice research.</article-title>             <source>Stat Methods Med Res</source>             <volume>9</volume>             <fpage>81</fpage>             <lpage>94</lpage>          </element-citation></ref>
<ref id="pmed.1000065-Farrin1"><label>15</label><element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author">
<name name-style="western"><surname>Farrin</surname><given-names>A</given-names></name>
<name name-style="western"><surname>Russell</surname><given-names>I</given-names></name>
<name name-style="western"><surname>Torgerson</surname><given-names>D</given-names></name>
<name name-style="western"><surname>Underwood</surname><given-names>M</given-names></name>
</person-group>             <year>2005</year>             <article-title>Differential recruitment in a cluster randomized trial in primary care: The experience of the UK back pain, exercise, active management and manipulation (UK BEAM) feasibility study.</article-title>             <source>Clin Trials</source>             <volume>2</volume>             <fpage>119</fpage>             <lpage>124</lpage>          </element-citation></ref>
<ref id="pmed.1000065-Eldridge1"><label>16</label><element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author">
<name name-style="western"><surname>Eldridge</surname><given-names>S</given-names></name>
<name name-style="western"><surname>Ashby</surname><given-names>D</given-names></name>
<name name-style="western"><surname>Bennett</surname><given-names>C</given-names></name>
<name name-style="western"><surname>Wakelin</surname><given-names>M</given-names></name>
<name name-style="western"><surname>Feder</surname><given-names>G</given-names></name>
</person-group>             <year>2008</year>             <article-title>Internal and external validity of cluster randomised trials: Systematic review of recent trials.</article-title>             <source>BMJ</source>             <volume>336</volume>             <fpage>876</fpage>             <lpage>880</lpage>          </element-citation></ref>
<ref id="pmed.1000065-Taljaard1"><label>17</label><element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author">
<name name-style="western"><surname>Taljaard</surname><given-names>M</given-names></name>
<name name-style="western"><surname>Donner</surname><given-names>A</given-names></name>
<name name-style="western"><surname>Klar</surname><given-names>N</given-names></name>
</person-group>             <year>2008</year>             <article-title>Imputation strategies for missing continuous outcomes in cluster randomized trials.</article-title>             <source>Biom J</source>             <volume>50</volume>             <fpage>329</fpage>             <lpage>345</lpage>          </element-citation></ref>
<ref id="pmed.1000065-Hunsberger1"><label>18</label><element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author">
<name name-style="western"><surname>Hunsberger</surname><given-names>S</given-names></name>
<name name-style="western"><surname>Murray</surname><given-names>D</given-names></name>
<name name-style="western"><surname>Davis</surname><given-names>CE</given-names></name>
<name name-style="western"><surname>Fabsitz</surname><given-names>RR</given-names></name>
</person-group>             <year>2001</year>             <article-title>Imputation strategies for missing data in a school-based multi-centre study: The Pathways study.</article-title>             <source>Stat Med</source>             <volume>20</volume>             <fpage>305</fpage>             <lpage>316</lpage>          </element-citation></ref>
<ref id="pmed.1000065-Torgerson1"><label>19</label><element-citation publication-type="other" xlink:type="simple">             <person-group person-group-type="author">
<name name-style="western"><surname>Torgerson</surname><given-names>DJ</given-names></name>
<name name-style="western"><surname>Torgerson</surname><given-names>CJ</given-names></name>
</person-group>             <year>2008</year>             <source>Designing randomised trials in health, education and the social sciences. An introduction</source>             <publisher-loc>New York</publisher-loc>             <publisher-name>Palgrave Macmillan</publisher-name>             <fpage>256</fpage>          </element-citation></ref>
<ref id="pmed.1000065-Hahn1"><label>20</label><element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author">
<name name-style="western"><surname>Hahn</surname><given-names>S</given-names></name>
<name name-style="western"><surname>Puffer</surname><given-names>S</given-names></name>
<name name-style="western"><surname>Torgerson</surname><given-names>DJ</given-names></name>
<name name-style="western"><surname>Watson</surname><given-names>J</given-names></name>
</person-group>             <year>2005</year>             <article-title>Methodological bias in cluster randomised trials.</article-title>             <source>BMC Med Res Methodol</source>             <volume>5</volume>             <fpage>10</fpage>          </element-citation></ref>
<ref id="pmed.1000065-Jordhoy1"><label>21</label><element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author">
<name name-style="western"><surname>Jordhoy</surname><given-names>MS</given-names></name>
<name name-style="western"><surname>Fayers</surname><given-names>PM</given-names></name>
<name name-style="western"><surname>Ahlner-Elmqvist</surname><given-names>M</given-names></name>
<name name-style="western"><surname>Kaasa</surname><given-names>S</given-names></name>
</person-group>             <year>2002</year>             <article-title>Lack of concealment may lead to selection bias in cluster randomized trials of palliative care.</article-title>             <source>Palliat Med</source>             <volume>16</volume>             <fpage>43</fpage>             <lpage>49</lpage>          </element-citation></ref>
<ref id="pmed.1000065-Groves1"><label>22</label><element-citation publication-type="other" xlink:type="simple">             <person-group person-group-type="author">
<name name-style="western"><surname>Groves</surname><given-names>RM</given-names></name>
<name name-style="western"><surname>Dillman</surname><given-names>DA</given-names></name>
<name name-style="western"><surname>Eltinge</surname><given-names>JL</given-names></name>
<name name-style="western"><surname>Little</surname><given-names>RJA</given-names></name>
</person-group>             <year>2002</year>             <source>Survey nonresponse</source>             <publisher-loc>New York</publisher-loc>             <publisher-name>John Wiley &amp; Sons</publisher-name>             <fpage>520</fpage>          </element-citation></ref>
<ref id="pmed.1000065-Kessler1"><label>23</label><element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author">
<name name-style="western"><surname>Kessler</surname><given-names>RC</given-names></name>
<name name-style="western"><surname>Little</surname><given-names>RJ</given-names></name>
<name name-style="western"><surname>Groves</surname><given-names>RM</given-names></name>
</person-group>             <year>1995</year>             <article-title>Advances in strategies for minimizing and adjusting for survey nonresponse.</article-title>             <source>Epidemiol Rev</source>             <volume>17</volume>             <fpage>192</fpage>             <lpage>204</lpage>          </element-citation></ref>
<ref id="pmed.1000065-Rosenbaum1"><label>24</label><element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author">
<name name-style="western"><surname>Rosenbaum</surname><given-names>P</given-names></name>
<name name-style="western"><surname>Rubin</surname><given-names>D</given-names></name>
</person-group>             <year>1983</year>             <article-title>The central role of the propensity score in observational studies for causal effects.</article-title>             <source>Biometrika</source>             <volume>70</volume>             <fpage>41</fpage>             <lpage>55</lpage>          </element-citation></ref>
<ref id="pmed.1000065-Rosenbaum2"><label>25</label><element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author">
<name name-style="western"><surname>Rosenbaum</surname><given-names>PR</given-names></name>
<name name-style="western"><surname>Rubin</surname><given-names>DB</given-names></name>
</person-group>             <year>1984</year>             <article-title>Reducing bias in observational studies using subclassification on the propensity score.</article-title>             <source>J Am Stat Assoc</source>             <volume>79</volume>             <fpage>516</fpage>             <lpage>524</lpage>          </element-citation></ref>
<ref id="pmed.1000065-Ravaud1"><label>26</label><element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author">
<name name-style="western"><surname>Ravaud</surname><given-names>P</given-names></name>
<name name-style="western"><surname>Flipo</surname><given-names>RM</given-names></name>
<name name-style="western"><surname>Boutron</surname><given-names>I</given-names></name>
<name name-style="western"><surname>Roy</surname><given-names>C</given-names></name>
<name name-style="western"><surname>Giraudeau</surname><given-names>B</given-names></name>
<etal/></person-group>             <year>2009</year>             <article-title>ARTIST (osteoarthritis intervention standardized) study of standardised consultation versus usual care for patients with osteoarthritis of the knee in primary care in France: Pragmatic randomised controlled trial.</article-title>             <source>BMJ</source>             <volume>338</volume>             <fpage>b421</fpage>             <comment>doi:<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1136/bmj.b421" xlink:type="simple">10.1136/bmj.b421</ext-link></comment>          </element-citation></ref>
<ref id="pmed.1000065-vanMarwijk1"><label>27</label><element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author">
<name name-style="western"><surname>van Marwijk</surname><given-names>HW</given-names></name>
<name name-style="western"><surname>Ader</surname><given-names>H</given-names></name>
<name name-style="western"><surname>de Haan</surname><given-names>M</given-names></name>
<name name-style="western"><surname>Beekman</surname><given-names>A</given-names></name>
</person-group>             <year>2008</year>             <article-title>Primary care management of major depression in patients aged &gt; or  = 55 years: Outcome of a randomised clinical trial.</article-title>             <source>Br J Gen Pract</source>             <volume>58</volume>             <fpage>680</fpage>             <lpage>686</lpage><comment>I–II; discussion 687</comment>          </element-citation></ref>
<ref id="pmed.1000065-Nicholas1"><label>28</label><element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author">
<name name-style="western"><surname>Nicholas</surname><given-names>J</given-names></name>
<name name-style="western"><surname>Gulliford</surname><given-names>MC</given-names></name>
</person-group>             <year>2008</year>             <article-title>Commentary. What is a propensity score?</article-title>             <source>Br J Gen Pract</source>             <volume>58</volume>             <fpage>687</fpage>          </element-citation></ref>
<ref id="pmed.1000065-Campbell4"><label>29</label><element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author">
<name name-style="western"><surname>Campbell</surname><given-names>R</given-names></name>
<name name-style="western"><surname>Starkey</surname><given-names>F</given-names></name>
<name name-style="western"><surname>Holliday</surname><given-names>J</given-names></name>
<name name-style="western"><surname>Audrey</surname><given-names>S</given-names></name>
<name name-style="western"><surname>Bloor</surname><given-names>M</given-names></name>
<etal/></person-group>             <year>2008</year>             <article-title>An informal school-based peer-led intervention for smoking prevention in adolescence (ASSIST): A cluster randomised trial.</article-title>             <source>Lancet</source>             <volume>371</volume>             <fpage>1595</fpage>             <lpage>1602</lpage>          </element-citation></ref>
<ref id="pmed.1000065-Bellary1"><label>30</label><element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author">
<name name-style="western"><surname>Bellary</surname><given-names>S</given-names></name>
<name name-style="western"><surname>O'Hare</surname><given-names>JP</given-names></name>
<name name-style="western"><surname>Raymond</surname><given-names>NT</given-names></name>
<name name-style="western"><surname>Gumber</surname><given-names>A</given-names></name>
<name name-style="western"><surname>Mughal</surname><given-names>S</given-names></name>
<etal/></person-group>             <year>2008</year>             <article-title>Enhanced diabetes care to patients of south Asian ethnic origin (the United Kingdom Asian Diabetes Study): A cluster randomised controlled trial.</article-title>             <source>Lancet</source>             <volume>371</volume>             <fpage>1769</fpage>             <lpage>1776</lpage>          </element-citation></ref>
</ref-list><glossary><title>Abbreviations</title><def-list><def-item>
<term>CRT</term>
<def>
<p>cluster randomised trial</p>
</def>
</def-item><def-item>
<term>ITT</term>
<def>
<p>intention to treat</p>
</def>
</def-item></def-list></glossary>
<fn-group><fn fn-type="other"><p><bold>Provenance:</bold> Not commissioned; externally peer reviewed</p></fn></fn-group>
</back>
</article>