<?xml version="1.0" encoding="utf-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.1d3 20150301//EN" "http://jats.nlm.nih.gov/publishing/1.1d3/JATS-journalpublishing1.dtd">
<article article-type="other" dtd-version="1.1d3" xml:lang="en" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">
<front>
<journal-meta>
<journal-id journal-id-type="nlm-ta">PLoS Biol</journal-id>
<journal-id journal-id-type="publisher-id">plos</journal-id>
<journal-id journal-id-type="pmc">plosbiol</journal-id>
<journal-title-group>
<journal-title>PLOS Biology</journal-title>
</journal-title-group>
<issn pub-type="ppub">1544-9173</issn>
<issn pub-type="epub">1545-7885</issn>
<publisher>
<publisher-name>Public Library of Science</publisher-name>
<publisher-loc>San Francisco, CA USA</publisher-loc>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.1371/journal.pbio.2001221</article-id>
<article-id pub-id-type="publisher-id">pbio.2001221</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Perspective</subject>
</subj-group>
<subj-group subj-group-type="Discipline-v3"><subject>Social sciences</subject><subj-group><subject>Economics</subject><subj-group><subject>Finance</subject></subj-group></subj-group></subj-group><subj-group subj-group-type="Discipline-v3"><subject>Science policy</subject><subj-group><subject>Research funding</subject></subj-group></subj-group><subj-group subj-group-type="Discipline-v3"><subject>People and places</subject><subj-group><subject>Population groupings</subject><subj-group><subject>Professions</subject><subj-group><subject>Scientists</subject></subj-group></subj-group></subj-group></subj-group><subj-group subj-group-type="Discipline-v3"><subject>Science policy</subject><subj-group><subject>Science and technology workforce</subject><subj-group><subject>Careers in research</subject></subj-group></subj-group></subj-group><subj-group subj-group-type="Discipline-v3"><subject>Social sciences</subject><subj-group><subject>Sociology</subject><subj-group><subject>Social research</subject></subj-group></subj-group></subj-group><subj-group subj-group-type="Discipline-v3"><subject>Engineering and technology</subject><subj-group><subject>Industrial engineering</subject><subj-group><subject>Industrial research</subject></subj-group></subj-group></subj-group><subj-group subj-group-type="Discipline-v3"><subject>Science policy</subject><subj-group><subject>Research integrity</subject></subj-group></subj-group><subj-group subj-group-type="Discipline-v3"><subject>Science policy</subject><subj-group><subject>Research funding</subject><subj-group><subject>Research grants</subject></subj-group></subj-group></subj-group></article-categories>
<title-group>
<article-title>Why Having a (Nonfinancial) Interest Is Not a Conflict of Interest</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes" xlink:type="simple">
<name name-style="western">
<surname>Bero</surname>
<given-names>Lisa A.</given-names>
</name>
<xref ref-type="aff" rid="aff001"/>
<xref ref-type="corresp" rid="cor001">*</xref>
</contrib>
<contrib contrib-type="author" xlink:type="simple">
<name name-style="western">
<surname>Grundy</surname>
<given-names>Quinn</given-names>
</name>
<xref ref-type="aff" rid="aff001"/>
</contrib>
</contrib-group>
<aff id="aff001"><addr-line>Charles Perkins Centre, Faculty of Pharmacy, University of Sydney, Sydney, Australia</addr-line></aff>
<author-notes>
<fn fn-type="conflict" id="coi001">
<p>The authors have declared that no competing interests exist.</p>
</fn>
<corresp id="cor001">* E-mail: <email xlink:type="simple">lisa.bero@sydney.edu.au</email></corresp>
</author-notes>
<pub-date pub-type="epub">
<day>21</day>
<month>12</month>
<year>2016</year>
</pub-date>
<pub-date pub-type="collection">
<month>12</month>
<year>2016</year>
</pub-date>
<volume>14</volume>
<issue>12</issue>
<elocation-id>e2001221</elocation-id>
<permissions>
<copyright-year>2016</copyright-year>
<copyright-holder>Bero, Grundy</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/" xlink:type="simple">
<license-p>This is an open access article distributed under the terms of the <ext-link ext-link-type="uri" xlink:href="http://creativecommons.org/licenses/by/4.0/" xlink:type="simple">Creative Commons Attribution License</ext-link>, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.</license-p>
</license>
</permissions>
<self-uri content-type="pdf" xlink:href="info:doi/10.1371/journal.pbio.2001221"/>
<abstract>
<p>A current debate about conflicts of interest related to biomedical research is to question whether the focus on financial conflicts of interest overshadows “nonfinancial” interests that could put scientific judgment at equal or greater risk of bias. There is substantial evidence that financial conflicts of interest such as commercial sponsorship of research and investigators lead to systematic biases in scientific research at all stages of the research process. Conflation of “conflicts of interest” with “interests” in general serves to muddy the waters about how to manage conflicts of interest. We call for heightened disclosure of conflicts of interest and policy action beyond disclosure as the sole management strategy. We propose a different strategy to manage interests more broadly to ensure fair representation and accountability.</p>
</abstract>
<funding-group>
<funding-statement>The author(s) received no specific funding for this work.</funding-statement>
</funding-group>
<counts>
<fig-count count="0"/>
<table-count count="1"/>
<page-count count="8"/>
</counts>
</article-meta>
</front>
<body>
<p>In 2005, a Scottish judge ruled against the plaintiff, a lifelong smoker, in <italic>McTear v</italic>. <italic>Imperial Tobacco Limited</italic> [<xref ref-type="bibr" rid="pbio.2001221.ref001">1</xref>]. In part of his judgment, Lord Nimmo Smith contrasted the expert witnesses handsomely paid by Imperial Tobacco with the plaintiff’s unpaid experts. He contended that the paid expert witnesses were less biased than the unpaid experts who had dedicated their lives and professional careers to their scientific research. In this case, the judge believed that the experts’ “nonfinancial” interests constituted the greater risk to expert opinion.</p>
<p>A current debate about conflicts of interest related to biomedical research is to question whether the focus on financial conflicts of interest overlooks “nonfinancial” interests that could put scientific judgment at equal or greater risk of bias [<xref ref-type="bibr" rid="pbio.2001221.ref002">2</xref>–<xref ref-type="bibr" rid="pbio.2001221.ref005">5</xref>]. As shown in <xref ref-type="boxed-text" rid="pbio.2001221.box001">Box 1</xref>, these important and influential nonfinancial interests range from personal beliefs to past experience to theoretical commitments to the desire for enhanced reputation and career advancement [<xref ref-type="bibr" rid="pbio.2001221.ref006">6</xref>]. Many scientific organizations have aimed to identify these “nonfinancial” interests by appending a laundry list to standardized conflict of interest disclosure forms. For example, a recent cross-sectional study found that 57% of the National Library of Medicine’s core clinical journals required disclosure of at least one form of “non-financial conflict of interest” [<xref ref-type="bibr" rid="pbio.2001221.ref006">6</xref>].</p>
<boxed-text id="pbio.2001221.box001" position="float">
<sec id="sec001">
<title>Box 1. Examples of Interests in Biomedical Research</title>
<p>Personal, religious, or political beliefs</p>
<p specific-use="continuation">Personal experiences</p>
<p specific-use="continuation">Advocacy or policy positions of the researcher or organization with which they are affiliated</p>
<p specific-use="continuation">Intellectual, theoretical, or school of thought commitments</p>
<p specific-use="continuation">Type of training; professional or academic education</p>
<p specific-use="continuation">Profession or discipline</p>
<p specific-use="continuation">Academic competition or rivalry</p>
<p specific-use="continuation">Career advancement or promotion</p>
<p specific-use="continuation">Glory seeking or desire for fame</p>
<p specific-use="continuation">Dominant researcher in area of research</p>
<p specific-use="continuation">Personal experience with subject of the research</p>
<p specific-use="continuation">Personal relationship with someone who has the disease or condition under study</p>
<p specific-use="continuation">Role as investigator on study included in a systematic review</p>
<p specific-use="continuation">Published opinion essay or commentary on topic of research</p>
<p specific-use="continuation">Institutional affiliation or academic associations</p>
</sec>
</boxed-text>
<p>There is substantial evidence that financial conflicts of interest such as commercial sponsorship of research and investigators lead to systematic biases in scientific research at all stages of the research process [<xref ref-type="bibr" rid="pbio.2001221.ref007">7</xref>–<xref ref-type="bibr" rid="pbio.2001221.ref011">11</xref>]. Focusing on interests such as personal beliefs, experience, or intellectual commitments can divert attention from financial conflicts of interest, which have the potential for widespread influence. The result is an erosion of the evidence base and confidence in science, making it vulnerable to competing groups’ claims [<xref ref-type="bibr" rid="pbio.2001221.ref012">12</xref>], as we are seeing with issues as diverse as childhood vaccination and climate change.</p>
<p>The concern over “nonfinancial” interests is in part due to the growing recognition that the social context in which research is conducted will impact the research questions that are asked, the studies that are funded, the research outcomes, their dissemination, and their interpretation. Scientists have long operated under the pretext that they can and should be completely neutral when approaching the research process, without any desire to influence the outcome. Yet, social values, interpretation, and theoretical commitments are essential parts of research at every phase [<xref ref-type="bibr" rid="pbio.2001221.ref013">13</xref>]. When past experiences, personal identities, or expertise are treated as conflicts of interest, individuals with a stake in the research process are excluded. At the same time, those that claim to be “neutral”—though they too have a particular stake in the process—attain a privileged position, and their interests are allowed to shape the research.</p>
<p>Conflation of “conflicts of interest” with “interests” in general serves to muddy the waters about how to manage conflicts of interest, generating confusion as to the nature and definition of the problem and doubt as to whether conflicts of interest can be addressed at all [<xref ref-type="bibr" rid="pbio.2001221.ref014">14</xref>]. Taking the “laundry list” approach, in which anything and everything becomes labelled a “conflict of interest,” will not be effective in managing the influence of interests more broadly. In this paper, we clarify the concept of conflict of interest. We call for heightened disclosure of conflicts of interest and policy action beyond disclosure as the sole management strategy. The scientific community requires new tools to account for the influence of identities and interests in research. We adopt a multidisciplinary perspective and borrow from the social sciences to propose the use of reflexivity, a tool for identifying and engaging such interests.</p>
<sec id="sec002">
<title>Refocusing Definitions of Conflict of Interest</title>
<p>The Institute of Medicine (IOM) defines a conflict of interest as “a set of circumstances that creates a risk that professional judgment or actions regarding a primary interest will be unduly influenced by a secondary interest” [<xref ref-type="bibr" rid="pbio.2001221.ref015">15</xref>]. Conflicts of interest are a problem for those who must make expert judgments on behalf of others; thus, their primary interest is the well-being of those who rely upon these judgments. For researchers, this is the scientific community and public, who make decisions on the basis of the outcomes of research. Conflicts of interest are distinct from ethical dilemmas in that one interest has a claim to priority—the primary or professional interest—and efforts are directed at ensuring that secondary interests do not dominate, or appear to dominate, the primary interest [<xref ref-type="bibr" rid="pbio.2001221.ref014">14</xref>].</p>
<p>Being a researcher means having particular education and training, typically a personal interest in a topic or field, usually employment with some kind of academic or scientific institution, and a whole host of experiences that make up a research career. These interests are part of the primary roles and responsibilities that come with being a scientist [<xref ref-type="bibr" rid="pbio.2001221.ref013">13</xref>]. However, interests are distinct from conflicts of interest (<xref ref-type="boxed-text" rid="pbio.2001221.box002">Box 2</xref>).</p>
<boxed-text id="pbio.2001221.box002" position="float">
<sec id="sec003">
<title>Box 2. Is an Interest a Conflict of Interest?</title>
<list list-type="bullet">
<list-item><p>The individual or institution is in a position where others rely on their decision making.</p></list-item>
<list-item><p>One of the conflicting interests has an ethical claim to priority.</p></list-item>
<list-item><p>It is theoretically possible to eliminate the conflict of interest. (If the only solution is recusal, this is not a conflict of interest.)</p></list-item>
<list-item><p>The direction of bias produced by the conflict of interest is consistent within a set of circumstances.</p></list-item>
<list-item><p>The scope of influence may extend beyond an individual and immediate set of circumstances, as in the case of sponsorship.</p></list-item>
</list>
</sec>
</boxed-text>
<p>We propose three rules of thumb to distinguish conflicts of interest from “interests” more broadly. First, it is theoretically possible, though not always necessary, to eliminate a conflict of interest. For example, an investigator can divest themselves from shares in the company that commercializes their research product, whereas they cannot possibly separate themselves from their disciplinary training. Similarly, if the only solution for a particular type of interest is recusal because the interest cannot be eliminated, this is not a conflict of interest but rather part of the researcher’s professional role or personal identity.</p>
<p>Second, the direction of the bias produced by a conflict of interest is consistent within a set of circumstances. Evidence examining the influence of industry sponsorship on research suggests that the existence of these conflicts may systematically distort the outcomes, effect sizes, or conclusions of research in a direction which consistently favors the sponsor [<xref ref-type="bibr" rid="pbio.2001221.ref007">7</xref>–<xref ref-type="bibr" rid="pbio.2001221.ref011">11</xref>].</p>
<p>Third, conflicts of interest can be widespread, and their scope of influence may extend far beyond an individual. People participate in research as individuals, and each bring their experiences and personal and professional interests to the process. However, sponsorship serves to amplify a particular viewpoint, ensuring its widespread dissemination and representation in decision making. For example, corporate sponsorship of research is capable of distorting an entire body of published research, as was the case with the tobacco industry and research on secondhand smoke [<xref ref-type="bibr" rid="pbio.2001221.ref016">16</xref>].</p>
<p>Conflicts of interest are not exclusively financial: for example, conflicts of interest can arise from personal relationships. First, a person theoretically can eliminate the conflict by eliminating the relationship (which in most cases is an extreme measure) or, more commonly, by reorganizing roles and responsibilities or seeking oversight. For example, spouses working in the same lab commonly require special permission from the institution and are not allowed to directly supervise each other. Recusal is a common strategy but, importantly, not the only option. For example, individuals disclose the relationship and typically recuse themselves from reviewing grant applications written by their students, postdocs, collaborators, rivals, or family members. Second, the direction of the bias can almost always be predicted with conflicts of interest arising from personal relationships—individuals will typically help their friends and harm their enemies. However, while personal relationships can lead to conflicts of interest, unlike conflicts of interest arising from financial ties, their effects rarely extend beyond the immediate situation. That said, conflicts of interest stemming from relationships may be more damaging for individuals in positions of power (such as supervisory or leadership roles), as their scope of influence is greater.</p>
</sec>
<sec id="sec004">
<title>Why Financial Conflicts of Interest are so Problematic</title>
<p>Commercial sponsorship of research and investigator financial conflicts of interest are two forms of conflict of interest with the strongest evidence base, suggesting that they are a widespread and harmful source of bias. Pharmaceutical, tobacco, food, or chemical industry funding biases human research studies towards outcomes that are favorable to the sponsor’s product, even when controlling for other biases in the methods [<xref ref-type="bibr" rid="pbio.2001221.ref007">7</xref>–<xref ref-type="bibr" rid="pbio.2001221.ref008">8</xref>,<xref ref-type="bibr" rid="pbio.2001221.ref010">10</xref>–<xref ref-type="bibr" rid="pbio.2001221.ref011">11</xref>,<xref ref-type="bibr" rid="pbio.2001221.ref017">17</xref>]. Thus, even when the methods meet high standards for internal validity, financial conflicts of interest may influence research results through other mechanisms, such as the framing of the question, how the study is actually conducted, and whether it is fully and accurately reported.</p>
<p>While everyone comes to the table with an identity, past experiences, and professional interests, industry sponsorship or investigator payments serve as a megaphone, amplifying and multiplying a set of interests that align with the sponsor’s and thereby create a widespread platform of influence for the sponsor. The tobacco industry for decades used sponsorship of research and payments to scientists to fund research that supported their interests, to suppress research that did not, and to disseminate interest group data to the lay press and policymakers [<xref ref-type="bibr" rid="pbio.2001221.ref016">16</xref>]. The influence of industry sponsorship on research has created a crisis within biomedicine—not only of confidence in the evidence that underlies clinical practice and public policy, but the integrity of the research itself. For example, Coca-Cola’s sponsorship of public health research resulted in the reshaping of an entire field of research to focus on physical activity to reduce obesity, to the exclusion of nutrition-related research [<xref ref-type="bibr" rid="pbio.2001221.ref018">18</xref>].</p>
</sec>
<sec id="sec005">
<title>Not All Interests are Conflicts of Interest</title>
<p>The growing concern about “nonfinancial” interests may be part of the recognition that the social context in which research is conducted influences the results. For example, researchers conducted replications of 100 experimental and correlational studies in psychology and found that over half of the replications produced weaker evidence for the original findings, despite attempts to use the author’s original materials [<xref ref-type="bibr" rid="pbio.2001221.ref019">19</xref>]. This suggests that something other than the research design produced such variation. In science, there has been a common pretext that the researcher should approach the research without any desire to influence the outcome and that any conclusions should be driven solely by the data. Social scientists, however, have long argued that it is not possible to be impartial, disinterested, or value-neutral and that it is essential to acknowledge this as a means of being answerable for what science claims to know about the world [<xref ref-type="bibr" rid="pbio.2001221.ref020">20</xref>–<xref ref-type="bibr" rid="pbio.2001221.ref021">21</xref>]. Feminist scholars in particular have argued that it is not possible to be neutral in research as it is neither possible nor even desirable for scientists to be interest-free [<xref ref-type="bibr" rid="pbio.2001221.ref021">21</xref>–<xref ref-type="bibr" rid="pbio.2001221.ref022">22</xref>]. While it is essential to systematically examine all of the social values shaping a research process, these cannot possibly be eliminated but must instead be made visible and open to critical interpretation [<xref ref-type="bibr" rid="pbio.2001221.ref023">23</xref>]. However, this does not mean that one cannot be objective or that all interests and values are merely relative. Instead, scholars have advocated for a “passionate detachment,” which emphasizes fairness, honesty, and recognition of the social positions and interests that influence how evidence is produced and shared [<xref ref-type="bibr" rid="pbio.2001221.ref020">20</xref>–<xref ref-type="bibr" rid="pbio.2001221.ref021">21</xref>].</p>
<p>Recognizing that scientists possess an interested view—grounded in personal experiences and beliefs, education and disciplinary training, and intellectual commitments—is crucial to rigorous research and healthy scientific debate, but it is distinct from conflict of interest. Scientists cannot be separated from their interests or their social position in the world. Recusal of scientists based on their personal beliefs and experience can serve exclusionary purposes and falsely identify certain individuals, who also possess personal beliefs and experiences, as “objective,” narrowing the diversity of perspectives involved in decision making. For example, a recent analysis of recusals from Food and Drug Administration (FDA) advisory committees on the basis of “intellectual conflicts of interest” found that each instance led to a decision that favored industry interests and that no expert had been excluded because he or she supported a particular drug or device [<xref ref-type="bibr" rid="pbio.2001221.ref024">24</xref>]. Similarly, the effect of interests on research is isolated to the sphere of influence of the individual, and the direction of the bias created cannot be predicted. A scientist seeking academic glory may do so on either side of a research agenda—for example, climate scientists and climate change-deniers have achieved equal renown. It could be argued that researchers’ personal and intellectual interests are fundamental to good research and that these interests provide the momentum for scientific ideas to persist long enough to be scrutinized and, ultimately, to be useful.</p>
</sec>
<sec id="sec006">
<title>Managing Interests and Dealing with Conflicts</title>
<p>Confusing “interests” with “conflicts of interests” makes conflicts of interest appear so pervasive that they cannot be avoided but only disclosed. Rather, there are precedents for disclosing and managing financial conflicts of interest, which should be adopted and enforced widely within biomedical research institutions.</p>
<p>Disclosure is only a first step: requirements for disclosing financial conflicts of interest should be enforced, clear, and should list examples of financial conflicts of interest, following the example of the ICMJE [<xref ref-type="bibr" rid="pbio.2001221.ref025">25</xref>]. Most disclosure policies currently rely on self-report; however, regulation such as the United States Physician Payments Sunshine Act could be expanded to include researchers and institutions to provide a more comprehensive source of data on financial conflicts of interest. While disclosure is essential in order to understand the scope of the problem and its effects, it is necessary that policy action go beyond disclosure to ensure that disclosures do not provide a moral license to dispense with their actual management [<xref ref-type="bibr" rid="pbio.2001221.ref026">26</xref>].</p>
<p>Organizations, such as research institutions, scientific journals, and grant review panels should have policies for reviewing, mitigating, or eliminating financial conflicts of interest, and these should be enforced. Before engaging with a commercial entity, the proposed interaction should be subject to a thorough risk–benefit assessment by the research institution that includes the risk for reputational damage or loss of trust in the research activity [<xref ref-type="bibr" rid="pbio.2001221.ref027">27</xref>]. For example, the Charles Perkins Centre at the University of Sydney has guidelines that require a committee to assess the alignment of a sponsor with the Centre’s mission; potential influence on the design, conduct, and publication of research; and the reputational risk to the institution [<xref ref-type="bibr" rid="pbio.2001221.ref027">27</xref>]. Researchers should not engage with industry when the commercial interests are not aligned with improved public health or when the sponsor has any control over the design, conduct, or dissemination of the project [<xref ref-type="bibr" rid="pbio.2001221.ref027">27</xref>]. Scientific institutions should consider prohibiting the acceptance of funding or publication of research when industry sponsorship or investigator conflicts of interest pose too high a risk. For example, several biomedical journals will not publish tobacco industry–funded research [<xref ref-type="bibr" rid="pbio.2001221.ref028">28</xref>], and some universities do not accept tobacco industry funding for research [<xref ref-type="bibr" rid="pbio.2001221.ref029">29</xref>].</p>
<p>The biomedical community needs new tools to account for the influence of interests and identities more generally on research. Reflexivity is a tool that could be borrowed from the social sciences and adapted to biomedical research that makes transparent and accounts for researchers’ professional and personal identities. It can be implemented at the level of the individual scientist but perhaps can be more effective when built into existing institutional processes. For example, if a university wished to set up a center on reproductive technology using CRISPR to genetically modify embryos, the steering committee would be well served to identify personal interests and past experience with the issue. Experts and those with particular opinions on the matter would not be recused, but perhaps opposing perspectives would be purposely included and processes put in place to ensure fair representation and an evidence-informed approach [<xref ref-type="bibr" rid="pbio.2001221.ref030">30</xref>]. In lab settings, reflexivity has been used to make day-to-day research decisions transparent and to evaluate these decisions in terms of the interests at play [<xref ref-type="bibr" rid="pbio.2001221.ref031">31</xref>–<xref ref-type="bibr" rid="pbio.2001221.ref032">32</xref>]. <xref ref-type="boxed-text" rid="pbio.2001221.box003">Box 3</xref> outlines key questions that are characteristic of reflexive processes [<xref ref-type="bibr" rid="pbio.2001221.ref033">33</xref>].</p>
<boxed-text id="pbio.2001221.box003" position="float">
<sec id="sec007">
<title>Box 3. Key Questions for Reflexivity [<xref ref-type="bibr" rid="pbio.2001221.ref033">33</xref>]</title>
<p>Who is the researcher?</p>
<list list-type="bullet">
<list-item><p>What are their <italic>professional</italic> identities? What is their discipline, educational background, or training? Where are they employed? What is their career stage, and are they in a position of power or influence? What is their area of research or theoretical perspective? What are their advocacy positions?</p></list-item>
<list-item><p>What are their relevant <italic>personal</italic> identities, including age, race/ethnicity, gender, religious or political affiliations, and life experience?</p></list-item>
</list>
<p specific-use="continuation">How could who they are affect the design, conduct, or reporting of research?</p>
<p specific-use="continuation">Who or what is the focus of the research? For whom does this have consequences? What are these consequences?</p>
<p specific-use="continuation">Who or what is placed at risk by this research? How?</p>
<p specific-use="continuation">Who or what is advantaged by this research? How?</p>
<p specific-use="continuation">What are the ethical, social, political, or economic implications of this research?</p>
</sec>
</boxed-text>
<p>We use a grant funding review panel as an example in <xref ref-type="table" rid="pbio.2001221.t001">Table 1</xref> to show how two parallel processes can be used simultaneously: reflexive processes to address relevant interests and comprehensive disclosure and management for conflicts of interest (<xref ref-type="table" rid="pbio.2001221.t001">Table 1</xref>). These practices could also be useful at the research agenda–setting phase, in determining funding priorities, or in peer review processes. The goal is to hold researchers accountable without discrediting scientific findings and claims as mere “personal biases” [<xref ref-type="bibr" rid="pbio.2001221.ref033">33</xref>] and to ensure fair representation rather than excluding certain individuals based on their personal characteristics, beliefs, or expertise.</p>
<table-wrap id="pbio.2001221.t001" position="float">
<object-id pub-id-type="doi">10.1371/journal.pbio.2001221.t001</object-id>
<label>Table 1</label> <caption><title>A grant proposal review panel: a hypothetical example of reflexivity and conflict of interest management.</title></caption>
<alternatives>
<graphic id="pbio.2001221.t001g" mimetype="image" position="float" xlink:href="info:doi/10.1371/journal.pbio.2001221.t001" xlink:type="simple"/>
<table>
<colgroup>
<col align="left" valign="middle"/>
<col align="left" valign="middle"/>
<col align="left" valign="middle"/>
</colgroup>
<thead>
<tr>
<th align="left">Phase</th>
<th align="left">Nonfinancial interests</th>
<th align="left">Conflicts of interest</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left">Panel formation</td>
<td align="left">Prospective panel members are approached, aiming for diversity in terms of education, discipline, gender, and race/ethnicity, with a focus on contrasting opinions and representation from those both within the field of research and external perspectives. Prospective panel members write a narrative position statement, which addresses key reflexive points:
<list list-type="bullet">
<list-item><p>Biographical details</p></list-item>
<list-item><p>Relevant personal details (at individual’s discretion)</p></list-item>
<list-item><p>Reflection on how who they are might influence the funding process</p></list-item>
<list-item><p>Statement of purpose and interest in participating</p></list-item>
</list>
</td>
<td align="left">Potential panel members are asked to report any financial conflicts of interest using a structured disclosure form. Disclosures of potential panel members are supplemented with data on financial conflicts of interest using a database such as Open Payments</td>
</tr>
<tr>
<td align="left">Panel selection</td>
<td align="left">Position statements are reviewed for:
<list list-type="bullet"><list-item><p>What perspectives are represented?</p></list-item>
<list-item><p>Are any positions over represented? Under represented? Panel is reselected accordingly, aiming for diversity.</p></list-item>
</list>
</td>
<td align="left">Panel chair without any financial conflicts of interest is selected. A panel is selected in which less than half of the members have financial conflicts of interest.</td>
</tr>
<tr>
<td align="left">Panel deliberations</td>
<td align="left">A reflexive process such as deliberative dialogue [<xref ref-type="bibr" rid="pbio.2001221.ref034">34</xref>–<xref ref-type="bibr" rid="pbio.2001221.ref035">35</xref>] is implemented, facilitated by the chair.</td>
<td align="left">Panel members with relevant financial conflicts of interest are recused from discussion and final decision making regarding relevant applications.</td>
</tr>
<tr>
<td align="left">Funding decisions and dissemination of results</td>
<td align="left">A narrative summary of the panel members’ position statements is published to discuss how the panel composition influenced the funding outcomes. A summary of the review process reflects on and takes accountability for:
<list list-type="bullet">
<list-item><p>Who and/or what is the target of the funded research? With what consequences? For whom?</p></list-item>
<list-item><p>Who and/or what is placed at risk by the funded research? How? Who and/or what is advantaged? How?</p></list-item>
</list>
</td>
<td align="left">All financial conflicts of interest and how they were managed are reported.</td>
</tr>
</tbody>
</table>
</alternatives>
</table-wrap>
</sec>
<sec id="sec008" sec-type="conclusions">
<title>Conclusion</title>
<p>The muddying of the waters around conflicts of interest serves to erode the political will to identify and manage conflicts of interest in scientific research, as they are portrayed as increasingly ubiquitous and unsolvable. A substantial evidence base supports the need for continued policy action, particularly around the disclosure and management of commercial sponsorship of research and investigator financial conflicts of interest. Different strategies are needed to manage interests more broadly to ensure fair representation and accountability.</p>
</sec>
</body>
<back>
<fn-group>
<fn fn-type="other" id="fn001">
<p><bold>Provenance:</bold> Not commissioned; externally peer reviewed</p>
</fn>
</fn-group>
<ref-list>
<title>References</title>
<ref id="pbio.2001221.ref001"><label>1</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Friedman</surname> <given-names>L</given-names></name>, <name name-style="western"><surname>Daynard</surname> <given-names>R</given-names></name>. <article-title>Scottish court dismisses a historic smoker's suit</article-title>. <source>Tob Control</source>. <year>2007</year>;<volume>16</volume>(<issue>5</issue>):<fpage>e4</fpage>–<lpage>e</lpage>. <comment>doi: <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1136/tc.2007.020768" xlink:type="simple">10.1136/tc.2007.020768</ext-link></comment> <object-id pub-id-type="pmid">17897973</object-id></mixed-citation></ref>
<ref id="pbio.2001221.ref002"><label>2</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Rosenbaum</surname> <given-names>L</given-names></name>. <article-title>Understanding bias—The case for careful study</article-title>. <source>N Engl J Med</source>. <year>2015</year>;<volume>372</volume>(<issue>20</issue>):<fpage>1959</fpage>–<lpage>63</lpage>. <comment>doi: <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1056/NEJMms1502497" xlink:type="simple">10.1056/NEJMms1502497</ext-link></comment> <object-id pub-id-type="pmid">25970055</object-id></mixed-citation></ref>
<ref id="pbio.2001221.ref003"><label>3</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Cappola</surname> <given-names>AR</given-names></name>, <name name-style="western"><surname>FitzGerald</surname> <given-names>GA</given-names></name>. <article-title>Confluence, not conflict of interest: Name change necessary</article-title>. <source>JAMA</source>. <year>2015</year>;<volume>314</volume>(<issue>17</issue>):<fpage>1791</fpage>–<lpage>2</lpage>. <comment>doi: <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1001/jama.2015.12020" xlink:type="simple">10.1001/jama.2015.12020</ext-link></comment> <object-id pub-id-type="pmid">26402846</object-id></mixed-citation></ref>
<ref id="pbio.2001221.ref004"><label>4</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Bero</surname> <given-names>L</given-names></name>. <article-title>What is in a name? Nonfinancial influences on the outcomes of systematic reviews and guidelines</article-title>. <source>J Clin Epi</source>. <year>2014</year>;<volume>67</volume>(<issue>11</issue>):<fpage>1239</fpage>–<lpage>41</lpage>.</mixed-citation></ref>
<ref id="pbio.2001221.ref005"><label>5</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Saver</surname> <given-names>RS</given-names></name>. <article-title>Is it really all about the money? Reconsidering non-financial interests in medical research</article-title>. <source>J Law Med &amp; Ethics</source>. <year>2012</year>;<volume>40</volume>(<issue>3</issue>):<fpage>467</fpage>–<lpage>81</lpage>.</mixed-citation></ref>
<ref id="pbio.2001221.ref006"><label>6</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Shawwa</surname> <given-names>K</given-names></name>, <name name-style="western"><surname>Kallas</surname> <given-names>R</given-names></name>, <name name-style="western"><surname>Koujanian</surname> <given-names>S</given-names></name>, <name name-style="western"><surname>Agarwal</surname> <given-names>A</given-names></name>, <name name-style="western"><surname>Neumann</surname> <given-names>I</given-names></name>, <name name-style="western"><surname>Alexander</surname> <given-names>P</given-names></name>, <etal>et al</etal>. <article-title>Requirements of clinical journals for authors? Disclosure of financial and non-financial conflicts of interest: A cross sectional study</article-title>. <source>PLoS ONE</source>. <year>2016</year>;<volume>11</volume>(<issue>3</issue>):<fpage>e0152301</fpage>. <comment>doi: <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1371/journal.pone.0152301" xlink:type="simple">10.1371/journal.pone.0152301</ext-link></comment> <object-id pub-id-type="pmid">27030966</object-id></mixed-citation></ref>
<ref id="pbio.2001221.ref007"><label>7</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Lundh</surname> <given-names>A</given-names></name>, <name name-style="western"><surname>Sismondo</surname> <given-names>S</given-names></name>, <name name-style="western"><surname>Lexchin</surname> <given-names>J</given-names></name>, <name name-style="western"><surname>Busuioc</surname> <given-names>O</given-names></name>, <name name-style="western"><surname>Bero</surname> <given-names>L</given-names></name>. <article-title>Industry sponsorship and research outcome</article-title>. <source>Cochrane Database Syst Rev</source>. <year>2012</year>;<volume>12</volume>:<fpage>MR000033</fpage>. <comment>doi: <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1002/14651858.MR000033.pub2" xlink:type="simple">10.1002/14651858.MR000033.pub2</ext-link></comment> <object-id pub-id-type="pmid">23235689</object-id></mixed-citation></ref>
<ref id="pbio.2001221.ref008"><label>8</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Bero</surname> <given-names>L</given-names></name>, <name name-style="western"><surname>Anglemyer</surname> <given-names>A</given-names></name>, <name name-style="western"><surname>Vesterinen</surname> <given-names>H</given-names></name>, <name name-style="western"><surname>Krauth</surname> <given-names>D</given-names></name>. <article-title>The relationship between study sponsorship, risks of bias, and research outcomes in atrazine exposure studies conducted in non-human animals: Systematic review and meta-analysis</article-title>. <source>Env Int</source>. <year>2016</year>;<volume>92–93</volume>:<fpage>597</fpage>–<lpage>604</lpage>.</mixed-citation></ref>
<ref id="pbio.2001221.ref009"><label>9</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Anglemyer</surname> <given-names>AT</given-names></name>, <name name-style="western"><surname>Krauth</surname> <given-names>D</given-names></name>, <name name-style="western"><surname>Bero</surname> <given-names>L</given-names></name>. <article-title>Industry sponsorship and publication bias among animal studies evaluating the effects of statins on atherosclerosis and bone outcomes: a meta-analysis</article-title>. <source>BMC Med Res Methodology</source>. <year>2015</year>;<volume>15</volume>:<fpage>12</fpage>.</mixed-citation></ref>
<ref id="pbio.2001221.ref010"><label>10</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Vartanian</surname> <given-names>LR</given-names></name>, <name name-style="western"><surname>Schwartz</surname> <given-names>MB</given-names></name>, <name name-style="western"><surname>Brownell</surname> <given-names>KD</given-names></name>. <article-title>Effects of soft drink consumption on nutrition and health: A systematic review and meta-analysis</article-title>. <source>Am J Public Health</source>. <year>2007</year>;<volume>97</volume>(<issue>4</issue>):<fpage>667</fpage>–<lpage>75</lpage>. <comment>doi: <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.2105/AJPH.2005.083782" xlink:type="simple">10.2105/AJPH.2005.083782</ext-link></comment> <object-id pub-id-type="pmid">17329656</object-id></mixed-citation></ref>
<ref id="pbio.2001221.ref011"><label>11</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Barnes</surname> <given-names>DE</given-names></name>, <name name-style="western"><surname>Bero</surname> <given-names>LA</given-names></name>. <article-title>Why review articles on the health effects of passive smoking reach different conclusions</article-title>. <source>JAMA</source>. <year>1998</year>;<volume>279</volume>(<issue>19</issue>):<fpage>1566</fpage>–<lpage>70</lpage>. <object-id pub-id-type="pmid">9605902</object-id></mixed-citation></ref>
<ref id="pbio.2001221.ref012"><label>12</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Frankel</surname> <given-names>MS</given-names></name>. <article-title>Perception, reality, and the political context of conflict of interest in university-industry relationships</article-title>. <source>Acad Med</source>. <year>1996</year>;<volume>71</volume>(<issue>12</issue>):<fpage>1297</fpage>–<lpage>304</lpage>. <object-id pub-id-type="pmid">9114887</object-id></mixed-citation></ref>
<ref id="pbio.2001221.ref013"><label>13</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Krimsky</surname> <given-names>S</given-names></name>. <article-title>Autonomy, disinterest, and entrepreneurial science</article-title>. <source>Society</source>. <year>2006</year>;<volume>43</volume>(<issue>4</issue>):<fpage>22</fpage>–<lpage>9</lpage>.</mixed-citation></ref>
<ref id="pbio.2001221.ref014"><label>14</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Thompson</surname> <given-names>D</given-names></name>. <article-title>Understanding financial conflicts of interest</article-title>. <source>N Engl J Med</source>. <year>1993</year>;<volume>329</volume>:<fpage>573</fpage>–<lpage>576</lpage>. <comment>doi: <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1056/NEJM199308193290812" xlink:type="simple">10.1056/NEJM199308193290812</ext-link></comment> <object-id pub-id-type="pmid">8336759</object-id></mixed-citation></ref>
<ref id="pbio.2001221.ref015"><label>15</label><mixed-citation publication-type="book" xlink:type="simple"><collab>Institute of Medicine</collab>. <source>Conflict of interest in medical research, education and practice</source>. <publisher-loc>Washington, DC</publisher-loc>: <publisher-name>The National Academies Press</publisher-name>; <year>2009</year>.</mixed-citation></ref>
<ref id="pbio.2001221.ref016"><label>16</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Bero</surname> <given-names>LA</given-names></name>. <article-title>Tobacco industry manipulation of research</article-title>. <source>Public Health Rep</source>. <year>2005</year>; <volume>120</volume>(<issue>2</issue>): <fpage>200</fpage>–<lpage>208</lpage>. <object-id pub-id-type="pmid">15842123</object-id></mixed-citation></ref>
<ref id="pbio.2001221.ref017"><label>17</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>White</surname> <given-names>J</given-names></name>, <name name-style="western"><surname>Bero</surname> <given-names>LA</given-names></name>. <article-title>Corporate manipulation of research: Strategies are similar across five industries</article-title>. <source>Stanford Law &amp; Policy Rev</source>. <year>2010</year>;<volume>21</volume>(<issue>1</issue>):<fpage>105</fpage>–<lpage>33</lpage>.</mixed-citation></ref>
<ref id="pbio.2001221.ref018"><label>18</label><mixed-citation publication-type="other" xlink:type="simple">O'Connor A. Coca-Cola funds scientists who shift blame for obesity away from bad diets. The New York Times. August 9 2015. <ext-link ext-link-type="uri" xlink:href="http://well.blogs.nytimes.com/2015/08/09/coca-cola-funds-scientists-who-shift-blame-for-obesity-away-from-bad-diets/" xlink:type="simple">http://well.blogs.nytimes.com/2015/08/09/coca-cola-funds-scientists-who-shift-blame-for-obesity-away-from-bad-diets/</ext-link> Cited November 25.</mixed-citation></ref>
<ref id="pbio.2001221.ref019"><label>19</label><mixed-citation publication-type="journal" xlink:type="simple"><collab>Open Science Collaboration</collab>. <article-title>Estimating the reproducibility of psychological science</article-title>. <source>Science</source>. <year>2015</year>;<volume>349</volume>(<issue>6251</issue>).</mixed-citation></ref>
<ref id="pbio.2001221.ref020"><label>20</label><mixed-citation publication-type="book" xlink:type="simple"><name name-style="western"><surname>Haraway</surname> <given-names>D</given-names></name>. <source>Simian, Cyborgs, and Women: The Reinvention of nature</source>. <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Routledge</publisher-name>; <year>1991</year>.</mixed-citation></ref>
<ref id="pbio.2001221.ref021"><label>21</label><mixed-citation publication-type="book" xlink:type="simple"><name name-style="western"><surname>Harding</surname> <given-names>S</given-names></name>. <source>Whose Science? Whose Knowledge?: Thinking from Women's Lives</source>. <publisher-loc>Ithaca, NY</publisher-loc>: <publisher-name>Cornell University Press</publisher-name>; <year>1991</year>.</mixed-citation></ref>
<ref id="pbio.2001221.ref022"><label>22</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Hill Collins</surname> <given-names>P</given-names></name>. <article-title>The social construction of Black feminist thought</article-title>. <source>Signs</source>. <volume>14</volume>(<issue>4</issue>):<fpage>745</fpage>–<lpage>73</lpage>.</mixed-citation></ref>
<ref id="pbio.2001221.ref023"><label>23</label><mixed-citation publication-type="book" xlink:type="simple"><name name-style="western"><surname>Haraway</surname> <given-names>D</given-names></name>. <chapter-title>Modest_Witness@Second_Millennium</chapter-title>. <source>FemaleMan_Meets_OncoMouse<sup>™</sup>: Feminism and Technoscience</source>. <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Routledge</publisher-name>; <year>1997</year>.</mixed-citation></ref>
<ref id="pbio.2001221.ref024"><label>24</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Lenzer</surname> <given-names>J</given-names></name>. <article-title>When is a point of view a conflict of interest?</article-title> <source>BMJ</source>. <year>2016</year>;<volume>355</volume>:<fpage>i6194</fpage>. <comment>doi: <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1136/bmj.i6194" xlink:type="simple">10.1136/bmj.i6194</ext-link></comment> <object-id pub-id-type="pmid">27881367</object-id></mixed-citation></ref>
<ref id="pbio.2001221.ref025"><label>25</label><mixed-citation publication-type="book" xlink:type="simple"><collab>International Committee of Medical Journal Editors (ICMJE)</collab>. <source>Author responsibilities—Conflicts of interest</source> <publisher-loc>Philadelphia, PA</publisher-loc>: <publisher-name>ICMJE</publisher-name>,; <year>2016</year> [cited 2016 March 21]. <ext-link ext-link-type="uri" xlink:href="http://www.icmje.org/recommendations/browse/roles-and-responsibilities/author-responsibilities--conflicts-of-interest.html" xlink:type="simple">http://www.icmje.org/recommendations/browse/roles-and-responsibilities/author-responsibilities--conflicts-of-interest.html</ext-link>.</mixed-citation></ref>
<ref id="pbio.2001221.ref026"><label>26</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Loewenstein</surname> <given-names>G</given-names></name>, <name name-style="western"><surname>Sah</surname> <given-names>S</given-names></name>, <name name-style="western"><surname>Cain</surname> <given-names>DM</given-names></name>. <article-title>The unintended consequences of conflict of interest disclosure</article-title>. <source>JAMA</source>. <year>2012</year>;<volume>307</volume>:<fpage>669</fpage>–<lpage>670</lpage>. <comment>doi: <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1001/jama.2012.154" xlink:type="simple">10.1001/jama.2012.154</ext-link></comment> <object-id pub-id-type="pmid">22337676</object-id></mixed-citation></ref>
<ref id="pbio.2001221.ref027"><label>27</label><mixed-citation publication-type="book" xlink:type="simple"><collab>Charles Perkins Centre</collab>. <source>Engagement with industry guidelines</source>. <publisher-loc>Sydney, Australia</publisher-loc>: <publisher-name>The University of Sydney</publisher-name>, <year>2016</year>. <ext-link ext-link-type="uri" xlink:href="https://sydney.edu.au/perkins/documents/cpc_engagement_with_industry_guidelines_2016.pdf" xlink:type="simple">https://sydney.edu.au/perkins/documents/cpc_engagement_with_industry_guidelines_2016.pdf</ext-link></mixed-citation></ref>
<ref id="pbio.2001221.ref028"><label>28</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Godlee</surname> <given-names>F</given-names></name>, <name name-style="western"><surname>Malone</surname> <given-names>R</given-names></name>, <name name-style="western"><surname>Timmis</surname> <given-names>A</given-names></name>, <name name-style="western"><surname>Otto</surname> <given-names>C</given-names></name>, <name name-style="western"><surname>Bush</surname> <given-names>A</given-names></name>, <name name-style="western"><surname>Pavord</surname> <given-names>I</given-names></name>, <etal>et al</etal>. <article-title>Journal policy on research funded by the tobacco industry</article-title>. <source>BMJ</source>. <year>2013</year>;<volume>347</volume>:<fpage>f5193</fpage>. <comment>doi: <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1136/bmj.f5193" xlink:type="simple">10.1136/bmj.f5193</ext-link></comment> <object-id pub-id-type="pmid">24129479</object-id></mixed-citation></ref>
<ref id="pbio.2001221.ref029"><label>29</label><mixed-citation publication-type="book" xlink:type="simple"><collab>The University of Sydney</collab>. <source>Tobacco industry funding</source>. <publisher-loc>Sydney, Australia</publisher-loc>: <publisher-name>The University of Sydney</publisher-name>, <year>2003</year>. <ext-link ext-link-type="uri" xlink:href="http://sydney.edu.au/policies/showdoc.aspx?recnum=PDOC2011/4" xlink:type="simple">http://sydney.edu.au/policies/showdoc.aspx?recnum=PDOC2011/4</ext-link></mixed-citation></ref>
<ref id="pbio.2001221.ref030"><label>30</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Lavis</surname> <given-names>JN</given-names></name>, <name name-style="western"><surname>Boyko</surname> <given-names>JA</given-names></name>, <name name-style="western"><surname>Gauvin</surname> <given-names>F-P</given-names></name>. <article-title>Evaluating deliberative dialogues focussed on healthy public policy</article-title>. <source>BMC Public Health</source>. <year>2014</year>;<volume>14</volume>(<issue>1</issue>):<fpage>1</fpage>–<lpage>7</lpage>.</mixed-citation></ref>
<ref id="pbio.2001221.ref031"><label>31</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Fisher</surname> <given-names>E</given-names></name>. <article-title>Ethnographic Invention: Probing the Capacity of Laboratory Decisions</article-title>. <source>NanoEthics</source>. <year>2007</year>;<volume>1</volume>(<issue>2</issue>):<fpage>155</fpage>–<lpage>65</lpage>.</mixed-citation></ref>
<ref id="pbio.2001221.ref032"><label>32</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Schuurbiers</surname> <given-names>D</given-names></name>. <article-title>What happens in the Lab: Applying midstream modulation to enhance critical reflection in the laboratory</article-title>. <source>Sci Eng Ethics</source>. <year>2011</year>;<volume>17</volume>(<issue>4</issue>):<fpage>769</fpage>–<lpage>88</lpage>. <comment>doi: <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1007/s11948-011-9317-8" xlink:type="simple">10.1007/s11948-011-9317-8</ext-link></comment> <object-id pub-id-type="pmid">22057782</object-id></mixed-citation></ref>
<ref id="pbio.2001221.ref033"><label>33</label><mixed-citation publication-type="book" xlink:type="simple"><name name-style="western"><surname>Clarke</surname> <given-names>AE</given-names></name>. <source>Situational analysis: Grounded theory after the postmodern turn</source>. <publisher-loc>Thousand Oaks, CA</publisher-loc>: <publisher-name>Sage</publisher-name>; <year>2005</year>.</mixed-citation></ref>
<ref id="pbio.2001221.ref034"><label>34</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Boyko</surname> <given-names>JA</given-names></name>, <name name-style="western"><surname>Lavis</surname> <given-names>JN</given-names></name>, <name name-style="western"><surname>Abelson</surname> <given-names>J</given-names></name>, <name name-style="western"><surname>Dobbins</surname> <given-names>M</given-names></name>, <name name-style="western"><surname>Carter</surname> <given-names>N</given-names></name>. <article-title>Deliberative dialogues as a mechanism for knowledge translation and exchange in health systems decision-making</article-title>. <source>Soc Sci Med</source>. <year>2012</year>;<volume>75</volume>:<fpage>1938</fpage>–<lpage>45</lpage>. <comment>doi: <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1016/j.socscimed.2012.06.016" xlink:type="simple">10.1016/j.socscimed.2012.06.016</ext-link></comment> <object-id pub-id-type="pmid">22938912</object-id></mixed-citation></ref>
<ref id="pbio.2001221.ref035"><label>35</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Culyer</surname> <given-names>AJ</given-names></name>, <name name-style="western"><surname>Lomas</surname> <given-names>J</given-names></name>. <article-title>Deliberative processes and evidence-informed decision making in healthcare: do they work and how might we know?</article-title> <source>Evidence &amp; Policy</source>. <year>2006</year>;<volume>2</volume>(<issue>3</issue>):<fpage>357</fpage>–<lpage>71</lpage>.</mixed-citation></ref>
</ref-list>
</back>
</article>