<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article
  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article" dtd-version="3.0" xml:lang="en">
<front>
<journal-meta>
<journal-id journal-id-type="nlm-ta">PLoS ONE</journal-id>
<journal-id journal-id-type="publisher-id">plos</journal-id>
<journal-id journal-id-type="pmc">plosone</journal-id>
<journal-title-group>
<journal-title>PLOS ONE</journal-title>
</journal-title-group>
<issn pub-type="epub">1932-6203</issn>
<publisher>
<publisher-name>Public Library of Science</publisher-name>
<publisher-loc>San Francisco, CA USA</publisher-loc>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.1371/journal.pone.0120817</article-id>
<article-id pub-id-type="publisher-id">PONE-D-14-43715</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Formal Comment</subject>
</subj-group>
</article-categories>
<title-group>
<article-title>Adjusting for One Issue while Ignoring Others Can Make Things Worse</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes" xlink:type="simple">
<name name-style="western">
<surname>Welsh</surname>
<given-names>Alan H.</given-names>
</name>
<xref rid="cor001" ref-type="corresp">*</xref>
<xref rid="aff001" ref-type="aff"/>
</contrib>
<contrib contrib-type="author" xlink:type="simple">
<name name-style="western">
<surname>Lindenmayer</surname>
<given-names>David B.</given-names>
</name>
<xref rid="aff001" ref-type="aff"/>
</contrib>
<contrib contrib-type="author" xlink:type="simple">
<name name-style="western">
<surname>Donnelly</surname>
<given-names>Christine F.</given-names>
</name>
<xref rid="aff001" ref-type="aff"/>
</contrib>
</contrib-group>
<aff id="aff001"><addr-line>Australian National University, Canberra, Australia</addr-line></aff>
<contrib-group>
<contrib contrib-type="editor" xlink:type="simple">
<name name-style="western">
<surname>White</surname>
<given-names>Ethan P.</given-names>
</name>
<role>Academic Editor</role>
<xref ref-type="aff" rid="edit1"/>
</contrib>
</contrib-group>
<aff id="edit1"><addr-line>Utah State University, UNITED STATES</addr-line></aff>
<author-notes>
<fn fn-type="conflict" id="coi001">
<p>These are the authors of the work that Guillera-Arroita et al (2014) are disputing. This does not alter the authors' adherence to PLOS ONE policies on sharing data and materials.</p>
</fn>
<fn fn-type="con" id="contrib001">
<p>Wrote the paper: AHW DBL CFD.</p>
</fn>
<corresp id="cor001">* E-mail: <email xlink:type="simple">Alan.Welsh@anu.edu.au</email></corresp>
</author-notes>
<pub-date pub-type="epub">
<day>18</day>
<month>3</month>
<year>2015</year>
</pub-date>
<pub-date pub-type="collection">
<year>2015</year>
</pub-date>
<volume>10</volume>
<issue>3</issue>
<elocation-id>e0120817</elocation-id>
<history>
<date date-type="received">
<day>29</day>
<month>9</month>
<year>2014</year>
</date>
<date date-type="accepted">
<day>22</day>
<month>1</month>
<year>2015</year>
</date>
</history>
<permissions>
<copyright-year>2015</copyright-year>
<copyright-holder>Welsh et al</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/" xlink:type="simple">
<license-p>This is an open access article distributed under the terms of the <ext-link ext-link-type="uri" xlink:href="http://creativecommons.org/licenses/by/4.0/" xlink:type="simple">Creative Commons Attribution License</ext-link>, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited</license-p>
</license>
</permissions>
<self-uri content-type="pdf" xlink:href="info:doi/10.1371/journal.pone.0120817" xlink:type="simple"/>
<funding-group>
<funding-statement>The authors have no support or funding to report.</funding-statement>
</funding-group>
<counts>
<fig-count count="0"/>
<table-count count="0"/>
<page-count count="2"/>
</counts>
</article-meta>
</front>
<body>
<p>In [<xref rid="pone.0120817.ref001" ref-type="bibr">1</xref>], we presented an example to show that using occupancy modelling to adjust for imperfect detection can make the bias worse than not making any adjustment for imperfect detection. The intuition behind the example is that imperfect detection is only one of a number of problems that can introduce measurement error into the data and it is a mistake to focus exclusively on only one kind of measurement error and ignore other kinds. Our example can be regarded as a counter example against the widespread belief that occupancy modelling is a universally applicable approach for handling imperfect detection. As is usual with counter examples, the example was constructed to make a strong point, but it was inspired by a real empirical study using data gathered from 55 long-term sites surveyed repeated in 8 years between 1998 and 2009. This dataset provided insight into the kind of counter example that would make the adjustment from occupancy modelling misleading.</p>
<p>Guillera-Arroita et al have presented in [<xref rid="pone.0120817.ref002" ref-type="bibr">2</xref>] a counter counter example to show that occupancy modelling sometimes works and, on this basis, argue that it is dangerous not to adjust for non-detection. Counter counter examples have no standing in logic and do not refute counter examples. Indeed, [<xref rid="pone.0120817.ref001" ref-type="bibr">1</xref>] also contained ideal examples where detection/occupancy modelling works. Specifically, we presented examples in which imperfect detection was the only source of measurement error. A key point made in [<xref rid="pone.0120817.ref001" ref-type="bibr">1</xref>] is that we cannot tell empirically from the data whether we have a case in which imperfect detection is the only source of measurement error or not. This means that we cannot tell whether adjustment for imperfect detection improves the estimates, has no effect or makes the estimates worse. We can claim as a matter of belief (that other scientists are free to reject) that imperfect detection is the only source of measurement error, but we cannot demonstrate this empirically. Moreover, variation in abundance and the use of detection methods that are affected by abundance means that we are often (and indeed usually) in a situation where imperfect detection is not the only source of measurement error. As shown in [<xref rid="pone.0120817.ref001" ref-type="bibr">1</xref>], in such cases, the adjustment can be harmful by an unknown but possibly large amount.</p>
<p>We agree that we should not simply ignore imperfect detection. However, as we demonstrated in [<xref rid="pone.0120817.ref001" ref-type="bibr">1</xref>], standard adjustments can often make things worse and we cannot tell empirically whether adjustment is improving or making the situation worse. This makes imperfect detection a difficult problem that the currently available methods do not solve and means that the application of these methods in all cases is not justified.</p>
</body>
<back>
<ref-list>
<title>References</title>
<ref id="pone.0120817.ref001"><label>1</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Welsh</surname> <given-names>AH</given-names></name>, <name name-style="western"><surname>Lindenmayer</surname> <given-names>DB</given-names></name>, <name name-style="western"><surname>Donnelly</surname> <given-names>CF</given-names></name> (<year>2013</year>). <article-title>Fitting and interpreting occupancy models</article-title>. <source>PLoS ONE</source> <volume>8</volume>: <fpage>e52015</fpage>. <comment>doi: <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1371/journal.pone.0052015" xlink:type="simple">10.1371/journal.pone.0052015</ext-link></comment> <object-id pub-id-type="pmid">23326323</object-id></mixed-citation></ref>
<ref id="pone.0120817.ref002"><label>2</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Guillera-Arroita</surname> <given-names>G</given-names></name>, <name name-style="western"><surname>Lahoz-Monfort</surname> <given-names>JJ</given-names></name>, <name name-style="western"><surname>MacKenzie</surname> <given-names>DI</given-names></name>, <name name-style="western"><surname>Wintle</surname> <given-names>BA</given-names></name>, <name name-style="western"><surname>McCarthy</surname> <given-names>MA</given-names></name> (<year>2014</year>). <article-title>Ignoring imperfect detection in biological surveys is dangerous: a response to 'Fitting and Interpreting Occupancy Models'</article-title>. <source>PLoS ONE</source> <volume>9</volume>(<issue>7</issue>): <fpage>e99571</fpage>. <comment>doi: <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1371/journal.pone.0099571" xlink:type="simple">10.1371/journal.pone.0099571</ext-link></comment> <object-id pub-id-type="pmid">25075615</object-id></mixed-citation></ref>
</ref-list>
</back>
</article>