<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article
  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="discussion" dtd-version="3.0" xml:lang="EN">
<front>
<journal-meta><journal-id journal-id-type="nlm-ta">PLoS Med</journal-id><journal-id journal-id-type="publisher-id">PLoS</journal-id><journal-id journal-id-type="pmc">plosmed</journal-id><!--===== Grouping journal title elements =====--><journal-title-group><journal-title>PLoS Medicine</journal-title></journal-title-group><issn pub-type="epub">1549-1676</issn><publisher>
<publisher-name>Public Library of Science</publisher-name>
<publisher-loc>San Francisco, USA</publisher-loc></publisher></journal-meta>
<article-meta><article-id pub-id-type="publisher-id">10-PLME-PF-4212R2</article-id><article-id pub-id-type="doi">10.1371/journal.pmed.1000323</article-id><article-categories><subj-group subj-group-type="heading"><subject>Policy Forum</subject></subj-group><subj-group subj-group-type="Discipline"><subject>Public Health and Epidemiology</subject><subject>Public Health and Epidemiology/Social and Behavioral Determinants of Health</subject></subj-group></article-categories><title-group><article-title>Does It Matter Who Writes Medical News Stories?</article-title></title-group><contrib-group>
<contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Wilson</surname><given-names>Amanda</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib>
<contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Robertson</surname><given-names>Jane</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib>
<contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>McElduff</surname><given-names>Patrick</given-names></name><xref ref-type="aff" rid="aff2"><sup>2</sup></xref></contrib>
<contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Jones</surname><given-names>Alison</given-names></name><xref ref-type="aff" rid="aff3"><sup>3</sup></xref></contrib>
<contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Henry</surname><given-names>David</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref><xref ref-type="aff" rid="aff4"><sup>4</sup></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib>
</contrib-group><aff id="aff1"><label>1</label><addr-line>The School of Medicine and Public Health, Faculty of Health, University of Newcastle, Waratah, Australia</addr-line>       </aff><aff id="aff2"><label>2</label><addr-line>Centre for Clinical Epidemiology and Biostatistics, Faculty of Health, University of Newcastle, Newcastle, Australia</addr-line>       </aff><aff id="aff3"><label>3</label><addr-line>School of Medicine, University of Western Sydney, Sydney, Australia</addr-line>       </aff><aff id="aff4"><label>4</label><addr-line>The Institute for Clinical Evaluative Sciences, Toronto, Canada</addr-line>       </aff><author-notes>
<corresp id="cor1">* E-mail: <email xlink:type="simple">david.henry@ices.on.ca</email></corresp>
<fn fn-type="con"><p><ext-link ext-link-type="uri" xlink:href="http://www.icmje.org/" xlink:type="simple">ICMJE</ext-link> criteria for authorship read and met: AW JR PM AJ DH. Agree with the manuscript's results and conclusions: AW JR PM AJ DH. Designed the experiments/the study: AW AJ DH. Analyzed the data: AW PM DH. Collected data/did experiments for the study: AW. Wrote the first draft of the paper: AW. Contributed to the writing of the paper: AW JR AJ DH. Supervisor for PhD thesis of Amanda Wilson: AJ DH.</p></fn>
<fn><p>The Policy Forum allows health policy makers around the world to discuss challenges and opportunities for improving health care in their societies.</p></fn>
<fn fn-type="conflict"><p>The authors of this paper have acted as reviewers for Media Doctor, rating news articles featured on the Media Doctor Web site (<ext-link ext-link-type="uri" xlink:href="http://www.mediadoctor.org.au/" xlink:type="simple">http://www.mediadoctor.org.au/</ext-link>).</p></fn></author-notes><pub-date pub-type="collection"><month>9</month><year>2010</year></pub-date><pub-date pub-type="epub"><day>14</day><month>9</month><year>2010</year></pub-date><volume>7</volume><issue>9</issue><elocation-id>e1000323</elocation-id><!--===== Grouping copyright info into permissions =====--><permissions><copyright-year>2010</copyright-year><copyright-holder>Wilson et al</copyright-holder><license><license-p>This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.</license-p></license></permissions><abstract abstract-type="toc">
<p>David Henry and colleagues review Australian news stories over a five-year period to assess whether quality is associated with who wrote the story: a specialist health journalist or a non-specialist.</p>
</abstract><funding-group><funding-statement>Media Doctor Australia has received funding over the past three years from the Hunter Medical Research Institute and the University of Newcastle. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.</funding-statement></funding-group><counts><page-count count="5"/></counts></article-meta>
</front>
<body><boxed-text id="pmed-1000323-box001" position="float"><sec id="s1a">
<title>Summary Points</title>
<list list-type="bullet"><list-item>
<p>The media can influence health literacy and health seeking behaviours, but few studies have looked at the quality of news stories. We examined whether experienced specialist health reporters write better stories than other categories of journalists</p>
</list-item><list-item>
<p>We compared the quality of stories written by specialist and non-specialist journalists, and those sourced from major news organisations, in Australia from 2004–08.</p>
</list-item><list-item>
<p>We found that it does matter who writes news stories that cover the benefits and harms of health care interventions. Stories written by specialist health journalists working for a single media outlet scored more highly than those written by less experienced writers.</p>
</list-item><list-item>
<p>Our findings are important because this source of health literacy is currently under pressure as falling revenues threaten the future of the traditional media.</p>
</list-item></list>
</sec></boxed-text><sec id="s2">
<title>Background</title>
<p>The news media have a crucial role in supporting health literacy, and multiple surveys have shown the extent to which the public relies on them for information about medical advances <xref ref-type="bibr" rid="pmed.1000323-Tian1">[1]</xref>,<xref ref-type="bibr" rid="pmed.1000323-Viswanath1">[2]</xref>. However, the mainstream media are undergoing rapid and unprecedented change, with a shift from the traditional outlets (broadsheet newspapers and flagship current affairs programs) to online news services and blogs that are available free of charge. These online sources, and the more recent Web 2.0 activities (e.g., FaceBook and Twitter), still rely on the quality of the news coverage by the traditional media, which they frequently cite as information sources <xref ref-type="bibr" rid="pmed.1000323-Kovic1">[3]</xref>.</p>
<p>A number of recent studies have pointed to the poor and variable quality of many health stories in the mainstream media, particularly those covering new drugs and procedures <xref ref-type="bibr" rid="pmed.1000323-Cassels1">[4]</xref>,<xref ref-type="bibr" rid="pmed.1000323-Wilson1">[5]</xref>. Some outlets are capable of producing excellent stories, but common flaws across all media include lack of attention to the quality of the research evidence, exaggerated estimates of benefits, inadequate coverage of potential harm, no information on the costs of new treatments and a failure to identify unbiased expert sources. Studies have revealed such deficiencies in Australia, Canada and the United States, with little evidence of improvement in reporting over the last five years <xref ref-type="bibr" rid="pmed.1000323-Cassels1">[4]</xref>–<xref ref-type="bibr" rid="pmed.1000323-Schwitzer1">[7]</xref>. The reasons for poor-quality journalism are complex, and include lack of specialised knowledge, time pressures on journalists, space limitations, the difficulty of accessing expert unbiased informants, and the desire of researchers, their institutions, and (sometimes) journals to exaggerate the significance of the research <xref ref-type="bibr" rid="pmed.1000323-Chapman1">[8]</xref>–<xref ref-type="bibr" rid="pmed.1000323-Larsson1">[11]</xref>.</p>
<p>But what impact will the current financial pressures on the traditional media have on the already variable quality of medical news reporting? Should a newspaper editor faced with falling sales and advertising revenue retain the services of a specialised but more expensive medical journalist, who can interpret new scientific data and place it in a local context? Or will a non-specialist journalist do the job as well? Can medical news content be reliably imported from overseas media, or from news organisations such as Associated Press and Reuters? Here, we examine the question “does it matter who writes the stories?”</p>
</sec><sec id="s3">
<title>Monitoring the Quality of Medical News Stories</title>
<p>In recent years, sites that monitor the completeness and accuracy of medical news reporting have been established in Australia (<ext-link ext-link-type="uri" xlink:href="http://www.mediadoctor.org.au" xlink:type="simple">http://www.mediadoctor.org.au</ext-link>), Canada (<ext-link ext-link-type="uri" xlink:href="http://www.mediadoctor.ca" xlink:type="simple">http://www.mediadoctor.ca</ext-link>), Hong Kong (<ext-link ext-link-type="uri" xlink:href="http://www.mediadoctor.hk" xlink:type="simple">http://www.mediadoctor.hk</ext-link>), and the US (<ext-link ext-link-type="uri" xlink:href="http://www.healthnewsreview.org" xlink:type="simple">http://www.healthnewsreview.org</ext-link>). To address the question posed in this Policy Forum, we accessed and analysed data from the Media Doctor Australia site. This site posts reviews of health news stories published in the Australian commercial and publicly funded media, including newspapers, online news, television, and radio broadcast transcripts <xref ref-type="bibr" rid="pmed.1000323-Wilson1">[5]</xref>,<xref ref-type="bibr" rid="pmed.1000323-Bonevski1">[6]</xref>,<xref ref-type="bibr" rid="pmed.1000323-Smith1">[12]</xref>. The focus is on stories that make therapeutic claims about new treatments and procedures, including diagnostic tests. News stories are not limited to local content, and include “wire” stories from major news organizations and stories from overseas media outlets that are carried by Australian media. The stories are identified from regular searches of a wide range of online news Web sites, along with media releases, journal articles, and other material relevant to the stories. Two raters independently score each news story according to ten criteria (See <xref ref-type="boxed-text" rid="pmed-1000323-box002">Box 1</xref> for a description of rating criteria and Media Doctor Australia methods).</p>
<boxed-text id="pmed-1000323-box002" position="float"><sec id="s3a1">
<title>Box 1. Media Doctor Rating Criteria</title>
<p>Criteria reflect the extent to which the story:</p>
<list list-type="order"><list-item>
<p>Reported on the novelty of the intervention</p>
</list-item><list-item>
<p>Reported on the availability of the intervention</p>
</list-item><list-item>
<p>Described any treatment or diagnostic options available</p>
</list-item><list-item>
<p>Avoided elements of disease mongering</p>
</list-item><list-item>
<p>Reported on evidence supporting the intervention</p>
</list-item><list-item>
<p>Quantified the benefits of intervention</p>
</list-item><list-item>
<p>Described the harms of intervention</p>
</list-item><list-item>
<p>Reported on the costs of intervention</p>
</list-item><list-item>
<p>Consulted with independent expert sources</p>
</list-item><list-item>
<p>Did not rely heavily on a media release</p>
</list-item></list>
<p>* Each story was sent to two of 15 reviewers, comprising clinicians, public health specialists, medical writers, journalists, and clinical and population health researchers, who conducted the evaluations in a voluntary capacity. Reviewers rated stories about medical interventions and diagnostic tests independently, using validated rating instruments and rating guides <xref ref-type="bibr" rid="pmed.1000323-Smith1">[12]</xref>. The instruments contain 10 items (see above) that are identical to those used by the sister sites “Media Doctor Canada” and “Health News Review” in the United States <xref ref-type="bibr" rid="pmed.1000323-Cassels1">[4]</xref>,<xref ref-type="bibr" rid="pmed.1000323-Schwitzer1">[7]</xref>. Scores are assigned by each reviewer based on a scoring guide. Reviewers put their draft reviews in a password-protected area of the Web site and any discrepancies are resolved by consensus. If necessary, a third reviewer is used to settle disagreements. To ensure objectivity and reliability, all reviews are screened by a researcher, who checks the scores and edits comments. Scores are “satisfactory,” “not satisfactory,” or “not applicable.” Both reviewers contribute to a comments section, which is used to highlight the strengths of the story or aspects that could have been improved and areas that are not covered in the rating instrument, such as the use sensationalist language or inappropriate headlines.</p>
</sec></boxed-text></sec><sec id="s4">
<title>Categorising the Authorship of Health News Reports</title>
<p>There has been little empirical research on the relationship between the authorship of articles and the content and quality of the stories. Anecdotally, specialist health journalists can provide lucid and succinct summaries of complex research, which can inform both the public and the researcher community. In operating the media monitoring sites, we have avoided naming specific journalists, preferring to concentrate on reporting the performance of the media outlets. We examined the provenance of 1,337 medical news stories published by the Australian mainstream media between 2004 and 2009, and subsequently rated by Media Doctor Australia. Although journalists are not named on the Web site, author information is recorded in a password-protected area of the Media Doctor database. Based on the “bylines” (who wrote the story) we placed the authors into six categories (<xref ref-type="boxed-text" rid="pmed-1000323-box003">Box 2</xref>).</p>
<boxed-text id="pmed-1000323-box003" position="float"><sec id="s4a1">
<title>Box 2. Categorisation of Journalists Used in This Report</title>
<list list-type="order"><list-item>
<p><italic>No byline</italic>: All articles that did not identify authors</p>
</list-item><list-item>
<p><italic>General journalist</italic>: A Google search on the author's name revealed no reporting specialty</p>
</list-item><list-item>
<p><italic>Overseas media</italic>: Story imported from an overseas media outlet (e.g., New York Times)</p>
</list-item><list-item>
<p><italic>News organizations</italic>: Story bought from a news syndicate, such as Associated Press or Reuters</p>
</list-item><list-item>
<p><italic>Health journalist</italic>: A Google search identified the author as being a “health,” “medical,” or “science” reporter</p>
</list-item><list-item>
<p><italic>Specialist health journalist</italic>: A Health Journalist subcategory in which the journalist had 10 or more stories posted on the Media Doctor web site during the period of the study</p>
</list-item></list>
</sec></boxed-text></sec><sec id="s5">
<title>Relationship between Categories of Journalists, Media Outlets, and the Quality of the Stories</title>
<p>The key issue was whether the more experienced specialist health journalists wrote stories of higher quality than journalists in the other categories. In making this judgement we were aware that the media outlet where the journalist worked was a potential confounder; even the best health journalist can have a story ruined by inappropriate editing or production. The 1,337 stories were published by 12 Australian media outlets between February 2004 and March 2009 (<xref ref-type="table" rid="pmed-1000323-t001">Table 1</xref>). Three hundred twenty stories had no byline. Of the remainder, 193 were written by 143 nonspecialist journalists; 415 came from four news organizations (Australian Associated Press [AAP], Associated Press [AP], Agence France Presse [AFP], and Reuters) and 39 came from 12 foreign media outlets (including ABC, BBC, Boston Globe, Guardian, The New York Times, The Telegraph UK, The Times, Los Angeles Times, Washington Post); 142 stories were written by 65 health/science journalists, and 228 stories were written by eight specialist health journalists, all based in Australia.</p>
<table-wrap id="pmed-1000323-t001" position="float"><object-id pub-id-type="doi">10.1371/journal.pmed.1000323.t001</object-id><label>Table 1</label><caption>
<title>Average unadjusted scores for medical news stories written by different categories of journalists and sourced from different news organisations.</title>
</caption><!--===== Grouping alternate versions of objects =====--><alternatives><graphic id="pmed-1000323-t001-1" mimetype="image" position="float" xlink:href="info:doi/10.1371/journal.pmed.1000323.t001" xlink:type="simple"/><table><colgroup span="1"><col align="left" span="1"/><col align="center" span="1"/><col align="center" span="1"/><col align="center" span="1"/></colgroup>
<thead>
<tr>
<td align="left" colspan="1" rowspan="1">Source</td>
<td align="left" colspan="1" rowspan="1"><italic>n</italic></td>
<td align="left" colspan="1" rowspan="1">Average Score*</td>
<td align="left" colspan="1" rowspan="1">95% CI</td>
</tr>
</thead>
<tbody>
<tr>
<td align="left" colspan="1" rowspan="1"><bold><italic>Category of Journalist</italic></bold></td>
<td align="left" colspan="1" rowspan="1"/>
<td align="left" colspan="1" rowspan="1"/>
<td align="left" colspan="1" rowspan="1"/>
</tr>
<tr>
<td align="left" colspan="1" rowspan="1"><bold>No byline</bold></td>
<td align="left" colspan="1" rowspan="1">320</td>
<td align="left" colspan="1" rowspan="1">44.1</td>
<td align="left" colspan="1" rowspan="1">41.8, 46.4</td>
</tr>
<tr>
<td align="left" colspan="1" rowspan="1"><bold>General journalist</bold></td>
<td align="left" colspan="1" rowspan="1">193</td>
<td align="left" colspan="1" rowspan="1">44.8</td>
<td align="left" colspan="1" rowspan="1">41.7, 47.9</td>
</tr>
<tr>
<td align="left" colspan="1" rowspan="1"><bold>Overseas media</bold></td>
<td align="left" colspan="1" rowspan="1">39</td>
<td align="left" colspan="1" rowspan="1">50.6</td>
<td align="left" colspan="1" rowspan="1">43.9, 57.3</td>
</tr>
<tr>
<td align="left" colspan="1" rowspan="1"><bold>News organizations</bold></td>
<td align="left" colspan="1" rowspan="1">415</td>
<td align="left" colspan="1" rowspan="1">54.9</td>
<td align="left" colspan="1" rowspan="1">53.0, 56.7</td>
</tr>
<tr>
<td align="left" colspan="1" rowspan="1"><bold>Health journalists</bold></td>
<td align="left" colspan="1" rowspan="1">142</td>
<td align="left" colspan="1" rowspan="1">56.2</td>
<td align="left" colspan="1" rowspan="1">52.8, 59.7</td>
</tr>
<tr>
<td align="left" colspan="1" rowspan="1"><bold>Specialist health journalists</bold></td>
<td align="left" colspan="1" rowspan="1">228</td>
<td align="left" colspan="1" rowspan="1">59.6</td>
<td align="left" colspan="1" rowspan="1">56.7, 62.6</td>
</tr>
<tr>
<td align="left" colspan="1" rowspan="1"><bold><italic>Australian Media Outlet</italic></bold></td>
<td align="left" colspan="1" rowspan="1"/>
<td align="left" colspan="1" rowspan="1"/>
<td align="left" colspan="1" rowspan="1"/>
</tr>
<tr>
<td align="left" colspan="1" rowspan="1"><bold>Broadsheet newspapers</bold></td>
<td align="left" colspan="1" rowspan="1"/>
<td align="left" colspan="1" rowspan="1"/>
<td align="left" colspan="1" rowspan="1"/>
</tr>
<tr>
<td align="left" colspan="1" rowspan="1"><bold>Sydney Morning Herald (Sydney)</bold></td>
<td align="left" colspan="1" rowspan="1">252</td>
<td align="left" colspan="1" rowspan="1">58.8</td>
<td align="left" colspan="1" rowspan="1">56.3, 61.3</td>
</tr>
<tr>
<td align="left" colspan="1" rowspan="1"><bold>The Australian (National)</bold></td>
<td align="left" colspan="1" rowspan="1">256</td>
<td align="left" colspan="1" rowspan="1">57.9</td>
<td align="left" colspan="1" rowspan="1">55.4, 60.5</td>
</tr>
<tr>
<td align="left" colspan="1" rowspan="1"><bold>The Age (Melbourne)</bold></td>
<td align="left" colspan="1" rowspan="1">96</td>
<td align="left" colspan="1" rowspan="1">55.0</td>
<td align="left" colspan="1" rowspan="1">51.0, 59.0</td>
</tr>
<tr>
<td align="left" colspan="1" rowspan="1"><bold>The West Australian (Perth)</bold></td>
<td align="left" colspan="1" rowspan="1">11</td>
<td align="left" colspan="1" rowspan="1">50.7</td>
<td align="left" colspan="1" rowspan="1">31.3, 50.7</td>
</tr>
<tr>
<td align="left" colspan="1" rowspan="1"><bold>Tabloid newspapers</bold></td>
<td align="left" colspan="1" rowspan="1"/>
<td align="left" colspan="1" rowspan="1"/>
<td align="left" colspan="1" rowspan="1"/>
</tr>
<tr>
<td align="left" colspan="1" rowspan="1"><bold>The Sun Herald (Sydney)</bold></td>
<td align="left" colspan="1" rowspan="1">14</td>
<td align="left" colspan="1" rowspan="1">53.7</td>
<td align="left" colspan="1" rowspan="1">43.6, 63.8</td>
</tr>
<tr>
<td align="left" colspan="1" rowspan="1"><bold>The Daily/Sunday Telegraph (Sydney)</bold></td>
<td align="left" colspan="1" rowspan="1">68</td>
<td align="left" colspan="1" rowspan="1">52.0</td>
<td align="left" colspan="1" rowspan="1">46.6, 57.4</td>
</tr>
<tr>
<td align="left" colspan="1" rowspan="1"><bold>The Herald Sun (Melbourne)</bold></td>
<td align="left" colspan="1" rowspan="1">58</td>
<td align="left" colspan="1" rowspan="1">43.7</td>
<td align="left" colspan="1" rowspan="1">37.7, 49.6</td>
</tr>
<tr>
<td align="left" colspan="1" rowspan="1"><bold>The Courier Mail (Brisbane)</bold></td>
<td align="left" colspan="1" rowspan="1">15</td>
<td align="left" colspan="1" rowspan="1">41.5</td>
<td align="left" colspan="1" rowspan="1">31.3, 51.6</td>
</tr>
<tr>
<td align="left" colspan="1" rowspan="1"><bold>Internet news sites</bold></td>
<td align="left" colspan="1" rowspan="1"/>
<td align="left" colspan="1" rowspan="1"/>
<td align="left" colspan="1" rowspan="1"/>
</tr>
<tr>
<td align="left" colspan="1" rowspan="1"><bold>NineMSN (National: private)</bold></td>
<td align="left" colspan="1" rowspan="1">247</td>
<td align="left" colspan="1" rowspan="1">51.4</td>
<td align="left" colspan="1" rowspan="1">48.9, 53.9</td>
</tr>
<tr>
<td align="left" colspan="1" rowspan="1"><bold>Australian Broadcasting Corporation (National: public)</bold></td>
<td align="left" colspan="1" rowspan="1">242</td>
<td align="left" colspan="1" rowspan="1">45.2</td>
<td align="left" colspan="1" rowspan="1">42.5, 48.0</td>
</tr>
<tr>
<td align="left" colspan="1" rowspan="1"><bold>TV current affairs programs</bold></td>
<td align="left" colspan="1" rowspan="1"/>
<td align="left" colspan="1" rowspan="1"/>
<td align="left" colspan="1" rowspan="1"/>
</tr>
<tr>
<td align="left" colspan="1" rowspan="1"><bold>A Current Affair (Channel 9; national)</bold></td>
<td align="left" colspan="1" rowspan="1">30</td>
<td align="left" colspan="1" rowspan="1">34.7</td>
<td align="left" colspan="1" rowspan="1">27.3, 42.0</td>
</tr>
<tr>
<td align="left" colspan="1" rowspan="1"><bold>Today Tonight (Channel 7; national)</bold></td>
<td align="left" colspan="1" rowspan="1">48</td>
<td align="left" colspan="1" rowspan="1">32.7</td>
<td align="left" colspan="1" rowspan="1">26.9, 38.6</td>
</tr>
</tbody>
</table></alternatives><table-wrap-foot><fn id="nt101"><label>a</label><p>We assessed the quality of each news story using the Media Doctor criteria (<xref ref-type="boxed-text" rid="pmed-1000323-box002">Box 1</xref>), where total scores (expressed as proportion of all items that were rated “satisfactory”) were derived for stories that had seven or more items rated either satisfactory or not satisfactory. Stories with fewer than seven completed items were excluded. The data presented in this table are unweighted mean scores with their 95% confidence intervals.</p></fn></table-wrap-foot></table-wrap>
<p>The media outlets that published these stories are summarised in <xref ref-type="table" rid="pmed-1000323-t001">Table 1</xref>, which also presents the mean scores by media outlet and journalist category. The mean scores were highest for the broadsheet newspapers and lowest for the human interest current affairs programs. The difference between the average scores of the highest and lowest performing media outlets was 26.1% (95% CI 19.9%, 32.2%). The variation in unadjusted scores between the highest and lowest performing categories of journalists was less—a range of 15.5% (95% CI 11.2%, 19.8%) (<xref ref-type="table" rid="pmed-1000323-t002">Table 2</xref>). To deal with potential confounding by media outlet, we adjusted the analyses that compared average scores by categories of journalists, and these are given in <xref ref-type="table" rid="pmed-1000323-t002">Table 2</xref>. Using stories published without a byline as the reference category, those with significantly higher average scores were from news organizations, science/health journalists and specialist health journalists; the latter scored highest.</p>
<table-wrap id="pmed-1000323-t002" position="float"><object-id pub-id-type="doi">10.1371/journal.pmed.1000323.t002</object-id><label>Table 2</label><caption>
<title>Comparisons of Media Doctor scores for stories written by different categories of journalists.</title>
</caption><!--===== Grouping alternate versions of objects =====--><alternatives><graphic id="pmed-1000323-t002-2" mimetype="image" position="float" xlink:href="info:doi/10.1371/journal.pmed.1000323.t002" xlink:type="simple"/><table><colgroup span="1"><col align="left" span="1"/><col align="center" span="1"/><col align="center" span="1"/><col align="center" span="1"/></colgroup>
<thead>
<tr>
<td align="left" colspan="1" rowspan="1">Comparison</td>
<td align="left" colspan="1" rowspan="1">Mean Difference</td>
<td align="left" colspan="1" rowspan="1">95% CI<xref ref-type="table-fn" rid="nt103">a</xref></td>
<td align="left" colspan="1" rowspan="1"><italic>p</italic>-Value*</td>
</tr>
</thead>
<tbody>
<tr>
<td align="left" colspan="1" rowspan="1"><bold>No byline (</bold><bold><italic>n</italic></bold><bold> = 320)</bold></td>
<td align="left" colspan="1" rowspan="1">Reference</td>
<td align="left" colspan="1" rowspan="1">Reference</td>
<td align="left" colspan="1" rowspan="1">Reference</td>
</tr>
<tr>
<td align="left" colspan="1" rowspan="1"><bold>General journalist (</bold><bold><italic>n</italic></bold><bold> = 193)</bold></td>
<td align="left" colspan="1" rowspan="1">0.1</td>
<td align="left" colspan="1" rowspan="1">−3.9, 4.1</td>
<td align="left" colspan="1" rowspan="1">0.954</td>
</tr>
<tr>
<td align="left" colspan="1" rowspan="1"><bold>Overseas media (</bold><bold><italic>n</italic></bold><bold> = 39)</bold></td>
<td align="left" colspan="1" rowspan="1">1.2</td>
<td align="left" colspan="1" rowspan="1">−5.7, 8.1</td>
<td align="left" colspan="1" rowspan="1">0.730</td>
</tr>
<tr>
<td align="left" colspan="1" rowspan="1"><bold>News organization (</bold><bold><italic>n</italic></bold><bold> = 415)</bold></td>
<td align="left" colspan="1" rowspan="1">7.5</td>
<td align="left" colspan="1" rowspan="1">4.3, 10.7</td>
<td align="left" colspan="1" rowspan="1">&lt;0.001</td>
</tr>
<tr>
<td align="left" colspan="1" rowspan="1"><bold>Health journalist (</bold><bold><italic>n</italic></bold><bold> = 142)</bold></td>
<td align="left" colspan="1" rowspan="1">8.1</td>
<td align="left" colspan="1" rowspan="1">3.8, 12.4</td>
<td align="left" colspan="1" rowspan="1">&lt;0.001</td>
</tr>
<tr>
<td align="left" colspan="1" rowspan="1"><bold>Specialist health journalist (</bold><bold><italic>n</italic></bold><bold> = 228)</bold></td>
<td align="left" colspan="1" rowspan="1">12.5</td>
<td align="left" colspan="1" rowspan="1">8.9, 16.2</td>
<td align="left" colspan="1" rowspan="1">&lt;0.001</td>
</tr>
</tbody>
</table></alternatives><table-wrap-foot><fn id="nt102"><label/><p>See <xref ref-type="boxed-text" rid="pmed-1000323-box003">Box 2</xref> for definitions.</p></fn><fn id="nt103"><label>a</label><p>Our main hypothesis was that stories written by specialist health journalists would have higher scores than those from other sources. In the analysis the association between author category and score was examined, using stories without by-lines as the reference group. Comparisons were made between author types using a generalised linear mixed model. The outcome variable in the model was the article score, the predictor variable of interest was author category, which was included as a factor, and media outlet was used as the random effect.</p></fn></table-wrap-foot></table-wrap>
<p>Of the large news organizations examined, the company with the highest average scores was AP (<xref ref-type="table" rid="pmed-1000323-t003">Table 3</xref>). Differences between AP and other news organizations ranged from 7% to 15%, but after adjustment for multiple comparisons the only statistically significant difference was that between AP and AFP, 15.3% (95% CI 2.9% to 27.7%).</p>
<table-wrap id="pmed-1000323-t003" position="float"><object-id pub-id-type="doi">10.1371/journal.pmed.1000323.t003</object-id><label>Table 3</label><caption>
<title>Comparisons of Media Doctor scores for stories sourced from different news organisations.</title>
</caption><!--===== Grouping alternate versions of objects =====--><alternatives><graphic id="pmed-1000323-t003-3" mimetype="image" position="float" xlink:href="info:doi/10.1371/journal.pmed.1000323.t003" xlink:type="simple"/><table><colgroup span="1"><col align="left" span="1"/><col align="center" span="1"/><col align="center" span="1"/><col align="center" span="1"/></colgroup>
<thead>
<tr>
<td align="left" colspan="1" rowspan="1">Comparison</td>
<td align="left" colspan="1" rowspan="1">Mean Difference</td>
<td align="left" colspan="1" rowspan="1">95% CI<xref ref-type="table-fn" rid="nt104">a</xref></td>
<td align="left" colspan="1" rowspan="1"><italic>p</italic>-Value*</td>
</tr>
</thead>
<tbody>
<tr>
<td align="left" colspan="1" rowspan="1"><bold>AFP versus AP</bold></td>
<td align="left" colspan="1" rowspan="1">−15.3</td>
<td align="left" colspan="1" rowspan="1">−27.7, −2.9</td>
<td align="left" colspan="1" rowspan="1">0.008</td>
</tr>
<tr>
<td align="left" colspan="1" rowspan="1"><bold>AFP versus Reuters</bold></td>
<td align="left" colspan="1" rowspan="1">−8.2</td>
<td align="left" colspan="1" rowspan="1">−17.1, 0.7</td>
<td align="left" colspan="1" rowspan="1">0.086</td>
</tr>
<tr>
<td align="left" colspan="1" rowspan="1"><bold>AAP versus AP</bold></td>
<td align="left" colspan="1" rowspan="1">−9.2</td>
<td align="left" colspan="1" rowspan="1">−19.3, 0.9</td>
<td align="left" colspan="1" rowspan="1">0.088</td>
</tr>
<tr>
<td align="left" colspan="1" rowspan="1"><bold>AAP versus AFP</bold></td>
<td align="left" colspan="1" rowspan="1">6.1</td>
<td align="left" colspan="1" rowspan="1">−2.5, 14.8</td>
<td align="left" colspan="1" rowspan="1">0.263</td>
</tr>
<tr>
<td align="left" colspan="1" rowspan="1"><bold>AP versus Reuters</bold></td>
<td align="left" colspan="1" rowspan="1">7.2</td>
<td align="left" colspan="1" rowspan="1">−3.1, 17.5</td>
<td align="left" colspan="1" rowspan="1">0.278</td>
</tr>
<tr>
<td align="left" colspan="1" rowspan="1"><bold>AAP versus Reuters</bold></td>
<td align="left" colspan="1" rowspan="1">−2.0</td>
<td align="left" colspan="1" rowspan="1">−7.3, 3.2</td>
<td align="left" colspan="1" rowspan="1">0.749</td>
</tr>
</tbody>
</table></alternatives><table-wrap-foot><fn id="nt104"><label>a</label><p>Adjusted for multiple comparisons using the Tukey-Kramer procedure.</p></fn></table-wrap-foot></table-wrap></sec><sec id="s6">
<title>How Should We Interpret These Results?</title>
<p>It does matter who writes news stories that cover the benefits and harms of health care interventions. Stories written by specialist health journalists were superior to those written by other groups. These data illustrate what can be achieved in terms of high-quality health news reporting, but this ideal is seldom reached. The analyses also underscore the importance of which outlets journalists work for. Traditional broadsheet newspapers scored highest and commercial human interest programs consistently returned the poorest scores. We presume that these differences reflect not only the professional skills of journalists, but also editorial policies, which dictate the target audience, the writing style (favouring human interest over evidence), the length of the article, and the extent to which it serves particular sectoral interests (e.g., a patient support group or identifiable victims of a disease). These findings are not surprising, but some of the differences were large and likely to translate into flawed information for consumers, with an adverse effect on health literacy.</p>
<p>These findings are also significant because financial pressures in the industry threaten the jobs of experienced health journalists and the future of broadsheet newspapers. The internet has become a formidable rival to the more traditional forms of news <xref ref-type="bibr" rid="pmed.1000323-Fitzgerald1">[13]</xref>. Newspaper circulation has fallen and some experts envisage their end within a decade <xref ref-type="bibr" rid="pmed.1000323-Simmons1">[14]</xref>. While this is speculation, there is no doubt that the traditional media are in a state of flux and there is pressure to economise. One outcome has been the downsizing of newsrooms across the world. An easy option for a pressured editor is to purchase health stories from foreign media outlets or news organisations. But the data presented here suggest that s/he should choose carefully. AP achieved fairly high and consistent ratings, whereas AFP had significantly lower average scores.</p>
</sec><sec id="s7">
<title>What Are the Policy Implications of These Results?</title>
<p>Obvious suggestions to improve health reporting include better training of all journalists about evidence-based medicine during their undergraduate education. Major outlets could invest in more specialist health journalists and rely on fewer imported health stories. However, each of these suggestions comes at a cost, which may be substantial and unsustainable for the foreseeable future.</p>
<p>Another solution is to demand more responsibility from researchers and their institutions when interacting with the media. Research funding bodies usually require grant applicants to describe how they will disseminate their findings. They should ensure that information given to the media through press releases and comments is accurate and balanced. This role properly lies with the principal investigators, but funding bodies, research institutions, universities, those responsible for media promotion, and journals publishing the work share the responsibility to make more balanced claims about the findings, their importance and implications. The intention has to be promotion of the findings of good science, not self-promotion by researchers, sponsors, institutions, or journals, which all stand to benefit from media coverage. The public deserves to be well-informed about the research it funds. While we may not be able to directly influence which journalist writes health stories, researchers can make it easier for less-experienced journalists to do a good job. Better collaboration of researchers and health professionals with journalists and news outlets is an important step towards more objective communication.</p>
</sec></body>
<back><ref-list>
<title>References</title>
<ref id="pmed.1000323-Tian1"><label>1</label><element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author">
<name name-style="western"><surname>Tian</surname><given-names>Y</given-names></name>
<name name-style="western"><surname>Robinson</surname><given-names>JD</given-names></name>
</person-group>             <year>2008</year>             <article-title>Incidental health information use and media complementarity: a comparison of senior and non-senior cancer patients.</article-title>             <source>Patient Educ Couns</source>             <volume>71</volume>             <fpage>340</fpage>             <lpage>344</lpage>          </element-citation></ref>
<ref id="pmed.1000323-Viswanath1"><label>2</label><element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author">
<name name-style="western"><surname>Viswanath</surname><given-names>K</given-names></name>
<name name-style="western"><surname>Breen</surname><given-names>N</given-names></name>
<name name-style="western"><surname>Meissner</surname><given-names>H</given-names></name>
<name name-style="western"><surname>Moser</surname><given-names>RP</given-names></name>
<name name-style="western"><surname>Hesse</surname><given-names>B</given-names></name>
<etal/></person-group>             <year>2006</year>             <article-title>Cancer knowledge and disparities in the information age.</article-title>             <source>J Health Commun</source>             <volume>11</volume>             <supplement>Suppl 1</supplement>             <fpage>1</fpage>             <lpage>17</lpage>          </element-citation></ref>
<ref id="pmed.1000323-Kovic1"><label>3</label><element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author">
<name name-style="western"><surname>Kovic</surname><given-names>I</given-names></name>
<name name-style="western"><surname>Lulic</surname><given-names>I</given-names></name>
<name name-style="western"><surname>Brumini</surname><given-names>G</given-names></name>
</person-group>             <year>2008</year>             <article-title>Examining the medical blogosphere: an online survey of medical bloggers.</article-title>             <source>J Med Internet Res</source>             <volume>10</volume>             <fpage>e28</fpage>          </element-citation></ref>
<ref id="pmed.1000323-Cassels1"><label>4</label><element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author">
<name name-style="western"><surname>Cassels</surname><given-names>A</given-names></name>
<name name-style="western"><surname>Lexchin</surname><given-names>J</given-names></name>
</person-group>             <year>2008</year>             <article-title>How well do Canadian media outlets convey medical treatment information? Initial findings from a year and a half of media monitoring by Media Doctor Canada.</article-title>             <source>Open Medicine</source>             <volume>2</volume>             <fpage>e20</fpage>             <lpage>23</lpage>             <comment>Available: <ext-link ext-link-type="uri" xlink:href="http://www.openmedicine.ca/article/view/170/131" xlink:type="simple">http://www.openmedicine.ca/article/view/170/131</ext-link>. Accessed 17 August 2010</comment>          </element-citation></ref>
<ref id="pmed.1000323-Wilson1"><label>5</label><element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author">
<name name-style="western"><surname>Wilson</surname><given-names>A</given-names></name>
<name name-style="western"><surname>Bonevski</surname><given-names>B</given-names></name>
<name name-style="western"><surname>Jones</surname><given-names>A</given-names></name>
<name name-style="western"><surname>Henry</surname><given-names>D</given-names></name>
</person-group>             <year>2009</year>             <article-title>Media reporting of health interventions: signs of improvement, but major problems persist.</article-title>             <source>PLoS ONE</source>             <volume>4</volume>             <fpage>e4831</fpage>             <comment>doi:<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1371/journal.pone.0004831" xlink:type="simple">10.1371/journal.pone.0004831</ext-link></comment>          </element-citation></ref>
<ref id="pmed.1000323-Bonevski1"><label>6</label><element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author">
<name name-style="western"><surname>Bonevski</surname><given-names>B</given-names></name>
<name name-style="western"><surname>Wilson</surname><given-names>A</given-names></name>
<name name-style="western"><surname>Henry</surname><given-names>DA</given-names></name>
</person-group>             <year>2008</year>             <article-title>An analysis of news media coverage of complementary and alternative medicine.</article-title>             <source>PLoS ONE</source>             <volume>3</volume>             <fpage>e2406</fpage>             <comment>doi:<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1371/journal.pone.0002406" xlink:type="simple">10.1371/journal.pone.0002406</ext-link></comment>          </element-citation></ref>
<ref id="pmed.1000323-Schwitzer1"><label>7</label><element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author">
<name name-style="western"><surname>Schwitzer</surname><given-names>G</given-names></name>
</person-group>             <year>2008</year>             <article-title>How do US journalists cover treatments, tests, products, and procedures? An evaluation of 500 stories.</article-title>             <source>PLoS Med</source>             <volume>5</volume>             <fpage>e95</fpage>             <comment>doi:<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1371/journal.pmed.0050095" xlink:type="simple">10.1371/journal.pmed.0050095</ext-link></comment>          </element-citation></ref>
<ref id="pmed.1000323-Chapman1"><label>8</label><element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author">
<name name-style="western"><surname>Chapman</surname><given-names>S</given-names></name>
<name name-style="western"><surname>Nguyen</surname><given-names>TN</given-names></name>
<name name-style="western"><surname>White</surname><given-names>C</given-names></name>
</person-group>             <year>2007</year>             <article-title>Press-released papers are more downloaded and cited.</article-title>             <source>Tob Control</source>             <volume>16</volume>             <fpage>71</fpage>          </element-citation></ref>
<ref id="pmed.1000323-Ransohoff1"><label>9</label><element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author">
<name name-style="western"><surname>Ransohoff</surname><given-names>DF</given-names></name>
<name name-style="western"><surname>Ransohoff</surname><given-names>RM</given-names></name>
</person-group>             <year>2001</year>             <article-title>Sensationalism in the media: when scientists and journalists may be complicit collaborators.</article-title>             <source>Eff Clin Pract</source>             <volume>4</volume>             <fpage>185</fpage>             <lpage>188</lpage>          </element-citation></ref>
<ref id="pmed.1000323-Hodgetts1"><label>10</label><element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author">
<name name-style="western"><surname>Hodgetts</surname><given-names>D</given-names></name>
<name name-style="western"><surname>Chamberlain</surname><given-names>K</given-names></name>
<name name-style="western"><surname>Scammell</surname><given-names>M</given-names></name>
<name name-style="western"><surname>Karapu</surname><given-names>R</given-names></name>
<name name-style="western"><surname>Waimarie Nikora</surname><given-names>L</given-names></name>
</person-group>             <year>2008</year>             <article-title>Constructing health news: possibilities for a civic-oriented journalism.</article-title>             <source>Health (London)</source>             <volume>12</volume>             <fpage>43</fpage>             <lpage>66</lpage>          </element-citation></ref>
<ref id="pmed.1000323-Larsson1"><label>11</label><element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author">
<name name-style="western"><surname>Larsson</surname><given-names>A</given-names></name>
<name name-style="western"><surname>Oxman</surname><given-names>AD</given-names></name>
<name name-style="western"><surname>Carling</surname><given-names>C</given-names></name>
<name name-style="western"><surname>Herrin</surname><given-names>J</given-names></name>
</person-group>             <year>2003</year>             <article-title>Medical messages in the media—barriers and solutions to improving medical journalism.</article-title>             <source>Health Expect</source>             <volume>6</volume>             <fpage>323</fpage>             <lpage>331</lpage>          </element-citation></ref>
<ref id="pmed.1000323-Smith1"><label>12</label><element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author">
<name name-style="western"><surname>Smith</surname><given-names>DE</given-names></name>
<name name-style="western"><surname>Wilson</surname><given-names>AJ</given-names></name>
<name name-style="western"><surname>Henry</surname><given-names>DA</given-names></name>
</person-group>             <year>2005</year>             <article-title>Monitoring the quality of medical news reporting: early experience with media doctor.</article-title>             <source>Med J Aust</source>             <volume>183</volume>             <fpage>190</fpage>             <lpage>193</lpage>          </element-citation></ref>
<ref id="pmed.1000323-Fitzgerald1"><label>13</label><element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author">
<name name-style="western"><surname>Fitzgerald</surname><given-names>T</given-names></name>
</person-group>             <year>2009</year>             <article-title>Newspaper circulation drops 11 percent.</article-title>             <source>Media Life.</source>             <comment>Available: <ext-link ext-link-type="uri" xlink:href="http://www/publish/Newspapers_24/Newspaper_circulation_drops_11_percent.asp." xlink:type="simple">http://www/publish/Newspapers_24/Newspaper_circulation_drops_11_percent.asp.</ext-link> Accessed 24 August 2010</comment>          </element-citation></ref>
<ref id="pmed.1000323-Simmons1"><label>14</label><element-citation publication-type="other" xlink:type="simple">             <person-group person-group-type="author">
<name name-style="western"><surname>Simmons</surname><given-names>M</given-names></name>
</person-group>             <year>2009 16 September</year>             <article-title>Web expert tells Fairfax: newspapers have 10 years. Tops. Crikey.</article-title>             <comment>Available: <ext-link ext-link-type="uri" xlink:href="http://www.crikey.com.au/2009/09/16/web-expert-tells-fairfax-newspapers-have-10-years-tops/" xlink:type="simple">http://www.crikey.com.au/2009/09/16/web-expert-tells-fairfax-newspapers-have-10-years-tops/</ext-link>. Sept 16<sup>th</sup> 2009 (Accessed August 17<sup>th</sup> 2010)</comment>          </element-citation></ref>
</ref-list><glossary><title>Abbreviations</title><def-list><def-item>
<term>AAP</term>
<def>
<p>Australian Associated Press</p>
</def>
</def-item><def-item>
<term>AFP</term>
<def>
<p>Agence France Presse</p>
</def>
</def-item><def-item>
<term>AP</term>
<def>
<p>Associated Press</p>
</def>
</def-item></def-list></glossary>
<fn-group><fn fn-type="other"><p><bold>Provenance:</bold> Not commissioned; externally peer reviewed.</p></fn></fn-group>
</back>
</article>