<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article
  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article" dtd-version="3.0" xml:lang="en">
  <front>
    <journal-meta>
      <journal-id journal-id-type="publisher-id">PLoS</journal-id>
      <journal-id journal-id-type="nlm-ta">PLoS Med</journal-id>
      <journal-id journal-id-type="pmc">plosmed</journal-id>
      <journal-title-group>
        <journal-title>PLoS Medicine</journal-title>
      </journal-title-group>
      <issn pub-type="epub">1549-1676</issn>
      <publisher>
        <publisher-name>Public Library of Science</publisher-name>
        <publisher-loc>San Francisco, USA</publisher-loc>
      </publisher>
    </journal-meta>
    <article-meta>
      <article-id pub-id-type="publisher-id">PMEDICINE-D-13-00143</article-id>
      <article-id pub-id-type="doi">10.1371/journal.pmed.1001395</article-id>
      <article-categories>
        <subj-group subj-group-type="heading">
          <subject>Editorial</subject>
        </subj-group>
        <subj-group subj-group-type="Discipline-v2">
          <subject>Medicine</subject>
        </subj-group>
      </article-categories>
      <title-group>
        <article-title>A Reality Checkpoint for Mobile Health: Three Challenges to Overcome</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author" xlink:type="simple">
          <collab xlink:type="simple">The <italic>PLOS Medicine</italic> Editors</collab>
          <xref ref-type="corresp" rid="cor1">
            <sup>*</sup>
          </xref>
        </contrib>
      </contrib-group>
      <author-notes>
        <corresp id="cor1">* E-mail: <email xlink:type="simple">medicine_editors@plos.org</email></corresp>
        <fn fn-type="conflict">
          <p>The authors' individual competing interests are at <ext-link ext-link-type="uri" xlink:href="http://www.plosmedicine.org/static/editorsInterests.action" xlink:type="simple">http://www.plosmedicine.org/static/editorsInterests.action</ext-link>. PLOS is funded partly through manuscript publication charges, but the <italic>PLOS Medicine</italic> Editors are paid a fixed salary (their salary is not linked to the number of papers published in the journal).</p>
        </fn>
        <fn fn-type="con">
          <p>Wrote the first draft of the manuscript: EV. Contributed to the writing of the manuscript: VB JC PS MW LC AR. <ext-link ext-link-type="uri" xlink:href="http://www.icmje.org/" xlink:type="simple">ICMJE</ext-link> criteria for authorship read and met: VB JC PS MW LC AR. Agree with manuscript results and conclusions: VB JC PS MW LC AR.</p>
        </fn>
        <fn fn-type="other">
          <p><bold>Provenance:</bold> Written by editorial staff; not externally peer reviewed.</p>
        </fn>
      </author-notes>
      <pub-date pub-type="collection">
        <month>2</month>
        <year>2013</year>
      </pub-date>
      <pub-date pub-type="epub">
        <day>26</day>
        <month>2</month>
        <year>2013</year>
      </pub-date>
      <volume>10</volume>
      <issue>2</issue>
      <elocation-id>e1001395</elocation-id>
      <permissions>
        <copyright-year>2013</copyright-year>
        <copyright-holder>PLoS Medicine Editors</copyright-holder>
        <license xlink:type="simple">
          <license-p>This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.</license-p>
        </license>
      </permissions>
      <funding-group>
        <funding-statement>The authors are each paid a salary by the Public Library of Science, and they wrote this editorial during their salaried time.</funding-statement>
      </funding-group>
      <counts>
        <page-count count="2"/>
      </counts>
    </article-meta>
  </front>
  <body>
    <sec id="s1">
      <title/>
      <p>The use of mobile electronic devices to support medical or public health practice, or m-health, is currently a hot topic. It has been predicted that by 2017 there will be “more mobile phones than people” on the planet <xref ref-type="bibr" rid="pmed.1001395-Garside1">[1]</xref>, and currently three-quarters of the world's population have access to a mobile phone <xref ref-type="bibr" rid="pmed.1001395-No1">[2]</xref>. The World Health Organization (WHO) has announced <xref ref-type="bibr" rid="pmed.1001395-WHO1">[3]</xref> that m-health has the “potential to transform the face of health service delivery across the globe,” and there is increasing media and consumer interest in m-health, illustrated for example by a recent panel at the US Consumer Electronics Show on “The Digital Health Revolution” <xref ref-type="bibr" rid="pmed.1001395-Huffington1">[4]</xref>. Survey data illustrates that most regions of the world, including many low- and middle-income countries, are actively working on m-health pilot projects or have set up systems, for example, for managing treatment compliance, sending appointment reminders, or conducting surveys <xref ref-type="bibr" rid="pmed.1001395-WHO1">[3]</xref>.</p>
      <p>However, amidst the interest (and, possibly, a bit of hype) it is worth considering whether m-health needs a reality check. Recently in <italic>PLOS Medicine</italic>, an Essay by Mark Tomlinson and colleagues <xref ref-type="bibr" rid="pmed.1001395-Tomlinson1">[5]</xref> highlighted the proliferation of m-health pilots in many countries. However, in the Essay, Tomlinson and colleagues comment that few pilots move forward to scale-up, and there is little evidence to inform whether, when, and how, pilots might expand countrywide. Tomlinson and colleagues also raise concerns regarding the increasing interest in m-health from industry, which is likely to have very different motivations than would patients or those responsible for safeguarding public health.</p>
      <p>At a WHO forum on data standards for e-health (defined as the use of electronic processes and communication to support health care), held in December 2012 <xref ref-type="bibr" rid="pmed.1001395-WHO2">[6]</xref> (where one of us, EV, participated), countries reported that a panoply of proliferating standards exists, many of which are closed standards, with high barriers to access; barriers include not just cost, but also the technical complexity of systems and standards and language differences. Consequently, in the rush to develop new applications, many countries end up with a fragmented patchwork of systems, which do not talk to each other. Although these concerns were raised in the context of e-health, the same issues also apply to m-health. With this in mind, we set out three key challenges that advocates will need to overcome to fulfill the promise of m-health.</p>
    </sec>
    <sec id="s2">
      <title>Reality Check 1: Are Your Systems Interoperable?</title>
      <p>Interoperability refers to those properties of systems (whether software, communications, or other systems), that enable the exchange of data among systems in common formats, the use of common protocols, and ultimately the ability to work together. Interoperability is a critical issue for m-health (and for e-health more generally), because patients may have multiple clinical needs and conditions at one time, and will interact with the health systems via multiple points, providers, and professionals <xref ref-type="bibr" rid="pmed.1001395-vanHeerden1">[7]</xref>. Although many m-health applications may appear simple (e.g., a system sending texts to patients reminding them of their next appointment), such systems will have greatest potential for wider use if they can easily and accurately exchange information with other systems—for example, microscopy images taken using a mobile phone can be securely imported back into the electronic health record.</p>
      <p>A vision for interoperability <xref ref-type="bibr" rid="pmed.1001395-Estrin1">[8]</xref> has set out what should live inside the interoperable “core” of m-health systems: standards that govern health data concepts, patient identity, data processing protocols, and mechanisms for secure sharing of patient data that preserve confidentiality. However, while common standards for all these uses do not yet exist, there is light at the end of the tunnel. As Estrin and Sim have emphasized <xref ref-type="bibr" rid="pmed.1001395-Estrin1">[8]</xref>, there are critical differences between the e-health and m-health fields. M-health has fewer entrenched systems than does e-health, and therefore potentially fewer legacy barriers to overcome in order to establish a new shared architecture.</p>
    </sec>
    <sec id="s3">
      <title>Reality Check 2: Are You Using Open Standards?</title>
      <p>Open standards and interoperability go hand in hand, although these terms refer to different properties of a system <xref ref-type="bibr" rid="pmed.1001395-Estrin1">[8]</xref>. There is no single definition of “open standard,” but generally this term is taken to imply that the standard is publicly available, information about its use and application is available, there are no fees for use of the standard, and the standard was developed using a consensus process <xref ref-type="bibr" rid="pmed.1001395-No2">[9]</xref>. Multiple “standards” exist in e- and m-health—for example, Health Level Seven (HL7) refers to a set of rules that govern how health-care systems exchange information with each other. SNOMED CT is a coded taxonomy which is used to define healthcare information concepts (e.g., to define diseases, findings, procedures, and so on. However, although both examples have been developed by nonprofit organizations, neither is yet freely available for use (although HL7 hopes to soon make its standards free <xref ref-type="bibr" rid="pmed.1001395-Mearian1">[10]</xref>). Development of open standards is particularly critical for equity in e- and m-health. Contributors to the WHO forum on data standards <xref ref-type="bibr" rid="pmed.1001395-WHO2">[6]</xref> emphasized that closed standards create a knowledge barrier for systems developers in low- and middle-income countries. Without access to the standard, programmers and policy makers cannot understand how the systems or standards work, cannot develop technical capacity, and ultimately cannot make good decisions for their country about what systems they need to develop and how. There is a need for a governing body—for example, WHO—to certify open standards and enable countries' access to standards that meet key criteria.</p>
    </sec>
    <sec id="s4">
      <title>Reality Check 3: How Will You Evaluate?</title>
      <p>Finally, a key challenge for the m-health field relates to evaluation—not just the need for better and more evaluation, but also the challenge of knowing how to evaluate. In January 2013 <italic>PLOS Medicine</italic> published two systematic reviews of randomized trials in m-health addressing the use of such interventions to improve health behaviors, improve disease self-management, and facilitate health-care delivery processes <xref ref-type="bibr" rid="pmed.1001395-Free1">[11]</xref>,<xref ref-type="bibr" rid="pmed.1001395-Free2">[12]</xref>. Caroline Free and colleagues found that while many studies have been conducted, many are of poor quality, few have low risk of bias, and very few have found clinically significant benefits of the interventions. However, analyses do highlight some evidence suggesting benefits from specific m-health applications, such as those helping patients quit smoking, improving HIV medication adherence, and modestly improving aspects of clinical diagnosis and management. The authors emphasize, crucially, that high-quality trials are needed to provide a much more rigorous evidence base to inform scale-up of m-health applications. Furthermore, the authors found very few studies that had been conducted in low- and middle-income countries, which are needed to evaluate feasibility and efficacy of m-health in such settings, including comparing interventions with control groups that reflect real-world conditions. However, some viewpoints suggest that focusing exclusively on randomized trials as the “gold standard” for evaluating interventions is too restrictive for m-health <xref ref-type="bibr" rid="pmed.1001395-Walshe1">[13]</xref>. After all, m-health applications can best be thought of as complex interventions—because to be effective, such interventions will entail changes to the behavior of health-care professionals or patients who will use them, and potentially may also involve changes to systems or processes involved in delivery of care. Some researchers <xref ref-type="bibr" rid="pmed.1001395-Walshe1">[13]</xref>,<xref ref-type="bibr" rid="pmed.1001395-Shepperd1">[14]</xref>,<xref ref-type="bibr" rid="pmed.1001395-Greenhalgh1">[15]</xref> have suggested that complex interventions require a broader definition of what constitutes evidence—for example, suggesting that theoretical and qualitative approaches are necessary to help policy makers go beyond evaluating <italic>whether</italic> an m-health application works to understand <italic>why, what, and under what conditions</italic> it works (or does not work). Standards are currently being developed <xref ref-type="bibr" rid="pmed.1001395-Greenhalgh1">[15]</xref> for such approaches, termed “realist” or “meta-narrative” methods. M-health aficionados would do well to follow the emerging debate in this area and avoid taking too narrow a view of what constitutes “evidence” in this fast-moving field.</p>
      <p>Given the challenges for m-health, cooperation and coordination between very different stakeholders will be necessary to deliver on its potential.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <title>References</title>
      <ref id="pmed.1001395-Garside1">
        <label>1</label>
        <mixed-citation publication-type="other" xlink:type="simple">Garside J (06 June 2012) More mobile devices than people ‘within five years.” Available: <comment><ext-link ext-link-type="uri" xlink:href="http://www.guardian.co.uk/business/2012/jun/06/more-mobile-devices-people-five-years" xlink:type="simple">http://www.guardian.co.uk/business/2012/jun/06/more-mobile-devices-people-five-years</ext-link></comment>. Accessed 15 January 2013.</mixed-citation>
      </ref>
      <ref id="pmed.1001395-No1">
        <label>2</label>
        <mixed-citation publication-type="other" xlink:type="simple">[No author listed] (17 July 2012) Mobile phone access reaches three quarters of planet's population. Available: <comment><ext-link ext-link-type="uri" xlink:href="http://www.worldbank.org/en/news/2012/07/17/mobile-phone-access-reaches-three-quarters-planets-population" xlink:type="simple">http://www.worldbank.org/en/news/2012/07/17/mobile-phone-access-reaches-three-quarters-planets-population</ext-link></comment>. Accessed 15 January 2013.</mixed-citation>
      </ref>
      <ref id="pmed.1001395-WHO1">
        <label>3</label>
        <mixed-citation publication-type="other" xlink:type="simple">WHO Global Observatory for eHealth (2011) New horizons for health through mobile technologies. Geneva: World Health Organization. Available: <comment><ext-link ext-link-type="uri" xlink:href="http://www.who.int/goe/publications/ehealth_series_vol3/en/" xlink:type="simple">http://www.who.int/goe/publications/ehealth_series_vol3/en/</ext-link></comment>. Accessed 15 January 2013.</mixed-citation>
      </ref>
      <ref id="pmed.1001395-Huffington1">
        <label>4</label>
        <mixed-citation publication-type="other" xlink:type="simple">Huffington A (07 January 2013) CES 2013, GPS for the soul and the digital health revolution. Available: <comment><ext-link ext-link-type="uri" xlink:href="http://www.huffingtonpost.com/arianna-huffington/ces-gps-for-the-soul-app_b_2426569.html?utm_source=DailyBrief&amp;utm_campaign=010813&amp;utm_medium=email&amp;utm_content=FeatureTitle&amp;utm_term=Daily%20Brief" xlink:type="simple">http://www.huffingtonpost.com/arianna-huffington/ces-gps-for-the-soul-app_b_2426569.html?utm_source=DailyBrief&amp;utm_campaign=010813&amp;utm_medium=email&amp;utm_content=FeatureTitle&amp;utm_term=Daily%20Brief</ext-link></comment>. Accessed 15 January 2013.</mixed-citation>
      </ref>
      <ref id="pmed.1001395-Tomlinson1">
        <label>5</label>
        <mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Tomlinson</surname><given-names>M</given-names></name>, <name name-style="western"><surname>Rotheram-Borus</surname><given-names>MJ</given-names></name>, <name name-style="western"><surname>Swartz</surname><given-names>L</given-names></name>, <name name-style="western"><surname>Tsai</surname><given-names>AC</given-names></name> (<year>2013</year>) <article-title>Scaling Up mHealth: Where is the evidence?</article-title> <source>PLoS Med</source> <volume>10</volume> (<issue>2</issue>)  <fpage>e1001382</fpage> <comment>doi:<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1371/journal.pmed.1001382" xlink:type="simple">10.1371/journal.pmed.1001382</ext-link></comment>.</mixed-citation>
      </ref>
      <ref id="pmed.1001395-WHO2">
        <label>6</label>
        <mixed-citation publication-type="other" xlink:type="simple">WHO (2013) Call for innovative health technologies. Available: <comment><ext-link ext-link-type="uri" xlink:href="http://www.who.int/ehealth/en/" xlink:type="simple">http://www.who.int/ehealth/en/</ext-link></comment>. Accessed 15 January 2013.</mixed-citation>
      </ref>
      <ref id="pmed.1001395-vanHeerden1">
        <label>7</label>
        <mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>van Heerden</surname><given-names>A</given-names></name>, <name name-style="western"><surname>Tomlinson</surname><given-names>M</given-names></name>, <name name-style="western"><surname>Swartz</surname><given-names>L</given-names></name> (<year>2012</year>) <article-title>Point of care in your pocket: a research agenda for the field of m-health</article-title>. <source>Bull World Health Organ</source> <volume>90</volume>: <fpage>393</fpage>–<lpage>394</lpage> <comment>doi:<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.2471/BLT.11.099788" xlink:type="simple">10.2471/BLT.11.099788</ext-link></comment>.</mixed-citation>
      </ref>
      <ref id="pmed.1001395-Estrin1">
        <label>8</label>
        <mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Estrin</surname><given-names>D</given-names></name>, <name name-style="western"><surname>Sim</surname><given-names>I</given-names></name> (<year>2010</year>) <article-title>Open mHealth architecture: an engine for health care innovation</article-title>. <source>Science</source> <volume>350</volume>: <fpage>759</fpage>–<lpage>760</lpage>.</mixed-citation>
      </ref>
      <ref id="pmed.1001395-No2">
        <label>9</label>
        <mixed-citation publication-type="other" xlink:type="simple">[No author listed] (2012) Open standard. Available: <comment><ext-link ext-link-type="uri" xlink:href="http://en.wikipedia.org/wiki/Open_standard" xlink:type="simple">http://en.wikipedia.org/wiki/Open_standard</ext-link></comment>. Accessed 15 January 2013.</mixed-citation>
      </ref>
      <ref id="pmed.1001395-Mearian1">
        <label>10</label>
        <mixed-citation publication-type="other" xlink:type="simple">Mearian L (04 September 2012) HL7 e-health information-sharing standard to be free. Available: <comment><ext-link ext-link-type="uri" xlink:href="http://www.computerworld.com/s/article/9230896/HL7_e_health_information_sharing_standard_to_be_free?source=CTWNLE_nlt_ithealthcare_2012-09-05" xlink:type="simple">http://www.computerworld.com/s/article/9230896/HL7_e_health_information_sharing_standard_to_be_free?source=CTWNLE_nlt_ithealthcare_2012-09-05</ext-link></comment>. Accessed 15 January 2012.</mixed-citation>
      </ref>
      <ref id="pmed.1001395-Free1">
        <label>11</label>
        <mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Free</surname><given-names>C</given-names></name>, <name name-style="western"><surname>Phillips</surname><given-names>G</given-names></name>, <name name-style="western"><surname>Watson</surname><given-names>L</given-names></name>, <name name-style="western"><surname>Galli</surname><given-names>L</given-names></name>, <name name-style="western"><surname>Felix</surname><given-names>L</given-names></name>, <etal>et al</etal>. (<year>2013</year>) <article-title>The Effectiveness of Mobile-Health Technologies to Improve Health Care Service Delivery Processes: A Systematic Review and Meta-Analysis</article-title>. <source>PLoS Med</source> <volume>10</volume> (<issue>1</issue>)  <fpage>e1001363</fpage> <comment>doi:<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1371/journal.pmed.1001363" xlink:type="simple">10.1371/journal.pmed.1001363</ext-link></comment>.</mixed-citation>
      </ref>
      <ref id="pmed.1001395-Free2">
        <label>12</label>
        <mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Free</surname><given-names>C</given-names></name>, <name name-style="western"><surname>Phillips</surname><given-names>G</given-names></name>, <name name-style="western"><surname>Galli</surname><given-names>L</given-names></name>, <name name-style="western"><surname>Watson</surname><given-names>L</given-names></name>, <name name-style="western"><surname>Felix</surname><given-names>L</given-names></name>, <etal>et al</etal>. (<year>2013</year>) <article-title>The Effectiveness of Mobile-Health Technology-Based Health Behaviour Change or Disease Management Interventions for Health Care Consumers: A Systematic Review</article-title>. <source>PLoS Med</source> <volume>10</volume> (<issue>1</issue>)  <fpage>e1001362</fpage> <comment>doi:<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1371/journal.pmed.1001362" xlink:type="simple">10.1371/journal.pmed.1001362</ext-link></comment>.</mixed-citation>
      </ref>
      <ref id="pmed.1001395-Walshe1">
        <label>13</label>
        <mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Walshe</surname><given-names>K</given-names></name> (<year>2007</year>) <article-title>Understanding what works – and why – in quality improvement – the need for theory driven evaluation</article-title>. <source>Int J Qual Health Care</source> <volume>19</volume>: <fpage>57</fpage>–<lpage>59</lpage>.</mixed-citation>
      </ref>
      <ref id="pmed.1001395-Shepperd1">
        <label>14</label>
        <mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Shepperd</surname><given-names>S</given-names></name>, <name name-style="western"><surname>Lewin</surname><given-names>S</given-names></name>, <name name-style="western"><surname>Straus</surname><given-names>S</given-names></name>, <name name-style="western"><surname>Clarke</surname><given-names>M</given-names></name>, <name name-style="western"><surname>Eccles</surname><given-names>MP</given-names></name>, <etal>et al</etal>. (<year>2009</year>) <article-title>Can We Systematically Review Studies That Evaluate Complex Interventions?</article-title> <source>PLoS Med</source> <volume>6</volume> (<issue>8</issue>)  <fpage>e1000086</fpage> <comment>doi:<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1371/journal.pmed.1000086" xlink:type="simple">10.1371/journal.pmed.1000086</ext-link></comment>.</mixed-citation>
      </ref>
      <ref id="pmed.1001395-Greenhalgh1">
        <label>15</label>
        <mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Greenhalgh</surname><given-names>T</given-names></name>, <name name-style="western"><surname>Wong</surname><given-names>G</given-names></name>, <name name-style="western"><surname>Westhorp</surname><given-names>G</given-names></name>, <name name-style="western"><surname>Pawson</surname><given-names>R</given-names></name> (<year>2011</year>) <article-title>Protocol - realist and meta-narrative evidence synthesis: Evolving Standards (RAMESES)</article-title>. <source>BMC Med Res Methodol</source> <volume>11</volume>: <fpage>115</fpage> <comment>doi:<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1186/1471-2288-11-115" xlink:type="simple">10.1186/1471-2288-11-115</ext-link></comment>.</mixed-citation>
      </ref>
    </ref-list>
    <fn-group>
      <fn fn-type="other">
        <p>The <italic>PLOS Medicine</italic> Editors are Virginia Barbour, Jocalyn Clark, Laureen Connell, Amy Ross, Paul Simpson, Emma Veitch, and Margaret Winker.</p>
      </fn>
      <fn fn-type="other">
        <p><bold>Provenance:</bold> Written by editorial staff; not externally peer reviewed.</p>
      </fn>
    </fn-group>
  </back>
</article>