<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article
  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article" dtd-version="3.0" xml:lang="EN">
  <front>
    <journal-meta><journal-id journal-id-type="publisher-id">plos</journal-id><journal-id journal-id-type="nlm-ta">PLoS Comput Biol</journal-id><journal-id journal-id-type="pmc">ploscomp</journal-id><!--===== Grouping journal title elements =====--><journal-title-group><journal-title>PLoS Computational Biology</journal-title></journal-title-group><issn pub-type="ppub">1553-734X</issn><issn pub-type="epub">1553-7358</issn><publisher>
        <publisher-name>Public Library of Science</publisher-name>
        <publisher-loc>San Francisco, USA</publisher-loc>
      </publisher></journal-meta>
    <article-meta><article-id pub-id-type="publisher-id">PCOMPBIOL-D-11-01029</article-id><article-id pub-id-type="doi">10.1371/journal.pcbi.1002360</article-id><article-categories>
        <subj-group subj-group-type="heading">
          <subject>Research Article</subject>
        </subj-group>
        <subj-group subj-group-type="Discipline-v2">
          <subject>Biology</subject>
          <subj-group>
            <subject>Ecology</subject>
          </subj-group>
        </subj-group>
        <subj-group subj-group-type="Discipline-v2">
          <subject>Mathematics</subject>
          <subj-group>
            <subject>Nonlinear dynamics</subject>
          </subj-group>
        </subj-group>
        <subj-group subj-group-type="Discipline">
          <subject>Ecology</subject>
          <subject>Mathematics</subject>
        </subj-group>
      </article-categories><title-group><article-title>Early Warning Signals for Critical Transitions: A Generalized Modeling Approach</article-title><alt-title alt-title-type="running-head">Early Warning Signals by Generalized Modeling</alt-title></title-group><contrib-group>
        <contrib contrib-type="author" xlink:type="simple">
          <name name-style="western">
            <surname>Lade</surname>
            <given-names>Steven J.</given-names>
          </name>
          <xref ref-type="aff" rid="aff1"/>
          <xref ref-type="corresp" rid="cor1">
            <sup>*</sup>
          </xref>
        </contrib>
        <contrib contrib-type="author" xlink:type="simple">
          <name name-style="western">
            <surname>Gross</surname>
            <given-names>Thilo</given-names>
          </name>
          <xref ref-type="aff" rid="aff1"/>
        </contrib>
      </contrib-group><aff id="aff1">          <addr-line>Max Planck Institute for the Physics of Complex Systems, Dresden, Germany</addr-line>       </aff><contrib-group>
        <contrib contrib-type="editor" xlink:type="simple">
          <name name-style="western">
            <surname>Pascual</surname>
            <given-names>Mercedes</given-names>
          </name>
          <role>Editor</role>
          <xref ref-type="aff" rid="edit1"/>
        </contrib>
      </contrib-group><aff id="edit1">University of Michigan and Howard Hughes Med. Inst., United States of America</aff><author-notes>
        <corresp id="cor1">* E-mail: <email xlink:type="simple">slade@pks.mpg.de</email></corresp>
        <fn fn-type="con">
          <p>Wrote the paper: SJL TG. Designed the research: SJL TG. Performed the research: SJL.</p>
        </fn>
      <fn fn-type="conflict">
        <p>The authors have declared that no competing interests exist.</p>
      </fn></author-notes><pub-date pub-type="collection">
        <month>2</month>
        <year>2012</year>
      </pub-date><pub-date pub-type="epub">
        <day>2</day>
        <month>2</month>
        <year>2012</year>
      </pub-date><volume>8</volume><issue>2</issue><elocation-id>e1002360</elocation-id><history>
        <date date-type="received">
          <day>15</day>
          <month>7</month>
          <year>2011</year>
        </date>
        <date date-type="accepted">
          <day>9</day>
          <month>12</month>
          <year>2011</year>
        </date>
      </history><!--===== Grouping copyright info into permissions =====--><permissions><copyright-year>2012</copyright-year><copyright-holder>Lade, Gross</copyright-holder><license><license-p>This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.</license-p></license></permissions><abstract>
        <p>Critical transitions are sudden, often irreversible, changes that can occur in a large variety of complex systems; signals that warn of critical transitions are therefore highly desirable. We propose a new method for early warning signals that integrates multiple sources of information and data about the system through the framework of a generalized model. We demonstrate our proposed approach through several examples, including a previously published fisheries model. We regard our method as complementary to existing early warning signals, taking an approach of intermediate complexity between model-free approaches and fully parameterized simulations. One potential advantage of our approach is that, under appropriate conditions, it may reduce the amount of time series data required for a robust early warning signal.</p>
      </abstract><abstract abstract-type="summary">
        <title>Author Summary</title>
        <p>Fisheries, coral reefs, productive farmland, planetary climate, neural activity in the brain, and financial markets are all complex systems that can be susceptible to sudden changes leading to drastic re-organization or collapse. A variety of signals based on analysis of time-series data have been proposed that would provide warning of these so-called critical transitions. We propose a new method for calculating early warning signals that is complementary to existing approaches. The key step is to incorporate other available information about the system through the framework of a so-called generalized model. Our new approach may help to anticipate future catastrophic regime shifts in nature and society, allowing humankind to avert or to mitigate the consequences of the impending change.</p>
      </abstract><funding-group><funding-statement>This research was supported by the Max Planck Society. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.</funding-statement></funding-group><counts>
        <page-count count="6"/>
      </counts></article-meta>
  </front>
  <body>
    <sec id="s1">
      <title>Introduction</title>
      <p>Critical transitions are sudden, long-term changes in complex systems that occur when a threshold is crossed <xref ref-type="bibr" rid="pcbi.1002360-Scheffer1">[1]</xref>. Many systems are known to be at risk of such transitions, including systems in ecology <xref ref-type="bibr" rid="pcbi.1002360-Scheffer2">[2]</xref>, climate research <xref ref-type="bibr" rid="pcbi.1002360-Lenton1">[3]</xref>, economics <xref ref-type="bibr" rid="pcbi.1002360-May1">[4]</xref>, sociology <xref ref-type="bibr" rid="pcbi.1002360-Brock1">[5]</xref> and human physiology <xref ref-type="bibr" rid="pcbi.1002360-Venegas1">[6]</xref>. Examples of critical transitions in ecology include shifts in food web composition in shallow lakes <xref ref-type="bibr" rid="pcbi.1002360-Carpenter1">[7]</xref>, degradation of coral reefs <xref ref-type="bibr" rid="pcbi.1002360-Mumby1">[8]</xref>, degradation of managed rangelands <xref ref-type="bibr" rid="pcbi.1002360-Anderies1">[9]</xref>, and desertification <xref ref-type="bibr" rid="pcbi.1002360-Foley1">[10]</xref>.</p>
      <p>Warning signals for impending critical transitions are highly desirable, because it is often difficult to revert a system to the previous state once a critical transition has occurred <xref ref-type="bibr" rid="pcbi.1002360-Scheffer2">[2]</xref>, <xref ref-type="bibr" rid="pcbi.1002360-Folke1">[11]</xref>. If an accurate mathematical model of the system is available then critical transitions can be predicted straight-forwardly, either by numerical simulation or by direct computation of the dynamical thresholds. For real world complex systems, however, sufficiently accurate models are in general not available, and predictions based on models of limited accuracy face substantial difficulties <xref ref-type="bibr" rid="pcbi.1002360-Groffman1">[12]</xref>. Recent research has therefore focused on model-free approaches that extract warning signals from observed time series <xref ref-type="bibr" rid="pcbi.1002360-Scheffer3">[13]</xref>. Two of the most widely used approaches are increasing variance <xref ref-type="bibr" rid="pcbi.1002360-Carpenter2">[14]</xref> and autocorrelation <xref ref-type="bibr" rid="pcbi.1002360-Dakos1">[15]</xref>, both of which are caused by critical slowing down <xref ref-type="bibr" rid="pcbi.1002360-Wissel1">[16]</xref>. Other approaches consider warning signals based on skewness <xref ref-type="bibr" rid="pcbi.1002360-Guttal1">[17]</xref>, flickering <xref ref-type="bibr" rid="pcbi.1002360-Brock2">[18]</xref> and spatial correlation <xref ref-type="bibr" rid="pcbi.1002360-Dakos2">[19]</xref>.</p>
      <p>One strategy for improving the quality of an early warning signal, which to our knowledge has not been explored, is to utilize other information that may be available. This other information may take the form of other time series data, for example in ecological applications birth rates as well as population sizes, or additional knowledge about the system, such as that the top-predator mortality is likely to be linear. This highlights the need for intermediate approaches, which can efficiently incorporate available information without requiring a fully specified mathematical model.</p>
      <p>In the present Letter, we propose an approach for the prediction of critical transitions based on the framework of generalized modeling <xref ref-type="bibr" rid="pcbi.1002360-Gross1">[20]</xref>, <xref ref-type="bibr" rid="pcbi.1002360-Gross2">[21]</xref>. The approach allows available information to be used, subject to certain limitations on the quality and availability of the information. Our results indicate that in the cases considered here, the approach can reduce the amount of time series data required or increase the quality of the prediction. We demonstrate the applicability of the proposed approach by considering a simple one-population model, a previously studied fisheries model and a tri-trophic food chain.</p>
    </sec>
    <sec id="s2" sec-type="methods">
      <title>Methods</title>
      <sec id="s2a">
        <title>Generalized modeling</title>
        <p>Suppose that a system has been identified as being at risk of a critical transition. Even if very little specific information is available, the dynamics can generally still be captured by a so-called generalized model <xref ref-type="bibr" rid="pcbi.1002360-Gross1">[20]</xref>. Such a model captures the structure of the system, without restricting it to specific functional forms.</p>
        <p>To formulate a generalized model we first identify important system variables (say, abundance or biomass of the populations in the system) and processes (for example, birth, death, or predation). As a first step, the generalized model can then be sketched in graphical form, such as in <xref ref-type="fig" rid="pcbi-1002360-g001">Fig. 1</xref> below. This graphical representation is sometimes called a causal loop diagram <xref ref-type="bibr" rid="pcbi.1002360-Sterman1">[22]</xref>.</p>
        <fig id="pcbi-1002360-g001" position="float">
          <object-id pub-id-type="doi">10.1371/journal.pcbi.1002360.g001</object-id>
          <label>Figure 1</label>
          <caption>
            <title>Schematic of the fishery knowledge that was incorporated into the generalized model.</title>
          </caption>
          <graphic mimetype="image" position="float" xlink:href="info:doi/10.1371/journal.pcbi.1002360.g001" xlink:type="simple"/>
        </fig>
        <p>To obtain a mathematical representation of the model we write a dynamical equation for each variable <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e001" xlink:type="simple"/></inline-formula>. In these equations we represent the processes by general functions. For instance we can model a single population <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e002" xlink:type="simple"/></inline-formula> subject to gains <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e003" xlink:type="simple"/></inline-formula> and losses <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e004" xlink:type="simple"/></inline-formula> by an ordinary differential equation<disp-formula><graphic mimetype="image" position="float" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e005" xlink:type="simple"/></disp-formula>or as a discrete-time map<disp-formula><graphic mimetype="image" position="float" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e006" xlink:type="simple"/></disp-formula>Note, that in contrast to conventional models, we do not attempt to describe the processes G and L by specific functional forms. Instead, we use unspecified functions <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e007" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e008" xlink:type="simple"/></inline-formula> as formal placeholders for the (unknown) relationships realized in the real system.</p>
      </sec>
      <sec id="s2b">
        <title>Calculation of early warning signal</title>
        <p>We assume that before the critical transition, the system can be considered in equilibrium. We emphasize that this does not require the system to be completely static or closed in a thermodynamic sense, but that, on the chosen macroscopic level of description, the system can be considered at rest. For example, the system may be undergoing stochastic fluctuations of a fixed distribution around a stable fixed point. Additionally, the system is subject to a slowly changing external parameter that puts it at risk of undergoing a critical transition. The system is therefore at equilibrium only on a certain timescale. In the following we refer to this timescale as the <italic>fast timescale</italic>, while the dynamics of the whole system, including the slow change of the external parameter, takes place on the <italic>slow timescale</italic>.</p>
        <p>Using the definitions above critical transitions can be linked to instabilities (bifurcations) of the fast subsystem <xref ref-type="bibr" rid="pcbi.1002360-Kuehn1">[23]</xref>. For detecting these instabilities we construct the Jacobian matrix, a local linearization of the system around the steady state <xref ref-type="bibr" rid="pcbi.1002360-Kuznetsov1">[24]</xref>. A system of ordinary differential equations (ODEs) is dynamically stable if all eigenvalues of the Jacobian have negative real parts, whereas a discrete time map is stable if all eigenvalues have an absolute value less than one. Critical transitions are thus signified by a change in the external parameter causing at least one of the eigenvalues to cross the imaginary axis (ODE) or a unit circle around the origin (map).</p>
        <p>To warn of impending critical transitions we monitor the eigenvalues of the Jacobian of the fast subsystem, which usually change slowly in time. A warning is raised if at least one of the eigenvalues shows a clear trend toward the stability boundary (for ODEs, zero real part; for maps, absolute value of one). The Jacobian itself can be computed directly from the generalized model, but will contain unknown terms reflecting our ignorance of the precise functional forms in the model. Previous publications <xref ref-type="bibr" rid="pcbi.1002360-Gross1">[20]</xref> have shown that these unknowns can be treated as well-defined parameters with clear ecological interpretations. In the present applications we estimate the unknowns in the Jacobian matrix from short segments of time series data. Thereby, a pseudo-continuous monitoring of the eigenvalues of the fast subsystem is possible.</p>
        <p>The generalized model that is constructed should reflect existing knowledge about the structure of the system. It should contain terms that represent relevant and observable processes (or relevant processes whose magnitudes can be deduced from other processes, as we will see below). The generalized model should also have a structure that permits bifurcations that are relevant for the system; if not, the generalized model cannot be used to anticipate those bifurcations.</p>
        <p>We note that with given time series data estimating the generalized model parameters is simpler than estimating the entries of the Jacobian matrix directly, because the generalized model already incorporates structural information about the system. Further, many of the parameters in the generalized model may already be available in a given application, because they refer to well-studied properties of the species, such as natural life expectancy or metabolic rate.</p>
      </sec>
    </sec>
    <sec id="s3">
      <title>Results</title>
      <p>We applied the proposed approach to three case studies, focusing on a generic population with an Allee effect, a fisheries example, and a tri-trophic food chain.</p>
      <sec id="s3a">
        <title>Simulation with Allee effect</title>
        <p>Allee effects, that is, positive relationships between per-capita growth rate and population size, are postulated in many populations and have been conclusively demonstrated in some <xref ref-type="bibr" rid="pcbi.1002360-Kramer1">[25]</xref>. A population with an Allee effect can suddenly transition from a stable, non-zero population size to unconditional extinction <xref ref-type="bibr" rid="pcbi.1002360-Boukal1">[26]</xref>.</p>
        <p>We supposed that an early warning signal was desired for a population in which a slowly increasing death rate (for example the spread of a new disease, the appearance of a new predator, or habitat destruction) was pushing the population towards a critical transition associated with an Allee effect. We assumed that regular observations of the population size and birth rate were available.</p>
        <p>Accordingly, we constructed the generalized model<disp-formula><graphic mimetype="image" position="float" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e009" xlink:type="simple"/><label>(1)</label></disp-formula>where <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e010" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e011" xlink:type="simple"/></inline-formula> are the birth and death rates of the population, respectively, and <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e012" xlink:type="simple"/></inline-formula> represents the external factor pushing the system towards the critical transition. We refer to the population and birth rate observations as <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e013" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e014" xlink:type="simple"/></inline-formula>, taken at times <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e015" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e016" xlink:type="simple"/></inline-formula>. (Observations of the death rate would also be acceptable in place of the birth rate.)</p>
        <p>From the generalized model of Eq. (1), we constructed the Jacobian (in this 1-D system, also the eigenvalue) of the system<disp-formula><graphic mimetype="image" position="float" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e017" xlink:type="simple"/><label>(2)</label></disp-formula>near its steady state, where the prime denotes the derivative with respect to <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e018" xlink:type="simple"/></inline-formula>. To calculate the changing values of the eigenvalue <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e019" xlink:type="simple"/></inline-formula> as the external parameter changes, we need to estimate the gradients <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e020" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e021" xlink:type="simple"/></inline-formula> from our time series observations of <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e022" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e023" xlink:type="simple"/></inline-formula>.</p>
        <p>We calculated <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e024" xlink:type="simple"/></inline-formula> as follows. Since the birth rate <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e025" xlink:type="simple"/></inline-formula> and the population <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e026" xlink:type="simple"/></inline-formula> have been directly observed, <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e027" xlink:type="simple"/></inline-formula> could therefore be computed immediately, where we use the notation <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e028" xlink:type="simple"/></inline-formula>. (These one-sided derivative estimators involve a loss in accuracy but allow the eigenvalues to be estimated at the most recent observation time, which is important when attempting to predict an imminent transition.) A discretization of Eq. (1) gives <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e029" xlink:type="simple"/></inline-formula>. We cannot calculate <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e030" xlink:type="simple"/></inline-formula> in the same way as <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e031" xlink:type="simple"/></inline-formula>, because <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e032" xlink:type="simple"/></inline-formula> also depends on <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e033" xlink:type="simple"/></inline-formula>. Instead, we make one additional assumption: That the mortality <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e034" xlink:type="simple"/></inline-formula> is linear in <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e035" xlink:type="simple"/></inline-formula> (although the coefficient of this linearity may change with <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e036" xlink:type="simple"/></inline-formula>). Then we can estimate <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e037" xlink:type="simple"/></inline-formula>. (Suppose <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e038" xlink:type="simple"/></inline-formula>. Then <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e039" xlink:type="simple"/></inline-formula>.) Finally, the eigenvalue <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e040" xlink:type="simple"/></inline-formula>.</p>
        <p>To test the early warning signal, we simulated a simple model (given in the Supporting Information as <xref ref-type="supplementary-material" rid="pcbi.1002360.s001">Text S1</xref>) of an Allee effect with additive noise. A critical transition occurred, causing subsequent extinction of the population (<xref ref-type="fig" rid="pcbi-1002360-g002">Fig. 2</xref>). The challenge we addressed is predicting the critical transition from a limited number (here, fifteen) of observations of population size and birth rate. We emphasize that we did not utilize any information on the functional forms of processes employed in the simulation, so that the prediction is based solely on the 15 observations and the assumed structural information (that is, one population subject to gains and losses). By estimating the parameters of the generalized model as described above, we determined the eigenvalues of the Jacobian as a function of time (<xref ref-type="fig" rid="pcbi-1002360-g002">Fig. 2b</xref>). A clear increase in the eigenvalue is detectable well before the critical transition, giving ample warning of the impending collapse.</p>
        <fig id="pcbi-1002360-g002" position="float">
          <object-id pub-id-type="doi">10.1371/journal.pcbi.1002360.g002</object-id>
          <label>Figure 2</label>
          <caption>
            <title>Early warning signal for a single population with Allee effect.</title>
            <p>(a) Population time series (solid line, left axis, in relative units) and yearly births (circles, right axis) generated by the simulation model described in <xref ref-type="supplementary-material" rid="pcbi.1002360.s001">Text S1</xref>. The vertical dashed line indicates the time of the bifurcation. Parameters were <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e041" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e042" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e043" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e044" xlink:type="simple"/></inline-formula>. The simulation was started at <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e045" xlink:type="simple"/></inline-formula> to allow for the decay of transient responses. (b) Eigenvalues estimated from the sampled data indicated with markers in (a), using the procedure described in the text. The eigenvalue was always real.</p>
          </caption>
          <graphic mimetype="image" position="float" xlink:href="info:doi/10.1371/journal.pcbi.1002360.g002" xlink:type="simple"/>
        </fig>
        <p>Due to a phenomenon called bifurcation delay <xref ref-type="bibr" rid="pcbi.1002360-Kuehn1">[23]</xref>, the population size did not start to change rapidly until well after (<inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e046" xlink:type="simple"/></inline-formula>) the bifurcation point (<inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e047" xlink:type="simple"/></inline-formula>). As previously observed by Biggs <italic>et al.</italic> <xref ref-type="bibr" rid="pcbi.1002360-Biggs1">[27]</xref>, management action to reverse the change in bifurcation parameter may successfully avert the critical transition even after the fast subsystem's bifurcation has occurred, if still within the range of the bifurcation delay. In the case of <xref ref-type="fig" rid="pcbi-1002360-g002">Fig. 2b</xref>, the eigenvalue trend is directed more towards the last possible time that successful management action can be taken than towards the time of the actual bifurcation.</p>
      </sec>
      <sec id="s3b">
        <title>Fishery simulation of Biggs <italic>et al.</italic></title>
        <p>Our second case study focuses on an example from fisheries. Increased harvesting of piscivores can induce a shift from the high-piscivore low-planktivore regime to a low-piscivore high-planktivore regime <xref ref-type="bibr" rid="pcbi.1002360-Walters1">[28]</xref>. Many fisheries are suspected to have undergone such transitions <xref ref-type="bibr" rid="pcbi.1002360-Steele1">[29]</xref>, <xref ref-type="bibr" rid="pcbi.1002360-deYoung1">[30]</xref>. Based on the causal loop diagram (<xref ref-type="fig" rid="pcbi-1002360-g001">Fig. 1</xref>), we formulated a discrete-time generalized model, describing the piscivore and planktivore populations at the end of each year, in the spirit of stock-assessment modeling (see <xref ref-type="supplementary-material" rid="pcbi.1002360.s001">Text S1</xref>). Thereby detailed modeling of the intra-annual dynamics was avoided.</p>
        <p>To test the warning signal, we generated time series data with a detailed fishery model by Biggs <italic>et al.</italic> <xref ref-type="bibr" rid="pcbi.1002360-Biggs1">[27]</xref>, which was developed from a series of whole-lake experiments <xref ref-type="bibr" rid="pcbi.1002360-Carpenter3">[31]</xref>. We describe this model more fully in <xref ref-type="supplementary-material" rid="pcbi.1002360.s001">Text S1</xref>, but note here that the model differs significantly from our generalized model by a) accounting for the intra-annual dynamics and b) containing an additional state variable denoting the juvenile piscivore population. These discrepancies were intentionally included to reflect the limited information that would be available for the formulation of the generalized model in practice. In simulations the detailed model showed a transition to a low-piscivore high-planktivore regime as the harvesting rate was increased (<xref ref-type="fig" rid="pcbi-1002360-g003">Fig. 3a</xref>).</p>
        <fig id="pcbi-1002360-g003" position="float">
          <object-id pub-id-type="doi">10.1371/journal.pcbi.1002360.g003</object-id>
          <label>Figure 3</label>
          <caption>
            <title>Early warning signals for the fishery simulation of Biggs <italic>et al.</italic> <xref ref-type="bibr" rid="pcbi.1002360-Biggs1">[<bold>27</bold>]</xref>.</title>
          </caption>
          <graphic mimetype="image" position="float" xlink:href="info:doi/10.1371/journal.pcbi.1002360.g003" xlink:type="simple"/>
        </fig>
        <p>From this simulation, we recorded the simulated piscivore and planktivore density and piscivore catch at the end of each year. Because the simulated data was very noisy we estimated the Jacobian's eigenvalues after smoothing the recorded data (see <xref ref-type="supplementary-material" rid="pcbi.1002360.s001">Text S1</xref>). In addition to the time series data, the information on the natural adult piscivore mortality and reproduction rate and the planktivore influx from refugia were required (see <xref ref-type="supplementary-material" rid="pcbi.1002360.s001">Text S1</xref>). This type of information can be reasonably well estimated for most systems. We confirmed that our predictions (reported below) are not sensitive to the specific values used. Indeed, a simple approach for estimating these parameters is to recognize that the initial state, before the critical transition, is stable. In a number of test trials we confirmed that any reasonable combination of parameters used that corresponded to an initially stable steady state provided an early warning signal comparable to the results reported below.</p>
        <p>An estimate of the Jacobian eigenvalues for the fisheries example is shown in <xref ref-type="fig" rid="pcbi-1002360-g003">Fig. 3b</xref>. As the system approaches the critical transition we observe that an eigenvalue approaches one, which signifies a critical transition for discrete time systems. This result is compared to the variance early warning signal computed by Biggs <italic>et al.</italic> <xref ref-type="bibr" rid="pcbi.1002360-Biggs1">[27]</xref>, which uses a much more densely sampled time series including intra-annual dynamics. The comparison shows that the approach proposed here produces a signal of similar quality (although possibly <italic>too</italic> early), while requiring significantly less time series data. Further, comparison with a variance signal using the same amount of time-series data as the generalized model shows that the generalized model-based signal is a much clearer early warning signal in this case. In particular, the variance signal only rises during or after the transition.</p>
      </sec>
      <sec id="s3c">
        <title>Tri-trophic food chain</title>
        <p>For our final example we consider a tri-trophic food chain. In ecological theory food chains play a role both as a prominent motif appearing in complex food webs and as coarse-grained models. Using generalized models, a general Jacobian for a continuous-time model of the tri-trophic food chain can be derived (see <xref ref-type="supplementary-material" rid="pcbi.1002360.s001">Text S1</xref> and Gross <italic>et al.</italic> <xref ref-type="bibr" rid="pcbi.1002360-Gross3">[32]</xref>).</p>
        <p>We generated example time series data using a set of three ordinary differential equations that modeled a producer biomass, <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e051" xlink:type="simple"/></inline-formula>, predator biomass, <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e052" xlink:type="simple"/></inline-formula>, and top predator biomass, <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e053" xlink:type="simple"/></inline-formula>, as described in <xref ref-type="supplementary-material" rid="pcbi.1002360.s001">Text S1</xref>. We included additive noise terms in the equations, and if any biomass decreased to zero we suppressed the noise term so that the corresponding population remained extinct. We simulated these equations while increasing the mortality rate <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e054" xlink:type="simple"/></inline-formula> of the top predator. The resulting time series, for the chosen combination of parameters, show a slowly changing steady-state followed by a sudden transition to large oscillations, and a sudden collapse of all three populations (<xref ref-type="fig" rid="pcbi-1002360-g004">Fig. 4</xref>).</p>
        <fig id="pcbi-1002360-g004" position="float">
          <object-id pub-id-type="doi">10.1371/journal.pcbi.1002360.g004</object-id>
          <label>Figure 4</label>
          <caption>
            <title>Early warning signal for a critical transition in a tri-trophic food chain.</title>
            <p>(a) Time series of <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e055" xlink:type="simple"/></inline-formula> (blue circles, left axis), <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e056" xlink:type="simple"/></inline-formula> (green crosses, left axis) and <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e057" xlink:type="simple"/></inline-formula> (red triangles, left axis) generated by the simulation model described in <xref ref-type="supplementary-material" rid="pcbi.1002360.s001">Text S1</xref>. Only the data subsequently used in the early warning analysis were plotted. Some of the data during the oscillations between <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e058" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e059" xlink:type="simple"/></inline-formula> were outside the scale of this graph, with <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e060" xlink:type="simple"/></inline-formula> exceeding 30. The estimates of top-predator mortality used to calculate the early warning signal are also shown (black dots, right axis). Parameters were <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e061" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e062" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e063" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e064" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e065" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e066" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e067" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e068" xlink:type="simple"/></inline-formula>. (b,c) Real and imaginary parts of eigenvalues estimated from the data in (a), using the procedure described in the text. Eigenvalues are denoted by dots and circles; a dot within a circle indicates two eigenvalues had the same real value. The markers and colors used in (b,c) have no correspondence to those used in (a). A third (purely real) eigenvalue was not plotted, for reasons described in the main text. In (b), the horizontal dashed line indicates the stability boundary at zero real part, while the vertical dashed line indicates the time that the (Hopf) bifurcation occurred in the fast subsystem of the simulation model.</p>
          </caption>
          <graphic mimetype="image" position="float" xlink:href="info:doi/10.1371/journal.pcbi.1002360.g004" xlink:type="simple"/>
        </fig>
        <p>To provide an early warning signal for the transition we recorded time series of the three biomasses and the top-predator's death rate, and estimated the parameters of the generalized model from smoothed segments of these time series. Even for the smoothed data we find that one of the eigenvalues is very noisy and sometimes positive. We believe that the presence of this eigenvalue reflects the response of the prey to fluctuations on the higher trophic levels and therefore exclude this value from our analysis. As <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e069" xlink:type="simple"/></inline-formula> is increased toward the onset of oscillations, two eigenvalues show a clear increase toward zero real part (<xref ref-type="fig" rid="pcbi-1002360-g004">Fig. 4</xref>). The two eigenvalues approach zero as a complex conjugate eigenvalue pair, which is indicative of the system undergoing a Hopf bifurcation <xref ref-type="bibr" rid="pcbi.1002360-Kuznetsov1">[24]</xref>, which in turn generally implies a transition from stationary to oscillatory dynamics. The early warning signal constructed here, consisting of the approach of this eigenvalue pair towards the imaginary axis, warned of the transition to an oscillatory state significantly before the transition occurred. These large oscillations combined with stochastic fluctuations then led rapidly to extinction.</p>
        <p>Supercritical Hopf bifurcations, to which class the bifurcation in the present system belongs, are by themselves not critical transitions. The detection of Hopf bifurcations is nevertheless of interest. First, subcritical Hopf bifurcations are indeed true critical transitions. Second, even supercritical Hopf bifurcations have long been associated in ecology with rapid destabilization and extinction of populations <xref ref-type="bibr" rid="pcbi.1002360-Rosenzweig1">[33]</xref>, a chain of events that we characterize as a critical transition and that we observed to occur in the present system. We also note that although to linear order sub- and super-critical Hopf bifurcations cannot be distinguished, generalized modeling can be extended to higher orders where these cases can be identified <xref ref-type="bibr" rid="pcbi.1002360-Zumsande1">[34]</xref>.</p>
      </sec>
    </sec>
    <sec id="s4">
      <title>Discussion</title>
      <p>In this Letter we proposed an approach for anticipating critical transitions before they occur. In particular we showed that generalized modeling of the system can facilitate the incorporation of the structural information that is in general available.</p>
      <p>We demonstrated the proposed approach in a series of three case studies. The first example showed that in simple systems even very few time points can be sufficient for clean prediction of the critical transition. The second example posed a hard challenge, where test data was generated by a model that differed considerably from the generalized model. Yet even in this case the generalized model significantly reduced the amount of data needed for predicting the transition. The third and final example demonstrated the ability of the proposed approach to distinguish between different types of critical transitions (in this case, through the presence of a complex conjugate pair of eigenvalues approaching the imaginary axis).</p>
      <p>In all case studies we found that the proposed approach can robustly warn of critical transitions in the presence of noise. We believe that the performance of the approach under noisy conditions can be further improved by subsequent refinements. Such refinements could include combination with dynamic linear modeling <xref ref-type="bibr" rid="pcbi.1002360-Carpenter2">[14]</xref>, utilization of a parameter transformation (to ‘scale’ and ‘elasticity’ parameters) previously proposed for generalized models <xref ref-type="bibr" rid="pcbi.1002360-Gross1">[20]</xref>, or the use of optimized sampling procedures.</p>
      <p>Two important rules for constructing the generalized model are as follows. First, there must be sufficiently few unobservable processes (represented by placeholder functions in the generalized model) that their magnitudes can be inferred from balancing the observable processes. For example, in the Allee effect study, the unobserved process <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e070" xlink:type="simple"/></inline-formula> was estimated by <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e071" xlink:type="simple"/></inline-formula>. Second, where a process is a function of <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e072" xlink:type="simple"/></inline-formula> variables (although in the cases studied here <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e073" xlink:type="simple"/></inline-formula> was never larger than 2), our method at present requires assumptions or other knowledge about the dependence of the process on <inline-formula><inline-graphic mimetype="image" xlink:href="info:doi/10.1371/journal.pcbi.1002360.e074" xlink:type="simple"/></inline-formula> of those variables. This requirement could be relaxed in future work, although probably at the cost of requiring more time series data.</p>
      <p>An advantage of the proposed approach is that it generally becomes more reliable closer to a critical transition, where rates of change of state variables and other observables are generally larger, which may lead to better sampling, although noise will also increase close to the transition due to critical slowing down. In such situations statistical methods such as variance may become more difficult to estimate as the time series becomes less stationary, for example since detrending becomes more difficult. On the other hand, the model-free statistical approaches may be more useful where little knowledge is available about the system, or where trends in the means of observed quantities are strongly obscured by noise. In these respects, the proposed approach provides a tool complementary to established statistical methods, each method with its own domain of utility.</p>
      <p>One limitation shared by both our and the statistical early warning methods is that large noise can bias the estimation of the respective warning signals. In our case, an asymmetric distribution of fluctuations can bias the estimation of the underlying steady state. That our approach effectively involves derivatives of time series can increase the sensitivity to high observation noise or otherwise poor-quality data. Another important assumption in our present treatment (that is also shared by the statistical approaches) was that the dynamics of the fast subsystem could, at least at some level of description, be considered as stationary. Let us emphasize that this is not a strong assumption because even systems that are primarily non-stationary, such as the fisheries example, can be modeled as stationary if a suitable generalized modeling framework is chosen. Furthermore, ongoing efforts aim at extending the framework of generalized modeling to non-stationary dynamics, which may lead to a further relaxation of that assumption in the future <xref ref-type="bibr" rid="pcbi.1002360-Kuehn2">[35]</xref>.</p>
      <p>A thorough statistical analysis of the generalized modeling and the statistics-based approaches is another topic for future work. Such a study would help to quantify under exactly what conditions the generalized modeling approach can operate effectively and offer advantages compared to statistics-based approaches.</p>
      <p>In summary, we used generalized models to efficiently incorporate available information about a system without requiring detailed knowledge about that system. Our intermediate-complexity method provides an early warning signal approach complementary to existing statistics-based methods. In the cases studied here, our method could provide early warning signals with significantly less time series data than statistical approaches. Thereby the proposed approach can, under suitable conditions and with good quality data, contribute to the warning of critical transitions from a realistic sampling effort.</p>
    </sec>
    <sec id="s5">
      <title>Supporting Information</title>
      <supplementary-material id="pcbi.1002360.s001" mimetype="application/pdf" position="float" xlink:href="info:doi/10.1371/journal.pcbi.1002360.s001" xlink:type="simple">
        <label>Text S1</label>
        <caption>
          <p><bold>Simulation models and detailed method for early warning signal calculation.</bold> <xref ref-type="supplementary-material" rid="pcbi.1002360.s001">Text S1</xref> details the application of the generalized modeling-based early warning approach to the fishery simulation and the tri-trophic food chain simulation. (The method for the Allee effect application is described in the main text.) The simulation models, used to generate the data to which the early warning signals were applied, are also described.</p>
          <p>(PDF)</p>
        </caption>
      </supplementary-material>
    </sec>
  </body>
  <back>
    <ack>
      <p>The authors acknowledge useful discussions with Christian Kuehn.</p>
    </ack>
    <ref-list>
      <title>References</title>
      <ref id="pcbi.1002360-Scheffer1">
        <label>1</label>
        <element-citation publication-type="other" xlink:type="simple">             <person-group person-group-type="author"><name name-style="western"><surname>Scheffer</surname><given-names>M</given-names></name></person-group>             <year>2009</year>             <source>Critical Transitions in Nature and Society</source>             <publisher-loc>Princeton</publisher-loc>             <publisher-name>Princeton University Press</publisher-name>          </element-citation>
      </ref>
      <ref id="pcbi.1002360-Scheffer2">
        <label>2</label>
        <element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author"><name name-style="western"><surname>Scheffer</surname><given-names>M</given-names></name><name name-style="western"><surname>Carpenter</surname><given-names>S</given-names></name><name name-style="western"><surname>Foley</surname><given-names>JA</given-names></name><name name-style="western"><surname>Folke</surname><given-names>C</given-names></name><name name-style="western"><surname>Walker</surname><given-names>B</given-names></name></person-group>             <year>2001</year>             <article-title>Catastrophic shifts in ecosystems.</article-title>             <source>Nature</source>             <volume>413</volume>             <fpage>591</fpage>             <lpage>596</lpage>          </element-citation>
      </ref>
      <ref id="pcbi.1002360-Lenton1">
        <label>3</label>
        <element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author"><name name-style="western"><surname>Lenton</surname><given-names>TM</given-names></name><name name-style="western"><surname>Held</surname><given-names>H</given-names></name><name name-style="western"><surname>Kriegler</surname><given-names>E</given-names></name><name name-style="western"><surname>Hall</surname><given-names>JW</given-names></name><name name-style="western"><surname>Lucht</surname><given-names>W</given-names></name><etal/></person-group>             <year>2008</year>             <article-title>Tipping elements in the Earth's climate system.</article-title>             <source>Proc Natl Acad Sci USA</source>             <volume>105</volume>             <fpage>1786</fpage>             <lpage>1793</lpage>          </element-citation>
      </ref>
      <ref id="pcbi.1002360-May1">
        <label>4</label>
        <element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author"><name name-style="western"><surname>May</surname><given-names>RM</given-names></name><name name-style="western"><surname>Levin</surname><given-names>SA</given-names></name><name name-style="western"><surname>Sugihara</surname><given-names>G</given-names></name></person-group>             <year>2008</year>             <article-title>Ecology for bankers.</article-title>             <source>Nature</source>             <volume>451</volume>             <fpage>893</fpage>             <lpage>985</lpage>          </element-citation>
      </ref>
      <ref id="pcbi.1002360-Brock1">
        <label>5</label>
        <element-citation publication-type="other" xlink:type="simple">             <person-group person-group-type="author"><name name-style="western"><surname>Brock</surname><given-names>WA</given-names></name></person-group>             <year>2006</year>             <article-title>Tipping points, abrupt opinion changes, and punctuated policy change.</article-title>             <person-group person-group-type="editor"><name name-style="western"><surname>Repetto</surname><given-names>R</given-names></name></person-group>             <source>Punctuated Equilibrium and the Dynamics of U.S. Environmental Policy</source>             <publisher-loc>New Haven</publisher-loc>             <publisher-name>Yale University Press</publisher-name>             <fpage>47</fpage>             <lpage>77</lpage>          </element-citation>
      </ref>
      <ref id="pcbi.1002360-Venegas1">
        <label>6</label>
        <element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author"><name name-style="western"><surname>Venegas</surname><given-names>JG</given-names></name><name name-style="western"><surname>Winkler</surname><given-names>T</given-names></name><name name-style="western"><surname>Musch</surname><given-names>G</given-names></name><name name-style="western"><surname>Melo</surname><given-names>MFV</given-names></name><name name-style="western"><surname>Layfield</surname><given-names>D</given-names></name><etal/></person-group>             <year>2005</year>             <article-title>Self-organized patchiness in asthma as a prelude to catastrophic shifts.</article-title>             <source>Nature</source>             <volume>434</volume>             <fpage>777</fpage>             <lpage>782</lpage>          </element-citation>
      </ref>
      <ref id="pcbi.1002360-Carpenter1">
        <label>7</label>
        <element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author"><name name-style="western"><surname>Carpenter</surname><given-names>SR</given-names></name><name name-style="western"><surname>Cole</surname><given-names>JJ</given-names></name><name name-style="western"><surname>Pace</surname><given-names>ML</given-names></name><name name-style="western"><surname>Batt</surname><given-names>R</given-names></name><name name-style="western"><surname>Brock</surname><given-names>WA</given-names></name><etal/></person-group>             <year>2011</year>             <article-title>Early warnings of regime shifts: A whole-ecosystem experiment.</article-title>             <source>Science</source>             <volume>332</volume>             <fpage>1079</fpage>             <lpage>1082</lpage>          </element-citation>
      </ref>
      <ref id="pcbi.1002360-Mumby1">
        <label>8</label>
        <element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author"><name name-style="western"><surname>Mumby</surname><given-names>PJ</given-names></name><name name-style="western"><surname>Hastings</surname><given-names>A</given-names></name><name name-style="western"><surname>Edwards</surname><given-names>HJ</given-names></name></person-group>             <year>2007</year>             <article-title>Thresholds and the resilience of caribbean coral reefs.</article-title>             <source>Nature</source>             <volume>450</volume>             <fpage>98</fpage>             <lpage>101</lpage>          </element-citation>
      </ref>
      <ref id="pcbi.1002360-Anderies1">
        <label>9</label>
        <element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author"><name name-style="western"><surname>Anderies</surname><given-names>JM</given-names></name><name name-style="western"><surname>Janssen</surname><given-names>MA</given-names></name><name name-style="western"><surname>Walker</surname><given-names>BH</given-names></name></person-group>             <year>2002</year>             <article-title>Grazing management, resilience, and the dynamics of a fire-driven rangeland system.</article-title>             <source>Ecosystems</source>             <volume>5</volume>             <fpage>23</fpage>             <lpage>44</lpage>          </element-citation>
      </ref>
      <ref id="pcbi.1002360-Foley1">
        <label>10</label>
        <element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author"><name name-style="western"><surname>Foley</surname><given-names>JA</given-names></name><name name-style="western"><surname>Coe</surname><given-names>MT</given-names></name><name name-style="western"><surname>Scheffer</surname><given-names>M</given-names></name><name name-style="western"><surname>Wang</surname><given-names>G</given-names></name></person-group>             <year>2003</year>             <article-title>Regime shifts in the Sahara and Sahel: Interactions between ecological and climatic systems in northern Africa.</article-title>             <source>Ecosystems</source>             <volume>6</volume>             <fpage>524</fpage>             <lpage>532</lpage>          </element-citation>
      </ref>
      <ref id="pcbi.1002360-Folke1">
        <label>11</label>
        <element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author"><name name-style="western"><surname>Folke</surname><given-names>C</given-names></name><name name-style="western"><surname>Carpenter</surname><given-names>S</given-names></name><name name-style="western"><surname>Walker</surname><given-names>B</given-names></name><name name-style="western"><surname>Scheffer</surname><given-names>M</given-names></name><name name-style="western"><surname>Elmqvist</surname><given-names>T</given-names></name><etal/></person-group>             <year>2004</year>             <article-title>Regime shifts, resilience, and biodiversity in ecosystem management.</article-title>             <source>Annu Rev Ecol Evol Syst</source>             <volume>35</volume>             <fpage>557</fpage>             <lpage>581</lpage>          </element-citation>
      </ref>
      <ref id="pcbi.1002360-Groffman1">
        <label>12</label>
        <element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author"><name name-style="western"><surname>Groffman</surname><given-names>P</given-names></name><name name-style="western"><surname>Baron</surname><given-names>J</given-names></name><name name-style="western"><surname>Blett</surname><given-names>T</given-names></name><name name-style="western"><surname>Gold</surname><given-names>A</given-names></name><name name-style="western"><surname>Goodman</surname><given-names>I</given-names></name><etal/></person-group>             <year>2006</year>             <article-title>Ecological thresholds: The key to successful environmental management or an important concept with no practical application?</article-title>             <source>Ecosystems</source>             <volume>9</volume>             <fpage>1</fpage>             <lpage>13</lpage>          </element-citation>
      </ref>
      <ref id="pcbi.1002360-Scheffer3">
        <label>13</label>
        <element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author"><name name-style="western"><surname>Scheffer</surname><given-names>M</given-names></name><name name-style="western"><surname>Bascompte</surname><given-names>J</given-names></name><name name-style="western"><surname>Brock</surname><given-names>WA</given-names></name><name name-style="western"><surname>Brovkin</surname><given-names>V</given-names></name><name name-style="western"><surname>Carpenter</surname><given-names>SR</given-names></name><etal/></person-group>             <year>2009</year>             <article-title>Early-warning signals for critical transitions.</article-title>             <source>Nature</source>             <volume>461</volume>             <fpage>53</fpage>             <lpage>59</lpage>          </element-citation>
      </ref>
      <ref id="pcbi.1002360-Carpenter2">
        <label>14</label>
        <element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author"><name name-style="western"><surname>Carpenter</surname><given-names>SR</given-names></name><name name-style="western"><surname>Brock</surname><given-names>WA</given-names></name></person-group>             <year>2006</year>             <article-title>Rising variance: a leading indicator of ecological transition.</article-title>             <source>Ecol Lett</source>             <volume>9</volume>             <fpage>311</fpage>             <lpage>318</lpage>          </element-citation>
      </ref>
      <ref id="pcbi.1002360-Dakos1">
        <label>15</label>
        <element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author"><name name-style="western"><surname>Dakos</surname><given-names>V</given-names></name><name name-style="western"><surname>Scheffer</surname><given-names>M</given-names></name><name name-style="western"><surname>van Nes</surname><given-names>EH</given-names></name><name name-style="western"><surname>Brovkin</surname><given-names>V</given-names></name><name name-style="western"><surname>Petoukhov</surname><given-names>V</given-names></name><etal/></person-group>             <year>2008</year>             <article-title>Slowing down as an early warning signal for abrupt climate change.</article-title>             <source>Proc Natl Acad Sci USA</source>             <volume>105</volume>             <fpage>14308</fpage>             <lpage>14312</lpage>          </element-citation>
      </ref>
      <ref id="pcbi.1002360-Wissel1">
        <label>16</label>
        <element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author"><name name-style="western"><surname>Wissel</surname><given-names>C</given-names></name></person-group>             <year>1984</year>             <article-title>A universal law of the characteristic return time near thresholds.</article-title>             <source>Oecologia</source>             <volume>65</volume>             <fpage>101</fpage>             <lpage>107</lpage>          </element-citation>
      </ref>
      <ref id="pcbi.1002360-Guttal1">
        <label>17</label>
        <element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author"><name name-style="western"><surname>Guttal</surname><given-names>V</given-names></name><name name-style="western"><surname>Jayaprakash</surname><given-names>C</given-names></name></person-group>             <year>2008</year>             <article-title>Changing skewness: an early warning signal of regime shifts in ecosystems.</article-title>             <source>Ecol Lett</source>             <volume>11</volume>             <fpage>450</fpage>             <lpage>460</lpage>          </element-citation>
      </ref>
      <ref id="pcbi.1002360-Brock2">
        <label>18</label>
        <element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author"><name name-style="western"><surname>Brock</surname><given-names>WA</given-names></name><name name-style="western"><surname>Carpenter</surname><given-names>SR</given-names></name></person-group>             <year>2010</year>             <article-title>Interacting regime shifts in ecosystems: Implication for early warnings.</article-title>             <source>Ecol Monogr</source>             <volume>80</volume>             <fpage>353</fpage>             <lpage>367</lpage>          </element-citation>
      </ref>
      <ref id="pcbi.1002360-Dakos2">
        <label>19</label>
        <element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author"><name name-style="western"><surname>Dakos</surname><given-names>V</given-names></name><name name-style="western"><surname>van Nes</surname><given-names>E</given-names></name><name name-style="western"><surname>Donangelo</surname><given-names>R</given-names></name><name name-style="western"><surname>Fort</surname><given-names>H</given-names></name><name name-style="western"><surname>Scheffer</surname><given-names>M</given-names></name></person-group>             <year>2010</year>             <article-title>Spatial correlation as leading indicator of catastrophic shifts.</article-title>             <source>Theor Ecol</source>             <volume>3</volume>             <fpage>163</fpage>             <lpage>174</lpage>          </element-citation>
      </ref>
      <ref id="pcbi.1002360-Gross1">
        <label>20</label>
        <element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author"><name name-style="western"><surname>Gross</surname><given-names>T</given-names></name><name name-style="western"><surname>Feudel</surname><given-names>U</given-names></name></person-group>             <year>2006</year>             <article-title>Generalized models as a universal approach to the analysis of nonlinear dynamical systems.</article-title>             <source>Phys Rev E</source>             <volume>73</volume>             <fpage>016205</fpage>          </element-citation>
      </ref>
      <ref id="pcbi.1002360-Gross2">
        <label>21</label>
        <element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author"><name name-style="western"><surname>Gross</surname><given-names>T</given-names></name><name name-style="western"><surname>Rudolf</surname><given-names>L</given-names></name><name name-style="western"><surname>Levin</surname><given-names>SA</given-names></name><name name-style="western"><surname>Dieckmann</surname><given-names>U</given-names></name></person-group>             <year>2009</year>             <article-title>Generalized models reveal stabilizing factors in food webs.</article-title>             <source>Science</source>             <volume>325</volume>             <fpage>747</fpage>             <lpage>750</lpage>          </element-citation>
      </ref>
      <ref id="pcbi.1002360-Sterman1">
        <label>22</label>
        <element-citation publication-type="other" xlink:type="simple">             <person-group person-group-type="author"><name name-style="western"><surname>Sterman</surname><given-names>JD</given-names></name></person-group>             <year>2000</year>             <source>Business Dynamics: Systems Thinking and Modeling for a Complex World</source>             <publisher-name>McGraw-Hill</publisher-name>          </element-citation>
      </ref>
      <ref id="pcbi.1002360-Kuehn1">
        <label>23</label>
        <element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author"><name name-style="western"><surname>Kuehn</surname><given-names>C</given-names></name></person-group>             <year>2011</year>             <article-title>A mathematical framework for critical transitions: Bifurcations, fast-slow systems and stochastic dynamics.</article-title>             <source>Physica D</source>             <volume>240</volume>             <fpage>1020</fpage>             <lpage>1035</lpage>          </element-citation>
      </ref>
      <ref id="pcbi.1002360-Kuznetsov1">
        <label>24</label>
        <element-citation publication-type="other" xlink:type="simple">             <person-group person-group-type="author"><name name-style="western"><surname>Kuznetsov</surname><given-names>Y</given-names></name></person-group>             <year>2010</year>             <source>Elements of Applied Bifurcation Theory</source>             <publisher-name>Springer</publisher-name>          </element-citation>
      </ref>
      <ref id="pcbi.1002360-Kramer1">
        <label>25</label>
        <element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author"><name name-style="western"><surname>Kramer</surname><given-names>A</given-names></name><name name-style="western"><surname>Dennis</surname><given-names>B</given-names></name><name name-style="western"><surname>Liebhold</surname><given-names>A</given-names></name><name name-style="western"><surname>Drake</surname><given-names>J</given-names></name></person-group>             <year>2009</year>             <article-title>The evidence for Allee effects.</article-title>             <source>Pop Ecol</source>             <volume>51</volume>             <fpage>341</fpage>             <lpage>354</lpage>          </element-citation>
      </ref>
      <ref id="pcbi.1002360-Boukal1">
        <label>26</label>
        <element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author"><name name-style="western"><surname>Boukal</surname><given-names>DS</given-names></name><name name-style="western"><surname>Berec</surname><given-names>L</given-names></name></person-group>             <year>2002</year>             <article-title>Single-species models of the allee effect: Extinction boundaries, sex ratios and mate encounters.</article-title>             <source>J Theor Biol</source>             <volume>218</volume>             <fpage>375</fpage>             <lpage>394</lpage>          </element-citation>
      </ref>
      <ref id="pcbi.1002360-Biggs1">
        <label>27</label>
        <element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author"><name name-style="western"><surname>Biggs</surname><given-names>R</given-names></name><name name-style="western"><surname>Carpenter</surname><given-names>SR</given-names></name><name name-style="western"><surname>Brock</surname><given-names>WA</given-names></name></person-group>             <year>2009</year>             <article-title>Turning back from the brink: Detecting an impending regime shift in time to avert it.</article-title>             <source>Proc Natl Acad Sci USA</source>             <volume>106</volume>             <fpage>826</fpage>             <lpage>831</lpage>          </element-citation>
      </ref>
      <ref id="pcbi.1002360-Walters1">
        <label>28</label>
        <element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author"><name name-style="western"><surname>Walters</surname><given-names>C</given-names></name><name name-style="western"><surname>Kitchell</surname><given-names>JF</given-names></name></person-group>             <year>2001</year>             <article-title>Cultivation/depensation effects on juvenile survival and recruitment: Implications for the theory of fishing.</article-title>             <source>Can J Fish Aquat Sci</source>             <volume>58</volume>             <fpage>39</fpage>             <lpage>50</lpage>          </element-citation>
      </ref>
      <ref id="pcbi.1002360-Steele1">
        <label>29</label>
        <element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author"><name name-style="western"><surname>Steele</surname><given-names>JH</given-names></name></person-group>             <year>2004</year>             <article-title>Regime shifts in the ocean: reconciling observations and theory.</article-title>             <source>Prog Oceanography</source>             <volume>60</volume>             <fpage>135</fpage>             <lpage>141</lpage>          </element-citation>
      </ref>
      <ref id="pcbi.1002360-deYoung1">
        <label>30</label>
        <element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author"><name name-style="western"><surname>deYoung</surname><given-names>B</given-names></name><name name-style="western"><surname>Barange</surname><given-names>M</given-names></name><name name-style="western"><surname>Beaugrand</surname><given-names>G</given-names></name><name name-style="western"><surname>Harris</surname><given-names>R</given-names></name><name name-style="western"><surname>Perry</surname><given-names>RI</given-names></name><etal/></person-group>             <year>2008</year>             <article-title>Regime shifts in marine ecosystems: detection, prediction and management.</article-title>             <source>Trends Ecol Evol</source>             <volume>23</volume>             <fpage>402</fpage>             <lpage>409</lpage>          </element-citation>
      </ref>
      <ref id="pcbi.1002360-Carpenter3">
        <label>31</label>
        <element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author"><name name-style="western"><surname>Carpenter</surname><given-names>SR</given-names></name><name name-style="western"><surname>Brock</surname><given-names>WA</given-names></name><name name-style="western"><surname>Cole</surname><given-names>JJ</given-names></name><name name-style="western"><surname>Kitchell</surname><given-names>JF</given-names></name><name name-style="western"><surname>Pace</surname><given-names>ML</given-names></name></person-group>             <year>2008</year>             <article-title>Leading indicators of trophic cascades.</article-title>             <source>Ecol Lett</source>             <volume>11</volume>             <fpage>128</fpage>             <lpage>138</lpage>          </element-citation>
      </ref>
      <ref id="pcbi.1002360-Gross3">
        <label>32</label>
        <element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author"><name name-style="western"><surname>Gross</surname><given-names>T</given-names></name><name name-style="western"><surname>Ebenhöh</surname><given-names>W</given-names></name><name name-style="western"><surname>Feudel</surname><given-names>U</given-names></name></person-group>             <year>2005</year>             <article-title>Long food chains are in general chaotic.</article-title>             <source>Oikos</source>             <volume>109</volume>             <fpage>135</fpage>             <lpage>144</lpage>          </element-citation>
      </ref>
      <ref id="pcbi.1002360-Rosenzweig1">
        <label>33</label>
        <element-citation publication-type="journal" xlink:type="simple">             <person-group person-group-type="author"><name name-style="western"><surname>Rosenzweig</surname><given-names>ML</given-names></name></person-group>             <year>1971</year>             <article-title>Paradox of enrichment: Destabilization of exploitation ecosystems in ecological time.</article-title>             <source>Science</source>             <volume>171</volume>             <fpage>385</fpage>             <lpage>387</lpage>          </element-citation>
      </ref>
      <ref id="pcbi.1002360-Zumsande1">
        <label>34</label>
        <element-citation publication-type="other" xlink:type="simple">             <person-group person-group-type="author"><name name-style="western"><surname>Zumsande</surname><given-names>M</given-names></name></person-group>             <year>2011</year>             <article-title>Extension of Generalized Modelling and Application to Problems from Cell Biology.</article-title>             <comment>Ph.D. thesis, Technische Universität Dresden</comment>          </element-citation>
      </ref>
      <ref id="pcbi.1002360-Kuehn2">
        <label>35</label>
        <element-citation publication-type="other" xlink:type="simple">             <person-group person-group-type="author"><name name-style="western"><surname>Kuehn</surname><given-names>C</given-names></name><name name-style="western"><surname>Gross</surname><given-names>T</given-names></name></person-group>             <year>2011</year>             <article-title>Nonlocal generalized models of predator-prey systems.</article-title>             <comment>Available: <ext-link ext-link-type="uri" xlink:href="http://arxiv.org/abs/1105.3662" xlink:type="simple">http://arxiv.org/abs/1105.3662</ext-link></comment>          </element-citation>
      </ref>
    </ref-list>
    
  </back>
</article>