Skip to main content
  • ASM Journals
    • Antimicrobial Agents and Chemotherapy
    • Applied and Environmental Microbiology
    • Clinical Microbiology Reviews
    • Clinical and Vaccine Immunology
    • EcoSal Plus
    • Infection and Immunity
    • Journal of Bacteriology
    • Journal of Clinical Microbiology
    • Journal of Microbiology & Biology Education
    • Journal of Virology
    • mBio
    • Microbiology and Molecular Biology Reviews
    • Microbiology Resource Announcements
    • Microbiology Spectrum
    • Molecular and Cellular Biology
    • mSphere
    • mSystems
  • Log in
  • My alerts
  • My Cart

Main menu

  • Home
  • Articles
    • Latest Articles
    • Special Issues
    • COVID-19 Special Collection
    • Editor's Picks
    • Special Series: Sponsored Minireviews and Video Abstracts
    • Archive
  • Topics
    • Applied and Environmental Science
    • Ecological and Evolutionary Science
    • Host-Microbe Biology
    • Molecular Biology and Physiology
    • Novel Systems Biology Techniques
    • Early-Career Systems Microbiology Perspectives
  • For Authors
    • Getting Started
    • Submit a Manuscript
    • Scope
    • Editorial Policy
    • Submission, Review, & Publication Processes
    • Organization and Format
    • Errata, Author Corrections, Retractions
    • Illustrations and Tables
    • Nomenclature
    • Abbreviations and Conventions
    • Publication Fees
    • Ethics
  • About the Journal
    • About mSystems
    • Editor in Chief
    • Board of Editors
    • For Reviewers
    • For the Media
    • For Librarians
    • For Advertisers
    • Alerts
    • RSS
    • FAQ
  • ASM Journals
    • Antimicrobial Agents and Chemotherapy
    • Applied and Environmental Microbiology
    • Clinical Microbiology Reviews
    • Clinical and Vaccine Immunology
    • EcoSal Plus
    • Infection and Immunity
    • Journal of Bacteriology
    • Journal of Clinical Microbiology
    • Journal of Microbiology & Biology Education
    • Journal of Virology
    • mBio
    • Microbiology and Molecular Biology Reviews
    • Microbiology Resource Announcements
    • Microbiology Spectrum
    • Molecular and Cellular Biology
    • mSphere
    • mSystems

User menu

  • Log in
  • My alerts
  • My Cart

Search

  • Advanced search
mSystems
publisher-logosite-logo

Advanced Search

  • Home
  • Articles
    • Latest Articles
    • Special Issues
    • COVID-19 Special Collection
    • Editor's Picks
    • Special Series: Sponsored Minireviews and Video Abstracts
    • Archive
  • Topics
    • Applied and Environmental Science
    • Ecological and Evolutionary Science
    • Host-Microbe Biology
    • Molecular Biology and Physiology
    • Novel Systems Biology Techniques
    • Early-Career Systems Microbiology Perspectives
  • For Authors
    • Getting Started
    • Submit a Manuscript
    • Scope
    • Editorial Policy
    • Submission, Review, & Publication Processes
    • Organization and Format
    • Errata, Author Corrections, Retractions
    • Illustrations and Tables
    • Nomenclature
    • Abbreviations and Conventions
    • Publication Fees
    • Ethics
  • About the Journal
    • About mSystems
    • Editor in Chief
    • Board of Editors
    • For Reviewers
    • For the Media
    • For Librarians
    • For Advertisers
    • Alerts
    • RSS
    • FAQ
Editor's Pick Minireview | Novel Systems Biology Techniques

On the Power of Uncertainties in Microbial System Modeling: No Need To Hide Them Anymore

Benoit Delahaye, Damien Eveillard, Nicholas Bouskill
Nicholas Chia, Editor
Benoit Delahaye
a LS2N, UMR 6004, CNRS, Université de Nantes, ECN, IMTA, Nantes, France
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Benoit Delahaye
Damien Eveillard
a LS2N, UMR 6004, CNRS, Université de Nantes, ECN, IMTA, Nantes, France
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Damien Eveillard
Nicholas Bouskill
b Lawrence Berkeley National Laboratory, Berkeley, California, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Nicholas Chia
Mayo Clinic
Roles: Editor
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
DOI: 10.1128/mSystems.00169-17
  • Article
  • Figures & Data
  • Info & Metrics
  • PDF
Loading

ABSTRACT

For decades, microbiologists have considered uncertainties as an undesired side effect of experimental protocols. As a consequence, standard microbial system modeling strives to hide uncertainties for the sake of deterministic understanding. However, recent studies have highlighted greater experimental variability than expected and emphasized uncertainties not as a weakness but as a necessary feature of complex microbial systems. We therefore advocate that biological uncertainties need to be considered foundational facets that must be incorporated in models. Not only will understanding these uncertainties improve our understanding and identification of microbial traits, it will also provide fundamental insights on microbial systems as a whole. Taking into account uncertainties within microbial models calls for new validation techniques. Formal verification already overcomes this shortcoming by proposing modeling frameworks and validation techniques dedicated to probabilistic models. However, further work remains to extract the full potential of such techniques in the context of microbial models. Herein, we demonstrate how statistical model checking can enhance the development of microbial models by building confidence in the estimation of critical parameters and through improved sensitivity analyses.

INTRODUCTION

Since the work of Monod (1), simple biological modeling has been prominent in microbiology. Because of their experimental tractability and purported simplicity, microbial experimental systems have fostered the rise of several cross-scale modeling approaches from the gene to the population level, which have been extended to test ecoevolutionary hypotheses. These modeling approaches proposed and addressed foundational hypotheses that developed into new biological paradigms such as growth rate or identification of functional units. The first microbial models were driven by reductionist assumptions (e.g., intracellular quota combined with kinetics mimicking biochemistry rules) yet demonstrated remarkable predictive power for portraying the growth of microbes in simple systems such as chemostats (1). Similar quota assumptions were used to model phytoplankton physiology (2) and later for modeling simplified global ocean ecosystems (3).

Reductionist modeling approaches have generally been parameterized from data gleaned from laborious bench experiments. However, contemporary next-generation sequencing (NGS) approaches provide unprecedented characterization of the diversity of microbial communities, yet because feedbacks between biotic and abiotic systems are inherently nonlinear and complex, mathematical models of microbial guilds interacting with their environment are required. Current models have been developed along the lines of systems biology approaches (4, 5) or trait-based models (6). Furthermore, NGS provides a large amount of data that represent one experiment alongside its associated uncertainties. It is also worth noting that increasing the data set provides a concomitant increase in the number of uncertainties that must be considered.

Within microbial models, these uncertainties can be accounted for by machine learning techniques (see Libbrecht and Noble [7] for a review) that produce automatically predictive (deterministic) models from experimental measurements. Uncertainties are accounted for in the modeling process (e.g., via averaging) but are hidden in the model itself. Moreover, despite the great predictive power of such modelings, the resulting models are not necessarily biologically meaningful. In particular, once parameterized, a model could be overfit to a data set without reflecting emergent properties and precluding or reducing knowledge discovery. Considering that a single microbial system could produce several distinct data sets through several experimental approaches, several different models are built accordingly (8, 9). All corresponding models must then be investigated via automatic learning and verification techniques to take into account their common properties rather than considering each model in isolation (10). Conversely, other probabilistic modelings consider uncertainties but make the parameterization difficult or advocate the use of multiple models that are difficult to validate (11). Despite the aforementioned challenges, uncertainties must be accounted for and integrated into microbial modeling approaches. Such an issue remains a general problem across biology, and even in ecology despite a long tradition of dealing with quantitative uncertainties (12). Herein, as previously done in engineering (13), we advocate that the proper use of dedicated verification techniques could support efforts to capture the complexity of microbial systems within models by promoting a computational convergence on uncertainties rather than simple simulations. Below we present a short overview of current modeling approaches for studying microbial systems, after which we discuss the computational challenges that must be overcome to better take into account uncertainties and verify the resulting models.

MICROBIAL STATE-OF-THE ART MODELINGS AND UNCERTAINTIES

Initial biological modeling efforts were inspired by models of physical systems and formalized using nonlinear ordinary differential equations representing dynamic behaviors of gene activity or molecular concentrations. Interactions within these models are driven by reaction rates associated with particular mechanistic behaviors such as Michaelis-Menten or Hill functions. The need to use formal methods to analyze such models has been discussed extensively in the last 15 years (see De Jong [14] for a state-of-the-art review or Fisher and Henzinger [15]). However, their application mainly results in a discretization of all interactions, such that the model becomes qualitative. An advantage in this context is that the resulting qualitative models are computationally scalable and do not need to incorporate an extensive number of parameters that are mostly out of experimental reach, including parameters that show clear sensitivity to experimental conditions (16). Nonetheless, even if such models are sufficient to represent microbial gene regulatory networks, they are generally not sufficient for modeling quantitative microbial behaviors as needed in the context of simulation of microbial populations and communities, and subsequently, biogeochemical processes.

In order to represent complex quantitative microbial community responses to environmental constraints, several studies postulate that the development of genome-scale metabolic models that consider the whole set of metabolic reactions within a microbial strain are necessary (17). In this context, the metabolic network consists of stoichiometric coefficients and mass balance constraints. Herein, the rates are reduced to fluxes that can be estimated via flux balance analysis (FBA) (18), which negates the need for specific kinetic parameterization yet provides quantitative predictions. FBA models are based on constraints, and solving the metabolic network analysis requires the consideration of boundary conditions for all metabolic fluxes that take place within the cell (see Bordbar et al. [19] for a review). In particular, recently, Basler et al. (20) have shown that those boundaries that reflect uncertainties are necessary to better understand intracellular metabolic flux distribution.

In order to simulate microbial communities, one can consider them at equilibrium by performing extensions of FBA (21, 22) or focus on dynamic quantitative behaviors by representing kinetics of several microbial populations via traits. These trait-based models use nonlinear differential equations and simplified complex dynamic behaviors with a single parameter. However, because of the inherent complexity of the population (23), estimating such a parameter is a difficult task without considering uncertainties and intensive statistical analyses. Despite several attempts to identify those traits from metagenomic experiments (24), estimating trait parameter values and automatically building predictive models from ecosystem experiments remain key challenges for the field.

NEED FOR DEDICATED MODEL-CHECKING TECHNIQUES

Following standard parameter estimation, whereby simulations satisfy the trends and trajectories of experimental data, models are usually tested through sensitivity analyses. Such analyses test the predictive accuracy of models across a wider range of parameter values. However, while such testing is commonly used in practice because of its computational scalability, sensitivity analysis does not provide a formal guarantee of the correctness of the model but rather a synthesis of extensive number of simulations. In several engineering fields, formal verification of models overcomes this shortcoming by performing model checking (25), which provides such guarantees. Unfortunately, because standard model checking was originally designed to study artificial systems, such as computer programs, it does not necessarily scale up to meet the demands of complexity of microbial systems, in particular when dealing with uncertainties. One must therefore combine model checking with sensitivity analyses, as fostered by recent statistical model-checking (SMC) methods (26–28). Like sensitivity analysis, SMC is based on simulations and executes the model several times to converge on a probability for a given property to be satisfied (see Fig. 1 for an illustration). In this case, the number of simulations that must be performed, and satisfied, is not arbitrarily fixed by the modeler but rather precomputed in order to ensure strong (formal) guarantees on the confidence and error levels of the analysis. Because SMC methods are based on simulations, they do not rely directly on the model structure (i.e., number of variables and constraints), only on the ability to run simulations, regardless of the formalization used (i.e., ordinary differential equations [ODEs], constraint-based, Boolean…). As a consequence, they are suitable for realistic modelings, ensuring strong formal guarantees (29) despite the complexity inherent to microbial systems.

STATISTICAL MODEL CHECKING OF MICROBIAL MODELS

Because uncertainties are central to SMC methods, our hypothesis is that its use will be central for microbial model validation. SMC will indeed build formal confidence (trust) in the validation process while improving standard validation techniques. Standard validation is usually performed using a sufficiently large number of model simulations, but the precise number is left to the acumen of the modeler, which is not a satisfying guarantee with respect to the precision and correctness of the analyses. In contrast, the precision and correctness of SMC methods are formally certified by using statistical results to compute the required number of model simulations. Moreover, SMC methods are tailored for the analysis of models that incorporate uncertainties per se and therefore take into account parameter variations as standard characteristics of the models studied. Thus, two potential SMC applications in the context of microbial system validation could be emphasized.

Model certification rather than sensitivity analysis.Instead of fixing parameter values to their mean observed values and performing sensitivity analysis of one parameter at a time (Fig. 1A), we propose to embed the uncertainty of the parameter values into the models by assigning each parameter to a probability distribution based on its potential values informed by lab or field experiments (Fig. 1B). Consequently, a trait must then be considered a distribution on a range of values instead of a single value that represents multiple experiments. The distribution of values over a given range can thus be set as Gaussian, or as another distribution, in order to fit experimental uncertainties. In SMC, model simulations can be performed by picking parameter values within their attached distributions (i.e., by considering the variances of all parameters) and executing standard simulations. Following a simulation, deciding whether one prediction is valid can be done by computing the deviation of predicted values from existing observations. Since several simulations are performed (for several parameter values), SMC outputs a score representing the ratio of valid simulations. Thus, the SMC method performs a generalization of standard sensitivity analyses, not by analyzing the sensitivity of a single average simulation but by analyzing all feasible simulations and proposing general statistics of the whole; i.e., accurate statistical guarantees to perform predictive simulations while taking into account experimental uncertainties. By extension, considering uncertainties also allows us to certify all simulation behaviors (i.e., average of simulations) for the sake of model validation, rather than validating a single behavior (i.e., simulation of an average).

FIG 1
  • Open in new tab
  • Download powerpoint
FIG 1

Illustration of model checking without and with uncertainties. Following a range of experiments, standard data analysis highlights the distribution of values for a given parameter α. (A) Along a standard model-checking protocol, one assumes a single value for α, usually the mean. Such a value is then used for model calibration, which allows a simulation. Simulation results are then compared with observations for the sake of model verification (e.g., usually via linear regression between prediction and observations). (B) An example of a model-checking protocol that considers uncertainties per se. Instead of considering a single parameter value, one considers a range of values and precision guarantees and performs a range of simulations accordingly (one per color). Altogether, this SMC approach validates the models while taking into account intrinsic uncertainties and guarantees the desired precision (90% here).

Model parameter estimation with uncertainties.Model parameters are often difficult to measure because microbial communities encapsulate an array of trait data leading to wide ranges in parameter values. Moreover, identifying a distribution of parameter values, for instance, trait parameter values for models of microbe-mediated biogeochemical processes remains a difficult task. One could overcome this difficulty by considering a slight modification of the SMC paradigm to decipher the global set of parameters (with uncertainties) that best fit the experimental data (Fig. 2). While the global range of potential parameter values is often known, the aim here is to identify, within this range, the “ideal” parameter values (i.e., those that produce the highest rate of valid simulations). In this context, a partition of the global range of parameter values (alongside the variance) is produced (Fig. 2B), and simulations are performed for each of the obtained “subranges” (Fig. 2C). SMC can then provide a certified score for each of those subranges, which represent an evaluation of their adequacy with respect to experimental data (Fig. 2D and E). When performed on all subranges from the partition, this method allows us to identify the parameter subranges that best fit the experimental data.

FIG 2
  • Open in new tab
  • Download powerpoint
FIG 2

Statistical model checking (SMC) for model parameter estimation with uncertainties. (A and B) Considering the distribution of parameter values (A), SMC will perform a partition of the global range of parameter values (B). Notably, all parameters will be identified as a whole, instead of identifying each parameter independently from others as in standard parameterization techniques. (C and D) Probabilistic simulations are then performed for each of the “subranges” obtained. (E) Simulations of all models are then compared to experimental data for the sake of adequacy estimation. (F) Iterated several times, this protocol allows us to identify parameter subranges that, considered altogether, best fit the experimental data.

CONCLUSION

Uncertainties in parameter values are inherent to models built from experimental data. Instead of doing our best to rule out these uncertainties through deterministic modeling, we advocate that they should be incorporated into the models via the development of dedicated probabilistic modelings. Originally developed for software applications, statistical verification of such models will enhance the accuracy of model validation while also bringing formal evidence of the correctness of the approach. In addition, the future development of dedicated SMC methods will be the necessary steps to estimate parameter values with uncertainties, ensuring the satisfaction of desired properties, which represents the next methodological block for modeling quantitatively microbial systems from genes to ecosystems.

ACKNOWLEDGMENT

This work is supported by CNRS PICS 226589, ANR-14-CE28-0002.

  • Copyright © 2017 Delahaye et al.

This is an open-access article distributed under the terms of the Creative Commons Attribution 4.0 International license .

REFERENCES

  1. 1.↵
    1. Monod J
    . 1949. The growth of bacterial cultures. Annu Rev Microbiol3:371–394. doi:10.1146/annurev.mi.03.100149.002103.
    OpenUrlCrossRefWeb of Science
  2. 2.↵
    1. Droop M
    . 1973. Some thoughts on nutrient limitation in algae. J Phycol9:264–272.
    OpenUrlCrossRefWeb of Science
  3. 3.↵
    1. Follows MJ,
    2. Dutkiewicz S
    . 2011. Modeling diverse communities of marine microbes. Annu Rev Mar Sci3:427–451. doi:10.1146/annurev-marine-120709-142848.
    OpenUrlCrossRef
  4. 4.↵
    1. Raes J,
    2. Bork P
    . 2008. Molecular eco-systems biology: towards an understanding of community function. Nat Rev Microbiol6:693–699. doi:10.1038/nrmicro1935.
    OpenUrlCrossRefPubMedWeb of Science
  5. 5.↵
    1. Thiele I,
    2. Heinken A,
    3. Fleming RMT
    . 2013. A systems biology approach to studying the role of microbes in human health. Curr Opin Biotechnol24:4–12. doi:10.1016/j.copbio.2012.10.001.
    OpenUrlCrossRefPubMed
  6. 6.↵
    1. Litchman E,
    2. Klausmeier CA
    . 2008. Trait-based community ecology of phytoplankton. Annu Rev Ecol Evol Syst39:615–639. doi:10.1146/annurev.ecolsys.39.110707.173549.
    OpenUrlCrossRef
  7. 7.↵
    1. Libbrecht MW,
    2. Noble WS
    . 2015. Machine learning in genetics and genomics. Nat Rev Genet16:321–332. doi:10.1038/nrg3920.
    OpenUrlCrossRefPubMed
  8. 8.↵
    1. Simão E,
    2. Remy E,
    3. Thieffry D,
    4. Chaouiya C
    . 2005. Qualitative modelling of regulated metabolic pathways: application to the tryptophan biosynthesis in E. coli. Bioinformatics21(Suppl 2):ii190–ii196. doi:10.1093/bioinformatics/bti1130.
    OpenUrlCrossRefPubMed
  9. 9.↵
    1. Salazar-Cavazos E,
    2. Santillán M
    . 2014. Optimal performance of the tryptophan operon of E. coli: a stochastic, dynamical, mathematical-modeling approach. Bull Math Biol76:314–334. doi:10.1007/s11538-013-9920-8.
    OpenUrlCrossRef
  10. 10.↵
    1. Vert J-P
    . 2010. Reconstruction of biological networks by supervised machine learning approaches, p 165–188. InLodhi HM, Muggleton SH (ed), Elements of computational systems biology. John Wiley & Sons, Inc, Hoboken, NY.
  11. 11.↵
    1. Friedman N,
    2. Linial M,
    3. Nachman I,
    4. Pe’er D
    . 2000. Using Bayesian networks to analyze expression data. J Comput Biol7:601–620. doi:10.1089/106652700750050961.
    OpenUrlCrossRefPubMedWeb of Science
  12. 12.↵
    1. Mouquet N,
    2. Lagadeuc Y,
    3. Devictor V,
    4. Doyen L,
    5. Duputié A,
    6. Eveillard D,
    7. Faure D,
    8. Garnier E,
    9. Gimenez O,
    10. Huneman P,
    11. Jabot F,
    12. Jarne P,
    13. Joly D,
    14. Julliard R,
    15. Kéfi S,
    16. Kergoat GJ,
    17. Lavorel S,
    18. Le Gall L,
    19. Meslin L,
    20. Morand S,
    21. Morin X,
    22. Morlon H,
    23. Pinay G,
    24. Pradel R,
    25. Schurr FM,
    26. Thuiller W,
    27. Loreau M
    . 2015. Predictive ecology in a changing world. J Appl Ecol52:1293–1310. doi:10.1111/1365-2664.12482.
    OpenUrlCrossRef
  13. 13.↵
    1. Zuliani P,
    2. Platzer A,
    3. Clarke EM
    . 2013. Bayesian statistical model checking with application to Stateflow/Simulink verification. Formal Methods Syst Des43:338–367. doi:10.1007/s10703-013-0195-3.
    OpenUrlCrossRef
  14. 14.↵
    1. De Jong H
    . 2002. Modeling and simulation of genetic regulatory systems: a literature review. J Comput Biol9:67–103. doi:10.1089/10665270252833208.
    OpenUrlCrossRefPubMedWeb of Science
  15. 15.↵
    1. Fisher J,
    2. Henzinger TA
    . 2007. Executable cell biology. Nat Biotechnol25:1239–1249. doi:10.1038/nbt1356.
    OpenUrlCrossRefPubMedWeb of Science
  16. 16.↵
    1. Edwards JS,
    2. Palsson BO
    . 2000. Robustness analysis of the Escherichia coli metabolic network. Biotechnol Prog16:927–939. doi:10.1021/bp0000712.
    OpenUrlCrossRefPubMed
  17. 17.↵
    1. Thiele I,
    2. Palsson BØ
    . 2010. A protocol for generating a high-quality genome-scale metabolic reconstruction. Nat Protoc5:93–121. doi:10.1038/nprot.2009.203.
    OpenUrlCrossRefPubMedWeb of Science
  18. 18.↵
    1. Orth JD,
    2. Thiele I,
    3. Palsson BØ
    . 2010. What is flux balance analysis?Nat Biotechnol28:245–248. doi:10.1038/nbt.1614.
    OpenUrlCrossRefPubMedWeb of Science
  19. 19.↵
    1. Bordbar A,
    2. Monk JM,
    3. King ZA,
    4. Palsson BO
    . 2014. Constraint-based models predict metabolic and associated cellular functions. Nat Rev Genet15:107–120. doi:10.1038/nrg3643.
    OpenUrlCrossRefPubMed
  20. 20.↵
    1. Basler G,
    2. Nikoloski Z,
    3. Larhlimi A,
    4. Barabási AL,
    5. Liu YY
    . 2016. Control of fluxes in metabolic networks. Genome Res26:956–968. doi:10.1101/gr.202648.115.
    OpenUrlAbstract/FREE Full Text
  21. 21.↵
    1. Biggs MB,
    2. Papin JA
    . 2017. Managing uncertainty in metabolic network structure and improving predictions using Ensemble FBA. PLoS Comput Biol13:e1005413. doi:10.1371/journal.pcbi.1005413.
    OpenUrlCrossRef
  22. 22.↵
    1. Budinich M,
    2. Bourdon J,
    3. Larhlimi A,
    4. Eveillard D
    . 2017. A multi-objective constraint-based approach for modeling genome-scale microbial ecosystems. PLoS One12:e0171744. doi:10.1371/journal.pone.0171744.
    OpenUrlCrossRef
  23. 23.↵
    1. Loreau M,
    2. Naeem S,
    3. Inchausti P,
    4. Bengtsson J,
    5. Grime JP,
    6. Hector A,
    7. Hooper DU,
    8. Huston MA,
    9. Raffaelli D,
    10. Schmid B,
    11. Tilman D,
    12. Wardle DA
    . 2001. Biodiversity and ecosystem functioning: current knowledge and future challenges. Science294:804–808. doi:10.1126/science.1064088.
    OpenUrlAbstract/FREE Full Text
  24. 24.↵
    1. Raes J,
    2. Letunic I,
    3. Yamada T,
    4. Jensen LJ,
    5. Bork P
    . 2011. Toward molecular trait-based ecology through integration of biogeochemical, geographical and metagenomic data. Mol Syst Biol7:473. doi:10.1038/msb.2011.6.
    OpenUrlAbstract/FREE Full Text
  25. 25.↵
    1. Clarke EM Jr,
    2. Grumberg O,
    3. Peled DA
    . 1999. Model checking. MIT Press, Cambridge, MA.
  26. 26.↵
    1. Legay A,
    2. Delahaye B,
    3. Bensalem S
    . 2010. Statistical model checking: an overview, p 122–135. InBarringer H, et al. (ed), Runtime verification. RV 2010. Lecture Notes in Computer Science, vol 6418. Springer, Berlin, Germany. doi:10.1007/978-3-642-16612-9_11.
    OpenUrlCrossRef
  27. 27.↵
    1. Koh CH,
    2. Palaniappan SK,
    3. Thiagarajan PS,
    4. Wong L
    . 2012. Improved statistical model checking methods for pathway analysis. BMC Bioinformatics13:S15. doi:10.1186/1471-2105-13-S17-S15.
    OpenUrlCrossRef
  28. 28.↵
    1. Younes HLS,
    2. Simmons RG
    . 2006. Statistical probabilistic model checking with a focus on time-bounded properties. Inform Comput204:1368–1409. doi:10.1016/j.ic.2006.05.002.
    OpenUrlCrossRef
  29. 29.↵
    1. Kwiatkowska M,
    2. Norman G,
    3. Parker D
    . 2008. Using probabilistic model checking in systems biology. ACM SIGMETRICS Perform Eval Rev35:14–21.
    OpenUrl
View Abstract
PreviousNext
Back to top
Download PDF
Citation Tools
On the Power of Uncertainties in Microbial System Modeling: No Need To Hide Them Anymore
Benoit Delahaye, Damien Eveillard, Nicholas Bouskill
mSystems Dec 2017, 2 (6) e00169-17; DOI: 10.1128/mSystems.00169-17

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Print
Alerts
Sign In to Email Alerts with your Email Address
Email

Thank you for sharing this mSystems article.

NOTE: We request your email address only to inform the recipient that it was you who recommended this article, and that it is not junk mail. We do not retain these email addresses.

Enter multiple addresses on separate lines or separate them with commas.
On the Power of Uncertainties in Microbial System Modeling: No Need To Hide Them Anymore
(Your Name) has forwarded a page to you from mSystems
(Your Name) thought you would be interested in this article in mSystems.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
On the Power of Uncertainties in Microbial System Modeling: No Need To Hide Them Anymore
Benoit Delahaye, Damien Eveillard, Nicholas Bouskill
mSystems Dec 2017, 2 (6) e00169-17; DOI: 10.1128/mSystems.00169-17
del.icio.us logo Digg logo Reddit logo Twitter logo CiteULike logo Facebook logo Google logo Mendeley logo
  • Top
  • Article
    • ABSTRACT
    • INTRODUCTION
    • MICROBIAL STATE-OF-THE ART MODELINGS AND UNCERTAINTIES
    • NEED FOR DEDICATED MODEL-CHECKING TECHNIQUES
    • STATISTICAL MODEL CHECKING OF MICROBIAL MODELS
    • CONCLUSION
    • ACKNOWLEDGMENT
    • REFERENCES
  • Figures & Data
  • Info & Metrics
  • PDF

KEYWORDS

modeling
simulation
uncertainty

Related Articles

Cited By...

About

  • About mSystems
  • Author Videos
  • Board of Editors
  • Policies
  • Overleaf Pilot
  • For Reviewers
  • For the Media
  • For Librarians
  • For Advertisers
  • Alerts
  • RSS
  • FAQ
  • Permissions
  • Journal Announcements

Authors

  • ASM Author Center
  • Submit a Manuscript
  • Author Warranty
  • Types of Articles
  • Getting Started
  • Ethics
  • Contact Us

Follow #mSystemsJ

@ASMicrobiology

       

 

ASM Journals

ASM journals are the most prominent publications in the field, delivering up-to-date and authoritative coverage of both basic and clinical microbiology.

About ASM | Contact Us | Press Room

 

ASM is a member of

Scientific Society Publisher Alliance

Copyright © 2021 American Society for Microbiology | Privacy Policy | Website feedback

Online ISSN: 2379-5077