ABSTRACT
Most bacteria and archaea are infected by latent viruses that change their physiology and responses to environmental stress. We use a population model of the bacterium-phage relationship to examine the role that latent phage play in the bacterial population over time in response to antibiotic treatment. We demonstrate that the stress induced by antibiotic administration, even if bacteria are resistant to killing by antibiotics, is sufficient to control the infection under certain conditions. This work expands the breadth of understanding of phage-antibiotic synergy to include both temperate and chronic viruses persisting in their latent form in bacterial populations.
IMPORTANCE Antibiotic resistance is a growing concern for management of common bacterial infections. Here, we show that antibiotics can be effective at subinhibitory levels when bacteria carry latent phage. Our findings suggest that specific treatment strategies based on the identification of latent viruses in individual bacterial strains may be an effective personalized medicine approach to antibiotic stewardship.
INTRODUCTION
A worldwide growth of antibiotic resistance threatens the efficacy of antibiotic treatments for common infections, driving medical professionals to seek alternative treatments (1). Infections by Pseudomonas aeruginosa alone represent about 10% of nosocomial infections, are a leading cause of death among patients with cystic fibrosis (CF), and have been deemed a serious threat on the United States Centers for Disease Control and Prevention watch list for antibiotic resistance (2–4). Despite the increasing trend of multidrug resistance, antibiotic regimes remain the consensus first treatment for P. aeruginosa infection (5). As a last resort and as an attempt to prevent the evolution of resistance in P. aeruginosa, clinicians have turned to combination therapies (6) with bacteriophage (viruses) and antibiotics to treat recalcitrant bacteria.
Synergy between phage and antibiotic treatment (PAS) is now rising in interest for treatment of P. aeruginosa and other recalcitrant bacteria (7–9). Combination phage therapy uses viruses that kill bacteria (often in phage cocktails) and different types of antibiotics either at the same time or in series to clear bacteria and prevent the evolution of new resistant phenotypes (10–18). Although preexisting proviruses are highly prevalent in P. aeruginosa infections and appear to be induced by certain antibiotic treatments, synergy has not been considered in the context of temperate virus induction. Here, we investigate the role that phages play during antibiotic treatment when they are already present in the system. We show that, even without deliberate phage therapy, phages may play a critical role in antibiotic treatment, especially if the bacteria are antibiotic resistant.
Background.Bacteriophages are viruses that infect bacteria and hijack cell functions in order to reproduce. Just as bacteria have evolved many strategies to evade infection, phages have developed multiple strategies to circumvent cell defenses. Phages can be characterized by their lifestyles (obligately lytic, temperate, or chronic) within the host (19). Lytic viruses replicate within the host and kill host cells by bursting them open to release new particles. Temperate viruses have a lytic cycle but can also integrate into host genomes, where they remain latent until they are induced to replicate (19). In chronic infection, productive host cells shed new phages that bud from the cell without killing the bacterium (20). Both temperate and chronic viruses have a lysogenic (latent lytic or latent chronic) cycle in which phage DNA is incorporated into the bacterium’s genome, and the cell transmits the phage’s genetic material (prophage) to daughter cells vertically (21).
Comparative genomics among closely related bacterial strains has uncovered a plethora of proviruses of both temperate and chronic lifestyles (22–24). The large genome of the opportunistic pathogen P. aeruginosa is no exception (25–27). Each sequenced strain reveals multiple proviral genomes of both the temperate and chronic lifestyles, each in both active and inactive (latent) forms (28). These proviruses change bacterial fitness and environmental response, sometimes conferring competitive advantage, virulence, and antibiotic resistance (29–32).
Stressful environmental conditions (e.g., radiation, heat, and sublethal antibiotics) may trigger the cell to induce latent prophage and begin phage production (33–37). The induction of such latent phages is proposed to be one of the mechanisms behind the synergistic effect of antibiotics and phage infection (37, 38). The environmental conditions, especially dynamic antibiotic dosing regimes, under which these phage types may coexist are not well understood. We therefore develop a population model to understand the impact of antibiotics on the bacterium-phage system with multiple phage strategies and antibiotic resistance. We address conditions under which the bacterium-phage-antibiotic ecosystem results in control of the bacterial infection (14).
Previous work.Many mathematical models of bacterium-phage systems exist at various levels of complexity. The simplest models include only one phage strategy (lysis); in this simple scenario, either all bacteria are affected by the phage (39) or some bacteria are resistant to infection (40). More complex models study the competition between two different phage strategies, such as lysis and lysogeny (41) or lysis and productive chronic infection (42). The scope of many studies is extended to also include interactions among bacteria, phages, the host’s immune response, and/or antibiotic treatment. The immune response and antibiotic agent have been modeled implicitly by modifying the rates of change of bacteria and phages (40) or explicitly by adding compartments governing antibiotic and immune response rate of change (43–45).
Other distinctions among models of bacterial infections can be made based on how bacteria reproduce. Mechanistic models incorporate a limited nutrient as an additional compartment (45–47), while more phenomenological models assume that bacteria grow logistically (39, 41, 48, 49). Furthermore, many models are used to study bacterial evolution of resistance to either phages (45, 47) or antibiotics (50). These models are either deterministic (47) or stochastic (45, 50).
Phage and antibiotic synergy has been investigated experimentally using phage isolated from wastewater or other sources. Attention has primarily been paid to the breadth of killing that lytic phage exhibit on a diversity of P. aeruginosa strains, while little attention has been given to other parts of the phage lifestyle. Accordingly, models for phage-antibiotic synergy incorporate only the killing aspects of viruses (14). These models suggest that pretreatment with phage decreases the bacteria to a low-enough level that antibiotics can extinguish bacterial populations; they do not yet consider potential for phage to spread within a population and be induced by antibiotic treatment at a later time.
Consideration has been given to the impact of antibiotic treatment on the mobilization of temperate phage genetic material (including antibiotic resistance genes) between cells via transduction (51, 52). However, to our knowledge, no mathematical models of bacterium-phage interaction have analyzed the competition between temperate and chronic phage strategies in an environment with pulses of antibiotic stress, as would happen during treatment. Filling this knowledge gap is critical to understanding the impact of antibiotic treatment on a patient infected with the bacterium P. aeruginosa.
RESULTS
First, we examine the model without antibiotic administration. Without external stress, the bacterial population eventually stabilizes at carrying capacity, with doubly infected productive bacteria dominating the population (Fig. 1). Because we have assumed that infection by one phage type does not prevent infection by a different type (i.e., no cross-infection exclusion) and that coinfection does not impose a fitness cost on bacteria, eventually all bacteria are infected with both phages.
Simulation of population dynamics with no antibiotic administration: bacterial population (a) and free phage population (b). Without antibiotics, the dominant bacterial strain is producing chronic virus while also latently infected with temperate phage
Productive bacteria dominate the population because, initially, populations of bacteria latently infected with temperate phage increase faster than those latently infected with chronic phage due to the early rapid proliferation of temperate phage. Subsequently the productive strains dominate since they are formed at a much higher frequency on secondary infection than either latent infection. With a substantial population of chronically infected bacteria producing phage at steady state, the ratio of free chronic phage to bacteria stabilizes at approximately 10:1. Although little is known about the proportion of phage types seen in either clinical or wild settings, it is known that both temperate and chronic strains are often found in the same environment (53). Figure 2 shows a visualization of the dominant path through the model system without antibiotics.
Full flowchart of bacterium-phage system, corresponding to model system (equations S1 to S15 in Text S1), with results superimposed. The dominant path through the model compartments without antibiotics is shown in blue, while the dominant path with periodic antibiotic dosing is shown in red. Skull sketch courtesy of Dawn Hudson (CC0).
TEXT S1
Copyright © 2019 Clifton et al.This content is distributed under the terms of the Creative Commons Attribution 4.0 International license.
Antibiotic treatment.Next, we examine the model where all bacteria are sensitive to antibiotics (i.e., bacteria are not resistant to the antibiotic’s intended killing mechanism, namely, inhibiting bacterial DNA replication [54]) using baseline parameter values (see Table 2). For the purpose of illustration, we choose the period of antibiotic treatment T = 7.3, which is one antibiotic dose every 24 h; this is a typical clinical dosing protocol (55). When all bacteria are sensitive to antibiotics, periodic administration of antibiotic leads to periodic dips in bacterial populations and periodic spikes in induced free phage (Fig. 3). During antibiotic treatment, the total bacterial population remains well below the carrying capacity, and the ratio of free phage to bacteria is around 20:1 on average and about 30:1 at most. These values are consistent with existing studies of bacterium-to-phage ratios (28, 56).
Simulation of population dynamics with no antibiotic resistance: bacterial population (a) and free phage population (b). All bacteria and phage types are described in Table 1. All parameter values are taken from the baselines in Table 2, with hη = 1/2, hβ = 1, hγ = 1 (see Text S2 in the supplemental material for more details). Antibiotics are administered periodically every T = 7.3 bacterial reproductive cycles (once-daily dose). Note that both axes are linear, not logarithmic. Initially, S(0) = 1e−3, VT(0) = VC(0) = 1e−7, according to the work of Sinha et al. (41).
TEXT S2
Copyright © 2019 Clifton et al.This content is distributed under the terms of the Creative Commons Attribution 4.0 International license.
Figure 1 shows that without antibiotic administration, productive bacteria that are latently carrying the temperate phage are the dominant bacterial strain due to their high frequency of formation in early stages. With each antibiotic dose, the productive bacteria are replaced with strains doubly infected by latent phage, which eventually dominate the system (Fig. 3). This phenomenon occurs because most bacteria that are latently infected with temperate virus (including
To control an infection, there are two primary parameters that can be independently varied: antibiotic administration period T and antibiotic efficacy κ. The antibiotic dosing period and deadliness required to control an infection depend on other model parameters, especially the amplitude of stress caused by antibiotics and the metabolic decay rate of the antibiotic (Fig. 4). Antibiotics must be administered more frequently if antibiotics are less effective at killing bacteria either directly or via induced lysis, or if antibiotics are metabolized more quickly (Fig. 4a). On the other hand, antibiotics must be more effective in order to control an infection if antibiotics are administered less frequently, if antibiotic stress induces lysis less effectively, or if antibiotics are metabolized more quickly (Fig. 4b). See Text S2 in the supplemental material for technical details on the sensitivity analysis.
Sensitivity of the antibiotic dosing period T required to control the infection (a) and the antibiotic deadliness κ required to control the infection (b). The sensitivity analyses use Latin hypercube sampling (LHS) of parameter space and partial rank correlation coefficients (PRCC) (92). Infection control is an average total bacterial population below 10% of carrying capacity over 300 bacterial reproductive cycles. All parameter values are taken near the baselines in Table 2, with hη = 1/2, hβ = 1, hγ = 1. Initially, S(0) = 1e−3, VT(0) = 1e−7, VC(0) = ratio IC × 1e−7. The number of simulations is n = 150. Asterisks indicate significance (***, P < 0.001; no asterisks, P > 0.05). See Text S2 in the supplemental material for technical details.
Antibiotic resistance.If all bacteria are resistant to antibiotics (κ = 0), then the population dynamics are qualitatively similar to those when bacteria are sensitive to antibiotics. In both cases, antibiotic administration causes doubly latently infected bacteria to dominate the system. However, when all bacteria are antibiotic resistant, the total bacterial population and phage populations are noticeably larger (Fig. 5).
Simulation of population dynamics with complete antibiotic resistance: bacterial population (a) and free phage population (b). All bacteria and phage types are described in Table 1. All parameter values are taken from the baselines in Table 2, with hη = 1/2, hβ = 1, hγ = 1, and κ = 0 for all bacteria (see supplemental material for more details). Antibiotics are administered periodically every T = 7.3 bacterial reproductive cycles (once-daily dose). Initially, S(0) = 1e−3, VT(0) = VC(0) = 1e−7, according to the work of Sinha et al. (41).
Pharmacological implications with antibiotic resistance.The main concern when treating an infection with antibiotics is the size of the bacterial population. Therefore, we investigate the total bacterial population under a range of antibiotic dosing frequencies (Fig. 6). We compute the average total bacterial population over the first 300 bacterial reproductive cycles (40.8 days), and we find that both antibiotics and temperate phage are critical to controlling the infection and work synergistically even when bacteria are antibiotic resistant. We define infection control to be an average bacterial population less than 10% of carrying capacity (i.e., 1-log decrease in bacterial levels compared with placebo).
Average total bacterial population for a range of periodic antibiotic dosing protocols. All parameter values are taken at the baselines in Table 2, with hη = 1/2, hβ = 1, hγ = 1, tmax = 300 (see the supplemental material for more details). Solid lines indicate that all bacteria are sensitive to antibiotics, and dashed lines indicate that all bacteria are resistant. Note that the vertical axis is logarithmic, while the horizontal axis is linear. Nondimensional units are supplemented with standard units parenthetically. Initially, S(0) = 1e−3, VT(0) = VC(0) = 1e−7, unless otherwise noted.
If only chronic phage are present in the system (see Fig. S1a in the supplemental material), effective antibiotics are required to control the infection. If all bacteria are sensitive to antibiotics, the presence of chronic phage controls the infection slightly better than if there are no chronic phage due to the cost of production during productive infection.
FIG S1
Copyright © 2019 Clifton et al.This content is distributed under the terms of the Creative Commons Attribution 4.0 International license.
If only temperate phage are present in the system (Fig. S1b), infection is controlled even when bacteria are resistant. In fact, the efficacy of temperate phage alone is similar to the efficacy of antibiotics alone. With both effective antibiotics and temperate phage, the number of antibiotic doses required to keep the infection under control is cut in half compared with antibiotics alone or temperate phage alone.
If both phages are present in the system (Fig. 6), infection control is marginally better than if only temperate phage are present (Fig. S1b). These results demonstrate the synergy between temperate phage and antibiotics even in resistant populations. No deliberate combination therapy may be needed to treat these infections because temperate phage are commonly found in natural populations of P. aeruginosa bacteria (53).
DISCUSSION
The model presented here shows that temperate phage infection makes antibiotic treatment of bacterial infections both more effective and more efficient, whether or not the bacteria are susceptible to the antibiotics. When bacteria are sensitive to antibiotics, then antibiotic treatments need not be as frequent if temperate phage are present. Even if some or all bacterial strains are antibiotic resistant, antibiotics may still be able to control the infection in the presence of phages by triggering phage induction and cell lysis. For the rest of the discussion, we will assume that an infection is controlled if the average total bacterial population remains below 10% of carrying capacity over 300 bacterial reproductive cycles; in clinical terms, control is a 1-log difference between P. aeruginosa density in sputum for patients given antibiotics versus placebo over 40.8 days.
For P. aeruginosa bacterial infections that respond to antibiotics, the model predicts that standard antibiotic doses need to be administered approximately every 12.1 h if no phage are present but only once every 25.1 h if temperate phage are present (Fig. 6). If bacteria are all antibiotic resistant, then temperate phages are required to control the infection, and antibiotic dosing is required every 12.6 h to sufficiently induce lysis.
These findings are consistent with clinical evidence; patients with cystic fibrosis (CF) given aerosolized levofloxacin twice daily experienced a nearly 10-fold decrease in P. aeruginosa density (our definition of infection control) over the treatment period compared with the placebo group (57). The study did not investigate the presence of phage but did note that approximately 60% of P. aeruginosa isolates showed resistance to levofloxacin, supporting our prediction that dosing should fall between once and twice daily depending on the susceptibility of the bacteria to antibiotics. Our findings are also consistent with existing antibiotic dosing protocols; although aerosolized quinolones are no longer approved for CF patients, intravenous (i.v.) and oral doses are commonly recommended on a once-, twice-, or three-times-daily schedule (55, 58).
While chronic phages are marginally beneficial in controlling infections, they are not able to control an infection without either temperate phages or effective antibiotics. In fact, chronic phages may actually inhibit control of infections by disrupting the human immune response (59, 60), a detail not yet incorporated into our model.
Like all models, our model has limitations. In the interest of simplicity, we have ignored the possibility of multiple infections by the same phage type. However, many phages that infect P. aeruginosa produce superinfection exclusion proteins that effectively prevent multiple infections by the same phage type (61, 62). We also do not include the exclusion of one phage type by the other. Little is known about cross-resistance to phage infection; it is often assumed to be uncommon, but including cross-resistance may dramatically impact the model predictions. If cross-resistance is in fact common, it is possible that phage-antibiotic synergy breaks down for some range of model parameters; we leave this analysis for future study.
Also, our model assumes that antibiotics induce phage, so this model is applicable with only quinolone antibiotics like levofloxacin and ciprofloxacin (34). However, drugs from this class of antibiotics are commonly used to treat P. aeruginosa infections (57, 63).
In addition, some phage are able to detect bacterial population density, which appears to affect the frequency of lysogeny (64, 65). If this process applies to P. aeruginosa and its phages, a more sophisticated model would incorporate a density-dependent latency probability: fT(Btot) and fC(Btot).
The model additionally assumes that bacteria resistant to antibiotics are still susceptible to lysis via phage induction, but this phenomenon depends on the mechanism of antibiotic resistance. There are many mechanisms of resistance to quinolones and fluoroquinolones. However, subinhibitory concentrations of several antibiotics are known to induce SOS but not result directly in cell death (34, 61, 66–68). Therefore, we model the impact of phage induction on P. aeruginosa population size with and without antibiotic resistance.
Because this model does not include an evolutionary dynamics component, the results presented here are applicable only to acute exacerbations. If bacterium/phage evolution were integrated into this model, it might be able to explain longer-term dynamics seen in chronic infections in humans (28).
Also, all latent chronic infection states are final such that virus production cannot be induced by stress. We believe that changing the model structure to accommodate chronic phage induction might change the number of productive bacteria but would not change the overall impact of antibiotic synergy, which primarily occurs with temperate infections.
Finally, the quantitative results presented in Fig. 6 depend significantly on how effective antibiotics are at killing bacteria directly versus killing via phage induction (κ in our model). To our knowledge, no study has experimentally measured the relative number of bacteria killed by the intended antibiotic mechanism versus phage induction, so we assume that antibiotics kill via each method equally quickly. If antibiotics directly kill bacteria much more quickly (κ > 1), then antibiotic resistance is more detrimental to infection control than lack of phages. If antibiotics trigger phage induction much more quickly (κ < 1), then a lack of phages is more detrimental to infection control than antibiotic resistance. Experimental work is needed to determine a reasonable range for κ and test whether it is an evolvable trait.
Conclusion.Antibiotic resistance threatens the efficacy of standard treatments for many dangerous and common infections. Using P. aeruginosa infections as motivation, we present a theoretical case for using antibiotics that trigger phage induction (e.g., quinolones) to treat bacterial infections. We show that if bacteria are antibiotic resistant, then using antibiotics in the presence of phages can still control the infection. If bacteria are susceptible to antibiotics, then the presence of phages allows for less-frequent antibiotic dosing, which reduces the risk for antibiotic resistance in the future. In either case, the natural presence of phages in bacterial populations allows for more effective treatment of common bacterial infections. These, strain-dependent responses to antibiotics suggest the importance of personalized medicine approaches to treatment of infectious disease.
As a final perspective, we remember that phage induction and bacterial death may occur across the microbiome of individual hosts treated with antibiotics. The impact of these dynamics in a community context must be considered carefully for the stability of the microbiome ecosystem as a whole.
MATERIALS AND METHODS
Modeling framework.Consider a system of two competing types of bacteriophage (e.g., see references 41 and 42): one temperate phage VT with lytic and latent lytic stages and one chronic phage VC with productive and latent stages. During the productive phase of the chronic lifestyle, phage particles are released through budding and do not kill the host bacterium. Each phage attacks one strain of bacteria that is initially susceptible to infection by either phage type. Figure 7 shows an overview of the process; Fig. 8 shows the complete modeling framework.
Flowchart of bacterium-phage system with both temperate (orange) and chronic (blue) phages. Boxes indicate a bacterial state, and arrows indicate an infection by phage. If a bacterium is infected by temperate phage, the probability of going latent lytic is fT. If a bacterium is infected by chronic phage, the probability of becoming latent chronic is fC. Skull sketch courtesy of Dawn Hudson (CC0).
We assume the total bacterial population Btot grows logistically at a rate γ to a carrying capacity K (69). Each phage infects susceptible bacteria S at a rate η. Bacteria infected by the temperate phage VT will either become latently infected LT with probability fT or will enter a lytic state IT with probability (1 − fT). Bacteria in the lytic state produce phage and burst (with burst size βT) at a rate δ. (This modeling choice circumvents the necessity of a delay differential equation.) While in the lytic state, the phage hijacks cell functions, and the cell cannot reproduce (70, 71). Bacteria do not move between lytic and latent states unless there is a perturbation or stress to the system where viruses are induced.
Bacteria infected by the chronic phage VC will either become latently infected LC with probability fC or will enter a preproductive state IC with probability (1 − fC). Bacteria in the preproductive state stop reproducing and prepare to manufacture phage with delay rate δ. After the production delay, the preproductive bacteria enter the productive state PC, continue reproducing at a potentially reduced rate λγ, and begin producing phage at a rate βC without cell death (72). As above, after chronic phage enter the latent or productive state in a cell, they will not change state. Latent chronic phage cannot be induced by stress to become productive; however, productively infected strains produce more phage under stress and reproduce more slowly. We note that biologically, productively infected strains can revert to latent infection and latent hosts can induce chronic virus production.
Once a bacterium is infected, we assume that it will exclude superinfection by the same phages but may be infected by phages of the other type (73). If a bacterium that is latently infected by the temperate phage is additionally infected with the chronic phage, the bacterium will either become latently infected with both phages
Similarly, if a bacterium that is latently infected with a chronic phage is infected with the temperate phage, it will either become latently infected
If a productive bacterium is then infected with the temperate phage, the bacterium will become latently infected with temperate phage
As shown in Fig. 7, without the addition of new susceptible bacteria, this infection process results quickly in a population of cells that phenotypically are either doubly infected by both phages in the latent state or producing the chronic virus and latently infected with temperate phage.
Infection.Many models of bacterium-phage interaction assume that a mass action process governs infection (41, 44), but P. aeruginosa-phage infection rates are not well approximated by a mass action process (74, 75). More realistically, infection rates decrease as population growth activates quorum-sensing and biofilm formation (76). One way to accommodate this infection process is to replace a mass action term with a Michaelis-Menten or Hollings type II functional response. In this case, all infection and absorption rates are proportional to the nonlinear response
Sketches of the functions for infection r(V,B) with phage density V = 10 (a), antibiotic stress s(t,{ti}) with {ti} = {5,15} (b), phage production b(s) (c), and cell reproduction multiplier g(s) (d). Parameter values are taken from the baselines in Table 2.
Antibiotics.Because patients infected with P. aeruginosa are typically treated with antibiotics at the time of bacterial detection (77, 78), we must incorporate the effects of antibiotic doses administered at times ti on the bacterium-phage ecosystem. We assume that system stress spikes at times ti (when antibiotics become bioavailable) and decays exponentially, consistent with typical antibiotic metabolism in the human system (79–81). The functional form of stress is then
When the system is stressed, the following three processes occur. (i) Bacteria that are susceptible to the antibiotics die at a rate proportional to the amount of antibiotic in the system (82). If certain strains of bacteria are resistant to antibiotics, then they will not be killed directly by antibiotics (83–85). (ii) Bacteria that are infected by temperate phage induce phage production at a rate equal to the stress (34, 86, 87). In other words, stress measures the rate at which latent lytic bacteria induce phage. Note that not all antibiotics induce phage (34), so we focus only on the types of antibiotics known to do so (e.g., quinolones like levofloxacin and ciprofloxacin) (8, 88). We assume that even antibiotic-resistant bacteria induce viruses in the presence of antibiotics, which has been demonstrated for several classes of antibiotics (34, 61, 66–68). (iii) Productive bacteria increase phage production and decrease cell reproduction (89, 90). A simple way to incorporate increased phage production during system stress is with a Hollings-like functional response. With no system stress, the phage production rate is βC, and with increasing system stress, the phage production rate saturates at βmax:
Similarly, a simple way to incorporate decreased cell reproduction during system stress is with a Hollings-like functional response. With no system stress, the cell reproduction rate is λγ, and with increasing system stress, reproduction slows by a factor of g(s), and the cell eventually stops reproducing:
Tables 1 and 2 show variable and parameter definitions, respectively. See Text S2 in the supplemental material for a discussion on parameter selection. See equations S1 to S15 in Text S1 for the dynamical systems model.
Description of model variables in bacterium-phage systema
Description of model parameters in bacterium-phage systemm
Data availability.All software (Matlab.m files) is publicly available from the Illinois Data Bank at https://databank.illinois.edu/datasets/IDB-9721455 (91).
ACKNOWLEDGMENTS
This work was funded in part by the National Science Foundation grant DMS-1815764 (Z.R.), the Cystic Fibrosis Foundation grant WHITAK16PO (R.J.W.), an Allen Distinguished Investigator Award (R.J.W.), and National Institutes of Health grant R37 AI83256-06 (G.A.O.). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
The authors declare no competing interests.
FOOTNOTES
- Received April 1, 2019.
- Accepted August 30, 2019.
- Copyright © 2019 Clifton et al.
This is an open-access article distributed under the terms of the Creative Commons Attribution 4.0 International license.
REFERENCES
- 1.↵
- 2.↵
- 3.↵
- 4.↵
- 5.↵
- 6.↵
- 7.↵
- 8.↵
- 9.↵
- 10.↵
- 11.↵
- 12.↵
- 13.↵
- 14.↵
- 15.↵
- 16.↵
- 17.↵
- 18.↵
- 19.↵
- 20.↵
- 21.↵
- 22.↵
- 23.↵
- 24.↵
- 25.↵
- 26.↵
- 27.↵
- 28.↵
- 29.↵
- 30.↵
- 31.↵
- 32.↵
- 33.↵
- 34.↵
- 35.↵
- 36.↵
- 37.↵
- 38.↵
- 39.↵
- 40.↵
- 41.↵
- 42.↵
- 43.↵
- 44.↵
- 45.↵
- 46.↵
- 47.↵
- 48.↵
- 49.↵
- 50.↵
- 51.↵
- 52.↵
- 53.↵
- 54.↵
- 55.↵
- 56.↵
- 57.↵
- 58.↵
- 59.↵
- 60.↵
- 61.↵
- 62.↵
- 63.↵
- 64.↵
- 65.↵
- 66.↵
- 67.↵
- 68.↵
- 69.↵
- 70.↵
- 71.↵
- 72.↵
- 73.↵
- 74.↵
- 75.↵
- 76.↵
- 77.↵
- 78.↵
- 79.↵
- 80.↵
- 81.↵
- 82.↵
- 83.↵
- 84.↵
- 85.↵
- 86.↵
- 87.↵
- 88.↵
- 89.↵
- 90.↵
- 91.↵
- 92.↵
- 93.
- 94.
- 95.
- 96.
- 97.
- 98.
- 99.
- 100.
- 101.
- 102.
- 103.
- 104.
- 105.
- 106.
- 107.
- 108.
- 109.
- 110.