hypothesis testing

Even bad reviewers can be useful

Posted in hypothesis testing, practice of science, theory, writing on July 15th, 2010 by jeff – Be the first to comment

I’ve learnt my lesson for the day: even if a reviewer is just plain wrong, what you do in response can still improve the paper. And maybe even show you something new about your own data.

I’m revising a paper about my older work with plasmids. One of the reviewers, a theoretician (they wrote their review in TeX), thinks the paper “is really lacking a serious mathematical and statistical modeling effort”. And here I was happy to finally have a paper with no math in it! They don’t think it’s clear that my data support the conclusions I make, though it seems obvious enough to me. Plus, they want me to use a specific modelling method I think is seriously questionable.

At first I was upset at having to spend a bunch of time and effort responding to reviewer comments that were wrong and weren’t going to improve the paper. But then, in the process of doing some math to address a question from the other (more sensible) reviewer, I realized I could extend the math and show, quantitatively, how competing evolutionary hypotheses make different predictions about what should happen in my experiments. In the end, not only am I able to show that my data reject one hypothesis but are consistent with another, but I’m also able to explain the specific shape of my data—something I’d never even attempted to do. I’m actually surprised it fits so well.

So there you go. Score another one for peer review. It’s even better than the peers doing the reviewing.

  • Facebook
  • Twitter
  • email

A generalization of Hamilton’s rule for the evolution of microbial cooperation

Posted in conflict and cooperation, hypothesis testing, papers, publications, theory on June 24th, 2010 by jeff – Be the first to comment

Abstract: Hamilton’s rule states that cooperation will evolve if the fitness cost to actors is less than the benefit to recipients multiplied by their genetic relatedness. This rule makes many simplifying assumptions, however, and does not accurately describe social evolution in organisms such as microbes where selection is both strong and nonadditive. We derived a generalization of Hamilton’s rule and measured its parameters in Myxococcus xanthus bacteria. Nonadditivity made cooperative sporulation remarkably resistant to exploitation by cheater strains. Selection was driven by higher-order moments of population structure, not relatedness. These results provide an empirically testable cooperation principle applicable to both microbes and multicellular organisms and show how nonlinear interactions among cells insulate bacteria against cheaters.

jeff smith, J. David Van Dyken, & Peter C. Zee (2010) “A generalization of Hamilton’s rule for the evolution of microbial cooperation” Science 328: 1700-1703. [Link]

  • Facebook
  • Twitter
  • email

Being aware of your own blinders

Posted in hypothesis testing, practice of science on May 21st, 2010 by jeff – Be the first to comment

Scientists have opinions, and they are most interesting when they are controversial.  I have little patience for the pretense of a “fair and balanced view,” when we all know that balance comes out of discussions and disagreements among peers, not from the point of view of a single individual. (Pigliucci 2007 Science 31:317)

I more or less agree with this. But the same time, I think it’s important to try to recognize your own biases and try to look past them, to the extent that’s possible. I’ve always been impressed by scientists that actively seek out alternative explanations for their own data and then test those hypotheses with more data. Curt Lively is really good at this.

Why does this come up? Recently I’ve become interested in nonadaptive processes in evolution: the parts of evolution that aren’t natural selection. No, I shouldn’t say interested. More like: I’m mainly interested in selection, but if I’m going to spend all my time studying some particular phenotype of microbes, I want to know if that phenotype is a result of selection, and how.

Thinking about nonadaptive processes doesn’t come natural to me. I first got into evolution through behavioral ecology, a field that’s almost entirely about selection. But not considering the alternatives can lead you astray. The classic work here is “The spandrels of San Marco and the Panglossian paradigm: a critique of the adaptationist programme” by Gould and Lewontin. The basic idea is that not all phenotypes are adaptations; they might just be side effects of other things that are. More recently, Mike Lynch has shown that that many aspects of genome evolution have less to do with selection and more to do with mutation, recombination, and genetic drift.

So I may know that there’s more to evolution than selection, but it’s hard to just decide to think differently. And now that I come to think of it, my experience pretty much illustrate’s Pigliucci’s point. I only started thinking seriously about nonadaptive processes after talking with colleagues who have different backgrounds and different biases.

  • Facebook
  • Twitter
  • email

What DNA sequences tell us about the real world of bacteria

Posted in hypothesis testing, papers, practice of science, selfish genetic elements on March 7th, 2010 by jeff – Be the first to comment

So far, most of my research with bacteria has been experimental—experimental in the sense that I manipulate the genes or environment of bacteria in the laboratory and look at how those manipulations affect fitness, population dynamics, and evolution. One of the great strengths of experimental science is that it lets you change one variable at a time and keep everything else constant. That way, you can be sure that your results are caused by that variable and not something else. And because microbes evolve so quickly, you can use experiments to directly test the predictions of evolutionary theory. All these things are great.

One of the big disadvantages of the experimental approach, though, is that it tells you how evolution can happen—not necessarily how it does happen in the natural world. The best we can do in the lab is often still very different than an organism’s natural habitat. Experimental approaches also don’t tell you how general a result is. When you get a result, you hope that it holds for other bacteria in other environments, but there’s no guarantee that it should be so. Only by repeating those experiments in other systems do you get an idea about generality—and no one wants to perform, publish, or fund work that’s just repeating what other people did and getting the same results.

For these reasons, I’ve been becoming more interested in molecular evolution. The information in DNA and protein sequences reflects the actual evolutionary history of organisms in their real-world environment. It’s hard to observe or experiment on microbes in their natural habitat, but it’s not that hard to look at their DNA. And there’s lots of sequence data already available. Of course, sequence analysis has its disadvantages, too. Correllation is not causation, so if you see that two things are associated with each other it’s always possible that the real cause is some unknown third thing. It can also be difficult to exclude alternative explanations for results. Some people in my field feel these problems to be large and dismiss sequence-based studies as “retrospective evidence” and thus inferior to “prospective” experimental studies. But the way I see it, we have so much of this data these days—why not use it? Anything we can use to better understand out how the natural world works is a good thing, in my book. Why can’t experimental and sequence-based approaches complement each other?

This has been on my mind recently after reading an interesting paper by Fidelma Boyd, Salvador Almagro-Morenoand, and Michelle Parent.

Bacterial genomes are fluid things. Something like 30% of the genes in an E. coli cell may not even be present in the E. coli cell next to it. Often these differences in gene content are viruses laying dormant in the genome, waiting for the right trigger to emerge and find a new host. In other cases, they are clusters of genes called genomic islands that kind of look like viruses—they have a few genes with similar sequences—but don’t seem to have all the pieces necessary to make viruses on their own. What are they doing there? Microbiologists are interested in genomic islands because, aside from containing virus-like genes, they often also have genes that make bacteria more harmful or resistant to antibiotics.

Phage P2 (right) and its freeloader P4 (left). © Institute for Molecular Virology, U. Wisconson-Madison.

There are at least two possible answers. One is that genomic islands are degraded phage (viruses of bacteria). They were once infectious, but at some point mutation inactivated one or more genes necessary for that lifestyle. Now, as the mutations continue to accumulate, they’re sliding toward evolutionary oblivion and their own inevitable deletion. Another possibility is that genomic islands are mobilizeable. This means that they can’t make phage particles on their own, but they can use the proteins made by other phage in the same cell. They’re a kind of freeloader. Phage P4 is a well-known example.

How do we tell? Boyd and coauthors addressed this question using the tools of molecular evolution. If genomic islands were degraded phage, phylogenetic trees made from their protein and DNA sequences would show genomic islands scattered among the other phage. Because they’re degraded and nonfunctional, they’d be recent derivatives and wouldn’t persist long over evolutionary time. All the branches leading to genomic islands would be near the tips of the tree. If, on the other hand, genomic islands are mobilizeable and have a long evolutionary history of freeloading on self-sufficient phage, then phylogentic trees would show them clustering together on their own branch.

Boyd and coauthors made phylogenetic trees using the sequences of integrase (Int) genes from many different genomic islands and phage. They found that virtually all the genomic islands clustered together in their own branch that included P4. This evidence is consistent with the mobilizeable hypothesis and inconsistent with the degradation hypothesis. Boom—we’ve managed to exclude one hypothesis, the other one survived an empirical test, and we’ve made a tiny step forward in understanding the natural world. Science in action.

I wish Boyd and company tested another prediction of the degradation hypothesis: that degraded phage should show evidence of relaxed selection. Once phage get inactivated, natural selection no longer weeds out harmful mutations in their sequences. One kind of evidence for relaxed selection is a larger fraction of pseudogenes—sequences of DNA that once used to be genes but are now prematurely truncated or shifted so that they no longer make functional proteins. Another is that more of the DNA sequence changes should cause differences in the protein sequence (dN/dS, for those who know such things). Not finding these things, or at least putting lower limits on how much they occur, would be another strike against the degradation hypothesis and more support for the mobilizeable hypothesis. The data’s already there—the analysis just needs to be done.

It’s also wierd that this paper is published as a review article rather than a peer-reviewed results paper in a molecular evolution journal. Because it’s not, and because the paper glosses over many of the details of the phylogenetic analysis, I find myself taking the results with a grain of salt. Hopefully this work can at some point be redone or extended at some point so I can be more confident in the results.

In any case, this is an example of how sequence analysis lets us get at an evolutionary question—how does natural selection act on genomic islands?—that can’t be answered by experiments alone. We need both types of data. The experiments show us that mobilization can happen and the sequences show us that these elements have been persisting and evolving just fine without their own phage-producing genes.

  • Facebook
  • Twitter
  • email

Open questions in microbial cooperation

Posted in conflict and cooperation, hypothesis testing on December 10th, 2009 by jeff – Be the first to comment

While putting my Myxo work together into a talk, and trying to present it all with some semblance of coherence, I had the opportunity to think about where the evolution of microbial cooperation is as a field and where I think it should go.  The way I see it, the most important open are these:

Is shared genes the primary evolutionary mechanism maintaining cooperation in microbes? By shared genes I mean that the benefits of cooperation are preferentialy experienced by individuals who also share the alleles for expressing the cooperative trait.  This process can be described as kin selection or group selection.  Shared genes is widely thought to be the primary mechanism for the evolution of cooperation in animals—is it true for microbes, too?  And what role do other mechanisms like enforcement, direct benefits, or pleiotropic constraint play?

What is the primary cause of genetic correlations among individuals? Limited dispersal, kin recognition, green-beard genes, infectious gene transfer, or something else?  Do cooperative traits themselves create genetic correlations through their effect on migration and motility?  The important part of these questions is getting at what IS happening, not just what CAN happen.

How does social evolution shape microbial traits? Many traits seem to involve interactions between individuals (quorum sensing, biofilms, and so on), but are these traits cooperative in the evolutionary sense of increasing the fitness of other individuals?  How does the magnitude, regulation, or form of these traits differ from that what they would evolve to be if they did not have social effects?  To what extent do microbes actively alter their behavior in response to social conditions?  Which traits are adaptations and which are only side-effects of some other function?

How do social traits change over evolutionary time? Are social traits under stabilizing selection or do they evolve in evolutionary arms races?  How often are they lost?  If cheaters occur in natural habitats, do they persist because of selection or recurrent mutation?

What are the origins of microbial cooperation? What traits were co-opted into becoming the building blocks of cooperation?  Worker behavior in social insects, for example, is a modified form of maternal behavior.  Are the benefits of cooperative traits the same now as they were originally?  How many times have similar cooperative traits originated?  Are cooperative traits usually acquired by horizontal gene transfer or invented de novo?

  • Facebook
  • Twitter
  • email