Tuesday 1 February 2011

Exercise may be good for you, but it doesn’t boost your memory

“Moderate exercise such as walking boosts memory power” claims the BBC.

“Exercise in middle age can improve your memory” says the Daily Mail.

“Older adults improve memory through exercise” reports CNN.

“Want to improve your memory? Take a walk” invites Time.

These are just some of the many headlines today resulting from the publication of a paper in Proceedings of the National Academy of Sciences (PNAS) entitled “Exercise training increases size of hippocampus and improves memory”, by Kirk Erickson from the University of Pittsburgh and colleagues from the University of Illinois. You can access the abstract of the article here, although you may need to pay to read the whole paper.

The authors of the article have provided helpfully excited quotes in many of the news stories.  For example, senior author Art Kramer, from the University of Illinois, was quoted as saying “even modest amounts of exercise ... can lead to substantial improvements in memory.”  Exciting findings indeed!

In the study, 120 older adult volunteers were randomly assigned to an aerobic exercise group or a stretching control group. Participants in the exercise group undertook supervised sessions of moderate intensity walking for 40 min each day, three days per week for one year.  Those in the stretching control group were trained in various stretching and muscle toning exercises over a similar period.  At the start, middle and end of the intervention, structural MRI scans were obtained, and participants undertook a computerized spatial memory task.

The MRI scans revealed that volume of the hippocampus, a brain area known to be important for spatial memory, increased by around 2% in the exercise group participants over the one-year period.  Hippocampal volumes of participants in the stretching control group diminished by around 1.4% over the same period, as would be expected through age-related decline.

However, as illustrated by the headlines above, minor increases in volume of a brain structure with exercise appear to be less newsworthy than the suggestion that such exercise might “boost memory power”.  A common worry among older adults is that forgetfulness, which may seem to be increasingly pervasive as years go by, will eventually result in the loss of their precious store of memories.  If exercise really could “boost memory”, and potentially alleviate age-related memory decline, this would indeed be big news.  Thus, it is this claim that is worth looking at more closely.

Unfortunately, to find the data on this issue, one has to study the paper very closely indeed, because the authors have not made it particularly easy to locate.  However, buried in the text of the results section and in one row of a complex data table, one can read that the exercise group did indeed show increases in memory performance over the year period, going from an average score of 85.9% at the start of the intervention to 88.2% after 12 months, a 2.3% mean difference.  However, the suggestion that the exercise regime was responsible for this “memory boost” is rather undermined by the observation that the stretching control group showed a 3.7% mean increase in their memory performance over the same period.

In other words, the exercise group did not show any increase in memory performance relative to the control group.  Both groups showed similar small increases in spatial memory scores over the three testing sessions, which may be attributable to the well-known beneficial effects of practice when performing the same task repeatedly.

The fact that memory performance in the exercise group was no different to that achieved by the control group is a critical flaw in this study, and severely undermines the claims made throughout the paper, from the title onwards, that exercise training boosts memory.  For example, in the abstract the authors state that “exercise training ... is accompanied by improved memory function.”  Notably, in the abstract, discussion and main figures, no mention is made of the statistically identical memory boost in the control group.  Indeed the main figure only displays memory data from the exercise group, “because it was the only group that showed an increase in volume across the intervention”, according to the figure legend.  Why not show the data from both groups?  Presumably because the control group’s data would reveal a negative correlation between hippocampal volume and memory scores, weakening the authors’ claims considerably.

Thus, this appears not to be a story about misrepresentation of research by journalists, although there is much evidence that such errors do occur.  Rather, it seems to be an example of the scientists involved in the research “talking up” their findings for the press and even, perhaps, obscuring the true nature of the results in the journal article.

One can also question the quality of the peer review and editorial control process in a journal that published such obviously flawed research.  It is worth noting that the article states that it “had a prearranged editor”, in this case Fred Gage from the Salk Institute.  There have been a number of previous discussions about the quality of the research published in PNAS (see e.g., here), mostly relating to a former article submission method, in which members of the National Academy of Science (NAS) could “arrange” publication of papers from non-members each year.  Although this submission track no longer exists, the journal maintains the option for authors to “prearrange” for an NAS member to edit their article.  It may well be the case that the editorial process in this instance was conducted with total care and probity.  As a general point, though, it is difficult to believe that the “prearranged editor” option can be as impartial and rigorous as one might wish to be the case.

To sum up, the findings presented in this article do not support the notion that exercise will boost your memory, or will stop age-related memory decline.  Whereas, of course, it won't hurt anyone to do more exercise, it is unfortunate that potentially vulnerable older people may be misled by this article and its attendant news coverage into thinking that the exercise will cure their memory problems.

9 comments:

  1. excellent summary and fair comment!

    ReplyDelete
  2. Thanks for this excellent summary!

    ReplyDelete
  3. We must have read different articles. I see clear cut evidence in favor of the aerobic exercise. Re this being an invited article, Art Kramer is "the man" in this field and his research has set the gold standard for plasticity work. Nevertheless, I am certain this was peer reviewed in an impartial manner. I often agree with the charge you made about media hype over questionable research, but I don't understand how you reached your conclusion in this case.

    ReplyDelete
  4. @Susan - thanks for your comment. I agree entirely that the evidence indicating that aerobic exercise is associated with increased anterior hippocampal volume is clear and, to my mind, a very interesting result. The data demonstrate an interaction between group (exercise vs control) and volume, confirming that the effect is not simply due to other possible confounding factors associated with being enrolled in a research study. This is a strong finding, and I certainly do not dispute that.

    The point I tried to make in this post was that the authors, and as a result the media, went further than that, trying to claim that their data demonstrate that the exercise regime also led to improved memory. As I detail in the post, I don't think that they have demonstrated this point satisfactorily, because the control group showed a statistically identical increase in memory scores to the exercise group over the course of the intervention (see page 3, paragraph 2 of the paper). If the memory improvement in the exercise group was no different to that of the control group, then exercise is unlikely to be a sufficient explanation and, as I discuss, an account in terms of practice effects may be more likely.

    Thus, if the authors had confined themselves to talking about the plasticity results (which I agree are very interesting), I would have had no problem with the paper. Unfortunately, however, in making the claims about exercise increasing memory performance, which are there throughout the paper and were the main focus of most media reports, I think a misleading picture has been painted. It may well be true that exercise improves memory, but in my opinion these data don't demonstrate that.

    ReplyDelete
  5. Thank you very much for this great post Simons.

    ReplyDelete
  6. I am glad that there is so much discussion on exercise.Needed to know the merits..I insist my child to play outdoors and exercise to make his healthy habits and break away from the technological gizmo's he is attached to.

    ReplyDelete
  7. I think there are more tests that prove that your memory can be improved by exercise but I've noticed that most of those tests show results that are very short term. They give people or animals a test, have them run for 30 minutes then test them again. Maybe you just can't get long term improvements from exercise.

    ReplyDelete
  8. Excellent read, I just passed this onto a colleague who was doing a little research on that. And he actually bought me lunch because I found it for him smile So let me rephrase that.

    ReplyDelete