Coffee is good for you — no, it’s bad. Epidemiological studies can come up with some crazy results, causing some critics to wonder if they’re really worthwhile.
Drinking Coffee With Sugar Boosts Brain Power, Memory
By Deborah Huso
Nov 29th 2010
Can that morning cup of coffee increase your attention span, memory, judgment and reasoning throughout the day? Iif you’re a regular java consumer, you likely already thought so, but a recent study conducted at the University of Barcelona seems to confirm the fact.
Forty subjects recently participated in a study to reveal if caffeine and glucose can have beneficial effects on cognitive performance.
Participants in this study were right-handed, healthy, low caffeine-consuming subjects who received one of the following beverages: plain water, water plus 75 grams of glucose or natural sugar, water plus 75 miligrams of caffeine, or water plus both 75 grams of glucose and 75 miligrams of caffeine. Participants underwent a functional magnetic resonance imaging (MRI) before and 30 minutes after consuming the beverage, and a continuous performance test was used to assess the attention span of each person.
Subjects who received the combination of caffeine and glucose produced a similar performance to the others but had a decrease in activation in the bilateral parietal and left prefrontal cortex, which are the parts of the brain responsible for attention and memory. This may suggest that the caffeine/sugar combination was providing an artificial attention and memory boost in the brains of the subjects who consumed it. Thus, the study concludes a combination of caffeine and glucose could increase a person’s attention span.
“In theory, caffeine and glucose could work together if caffeine activates cells and sugar provides the energy to fuel the activation,” Dr. Richard Lipton, professor and vice chair of Neurology at the Albert Einstein College of Medicine and a member of the American Academy of Neurology, told AOL Health after reviewing the Spanish study. “Imagine a circuit with a light bulb, a battery and a switch. In a sense, caffeine acts as a molecular switch and glucose acts as the battery. If you throw the switch without the battery, the light will not go on.”
This is a great fix to a drowsy morning; however, overuse of caffeine does have its drawbacks. “One or two cups a day may increase alertness and productivity, but, taken in excess, caffeine tolerance develops,” says Lipton. “That means you need more and more caffeine to get the same effect.” Overuse of caffeine can lead to gastritis, headaches, and irritability.
Dr. David Knopman, a neurologist with the Mayo Clinic and also an AAN member, says given the study’s small size, it shouldn’t be taken as conclusive. “Caffeine has long been known as a stimulant,” he says, “but the overall health effects of either [caffeine or sugar] depend on quantity and duration.”
Claims of Industry Tampering with Science Are Overblown
“A new scientific McCarthyism is alive and well in America today.” –ACSH’s Dr. Elizabeth Whelan
“A new scientific McCarthyism is alive and well in America today.” –ACSH’s Dr. Elizabeth Whelan
Posted: Wednesday, April 2, 2008
PRESS RELEASE
Publication Date: April 2, 2008
April 2, 2008 — New York, NY. scientists’ ties to industry and point to a Scientific progress has long benefited from collaboration between science and business — so concludes a new report from the American Council on Science and Health (ACSH), a non-profit group critical of unscientific claims. Nevertheless, self-appointed “consumer advocacy” groups now routinely assert that science is being perverted byhandful of scandals to make their case — despite the lack of evidence showing that ties to industry are especially corrupting.
“Conflicts of interest activists assert that ties between researchers and industry are harming patients and consumers,” writes science journalist Ronald Bailey in ACSH’s report Scrutinizing Industry-Funded Science: The Crusade Against Conflicts of Interest. “In addition, the anti-industry activist groups are trying to exclude academic researchers who have any ties whatsoever to industry from government scientific advisory boards.” That side of the story is by now a familiar one. “However,” concludes the ACSH report, “even the activists’ own flawed studies can’t demonstrate that industry ‘influence’ is distorting the decisions made by those boards.”
Furthermore, the activists’ crusade has costs: “The campaign to purge any experts with industry ties — no matter how slender — from advisory panels is chilling scientific debate and depriving regulators and the public of valuable insights,” continues the ACSH report, which is also available in a condensed version, Collaboration Between Science and Industry: The Pro’s and Con’s of the Conflicts-of-Interest Movement.
Often, scientists have track records as occasional consultants to industry simply because they are experts in their field. By restricting regulatory decisions at governmental bodies such the Food and Drug Administration or Environmental Protection Agency only to those scientists who had done no such consulting, we are slanting the scientific policy debate in another direction: toward those who either lacked the expertise to be sought out by industry or who have a strong political animus against industry that may itself be a greater threat to objectivity than past consulting duties.
“If a scientist was once asked by a drug company to give his or her opinion about a drug, some groups would say all that scientist’s peer-reviewed research is now tainted,” says ACSH medical director Dr. Gilbert Ross. “But the critics themselves tout the work of scientists who may be funded by foundations dedicated to promoting environmentalism or organic food, and no one thinks to ask whether they might be less than impartial themselves.”
“A new Scientific McCarthyism is alive and well in America today,” says Dr. Elizabeth Whelan, president of ACSH. Singling out ties to industry makes it seem as if only the taint of business can impair scientific judgment. “There are myriad non-financial factors that can influence scientists and impair their objectivity, from closely held political convictions to the desire for glory in a given field.”
ACSH’s full-length report and consumer-friendly condensed report on scientific “conflicts of interest” conclude that while disclosure is perfectly reasonable, treating any and all ties to industry as corrupting and other sources of bias as irrelevant — even membership in anti-industry activist groups — is a formula for scientific stagnation and skewed debate.
Related Links
Collaboration Between Science and Industry: Pro’s and Con’s of the Conflicts-of-Interest Movement
Scrutinizing Industry-Funded Science: The Crusade Against Conflicts of Interest
Collaboration Between Science and Industry: Pro’s and Con’s of the Conflicts-of-Interest Movement
Scrutinizing Industry-Funded Science: The Crusade Against Conflicts of Interest
Scientists do the numbers
Coffee is good for you — no, it’s bad. Epidemiological studies can come up with some crazy results, causing some critics to wonder if they’re really worthwhile.
By Andreas von Bubnoff, Special to The Times
September 17, 2007
September 17, 2007
SAGITTARIANS are 38% more likely to break a leg than people of other star signs — and Leos are 15% more likely to suffer from internal bleeding. So says a 2006 Canadian study that looked at the reasons residents of Ontario province had unplanned stays in the hospital.
Leos, Sagittarians: There’s no need to worry. Even the study’s authors don’t believe their results.
They’re illustrating a point — that a scientific approach used in many human studies often leads to findings that are flat-out wrong.
They’re illustrating a point — that a scientific approach used in many human studies often leads to findings that are flat-out wrong.
Such studies make headlines every day, and often, as the public knows too well, they contradict each other. One week we may hear that pets are good for your health, the next week that they aren’t. One month, cellphone use causes brain cancer; the next month, it doesn’t.
“It’s the cure of the week or the killer of the week, the danger of the week,” says Dr. Barry Kramer, associate director for disease prevention at the National Institutes of Health in Bethesda, Md. It’s like treating people to an endless regimen of whiplash, he says.
Take the case of just one item: coffee. Drinking two or three cups per day can triple the risk of pancreatic cancer, according to a 1981 study. Not so, concluded a larger follow-up study published in 2001.
Coffee reduces the risk of colorectal cancer, found a 1998 study. Not so, according to one published later, in 2005.
“I’ve seen so many contradictory studies with coffee that I’ve come to ignore them all,” says Donald Berry, chair of the department of biostatistics at the University of Texas MD Anderson Cancer Center in Houston.
“What about the man on the street?” asks Stan Young, a statistician at the National Institute of Statistical Sciences in Research Triangle Park, N.C. “He reads about coffee causing and not causing cancer — so many contradictory findings he begins to think, ‘I don’t trust anything these scientists are saying.’ ”
These critics say the reason this keeps happening is simple: Far too many of these epidemiological studies — in which the habits and other factors of large populations of people are tracked, sometimes for years — are wrong and should be ignored.
In fact, some of these critics say, more than half of all epidemiological studies are incorrect.
The studies can be influential. Often, in response to them, members of the public will go out and dose themselves with this vitamin or that foodstuff.
And the studies also influence medical practice — doctors, the critics note, encouraged women to take hormones after menopause long before their effects were tested in randomized clinical trials, the gold standard of medical research.
Some of epidemiology’s critics are calling for stricter standards before such studies get reported in medical journals or in the popular press.
Young, one of the foremost critics, argues that epidemiological studies are so often wrong that they are coming close to being worthless. “We spend a lot of money and we could make claims just as valid as a random number generator,” he says.
Epidemiology’s defenders say such criticisms are hugely overblown.
They are “quite simplistic and exaggerated,” says Dr. Meir Stampfer, a professor of epidemiology and nutrition at the Harvard School of Public Health and a professor of medicine at Harvard Medical School.
What’s more, some things simply cannot be tested in randomized clinical trials. In certain cases, to do so would be unethical. (Care to assign half the people in a trial to smoke cigarettes?)
In other cases, a trial of adequate size and duration — say, to test whether coffee drinking raises or lowers the risk of Parkinson’s disease — would have to control the habits of huge numbers of people for decades. That would not only be hugely expensive but also virtually impossible.
Stampfer cites examples of findings of epidemiology that, he says, have stood the test of time: smoking’s link to lung cancer, to name the most notable.
Watching for cluesIn epidemiological studies (also called observational studies), scientists observe what’s going on — they don’t try to change it. From what they observe, they reach conclusions — for example, about the risk of developing a certain disease from being exposed to something in the environment, lifestyle or a health intervention.
There are different ways to do this. Cohort studies follow a healthy group of people (with different intakes of, say, coffee) over time and look at who gets a disease. They’re considered the strongest type of epidemiological study.
Case-control or retrospective studies examine people with and without a certain disease and compare their prior life — for how much coffee they drank, for example — and see if people who got the disease drank more coffee in their past than those who didn’t.
Cross-sectional studies compare people’s present lifestyle (how much coffee they drink now) with their present health status.
Epidemiological studies have several advantages: They are relatively inexpensive, and they can ethically be done for exposures to factors such as alcohol that are considered harmful, because the people under study chose their exposure themselves.
But epidemiological studies have their minuses too, some of which are very well known. Suppose a study finds that coffee drinkers are more likely to get a certain disease. That doesn’t mean coffee caused the disease. Other, perhaps unknown, factors (called “confounders” in the trade) that are unrelated to the coffee may cause it — and if coffee drinkers are more likely to do this other thing, coffee may appear, incorrectly, to be the smoking gun.
A much clearer picture of the role of coffee on disease could be found, in theory, via a randomized clinical trial. One would divide a population into two, put one group on coffee and the other not, then follow both groups for years or decades to see which group got certain diseases and which didn’t.
The problem, however, is that such a study is very expensive and takes a long time, and it can be difficult to control people’s lives for that length of time.
Despite their shortcomings, epidemiological studies are often taken seriously, so much so that they can change medical practice. Such was the case after dozens of epidemiological studies, including one large, frequently cited one that came out of Harvard in 1991, had shown that taking estrogen after menopause reduces the risk of women getting cardiovascular disease.
“There was such a belief,” even with the medical community, that hormone replacement became part of standard medical practice, says Dr. Lisa Schwartz, associate professor of medicine at Dartmouth Medical School in Hanover, N.H., even in the face of an increased potential risk of breast cancer. In fact, some scientists and doctors said it would be unethical to do a randomized clinical trial to check if the hormone effect was real.
But in the hormone epidemiological studies, women choosing to take hormones may well have been healthier in other ways, Kramer says. And that fact — that they were healthier — could explain the lower risk of heart disease, not the hormones.
“To get hormone therapy, you have to go to a doctor and have to have insurance,” Kramer says. “That means you are in the upper strata of society.”
Eventually, a randomized clinical trial was conducted, as part of the so-called Women’s Health Initiative. Findings published in 2002 not only found no protection to the heart but actually reported some harm.
Epidemiology’s detractors say they have no trouble finding other cases than hormones where frequently cited and sometimes influential epidemiology studies have later turned out to be wrong or exaggerated.
In 1993, Harvard University scientists published two cohort studies reporting that vitamin E protected people from coronary heart disease.One, the Nurses Health Study, followed over 87,000 middle-aged female nurses without heart disease for up to eight years. It found that the 20% of nurses with the highest vitamin E intake had a 34% lower risk of major coronary disease than those with the lowest fifth of intake.
The other study followed almost 40,000 male health professionals without heart disease for four years — and found a 36% lower risk of coronary disease in those men taking more than 60 IU of vitamin E per day compared with those consuming less than 7.5 IU.
In the three years after these studies appeared, each was cited by other research papers more than 400 times, according to John Ioannidis, an epidemiologist at the University of Ioannina School of Medicine in Ioannina, Greece. Vitamin E therapy for heart patients became widespread — a 1997 survey published in the American Journal of Cardiology reported that 44% of U.S. cardiologists reported routine use of antioxidants, primarily vitamin E.
The therapy was finally put to the test in a Canadian randomized clinical trial of about 2,500 women and 7,000 men aged 55 years or older who were at high risk for cardiovascular events.
The findings — reported in 2000 — showed that an average daily dose of 400 IU vitamin E from natural sources for about 4 1/2 years had no effect on cardiovascular disease.
Yet, Schwartz says, seven years after that finding, her patients continue to take vitamin E in the belief that it will protect their hearts. “I am still taking people off of vitamin E,” she says of her patients, some of whom have heart disease.
Study of studiesIn a provocative 2005 paper, Ioannidis examined the six most frequently cited epidemiological studies published from three major clinical journals between 1990 and 2003. He found that four of the six findings were later overturned by clinical trials.
Vitamin E didn’t protect the heart in men or women. Hormone therapy didn’t protect the heart in women. Nitric oxide inhalation didn’t help patients with respiratory distress syndrome.
Another finding turned out later to be exaggerated: Taking flavonoids reduces coronary artery disease risk only by 20%, not by 68% as originally reported.
The only finding of the six that stood the test of time was a small study that reported that a chemical called all-trans retinoic acid was effective in treating acute promyelocytic leukemia.
The studies that overturned each of these epidemiological findings, Ioannidis says, “caused major waves of surprise when they first appeared, because everybody had believed the observational studies. And then the randomized trials found something completely different.”
To be fair, Ioannidis also tested whether the most frequently cited randomized studies held up. He found that these had a much better track record. Only nine of 39 oft-cited ones were later contradicted or turned out to be exaggerated when other randomized studies were done.
True, Ioannidis looked at only six studies. But Young says he sees the same trend in his own informal counts of epidemiological claims. “When, in multiple papers, 15 out of 16 claims don’t replicate, there is a problem,” he says.
Belief can be costly, Young adds. For example, one part of the large, randomized Women’s Heath Initiative study tested the widely held belief — based in large part on epidemiological studies — that a low-fat diet decreases the risk of colorectal cancer, heart disease, or stroke.
The findings suggested that there was no effect. “$415 million later, none of the claims were supported,” Young says.
Other scientists, while more cautious than epidemiology’s most outspoken detractors, agree that there are many flawed studies. When Kramer first saw Ioannidis’ number, “I said to myself, ‘It can’t be that bad,’ ” he says. “But I can’t prove that it isn’t. I know there are a lot of bad studies out there.”
Ioannidis, Kramer says, is voicing what many know to be true.
Method in doubt Why does this happen?
Young believes there’s something fundamentally wrong with the method of observational studies — something that goes way beyond that thorny little issue of confounding factors. It’s about another habit of epidemiology some call data-mining.
Most epidemiological studies, according to Young, don’t account for the fact that they often check many different things in one study. “They think it is fine to ask many questions of the same data set,” Young says. And the more things you check, the more likely it becomes that you’ll find something that’s statistically significant — just by chance, luck, nothing more.
It’s like rolling a pair of dice many times without anyone looking until you get snake eyes and then claiming you’d only rolled it once. Often, epidemiological researchers ask dozens, maybe hundreds of questions in the questionnaires they send to the people they study. They ask so many questions that something, eventually, is bound to come out positive.
That’s where the Canadian star sign study comes into play, Young says. It was only because the authors deliberately asked a lot of questions — to prove a point — that it was able to come up with significant results for something that couldn’t be true.
The study’s lead author, statistician Peter Austin of the Institute for Clinical Evaluative Sciences in Toronto, says that once he cleaned up his methodology (by adding a statistical correction for the large number of questions he asked) the association between Leos and internal bleeding and Sagittarians and leg-breaks disappeared.
On the defensiveMany epidemiologists do not agree with the critics’ assertion that most epidemiological studies are wrong and that randomized studies are more reliable.
“Randomized studies often contradict one another, as do observational studies,” says Harvard’s Stampfer, who is an author on both the frequently cited vitamin E and hormone replacement studies that Ioannidis says were later refuted.
Instead, Stampfer says, the two types of studies often test different things. “It’s not an issue here that observational studies got it wrong and randomized trials got it right,” he says, referring to the hormone replacement studies. “My view is that [both] were right and they were addressing different questions.”
For one thing, the randomized studies on hormone replacement and vitamin E that Ioannidis cited in his 2005 paper looked at different populations than the observational studies they refuted, says Stampfer, who takes vitamin E himself.
In the hormone replacement case, the observational studies looked at women around the age of menopause. The randomized trial looked at women who were mostly well past that age.
In fact, Stampfer says, a recent reanalysis of the Women’s Health initiative data suggested a trend that hormone therapy may be less risky for younger than older women. The effect was not statistically significant, but, Stampfer says, it’s further support for the idea that hormones have different effects depending on when women start taking them.
And the vitamin E studies? The 1993 observational studies followed people who didn’t have heart disease. The randomized study looked at people with known heart disease who were on many other medications. All those meds could easily override the effect of vitamin E, says Dr. Walter Willett, a professor of epidemiology and nutrition at the Harvard School of Public Health, who was a coauthor on the hormone and the vitamin E epidemiological studies.
And finally, the low-fat trial from the Women’s Health Initiative. It’s not surprising, Willett and Stampfer say, that this gold-standard trial failed to find what epidemiology had — that low-fat diets ward off heart disease, colorectal cancer and stroke. The women in these trials didn’t stick to their diets.
“The compliance with the low-fat diet was definitely far lower than anticipated,” Willett says, “and probably far worse than even acknowledged in the papers.”
Such arguments do not sway epidemiology’s detractors.
Each time a study doesn’t replicate, “they make a specific argument why the studies are different,” Young says. He concedes that epidemiology did uncover the truth about the risks of smoking — but only because the effects are so strong.”Even a blind hog occasionally finds an acorn,” he says.
Yet epidemiologists warn that discarding results because of a correction for multiple testing may risk missing true and important effects — especially in cases where there’s a good biological reason suggesting an effect, such as in studies of drugs that have been shown to work in animal experiments. And setting the bar too high might sometimes be dangerous, says Sander Greenland, a professor of epidemiology and statistics at UCLA. “Do you want to screen for medical side-effects with the attitude, ‘So what if we miss side effects?’ ” he asks. “That’s deadly. That’s ridiculous!”
The debate is unlikely to be resolved any time soon. “If you put five epidemiologists and five statisticians in a room and have this debate,” Young says, “and try to get each one to convince the other side, at the end of the day it will still be five to five.”
Scientists do the numbers
