September 22, 2009

Study Uses Deception To Claim Antipsychotics Are Awesome Depression Treatments

This is one of the oddest studies I've seen in a while. It was published in the American Journal of Psychiatry earlier this month and it's literally an example of trying to pull the wool over the public's eyes concerning the efficacy of atypical antipsychotics used to augment an anti-depressant in the treatment of major depression. The study authors are J. Craig Nelson of UCSF and George Papakostas of Harvard/Mass General. Their stated purpose was:

"The authors sought to determine by meta-analysis the efficacy and tolerability of adjunctive atypical antipsychotic agents in major depressive disorder.trial, depression scale used, response and remission rates, and discontinuation rates for any reason or for adverse events."

They then focused on published studies or studies presented as posters at various conferences for the use of Zyprexa, Risperdal, Seroquel and Abilify as augmentation treatments. Oddly, only Abilify is approved for such use by the FDA. Seroquel's maker, AstraZeneca, is still awaiting FDA approval of its drug as an augmentation--and has been waiting for almost six months since an FDA panel recommended--quite gingerly--that the agency approve the drug. That's an unusually long wait and tells you that something odd is afoot.

Anyway, the researchers didn't report in their paper the efficacy of the four drugs. Instead, they pulled an odd trick and reported the odds ratio of all the studies of the four drugs as depression augmenters to placebo. In other words, they were telling readers the chance that this class of drugs beat placebo--not the efficacy of the drugs (except in a slippery manner I'll come to). That strikes me as a consumer and science dork as an utterly useless measure with little real world clinical significance, especially since several of the 16 studies were of only four weeks duration--some of the shortest depression treatment studies I've ever heard of.

They reported the odds of beating placebo as:

"Adjunctive atypical antipsychotics were significantly more effective than placebo (response: odds ratio=1.69, 95% CI=1.46–1.95, z=7.00, N=16, p<0.00001; remission: odds ratio=2.00, 95% CI=1.69– 2.37, z=8.03, N=16, p<0.00001). Mean odds ratios did not differ among the atypical agents and were not affected by trial duration or method of establishing treatment resistance. Discontinuation rates for adverse events were higher for atypical agents than for placebo (odds ratio=3.91, 95% CI=2.68–5.72, z=7.05, N=15, p<0.00001)."

Translation: atypicals as augmenters are 69 percent more likely to produce a response than is placebo and 100 percent more likely to produce remission than is placebo. Sounds awesome, right?

Now, here's why you should be very suspicious of the apparent epic victory over placebo:

"The odds ratio for remission was 2.00, with a number needed to treat of nine."

The NNT as it's known means the number of people who would have to try a treatment before one person would realize a treatment benefit. An NNT of nine people translates to an overall efficacy for atypical augmenters of about 11 percent. Staggeringly low. And hardly the victory researchers seemed to be claiming.

So why would such august researchers report an odds ratio that favored the drugs instead of reporting their individual and pooled lack of efficacy? I have no idea, but here are there conflicts of interest declarations from the paper:

"Dr. Nelson has received grant support from or served as a speaker on advisory boards, or as a consultant for Abbott Laboratories, Acadia Pharmaceuticals, AstraZeneca [maker of Seroquel], Biovail, Bristol-Myers Squibb [maker of Abilify], Corcept, Cyberonics, Eli Lilly [maker of Zyprexa], Forest Pharmaceuticals, GlaxoSmithKline, Health Resources and Services Administration, Janssen Pharmaceutica [maker of Risperdal], Medtronics, Merck, NIMH, Novartis Pharmaceuticals, Organon, Orexigen, Otsuka [creator of Abilify], Pfizer U.S. Pharmaceuticals Group, Sepracor, Shire, and Sierra Neuropharmaceuticals. Dr. Papakostas has received grant support from or served as a speaker, on advisory boards, or as a consultant for Bristol-Myers Squibb [maker of Abilify], Eli Lilly [maker of Zyprexa], Evotec AG, GlaxoSmithKline, Inflabloc Pharmaceuticals, Jazz Pharmaceuticals, Lundbeck, NIMH, Otsuka [creator of Abilify], PAMLAB LLC, Pfizer U.S. Pharmaceuticals Group, Pierre Fabre Laboratories, Precision Human Biolaboratories, Shire Pharmaceuticals, Titan Pharmaceuticals, and Wyeth.

"No external funding was received for the study design, trial search,
data analysis, interpretation of the data, writing of the paper, or the
decision to submit for publication."

When you've had recent research and consultant funding from the companies making the drugs is it any wonder that study resulted are measured in such a fashion that they sound totally wonderful when they are not? I'm just asking.

Posted by Philip Dawdy at September 22, 2009 12:03 AM
StumbleUpon Toolbar del.icio.us Digg it reddit
Comments

"N=15, p

The reason why this is ridiculous and amateurish is that "we" researchers simply do not have the kind of precision to judge accuracy to this fine level. We don't have measures that can discriminate between some result if it were significantly differnt to a likelihood of one in ten thousand versus one in twenty thousand. Regardless of what comes out of the computer. That kind of statement would require a huge sample size, long-term outcomes, and precise measure of symptomatolgy. We just don't have that - certainly not in these four-week studies with N = 15.

When your stats program gives and output like this, a reasonable convention is to simply state "p

Posted by: medsvstherapy at September 22, 2009 07:21 AM

It is time to stop the music for the promotion of these so-called atypical antipsychotic drugs in depression. You nailed it, Philip.

Posted by: Bernard Carroll at September 22, 2009 08:46 AM

-apparently the 'less than' sign is code for something else. p is less than .00001 is what I meant to quote. Less than one in ten thousand. With an N of 15. I would be chuckling, but they are using these data to push Rx drugs on people for whom they don't work, and who will be harmed to varying degrees.

Posted by: medsvstherapy at September 23, 2009 05:54 AM

Dear Philip,

Why not write to the journal, asking them to publish your criticism and challenging the authors to reply to your arguments in press?

Y

Posted by: Y at October 3, 2009 02:05 PM
Post a comment









Remember personal info?






pic1.jpg

Patient Blogs. Sites.
Doctor Blogs. Sites.
Activists. News.
Social Networking. Forums.
Science. Big Pharma. Ethics.
Current Affairs
Seattle Stuff
Smoking. Stuff.

Info
About Furious Seasons
Email
Other Articles
ZYPREXA Documents
Alt ZYPREXA Documents Source
Blakemore-Brown Transcript

 Subscribe in a reader

Search


Recent Entries
$99 Left
$114 To Go
Winter Fundraiser, $134 To Go, Final Day
Ruth Lilly, Eli Lilly Heiress, Prozac Beneficiary Dies At 94
Winter Fundraiser, Final Day, Less Than $200 To Go
UCLA Psychiatrist Criticizes DSM-5
Winter Fundraiser, Barely $200 To Go
Most Popular Posts Of 2009
Winter Fundraiser, Less Than $300 Left, Let's Wrap It Up
Senate Health Care Bill Contains $1.25 Billion Gift To Sen. Stabenow
Travel Day, Comment Approval May Be Intermittent
Winter Fundraiser, Close But Stalled
Senate Health Care Reform Bill Contains Controversial MOTHERS Act, Abortion Study
Adult ADHD And Sleep Problems
Vic Chesnutt Dead At 45, Possible Suicide
Recent Comments

Y on Study Uses Deception To Claim Antipsychotics Are Awesome Depression Treatments

medsvstherapy on Study Uses Deception To Claim Antipsychotics Are Awesome Depression Treatments

Bernard Carroll on Study Uses Deception To Claim Antipsychotics Are Awesome Depression Treatments

medsvstherapy on Study Uses Deception To Claim Antipsychotics Are Awesome Depression Treatments

Archives
December 2009
November 2009
October 2009
September 2009
August 2009
July 2009
June 2009
May 2009
April 2009
March 2009
February 2009
January 2009
December 2008
November 2008
October 2008
September 2008
August 2008
July 2008
June 2008
May 2008
April 2008
March 2008
February 2008
January 2008
December 2007
November 2007
October 2007
September 2007
August 2007
July 2007
June 2007
May 2007
April 2007
March 2007
February 2007
January 2007
December 2006
November 2006
October 2006
September 2006
August 2006
July 2006
June 2006
May 2006
April 2006
March 2006
February 2006
January 2006
December 2005
November 2005
October 2005
September 2005
Resources
Mental Health America
National Alliance on Mental Illness
Depression and Bipolar Support Alliance
National Institute of Mental Health
McMan Web
Powered by
Movable Type 3.2