A couple of weeks ago, the American Psychological Association (APA) released clinical practice guidelines for the treatment of people diagnosed with post-traumatic stress disorder (PTSD). “Developed over four years using a rigorous process,” according to an article in the APA Monitor, these are the first of many additional recommendations of specific treatment methods for particular psychiatric diagnoses to be published by the organization.
Almost immediately, controversy broke out. On the Psychology Today blog, Clinical Associate Professor Jonathon Shedler, advised practitioners and patients to ignore the new guidelines, labeling them “bad therapy.” Within a week, Professors Dean McKay and Scott Lilienfeld responded, lauding the guidelines a “significant advance for psychotherapy practice,” while repeatedly accusing Shedler of committing logical fallacies and misrepresenting the evidence.
One thing I know for sure, coming in at just over 700 pages, few if any practitioners will ever read the complete guideline and supportive appendices. Beyond length, the way the information is presented–especially the lack of hypertext for cross referencing of the studies cited–seriously compromises any strainghtforward effort to review and verify evidentiary claims.
If, as the old saying goes, “the devil is in the details,” the level of mind-numbing minutae contained in the offical documents ensures he’ll remain well-hidden, tempting all but the most compulsive to accept the headlines on faith.
Consider the question of whether certain treatment approaches are more effective than others? Page 1 of the Executive Summary identifies differential efficacy as a “key question” to be addressed by the Guideline. Ultimately, four specific approaches are strongly recommended, being deemed more effective than…wait for it… “relaxation.”
My first thought is, “OK, curious comparison.” Nevertheless, I read on.
Only by digging deep into the report, tracing the claim to the specific citations, and then using PsychNET, and another subscription service, to access the actual studies, is it possible to discover that in the vast majority of published trials reviewed, the four “strongly recommended” approaches were actually compared to nothing. That’s right, nothing.
In the few studies that did include relaxation, the structure of that particular “treatment” precluded sufferers from talking directly about their traumatic experiences. At this point, my curiosity gave way to chagrin. Is it any wonder the four other approaches proved more helpful? What real-world practitioner would limit their work with someone suffering from PTSD to recording “a relaxation script” and telling their client to “listen to it for an hour each day?”
(By the way, it took me several hours to distill the information noted above from the official documentation–and I’m someone with a background in research, access to several online databases, a certain facility with search engines, and connections with a community of fellow researchers with whom I can consult)
On the subject of what research shows works best in the treatment of PTSD, meta-analyses of studies in which two or more approaches intended to be therapeutic are directly compared, consistently find no difference in outcome between methods–importantly, whether the treatments are designated “trauma-focused” or not. Meanwhile, another highly specialized type of research–known as dismantling studies–fails to provide any evidence for the belief that specialized treatments contain ingredients specifically remedial to the diagnosis! And yes, that includes the ingredient most believe essential to therapeutic success in the treatment of PTSD: exposure (1, 2).
So, if the data I cite above is accurate–and freely available–how could the committee that created the Guideline come to such dramatically different conclusions? In particular, going to great lengths to recommend particular approaches to the exclusion of others?
Be forewarned, you may find my next statement confusing. The summary of studies contained in the Guideline and supportive appendices is absolutely accurate. It is the interpretation of that body of research, however, that is in question.
More than anything else, the difference between the recommendations contained in the Guideline and the evidence I cite above, is attributable to a deep and longstanding rift in the body politic of the APA. How otherwise is one able to reconcile advocating the use of particular approaches with APA’s official policy on psychotherapy recognizing, “different forms . . . typically produce relatively similar outcomes”?
Seeking to place the profession “on a comparable plane” with medicine, some within the organization–in particular, the leaders and membership of Division 12 (Clinical Psychology) have long sought to create a psychological formulary. In part, their argument goes, “Since medicine creates lists of recommended treatments and procedures, why not psychology?”
Here, the answer is simple and straightforward: because psychotherapy does not work like medicine. As Jerome Frank observed long before the weight of evidence supported his view, effective psychological care is comprised of:
- An emotionally-charged, confiding relationship with a helping person (e.g., a therapist);
- A healing context or setting (e.g., clinic);
- A rational, conceptual scheme, or myth that is congruent with the sufferer’s worldview and provides a plausible explanation for their difficulties (e.g., psychotherapy theories); and
- Rituals and/or procedures consistent with the explanation (e.g., techniques).
The four attributes not only fit the evidence but explain why virtually all psychological approaches tested over the last 40 years, work–even those labelled pseudoscience (e.g., EMDR) by Lilienfeld, and other advocates of guidelines comprised of “approved therapies.”
That the profession could benefit from good guidelines goes without saying. Healing the division within APA would be a good place to start. Until then, encouraging practitioners to follow the organization’s own definition of evidence-based practice would suffice. To wit, “Evidence based practice is the integration of the best available research with clinical expertise in the context of patient (sic) characteristics, culture, and preferences.” Note the absence of any mention of specific treatment approaches. Instead, consistent with Frank’s observations, and the preponderance of research findings, emphasis is placed on fitting care to the person.
How to do this? The official statement continues, encouraging the “monitoring of patient (sic) progress . . . that may suggest the need to adjust the treatment.” Over the last decade, multiple systems have been developed for tracking engagement and progress in real time. Our own system, known as Feedback Informed Treatment (FIT), is being applied by thousands of therapists around the world, with literally millions of clients. It is listed on the National Registry of Evidence based Programs and Practices. More, when engagement and progress are tracked together with clients in real time, data to date document improvements in retention and outcome of mental health services regardless of the treatment method being used.
Until next time,
Scott
Scott D. Miller, Ph.D.
Director, International Center for Clinical Excellence
Randy Moss says
Scott,
The post on PTSD treatment and APA guild lines you clearly show a political interpretation to research rather than simple critical thinking. The citations in the guild lines are solid. You note that many of the research designs were compared to “nothing” not even just silent relaxation. You imply this is problematic without tell us the reasons and how conclusions drawn from such research finding are suspect at best and false otherwise….
Randy Moss says
Guidelines not guild lines but the latter makes political sense!!!
Gary Cole says
Randy, I was wondering if that was intentional “guild lines”:-
Scott, I find your closing sentence confusing. Are you referring to your FIT treatments or the universe of treatments?
scottdm says
Gary, thanks for your note. I’ve edited that last sentence. It was vague! Hope the change makes the meaning more clear.
Randy Moss says
Second question. Shelder encourages the disregarding of the guidelines due to being bad therapy. Other have lauded the guidelines as important and responsible treatment prescriptions. You did neither. You did what most can’t or won’t, investigate the source document. You don’t come down on either party line other than noting that specific ingredient therapies consistently fail to show significant differentiation. How would you address our collective political voice in the APA, their (to my reading) exaggerated conclusion in the guidelines, and the Shelder encouragement to total disregard?
Randal Dixon says
Thanks for the article.
What you said was clear and precise and in my estimation right on.
Charlene Takeuchi says
Thank you for your continued energy and astute insight, Scott. I work ungodly hours as a licensed therapist and do not have time (or training) to pursue studies the way you manage to do, and every time you come up with a critique that inspires critical thinking instead of passive acceptance. I appreciate that. When there exists too much controversy over what is working right and well, I fail to see how the egos of a few who seek notoriety gain momentum… i experience these industry rifts and shifts as wearing down patients more than assistive. So again, I appreciate your attention to detail and ability to articulate an alternative reality to movement such as this PTSD edict.
Frank says
Thank you Charlene (and Scott). These were exactly my thoughts and feelings.
Ken Benau, PhD says
Since I have not read the APA guidelines, and have only read Shedler’s critique, and heard the critique of a few other respected colleagues, my comments are more in the form of questions:
1. Scott, it is my understanding the research the APA cites is based on patients with PTSD sans any co-morbid conditions. Likewise, it is my sense the trauma studied is more “simple” than “complex”, as in complex relational trauma survivors.
Does that match your read of the APA guidelines?
2. Scott, in my opinion, there is some excellent clinical work being done with complex trauma and dissociation that has been written about but hasn’t been researched (as you know, it is not so easy to do), and some that has been researched (see Bethany Brand, PhD et al’s research into online, adjunct treatments for DID patients). Has any of the non-researched, clinical work been discussed, and if so where do they situate that work in their overall assessment of the trauma therapy field? Also, has Brand et al’s work with DID been referenced, and if so what conclusions were drawn?
Thanks so much for your offering us your impressions and critical reflections, here.
David N Elkins says
Scott,
Thanks for your comments. Unfortunately, this is what I feared when I learned a few years back that APA planned to develop “treatment guidelines.” Several of us in Division 32 had a meeting with the APA guidelines committee at that time. They promised to “follow the data” but appear not to have done so. For more than a century, our profession has searched for “treatments,” meaning specific techniques, that are effective. Apparently, we just cannot believe that common factors, and particularly human factors, are the primary agents of change. This committee, unfortunately, has apparently fallen under the spell of techniques and have failed to follow where the data lead in terms of the power of those factors. Thanks for your thoughtful analysis, Scott. It’s amazing to see the weak research that is used to recommend these treatments.
Colleen Matthews says
Great article. Very interested in FIT Training.
Teknik Telekomunikasi says
Do clinical practice guidelines (CPG) have a significant role in the development of effective therapies?
Regard Telkom University