You are not going to believe me when I say it. Fifty percent. It’s true. Even in studies where carefully selected therapists who receive copious amounts of training, support, and supervision, and treat clients with a single diagnosis or problem, between 5 and 10% get worse and 35-40% experience no benefit whatsoever! That’s half, or more.
What happens to these people?
Well, as readers of this blog know, if the therapist formally and routinely solicits feedback regarding the quality of the relationship and progress in care, drop out and deterioration rates fall, and outcome improves.
Still, a significant percentage of people do not improve—as many as 25%! What can we do? The ethical standards for all of the professional mental health organizations require clinicians both monitor and end ineffective treatments as well as suggest helpful alternatives to clients (ACA [C2.d], APA [10.10]). But what?
Enter Lynn D. Johnson, Ph.D., a psychologist whose work and thinking is always a step ahead. I’ve known Lynn for 30 years, met him when I was a graduate student. As I blogged previously about, it was Lynn who in 1996 first suggested routinely measuring outcomes. He is also responsible for the creation of the original Session Rating Scale–a 10-item version that I later shortened to four. For several years, Lynn pushed me to do research on top performing therapists, believing they held clues to improving the practice of psychotherapy in general.
Well, my long time colleague and mentor is at it again, once more seeing “over the horizon.” Based on the latest findings on “human flourishing,” he says that lifestyles provide a pathway to health for the non-responders. True to form, he’s freely sharing what he knows, offering an online course–at no charge–on “Lifestyle secrets of the happy and healthy.”
Are you interested?
Click on this link: http://drlynnjohnson.com/free-lifestyles-course/?ref=14 and you can see his first video. More are coming. Lynn claims that these ideas and techniques are the next thing in both physical medicine and psychotherapy. Watch the video and let me know what you think.
Until next time, wishing you a healthy and happy life,
Scott
Scott D. Miller, Ph.D.
Director, International Center for Clinical Excellence
Thanks Scott. I’m a bit confused though .. I thought that from the ‘therapy works’ research, 8 out of 10 people get better with treatment. How does that square with this ‘50% don’t’ finding?
Cheers
Andrew
Hi Andrew. Great question. When you compare treated versus untreated clients, meta-analytic studies show that those receiving care are better off than 80% of those who do not. The figure I cite in my most recent blog is the percentage of clients who achieve a reliable change/improvement. Two different stats. Two different comparisons.
Very interesting, Scott, as always… Still wish I could get more of the clinic here to actually embrace FIT but perhaps if more outside pressure from 3rd-party payers and others builds over time to incorporate outcomes it may happen. Of course, I would rather have it come from a genuine interest in client welfare and effectiveness versus those other factors!
Nate…come hang out with us this summer at one of our three intensives. You’d be perfect for the professional development course. We will be use the latest research on top performing therapists to help participants develop an evidence based plan for improving engagement and effectiveness.
Hi Scott,
Thanks for the interesting info on failure rates. My question is more on FIT outcomes. I know that FIT enhances outcomes and decreases drop out rates across different modalities of therapy. How long do these improvements in therapist efficacy last? Is there a bump up when FIT starts and then it goes back to normal or does it stay improved? Similarly, do therapists who use FIT keep improving showing that experience does predict excellence when you add FIT?
thanks,
stephen
Interesting and important question. We know that therapists do not learn merely by receiving feedback. The tools function like a GPS, pointing the way and alerting us when we are off course. If one wants to learn the geography (keeping with the GPS analogy), an additional step is required: reflection and practice. Go to my publication list and read the two articles, “Supershrinks” and “The Road to Mastery” for a review.
Hi Scott,
Thanks for your feedback. I did read the articles and have a few questions/comments. Given yours and other’s work on the ineffectiveness of techniques and training, “reflection and practice” are no longer simple topics to understand or work with. “Reflecting” on how my family systems or cognitive behavioral intervention helped this last client isn’t likely to make me a better therapist. And you have written quite extensively on the futility of emulating or reflecting on a “common factors” approach; thinking about how I really listened to that client or supported her goals is also unlikely to make me more effective.
Ericsson’s recommendations regarding reflection and deliberate practice seem solid to me but only when we are working in a field where mastery of techniques improves outcome. Constructionists and Narrative Therapists argue that psychology is not such a field; instead of operating in fundamental reality—where techniques work—we are operating in constructed reality—where change occurs through other mechanisms. If enhanced therapeutic efficacy comes from reflection and practice, then your experience with de Shazar—which had huge amounts of reflection and practice—should have improved outcome. But you report that not only did that reflection and practice (which occurred at levels far above the norm) fail to enhance outcome, surprisingly the most effective therapists were two graduate students! In sum, following a recommendation about reflection and practice is much more challenging when operating in constructed reality.
I suspect that FIT works by enhancing listening and enhancing motivation—at least for a time. I think your graduate students at the BFTC were outstanding because they were trying harder—they were highly motivated to demonstrate they could help clients change, more motivated than the more experienced therapists who had already proved they could help clients change.
This leads back to my original question about whether there is any research yet about whether the improvements caused by FIT are sustained over time and whether they are cumulative (the therapist continues to improve). I don’t know if there are any early results in this area but such research could shed important light on the theoretical speculation above.
Thanks,
Stephen Bacon
Stephen:
Take a look at the work we’ve just finished looking at top performing therapists. The key is not to focus on the level of technique applied to clients by therapists in general but rather looking at what happens when individual therapists identify the edge of what they do well and push from there. We’ve got a number of studies now showing that clinicians can improve engagement, retention, and their outcomes.
Does you research also include clients who have received psychotherapy and improved/got better but would have got better/improved without any psychotherapy? I would think this would be hard to know?
Most comparisons of psychotherapy to no treatment find in favor of treatment. Changes from psychotherapy are greater, faster, and more enduring. However, the present study was looking at the failure rate WHEN people receive treatment.
The failure rate is much higher than that. The mental health issues in our society are a byproduct of our society. You can continue to treat individuals but until the field of psychology decides to address the real issues the failure rates will never improve.
Look at it this way. In a dysfunctional family you will normally find one individual who demonstrates that dysfunction. This individual is the one most effected. In order for long term results the family has to be addressed. Now apply systems theory. Our society is the family. The same patterns on a grander scale. For any lasting and significant change the real issues must be addressed. We live in an increasingly unhealthy society. Poor mental health is a byproduct of that society. It really is that simple. Healing our society however isn’t so simple.
You’re right. I couldn’t believe it’s 50%, and I still don’t.
There’s no way it’s as high as 50% success rate. Nor do I believe the percentage of those worse off is as a low as 5-10%. I’d suspect that if more realistic measures of success and worse off were presented to respondents, you’d find percentages more like:
Success: 10%
Nothing: 50%
Worse off: 40%