SCOTT D Miller - For the latest and greatest information on Feedback Informed Treatment

  • About
    • About Scott
    • Publications
  • Training and Consultation
  • Workshop Calendar
  • FIT Measures Licensing
  • FIT Software Tools
  • Online Store
  • Top Performance Blog
  • Contact Scott
info@scottdmiller.com 773.404.5130

The Failure Rate of Psychotherapy: What it is and what we can do?

April 24, 2015 By scottdm 15 Comments

50 percent

You are not going to believe me when I say it. Fifty percent. It’s true. Even in studies where carefully selected therapists who receive copious amounts of training, support, and supervision, and treat clients with a single diagnosis or problem, between 5 and 10% get worse and 35-40% experience no benefit whatsoever! That’s half, or more.

What happens to these people?

Well, as readers of this blog know, if the therapist formally and routinely solicits feedback regarding the quality of the relationship and progress in care, drop out and deterioration rates fall, and outcome improves.

Still, a significant percentage of people do not improve—as many as 25%!  What can we do? The ethical standards for all of the professional mental health organizations require clinicians both monitor and end ineffective treatments as well as suggest helpful alternatives to clients (ACA [C2.d], APA [10.10]).  But what?

23alynncropped

Enter Lynn D. Johnson, Ph.D., a psychologist whose work and thinking is always a step ahead.  I’ve known Lynn for 30 years, met him when I was a graduate student.  As I blogged previously about, it was Lynn who in 1996 first suggested routinely measuring outcomes.  He is also responsible for the creation of the original Session Rating Scale–a 10-item version that I later shortened to four.  For several years, Lynn pushed me to do research on top performing therapists, believing they held clues to improving the practice of psychotherapy in general.

Well, my long time colleague and mentor is at it again, once more seeing “over the horizon.”  Based on the latest findings on “human flourishing,” he says that lifestyles provide a pathway to health for the non-responders.  True to form, he’s freely sharing what he knows, offering online courses on “Lifestyle secrets of the happy and healthy.”

Click here if you are you interested in learning more.  Lynn claims that these ideas and techniques are the next thing in both physical medicine and psychotherapy. Let me know what you think.

Until next time, wishing you a healthy and happy life,

Scott

Scott D. Miller, Ph.D.
Director, International Center for Clinical Excellence

headerMain8.png

 

Filed Under: Feedback Informed Treatment - FIT

Comments

  1. Andrew Sedger says

    April 24, 2015 at 9:36 pm

    Thanks Scott. I’m a bit confused though .. I thought that from the ‘therapy works’ research, 8 out of 10 people get better with treatment. How does that square with this ‘50% don’t’ finding?
    Cheers
    Andrew

    Reply
    • scottdm says

      April 25, 2015 at 8:33 am

      Hi Andrew. Great question. When you compare treated versus untreated clients, meta-analytic studies show that those receiving care are better off than 80% of those who do not. The figure I cite in my most recent blog is the percentage of clients who achieve a reliable change/improvement. Two different stats. Two different comparisons.

      Reply
  2. Nate says

    April 28, 2015 at 3:48 pm

    Very interesting, Scott, as always… Still wish I could get more of the clinic here to actually embrace FIT but perhaps if more outside pressure from 3rd-party payers and others builds over time to incorporate outcomes it may happen. Of course, I would rather have it come from a genuine interest in client welfare and effectiveness versus those other factors!

    Reply
    • scottdm says

      May 5, 2015 at 11:02 am

      Nate…come hang out with us this summer at one of our three intensives. You’d be perfect for the professional development course. We will be use the latest research on top performing therapists to help participants develop an evidence based plan for improving engagement and effectiveness.

      Reply
  3. Stephen Bacon says

    April 30, 2015 at 11:57 pm

    Hi Scott,

    Thanks for the interesting info on failure rates. My question is more on FIT outcomes. I know that FIT enhances outcomes and decreases drop out rates across different modalities of therapy. How long do these improvements in therapist efficacy last? Is there a bump up when FIT starts and then it goes back to normal or does it stay improved? Similarly, do therapists who use FIT keep improving showing that experience does predict excellence when you add FIT?

    thanks,

    stephen

    Reply
    • scottdm says

      May 5, 2015 at 11:00 am

      Interesting and important question. We know that therapists do not learn merely by receiving feedback. The tools function like a GPS, pointing the way and alerting us when we are off course. If one wants to learn the geography (keeping with the GPS analogy), an additional step is required: reflection and practice. Go to my publication list and read the two articles, “Supershrinks” and “The Road to Mastery” for a review.

      Reply
      • Stephen Bacon says

        May 6, 2015 at 2:23 pm

        Hi Scott,

        Thanks for your feedback. I did read the articles and have a few questions/comments. Given yours and other’s work on the ineffectiveness of techniques and training, “reflection and practice” are no longer simple topics to understand or work with. “Reflecting” on how my family systems or cognitive behavioral intervention helped this last client isn’t likely to make me a better therapist. And you have written quite extensively on the futility of emulating or reflecting on a “common factors” approach; thinking about how I really listened to that client or supported her goals is also unlikely to make me more effective.

        Ericsson’s recommendations regarding reflection and deliberate practice seem solid to me but only when we are working in a field where mastery of techniques improves outcome. Constructionists and Narrative Therapists argue that psychology is not such a field; instead of operating in fundamental reality—where techniques work—we are operating in constructed reality—where change occurs through other mechanisms. If enhanced therapeutic efficacy comes from reflection and practice, then your experience with de Shazar—which had huge amounts of reflection and practice—should have improved outcome. But you report that not only did that reflection and practice (which occurred at levels far above the norm) fail to enhance outcome, surprisingly the most effective therapists were two graduate students! In sum, following a recommendation about reflection and practice is much more challenging when operating in constructed reality.

        I suspect that FIT works by enhancing listening and enhancing motivation—at least for a time. I think your graduate students at the BFTC were outstanding because they were trying harder—they were highly motivated to demonstrate they could help clients change, more motivated than the more experienced therapists who had already proved they could help clients change.

        This leads back to my original question about whether there is any research yet about whether the improvements caused by FIT are sustained over time and whether they are cumulative (the therapist continues to improve). I don’t know if there are any early results in this area but such research could shed important light on the theoretical speculation above.

        Thanks,

        Stephen Bacon

        Reply
        • scottdm says

          May 10, 2015 at 6:49 pm

          Stephen:

          Take a look at the work we’ve just finished looking at top performing therapists. The key is not to focus on the level of technique applied to clients by therapists in general but rather looking at what happens when individual therapists identify the edge of what they do well and push from there. We’ve got a number of studies now showing that clinicians can improve engagement, retention, and their outcomes.

          Reply
  4. Cristalexi says

    October 5, 2015 at 9:50 am

    Does you research also include clients who have received psychotherapy and improved/got better but would have got better/improved without any psychotherapy? I would think this would be hard to know?

    Reply
    • scottdm says

      October 5, 2015 at 1:39 pm

      Most comparisons of psychotherapy to no treatment find in favor of treatment. Changes from psychotherapy are greater, faster, and more enduring. However, the present study was looking at the failure rate WHEN people receive treatment.

      Reply
  5. David says

    June 26, 2017 at 4:04 am

    The failure rate is much higher than that. The mental health issues in our society are a byproduct of our society. You can continue to treat individuals but until the field of psychology decides to address the real issues the failure rates will never improve.

    Look at it this way. In a dysfunctional family you will normally find one individual who demonstrates that dysfunction. This individual is the one most effected. In order for long term results the family has to be addressed. Now apply systems theory. Our society is the family. The same patterns on a grander scale. For any lasting and significant change the real issues must be addressed. We live in an increasingly unhealthy society. Poor mental health is a byproduct of that society. It really is that simple. Healing our society however isn’t so simple.

    Reply
  6. K says

    May 2, 2018 at 2:27 am

    You’re right. I couldn’t believe it’s 50%, and I still don’t.

    There’s no way it’s as high as 50% success rate. Nor do I believe the percentage of those worse off is as a low as 5-10%. I’d suspect that if more realistic measures of success and worse off were presented to respondents, you’d find percentages more like:
    Success: 10%
    Nothing: 50%
    Worse off: 40%

    Reply
  7. Gregory says

    August 29, 2018 at 9:18 pm

    Your statement of 50% success and failure is inaccurate, at best misleading. To say that people who were helped somewhat, mild to moderately improved, did not count as success, is grossly mistaken. The suffering that people go through without treatment/before treatment, as compared to after “mild to moderate” improvement, cannot be measured in dollars. It is very important. The most extensive study of psychotherapy ever done was by Consumer Reports in 1994 and found psychotherapy to be 90% effective, as rated by the consumers themselves. That 54% of respondents found therapy “helped a great deal” is staggering. To put your view in perspective, using the same standard of effectiveness would place psychiatric medications at about 33% effective, since in numerous studies it was observed that roughly a third of patients were helped extremely, a third were helped moderately, and a third felt the medication had little to no effect. Psychotherapy has been found by researchers to be just as beneficial as psychiatric medications alone, or as in at least one study, a close second, and medication and psychotherapy together have repeatedly been found to be more effective than either one alone. The verdict is in: psychotherapy works.

    Reply
    • scottdm says

      August 30, 2018 at 3:02 pm

      Dear Gregory:
      Thanks for taking the time to reply. When assessing the effectiveness of therapy, it is important to separate change that is due to chance, the passage of time, the use of repeated measures, and measurement error from the actual effect of therapy. In our work, and in all clinical trials, researchers report both “reliable change” and “clinically significant” change. It is one of the most important advances in the assessment of psychotherapy outcomes of the last three decades. Such figures, derived from standardized formulas, allow us to determine when the change is actually due to treatment versus other (“noise”) factors. To our clients, change is change. It doesn’t matter what caused it. To therapist, it is essential to know what contribution they uniquely make to the change process so that we can improve the effectiveness of care. We do not and should not take credit for the changes that happen WHILE people are in care but that are not attributable to it. The most recent studies of the most researched treatment method (CBT) confirm the 50% figure. The study you cite is interesting. It was published in 1995. If you google it, you’ll be able to read scores of commentaries about the methods used in the study (survey, from a limited, highly select sample, etc.). No researcher takes the 90% figure seriously. Our own measures, applied by 10’s of 1000’s of therapists worldwide indicate that approximately 64% of people experience a reliable improvement (e.g., better than chance, maturation, and error)–a figure that is high compared to many medical procedures, and which simultaneously shows there is much room for improvement.

      Reply

Trackbacks

  1. Home | therapeutic alliance in family therapy says:
    April 29, 2015 at 1:23 pm

    […] A good therapeutic alliance in family therapy : What it is and what we can do? […]

    Reply

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

 

SEARCH

Subscribe for updates from my blog.

  

Upcoming Training

FIT Supervision Intensive 2018
FIT Implementation Intensive 2018

FIT Implementation Intensive 2019
FIT Training of Trainers 2019
FIT Deliberate Practice Aug 2019 - ICCE

NREPP Certified

HTML tutorial

LinkedIn

Topics of Interest:

  • Behavioral Health (107)
  • behavioral health (4)
  • Brain-based Research (1)
  • CDOI (14)
  • Conferences and Training (66)
  • deliberate practice (21)
  • Dodo Verdict (8)
  • Drug and Alcohol (3)
  • evidence-based practice (56)
  • excellence (57)
  • Feedback (32)
  • Feedback Informed Treatment – FIT (156)
  • FIT (18)
  • FIT Software Tools (10)
  • ICCE (25)
  • Implementation (5)
  • medication adherence (3)
  • obesity (1)
  • PCOMS (10)
  • Practice Based Evidence (36)
  • PTSD (3)
  • Suicide (1)
  • Termination (1)
  • Therapeutic Relationship (3)
  • Top Performance (39)

Recent Posts

  • Time for a New Paradigm? Psychotherapy Outcomes Stagnant for 40 years
  • Beating the Dodo Verdict: Can Psychotherapy Ever Achieve Better Results?
  • “Clients Won’t Like It” and Other Concerns about Feedback Informed Treatment
  • Aren’t You the Anti-Evidence-Based Practice Guy? My Socks. And Other Crazy Questions.
  • What Works in Psychotherapy? Valuing “What Works” rather than Working with What We Value

Recent Comments

  • Rikke Addis on Time for a New Paradigm? Psychotherapy Outcomes Stagnant for 40 years
  • alan beach on Time for a New Paradigm? Psychotherapy Outcomes Stagnant for 40 years
  • Adriano Bugliani on Time for a New Paradigm? Psychotherapy Outcomes Stagnant for 40 years
  • Nick Drury on Time for a New Paradigm? Psychotherapy Outcomes Stagnant for 40 years
  • John Fitzgerald on Symptom Reduction or Well-being: What Outcome should Matter Most in Psychotherapy

Tags

addiction Alliance behavioral health brief therapy Carl Rogers CBT cdoi common factors conferences continuing education denmark evidence based medicine evidence based practice Evolution of Psychotherapy excellence feedback feedback informed treatment healthcare holland icce international center for cliniclal excellence medicine mental health meta-analysis Norway NREPP ors outcome measurement outcome rating scale post traumatic stress practice-based evidence psychology psychometrics psychotherapy psychotherapy networker public behavioral health randomized clinical trial SAMHSA session rating scale srs supershrinks sweden Therapist Effects therapy Training

FIT Software tools

FIT Software tools