SCOTT D Miller - For the latest and greatest information on Feedback Informed Treatment

  • About
    • About Scott
    • Publications
  • Training and Consultation
  • Workshop Calendar
  • FIT Measures Licensing
  • FIT Software Tools
  • Online Store
  • Top Performance Blog
  • Contact Scott
scottdmiller@ talkingcure.com +1.773.454.8511

Recent study documents the effectiveness of psychotherapy has been overstated: An example of an RFTM and PEBKAC problem

October 5, 2015 By scottdm 10 Comments

RTFM

Not being a computer nerd, I’d never come across these expressions.  My 14-year-old son was the first person I heard use the terms.  He was referring to a problem I was having with my desktop computer.  To be sure, I’m no Luddite.  Still, “computer” will always be a second language for me.

With a restart and few clicks of the mouse, he resolved my issue.  When I asked him to explain what had caused the problem–hoping either to avoid or be able to resolve a similar occurrences in the future–he quipped, “Dad, it’s an RTFM problem, most likely in the PEBKAC.”

“RTFM problem?  In the PEBKAC?”

“Yeah,” he said with a laugh, then walked away.

Consulting Google, I quickly learned what the terms meant: Read the F%$&ing Manual as the Problem Exists Between the Keyboard and the Computer.  Swallowing my pride (and a fair bit of irritation), I had to admit my son was right.  I had not read the manual.  I didn’t want to read the manual.  I WANTED MY PROBLEM SOLVED!  As a result, I’d spent an increasingly frustrating hour, first tinkering, then on the phone with less than helpful customer service representative.

So, what’s this got to with psychotherapy?

Over the weekend, the twittersphere lit up with posts about a story in the New York Times: Effectiveness of Talk Therapy is Overstated.  The article reported on a new study which had found that psychotherapy was “25% less effective…than previously thought.”

The response to the story was swift, questioning, for the most part, motives and methodology:

  • Who published this study and why?
  • What kind of therapy was studied?  
  • Why the emphasis on quantitative studies?
  • Why is the media always so negative about therapy?
  • Is this the whole picture?

The reaction is understandable.  The headline and story are enough to give any practicing therapist pause.  More so because, as I reviewed in my recent presentation at the Evolution of Psychotherapy conference, they are already working in an challenging practice environment.  Rucost_of_living_income_4x3_1-300x225les and regulation are on the increase.  Incomes are on the decline.  They know the value of the work they do.  They can see it in the people they treat.  Instead of recognizing the value of the services offered, the effectiveness of the field, it’s methods, and practitioners are called into question.

The interaction with my son still fresh in my mind, I wondered, “Could this be a RTFM problem located in PEBKAC?”

Said another way, “Had anyone actually read the study?!”  Despite assurances that “the facts are always friendly” from the likes of Carl Rogers, we know therapists don’t read research, for example.  How do we know?  RESEARCH!

In truth, the study is a merely an empirical call for more openness and transparency in publication of psychotherapy research.  Inflated estimates of effectiveness help no one.  Not practitioners.  Not clients.  Not the field.

The very same factors that lead the media to highlight the most attention-grabbing aspects of a news story, influence what gets submitted, reviewed, and published in scholarly journals.  Sad, but true.  To get the full picture–to determine “what really works”–results from all research–whether published or not–must be tracked and reported.  Not surprisingly, when you get beyond the headlines, the story is almost always less dramatic and more nuanced.

Additionally, the research article contains some real gems!  For example:

  • Psychotherapy was found clearly superior to a variety of placebo and no-treatment controls, including treatment-as-usual, pill-placebo, and non-specific control conditions.
  • Consistent with research reported on this blog, no differences in outcome were found between treatment approaches!
  • No differences in outcome were found between psychological treatments and anti-depressant medication.
  • Finally, the effect of psychotherapy plus medications was superior to anti-depressant medication alone.

What’s not to like?

And while we’re on the subject, this week another study was published.  Click on the link and give it a read.  I’m sure there will be no headline in the New York Times, despite the fact that it’s the largest psychotherapy outcome study in history!   What are the results?  RTFM!

Until next time,

Scott

Scott D. Miller, Ph.D.
Director, International Center for Clinical Excellence

PS: Registration is open for the ICCE March Intensives:

Feedback Informed Treatment Advanced Intensive (March 17-19, 2016)
Feedback Informed Treatment Supervision Intensive (March 21-23, 2016)

Filed Under: Feedback Informed Treatment - FIT

Comments

  1. Peter Edwards says

    October 12, 2015 at 7:31 pm

    OK, so your blurb got me reading your blog – well done. Please don’t waste my time in future with stuff that doesn’t add anything to my ability to help people, but promotes populist articles. It just undermines your credibility. (It’s 20.30 and I’ve been working since 09.00 and yes, I’m tired!).

    PS – please update your error checking – your blog refuses my legitimate URL http://www.counsellingplus.co. As you point out, technology moves on.

    Reply
    • scottdm says

      October 13, 2015 at 6:13 pm

      Hi Peter:

      Thanks for taking the time to read my blog. The article was based on a research study that documenting a decline in effectiveness. As I relate in the post, I’d received a number of emails asking me about the piece. Our ability to help our clients is already being limited by the interpretation of such articles by payers, regulatory bodies, and consumers of mental health services. I hope that by making practitioners aware, they will be able to address concerns before they cause problems. Best wishes in your work!

      Scott

      Reply
  2. C says

    October 12, 2015 at 8:59 pm

    Thanks for the info!

    Reply
  3. C says

    October 12, 2015 at 8:59 pm

    Thanks for the review. Much appreciated.

    Reply
  4. Jane Pearce says

    October 13, 2015 at 10:44 am

    Excellent post. Thank you.

    Reply
    • scottdm says

      October 13, 2015 at 6:10 pm

      Thank you Jane. Pass the word!

      Reply
  5. Ken McCallion, MA, CPsych Assoc says

    October 13, 2015 at 9:47 pm

    The Times uses ‘talk therapy’ ‘psychological treatment’ interchangeably. If Dreissen, Hollen, Bockting and colleagues included only studies of ‘talk therapy,’ that would be an even bigger problem than publication bias. Show me a clinician that limited and I’ll show you someone who should have never gotten licensed.

    Reply
  6. Nick Drury says

    October 14, 2015 at 1:02 am

    Hi Scott, I’d be interested to see what Jackie Sparks made of the first paper – I think she has an astute eye for picking up all sorts of research bias. With regards to the 2nd, well it takes as long as it takes to complete therapy sort of conclusion. But, and I may be wrong, it seems the UK NHS has in these CORE statistics the potential to tell us how many (what percentage of) people are entering the front door of their mental health services and exiting the service ‘recovered’ – versus those who either drop out, die, or become chronic users. Does CORE record if they are symptom & medication free, and in full-time work or study – as Seikkula is recording in his outcome reports?

    regards

    Nick D

    Reply
  7. Yngve says

    November 24, 2015 at 12:53 pm

    PEBKAC is explained wrong in your article I believe. the C stands for Chair, not Computer.. 😉

    Reply
  8. Lauren Woodley says

    December 5, 2015 at 1:37 am

    I really appreciated all of the insight you give to psychotherapy. Specifically, you talk about how this type of therapy was found clearly superior to a variety of placebo and non-treatment controls, which is really surprising to me. I can see, though, that this is a way to get deeper insight on the patients condition and mindset and help the therapist to have a better grasp on how to treat and help the patient. Thus, because there is a better understanding of the problem, there will be better results. Thank you so much for sharing!

    Reply

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *


The reCAPTCHA verification period has expired. Please reload the page.

SEARCH

Subscribe for updates from my blog.

loader

Email Address*

Name

Upcoming Training

Jun
03

Feedback Informed Treatment (FIT) Intensive ONLINE


Oct
01

Training of Trainers 2025


Nov
20

FIT Implementation Intensive 2025

FIT Software tools

FIT Software tools

LinkedIn

Topics of Interest:

  • Behavioral Health (112)
  • behavioral health (5)
  • Brain-based Research (2)
  • CDOI (14)
  • Conferences and Training (67)
  • deliberate practice (31)
  • Dodo Verdict (9)
  • Drug and Alcohol (3)
  • evidence-based practice (67)
  • excellence (63)
  • Feedback (40)
  • Feedback Informed Treatment – FIT (246)
  • FIT (29)
  • FIT Software Tools (12)
  • ICCE (26)
  • Implementation (7)
  • medication adherence (3)
  • obesity (1)
  • PCOMS (11)
  • Practice Based Evidence (39)
  • PTSD (4)
  • Suicide (1)
  • supervision (1)
  • Termination (1)
  • Therapeutic Relationship (9)
  • Top Performance (40)

Recent Posts

  • Agape
  • Snippets
  • Results from the first bona fide study of deliberate practice
  • Fasten your seatbelt
  • A not so helpful, helping hand

Recent Comments

  • Bea Lopez on The Cryptonite of Behavioral Health: Making Mistakes
  • Anshuman Rawat on Integrity versus Despair
  • Transparency In Therapy and In Life - Mindfully Alive on How Does Feedback Informed Treatment Work? I’m Not Surprised
  • scottdm on Simple, not Easy: Using the ORS and SRS Effectively
  • arthur goulooze on Simple, not Easy: Using the ORS and SRS Effectively

Tags

addiction Alliance behavioral health brief therapy Carl Rogers CBT cdoi common factors conferences continuing education denmark evidence based medicine evidence based practice Evolution of Psychotherapy excellence feedback feedback informed treatment healthcare holland icce international center for cliniclal excellence medicine mental health meta-analysis Norway NREPP ors outcome measurement outcome rating scale post traumatic stress practice-based evidence psychology psychometrics psychotherapy psychotherapy networker public behavioral health randomized clinical trial SAMHSA session rating scale srs supershrinks sweden Therapist Effects therapy Training