SCOTT D Miller - For the latest and greatest information on Feedback Informed Treatment

  • About
    • About Scott
    • Publications
  • Training and Consultation
  • Workshop Calendar
  • FIT Measures Licensing
  • FIT Software Tools
  • Online Store
  • Top Performance Blog
  • Contact Scott
info@scottdmiller.com 773.404.5130

Feedback is NOT Enough: A Brief Update about the Empirical Evidence

September 25, 2018 By scottdm 1 Comment

my way highwayThe use of routine outcome monitoring (ROM) is on the rise.  In the United States and abroad, regulatory bodies are actually mandating the gathering of outcome data as the new “standard of care.”

As agencies rush to implement–often at great cost in terms of time and money–the question remains: just how much does ROM contribute to improved retention and effectiveness?

Over 20 years ago, I began using outcome and alliance scales in my work as a therapist, asking clients at each visit to give me feedback about the qaulity of our relationship and their experience of progress.  Eventually, together with colleagues, I developed two, brief measures: the Outcome and Session Rating Scales.

Concern-signWhen studies using the scales began to appear in the literature, I was immediately concerned.  In my opinion, the results were just “too good to be true.”  First, the results were confounded by allegiance effects, having been done exclusively by people with a significant investment in the results.  More to the point, however, I was worried that the studies focused on the measures rather than on therapists.

Soon, as I predicted, other studies appeared with far more modest results.   And now, a meta-analysis of all studies using the ORS and SRS has been published, confirming that routinely measuring performance, improves outcome but not as much as reported in the original studies (viz., .27 versus .50).

resultsFor those involved in and advocating FIT (Feedback-Informed Treatment), this is an IMPORTANT study.  It makes clear that when working feedback-informed, improving effectiveness requires more than the use of two measures.  Indeed, it’s not really about the measures at all.  Rather, it’s about therapists using feedback to identify opportunities for their own professional development.

As my colleague and fellow psychologist, Birgit Valla, is fond of saying, “A stopwatch will not make you a better runner.  It’s not about the clock.  It’s how you use the information to identify small, specific aspects of your performance that could be improved and then practicing.”

That’s what the team at ICCE and I have been exploring these past 7 years.  The latest article summarizing that research was published just this week.

All the best,

Scott

Scott D. Miller, Ph.D.
Director, International Center for Clinical Excellence

P.S.: Registration for the Spring Intensives is open.  Click on the links below to reserve your spot!
ICCE - Advanced FIT Intensive 2019Feedback Informed Treatment SupervisionIntensive2019-Scott D Miller

 

 

Filed Under: Behavioral Health, deliberate practice, Feedback Informed Treatment - FIT

Comments

  1. Jean Hornung-Starr says

    September 26, 2018 at 6:39 pm

    I agree! When I saw your first sentence, Scott, I said to my husband: “But HE started it!” Thank you for recognizing that feedback is not for the greater glory of marketing the program, but for quietly guiding the therapists to know which way to lean in future work, and what areas of work they choose to further develop within themselves. Too often the results are supersized into training programs that are mandated for everyone, thus burdening a therapists’ time. When the human aspect of connecting with a client is removed from the equation, therapy is a revolving door, through which clients just go out of, more hopeless than when they came in. When a therapist’s time (and a client’s time) are respected, there can be time for pondering the meaning behind clients’ presentation. When I walk in the morning, or when I’m driving into work, often a thought will pop up that I want to inquire about with a client. I always remember your video of the therapist in England ( I think) who worked mostly from curiosity. There is no substitute for human contact in the process of healing.

    Reply

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

 

SEARCH

Subscribe for updates from my blog.

  

Upcoming Training

Aug
02

FIT Implementation Intensive 2021


Aug
04

Training of Trainers 2021

FIT Software tools

FIT Software tools

NREPP Certified

HTML tutorial

LinkedIn

Topics of Interest:

  • Behavioral Health (111)
  • behavioral health (4)
  • Brain-based Research (2)
  • CDOI (14)
  • Conferences and Training (67)
  • deliberate practice (28)
  • Dodo Verdict (9)
  • Drug and Alcohol (3)
  • evidence-based practice (66)
  • excellence (61)
  • Feedback (38)
  • Feedback Informed Treatment – FIT (207)
  • FIT (26)
  • FIT Software Tools (12)
  • ICCE (26)
  • Implementation (7)
  • medication adherence (3)
  • obesity (1)
  • PCOMS (11)
  • Practice Based Evidence (38)
  • PTSD (4)
  • Suicide (1)
  • supervision (1)
  • Termination (1)
  • Therapeutic Relationship (8)
  • Top Performance (39)

Recent Posts

  • Three Common Misunderstandings about Deliberate Practice for Therapists
  • Feedback Informed Treatment in Statutory Services (Child Protection, Court Mandated)
  • Do We Learn from Our Clients? Yes, No, Maybe So …
  • Developing a Sustainable Deliberate Practice Plan
  • Making Sense of Client Feedback

Recent Comments

  • Asta on The Expert on Expertise: An Interview with K. Anders Ericsson
  • Michael McCarthy on Culture and Psychotherapy: What Does the Research Say?
  • Jim Reynolds on Culture and Psychotherapy: What Does the Research Say?
  • gloria sayler on Culture and Psychotherapy: What Does the Research Say?
  • Joseph Maizlish on Culture and Psychotherapy: What Does the Research Say?

Tags

addiction Alliance behavioral health brief therapy Carl Rogers CBT cdoi common factors conferences continuing education denmark evidence based medicine evidence based practice Evolution of Psychotherapy excellence feedback feedback informed treatment healthcare holland icce international center for cliniclal excellence medicine mental health meta-analysis Norway NREPP ors outcome measurement outcome rating scale post traumatic stress practice-based evidence psychology psychometrics psychotherapy psychotherapy networker public behavioral health randomized clinical trial SAMHSA session rating scale srs supershrinks sweden Therapist Effects therapy Training