SCOTT D Miller - For the latest and greatest information on Feedback Informed Treatment

  • About
    • About Scott
    • Publications
  • Training and Consultation
  • Workshop Calendar
  • FIT Measures Licensing
  • FIT Software Tools
  • Online Store
  • Top Performance Blog
  • Contact Scott
scottdmiller@ talkingcure.com +1.773.454.8511

Supervision: Time for a New Way or to Dump the Practice Altogether?

January 10, 2020 By scottdm 2 Comments

Therapists value supervision.  How do we know?  Research.

In their massive, long-term international study of therapist development, for example, Orlinsky and Rønnestad (2005) found, “practitioners at all experience levels, theoretical orientations, professions, and nationalities report that supervised client experience is highly important for their current and career development” (p. 188).

Regulatory boards deem supervision essential, in most jurisdictions requiring trainees have 3,000 hours –or nearly two years of full time work — before becoming licensed to practice independently.

Given such beliefs and requirements, one might reasonably conclude the evidence-base for clinical supervision is substantial.  And yet, a thorough search of the literature for studies investigating the relationship between the practice and treatment outcome turns up a mere handful of empirically sound investigations.  For these, the best that can be said is, the results are decidedly mixed (1, 2, 3, 4, 5).  It’s notable that a popular text on “evidence-based” supervision written by two leading researchers cites zero evidence that it leads to better results!

“Ultimately,” argue researchers Wrape and colleagues (2014), “the criteria by which to evaluate supervision’s efficacy … lie(s) in its power to bring about favorable client changes” p. (36).  Clearly, the assumption traditional supervision provides clinicians with the knowledge, skills, and capability necessary to provide safe and effective therapy is empirically questionable.  Perhaps the time has come to dump supervision altogether or at least consider new ways for helping clinicians deliver more effective services?

As already indicated, plenty of evidence indicates clinicians appreciate supervision.  Indeed, a near linear relationship exists between the number of hours received and levels of practitioner self-efficacy, job satisfaction, burnout, treatment knowledge, acquisition and use of particular treatment techniques and skills.  And therein lies the paradox: how, you might reasonably wonder, could such positive results not translate into improved outcomes for clients?

The answer?  Experience ([i.e., time in the field] of supervisors and therapists), self-rated efficacy, treatment knowledge, and competence in delivering particular treatment approaches are not, and have never been, related to outcome.  So, while regular contact with peers and mentors provides with critical emotional support for clinicians, something more and different is required for them to become more helpful to their clients.

Clues to what might replace traditional supervision can be found in a study by Goldberg et al. (2015) — the only study to date of a process resulting in continuous improvement in therapist effectiveness over time.  In it, practitioners engaged in five distinct activities: (1) formal and routine measurement of their client’s experience of progress and quality of the therapeutic relationship; (2) identification of performance shortfalls using the data generated by routine outcome monitoring; (3) ongoing clinical/supportive supervision to aimed at improving responsiveness in real time to the differences between individual clients; (4) coaching from an external expert; and (5) engagement in deliberate practice around basic therapeutic skills.

Filed Under: deliberate practice, Feedback Informed Treatment - FIT, supervision Tagged With: psychotherapy supervision

Do you ever have “Anticipointment?”

January 2, 2020 By scottdm 7 Comments

As a mental health professional, how do you approach a New Year?  Are you filled with hope for our field?  Suffering a twinge (or more) of despair?  Maybe you’re in reflective mood, longing for the ‘good ole days’?  Or is the difference between December 31st and January 1st just like any other twenty four hour period?

Recently, I came across a word that captured my experience.  I’d never seen it before.  Anticipointment.  Online sources define it as, “The state of mind resulting from anticipating and then being disappointed when expectations are not met.”  Truth is, I recognize now I’ve often experienced this, but mistaken it for nostalgia. I t’s not.

So what about you?  On one hand, we do have good reason to be hopeful.  After all, decades of evidence provide overwhelming proof of the effectiveness of psychotherapy.  On the other hand, the same research shows our outcomes have not improved in more than 40 years.

Returning to the positive side, researchers have now identified two specific practices — routine outcome monitoring and deliberate practice — that enable clinicians to accomplish something never before recorded in history the history of the field; namely, steadily improve their effectiveness from year to year.

On the negative side, the field –researchers, clinicians, payers, and policy makers alike — continues to be strongly attracted to treatment models, I’d say fatally so.  Crossing the term, “cognitive behavioral therapy” (CBT) with “randomized controlled trial” (RCT) on Google Scholar results in 1,930,000 hits!  In case you glossed over the figure, that’s one million, nine hundred thirty thousand — and that’s just one method out of hundreds.  By contrast, a similar search of “tetanus vaccine,” produces slightly more than 18,000 results.  I ask, does our field really need to spend precious resources on another study of CBT?  It’s discouraging.  More broadly, given the clear and overwhelming evidence of equivalence between treatment methods for any DSM diagnosis that’s been tested — and yes, that includes so-called trauma-specific approaches — do we need any more RCT’s pitting one protocol against another?  Wouldn’t time be better spent studying how practitioners can improve their ability to attune and respond to their clients?  After all, these two transtheoretical skills, researchers Stiles and Horvath, point out, are why “certain therapists are more effective than others” (p. 71)

Zombie ideasFor me, I approach each New Year with a strong sense of anticipointment.  I want to be hopeful, believe there are good empirical reasons to do so.  At the same time, I fear little will change.  Turns out, some of our field’s beliefs and practices refuse to die.

What can we do to escape these “walking dead?”

A quick Google search of “Surviving the Zombie Apocalypse” turns up in three clear themes.  First, make sure you are not a zombie.  “The main epidemiological risk of zombies,” says Wikipedia, “is that their population just keeps increasing [as] generations of humans merely ‘surviving’ … feed” them.  In the case of psychotherapy, I’ve come to believe practitioners often know certain popular ideas and practices are dead, but go along with them anyway.  We must say, “no” or risk infecting the next generation.

The second suggestion makes the first possible: don’t go it alone.  In short, you have a better chance of surviving in a group that shares your objectives.  If your professional goals as a therapist include improving your results, the International Center for Clinical Excellence might be your people.  It’s free.

Third, and finally, focus on the basics.  In the case of real zombies, that means securing water, shelter, and food over other, possibly more MGinnisstimulating interests.  Similarly, for therapists, chasing the “new and promising” must give way to personal work; in particular, deepening core skills associated with effective clinical practice.  If becoming a more effective version of you is of interest, check out an article on the subject published this week.  My colleague Brooke Mathewes and I provide concrete guidance for finding your performance edge and then developing, executing, and evaluating a highly individualized plan for improvement.

Filed Under: Feedback Informed Treatment - FIT

Where did you get that idea?

December 22, 2019 By scottdm 4 Comments

“I heard Scott Miller say it,” the man sitting next to me said.

“Really?” I responded, somewhat incredulous.  After all, I didn’t recall ever saying such a thing.  More to the point, it’s just not something I would say.  Its wrong.  Then again, it was clear he didn’t know that I was Scott Miller.  Not wanting to disrupt the presenter before me at the conference, I’d quietly snuck into the room, dressed in my “civies,” shortly after the meeting had started.

“Yep,” he replied, his voice full of certainty, “as I understand it, he says it all the time.”  Making “air” quote marks with his fingers, “If the client is not changing within three visits, you should terminate the treatment.”

You should have seen the look on his face when later our eyes met as I took to the stage to do my presentation.

On many occasions over the years, I’ve heard people quote me saying things I’ve never said.  Here’s a common one:

“Scott Miller says all you need for successful treatment is a good therapeutic relationship.”

Just so you know, I’ve never said this.  Ever. And yet, once, after I corrected a nationally known practitioner in front of a large audience, he nonetheless repeated it in his newsletter.  Here’s what I have said and continue to say:

  • All treatment models work equally well.  All.
  • Of all the factors affecting outcome, the specific approach used has the smallest impact.  By comparison, the relationship between client and therapist contributes eight to nine times more. 

Another:

“Scott Miller says therapists help 80% of their clients.”

Once again, I’ve never said this.  In this instance, the misquote is more understandable.  Here’s what I do say at almost every workshop:

  • Decades of research and hundreds of study document psychotherapy works.
  • The effectiveness of psychotherapy has remained fairly stable over the years.
  • In most studies, the average treated client is better off than 80% of the untreated comparison sample.

I’m certain it’s the last of these statements that causes problems.  Presented, as it, is in “researchspeak,” it’s easy to misunderstand.  Read it again and you’ll see it does not mean we help 80% of our clients.  Rather, its about the advantage therapy offers relative to receiving no treatment at all.  By contrast, the percentage we help — as I’ve blogged about on numerous occasions — is actually around 50%.

Now, in the interest of fairness, let me mention something I often say but have never heard misquoted.  At nearly of all my workshops, I joke, “The ORS and SRS may not be the best scales ever developed … but they are free!”  The latter part of that statement is absolutely true.  Clinicians wishing to solicit feedback from clients about their progress and the quality of the therapeutic relationship simply need to register for a free paper and pencil license.  That said, recent research out of the University of Nottingham is giving me pause about the other half.

Just last week, I interviewed Professor Sam Malins who, together with a team of others, has been studying the use of the scales in real world clinical settings for a number of years.  In addition to replicating a number of important findings (e.g., the longer you use the ORS and SRS, the more impact they have on retention and effectiveness; spending time gathering information for diagnosis and treatment planning results in poorer outcomes, the scales can be used to identify skill development opportunities), he also found the Outcome Rating Scale predicted …  oh, just watch the video yourself.  That way, I won’t be misquoted!

Filed Under: Feedback Informed Treatment - FIT

  • « Previous Page
  • 1
  • …
  • 21
  • 22
  • 23
  • 24
  • 25
  • …
  • 108
  • Next Page »

SEARCH

Subscribe for updates from my blog.

[sibwp_form id=1]

Upcoming Training

There are no upcoming Events at this time.

FIT Software tools

FIT Software tools

LinkedIn

Topics of Interest:

  • behavioral health (5)
  • Behavioral Health (109)
  • Brain-based Research (2)
  • CDOI (12)
  • Conferences and Training (62)
  • deliberate practice (29)
  • Dodo Verdict (9)
  • Drug and Alcohol (3)
  • evidence-based practice (64)
  • excellence (61)
  • Feedback (36)
  • Feedback Informed Treatment – FIT (230)
  • FIT (27)
  • FIT Software Tools (10)
  • ICCE (23)
  • Implementation (6)
  • medication adherence (3)
  • obesity (1)
  • PCOMS (9)
  • Practice Based Evidence (38)
  • PTSD (4)
  • Suicide (1)
  • supervision (1)
  • Termination (1)
  • Therapeutic Relationship (9)
  • Top Performance (37)

Recent Posts

  • Agape
  • Snippets
  • Results from the first bona fide study of deliberate practice
  • Fasten your seatbelt
  • A not so helpful, helping hand

Recent Comments

  • Typical Duration of Outpatient Therapy Sessions | The Hope Institute on Is the “50-minute hour” done for?
  • Dr Martin Russell on Agape
  • hima on Simple, not Easy: Using the ORS and SRS Effectively
  • hima on The Cryptonite of Behavioral Health: Making Mistakes
  • himalaya on Alas, it seems everyone comes from Lake Wobegon

Tags

addiction Alliance behavioral health brief therapy Carl Rogers CBT cdoi common factors continuing education denmark evidence based medicine evidence based practice Evolution of Psychotherapy excellence feedback feedback informed treatment healthcare holland Hypertension icce international center for cliniclal excellence medicine mental health meta-analysis Norway NREPP ors outcome measurement outcome rating scale post traumatic stress practice-based evidence psychology psychometrics psychotherapy psychotherapy networker public behavioral health randomized clinical trial SAMHSA session rating scale srs supershrinks sweden Therapist Effects therapy Training