SCOTT D Miller - For the latest and greatest information on Feedback Informed Treatment

  • About
    • About Scott
    • Publications
  • Training and Consultation
  • Workshop Calendar
  • FIT Measures Licensing
  • FIT Software Tools
  • Online Store
  • Top Performance Blog
  • Contact Scott
info@scottdmiller.com 773.404.5130

Three, Free Evidence-Based Resources for Improving Individual Therapist Effectiveness

January 1, 2017 By scottdm 27 Comments

Take a look at the figure to the right.  therapist-decline
It’s data taken from the largest study conducted in the history of psychotherapy research examining the relationship between experience and effectiveness.

Each of the smaller lines represents the outcomes of an individual practitioner followed, in some cases, over a 17-year period.  The single, thicker, dashed-line plots the average across all, 170 practitioners in total–a group that measured the results of their work at every visit, with every client.

The data confirm what a host of correlational studies have hinted at since the mid-1980’s: in general, clinician effectiveness declines with time and experience.

slopeIt’s not a steep slope, to be sure.  It is slow and gradual, like a leak in a bicycle tire.  Most problematically, other research shows, it’s also imperceptible.  Indeed, as experience in the field grows, clinician-confidence increases, leading most to see themselves as more effective than their results actually indicate.

Now, consider the second figure.  Once again, outcomes of individual practitioners are plotted.therapist-improve

Here, however, the slope is positive.  In other words, therapists are becoming more and more effective over time.  As before, the change is slow and gradual.  Said another way, there are no shortcuts to improved outcomes.  Slow and steady wins the race.  More, unlike the prior results, therapists are both aware of their growth and, curiously, less confident about the effectiveness of their work.

Importantly, the data from the latter are not drawn from the application of some hypothetical, yet-to-be-hoped-for treatment model or training scenario.  Indeed, they are from the only published study to date documenting the factors that actually influence development of individual therapist effectiveness. When employed purposefully and mindfully, clinicians improve three times larger than they were documented to decline in the prior study.

What are these factors?

As simple as it sounds: (1) measure your results; and (2) focus on your mistakes.incline

There is no way around this basic fact: any effort aimed at improving effectiveness begins with a valid and reliable estimate of one’s current outcomes. Without that, there is no way of knowing when progress is being made or not.

On the subject of mistakes, several studies now confirm that “healthy self-criticism,” or professional self-doubt (PSD), is a strong predictor of both alliance and outcome in psychotherapy (Nissen-Lie et al., 2015).  Not surprisingly, therapist effectiveness improves in practice environments that provide: (1) ample opportunity and a safe place for discussing cases that are not making progress (or deteriorating); and (2) concrete suggestions for improvement that are tailored to the individual therapist.

Here are three, evidence-based resources you can tap in your efforts to improve your effectiveness in 2017:

  • Begin measuring your results using two simple scales that have been tested in diverse settings and with a wide range of treatment populations.  In 2013, they were approved by the Substance Abuse and  Mental Health Services Administration (SAMHSA) and listed on the National Registry of Evidence-based Programs and Practices.  Get them for free by registering for a free license here.
  • For a limited time, I’ll send you a free copy of the “How to” manual for using the two measures.  Just email me at: scottdmiller@talkingcure.com.  Online, the manual retails for $24.95.  It’s one of a series of 5, which SAMHSA gave perfect marks to as a support to implementation of routine outcome measurement in clinical practice.
  • If you work alone or need a error-friendly practice community to discuss your work, join the International Center for Clinical Excellence.  It’s our free, online community.  There, you can link up with other like-minded clinicians, share your work, discuss your outcomes, watch “how-to” videos, help and be helped by practitioners around the world.

One final suggestion.  Since “simple” does not necessarily mean, “easy,” join me in Chicago for one of our upcoming intensive trainings.  Coming up in March is the “Advanced Intensive in Feedback Informed Treatment,” and the “Feedback Informed Supervision Intensive.”  You’ll meet colleagues from around the world, learn from an international faculty, and leave with all the knowledge and skills you need to use outcomes to improve the quality and outcome of your practice or agency.  The early bird rate is still available and we’ve only got a few spots left in each course.

Register by clicking on the text above or icons on the right side of the page.

Until then, best wishes for the New Year!

Scott

Scott D. Miller, Ph.D.
Director, International Center for Clinical Excellence
Scott D Miller Symposium bg3

Filed Under: Feedback Informed Treatment - FIT

Comments

  1. Yerachmiel says

    January 4, 2017 at 5:36 pm

    The results are not intuitive and somewhat scary. The question is how to reverse the trend.

    Reply
  2. Vivian Luth-Hanssen says

    January 4, 2017 at 6:14 pm

    I am wondering if the research results you share with us here about the effectiveness of therapists also could be suggested for leaders? Without research to back it up, my opinion is that it is very important also for leaders to engage in “healthy self-criticism and professional self-doubt. Could the two measures you present be used as well by leaders with their employees?

    Reply
  3. Donna Johnson says

    January 4, 2017 at 7:05 pm

    Thank you for the resources– they look very helpful. Research-based outcomes data is always appreciated. I look forward to reviewing them more in depth.

    Reply
  4. Julie Selwyn says

    January 4, 2017 at 7:11 pm

    Thanks for these really useful tools. Not just useful for therapists but for researchers who are evaluating group training programmes that might be being delivered on multiple sites. Quick and easy to use.

    Reply
  5. James Vigorito says

    January 4, 2017 at 8:12 pm

    Thank you, Scott, for the free manual. It will be very helpful in improving my therapeutic skills.

    Reply
  6. john ezell says

    January 4, 2017 at 9:20 pm

    I continue to enjoy all the information you provide. After 40+ years in the profession, I have a real need to get out of my old habits. I have several of your books which I have read and refer to many times. It would be great to participate in all of the available training, but I am afraid I worked too long in agencies before finally moving to private practice. It has been slow going, but I am getting there. I have penciled your training in for 2018. Thanks so much for your help

    Reply
  7. pit kolodinsky says

    January 4, 2017 at 9:28 pm

    any way to still purchase content from this webinar:
    https://www.eventbrite.ie/e/fall-2016-feedback-informed-treatment-webinar-series-tickets-26431099129

    Reply
  8. Helena Rose says

    January 4, 2017 at 9:45 pm

    This is an important theme in my practice. I often worry that I doubt myself too much, or that I might become complacent in my work. Whilst I think it’s important to keep these concerns ‘in check’, it’s good to think that they might, together with client feedback, be a valued resource. Great blog post!

    Reply
  9. Ella says

    January 5, 2017 at 10:48 am

    Thank you so much!
    I’ve used the ORS and SRS in my Dutch counselling practice (www.bureau-uil.nl). Thanks to Arnoud Huibers (Solutions Centre) I’ve known about these instruments for years.
    Keep on doing this great job, please! Smile, Ella

    Reply
  10. Stan Bayne says

    January 5, 2017 at 1:32 pm

    I’ve followed you for years after seeing a presentation in North Carolina. I believe in the work your doing. The only problems is Chicago is way up north and far from the Sunny South. Hopefully you can find your way down here. Expense is a primary concern.
    Thanks so much.
    Keep up the good work.

    Reply
  11. Eoin Stephens says

    January 5, 2017 at 3:22 pm

    Thanks Scott, that’s very thought-provoking.

    I’ve always been a fan of healthy self-doubt in therapy professionals. Has anyone studied the difference between this and a more toxic kind of self-doubt?

    Reply
  12. Pavlina Strnadova says

    January 5, 2017 at 11:28 pm

    Hi Scott
    You’ve written that nothing improves therapist effectiveness. Not even supervision… But what if I measure my results and discuss cases with which I cannot move on my own with my supervisor? Both of us have attended your great FIT workshop in 2014 in Czech Republic and he is en expert :-)

    Reply
  13. Cheryl Leber says

    January 6, 2017 at 10:11 am

    Many thanks for your generosity in providing your well researched tools to practitioners.
    Outcome measures that help us improve effective treatment should be used by all practitioners interested in improving outcomes for their clients.

    Reply
  14. Barbara Lewis says

    January 6, 2017 at 10:41 am

    I always enjoy reading you blog I think that practitioners tend to focus more out the ‘outcome’ rather than the actual ‘process’, which to me is the key to learning.

    Reply
  15. Susan Hackett says

    January 6, 2017 at 7:51 pm

    Hey Scott, Thanks for the free manual. I have been a fan of yours for years. Your client-directed approach has shaped my therapy with kids and families, for sure!

    Reading your blog is challenging, but it sure has the sad ring of truth to it. I will take up your measures again and try, again to stop the slide into mediocrity.

    Thanks for keeping up the faith – Sue

    Reply
  16. Domina Matthews Page says

    January 7, 2017 at 1:27 pm

    Appreciate the feedback of the ORS and SRS and feel you hit upon an important point. The therapist using the instruments has to “want” the feedback/criticism. Then use information to improve. So how do we provide supervisors with skills to “guide” their staff into a place acceptance. If not handled correctly the ORS and SRS become bookends and resentment of therapist and supervisor. Cultural change always a challenge. Most supervisor training I have observed are moving more to how to “collect” the data to demonstrate maximum productivity and evidence based programming which in themselves do not make better therapy or therapists.

    Reply
  17. Russell J Wilson says

    January 8, 2017 at 10:46 pm

    Thanks for the manual. I think everyone could benefit from their use, regardless of their model. I do believe model is still important, but it’s hard work, initially, negotiating both SRS and model with clients always rushing to get their problems fixed NOW.

    Reply
  18. ann nielsen says

    January 11, 2017 at 10:00 am

    Dear Scott,

    Thank you for the manual!
    As the manager of a psychoterapeutic out patient Clinic always very good to be reminded of the importance of creating an enviroment were difficult case can be openly disscussed!!

    Reply
  19. Corinna Burrows says

    January 12, 2017 at 3:47 am

    Thanks for the info in your blog and sending through the manual – much appreciated. The data you refer to makes me think about years of experience and burnout. I notice that the graph with a positive slope follows outcomes for up to 6ish years, but the one with a negative slope follows outcomes for up to 17 years. I wonder whether the nature of this work means that any therapist will find their outcomes deteriorate if they do this work for too long without sufficient time away?

    Reply
  20. Jim Kreider says

    January 12, 2017 at 4:32 pm

    I take your making the FIT manual available for free as additional evidence of your commitment to improving mental health services to benefit both clients and practitioners. Thank you Scott! And thanks also for all the work you’ve don’t to bring together an evidence based approach and a respectful, empowering, compassionate view of those we serve.

    Reply
  21. Sjef de Vries says

    January 26, 2017 at 1:32 pm

    Thanks for the manual. There are lot of manuals/protocols that don’t work at all. This one does.

    Reply
  22. Barry McInnes says

    January 26, 2017 at 6:21 pm

    Scott, very many thanks for the manual. I’m really impressed by the level of detailed guidance, right down to the dialogues that we might have with clients. As a ‘how to’ it ticks all the boxes. What always throws me is the scoring though – I’m much more used to the CORE measures, where higher scores mean the client is getting worse and not better – small detail in the big scheme of things!

    Cheers – Barry

    Reply
  23. Serafin Dillon says

    January 28, 2017 at 11:12 pm

    Thank you so much for your outstanding and courageous commitment to improving the field for clinicians and patients and the organisations serving communities. Your work is elegant and accessible.

    Reply
  24. Andrew S. says

    January 31, 2017 at 3:03 pm

    Thanks for the research and the resources. I am always wondering how effective I am and can be as a therapist. Using these resources will give me a better understanding of the work I am doing with my clients and give me much better insight into how they see therapy.

    Reply
  25. Loke says

    February 23, 2017 at 9:11 pm

    Thanks a lot for the manual Scott and for all that you do to improve the field. I look forward to start working with FIT.

    All the best from Sweden!

    Reply
  26. Matt says

    March 15, 2017 at 3:00 am

    Hi Scott,

    Thank you kindly for the resources and for continuing to bring awareness to this hugely important but all too often overlooked area of psychotherapy. It continues to amaze me that such simple acts of measuring results, seeking feedback, and learning from the data are not routine practice.

    Keep up the great work.

    Matt

    Reply
  27. Matthew Jarvinen says

    March 16, 2017 at 10:32 pm

    Thanks for these invaluable resources, Dr. Miller! The process of incorporating feedback-informed treatment methods into one’s practice for the first time can be a daunting task for both therapists and their clients, but your straight-forward tips and tools provide the clarity and confidence needed get started in this important aspect of our work. Looking forward to seeing how it improves patient care in my practice. Thanks again!

    Reply

Leave a Reply to Helena Rose Cancel reply

Your email address will not be published. Required fields are marked *

 

SEARCH

Subscribe for updates from my blog.

  

Upcoming Training

 ICCE FIT Intensive Training with Dr. Scott Miller
ICCE FIT Supervision Intensive Online Scott D Miller

FIT Software tools

FIT Software tools

NREPP Certified

HTML tutorial

LinkedIn

Topics of Interest:

  • Behavioral Health (110)
  • behavioral health (4)
  • Brain-based Research (2)
  • CDOI (14)
  • Conferences and Training (67)
  • deliberate practice (27)
  • Dodo Verdict (9)
  • Drug and Alcohol (3)
  • evidence-based practice (65)
  • excellence (61)
  • Feedback (38)
  • Feedback Informed Treatment – FIT (204)
  • FIT (25)
  • FIT Software Tools (12)
  • ICCE (26)
  • Implementation (7)
  • medication adherence (3)
  • obesity (1)
  • PCOMS (11)
  • Practice Based Evidence (38)
  • PTSD (4)
  • Suicide (1)
  • supervision (1)
  • Termination (1)
  • Therapeutic Relationship (8)
  • Top Performance (39)

Recent Posts

  • Developing a Sustainable Deliberate Practice Plan
  • Making Sense of Client Feedback
  • Umpires and Psychotherapists
  • Augmenting the Two-Dimensional Sensory Input of Online Psychotherapy
  • Death of a Friend

Recent Comments

  • Asta on The Expert on Expertise: An Interview with K. Anders Ericsson
  • Michael McCarthy on Culture and Psychotherapy: What Does the Research Say?
  • Jim Reynolds on Culture and Psychotherapy: What Does the Research Say?
  • gloria sayler on Culture and Psychotherapy: What Does the Research Say?
  • Joseph Maizlish on Culture and Psychotherapy: What Does the Research Say?

Tags

addiction Alliance behavioral health brief therapy Carl Rogers CBT cdoi common factors conferences continuing education denmark evidence based medicine evidence based practice Evolution of Psychotherapy excellence feedback feedback informed treatment healthcare holland icce international center for cliniclal excellence medicine mental health meta-analysis Norway NREPP ors outcome measurement outcome rating scale post traumatic stress practice-based evidence psychology psychometrics psychotherapy psychotherapy networker public behavioral health randomized clinical trial SAMHSA session rating scale srs supershrinks sweden Therapist Effects therapy Training