SCOTT D Miller - For the latest and greatest information on Feedback Informed Treatment

  • About
    • About Scott
    • Publications
  • Training and Consultation
  • Workshop Calendar
  • FIT Measures Licensing
  • FIT Software Tools
  • Online Store
  • Top Performance Blog
  • Contact Scott
scottdmiller@ talkingcure.com +1.773.454.8511

The Success Probability Index (SPI)

March 20, 2024 By scottdm 12 Comments

Its the biggest update to Feedback Informed Treatment (FIT) in two decades.

In the beginning, all we had were the measures. Clinicians administered the outcome and session rating scales at each session and then compared client scores to the clinical cutoffs (CCO) and reliable change index (RCI) to determine whether care was “on or off track.”

Remember this? You crossed the first session score (plotted along the horizontal axis) with the last session score (on the vertical axis). And while the simple graphic was great for determining whether a particular episode of care had been helpful (> 5 points from start to finish) or resulted in clinically significant change (i.e., crossed over the CCO), the static indices employed rendered it useless for assessing progress from session-to-session.

The evolution continued. As data gathered from clinical practice settings accumulated, it became possible to develop “trajectories of change.”

Similar to interpeting an IQ test, individual client scores from week to week (purple line) were plotted against the 25th, 50th and 75th percentile of the normative sample. As such, it indicated whether the client was progressing at, above, or below average compared to people with similar start scores. Unfortunately, however, it said nothing about being on track for a reliable of clinically significant improvement.

Users of Myoutcomes.com, Fitoutcomes.com, and OpenFIT will instantly recognize the graph pictured below.

Based on a decade of research, the colored zones were the first predictive trajectories ever developed for informing and improving mental health care.

Gone were the comparisons to percentile rankings of the normative sample. Instead, the green line represented the least amount of progress the client could make from session to session and still be on track for a successful outcome. Yellow was interderminate and red definately, “off track.”

Since first becoming available, the algorithms that produce the predictive trjectories have been checked and updated every three years or so. The latest review — involving millions of completed cases of care — confimed their ability to inform mental health services provided in diverse settings around the world.

All good. Except, it wasn’t.

Isn’t.

While offering a clear advantage over comparisons to the cutoff scores, percentile rankings, and pre-established change indices, the algorithm-driven, predictive trajectories were still static. Said another way, they did not change following the first visit. True, the initial score was a better predictor of success than a host of factors traditionally considered reliable indicators (e.g., diagnosis, prior treatment history, type and level therapist training). But surely, more accurate assessments of progress would be made if they took into account what happened from visit to visit. Indeed, wasn’t that the whole point of soliciting feedback? Improving the chances of success by adjusting services on an ongoing basis to better fit the individual client?

Enter the SPI, or “Success Probability Index.”

Briefly, the SPI offers an indication of the likelihood of success at each session based on the current and historical pattern of SRS and ORS scores. Importantly, the particular pattern used to generate the index at any given session (e.g., average, slope, change in scores since the prior visit or over the course of care) varies depending on which most accurantely predicts success at the end of care. As can be seen in the screenshot below, despite similar start scores, the different patterns of progress represented in the two graphs result in different predictions. Specifically, the case on the left is on track, while the one on the right (coded in red), is about 16.5% below the average successful client.

In the near future, I’ll publish a “FIT TIP” or two explaining in greater detail both meaning and use of the SPI. In the meantime, take a look at the video produced by Myoutcomes.com — the first system to make the SPI available to their users.

Until next time,

Scott
Director, International Center for Clinical Excellence

Filed Under: Feedback Informed Treatment - FIT

Comments

  1. Vijay Gopal says

    March 21, 2024 at 7:14 pm

    Hi Scott,
    This is exciting to know! I am so glad to hear of a dynamic prediction for a specific client.

    Is there absolutely no way the SPI can be computed on a spreadsheet? If it is a “complicated formula” as you say – could it be provided as an spreadsheet template?

    I will truly appreciate it if this could be done.

    Thank you for this upgrade. FIT has been a lifesaver for me – I cannot thank you enough for it. Looking forward to your reply

    Reply
    • scottdm says

      March 21, 2024 at 8:45 pm

      Absolutely no way. It’s dynamic, so it has to check the calculations at each visit against the database.

      Reply
  2. Patric Esters says

    March 21, 2024 at 7:34 pm

    Dear Scott,
    This dynamic index sounds very interesting, and wonderful that you also add nuance to the SPI and that it can foster further exploration between client and therapist rather than being “the truth” with a capital T. Has the SPI been tested with a big sample or is there a preprint available by any chance?
    Thanks for the update and best wishes from Rotterdam, The Netherlands.

    Reply
    • scottdm says

      March 21, 2024 at 8:44 pm

      No preprint available yet. The SPI was developed and tested, as I think I say in the video, on several million cases of completed treatment.

      Reply
  3. Jeremy Ray says

    March 22, 2024 at 3:39 pm

    Hi Scott!
    Interesting! Do you know if the SPI is something that will automatically update in the FIT outcomes software package?

    Reply
    • scottdm says

      March 25, 2024 at 10:58 am

      Jeremy … I’m not certain I understand what you are asking … but if you are wondering IF FIT-O will have the metric available in their system, the answer is, “yes.”

      Reply
  4. Vivian Baruch says

    March 24, 2024 at 3:45 am

    Hi Scott,

    I’m excited to be seeing this new update to my clients’ scores on MyOutcomes. looking forward to learning with & from it.

    Reply
  5. Bjørnar says

    May 13, 2024 at 8:22 am

    Hi Scott,

    when will this be available for fitoutcomes.com?

    Reply
    • scottdm says

      May 13, 2024 at 11:50 am

      They are working on integration as I write.

      Reply
      • Bjørnar says

        May 14, 2024 at 6:54 am

        Excellent. Thank you.

        Reply
  6. Lisa Russell says

    July 24, 2024 at 11:26 pm

    Hi Scott;
    Will other software vendors with FIT licenses be able to access and incorporate this technology at some point?
    Thanks!

    Reply
    • scottdm says

      July 25, 2024 at 10:56 am

      Myoutcomes.com already has this new statistic implemented.

      Reply

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *


The reCAPTCHA verification period has expired. Please reload the page.

SEARCH

Subscribe for updates from my blog.

[sibwp_form id=1]

Upcoming Training

Oct
01

Training of Trainers 2025


Nov
04

Delberate Practice Café (PLUS) Fall 2025


Nov
20

FIT Implementation Intensive 2025

FIT Software tools

FIT Software tools

LinkedIn

Topics of Interest:

  • Behavioral Health (111)
  • behavioral health (5)
  • Brain-based Research (2)
  • CDOI (14)
  • Conferences and Training (67)
  • deliberate practice (31)
  • Dodo Verdict (9)
  • Drug and Alcohol (3)
  • evidence-based practice (67)
  • excellence (63)
  • Feedback (40)
  • Feedback Informed Treatment – FIT (243)
  • FIT (29)
  • FIT Software Tools (12)
  • ICCE (26)
  • Implementation (7)
  • medication adherence (3)
  • obesity (1)
  • PCOMS (11)
  • Practice Based Evidence (39)
  • PTSD (4)
  • Suicide (1)
  • supervision (1)
  • Termination (1)
  • Therapeutic Relationship (9)
  • Top Performance (40)

Recent Posts

  • Agape
  • Snippets
  • Results from the first bona fide study of deliberate practice
  • Fasten your seatbelt
  • A not so helpful, helping hand

Recent Comments

  • Typical Duration of Outpatient Therapy Sessions | The Hope Institute on Is the “50-minute hour” done for?
  • Dr Martin Russell on Agape
  • hima on Simple, not Easy: Using the ORS and SRS Effectively
  • hima on The Cryptonite of Behavioral Health: Making Mistakes
  • himalaya on Alas, it seems everyone comes from Lake Wobegon

Tags

addiction Alliance behavioral health brief therapy Carl Rogers CBT cdoi common factors conferences continuing education denmark evidence based medicine evidence based practice Evolution of Psychotherapy excellence feedback feedback informed treatment healthcare holland icce international center for cliniclal excellence medicine mental health meta-analysis Norway NREPP ors outcome measurement outcome rating scale post traumatic stress practice-based evidence psychology psychometrics psychotherapy psychotherapy networker public behavioral health randomized clinical trial SAMHSA session rating scale srs supershrinks sweden Therapist Effects therapy Training