Its the biggest update to Feedback Informed Treatment (FIT) in two decades.
In the beginning, all we had were the measures. Clinicians administered the outcome and session rating scales at each session and then compared client scores to the clinical cutoffs (CCO) and reliable change index (RCI) to determine whether care was “on or off track.”
Remember this? You crossed the first session score (plotted along the horizontal axis) with the last session score (on the vertical axis). And while the simple graphic was great for determining whether a particular episode of care had been helpful (> 5 points from start to finish) or resulted in clinically significant change (i.e., crossed over the CCO), the static indices employed rendered it useless for assessing progress from session-to-session.
The evolution continued. As data gathered from clinical practice settings accumulated, it became possible to develop “trajectories of change.”
Similar to interpeting an IQ test, individual client scores from week to week (purple line) were plotted against the 25th, 50th and 75th percentile of the normative sample. As such, it indicated whether the client was progressing at, above, or below average compared to people with similar start scores. Unfortunately, however, it said nothing about being on track for a reliable of clinically significant improvement.
Users of Myoutcomes.com, Fitoutcomes.com, and OpenFIT will instantly recognize the graph pictured below.
Based on a decade of research, the colored zones were the first predictive trajectories ever developed for informing and improving mental health care.
Gone were the comparisons to percentile rankings of the normative sample. Instead, the green line represented the least amount of progress the client could make from session to session and still be on track for a successful outcome. Yellow was interderminate and red definately, “off track.”
Since first becoming available, the algorithms that produce the predictive trjectories have been checked and updated every three years or so. The latest review — involving millions of completed cases of care — confimed their ability to inform mental health services provided in diverse settings around the world.
All good. Except, it wasn’t.
Isn’t.
While offering a clear advantage over comparisons to the cutoff scores, percentile rankings, and pre-established change indices, the algorithm-driven, predictive trajectories were still static. Said another way, they did not change following the first visit. True, the initial score was a better predictor of success than a host of factors traditionally considered reliable indicators (e.g., diagnosis, prior treatment history, type and level therapist training). But surely, more accurate assessments of progress would be made if they took into account what happened from visit to visit. Indeed, wasn’t that the whole point of soliciting feedback? Improving the chances of success by adjusting services on an ongoing basis to better fit the individual client?
Enter the SPI, or “Success Probability Index.”
Briefly, the SPI offers an indication of the likelihood of success at each session based on the current and historical pattern of SRS and ORS scores. Importantly, the particular pattern used to generate the index at any given session (e.g., average, slope, change in scores since the prior visit or over the course of care) varies depending on which most accurantely predicts success at the end of care. As can be seen in the screenshot below, despite similar start scores, the different patterns of progress represented in the two graphs result in different predictions. Specifically, the case on the left is on track, while the one on the right (coded in red), is about 16.5% below the average successful client.
In the near future, I’ll publish a “FIT TIP” or two explaining in greater detail both meaning and use of the SPI. In the meantime, take a look at the video produced by Myoutcomes.com — the first system to make the SPI available to their users.
Until next time,
Scott
Director, International Center for Clinical Excellence
Registration for the next ICCE FIT Intensive is now open. Click here for more information or to secure your seat.
Vijay Gopal says
Hi Scott,
This is exciting to know! I am so glad to hear of a dynamic prediction for a specific client.
Is there absolutely no way the SPI can be computed on a spreadsheet? If it is a “complicated formula” as you say – could it be provided as an spreadsheet template?
I will truly appreciate it if this could be done.
Thank you for this upgrade. FIT has been a lifesaver for me – I cannot thank you enough for it. Looking forward to your reply
scottdm says
Absolutely no way. It’s dynamic, so it has to check the calculations at each visit against the database.
Patric Esters says
Dear Scott,
This dynamic index sounds very interesting, and wonderful that you also add nuance to the SPI and that it can foster further exploration between client and therapist rather than being “the truth” with a capital T. Has the SPI been tested with a big sample or is there a preprint available by any chance?
Thanks for the update and best wishes from Rotterdam, The Netherlands.
scottdm says
No preprint available yet. The SPI was developed and tested, as I think I say in the video, on several million cases of completed treatment.
Jeremy Ray says
Hi Scott!
Interesting! Do you know if the SPI is something that will automatically update in the FIT outcomes software package?
scottdm says
Jeremy … I’m not certain I understand what you are asking … but if you are wondering IF FIT-O will have the metric available in their system, the answer is, “yes.”
Vivian Baruch says
Hi Scott,
I’m excited to be seeing this new update to my clients’ scores on MyOutcomes. looking forward to learning with & from it.
Bjørnar says
Hi Scott,
when will this be available for fitoutcomes.com?
scottdm says
They are working on integration as I write.
Bjørnar says
Excellent. Thank you.
Lisa Russell says
Hi Scott;
Will other software vendors with FIT licenses be able to access and incorporate this technology at some point?
Thanks!
scottdm says
Myoutcomes.com already has this new statistic implemented.