Remember these?

Did you ever own or try one?

Remember Beanie Babies?  According to one news story, interest was such, “People neglected other areas of their lives to spend all day trading, and some even invested their children’s college funds in toys that they believed would bring an astronomical return on investment.”

And how about advertising executive Gary Dahl’s product?  You remember him, right?  In the 1970’s, he became an overnight millionaire selling rocks marketed as pets.  Rocks!  Waterbeds, Crocs, cause-branded plastic wristbands, oxygen bars, Pogs, Silly Bandz, and the Macarena — the list is as endless as our attention span is short.

If you’ve been in practice for a while, you know the field of mental health is not immune to fad and fashion.  Like past diet crazes, the drugs, diagnoses, and treatment methods that capture professional interest and then quickly disappear can be hard to remember.  Thus, in the 1980’s it was Xanax, multiple personality disorder, and satanic cult abuse.  The 1990’s brought us the “decade of the brain,” borderline personality disorder, and a flood of Prozac and cognitive-behavior therapy knockoffs.  More recently, mindfulness, energy meridians, and trauma have become the objets de grand intérêt.

One more trend is Feedback-Informed Treatment (FIT).  Known also as Routine Outcome Monitoring, Patient Focused Research, and Measurement-based care, it involves using scales to solicit feedback from clients regarding their experience in treatment and using the resulting information in real time to improve quality and outcome.  The weight of the scientific evidence is such that professional and regulatory bodies in the U.S. and abroad have already deemed ROM a “standard” of care in the delivery of psychological services and clinical supervision (American Psychological Association Presidential Task Force on Evidence-based Practice, 2006; Association of State and Provincial Psychology Boards, 2019; Joint Commission, 2018; Tasca et al., 2019).

But is it just another fad?

Data from two recent surveys suggest FIT is moving beyond the “innovation” to the “mass adoption” phase among mental health providers and treatment agencies.  The study conducted by Myoutcomes® targeted members of Facebook-related psychotherapy interest groups and other sources, finding fairly dramatic growth in: (1) awareness of the empirical support for using measures to assess progress and the quality of the therapeutic relationship; and (2) experience with standardized measurement tools in psychotherapy.

Whether such results indicate FIT will stick around long enough to be the “game changer” remains to be seen.  What is known for sure is that, while important, awareness of, experience with, and research support for the process are insufficient to sustain the interest.  Research shows, for instance, successful implementation of FIT takes significant time, planning, and support, without which between 70 and 95% of efforts fail.  Why?  Because working feedback-informed is about changing culture, not using measurement scales in treatment.  Success requires that all members of management — from administration to clinical supervisors — understand and are actively involved in implementation.  Indeed, when practitioners rather than a team led by a manager are held accountable, the likelihood of FIT being a game changer plummets (80% versus 14 %).

Bottom line?  PLEASE don’t download the ORS and SRS and begin experimenting — testing it out to see “if it works.”  As I blogged about last week, the likelihood of failure is simply too high.   Instead, bring your team to our upcoming Spring intensives in Chicago.  You’ll not only “rub shoulders” with colleagues from around the world and our international faculty, but also leave with a thorough grounding in FIT, as well as skills for transforming the culture in which you work.

Until next time,

Scott

Director, International Center for Clinical Excellence

A couple of weeks ago I received an email from the leader of a group asking me to send them copies of the ORS and SRS. “We are to start using these straight away,” the person wrote.

I replied, of course, providing a link to my website where the scales could be downloaded along with a brief note, highlighting the Feedback Informed Treatment (FIT) Manuals and the upcoming March Intensives in Chicago.  “Both are great resources,” I said, “for learning how to use the measures to improve the quality and outcome of behavioral health services.”

I received a quick and polite response, thanking me for the links but going on to say, “I’ve seen the scales. They are really very simple and self-explanatory so I don’t think we really need much in the way of training or support materials.”

I’d like to say I was surprised. After all, what medical professional would say something similar?  Say, about a stethoscope?  To wit, “No thanks, seems pretty simple, stick these thingies in my ears, and the other end on the patient’s chest and listen…”.

But I was not — surprised, that is. Why?  Of the several hundred downloads of the measures from my website per week, and the more than 200,000 over the last decade, very few practitioners have sought or received any training.  Indeed, most have never even read the FIT manuals!

The impact on those who are initially enthusiastic about seeking formal feedback from their clients is as predictable as it is sad: they quickly give up.  How do I know, you ask?  Every week, as I’m out and about, training and consulting, I run into practitioners who say:

“Yeah, I heard of FIT, I even tried the scales…but they didn’t work…”

“I tried the ORS and SRS scales for a while, but I didn’t get any clinically useful information from them…”

“My clients weren’t honest … so I stopped using them”

And so I ask, what does it take to help people get the information and training they need to succeed?  The question is far from trivial or self-serving.  The measures are free to download and the latest research shows using them more than doubles the chances of helping clients experience meaningful change.  The only caveat is that, despite their simplicity, learning to employ the tools effectively takes time and support.  How do I know that?  Research, of course!

If you have thoughts about what I can do to address this problem, please let me know. In the meantime, in an effort to help, here are several offers:

1. For the time being, get the FIT Treatment and Training Manuals for 50% off;

2. Register for the combined FIT Advanced and Supervision Intensive now using the code FIT-Promo at checkout and get an additional discount off the early bird rate;

3. Sign up for the cutting-edge FIT e-learning program — where you can learn at your own pace from the comfort of your home — and receive the new, deliberate practice module, for free (if interested, email me for details about this offer).

Yes, please feel free to share these links and codes with your colleagues.  And, once more, if you have additional suggestions, I’m interested in hearing them.  Please post a comment below.

That’s it for now.

All the best for the Holidays,

Scott

Scott D. Miller, Ph.D.
Director, International Center for Clinical Excellence

Mr. Gomm was my sixth grade teacher.  Tall and angular, with a booming voice and stern demeanor, he remains a forbidding figure from my childhood.

I’ll never forget the day he slammed his open hand on my desk, bellowing “That, Mr. Miller, is an assumption!”  Turning abruptly, he walked to the chalkboard, and began writing, one capital letter at a time: A, S, S, U, M, E.

“And do you know what happens when we assume, Mr. Miller?” he asked.

“Speak up!” I remember him commanding.  But I just sat there, like a deer in the headlights.

I’m sure you know what happened next.  Returning to the board, he quickly drew slash marks between the S and U, and U and M:  ASS/U/ME.

For emphasis, he then tapped each section loudly with his chalk as he spoke, “Let me spell it out for you, Mr. Miller.  To assume is to make an ass out of you and me!”

It’s a moment I recall with absolute clarity.  Only later — much later —  did I come to realize I’d not understood the point he’d been trying to make at the time.  Indeed, at recess, all anyone could talk about was that Mr. Gomm said the word “ass” out loud in class.  Soon, we were applying our new knowledge to anything anyone did on the playground that we didn’t like: butting in line, missing a critical shot in kick ball, or any of the other possible social faux pas among marginally pubescent adolescents.

“You just made an ass out of you and me!” we repeated with glee at the slightest provocation.

Beyond the obvious irony involved, it turns out tr. Gomm was only half right.  Yes, assuming — supposing without proof — is fraught with risk.  That said, presuming — taking something for granted based on probability — is, as the incident so clearly demonstrates, just as problematic.  In his mind, he’d made a sensible presumption: we would get “it.”  After all, he knew us.  We were his students.  We made the same mistake.  Based on our experience of him, we figured he was teaching us another valuable lesson, and then assumed we’d understood what he’d said.

Prior to last week, I’d not thought of Mr. Gomm for ages.  I was was reminded of him after puzzling over a slew of questions about feedback-informed treatment (FIT) posted on our online discussion forums at the International Center for Clinical Excellence.  On the surface, all appeared to be straightforward requests for information, requiring nothing more than a simple and direct response.  The trouble was that any answer one might give ended up confirming assumptions contained in the queries that were fundamentally untrue or inaccurate.

While the particulars varied, a theme shared by many of the posts was whether one could or should trust scores on the Outcome and Session Rating Scales (ORS & SRS) with certain clients — in particular, people who were shy, mandated into treatment, cognitively compromised, or emotionally disturbed.

To be sure, it’s not the first time I’d encountered such concerns.  Indeed, they frequently come up at the beginning of introductory workshops on FIT:

“Court ordered clients won’t be truthful.”

“The feedback from client’s with (borderline personality disorder, bipolar, psychosis) won’t be reliable or valid.”

“People from this (age group, culture) are not (accustomed to or incapable of) providing feedback to professionals.”

When I have several hours to teach, interact, and illustrate, I usually ask people to wait with such observations, promising an answer will emerge in time.  In the truncated, two-dimensional space of most social media interactions, however, I’ve found a similar evolution of understanding much more challenging.  Hence this post.

Of course, in the best of all worlds, people would get more training.  Answers are available. Given the simplicity of the scales — you can learn to administer and score the ORS and SRS in less than a minute — the temptation to dive in, presuming our existing clinical knowledge and experience applies to their use, is simply too great for most to resist.  Consider this: several hundred thousand practitioners have download the measures from my website in just the last couple of years!  Of these, fewer than 2 or 3% have had any training!  In the end, the unquestioned assumptions brought to the process cause most to get stuck and eventually give up.

So, what about the concerns noted above?

All make perfect sense IF the ORS and SRS are thought of as assessments, the helpfulness of which depend on the accuracy of the data collected.  By contrast, were the measures primarily seen as tools to help engage clients, an entirely different set of assumptions becomes possible.  For example, rather than interpreting high ORS scores of a court-ordered client as evidence of dishonesty or denial that must be confronted or overcome, they could be treated as an opportunity to connect with, explore, and understand their experience and world view.

In practical terms that means taking client scores at face value.  Leaving traditional assumptions aside, the clinician would first acknowledge and then respond logically to what is reported on the scale.  “I see from your responses, you are doing quite well,” continuing, “So, why did you decide to come see me today?”  Should the client say, as most readily do, they were sent by the courts (or employer, parents, or partner), the clinician responds by asking them to complete the measure as if they were the person who sent them.  After all, from their perspective, that’s why they are there!  The discussion can then turn to closing the gap between the client’s and referral source’s scores, beginning, for instance, with asking, “What have they missed about you that, once recognized, will lead them to score you higher?”  Along the way, the result of this line of inquiry is greater participation of the client in treatment — the factor long ago established as the number one process-related predictor of outcome (see Orlinsky, Grawe, & Parks, 1994).

And what about the other questions?

As already stated, answers are available — ones that leave most thinking, “Duh, why didn’t I think of that?”  To be blunt, we can’t so long as we are unaware we are thinking something else!  That’s where a more in-depth training in FIT can prove helpful.  Join colleagues from around the world and our international faculty this coming Spring in Chicago for the three-day, Advanced FIT Intensive.  We’ll not only challenge your thinking, we’ll provide a thorough grounding in the principles and skills of using feedback to inform and improve the quality of mental health and substance abuse services with a broad and diverse clinical population — training which, research shows, improves therapist effectiveness.  Registration is limited to 40 participants.  Click either of the icons below for more information.

Until next time,

Scott

Scott D. Miller, Ph.D.
Director, International Center for Clinical Excellence