SCOTT D Miller - For the latest and greatest information on Feedback Informed Treatment

  • About
    • About Scott
    • Publications
  • Training and Consultation
  • Workshop Calendar
  • FIT Measures Licensing
  • FIT Software Tools
  • Online Store
  • Top Performance Blog
  • Contact Scott
scottdmiller@ talkingcure.com +1.773.454.8511

Using Feedback Informed Treatment to Improve Medication Adherence and Reduce Healthcare Costs

September 10, 2014 By scottdm Leave a Comment

persontakingpill

Medication adherence is a BIG problem.  According to recent research, nearly one-third of the prescriptions written are never filled.  Other data document that more than 60% of people who actually go the pharmacy and get the drug, do not take it as prescribed.

What’s the problem, you may ask?  Inefficiency aside, the health risks are staggering.  Consider, for example, that the prescriptions least likely to be filled are those aimed at treating headache (51 percent), heart disease (51.3 percent), and depression (36.8)percent).

medication adherence

When cost is factored into the equation, the impact of the problem on an already overburdened healthcare system becomes even more obvious.  Research indicates that not taking the medicines costs an estimated $290 billion dollars per year–or nearly $1000 for every man, woman, and child living in the United States.  It’s not hard to imagine more useful ways such money could be spent.

What can be done?

Pringle_Photo 2013

Enter Dr. Jan Pringle, director of the Program Evaluation Research Unit, and Professor of Pharmacy and Therapeutics at the University of Pittsburgh. As I blogged about back in 2009, Jan and I met at a workshop I did on feedback-informed treatment (FIT) in Pittsburgh.  Shortly thereafter, she went to work training pharmacists working in a community pharmacy to use the Session Rating Scale ([SRS] a four-item measure of the therapeutic alliance) in their encounters with customers.

It wasn’t long before Jan had results.  Her first study found that administering and discussing the SRS at the time medications were dispensed resulted in significantly improved adherence (you can read the complete study below).

She didn’t stop there, however.

reading

Just a few weeks ago, Jan forwarded the results from a much larger study, one involving 600 pharmacists and nearly 60,000 patients (via a special arrangement with the publisher, the entire study is available by clicking the link on her publications page of the University website).

Suffice it to say that using the measures, in combination with a brief interview between pharmacist and patient, significantly improved adherence across five medication classes aimed at treating chronic health conditions (e.g., calcium channel blockers, oral diabetes medications, beta-blockers, statins, and renin angiotemsin system antagonists).  In addition to the obvious health benefits, the study also documented significant cost reductions.  She estimates that using the brief, easy-to-use tools would result in an annual savings of $1.4 million for any insurer/payer covering at least 10,000 lives!

Prior to Jan’s research, the evidence-base for the ORS and SRS was focused exclusively on behavioral health services.  These two studies point to exciting possibilities for using feedback to improve the effectiveness and efficiency of healthcare in general.

The tools used in the pharmacy research have been reviewed and deemed evidence-based by the Substance Abuse and Mental Health Services Administration.

PCOMSLogoKnown as PCOMS, detailed information about the measures and feedback process can be found at www.whatispcoms.com.  It’s easy to get started and the measures are free for individual healthcare practitioners!

Filed Under: Feedback Informed Treatment - FIT, medication adherence Tagged With: depression, healthcare, heart disease, medication adherence, medicine, mental health, ors, outcome rating scale, pharmacy, prescriptions, SAMHSA, sesison rating scale, srs

Psychologist Alan Kazdin Needs Help: Please Give

September 25, 2011 By scottdm Leave a Comment

Look at this picture.  This man needs help.  He is psychologist, Alan Kazdin, former president of the American Psychological Association, and current Professor of Psychology at Yale University.  A little over a week ago, to the surprise and shock of many in the field, he disclosed a problem in his professional life.  In an interview that appeared online at TimeHealthland Dr. Kazdin reported being unable to find a therapist or treatment program to which he could refer clients–even in Manhattan, New York, the nation’s largest city!

After traveling the length and breadth of the United States for the last decade, and meeting and working with hundreds of agencies and tens of thousands of therapists, I know there are many clinicians that can help Dr. Kazdin with his problem.  Our group has been tracking the outcome of numerous practitioners over the last decade and found average outcomes to be on par with those obtained in tightly controlled randomized clinical trails!  That’s good news for Dr. Kazdin.

Now, just to be sure, it should be pointed out that Dr. Kazdin is asking for practitioners who adhere to the Cochrane Review’s and the American Psychological Association’s definition of evidence-based practice (EBP)–or, I should say, I believe that is what he is asking for as the interview is not entirely clear on this point and appears to imply that EBP is about using specific treatment methods (the most popular, of course, being CBT).  The actual definition contains three main points, and clearly states that EBP is the integration of:

  1. The best available research;
  2. Clinical expertise; and
  3. The client’s culture, values, and preferences.

Interestingly, the official APA policy on evidence-based practice further defines clinical expertise as the “monitoring of patient progress (and of changes in the patient’s circumstances)…that may suggest the need to adjust the treatment.  If progress is not proceeding adequately, the psychologist alters or addresses problematic aspects of the treatment (e.g., problems in the therapeutic relationship or in the implementation of the goals of the treatment) as appropriate.”

I say “interestingly” for two reasons.  First, the definition of EBP clearly indicates that clinicians must tailor psychotherapy to the individual client.  And yet, the interview with Dr. Kazdin specifically quotes him as saying, “That’s a red herring. The research shows that no one knows how to do that. [And they don’t know how to monitor your progress].”   Now, admittedly, the research is new and, as Dr. Kazdin says, “Most people practicing who are 50 years or older”–like himself–may not know about it, but there are over a dozen randomized clinical trials documenting how routinely monitoring progress and the relationship and adjusting accordingly improves outcome.  The interview also reports him saying that “there is no real evidence” that the relationship (aka alliance) between the therapist and client matters when, in fact, the APA Interdivisional Task Force on Evidence-Based Therapy Relationships concluded that there is abundant evidence that “the therapy relationship accounts for substantial and consistent contributions to…outcome….at least as much as the particular method.”  (Incidently, the complete APA policy statement on EBP can be found in the May-June 2006 issue of the American Psychologist).

Who knows how these two major bloopers managed to slip through the editing process?  I sure know I’d be embarrased and immediately issue a clarification if I’d been misquoted making statements so clearly at odds with the facts.  Perhaps Dr. Kazdin is still busy looking for someone to whom he can refer clients.  If you are a professional who uses your clinical expertise to tailor the application of scientifically sound psychotherapy practices to client preferences, values, and culture, then you can help.

Filed Under: evidence-based practice, Top Performance Tagged With: Alan Kazdin, American Psychological Association, brief therapy, Carl Rogers, CBT, continuing education, evidence based practice, icce, medicine, therapy

More Eruptions (in Europe and in Research)

April 20, 2010 By scottdm Leave a Comment

Dateline: Tuesday, 8:21pm, April 20th, 2010, Skellefteå, Sweden

What an incredible week.  Spent the day today working with 250 social workers, case managers, psychologists, psychiatrists, and agency directors in the far nothern town of Skellefteå, Sweden.  Many practitioners here are already measuring outcomes on an ongoing basis and using the information to improve the results of their work with consumers of behavioral health services.  Today, I presented the latest findings from ICCE’s ongoing research on “Achieving Clinical Excellence.”

I’ve been coming to the area to teach and consult since the early 1990’s, when I was first invited to work with Gun-Eva Langdahl and the rest of the talented crew at Rådgivningen Oden (RO).  As in previous years, I spent my first day (Monday) in Skellefteå watching sessions and working with clients at RO clinic.  Frankly, getting to Skellefteå from Goteborg had been a bit of ordeal.  What usually took a little over an hour by plane ended up being a 12-hour combination of cars, trains, and buses–all due to volcanic eruptions on Iceland.  (I shudder to think of how I will get from Skellefteå to Amsterdam on Wednesday evening if air travel doesn’t resume).

Anyway, the very first visit of the day at Rådgivningen Oden was with an adolescent and her parents.  Per usual, the session started with the everyone completing and discussing the Outcome Rating Scale.  The latest research reported in the April 2010 edition of Journal of Consulting and Clinical Psychology (JCCP) confirms the wisdom of this practice: measuring and discussing progress with consumers at every visit results in better outcomes.

It turns out that adolescents are at greater risk for deteriorating in treatment than adults (20% versus 10%).  Importantly, the study in JCCP by Warren, Nelson, Mondragon, Baldwin, and Burlingame found that the more frequently measures are used the less likely adolescents are to worsen in care.  Indeed, as ICCE Senior Associate Susanne Bargmann pointed out in a series of recent emails about this important study, “routinely tracking and discussing progress led to 37% higher recovery rates and 38% lower rates of deterioration!”

Skellefteå is a hotbed of feedback-informed practice in Sweden.  Accompanying the family at Rådgivningen Oden, for example, were professionals from a number of other agencies involved in the treatment and wanting to learn more about outcome-informed practice.  As already noted, 250 clinicians took time away from their busy schedules to hear the latest information and finesse their use of the measures.  And tomorrow, Wednesday, I meet with managers and directors of behavioral health agencies to discuss steps for successfully implementing routine measurement of progress and feedback in their settings.  You can download a video discussing the work being done by the team at Odin in Northern Sweden, by clicking here.

Stay tuned for more.  If all goes well, I’ll be in Amsterdam by Wednesday evening.

Filed Under: Behavioral Health, evidence-based practice, Feedback Informed Treatment - FIT Tagged With: behavioral health, continuing education, Journal of Consulting and Clinical Psychology, medicine, meta-analysis, public behavioral health

Improving Outcomes in the Treatment of Obesity via Practice-Based Evidence: Weight Loss, Nutrition, and Work Productivity

April 9, 2010 By scottdm 4 Comments

Obesity is a large and growing problem in the United States and elsewhere.  Data gathered by the National Center for Health Statistics indicate that 33% Americans are obese.  When overweight people are added to the mix, the figure climbs to a staggering 66%!   The problem is not likely to go away soon or on its own as the same figures apply to children.

Researchers estimate that weight problems are responsible for over 300,000 deaths annually and account for 12% of healthcare costs or 100 billion–that’s right, $100,000,000,000–in the United States alone.   The overweight and obese have higher incidences of arthritis, breast cancer, heart disease, colorectal cancer, diabetes, endometrial cancer, gallbladder disease, hypertension, liver disease, back pain, sleeping problems, and stroke–not to mention the tremendous emotional, relational, and social costs.  The data are clear: the overweight are the target of discrimination in education, healthcare, and employment.  A study by Brownell and Puhl (2003), for example, found that: (1) a significant percentage of healthcare professionals admit to feeling  “repulsed” by obese person, even among those who specialize in bariatric treatment; (2) parents provide less college support to their overweight compared to “thin” children; and (3) 87% of obese individuals reported that weight prevented them from being hired for a job.

Sadly, available evidence indicates that while weight problems are “among the easiest conditions to recognize,” they remain one of the “most difficult to treat.”  Weight loss programs abound.  When was the last time you watched television and didn’t see an ad for a diet pill, program, or exercise machine?  Many work.  Few, however, lead to lasting change.

What might help?

More than a decade ago, I met Dr. Paul Faulkner, the founder and then Chief Executive Officer of Resources for Living (RFL), an innovative employee assistance program located in Austin, Texas.  I was teaching a week-long course on outcome-informed work at the Cape Cod Institute in Eastham, Massachusetts.  Paul had long searched for a way of improving outcomes and service delivery that could simultaneously be used to provide evidence of the value of treatment to purchasers–in the case of RFL, the large, multinational companies that were paying him to manage their employee assistance programs.  Thus began a long relationship between me and the management and clinical staff of RFL.  I was in Austin, Texas dozens of times providing training and consultation as well as setting up the original ORS/SRS feedback system known as ALERT, which is still in use at the organization today.  All of the original reliability, validity, norming, and response trajectories were done together with the crew at RFL.

Along the way, RFL expanded services to disease management, including depression, chronic obstructive pulmonary disease, diabetes, and obesity.  The “weight management” program delivered coaching and nutritional consultation via the telephone informed by ongoing measurement of outcomes and the therapeutic alliance using the SRS and ORS.  The results are impressive.  The study by Ryan Sorrell, a clinician and researcher at RFL, not only found that the program and feedback led to weight loss, but also significant improvements in distress, health eating behaviors (70%), exercise (65%), and presenteeism on the job (64%)–the latter being critical to the employers paying for the service.

Such research adds to the growing body of literature documenting the importance of “practice-based” evidence, making clear that finding the “right” or “evidence-based” approach for obesity (or any problem for that matter) is less important than finding out “what works” for each person in need of help.  With challenging, “life-style” problems, this means using ongoing feedback to inform whatever services may be deemed appropriate or necessary.  Doing so not only leads to better outcomes, but also provides real-time, real-world evidence of return on investment for those footing the bill.

Filed Under: Behavioral Health, Feedback Informed Treatment - FIT, Practice Based Evidence Tagged With: behavioral health, cdoi, cognitive-behavioral therapy, conferences, continuing education, diabetes, disease management, Dr. Paul Faulkner, evidence based medicine, evidence based practice, Hypertension, medicine, obesity, ors, outcome rating scale, practice-based evidence, public behavioral health, randomized clinical trial, session rating scale, srs, Training

"What Works" in Holland: The Cenzo Experience

March 23, 2010 By scottdm 1 Comment

When it comes to healthcare, it can be said without risk of exaggeration that “revolution is in the air.”  The most sweeping legislation in history has just been passed in the United States.  Elsewhere, as I’ve been documenting in my blogs, countries, states, provinces, and municipalities are struggling to maintain quality while containing costs of the healthcare behemoth.

Back in January, I talked about the approach being taken in Holland where, in contrast to many countries, the healthcare system was jettisoning their government-run system in favor of private insurance reimbursement.  Believe me, it is a change no less dramatic in scope and impact than what is taking place in the U.S.  At the time, I noted that Dutch practitioners were, in response “’thinking ahead’, preparing for the change—in particular, understanding what the research literature indicates works as well as adopting methods for documenting and improving the outcome of treatment.” As a result, I’ve been traveling back and forth—at least twice a quarter–providing trainings to professional groups and agencies across the length and breadth of the country.

Not long ago, I was invited to speak at the 15th year anniversary of Cenzo—a franchise organization with 85 registered psychologist members.  Basically, the organization facilitates—some would say “works to smooth”–the interaction between practitioners and insurance companies.  In addition to helping with contracts, paperwork, administration, and training, Cenzo also has an ongoing “quality improvement” program consisting of routine outcome monitoring and feedback as well as client satisfaction metrics.  Everything about this forward-thinking group is “top notch,” including a brief film they made about the day and the workshop.  Whether you work in Holland or not, I think you’ll find the content interesting!  If you understand the language, click here to download the 15th year Anniversary Cenzo newsletter.

Filed Under: Feedback Informed Treatment - FIT Tagged With: behavioral health, cenzo, common factors, evidence based practice, holland, medicine, Therapist Effects

Outcomes in New Zealand

March 23, 2010 By scottdm Leave a Comment

Made it back to Chicago after a week in New Zealand providing training and consultation.  As I blogged about last Thursday, the last two days of my trip were spent in Christchurch providing a two-day training on “What Works” for Te Pou–New Zealand’s National Centre of Mental Health Research, Information, and Workforce Development.  Last year around this same time, I provided a similar training for Te Pou for managers and policy makers in Auckland.  News spread and this year my contact at Te Pou, Emma Wood brought the training to the south island.  It is such a pleasure to be involved with such a forward thinking organization.

Long before I arrived, leadership at Te Pou were promoting outcome measurement and feedback.  Here’s a direct quote from their website:

Outcomes information can assist:

  • service users to use their own outcomes data to reflect on their wellbeing and circumstances, talk to clinicians about their support needs and inform their recovery plans
  • clinicians to use outcomes information to support their decision-making in day-to-day practice, monitoring change, better understanding the needs of the service user, and also to begin evaluating the effectiveness of different interventions
  • planners and funders to assess population needs for mental health services and assist with allocation of resources policy and mental health strategy developments through nationally aggregated data.

Indeed, using outcome to inform mental health service delivery is a key aspect of the Past, Present, and Future: Vision Paper–a review of “what works” in care and a plan for improving treatment in the future.  The site even publishes a quarterly newsletter Outcomes Matter.  Take a few minutes and explore the Te Pou website.  While you are there, be sure and download the pamphlet entitled, “A Guide to Talking Therapies.”  As the title implies, this brief, easy-to-read text provides a non-nonsense guide to the various “talk therapies” for consumers (I took several copies home with me from the workshop).

Before ending, let me say a brief hello to the Clinical Practice Leaders from the Problem Gambling Foundation of New Zealand who attended the two-day training in Christchurch.    The dedicated staff use an integrated public health and clinical model and are working to implement ongoing measurement of outcome and consumer feedback into service delivery.  The website contains a free online library including fact sheets, research, and books on the issue of problem gambling that is an incredible resource to professionals and the public.  Following the workshop, the group sent a photo that was taken of us together.  From left to right, they are Wenli Zhang, me, Margaret Sloan, and Jude West.

Filed Under: Behavioral Health, Conferences and Training, excellence, Feedback Informed Treatment - FIT Tagged With: books, evidence based practice, medicine, New Zealand, randomized clinical trial, Te Pou, Therapist Effects

The Turn to Outcomes: A Revolution in Behavioral Health Practice

February 1, 2010 By scottdm Leave a Comment

Get ready.  The revolution is coming (if not already here).  Whether you are a direct service provider (psychologist, counselor, marriage and family therapist), agency, broker, or funder, you will be required to measure and likely report the outcomes of your clinical work.


Jay Lebow, Ph.D.

Just this month, Dr. Jay Lebow, a professor of psychology at the Family Institute at Northwestern University, published an article in the Psychotherapy Networker–the most widely circulated publication for practitioners in the world–where he claimed the field had reached a “tipping point.”  “Once a matter of interest only among a small circle of academics,” Dr. Lebow writes in his piece entitled, The Big Squeeze, “treatment outcome has now become a part of the national debate about healthcare reform.”


David Barlow, Ph.D.

The same sentiments were expressed in a feature article entitled, “Negative Effects from Psychological Treatments,” written by Dr. David Barlow in the January issue of the American Psychologist.  “Therapists,” he argues both eloquently and persuasively, “do not have to wait for the next clinical trial….[rather] clinicians [can act] as local clinical scientists…[using] outcome measures to track progress…rapidly becom[ing] aware of lack of progress or even deterioration” (p. 19).  What can I say, except that any practitioner with more than a few years to work before retirement, should read these articles and then forward them to every practitioner they know.

During the Holidays, and just before the turn of the New Year, I blogged about the trend toward outcome measurement.  As readers will recall, I talked about my experience on a panel at the Evolution of Psychotherapy conference where Dr. Barlow–who, in response to my brief remarks about the benefits of feedback– suprised me by stating unequivocally that all therapists would soon be required to measure and monitor the outcome of their clinical work. And even though my work has focused almost exclusively on measuring and using outcomes to improve both retention in and the results of behavioral health for the last 15 years, I said his pronouncement frightened me–which, by the way, reminds me of a joke.

A sheep farmer is out in the pasture tending his flock–I promise this is clean, so read on–when from over a small hill comes a man in a custom-tailored, three-piece business suit.  In one hand, the businessman holds a calculator; in the other, an expensive, leather brief case.  “I have a proposition for you,” the well-clad man says as he approaches the farmer, and then continues, “if I can tell you how many sheep are in your flock, to the exact number, may I have one of your sheep?”  Though initially startled by the stranger’s abrupt appearance and offer, the farmer quickly gathers his wits.  Knowing there is no way the man could know the actual number of sheep (since many in his flock were out of site in other pastures and several were born just that morning and still in the barn), the farmer quickly responded, “I’ll take that bet!”

Without a moment’s hesitation, the man calls out the correct number, “one thousand, three hundred and forty six,” then quickly adds, “…with the last three born this morning and still resting in the barn!”  Dumbfounded, the farmer merely motions toward his flock.  In response, the visitor stows his calculator, slings one of the animals up and across his shoulders and then, after retrieving his briefcase, begins making his way back up the hill.  Just as he nears the top of the embankment, the farmer finds his voice and calls out, “Sir, I have a counter proposal for you.”

“And what might that be?” the man replies, turning to face the farmer, who then asked, “If I can tell you, sir, what you do for a living, can I have my animal back?”

Always in the mood for a wager, the stranger replies, “I’ll take that bet!”  And then without a moment’s hesitation, the sheep farmer says, “You’re an accountant, a bureaucrat, a ‘bean-counter.'”  Now, it’s the businessman’s turn to be surprised.  “That’s right!” he says, and then asks, “How did you know?”

“Well,” the farmer answers, “because that’s my dog you have around your neck.”

The moral of the story?  Bureaucrats can count but they can’t tell the difference between what is and is not important.  In my blogpost on December 24th, I expressed concern about the explosion of “official interest” in measuring outcomes.  As the two articles mentioned above make clear, the revolution has started.  There’s no turning back now.  The only question that remains is whether behavioral health providers will be present to steer measurement toward what matters?  Here, our track record is less than impressive (remember the 80-90’s and the whole managed care revolution).  We had ample warning (and did, well, nothing.  If you don’t believe me, click here and read this article from 1986 by Dr. Nick Cummings).

As my colleague and friend Peter Albert is fond of saying, “If you’re not at the table, you’re likely to be on the menu.”  So, what can the average clinician do?  First of all, if you haven’t already done so, began tracking your outcomes.  Right here, on my website, you can download, free, simple-to use, valid and reliable measures.  Second, advocate for measures that are feasible, client-friendly, and have a empirical track record of improving retention and outcome.  Third, and lastly, join the International Center for Clinical Excellence.  Here, clinicians from all over the globe are connecting, learning, and sharing their experiences about how to use ongoing measures of progress and alliance.  Most importantly, all are determined to lead the revolution.

Filed Under: Behavioral Health, CDOI, excellence, Feedback Informed Treatment - FIT Tagged With: brief therapy, evidence based practice, icce, Jay Lebow, medicine, post traumatic stress, psychotherapy networker, public behavioral health

DODO BIRD HYPOTHESIS PROVEN FALSE! Study of PTSD finally proves Wampold, Miller, and other "common factor" proponents wrong

January 8, 2010 By scottdm 3 Comments

The Dodo Bird Researchers Anke Ehlers, Jonathon Bisson, David Clark, Mark Creamer, Steven Pilling, David Richards, Paula Schnurr, Stuart Turner, and William Yule have finally done it!  They slayed the “dodo.” Not the real bird of course–that beast has been extinct since the mid to late 17th century but rather the “dodo bird” conjecture first articulated by Saul Rozenzweig, Ph.D. in 1936.  The idea that all treatment approaches work about equally well has dogged the field–and driven proponents of  “specific treatments for specific disorders” positively mad.  In a soon to be published article in Clinical Psychology Review, the authors claim that bias, overgeneralization, lack of transparency, and poor judgement account for the finding that “all therapeutic approaches work equally well for people with a diagnosis of PTSD” reported in a meta-analysis by Benish, Imel, & Wampold (2008).

I guess this means that a public admission by me, Wampold, and other common factors researchers is in order…or maybe not!  Right now, we are writing a response to the article.  All I can say at this point is, “unbelievable!”  As soon as it becomes available, you’ll find it right here on this blog.  I’ll be drawing inspiration from Saul Rosenzweig who passed away in 2004.  It was such an honor to meet him.  Still working at 96 years of age.

Filed Under: Behavioral Health, Dodo Verdict Tagged With: behavioral health, Children, continuing education, icce, medicine, meta-analysis, post traumatic stress, public behavioral health, reimbursement

Why ongoing, formal feedback is critical for improving outcomes in healthcare

January 8, 2010 By scottdm 3 Comments

researchNot long ago, I had a rather lengthy email exchange with a well-known, high profile psychotherapist in the United States.  Feedback was the topic.  We both agreed that feedback was central to successful psychotherapy.   We differed, however, in terms of method.  I argued for the use of simple, standardized measures of progress and alliance (e.g., ORS and SRS).  In support of my opinion, I pointed to several randomized clinical trials documenting the impact of routine outcome monitoring on retention and progress.  I also cited studies showing traditionally low correlations between consumers and clinician’s rating of outcome and alliance and clinicians frighteningly frequent inability to predict deterioration and drop out in treatment.  He responded that such measures were an “unnecessary intrusion,” indicating that he’d always sought feedback from his clients albeit on an “informal basis.”  television-reception

When I mentioned our own research which had found that clinicians believed they asked consumers for feedback more often than they actually did, he finally seemed to agree with me.  “Of course,” he said immediately–but then he added, “I don’t need to ask in order to get feedback.”  In response to my query about how he managed to get feedback without asking, he responded (without a hint of irony), “I have unconditional empathic reception.”  Needless to say, the conversation ended there.

It’s a simple idea, feedback.  Yet, as I jet around the globe teaching about feedback-informed clinical practice, I’m struck by how hard it seems for many in healthcare to adopt.  Whatever the reason for the resistance–fear, hubris, or inertia–the failure to seek out valid and reliable feedback is a conceit that the field can no longer afford.  Simply stated, no one has “unconditional empathic reception.”  As the video below makes clear, we all need help seeing what is right before our eyes.

Filed Under: Behavioral Health, Feedback, Feedback Informed Treatment - FIT Tagged With: Alliance, behavioral health, cdoi, medicine, Norway, randomized clinical trial

Research on the Outcome Rating Scale, Session Rating Scale & Feedback

January 7, 2010 By scottdm Leave a Comment

PCOMS - Partners for change outcome management system Scott D Miller - SAMHSA - NREPP“How valid and reliable are the ORS and SRS?”  “What do the data say about the impact of routine measurement and feedback on outcome and retention in behavioral health?”  “Are the ORS and SRS ‘evidence-based?'”

These and other questions regarding the evidence supporting the ORS, SRS, and feedback are becoming increasingly common in the workshops I’m teaching in the U.S. and abroad.

As indicated in my December 24th blogpost, routine outcome monitoring (PROMS) has even been endorsed by “specific treatments for specific disorders” proponent David Barlow, Ph.D., who stated unequivocally that “all therapists would soon be required to measure and monitor the outcome of their clinical work.”  Clearly, the time has come for all behavioral health practitioners to be aware of the research regarding measurement and feedback.

Over the holidays, I updated a summary of the data to date that has long been available to trainers and associates of the International Center for Clinical Excellence.  The PDF reviews all of the research on the psychometric properties of the outcome and session ratings scales as well as the studies using these and other formal measures of progress and the therapeutic relationship to improve outcome and retention in behavioral health services.  The topics is so important, that I’ve decide to make the document available to everyone.  Feel free to distribute the file to any and all colleagues interested in staying up to date on this emerging mega-trend in clinical practice.

Measures And Feedback from Scott Miller

Filed Under: evidence-based practice, Feedback Informed Treatment - FIT, Practice Based Evidence Tagged With: behavioral health, continuing education, david barlow, evidence based medicine, evidence based practice, feedback, Hypertension, icce, medicine, ors, outcome measurement, outcome rating scale, post traumatic stress, practice-based evidence, proms, randomized clinical trial, session rating scale, srs, Training

Outcomes in Ohio: The Ohio Council of Behavioral Health & Family Service Providers

October 30, 2009 By scottdm Leave a Comment

Ohio is experiencing the same challenges faced by other states when it comes to behavioral health services: staff and financial cutbacks, increasing oversight and regulation, rising caseloads, unrelenting paperwork, and demands for accountability.  Into the breach, the Ohio Council of Behavioral Health & Family Service Providers organized their 30th annual conference, focused entirely on helping their members meet the challenges and provide the most effective services possible.

On Tuesday, I presented a plenary address summarizing 40 years of research on “What Works” in clinical practice as well as strategies for documenting and improving retention and outcome of behavioral health services.  What can I say?  It was a real pleasure working with the 200+ clinicians, administrators, payers, and business executives in attendance.  Members of OCBHFSP truly live up to their stated mission of, “improving the health of Ohio’s communities and the well-being of Ohio’s families by promoting effective, efficient, and sufficient behavioral health and family services through member excellence and family advocacy.”

For a variety of reasons, the State of Ohio has recently abandoned the outcome measure that had been in use for a number of years.  In my opinion, this is a “good news/bad news” situation.  The good news is that the scale that was being used was neither feasible or clinically useful.  The bad news, at least at this point in time, is that state officials opted for no measure rather than another valid, reliable, and feasible outcome tool.  This does not mean that agencies and providers are not interested in outcome.  Indeed, as I will soon blog about, a number of clinics and therapists in Ohio are using the Outcome and Session Rating Scales to inform and improve service delivery.  At the conference, John Blair and Jonathon Glassman from Myoutcomes.com demonstrated the web-based system for administering, scoring, and interpreting the scales to many attendees.  I caught up with them both in the hall outside the exhibit room.

Anyway, thanks go to the members and directors of OCBHFSP for inviting me to present at the conference.  I look forward to working with you in the future.

Filed Under: Behavioral Health, evidence-based practice, Feedback Informed Treatment - FIT Tagged With: behavioral health, medicine, outcome measurement, outcome measures, outcome rating scale, research, session rating scale, therapiy, therapy

SEARCH

Subscribe for updates from my blog.

loader

Email Address*

Name

Upcoming Training

Jun
03

Feedback Informed Treatment (FIT) Intensive ONLINE


Oct
01

Training of Trainers 2025


Nov
20

FIT Implementation Intensive 2025

FIT Software tools

FIT Software tools

LinkedIn

Topics of Interest:

  • Behavioral Health (112)
  • behavioral health (5)
  • Brain-based Research (2)
  • CDOI (14)
  • Conferences and Training (67)
  • deliberate practice (31)
  • Dodo Verdict (9)
  • Drug and Alcohol (3)
  • evidence-based practice (67)
  • excellence (63)
  • Feedback (40)
  • Feedback Informed Treatment – FIT (246)
  • FIT (29)
  • FIT Software Tools (12)
  • ICCE (26)
  • Implementation (7)
  • medication adherence (3)
  • obesity (1)
  • PCOMS (11)
  • Practice Based Evidence (39)
  • PTSD (4)
  • Suicide (1)
  • supervision (1)
  • Termination (1)
  • Therapeutic Relationship (9)
  • Top Performance (40)

Recent Posts

  • Agape
  • Snippets
  • Results from the first bona fide study of deliberate practice
  • Fasten your seatbelt
  • A not so helpful, helping hand

Recent Comments

  • Bea Lopez on The Cryptonite of Behavioral Health: Making Mistakes
  • Anshuman Rawat on Integrity versus Despair
  • Transparency In Therapy and In Life - Mindfully Alive on How Does Feedback Informed Treatment Work? I’m Not Surprised
  • scottdm on Simple, not Easy: Using the ORS and SRS Effectively
  • arthur goulooze on Simple, not Easy: Using the ORS and SRS Effectively

Tags

addiction Alliance behavioral health brief therapy Carl Rogers CBT cdoi common factors conferences continuing education denmark evidence based medicine evidence based practice Evolution of Psychotherapy excellence feedback feedback informed treatment healthcare holland icce international center for cliniclal excellence medicine mental health meta-analysis Norway NREPP ors outcome measurement outcome rating scale post traumatic stress practice-based evidence psychology psychometrics psychotherapy psychotherapy networker public behavioral health randomized clinical trial SAMHSA session rating scale srs supershrinks sweden Therapist Effects therapy Training