SCOTT D Miller - For the latest and greatest information on Feedback Informed Treatment

  • About
    • About Scott
    • Publications
  • Training and Consultation
  • Workshop Calendar
  • FIT Measures Licensing
  • FIT Software Tools
  • Online Store
  • Top Performance Blog
  • Contact Scott
info@scottdmiller.com 773.404.5130

Is your therapy making your clients worse? The Guardian Strikes Again

June 12, 2014 By scottdm 1 Comment

demand-evidence-and-think

Last week, an article appeared in The Guardian, one of the U.K.’s largest daily newspapers.  “Counselling and Therapy can be Harmful,” the headline boldly asserted, citing results of a study yet to be published.  It certainly got my attention.

Do some people in therapy get worse?  The answer is, most assuredly, “Yes.”  Research dating back several decades puts the figure at about 10% (Lambert, 2010).  Said another way, at termination, roughly one out of ten people are functioning more poorly than they were at the beginning of treatment.

The cause?  Here’s what we know.  Despite claims to the contrary (e.g., Lilenfeld, 2007), no psychotherapy approach tested in a clinical trial has ever been shown to reliably lead to or increase the chances of deterioration.  NONE.  Scary stories about dangerous psychological treatments are limited to a handful of fringe therapies–approaches that have been never vetted scientifically and which all practitioners, but a few, avoid.

So, if it’s not about the method, then how to account for deterioration?  As the article points out, “some therapists had a lot more clients [who] deteriorated than others.”  And yet, while that statement is true–lots of prior research shows that some do more harm than others–there are too few such clinicians to account for the total number of clients who worsen.  Moreover, beyond that 10%, between 30 and 50% of people in treatment experience no benefit whatsoever!

Here is where the old adage, “an ounce of prevention is worth a pound of cure,” applies.  Whatever the cause, lack of progress and risk of deterioration are issues for all clinicians.  A growing body of research makes clear, the key to addressing the problem is tracking the progress of clients from visit to visit so that those not improving, or getting worse, can be identified and offered alternatives.

It’s not hard to get started.  You can learn a simple, evidence-based method for tracking progress and the quality of the relationship at: www.whatispcoms.com.  Best of all, practitioners can access the tools for free!

After that, join fellow practitioners from the US, Canada, Europe, and Australia  for one of our intensive trainings  coming up this August in Chicago.  I promise you’ll leave prepared to address the issue of deterioration directly and successfully.

Filed Under: Feedback Informed Treatment - FIT Tagged With: clinical trial, counselling, lilenfeld, michael lambery, psychotherapy, the guardian, therapy, Training, whatispcoms

What can therapists learn from the CIA? Experts versus the "Wisdom of the Crowd"

May 6, 2014 By scottdm Leave a Comment

Central psychotherapy agency

What can we therapists learn from the CIA?  In a phrase, “When it comes to making predictions about important future events, don’t rely on experts!”

After a spate of embarrassing, high-profile intelligence failures, a recent story showed how a relatively small group of average people made better predictions about critical world events than highly-trained analysts with access to classified information.  The four-year study, known as the Good Judgment Project, adds to mounting evidence regarding the power of aggregating independent guesses of regular folks–or what is known as, “the wisdom of the crowd.”

When it comes to therapy, multiple scientific studies show that inviting the “wisdom of the crowd” into treatment as much as doubles effectiveness, while simultaneously cutting drop out and deterioration rates.

Whatever your profession, work setting, or preferred therapeutic approach, the process involves formally soliciting feedback from clients and then comparing the results to empirically established benchmarks.   Getting started is easy:

  • Download and  begin using two free, easy to use tools–one that charts progress, the other the quality of the therapeutic relationship–both of which are listed on SAMHSA’s National Registry of Evidence Based Programs and Practices.
  • Next, access cutting edge technology available on the web, smartphones, and tablets, that makes it easy to anonymously compare the progress of  your clients to effective patterns of practice worldwide.

You can learn more at: www.whatispcoms.com.  Plus, the ICCE–the world’s largest online community of professionals using feedback to enhance clinical judgment–is available at no cost to support you in your efforts.

While you’re at it, be sure and join fellow practitioners from the US, Canada, Europe, and Australia for the “Training of Trainers” or two-day FIT Implementation Intensive coming up this August in Chicago.  You’ll not only learn how to use the measures, but also tap into the collective wisdom of clients and practitioners around the globe.   Space is limited, and we are filling up quickly, so don’t wait to register.

Filed Under: Feedback, Feedback Informed Treatment - FIT Tagged With: feedback, feedback informed treatment, icce, international center for cliniclal excellence, National Registry of Evidence Based Programs and Practices, NREPP, PCOMS, SAMHSA, therapy, Training

How not to be among the 70-95% of practitioners and agencies that fail

April 20, 2014 By scottdm Leave a Comment

fail2

Our field is full of good ideas, strategies that work.  Each year, practitioners and agencies devote considerable time and resources to staying current with new developments.  What does the research say about such efforts?  When it comes to the implementation of new, evidence-based practices, traditional training strategies routinely produce only 5% to 30% success rates.  Said another way, 70-95% of training fails (Fixsen, Blase, Van Dyke, & Metz, 2013).  

In 2013, Feedback Informed Treatment (FIT)–that is, formally using measures of progress and the therapeutic alliance to guide care–was deemed an evidence-based practice by SAMHSA, and listed on the official NREPP website.  It’s one of those good ideas.  Research to date shows that FIT as much as doubles the effectiveness of behavioral health services, while decreasing costs, deterioration and dropout rates. 

As effective as FIT has proven to be in scientific studies, the bigger challenge is helping clinicians and agencies implement the approach in real world clinical settings.  Simply put, it’s not enough to know “what works.”  You have to be able to put “what works” to work.  On this subject, researchers have identified five, evidence-based steps associated with the successful implementation of any evidence-based practice.  The evidence is summarized in a free, manual available online.  You can avoid the 70-95% failure rate by reading it before attending another training, buying that new software, or hiring the latest consultant.

At the International Center for Clinical Excellence, we’ve integrated the research on implementation into all training events, including a special, two-day intensive workshop on implementing Feedback-Informed Treatment (FIT).  Based on the five, scientifically-established steps, clinicians, supervisors, and agency directors will learn how to both plan and execute a successful implementation of this potent evidence-based practice. 

You can register today by clicking on the link above or the “FIT for Management” icon below.  Feel free to e-mail me with any questions.  In the meantime, hope to see you this summer in Chicago!

Fit Imp 2014

Filed Under: Conferences and Training Tagged With: behavioral health, dropout rates, evidence based medicine, evidence based practice, feedback informed treatment, FIT, icce, implementation, international center for cliniclal excellence, NREPP, SAMHSA, Training

Psychotherapy Training: Is it Worth the Bother?

October 29, 2012 By scottdm 2 Comments

Big bucks.  That’s what training in psychotherapy costs.  Take graduate school in psychology as an example.  According to the US Department of Education’s National Center (NCES), a typical doctoral program takes five years to complete and costs between US$ 240,000-300,000.00.

Who has that kind of money laying around after completing four years of college?  The solution? Why, borrow the money, of course!  And students do.  In 2009, the average amount of debt of those doctoral students in psychology who borrowed was a whopping US$ 88,000–an amount nearly double that of the prior decade.  Well, the training must be pretty darn good to warrent such expenditures–especially when one considers that entry level salaries are on the decline and not terribly high to start!

Oh well, so much for high hopes.

Here are the facts, as recounted in a recent, concisely written summary of the evidence by John Malouff:

1. Studies comparing treatments delivered by professionals and paraprofessionals either show that paraprofessionals have better outcomes or that there is no difference between the two groups;

2. There is virtually no evidence that supervision of students by professionals leads to better client outcomes (you should have guessed this after reading the first point);

3. There is no evidence that required coursework in graduate programs leads to better client outcomes.

If you are hoping that post doctoral experience will make up for the shortcomings of professional training, well, keep hoping.  In truth, professional experience does not correlate often or significantly with client therapy outcomes.

What can you do?  As Malouf points out, “For accrediting agencies to operate in the realm of principles of evidence-based practice, they must produce evidence…and this evidence needs to show that…training…contribute(s) to psychotherapy outcomes…[and] has positive benefits for future clients of the students” (p. 31).

In my workshops, I often advise therapists to forgo additional training until they determine just how effective they are right now.  Doing otherwise, risks perceiving progress where, in fact, none exists.  What golfer would buy new clubs or pursue expensive lessions without first knowing their current handicap?  How will you know if the training you attend is “worth the bother” if you can’t accurately measure the impact of it on your performance?

Determining one’s baseline rate of effectiveness is not as hard as it might seem.  Simply download the Outcome Rating Scale and begin using it with your clients.  It’s free.  You can then aggregate and analyze the data yourself or use one of the existing web-based systems (www.fit-outcomes.com or www.myoutcomes.com) to get data regarding your effectiveness in real time.

After that, join your colleagues at the upcoming Advanced Intensive Training in Feedback Informed Treatment.   This is an “evidence-based” training event.  You learn:

• How to use outcome management tools (e.g., the ORS) to inform and improve the treatment services you provide;

• Specific skills for determining your overall clinical success rate;

• How to develop an individualized, evidence-based professional development plan for improving your outcome and retention rate.

There’s a special “early bird” rate available for a few more weeks.  Last year, the event filled up several months ahead of time, so don’t wait.

On another note, just received the schedule for the 2013 Evolution of Psychotherapy conference.  I’m very excited to have been invited once again to the pretigious event and will be bring the latest information and research on acheiving excellence as a behavioral health practitioner.  On that note, the German artist and psychologist, Andreas Steiner has created a really cool poster and card game for the event, featuring all of the various presenters.  Here’s the poster.  Next to it is the “Three of Hearts.”  I’m pictured there with two of my colleagues, mentors, and friends, Michael Yapko and Stephen Gilligan:

Filed Under: Conferences and Training, Feedback Informed Treatment - FIT, Top Performance Tagged With: Andreas Steiner, evidence based medicine, evidence based practice, Evolution of Psychotherapy conference, john malouff, Michael Yapko, ors, outcome management, outcome measurement, outcome rating scale, paraprofessionals, psychology, psychotherapy, session rating scale, srs, Stephen Gilligan, therapy, Training, US Department of Education's National Center (NCES)

REACHing the Next Level of Clinical Performance: What it Really Takes

September 1, 2012 By scottdm 2 Comments


Do any of these people look familiar?  Well, of course, I’m the guy in the middle pointing.  To my left is the rock and roll guitarist Joe Walsh.  On my right is world-renowned, card mechanic Richard Turner.  Why have I pictured myself sandwiched between these two?  Because they are both inspiring examples of what can be accomplished when individuals push beyond the “tried and true,” to reach the next level of performance.

Back in June, I read an article about Joe Walsh in the Chicago Tribune.  Buried deep in the piece was a brief biography of the guitarist that exemplifies what it takes to achieve excellence.  Walsh, who is 67 years old, began playing back in the late 1960’s.  Like many of his generation, he was inspired by the Beatles.  One day, he was listening to the band’s song, “And Your Bird can Sing,” which contains a “ridiculously finger stretching George Harrison guitar solo.”  According to the article, Walsh worked tirelessly until he mastered the riff.  It was only years later, long after he’d become famous, that he met Ringo Starr.  Walsh related the story to the drummer who “looked at Walsh like he was nuts.”  Harrison, Ringo told him, had played two guitar parts separately and tracked them on top of each other and later tracked them together in the studio.

Good thing no one told Walsh the truth.  As a result, he did what no one–even now–thought posssible.

On to Richard Turner.  Unless you are into magic or gambling, this may be the first time you’ve ever heard of this person.  Author Alex Stone, in his phenomenally fun and informative book, Fooling Houdini, describes him as “a card handler without equal, a man whose prowess with a deck borders on the supernatural.”  The supernaturnal?  Really?  I would have deemd such praise so much more hype, typical of “hollywood” and the media, if I hadn’t meet Turner personally and seen him work.  Simply put, there’s nothing he can’t do with a deck of cards.

Watch the brief video below filmed at this year’s “Training of Trainers” event in Chicago.  At all training events, we bring in top performers to entertain, inspire, and inform participants about what it takes to achieve excellence.

Not bad eh?  Especially when one considers that Turner is blind.  And the video above is only the tiniest snippet of his performance.  At one point, he dealt out hands of poker and black jack, asking audience members which position they would like to have dealt the winning cards.  Sure enough, whatever position was called, luck struck there and only there.  “Give me a number between 1 and 52,” he asked.  Whatever number was called out, he cut the cards to that exact position in the deck.  Did I mention he’s also a 6th degree black belt?  Simply put, Turner is a performer that is always pushing the limits.  Once he was cited for a driving motor cycle while blind!  How does he do it?  Practice.  Yep, seventeen hours a day!  For years, he slept with a deck of cards.  Like Walsh, he persisted until he mastered moves that no one considered possible or, more accurately, no one ever even imagined.

So, what can mental health professionals do to REACH the next level of clinical performance?  Over the last few years, together with my colleagues, we’ve been writing about the steps thrapists can take to achieving excellence.  This year, I was privileged to summarize the current state of the research on the subject in a keynote address at the Psychotherapy Networker conference in Washington, DC.  Here, for the first time, is “Part 1” of that address (the second half will follow soon).  In it, I lay out what the evidence says it takes to excel.

Filed Under: Conferences and Training, Top Performance Tagged With: icce, randomized clinical trial, Training

Feedback Informed Treatment as Evidence-Based Practice

May 23, 2012 By scottdm Leave a Comment

Back in November, I blogged about the ICCE application to SAMSHA’s National Registry for consideration of FIT as an official evidence-based approach (EBP).  Given the definition of EBP by the Institute of Medicine and the American Psychological Association, Feedback Informed Treatment seems a perfect, well, FIT.  According to the IOM and APA, evidence-based practice means using the best evidence and tailoring services to the client, their preferences, culture, and circumstances.  Additionally, when evidence-based, clinicians must monitor “patient progress (and of changes in the patient’s circumstances—e.g.,job loss, major illness) that may suggest the need to adjust the treatment. If progress is not proceeding adequately, the psychologist alters or addresses problematic aspects of the treatment (e.g., problems in the therapeutic relationship or in the implementation of the goals of the treatment) as appropriate.”

In late Summer 2011, ICCE submitted 1000’s of pages of supporting documents, research studies, as well as video in support of the application.  This week, we heard that FIT passed the “Quality of Research” phase of the review.  Now, the committee is looking at the “Readiness for Dissemination” materials, including the six detailed treatment and implementation manuals on feedback informed treatment.  Keep your fingers crossed.  We’ve been told that the entire process should be completed sometime in late fall.

In the meantime, we are preparing for this summer’s Advanced Intensive and Training of Trainer workshops.  Once again, clinicians, educators, and researchers from around the world will be coming together for cutting edge training.  Only a few spots remain, so register now.

Filed Under: Feedback Informed Treatment - FIT Tagged With: American Psychological Association, evidence based medicine, evidence based practice, feedback informed treatment, FIT, icce, Institute of Medicine, NREPP, practice-based evidence, SAMHSA, Training

Getting FIT: The Advanced Intensive Training

January 19, 2011 By scottdm Leave a Comment

Dateline: January 19, 2011
Buffalo, New York

The New Year is here and travel/training season is in full swing.  Last week, I was in Ohio and Virginia.  This week New York and Idaho (keep your weather fingers crossed, it’s going to be dicey getting from here to there and home again).

Interest in “Feedback Informed Treatment” continues to grow.  Agencies across the United States and abroad–as my travel schedule attests–are implementing the ORS and SRS in routine clinical practice.  Clinicians are finding the support they need on the International Center for Clinical Excellence web-based community.  As I blogged about a while back, the ICCE is the largest and most diverse group of practitioners working to improve the quality and outcome of behavioral health services.  Many will soon be joining me in Chicago for the 2011 “Advanced Intensive” training.  Once again, clinicians from all over the world will be in attendance–Sweden, Holland, England, Australia and so on.  Interest is high as participants receive a thorough, state-of-the-art grounding in the principles and practice of FIT.  I look forward to meeting everyone soon.

Last summer, I videoblogged about the event.  Ah, summer!   With everything my co-teacher, psychologist Susanne Bargmann, and I have planned, we promise a warm and rewarding event.

Filed Under: Behavioral Health, Conferences and Training, Feedback Informed Treatment - FIT Tagged With: feedback informed treatment, icce, ors, outcome rating scale, session rating scale, srs, Training

Becoming FIT: Simple but not Easy

November 29, 2010 By scottdm Leave a Comment

Becoming FIT (feedback informed in treatment).  Ask any experienced practitioner and they will tell you, “it’s such a simple idea, but it’s not easy.”  In addition to the time it takes to master the administration and interpretation of formal feedback, special skills are required for using the information to guide service delivery.

Implementation in agencies and large healthcare settings is even more challenging.  “What,” you may wonder, “is so difficult?”  All that appears to be involved is the administration of two simple scales: a 4-item outcome and a 4-item alliance measure.  Would that the process were as easy as the forms are simple.

On the International Center for Clinical Excellence community, an international group of supervisors, agency directors, and officers of large healthcare organizations meet routinely to discuss, plan, and help support one another in efforts to develop a feedback-friendly workplace culture.  Ask any and they will tell you that a key element of successful implementation is: communication.  It is also one of the biggest challenges.  Rising case loads, increased documentation requirements, and tight budgets all conspire to keep people chained to their desks, interacting with their desktop computer, and straining just to keep up with the work load.  The proverbial “water-cooler” conversations are, for many, a thing of the past–along with clinical supervision and “advanced training.”

Here’s where ICCE is helping.   The peer-to-peer, web-based community is available to clinicians, managers, researchers, and policy makers 24/7/365.  Signing up is simple and free–and you simply won’t believe the resources available.  Access to an experienced group of professionals ready, willing, and able to answer questions related to FIT.  Discussion groups on everything from using FIT in supervision to the latest research on evidence-based practice.  Training videos, research papers, policy statements, and other documents uploaded by ICCE certified trainers and associates.

In the video below, psychologist and ICCE community manager, Susanne Bargmann describes the community and available resources.  As I blogged about recently, the community is growing at a rapid rate.  We will soon hit 2000 members–and all in less than one year.  So….join us.  And if you are already a member, log onto the site now.  One cool new feature is live chat!  That right.  When you log on, look down in the left hand corner of your screen.  There you’ll be able to see everyone who is “live” on the site at that moment.  With a simple click of the button, you could be chatting with a professional in Washington or Wollongong!

Join us for the upcoming “Advanced Intensive” training in Chicago!  If you are looking for in-depth training in the “how-to” of CDOI/FIT, this is the training for you.  When you leave, you will be on your way to mastering:

  • The empirical foundations of feedback-informed clinical work (i.e., empirically supported factors underlying successful clinical work, the impact of feedback on performance)
  • Clinical skills for enhancing client engagement that cut across different therapeutic orientations and diverse treatment populations
  • How to integrate outcome management tools (including one or more of the following: ORS, SRS, CORE, and OQ 45) into clinical practice
  • How to use the outcome management tools to inform and improve service delivery
  • How to significantly improve your clinical skills and outcomes via feedback and deliberate practice
  • How to use data generated from outcome measures to inform management, supervision, and training decisions
  • Strategies for successful implementation of CDOI and FIT in your organization or practice

Registration is strictly limited to 35 participants.  To reserve your place, click on the icon below!

Filed Under: ICCE Tagged With: conferences, icce, Training

Where Necessity is the Mother of Invention: Forming Alliances with Consumers on the Margins

April 11, 2010 By scottdm 3 Comments

Spring of last year, I traveled to Gothenburg, Sweden to provide training GCK–an top notch organization led by Ulla Hansson and Ulla Westling-Missios providing cutting-edge training on “what works” in psychotherapy.  I’ll be back this week again doing an open workshop and an advanced training for the group.

While I’m always excited to be out and about traveling and training, being in Sweden is special for me.  It’s like my second home.  My family roots are Swedish and Danish and, it just so happens, I speak the language.  Indeed, I lived and worked in the country for two years back in the late seventies.  If you’ve never been, be sure and put it on your short list of places to visit…

AND IMPORTANTLY, go in the Summer!  (Actually, the photos above are from the famous “Ice Hotel”–that’s right, a hotel completely made of icc.  The lobby, bar, chairs, beds.  Everything!  If you find yourself in Sweden during the winter months, it’s a must see.  I promise you’ll never forget the experience).

Anyway, the last time I was in Gothenburg, I met a clinician whose efforts to deliver consumer-driven and outcome-informed services to people on the margins of society were truly inspiring.   During one of the breaks at the training, therapist Jan Larsson introduced himself, told me he had been reading my books and articles, and then showed me how he managed to seek and obtain feedback from the people he worked with on the streets.  “My work does not look like ‘traditional’ therapeutic work since I do not meet clients at an office.  Rather, I meet them where they live: at home, on a bench in the park, or sitting in the library or local activity center.”

Most of Jan’s clients have been involved with the “psychiatric system” for years and yet, he says, continue to struggle and suffer with many of the same problems they entered the system with years earlier.  “Oftentimes,” he observed, “a ‘treatment plan’ has been developed for the person that has little to do with what they think or want.”

So Jan began asking.  And each time they met, they also completed the ORS and SRS–“just to be sure,” he said.  No computer.  No I-phone app.  No sophisticated web-based adminsitration system.  With a pair of scissors, he simply trimmed copies of the measures to fit in his pocket-sized appointment book.

His experience thusfar?  In Swedish Jan says, “Det finns en livserfarenhet hos klienterna som bara väntar på att bli upptäckt och bli lyssnad till. Klienterna är så mycket mer än en diagnos. Frågan är om vi är nyfikna på den eftersom diagnosen har stulit deras livberättelse.”  Translated: “There is life experience with clients that is just waiting to be noticed and listened to.  Clients are so much more than their diagnosis.  The question is whether we are curious about them because the diagnosis has stolen their life story.”

I look forward to catching up Jan and the crew at GKC this coming week.  I also be posting interviews with Ulla and Ulla as well as ICCE certified trainers Gun-Eva Langdahl (who I’ll be working with in Skelleftea) and Gunnar Lindfeldt (who I’ll be meeting in Stockholm).  In the meantime, let me post several articles he sent by Swedish research Alain Topor on developing helpful relationships with people on the margins.  Dr. Topor was talking about the “recovery model” among people considered “severely and persistently mentally ill long before it became popular here in the States. Together with others, such as psychologist Jan Blomqvist (who I blogged about late last year), Alain’s work is putting the consumer at the center of service delivery.

Filed Under: Behavioral Health, Feedback Informed Treatment - FIT Tagged With: evidence based practice, Hypertension, Jan Blomqvist, ors, outcome rating scale, Pharmacology, psychotherapy, randomized clinical trial, recovery model, session rating scale, srs, sweden, Training

Improving Outcomes in the Treatment of Obesity via Practice-Based Evidence: Weight Loss, Nutrition, and Work Productivity

April 9, 2010 By scottdm 4 Comments

Obesity is a large and growing problem in the United States and elsewhere.  Data gathered by the National Center for Health Statistics indicate that 33% Americans are obese.  When overweight people are added to the mix, the figure climbs to a staggering 66%!   The problem is not likely to go away soon or on its own as the same figures apply to children.

Researchers estimate that weight problems are responsible for over 300,000 deaths annually and account for 12% of healthcare costs or 100 billion–that’s right, $100,000,000,000–in the United States alone.   The overweight and obese have higher incidences of arthritis, breast cancer, heart disease, colorectal cancer, diabetes, endometrial cancer, gallbladder disease, hypertension, liver disease, back pain, sleeping problems, and stroke–not to mention the tremendous emotional, relational, and social costs.  The data are clear: the overweight are the target of discrimination in education, healthcare, and employment.  A study by Brownell and Puhl (2003), for example, found that: (1) a significant percentage of healthcare professionals admit to feeling  “repulsed” by obese person, even among those who specialize in bariatric treatment; (2) parents provide less college support to their overweight compared to “thin” children; and (3) 87% of obese individuals reported that weight prevented them from being hired for a job.

Sadly, available evidence indicates that while weight problems are “among the easiest conditions to recognize,” they remain one of the “most difficult to treat.”  Weight loss programs abound.  When was the last time you watched television and didn’t see an ad for a diet pill, program, or exercise machine?  Many work.  Few, however, lead to lasting change.

What might help?

More than a decade ago, I met Dr. Paul Faulkner, the founder and then Chief Executive Officer of Resources for Living (RFL), an innovative employee assistance program located in Austin, Texas.  I was teaching a week-long course on outcome-informed work at the Cape Cod Institute in Eastham, Massachusetts.  Paul had long searched for a way of improving outcomes and service delivery that could simultaneously be used to provide evidence of the value of treatment to purchasers–in the case of RFL, the large, multinational companies that were paying him to manage their employee assistance programs.  Thus began a long relationship between me and the management and clinical staff of RFL.  I was in Austin, Texas dozens of times providing training and consultation as well as setting up the original ORS/SRS feedback system known as ALERT, which is still in use at the organization today.  All of the original reliability, validity, norming, and response trajectories were done together with the crew at RFL.

Along the way, RFL expanded services to disease management, including depression, chronic obstructive pulmonary disease, diabetes, and obesity.  The “weight management” program delivered coaching and nutritional consultation via the telephone informed by ongoing measurement of outcomes and the therapeutic alliance using the SRS and ORS.  The results are impressive.  The study by Ryan Sorrell, a clinician and researcher at RFL, not only found that the program and feedback led to weight loss, but also significant improvements in distress, health eating behaviors (70%), exercise (65%), and presenteeism on the job (64%)–the latter being critical to the employers paying for the service.

Such research adds to the growing body of literature documenting the importance of “practice-based” evidence, making clear that finding the “right” or “evidence-based” approach for obesity (or any problem for that matter) is less important than finding out “what works” for each person in need of help.  With challenging, “life-style” problems, this means using ongoing feedback to inform whatever services may be deemed appropriate or necessary.  Doing so not only leads to better outcomes, but also provides real-time, real-world evidence of return on investment for those footing the bill.

Filed Under: Behavioral Health, Feedback Informed Treatment - FIT, Practice Based Evidence Tagged With: behavioral health, cdoi, cognitive-behavioral therapy, conferences, continuing education, diabetes, disease management, Dr. Paul Faulkner, evidence based medicine, evidence based practice, Hypertension, medicine, obesity, ors, outcome rating scale, practice-based evidence, public behavioral health, randomized clinical trial, session rating scale, srs, Training

Research on the Outcome Rating Scale, Session Rating Scale & Feedback

January 7, 2010 By scottdm Leave a Comment

PCOMS - Partners for change outcome management system Scott D Miller - SAMHSA - NREPP“How valid and reliable are the ORS and SRS?”  “What do the data say about the impact of routine measurement and feedback on outcome and retention in behavioral health?”  “Are the ORS and SRS ‘evidence-based?'”

These and other questions regarding the evidence supporting the ORS, SRS, and feedback are becoming increasingly common in the workshops I’m teaching in the U.S. and abroad.

As indicated in my December 24th blogpost, routine outcome monitoring (PROMS) has even been endorsed by “specific treatments for specific disorders” proponent David Barlow, Ph.D., who stated unequivocally that “all therapists would soon be required to measure and monitor the outcome of their clinical work.”  Clearly, the time has come for all behavioral health practitioners to be aware of the research regarding measurement and feedback.

Over the holidays, I updated a summary of the data to date that has long been available to trainers and associates of the International Center for Clinical Excellence.  The PDF reviews all of the research on the psychometric properties of the outcome and session ratings scales as well as the studies using these and other formal measures of progress and the therapeutic relationship to improve outcome and retention in behavioral health services.  The topics is so important, that I’ve decide to make the document available to everyone.  Feel free to distribute the file to any and all colleagues interested in staying up to date on this emerging mega-trend in clinical practice.

Measures And Feedback from Scott Miller

Filed Under: evidence-based practice, Feedback Informed Treatment - FIT, Practice Based Evidence Tagged With: behavioral health, continuing education, david barlow, evidence based medicine, evidence based practice, feedback, Hypertension, icce, medicine, ors, outcome measurement, outcome rating scale, post traumatic stress, practice-based evidence, proms, randomized clinical trial, session rating scale, srs, Training

Magical Moments in Kansas

January 2, 2010 By scottdm Leave a Comment

Registrations are already coming in for the first International Conference on “Achieving Clinical Excellence.”

Not too long ago, I announced that internationally known researcher K. Anders Erickson, Ph.D.–the “expert on experts”–had agreed to present at the event.  At that time, I also indicated that a number of internationally accomplished performers from a variety of professions (including psychology, business, medicine, science, music, entertainment, and sports) would be with us in Kansas City to teach and inspire.  Attendees will learn the science and skills for achieving their personal best as a behavioral health practitioner by literally learning from the best.

Practice, as anyone who has been reading my recent blogosts and publications knows, is key for achieving excellence–and not just any old kind will do.  To be effective, it must be deliberate, reflective, and ongoing.   What’s more, it must be accompanied with high levels of support and detailed instruction from exceptional teachers.

michael ammart

No performer embodies these two principles–dedicated practice and exceptional teaching–better than FISM gold-medial winning magician, Michael Ammar.  Magic magazine named him one of the 100 most influential magicians of the century.

Michael will open the second day of the the conference.  First, he’ll perform. What can I say?  You’ll be astonished and amazed.  After that, Michael will talk about the role of practice in achieving excellence.  He’s a master teacher who has spent years studying the elements of successful practice.  He’ll not only inspire you, he will provide you with the means to excel.

Join us for three action packed days of fun, science and skill building.  In the meantime, if you have a spare moment, watch Michael Ammar perform one of the classics of magic: the cups and balls.

 

Filed Under: Behavioral Health, Conferences and Training, excellence, Feedback Tagged With: CEU, conference, expertise, k. andersm erickson, michael ammar, psychology, Training

Leading Outcomes in Vermont: The Brattleboro Retreat and Primarilink Project

November 8, 2009 By scottdm 4 Comments

For the last 7 years, I’ve been traveling to the small, picturesque village of Brattleboro, Vermont to work with clinicians, agency managers, and various state officials on integrating outcomes into behavioral health services.  Peter Albert, the director of Governmental Affairs and PrimariLink at the Brattleboro Retreat, has tirelessly crisscrossed the state, promoting outcome-informed clinical work and organizing the trainings and ongoing consultations.   Over time, I’ve done workshops on the common factors, “what works” in therapy, using outcome to inform treatment, working with challenging clinical problems and situations and, most recently, the qualities and practices of super effective therapists.  In truth, outcome-informed clinical work both grew up and “came of age” in Vermont.  Indeed, Peter Albert was the first to bulk-purchase the ASIST program and distribute it for free to any provider interested in tracking and improving the effectiveness of their clinical work.

If you’ve never been to the Brattleboro area, I can state without reservation that it is one of the most beautiful areas I’ve visited in the U.S.–particularly during the Fall, when the leaves are changing color.  If you are looking for a place to stay for a few days, the Crosy House is my first and only choice.  The campus of the Retreat is also worth visiting.  It’s no accident that the trainings are held there as it has been a place for cutting edge services since being founded in 1874.  The radical idea at that time?  Treat people with respect and dignity.  The short film below gives a brief history of the Retreat and a glimpse of the serene setting.

Anyway, this last week, I spent an entire day together with a select group of therapists dedicated to improving outcomes and delivering superior service to their clients.  Briefly, these clinicians have been volunteering their time to participate in a project to implement outcome-informed work in their clinical settings.  We met in the boardroom at the Retreat, discussing the principles and practices of outcome-informed work as well as reviewing graphs of their individual and aggregate ORS and SRS data.

It has been and continues to be an honor to work with each and every one in the PrimariLink project.  Together, they are making a real difference in the lives of those they work with and to the field of behavioral health in Vermont.  If you are a clinician located in Vermont or provide services to people covered by MVP or PrimariLink and would like to participate in the project, please email Peter Albert.  At the same time, if you are a person in need of behavioral health services and looking for a referral, you could do no better than contacting one of the providers in the project!

Filed Under: Behavioral Health, Feedback Informed Treatment - FIT, FIT Software Tools, Practice Based Evidence Tagged With: behavioral health, common factors, consultation, ors, outcome rating scale, session rating scale, srs, supershrinks, therapy, Training

History doesn’t repeat itself,

September 20, 2009 By scottdm 2 Comments

Mark Twain photo portrait.

Image via Wikipedia

“History doesn’t repeat itself,” the celebrated American author, Mark Twain once observed, “but it does rhyme.” No better example of Twain’s wry comment than recurring claims about specifc therapeutic approaches. As any clinician knows, every year witnesses the introduction of new treatment models.  Invariably, the developers and proponents claim superior effectivess of the approach over existing treatments.  In the last decade or so, such claims, and the publication of randomized clinical trials, has enabled some to assume the designation of an “evidence-based practice” or “empirically supported treatment.”  Training, continuing education, funding, and policy changes follow.

Without exception, in a few short years, other research appears showing the once widely heralded “advance” to be no more effective than what existed at the time.  Few notice, however, as professional attention is once again captured by a “newer” and “more improved” treatment model.  Studies conducted by my colleagues and I (downloadable from the “scholarly publications” are of my website), document this pattern with treatments for kids, alcohol abuse and dependence, and PTSD over the last 30 plus years.

As folks who’ve attended my recent workshops know, I’ve been using DBT as an example of approaches that have garnered significant professional attention (and funding) despite a relatively small number of studies (and participants) and no evidence of differential effectiveness.  In any event, the American Journal of Psychiatry will soon publish, “A Randomized Trial of Dialectical Behavior Therapy versus General Psychiatric Management for Borderline Personality Disorder.”

As described by the authors, this study is “the largest clinical trial comparing dialectical behavior therapy and an active high-standard, coherent, and principled approach derived from APA guidelines and delivered by clinicians with expertise in treating borderline personality disorder.”

And what did these researchers find?

“Dialectical behavior therapy was not superior to general psychiatric management with both intent-to-treat and per-protocol analyses; the two were equally effective across a range of outcomes.”  Interested readers can request a copy of the paper from the lead investigator, Shelley McMain at: Shelley_McMain@camh.net.

Below, readers can also find a set of slides summarizing and critiquing the current research on DBT. In reviewing the slides, ask yourself, “how could an approach based on such a limited and narrow sample of clients and no evidence of differential effectives achieved worldwide prominence?”

Of course, the results summarized here do not mean that there is nothing of value in the ideas and skills associated with DBT.  Rather, it suggests that the field, including clinicians, researchers, and policy makers, needs to adopt a different approach when attempting to improve the process and outcome of behavioral health practices.  Rather than continuously searching for the “specific treatment” for a “specific diagnosis,” research showing the general equivalence of competing therapeutic approaches indicates that emphasis needs to be placed on: (1) studying factors shared by all approaches that account for success; and (2) developing methods for helping clinicians identify what works for individual clients. This is, in fact, the mission of the International Center for Clinical Excellence: identifying the empirical evidence most likely to lead to superior outcomes in behavioral health.

Dbt Handouts 2009 from Scott Miller

Filed Under: Behavioral Health, Dodo Verdict, Practice Based Evidence Tagged With: alcohol abuse, Americal Psychological Association, American Journal of Psychiatry, APA, behavioral health, CEU, continuing education, CPD, evidence based medicine, evidence based practice, mental health, psychiatry, PTSD, randomized control trial, Training

International "Achieving Clinical Excellence" Conference

September 12, 2009 By scottdm 3 Comments

Mark your calendars!  The International Center for Clinical Excellence is pleased to announce the “Achieving Clinical Excellence” (ACE) conference to be held at the Westin Hotel in Kansas City, Missouri on October 20-22nd, 2010.

K. Anders Erickson, Ph.D., the editor of The Cambridge Handbook of Expertise and Expert Performance and recognized “expert on experts,” will keynote the event. Through a combination of plenary presentations and intensive workshops, an internationally renowned faculty of researchers and educators, including Scott D. Miller, Ph.D. and John Norcross, Ph.D., will help participants discover the means to achieve excellence in clinical practice, leadership, ethics, and personal care.

Attendees will also meet and learn directly from internationally ranked performers from a variety of professions, including medicine, science, music, entertainment, and sports.  As just one example, the Head Coach of the Olympic, Gold-Medal-winning Women’s volleyball team, Hugh McCutcheon, will present at the conference.  In addition to a pre-conference day on ethics and law, internationally renowned concert pianist David Helfgott, whose heart-warming story was featured in the award winning film Shine, will perform on Thursday evening, October 21st. Join us in Kansas City for three days of science, skill building, and inspiration.

Filed Under: Behavioral Health, Conferences and Training, deliberate practice, excellence Tagged With: behavioral health, CEU, conference, CPD, excellence, healthcare, John Norcross, K. Anders Erickson, Training

SEARCH

Subscribe for updates from my blog.

  

Upcoming Training

Mar
22

FIT Supervision Intensive 2021 ONLINE


Mar
30

FIT SPRING CAFÉ 2


Aug
02

FIT Implementation Intensive 2021


Aug
04

Training of Trainers 2021

FIT Software tools

FIT Software tools

NREPP Certified

HTML tutorial

LinkedIn

Topics of Interest:

  • Behavioral Health (111)
  • behavioral health (4)
  • Brain-based Research (2)
  • CDOI (14)
  • Conferences and Training (67)
  • deliberate practice (28)
  • Dodo Verdict (9)
  • Drug and Alcohol (3)
  • evidence-based practice (66)
  • excellence (61)
  • Feedback (38)
  • Feedback Informed Treatment – FIT (206)
  • FIT (26)
  • FIT Software Tools (12)
  • ICCE (26)
  • Implementation (7)
  • medication adherence (3)
  • obesity (1)
  • PCOMS (11)
  • Practice Based Evidence (38)
  • PTSD (4)
  • Suicide (1)
  • supervision (1)
  • Termination (1)
  • Therapeutic Relationship (8)
  • Top Performance (39)

Recent Posts

  • Feedback Informed Treatment in Statutory Services (Child Protection, Court Mandated)
  • Do We Learn from Our Clients? Yes, No, Maybe So …
  • Developing a Sustainable Deliberate Practice Plan
  • Making Sense of Client Feedback
  • Umpires and Psychotherapists

Recent Comments

  • Asta on The Expert on Expertise: An Interview with K. Anders Ericsson
  • Michael McCarthy on Culture and Psychotherapy: What Does the Research Say?
  • Jim Reynolds on Culture and Psychotherapy: What Does the Research Say?
  • gloria sayler on Culture and Psychotherapy: What Does the Research Say?
  • Joseph Maizlish on Culture and Psychotherapy: What Does the Research Say?

Tags

addiction Alliance behavioral health brief therapy Carl Rogers CBT cdoi common factors conferences continuing education denmark evidence based medicine evidence based practice Evolution of Psychotherapy excellence feedback feedback informed treatment healthcare holland icce international center for cliniclal excellence medicine mental health meta-analysis Norway NREPP ors outcome measurement outcome rating scale post traumatic stress practice-based evidence psychology psychometrics psychotherapy psychotherapy networker public behavioral health randomized clinical trial SAMHSA session rating scale srs supershrinks sweden Therapist Effects therapy Training