SCOTT D Miller - For the latest and greatest information on Feedback Informed Treatment

  • About
    • About Scott
    • Publications
  • Training and Consultation
  • Workshop Calendar
  • FIT Measures Licensing
  • FIT Software Tools
  • Online Store
  • Top Performance Blog
  • Contact Scott
scottdmiller@ talkingcure.com +1.773.454.8511

Want to be more effective? Point North!

July 24, 2014 By scottdm Leave a Comment

2014-06-25 14.22.57

In June, I spent several days in the air traveling to and from Perth, Australia for a conference.  Too tired to read anymore, I turned on the video system and began watching a program from the Discovery Channel about the North American red fox. 

red fox

The furry little creatures were shown hunting rodents hidden under three feet of snow.  Three feet!  Up in the air the foxes would hop, thrusting their noses deep into the drifts.  Most of the time, they came up with nothing.  That is, unless they were facing north.  Then the odds changed considerably.  Seventy-five percent of the time, the fox was guaranteed a meal.  Scientists believe the animal uses the planet’s magnetic field to more accurately calculate and plot it’s trajectory–the same principle as the GPS in your car.  Watch the video.  It’s incredible.

In a similar way, the odds of successful treatment increase considerably when clinicians incorporate feedback into their work.  Asking consumers to assess their progress and the quality of the therapeutic relationship is the “North Pole” of behavioral health services.  Available evidence documents that when providers ask for and accommodate such feedback, dropout and deterioration rates plummet, and effectiveness doubles.  Without it, the same body of evidence shows that likelihood of recovery for consumers is about 15-20%, roughly equivalent to foxes who hunt pointing in the wrong direction.

The process, known as Feedback-Informed Treatment (FIT), is being used around the globe to improve the quality and outcome of therapy.  It’s also listed on SAMHSA’s National Registry of Evidence-Based Programs and Practices.

I have a brand new DVD demonstrating how to introduce, administer, and deal effectively with the feedback consumers provide.  It was filmed live at the most recent Evolution of Psychotherapy Conference.  Thanks to the Erickson Foundation, for a limited time, you can get it here for 29.95 (that’s 50% off the regular price).

2014-07-24 11.01.58

More information about FIT is available at: www.whatispcoms.com.  You can also access the free outcome and alliance tools there.  Gotta go.  I’m re-arranging my office furniture…

Filed Under: Feedback Informed Treatment - FIT Tagged With: evidence based practice, feedback informed treatment

The Sounds of Silence: More on Research, Researchers, and the Media

July 21, 2014 By scottdm Leave a Comment

The Sound of Silence Flauta-1

Back in April, I blogged about an article that appeared in The Guardian, one of the U.K.’s largest daily newspapers.  Citing a single study published in Denmark, the authors boldly asserted, “The claim that all forms of psychotherapy are winners has been dealt a blow.”  Sure enough, that one study comparing CBT to psychoanalysis, found that CBT resulted in superior effects in the treatment of bulimia.

As I pointed out at the time, I was surprised that such an obscure research finding would be covered by a major newspaper.  “What could be the point?”  I wondered–that is, until I saw who had written the piece.  The authors were none other than psychologist Daniel Freemen, a strong proponent of the idea that certain treatments are better than others, and his journalist brother, Jason.

Jason&Daniel-Freeman

I have to admit, I suspected an agenda was at work.  After all, scientists have learned not to depend on extraordinary findings from single studies.  Replication is key to separating fact from hopeful fiction.  In the service of this objective, I cited a truly massive study published in Clinical Psychology Review.  Using the statistically rigorous method of meta-analysis, researchers reviewed results from 53 studies of psychological treatments for eating disorders.  The result?  No difference in effect between competing therapeutic approaches–a result confirming 50 years of robust research.  Why hadn’t this particular study been cited?  After all,  it was available at the time the two brothers wrote their piece.

Fast forward six months.  Another study from Denmark has been published, this one comparing two treatments for sexual abuse.  The results?   Both treatments worked and gains were maintained at 1 year follow up.  What’s more, consistent with the much-maligned “Dodo verdict,” no differences in outcome were found between analytic and systemic treatment approaches.

So far, no article from the Freemans.

Filed Under: Practice Based Evidence Tagged With: evidence based practice

What’s in an Acronym? CDOI, FIT, PCOMS, ORS, SRS … all BS?

June 7, 2014 By scottdm Leave a Comment

“What’s in a name?”

–William Shakespeare

A little over a week ago, I received an email from Anna Graham Anderson, a graduate student in psychology at Aarhus University in Denmark.  “I’m writing,” she said, “in hopes of receiving some clarifications.”

Anna Graham Anderson
Anna Graham Anderson

Without reading any further, I knew exactly where Anna was going.  I’d fielded the same question before.  As interest in measurement and feedback has expanded, it comes up more and more frequently.

Anna continued,  “I cannot find any literature on the difference between CDOI, FIT, PCOMS, ORS, and SRS.  No matter where I search, I cannot find any satisfying clues.  Is it safe to say they are the same?”  Or, as another asked more pointedly, “Are all these acronyms just a bunch of branding B.S.?”

I answered, “B.S.?  No.  Confusing?  Absolutely.  So, what is the difference?”

As spelled out in each of the six treatment and training manuals, FIT, or feedback-informed treatment, is, “a panetheoretical approach for evaluating and improving the quality and effectiveness of behavioral health services.  It involves routinely and formally soliciting feedback from consumers regarding the therapeutic relationship and outcome of care and using the resulting information to inform and tailor service deliver.”

Importantly, FIT is agnostic regarding both the method of treatment and the particular measures a practitioner may employ.  Some practitioners use the ORS and SRS, two brief, simple-to-use, and free measures of progress and the therapeutic relationship–but any other valid and reliable scales could be used.

Of all the acronyms associated with my work, CDOI is the one I no longer use.  For me, it had always problematic as it came precariously close to being a treatment model, a way of doing therapy.  I wasn’t  interested in creating a new therapeutic approach.  My work and writing on the common factors had long ago convinced me the field needed no more therapeutic schools.  The phrase, “client-directed, outcome-informed”  described the team’s position at the time, with one foot in the past (how to do therapy), the other in the future (feedback).

And PCOMS?  A long time ago, my colleagues and I had a dream of launching a web-based “system for both monitoring and improving the effectiveness of treatment” (Miller et. al, 2005).  We did some testing at an employee assistance program in located in Texas, formed a corporation called PCOMS (Partners for Change Outcome Management System), and even hired a developer to build the site.  In the end, nothing happened.  Overtime, the acronym, PCOMS, began to be used as an overall term referring to the ORS, SRS, and norms for interpreting the scores.  In February 2013, the Substance Abuse and Mental Health Service Adminstration (SAMHSA) formally recognized PCOMS as an evidence-based practice.  You can read more about PCOMS at: www.whatispcoms.com.

I expect there will be new names and acronyms as the work evolves.  While some remain, others, like fossils, are left behind; evidence of what has come before, their sum total a record of development over time.

Filed Under: Feedback Informed Treatment - FIT Tagged With: cdoi, evidence based medicine, evidence based practice, feedback informed treatment, FIT, ors, outcome measurement, outcome rating scale, PCOMS, SAMHSA, session rating scale, srs, Substance Abuse and Mental Health Service Adminstration

How not to be among the 70-95% of practitioners and agencies that fail

April 20, 2014 By scottdm Leave a Comment

fail2

Our field is full of good ideas, strategies that work.  Each year, practitioners and agencies devote considerable time and resources to staying current with new developments.  What does the research say about such efforts?  When it comes to the implementation of new, evidence-based practices, traditional training strategies routinely produce only 5% to 30% success rates.  Said another way, 70-95% of training fails (Fixsen, Blase, Van Dyke, & Metz, 2013).  

In 2013, Feedback Informed Treatment (FIT)–that is, formally using measures of progress and the therapeutic alliance to guide care–was deemed an evidence-based practice by SAMHSA, and listed on the official NREPP website.  It’s one of those good ideas.  Research to date shows that FIT as much as doubles the effectiveness of behavioral health services, while decreasing costs, deterioration and dropout rates. 

As effective as FIT has proven to be in scientific studies, the bigger challenge is helping clinicians and agencies implement the approach in real world clinical settings.  Simply put, it’s not enough to know “what works.”  You have to be able to put “what works” to work.  On this subject, researchers have identified five, evidence-based steps associated with the successful implementation of any evidence-based practice.  The evidence is summarized in a free, manual available online.  You can avoid the 70-95% failure rate by reading it before attending another training, buying that new software, or hiring the latest consultant.

At the International Center for Clinical Excellence, we’ve integrated the research on implementation into all training events, including a special, two-day intensive workshop on implementing Feedback-Informed Treatment (FIT).  Based on the five, scientifically-established steps, clinicians, supervisors, and agency directors will learn how to both plan and execute a successful implementation of this potent evidence-based practice. 

You can register today by clicking on the link above or the “FIT for Management” icon below.  Feel free to e-mail me with any questions.  In the meantime, hope to see you this summer in Chicago!

Fit Imp 2014

Filed Under: Conferences and Training Tagged With: behavioral health, dropout rates, evidence based medicine, evidence based practice, feedback informed treatment, FIT, icce, implementation, international center for cliniclal excellence, NREPP, SAMHSA, Training

Good News and Bad News about Psychotherapy

March 25, 2014 By scottdm 3 Comments

good news bad news

Have you seen this month’s issue of, “The National Psychologist?”  If you do counseling or psychotherapy, you should read it.  The headline screams, “Therapy: No Improvement for 40 Years.”  And while I did not know the article would be published, I was not surprised by the title nor it’s contents.  The author and associate editor, John Thomas, was summarizing the invited address I gave at the recent Evolution of Psychotherapy conference.

Fortunately, it’s not all bad news.  True, the outcomes of psychotherapy have not been improving.  Neither is there much evidence that clinicians become more effective with age and experience.  That said, we can get better.  Results from studies of top performing clinicians point the way.  I also reviewed this exciting research in my presentation.
Even if you didn’t attend the conference, you can see it here thanks to the generosity of the Milton H. Erickson Foundation.  Take a look at the article and video, then drop me a line and let me know what you think.  To learn more, you can access a variety of articles for free in the scholarly publications section of the website.

Click here to access the article from the National Psychologist about Scott Miller’s speech at the Evolution of Psychotherapy Conference in Anaheim, California (US) 

Filed Under: Top Performance Tagged With: accountability, Alliance, counselling, deliberate practice, erickson, evidence based practice, Evolution of Psychotherapy, feedback, healthcare, john thomas, psychotherapy, The National Psychologist, therapy

Did you know your clients can tell if you are happy?

January 19, 2014 By scottdm 3 Comments

Are_You_Happy

It’s true.  Adding to a growing literature showing that the person of the therapist is more important than theoretical orientation, years of experience, or discipline, a new study documents that clients are sensitive to the quality of their therapist’s life outside of treament.  In short, they can tell when you are happy or not.  Despite our best efforts to conceal it, they see it in how we interact with them in therapy.  By contrast, therapists’ judgements regarding the quality of the therapy are biased by their own sense of personal well-being. The solution?  Short of being happy, it means we need to check in with our clients on a regular basis regarding the quality of the therapeutic relationship.  Multiple randomized clinical trials show that formally soliciting feedback regarding progress and the alliance improves outcome and continued engagement in treatment.  One approach, “Feedback-Informed Treatment” is now listed on SAMHSA’s National Registry of Evidence-Based Programs and Practices.  Step-by-step instructions and videos for getting started are available on a new website: www.pcomsinternational.com. Seeking feedback from clients not only helps to identify and correct potential problems in therapy, but is also the first step in pushing one’s effectiveness to the next level.  In case you didn’t see it, I review the research and steps for improving performance as a therapist in an article/interview on the Psychotherapy.net website.  It’s sure to make you happy!

Filed Under: CDOI, Feedback, Feedback Informed Treatment - FIT, PCOMS Tagged With: behavioral health, common factors, evidence based practice, excellence, healthcare, productivity, Therapist Effects

Excellence in Amsterdam: The 2013 ACE Conference

June 6, 2013 By scottdm Leave a Comment

My how time flies!  Nearly three weeks have passed since hundreds of clinicians, researchers, and educators met in Amsterdam, Holland for the 2013 “Achieving Clinical Excellence.”  Participants came from around the globe–Holland, the US, Germany, Denmark, Italy, Russia, Norway, Sweden, Denmark, New Zealand, Romania, Australia, France–for three days of presentations on improving the quality and outcome of behavioral healthcare.  Suffice it to say, we had a blast!

The conference organizers, Dr. Liz Pluut and Danish psychologist Susanne Bargmann did a fantastic job planning the event, organizing a beautiful venue (the same building where the plans for New York City were drafted back in the 17th century), coordinating speakers (36 from around the globe), arranging meals, hotel rooms, and handouts.

Dr. Pluut opened the conference and introduced the opening plenary speaker, Dr. K. Anders Ericsson, the world’s leading researcher and “expert on expertise.”  Virtually all of the work being done by me and my colleagues at the ICCE on the study of excellence and expertise among therapists is based on the three decades of pioneering work done by Dr. Ericsson.  You can read about our work, of course, in several recent articles: Supershrinks, The Road to Mastery, or the latest The Outcome of Psychotherapy: Past, Present and Future (which appeared in the 50th anniversary edition of the journal, Psychotherapy).

Over the next several weeks, I’ll be posting summaries and videos of many of the presentations, including Dr. Ericsson.  One key aspect of his work is the idea of “Deliberate Practice.”  Each of the afternoon sessions on the first day focused on this important topic, describing how clinicians, agency managers, and systems of care can apply it to improve their skills and outcome.

The first of these presentations was by psychologist Birgit Valla–the leader of Family Help, a mental health agency in Stange, Norway–entitled, “Unreflectingly Bad or Deliberately Good: Deciding the Future of Mental Health Services.”  Grab a cup of coffee and listen in…

Oh, yeah…while on the subject of excellence, here’s an interview that just appeared in the latest issue of the UK’s Therapy Today magazine:

Excellence in therapy: An Interview with Scott D. Miller, Ph.D. by Colin Feltham. 
It starts on page 32.

Filed Under: Conferences and Training, ICCE Tagged With: accountability, behavioral health, conference, conferences, continuing education, evidence based practice, excellence, feedback

How Cool is Kuhl? A Man with Vision on a Mission

April 19, 2013 By scottdm Leave a Comment

This week, my colleague and friend, Dr. David Mee-Lee, sent me a link to a blogpost written by Don Kuhl.  Actually, I was already a subscriber to Don’s Minful MIDweek blog (you should be too), but my travel this week had prevented me from reading his latest installment.  His posts always leave me inspired and give me something to think about.  This week was no different.  More on that in a moment.

In the meantime, let me tell you about Don.  He is the founder and CEO of The Change Companies, a company whose mission is to create tailored materials and programs to support behavioral change for special populatons.  And create they do.  Hundreds of bright, attractive, highly readable publications and guided workbooks for use by professionals and the people they serve.  Their material is exhaustive and comprehensive, including adult behavioral health, criminal justice, education and prevention, clinical assessment, and faith-based programs.  A side note, it was Don and his skillful team at The Change Companies that produced the ICCE Feedback Informed Treatment and Training Manuals.  If you’ve not seen them, you should.  They are the cutting edge of information about FIT.

What is most striking about Don, however, is his passion.  I met him at a conference in San Francisco nearly a decade ago.  On several occasions, he flew to Chicago from his home base in Carson City, Nevada just to meet, talk, and share ideas.  The photo above is from one of the meetings he arranged.  Don is devoted to improving the quality and experience of behavioral health services for professionals and clients alike.  Simply said, Don Kuhl is cool.

In his blogpost this week, Don wrote about that meeting with Jim Prochaska, David Mee-Lee, me, and Bill Miller.  He referred to it as a “highlight” of his recent professional life, a lucky event resulting from his mindful pursuit of relationships with “people who have smiles on their faces and goodness in their hearts.”

My thought?  I was and am the lucky one.  Thanks Don.  Thanks Change Companies.  Keep up the good work.

Filed Under: Top Performance Tagged With: addiction, behavioral health, books, Change Companies, continuing education, Don Kuhl, evidence based practice, excellence, icce

Evidence-based Practice is a Verb not a Noun

April 8, 2013 By scottdm 1 Comment

Evidence-based practice (EBP).  What is it?  Take a look at the graphic above.  According to American Psychological Association and the Institute of Medicine, there are three components: (1) the best evidence; in combination with (2) individual clinical expertise; and consistent with (3) patient values and expectations.  Said another way, EBP is a verb.  Why then do so many treat it as a noun, continually linking the expression to the use of specific treatment approaches?  As just one example, check out guidelines published for the treatment of people with PTSD by the National Institute for Clinical Excellence (NICE)–the U.K.’s equivalent to the U.S. Substance Abuse and Mental Health Services Administration (SAMHSA).  Despite the above noted definition, and the lack of evidence favoring one treatment over another, the NICE equates EBP with the use of specific treatment approaches and boldly recommends certain methods over others.

Not long ago, ICCE Senior Associate, and U.K.-based researcher and clinician, Bill Andrews, addressed the problems with the guidelines in a presentation to an audience of British practitioners.  He not only addresses the inconsistent use of the term, evidence-based practice, in the development of guidelines by governing bodies but also the actual research on PTSD.  After watching the clip, take some time to review the articles assembled below, which Bill cites during his presentation.  The main point here is that clinicians need not be afraid of EBP.  Instead, they need to insist that leaders and officials stick to the stated definition–a definition I’m perfectly content to live with mas are most practitioners I meet.  To wit, know what the evidence says “works,” use my expertise to translate such findings into practices that fit with the values, preferences, and expectations of the individual consumers I treat.

Click here to read the meta-analysis that started it all.  Don’t stop there, however, make sure and read the response to that study written by proponents of the NICE guideliness.  You’ll be completely up-to-date if you finish with our response to that critique.

Filed Under: Practice Based Evidence Tagged With: American Psychological Association, evidence based practice, Institute of Medicine, NICE, NREPP, ptst, SAMHSA

The Revolution in Swedish Mental Health Services: UPDATE on the CBT Monopoly

April 5, 2013 By scottdm Leave a Comment

No blogpost I’ve ever published received the amount of attention as the one on May 13th, 2012 detailing changes to Swedish Mental Health practice.  At the time, I reported about research results showing that the massive investment of resources in training therapists in CBT had not translated into improved outcomes or efficiency in the treatment of people with depression and anxiety.  In short, the public experiment of limiting training and treatment to so called, “evidence-based methods” had failed to produce tangible results.  The findings generated publications in Swedish journals as merited commentary in Swedish newspapers and on the radio.

I promised to keep people updated if and when research became available in languages other than Swedish.  This week, the journal Psychotherapy, published an article comparing outcomes of three different treatment approaches, including CBT, psychodynamic, and integrative-eclectic psychotherapy.  Spanning a three year period, the results gathered at 13 outpatient clinics, found that psychotherapy was remarkably effective regardless of the type of treatment offered!  Read the study yourself and then ask yourself: when will a simpler, less expensive, and more client-centered approach to insuring effective and efficient behavioral health services be adopted?  Routinely seeking feedback from consumers regarding the process and outcome of care provides such an alternative.  The failure to find evidence that adopting specific models for specific disorders improves outcomes indicates the time has come.  You can learn more about feedback-informed treatment (FIT), a practice recently designed “evidence-based” by the Substance Abuse and Mental Health Services Administration (SAMHSA), by visiting the International Center for Clinical Excellence web-based community or attending an upcoming training with me in Chicago or on the road.

  • Learn more about what is going on in Sweden by reading:

Everyday evidence outcomes of psychotherapies in swedish public health services (psychotherapy werbart et al 2013)

  • Here’s one additional reference for those of you who read Swedish.  It’s the official summary of the results from the study that started this entire thread:
Delrapport ii slutversion

Filed Under: Practice Based Evidence Tagged With: CBT, evidence based practice, ors, outcome rating scale, psychotherapy, session rating scale, srs, sweden

What to Pay Attention to in Therapy?

March 15, 2013 By scottdm Leave a Comment

A week or so ago, I received an email from my friend, colleague, and mentor Joe Yeager.  He runs a small listserve that sends out interesting and often provocative information.  The email contained pictures from a new and, dare I say, ingenious advertising campaign for Colgate brand dental floss.  Before I give you any of further details, however, take a look at the images yourself:

All right.  So what caught your attention?  If you’re like most people–including me–you probably found yourself staring at the food stuck in the teeth of the men in all three images.  If so, the ad achieved its purpose.  Take a look at the pictures one more time.  In the first, the woman has one too many fingers on her left hand.  The second image has a “phamtom arm” around the man’s shoulder.  Can you see the issue in the third?

The anomalies in the photos are far from minor!  And yet, most of us, captured by the what initially catches our eye, miss them.

Looking beyond the obvious is what Feedback Informed Treatment (FIT) is all about.  Truth is, much of the time therapy works.  What we do pay attention to gets results–except when it doesn’t!  At those times, two things must happen: (1) we have to know when what we usually do isn’t working with a given person; and (2) look beyond the obvious and see a bigger picture.  Doing this takes effort and support.    What can you do?

1. Download two free, brief, simple to use tools for tracking outcome and engagement in care (the ORS and SRS) and begin using them in your work;

2. Join the International Center for Clinical Excellence, the world’s largest, free, online, non-denominational organization of behavioral health professionals;

3. Read the six cutting-edge treatment and training manuals on feedback-informed treatment–a series which helped earn FIT the highest ratings from the Substance Abuse and Mental Health Services Administration (SAMHSA);

4. Attend a training in Chicago or abroad.

 

Filed Under: Feedback Informed Treatment - FIT Tagged With: accountability, Alliance, behavioral health, deliberate practice, evidence based practice, feedback, NREPP, SAMHSA

Dealing with Scientific Objections to the Outcome and Session Rating Scales: Real and Bogus

December 15, 2012 By scottdm Leave a Comment

The available evidence is clear: seeking formal feedback from consumers of behavioral health services decreases drop out and deterioration while simultanesouly improving effectiveness.  When teaching practitioners how to use the ORS and SRS to elicit feedback regarding progress and the therapeutic relationship,  three common and important concerns are raised:

  1. How can such simple and brief scales provide meaningful information?
  2. Are consumers going to be honest?
  3. Aren’t these measures merely assessing satisfaction rather than anything meaninful?

Recently, I was discussing these concerns with ICCE Associate and Certified Trainer, Dan Buccino.

Briefly, Dan is a clinical supervisor and student coordinator in the Adult Outpatience Community Psychiatry program at Johns Hopkins.  He’d not only encountered the concerns noted above but several additional objections.  As he said in his email, “they were at once baffling and yet exciting, because they were so unusal and rigorous.”

“It’s a sign of the times,” I replied, “As FIT (feedback informed treatment) becomes more widespread, the supporting evidence will be scrutinized more carefully.  It’s a good sign.”

Together with Psychologist and ICCE Senior Associate and Trainer, Jason Seidel, Dan crafted detailed response.  When I told them that I believed the ICCE community would value having access to the document they created, both agreed to let me publish it on the Top Performance blog.  So…here it is.  Please read and feel free to pass it along to others.

 

 

 

Filed Under: Feedback Informed Treatment - FIT Tagged With: accountability, behavioral health, Certified Trainers, evidence based practice, feedback, interviews, mental health, ors, practice-based evidence, psychometrics, research, srs

The Importance of "Whoops" in Improving Treatment Outcome

December 2, 2012 By scottdm Leave a Comment

“Ring the bells that still can ring,
Forget your perfect offering
There is a crack in everything,
That’s how the light gets in.”

Leonard Cohen, Anthem

Making mistakes.  We all do it, in both our personal and professional lives.  “To err is human…,” the old saying goes.  And most of us say, if asked, that we agree whole heartedly with the adage–especially when it refers to someone else!  When the principle becomes personal, however, its is much more difficult to be so broad-minded.

Think about it for a minute: can you name five things you are wrong about?  Three?  How about the last mistake you made in your clinical work?  What was it?  Did you share it with the person you were working with?  With your colleagues?

Research shows there are surprising benefits to being wrong, especially when the maker views such errors differently.  As author Alina Tugend points out in her fabulous book, Better by Mistake, custom wrongly defines a mistake as ” the failure of a planned sequence of mental or physical activities to achieve its intended outcome.”  When you forget a client’s name during a session or push a door instead of pull, that counts as  slip or lapse.  A mistake, by contrast, is when “the plan itself is inadequate to achieve it’s objectives” (p. 11).  Knowing the difference, she continues, “can be very helpful in avoiding mistakes in the future” because it leads exploration away from assigning blame to the exploring systems, processes, and conditions that either cause mistakes or thwart their detection.

Last week, I was working with a talented and energetic group of helping professionals in New Bedford, Massachusetts.  The topic was, “Achieving Excellence: Pushing One’s Clinical Performance to the Next Level of Effectiveness.”  As part of my presentation, I talked about becoming more, “error-centric” in our work; specifically, using ongoing measurement of the alliance to identify opportunities for improving our connection with consumers of behavioral health services.  As an example of the benefits of making mistakes the focus of professional development efforts, I showed a brief video of Rachel Hsu and Roger Chen, two talented musicians who performed at the last Achieving Clinical Excellence (ACE) conference.  Rachel plays a piece by Liszt, Roger one by Mozart.  Both compositions are extremely challenging to play.  You tell me how they did (by the way, Rachel is 8 years old, Roger. 9):

Following her performance, I asked Rachel if she’d made any mistakes during her performance.  She laughed, and then said, “Yes, a lot!”  When I asked her what she did about that, she replied, “Well, its impossible to learn from my mistakes while I’m playing.  So I note them and then later practice those small bits, over and over, slow at first, then speeding up, until I get them right.”

After showing the video in New Bedford, a member of the audience raised his hand, “I get it but that whole idea makes me a bit nervous.”  I knew exactly what he was thinking.  Highlighting one’s mistakes in public is risky business.  Studies documenting that the most effective clinicians experience more self-doubt and are more willing to admit making mistakes is simply not convincing when one’s professional self-esteem or job may be on the line.  Neither is research showing that health care professionals who admit making mistakes and apologize to consumers are significantly less likely to be sued.  Becoming error centric, requires a change in culture, one that not only invites discloure but connects it with the kind of support and structure that leads to superior results.

Creating a “whoops-friendly” culture will be a focus of the next Achieving Clinical Excellence conference, scheduled for May 16-18th, 2013 in Amsterdam, Holland.  Researchers and clinicians from around the world will gather to share their data and experience at this unique event.  I promise you don’t want to miss it.  Here’s a short clip of highlights from the last one:

My colleague, Susanne Bargmann and I will also be teaching the latest research and evidence based methods for transforming mistakes into improved clinical performance at the upcoming FIT Advanced Intensive training in Chicago, Illinois.   I look forward to meeting you at one of these upcoming events.  In the meantime, here’s a fun, brief but informative video from the TED talks series on mistakes:

By the way, the house pictured above is real.  My family and I visited it while vacationing in Niagara Falls, Canada in October.  It’s a tourist attraction actually.  Mistakes, it seems, can be profitable.

Filed Under: Feedback Informed Treatment - FIT Tagged With: accountability, Alliance, behavioral health, cdoi, conferences, continuing education, deliberate practice, evidence based practice, feedback, mental health, Therapist Effects, top performance

What is the Real Source of Effectiveness in Smoking Cessation Treatment? New Research on Feedback Informed Treatment

November 24, 2012 By scottdm Leave a Comment

When it rains, it pours!  So much news to relay regarding recent research on Feedback Informed Treatment (FIT).  Just received news this week from ICCE Associate Stephen Michaels that research using the ORS and SRS in smoking cessation treatment is in print!   A few days prior to that, Kelley Quirk sent a copy of our long-awaited article on the validity and reliability of the Group Session Rating Scale.  On that very same day, the editors from the journal Psychotherapy sent proofs of an article written by me, Mark Hubble, Daryl Chow, and Jason Seidel for the 50th anniversary issue of the publication.

Let’s start with the validity and reliability study.  Many clinicians have already downloaded and been using Group Session Rating Scale.  The measure is part of the packet of FIT tools available in 20+ languages on both my personal and the International Center for Clinical Excellence websites.   The article presents the first research on the validity and reliability of the measure.  The data for the study was gathered at two sites I’ve worked with for many years.   Thanks to Kelley Quirk and Jesse Owen for crunching the numbers and writing up the results!   Since the alliance is one of the most robust predictors of outcome, the GSRS provides yet another method for helping therapists obtain feedback from consumers of behavior health services.

Moving on, if there were a Nobel Prize for patience and persistence, it would have to go to Stephen Michaels, the lead author of the study, Assessing Counsellor Effects on Quit Rates and Life Satisfactions Scores at a Tobacco Quitline” (Michael, Seltzer, Miller, and Wampold, 2012).  Over the last four years, Stephen has trained Quitline staff in FIT, implemented the ORS and SRS in Quitline tobacco cessation services, gathered outcome and alliance data on nearly 3,000 Quitline users, completed an in-depth review of the available smoking cessation literature, and finally, organized, analyzed, and written up the results.

What did he find?  Statistically significant differences in quit rates attributable to counselor effects.  In other words, as I’ve been saying for some time, some helpers are more helpful than others–even when the treatment provided is highly manualized and structured.  In short, it’s not the method that matters (including the use of the ORS and SRS), it’s the therapist.

What is responsible for the difference in effectiveness among therapists?  The answer to that question is the subject of the article, “The Outcome of Psychotherapy: Yesterday, Today, and Tomorrow” slated to appear in the 50th anniversary issue of Psychotherapy.  In it, we review controversies surround the question, “What makes therapy work?” and tip findings from another, soon-to-be-published empirical analysis of top performing clinicians.  Stay tuned.

Filed Under: Feedback Informed Treatment - FIT Tagged With: addiction, behavioral health, cdoi, Certified Trainers, evidence based practice, excellence, feedback, healthcare, icce, Smoking cessation, Therapist Effects

An Easy Way to Improve Our Schools (and Psychotherapy)

November 13, 2012 By scottdm Leave a Comment

If you didn’t see the October Atlantic Monthly, you really missed a great issue.  In it, Amanda Ripley wrote a delightful and informative article about a simple and straightforward method for improving the performance of the public schools: have kids grade teachers.   What kind of grades you ask?   Not those on standardized achievement tests, and certainly not measures of a teacher’s popularity.  Although both of those methods are widely advocated and used, neither has proven particularly predictive of student performance.  Rather, grades should be based on how well teachers engage students; particularly whether the kids believe the teacher makes them want to work hard, pay attention, understand the course material, and identify and correct their mistakes.  Indeed, in thousands of surveys, kids as young as kindergartners “can identify with uncanny accuracy, their most–and least effective teachers.”

The findings stood out for me not only because I am a parent but also because they mirror results from psychotherapy research.  First, data gathered over the last three decades documents that client engagement is the number one process-related predictor of treatment outcome.  Second, a growing number of studies indicates that clients can identify “with uncanny accuracy” the most and least effective treatment services and providers.  Importantly, this same body of evidence shows that client assessments of their sessions and progress can be used to enhance treatment results in general as well as the effectiveness and skill level of individual clinicians.

Viewpoint clearly matters–and in the case of schools and psychotherapy, it is the recipient of the service whose opinion we should be seeking.  In her article, Ripley identifies the types of questions that can be used in schools.  If you are a therapist, two brief, simple-to-use scales are available for free.  Research has shown that regularly using the measures to solicit client feedback improves both retention in and outcome of psychotherapy.  The largest, international professional community dedicated to enhancing the quality and outcome of behavioral healthcare is available to support you in your use of the tools.  There, you will find a wealth of information, discussion forums, and how-to videos available at no charge 24 hours a day, 7 days a week, 365 days a year.

In March, many members from around the world will be joining colleagues from around the world for four days of intensive training.  Why not join us?  We work and play hard.  Rest assured that by the end of the four days, you’ll be playing an “A” game.  Click here to register today.  In the meantime, here’s what participants from last year said about the event.

Filed Under: Top Performance Tagged With: Alliance, behavioral health, cdoi, evidence based practice, excellence, feedback

Psychotherapy Training: Is it Worth the Bother?

October 29, 2012 By scottdm 2 Comments

Big bucks.  That’s what training in psychotherapy costs.  Take graduate school in psychology as an example.  According to the US Department of Education’s National Center (NCES), a typical doctoral program takes five years to complete and costs between US$ 240,000-300,000.00.

Who has that kind of money laying around after completing four years of college?  The solution? Why, borrow the money, of course!  And students do.  In 2009, the average amount of debt of those doctoral students in psychology who borrowed was a whopping US$ 88,000–an amount nearly double that of the prior decade.  Well, the training must be pretty darn good to warrent such expenditures–especially when one considers that entry level salaries are on the decline and not terribly high to start!

Oh well, so much for high hopes.

Here are the facts, as recounted in a recent, concisely written summary of the evidence by John Malouff:

1. Studies comparing treatments delivered by professionals and paraprofessionals either show that paraprofessionals have better outcomes or that there is no difference between the two groups;

2. There is virtually no evidence that supervision of students by professionals leads to better client outcomes (you should have guessed this after reading the first point);

3. There is no evidence that required coursework in graduate programs leads to better client outcomes.

If you are hoping that post doctoral experience will make up for the shortcomings of professional training, well, keep hoping.  In truth, professional experience does not correlate often or significantly with client therapy outcomes.

What can you do?  As Malouf points out, “For accrediting agencies to operate in the realm of principles of evidence-based practice, they must produce evidence…and this evidence needs to show that…training…contribute(s) to psychotherapy outcomes…[and] has positive benefits for future clients of the students” (p. 31).

In my workshops, I often advise therapists to forgo additional training until they determine just how effective they are right now.  Doing otherwise, risks perceiving progress where, in fact, none exists.  What golfer would buy new clubs or pursue expensive lessions without first knowing their current handicap?  How will you know if the training you attend is “worth the bother” if you can’t accurately measure the impact of it on your performance?

Determining one’s baseline rate of effectiveness is not as hard as it might seem.  Simply download the Outcome Rating Scale and begin using it with your clients.  It’s free.  You can then aggregate and analyze the data yourself or use one of the existing web-based systems (www.fit-outcomes.com or www.myoutcomes.com) to get data regarding your effectiveness in real time.

After that, join your colleagues at the upcoming Advanced Intensive Training in Feedback Informed Treatment.   This is an “evidence-based” training event.  You learn:

• How to use outcome management tools (e.g., the ORS) to inform and improve the treatment services you provide;

• Specific skills for determining your overall clinical success rate;

• How to develop an individualized, evidence-based professional development plan for improving your outcome and retention rate.

There’s a special “early bird” rate available for a few more weeks.  Last year, the event filled up several months ahead of time, so don’t wait.

On another note, just received the schedule for the 2013 Evolution of Psychotherapy conference.  I’m very excited to have been invited once again to the pretigious event and will be bring the latest information and research on acheiving excellence as a behavioral health practitioner.  On that note, the German artist and psychologist, Andreas Steiner has created a really cool poster and card game for the event, featuring all of the various presenters.  Here’s the poster.  Next to it is the “Three of Hearts.”  I’m pictured there with two of my colleagues, mentors, and friends, Michael Yapko and Stephen Gilligan:

Filed Under: Conferences and Training, Feedback Informed Treatment - FIT, Top Performance Tagged With: Andreas Steiner, evidence based medicine, evidence based practice, Evolution of Psychotherapy conference, john malouff, Michael Yapko, ors, outcome management, outcome measurement, outcome rating scale, paraprofessionals, psychology, psychotherapy, session rating scale, srs, Stephen Gilligan, therapy, Training, US Department of Education's National Center (NCES)

Obesity Redux: The RFL Results and complex Nature of Truth and Science

August 28, 2012 By scottdm 2 Comments

Back in April, I blogged about research published by Ryan Sorrell on the use of feedback-informed treatment in a telephonically-divered weight management program.  The study, which appeared in the journal Disease Management*, not only found that the program and feedback led to weight loss, but also significant improvements in distress, health eating behaviors (70%), exercise (65%), and presenteeism on the job (64%)–the latter being critical to employers who were paying for the service.

Despite these results, the post garnered no attention until four months later during the first week of August when three clinicians posted comments on the very same day–that’s the beauty of the web, a long memory and an even longer reach.

What can I say?  I’m having to eat my hat (or, the bird on my shoulder is…).  I learned a great deal from the feedback:

  • Despite having sourced the figure from the American Academy of Child and Adolescent Psychiatry, the claim that weight gain due to poor diet and a lack of exercise was responsible for 300,000 deaths was false.  According to the comments, the figure is closer to 26,000, a mere 10% of the number claimed!
  • The same was true regarding the reported annual cost of obesity.  The 100 billion dollar figure reported on the AACAP website is, I was told, “grossly inflated” and worse, missed the point.  By focusing on BMI, the writer counseled, “we will have wasted money spent on the 51% of the healthy people who are deemed ‘unhealthy’ based on weight and the 18% unhealthy ones who are overlooked because their weight looks fine (see Wildman et al., 2008).”

Solid points both.  Thankfully, one of the writers noted what was supposed to have been the main point of the post; namely, ” the importance of “practice-based” evidence” in guiding service delivery, “making clear that finding the ‘right’ or ‘evidence-based’ approach for obesity (or any problem for that matter) is less important than finding out “what works” for each person in need of help.”

I want to make sure readers have access to the results of the study because they are an impressive demonstration of what’s possible when the feedback is sought from and used to guide service to people “in care.”  Weight loss aside, Ryan also reported significant improvements in distress, healthy eating behaviors (70%), exercise (65%), and presenteeism on the job (64%).  All this by using two simple, 4-question scales.

*Sorrell, R. (September, 2007).  Application of an Outcome-Directed Behavioral Modification Model for Obesity on a Telephonic, Web-based Platform.Disease Management, 10, Supplement 1, 23-26.

PS: An AP article that came out this last weekend and was discussed on NPR suggests the truth about the “weight of the nation” may be more complicated than either I or those who commented on my blog may realize.  Among the many changes that have occured over the last decades, the piece declares, “Who are we?  Fatter.  The average woman has gained 18 pounds since 1990, to 160 pounds; the average man is up 16 pounds, to 196.”   Hmm.

Filed Under: Feedback Informed Treatment - FIT, obesity Tagged With: American Academy of Child and Adolescent Psychiatry, Chronic Disease, cognitive-behavioral therapy, disease management, evidence based practice, icce, Weight Management

Feedback Informed Treatment as Evidence-Based Practice

May 23, 2012 By scottdm Leave a Comment

Back in November, I blogged about the ICCE application to SAMSHA’s National Registry for consideration of FIT as an official evidence-based approach (EBP).  Given the definition of EBP by the Institute of Medicine and the American Psychological Association, Feedback Informed Treatment seems a perfect, well, FIT.  According to the IOM and APA, evidence-based practice means using the best evidence and tailoring services to the client, their preferences, culture, and circumstances.  Additionally, when evidence-based, clinicians must monitor “patient progress (and of changes in the patient’s circumstances—e.g.,job loss, major illness) that may suggest the need to adjust the treatment. If progress is not proceeding adequately, the psychologist alters or addresses problematic aspects of the treatment (e.g., problems in the therapeutic relationship or in the implementation of the goals of the treatment) as appropriate.”

In late Summer 2011, ICCE submitted 1000’s of pages of supporting documents, research studies, as well as video in support of the application.  This week, we heard that FIT passed the “Quality of Research” phase of the review.  Now, the committee is looking at the “Readiness for Dissemination” materials, including the six detailed treatment and implementation manuals on feedback informed treatment.  Keep your fingers crossed.  We’ve been told that the entire process should be completed sometime in late fall.

In the meantime, we are preparing for this summer’s Advanced Intensive and Training of Trainer workshops.  Once again, clinicians, educators, and researchers from around the world will be coming together for cutting edge training.  Only a few spots remain, so register now.

Filed Under: Feedback Informed Treatment - FIT Tagged With: American Psychological Association, evidence based medicine, evidence based practice, feedback informed treatment, FIT, icce, Institute of Medicine, NREPP, practice-based evidence, SAMHSA, Training

Revolution in Swedish Mental Health Care: Brief Update

May 14, 2012 By scottdm 1 Comment

In April 2010, I blogged about Jan Larsson, a Swedish clinician who works with people on the margins of the mental health system.  Jan was dedicated to seeking feedback, using the ORS and SRS to tailor services to the individuals he met.  It wasn’t easy.  Unilke most, he did not meet his clients in an office or agency setting.  Rather, he met them where they were: in the park, on the streets, and in their one room aparments.  Critically, wherever they met, Jan had them complete the two measures–“just to be sure,” he said.  No computer.  No I-phone app.  No sophisticated web-based adminsitration system.  With a pair of scissors, he simply trimmed copies of the measures to fit in his pocket-sized appointment book! I’ve been following his creative application of the scales ever since.

Not surprisingly, Jan was on top of the story I blogged about yesterday regarding changes in the guidelines governing Swedish mental health care practice.  He emailed me as I was writing my post, including the link to the Swedish Radio program about the changes.  Today, he emailed again, sending along links to stories appearing in two Swedish newspapers: Dagens Nyheter and Goteborg Posten.

Thanks Jan!

And to everyone else, please continue to send any new links, videos, and comments.

Filed Under: behavioral health, excellence, Feedback Informed Treatment - FIT, Top Performance Tagged With: continuing education, Dagens Nyheter, evidence based practice, Goteborg Posten, icce, ors, outcome rating scale, session rating scale, srs, sweden

Revolution in Swedish Mental Health Practice: The Cognitive Behavioral Therapy Monopoly Gives Way

May 13, 2012 By scottdm 34 Comments

Sunday, May 13th, 2012
Arlanda Airport, Sweden

Over the last decade, Sweden, like most Western countries, embraced the call for “evidence-based practice.”  Socialstyrelsen, the country’s National Board of Health and Welfare, developed and disseminated a set of guidelines (“riktlinger”) for mental health practice.  Topping the list of methods was, not surprisingly, cognitive-behavioral therapy. 

The Swedish State took the list seriously, restricting payment for training of clinicians and treatment of clients to cognitive behavioral methods.  In the last three years, a billion Swedish crowns were spent on training clinicians in CBT.  Another billion was spent on providing CBT to people with diagnoses of depression and anxiety.  No funding was provided for training or treatment in other methods. 

The State’s motives were pure: use the best methods to decrease the number of people who become disabled as result of depression and anxiety.  Like other countries, the percentage of people in Sweden who exit the work force and draw disability pensions has increased dramatically.  As a result, costs skyrocketed.  Even more troubling, far too many became permanently disabled. 

The solution?  Identify methods which have scientific support, or what some called, “evidence-based practice.” The result?  Despite substantial evidence that all methods work equally well, CBT became the treatment of choice throughout the country.  In point of fact, CBT became the only choice.

As noted above, Sweden is not alone in embracing practice guidelines.  The U.K. and U.S. have charted similar paths, as have many professional organizations.  Indeed, the American Psychological Association has now resurrected its plan to develop and disseminate a series of guidelines advocating specific treatments for specific disorders.  Earlier efforts by Division 12 (“Clinical Psychology”) met with resistance from the general membership as well as scientists who pointed to the lack of evidence for differential effectiveness among treatment approaches. 

Perhaps APA and other countries can learn from Sweden’s experience.  The latest issue of Socionomen, the official journal for Swedish social workers, reported the results of the government’s two billion Swedish crown investment in CBT.  The widespread adoption of the method has had no effect whatsoever on the outcome of people disabled by depression and anxiety.  Moreover, a significant number of people who were not disabled at the time they were treated with CBT became disabled, costing the government an additional one billion Swedish crowns.  Finally, nearly a quarter of those who started treatment, dropped out, costing an additional 340 million!

In sum, billions training therapists in and treating clients with CBT to little or no effect.  

Since the publication of Escape from Babel in 1995, my colleagues and I at the International Center for Clinical Excellence have gathered, summarized, published, and taught about research documenting little or no difference in outcome between treatment approaches.  All approaches worked about equally well, we argued, suggesting that efforts to identify specific approaches for specific psychiatric diagnoses were a waste of precious time and resources.  We made the same argument, citing volumes of research in two editions of The Heart and Soul of Change.

Yesterday, I presented at Psykoterapi Mässan, the country’s largest free-standing mental health conference.  As I have on previous visits, I talked about “what works” in behavioral health, highlighting data documenting that the focus of care should shift away from treatment model and technique, focusing instead on tailoring services to the individual client via ongoing measurement and feedback.  My colleague and co-author, Bruce Wampold had been in the country a month or so before singing the same tune.

One thing about Sweden:  the country takes data seriously.  As I sat down this morning to eat breakfast at the home of my long-time Swedish friend, Gunnar Lindfeldt, the newscaster announced on the radio that Socialstyrelsen had officially decided to end the CBT monopoly (listen here).  The experiment had failed.  To be helped, people must have a choice. 

“What have we learned?” Rolf Holmqvist asks in Socionomen, “Treatment works…at the same time, we have the possibility of exploring…new perspectives.  First, getting feedback during treatment…taking direction from the patient at every session while also tracking progress and the development of the therapeutic relationship!”

“Precis,” (exactly) my friend Gunnar said. 

And, as readers of my blog know, using the best evidence, informed by clients’ preferences and ongoing monitoring of progress and alliance is evidence-based practice.  However the concept ever got translated into creating lists of preferred treatment is anyone’s guess and, now, unimportant.  Time to move forward.  The challenge ahead is helping practitioners learn to integrate client feedback into care—and here, Sweden is leading the way.

“Skål Sverige!”

Filed Under: Behavioral Health, evidence-based practice, Feedback Informed Treatment - FIT, Practice Based Evidence Tagged With: CBG, continuing education, evidence based practice, icce, Socialstyrelsen, sweden

Mental Health Practice in a Global Economy

April 17, 2012 By scottdm 2 Comments

Did you feel it?  The seismic shift that occurred in field of mental health just a little over a month ago?  No?  Nothing?  Well, in truth, it wasn’t so much a rip in the space-time continuum as a run.  That “run,” however, promises to forever alter the fabric of clinical practice–in particular how clinicians earn and maintain a certain standard of living.

For decades, licensing statutes have protected behavioral health professionals from competing with providers living outside of their state and local jurisdiction.  In order to bill or receive reimbursement, mental health professionals needed to be licensed in the state in which treatment services were offered.  Over the years, the various professional organizations have worked to make it easier for professionals to become licensed when they move from one state to the another.  Still, it ain’t easy and, some practitioners and professional groups would argue, for good reason.  Such laws, to some extent, insure that fees charged for services are commensurate with the cost of living in the place where therapists live and work.  The cost of therapy in Manhattan varies considerably, for example, depending on whether one is talking about the city located in state of New York or Kansas.

As far as outcomes are concerned, however, there is no evidence that people who pay more necessarily get better results.  Indeed, as reviewed here on this blog, available evidence indicates little or no difference in outcome between highly trained (and expensive) clinicians and minimally trained (and less expensive) para-professionals and students.  If the traditional geographic (licensing) barriers were reduced or eliminated, consumers would with few exceptions gravitate to the best value for their money.  In the 1980’s and 90’s, for example, comsumers deserted small, Main Street retailers when big box stores opened on the outskirts of town offering the same merchandise at a lower price.  Now, big box retailers are closing en masse as consumers shift their purchases to less expensive, web based outlets.

And that’s precisely the shift that began a little over a month ago in the field of mental health.  The U.S. Military eliminated the requirement that civilian providers be licensed in the same jurisdiction or state in which treatment is offered.  The new law allows care to be provided wherever the receipient of services lives and regardless of where the provider is licensed.  Public announcements argued that the change was needed to make services available to service members and veterans living in isolated or rural areas where few providers may be available.  Whatever the reason, the implications are profound: in the future, clinicians, like Main Street retailers, will be competing with geographically distant providers.

Just one week prior to the announcement by the U.S. Military, I posted a blogpost highlighting a recent New York Times column by author and trend watcher, Thomas Friedman.  In it, I argued that “Globalization and advances in information technology were…challenging the status quo…access. At one time, being average enabled one to live an average life, live in an average neighborhood and, most importantly, earn an average living.  Not so anymore.  Average is now plentiful, easily accessible, and cheap. What technology can’t do in either an average or better way, a younger, less-trained but equally effective provider can do for less. A variety of computer programs and web-based systems provide both psychological advice and treatment.”

Truth is, the change is likely to be a boon to consumers of mental health services: easier access to services at a better price.  What can clinicians do?  First, begin measuring outcome.  Without evidence of their effectiveness, individual providers will lose out to the least expensive provider.  No matter how much people complain about “big box and internet retailers,” most use them.  The savings are too great to ignore.

What else can clinicians do?  The advice of Friedman, which I quoted in my recent blogpost, applies, “everyone needs to find their extra–their unique value contribution that makes them stand out in whatever is their field.” Measuring outcome and finding that “something special” is what the International Center for Clinical Excellence is all about.  If you are not a member, please join the thousands of other professionals online today.   After that, why not spend time with peers and cutting edge instructors at the upcoming “advanced intensive” or “training of trainers” workshops this summer.

Filed Under: Behavioral Health, Feedback Informed Treatment - FIT, ICCE Tagged With: behavioral health, brief therapy, cdoi, evidence based practice, mental health, Thomas Friedman

Is the "Summer of Love" Over? Positive Publication Bias Plagues Pharmaceutical Research

March 27, 2012 By scottdm Leave a Comment


Evidence-based practice is only as good as the available “evidence”–and on this subject, research points to a continuing problem with both the methodology and type of studies that make it into the professional literature.  Last week, PloS Medicine, a peer-reviewed, open access journal of the Public Library of Science, published a study showing a positive publication bias in research on so-called atypical antipsychotic drugs.  In comparing articles appearing in journals to the FDA database, researchers found that almost all postive studies were published while clinical trials with negative or questionable results were not or–and get this–were published as having positive results!

Not long ago, similar yet stronger results appeared in the same journal on anti-depressants.  Again, in a comparison with the FDA registry, researchers found all postive studies were published while clinical trials with negative or questionable results were not or–and get this–were published as having positive results!  The problem is far from insignificant.  Indeed, a staggering 46% of studies with negative results were not published or published but reported as positive.

Maybe the “summer of love” is finally over for the field and broader American public.  Today’s Chicago Tribune has a story by Kate Kelland and Ben Hirschler reporting data about sagging sales of anti-depressants and multiple failures to bring new, “more effective” drug therapies to market.  Taken together, robust placebo effects, the FDA mandate to list all trials (positive and negative), and an emphasis in research on conducting fair comparisons (e.g., comparing any new “products” to existing ones) make claims about “new and improved” effectiveness challenging.

Still one sees ads on TV making claims about the biological basis of depression–the so called, “biochemical imbalance.”  Perhaps this explains why a recent study of Medicaid clients found that costs of treating depression rose by 30% over the last decade while the outcomes did not improve at all during the same period.  The cause for the rise in costs?    Increased use of psychiatric drugs–in particular, anti-psychotics in cases of depression.

“It’s a great time for brain science, but at the same time a poor time for drug discovery for brain disorders,” says David Nutt, professor of neuropsychopharmacology, cited in the Chicago Tribune, “That’s an amazing paradox which we need to do something about.”

Here’s an idea: how about not assuming that problems in living are reduceable to brain chemistry?   That the direction of causality for much of what ails people is not brain to behavior but perhaps behavior to brain?  On this note, it is sad to note that while the percentage of clients prescribed drugs rose from 81 to 87%–with no improvement in effect–the number of those receiving psychotherapy dropped from 57 to 38%.

Here’s what we know about psychotherapy: it works and it has a far less troublesome side effect profile than psychotropic drugs.  No warnings needed for dry mouth, dizziness, blood and liver problems, or sexual dysfunction.  The time has come to get over the collective 1960’s delusion of better living through chemistry.

Filed Under: Practice Based Evidence Tagged With: behavioral health, continuing education, depression, evidence based practice, icce, Medicaid, mental health, psychotherapy

Feedback-Informed Treatment as Evidence-based Practice: APA, SAMSHA, and NREPP

November 1, 2011 By scottdm 1 Comment

What is evidence-based practice?  Visit the UK-based NICE website, or talk to proponents of particular theoretical schools or therapeutic models, and they will tell you that being “evidence-based” means using the approach research has deemed effective for a particular diagnosis  (e.g., CBT for depression, EMDR for trauma).  Over the last two decades, numerous organizations and interest groups have promoted lists of “approved” treatment approaches–guidelines that clinicians and funding bodies should follow when making practice decisions.  Throughout the 1990’s, for example, division 12 within the American Psychological Association (APA) promoted the idea of “empirically supported treatments.”

However, when one considers the official definition of evidence-based practice offered by the Institute of Medicine and the APA, it is hard to fathom how anyone could come to such a conclusion.  According to the APA, evidence-based practice is, “the integration of the best available research with clinical expertise in the context of patient characteristics, culture, and preferences.” (see American Psychologist, May 2006).  Nothing here about “empirically supported treatments” or the mindless application of specific treatment protocols.  Rather, according to the APA and IOM, clinicians must FIT the treatment to the client, their preferences, culture, and circumstances.  And how can one do that?  Well, conspicuously absent from the definition is, “consult a set of treatment guidelines.”  Rather, when evidence-based, clinicians must monitor “patient progress (and of changes in the patient’s circumstances—e.g.,job loss, major illness) that may suggest the need to adjust the treatment. If progress is not proceeding adequately, the psychologist alters or addresses problematic aspects of the treatment (e.g., problems in the therapeutic relationship or in the implementation of the goals of the treatment) as appropriate.”

The principles and practices of feedback-informed treatment (FIT) are not only consistent with but operationalize the American Psychological Association’s (APA) definition of evidence-based practice.  To wit, routinely and formally soliciting feedback from consumers regarding the therapeutic alliance and outcome of care and using the resulting information to inform  and tailor service delivery.  And indeed, over the last 9 months, together with Senior Associates, I completed and submitted an application for FIT to be reviewed by NREPP–SAMSHA’s National Registry of Evidence-based Practices and Approaches!  As part of that application and ICCE’s commitment to improving the quality and outcome of behavioral health, we developed a list of “core competencies” for FIT practice, a series of six detailed treatment and implementation manuals, a gap assessment tool that organizations can use to quickly and expertly assess implementation and fidelity problems, and supportive documentation and paperwork.  Finally, we developed and rigorously tested training curricula and administered the first standardized exam for certifying FIT practitioners and trainers.  We are in the final stages of that review process soon and I’m sure I’ll be making a major announcement right here on this blog shortly.  So, stay tuned.

In the meantime, this last Saturday, clinicians located the globe–Canada, New Zealand, Australia, the US,a nd Romania–sat for the first administration of ICCE “Core Competency” Exam.  Taking the test is the last step in becoming an ICCE “Certified Trainer.”   The other requirements include: (1) attending the “Advanced Intensive” and “Training of Trainers” workshops; and (2) submitting a training video on FIT for review.  The exam was administered online using the latest technology.


The members, directors, and senior associates of ICCE want to congratulate (from top left):

  • Eeuwe Schuckard, Psychologist, Wellington, New Zealand;
  • Aaron Frost, Psychologist, Brisbane, Australia;
  • Cindy Hansen, BA-Psych, HHP, Manager Myoutcomes;
  • David Prescott, Director of Professional Development, Becket Family of Services, Portland, Maine;
  • Arnold Woodruff, LMFT, Clinical Director, Home for Good, Richmond, Virginia;
  • Bogdan, Ion, Ph.D., Bucharest University, Bucharest, Romania;
  • Daniel Buccino, Clinical Supervisor, Community Psychiatry Program. Johns Hopkins;
  • Dwayne Cameron, Outreach Counselor, Prince Albert, Saskatoon, Canada;
  • Mark Goheen, the Clinical Practice Lead at Fraser Health, British Columbia.

If you are not yet a member of the ICCE community, please join the largest, fastest growing, and friendly group of behavioral health professionals today at: www.centerforclinicalexcellence.com.

Filed Under: Conferences and Training, Feedback Informed Treatment - FIT, ICCE Tagged With: APA, cdoi, continuing education, evidence based practice, HHS, icce, NREPP, SAMHSA

Psychologist Alan Kazdin Needs Help: Please Give

September 25, 2011 By scottdm Leave a Comment

Look at this picture.  This man needs help.  He is psychologist, Alan Kazdin, former president of the American Psychological Association, and current Professor of Psychology at Yale University.  A little over a week ago, to the surprise and shock of many in the field, he disclosed a problem in his professional life.  In an interview that appeared online at TimeHealthland Dr. Kazdin reported being unable to find a therapist or treatment program to which he could refer clients–even in Manhattan, New York, the nation’s largest city!

After traveling the length and breadth of the United States for the last decade, and meeting and working with hundreds of agencies and tens of thousands of therapists, I know there are many clinicians that can help Dr. Kazdin with his problem.  Our group has been tracking the outcome of numerous practitioners over the last decade and found average outcomes to be on par with those obtained in tightly controlled randomized clinical trails!  That’s good news for Dr. Kazdin.

Now, just to be sure, it should be pointed out that Dr. Kazdin is asking for practitioners who adhere to the Cochrane Review’s and the American Psychological Association’s definition of evidence-based practice (EBP)–or, I should say, I believe that is what he is asking for as the interview is not entirely clear on this point and appears to imply that EBP is about using specific treatment methods (the most popular, of course, being CBT).  The actual definition contains three main points, and clearly states that EBP is the integration of:

  1. The best available research;
  2. Clinical expertise; and
  3. The client’s culture, values, and preferences.

Interestingly, the official APA policy on evidence-based practice further defines clinical expertise as the “monitoring of patient progress (and of changes in the patient’s circumstances)…that may suggest the need to adjust the treatment.  If progress is not proceeding adequately, the psychologist alters or addresses problematic aspects of the treatment (e.g., problems in the therapeutic relationship or in the implementation of the goals of the treatment) as appropriate.”

I say “interestingly” for two reasons.  First, the definition of EBP clearly indicates that clinicians must tailor psychotherapy to the individual client.  And yet, the interview with Dr. Kazdin specifically quotes him as saying, “That’s a red herring. The research shows that no one knows how to do that. [And they don’t know how to monitor your progress].”   Now, admittedly, the research is new and, as Dr. Kazdin says, “Most people practicing who are 50 years or older”–like himself–may not know about it, but there are over a dozen randomized clinical trials documenting how routinely monitoring progress and the relationship and adjusting accordingly improves outcome.  The interview also reports him saying that “there is no real evidence” that the relationship (aka alliance) between the therapist and client matters when, in fact, the APA Interdivisional Task Force on Evidence-Based Therapy Relationships concluded that there is abundant evidence that “the therapy relationship accounts for substantial and consistent contributions to…outcome….at least as much as the particular method.”  (Incidently, the complete APA policy statement on EBP can be found in the May-June 2006 issue of the American Psychologist).

Who knows how these two major bloopers managed to slip through the editing process?  I sure know I’d be embarrased and immediately issue a clarification if I’d been misquoted making statements so clearly at odds with the facts.  Perhaps Dr. Kazdin is still busy looking for someone to whom he can refer clients.  If you are a professional who uses your clinical expertise to tailor the application of scientifically sound psychotherapy practices to client preferences, values, and culture, then you can help.

Filed Under: evidence-based practice, Top Performance Tagged With: Alan Kazdin, American Psychological Association, brief therapy, Carl Rogers, CBT, continuing education, evidence based practice, icce, medicine, therapy

The ICCE Feedback-Informed Treatment Manuals

September 12, 2011 By scottdm 3 Comments

September 12, 2011
Copenhagen, Denmark

Fall is in the air.  For me, that means the start of the travel season.  For the next two weeks, I’ll be traveling throughout Scandanavia–this week in Denmark and Norway.  It’s great to be back on the road meeting clinicians and consulting with agencies about feedback-informed treatment (FIT).

On this trip, I’m finally able to announce the publication of the Feedback-Informed Treatment Manuals.  Over the summer, senior associates of the International Center for Clinical Excellence, together with the talented artists and graphic designers at The Change Companies, worked hard to complete the series.

The six manuals cover every aspect of feedback-informed practice including: empirical foundations, basic and advanced applications (including FIT in groups, couples, and with special populations), supervision, data analysis, and agency implementation.  Each manual is written in clear, step-by-step, non-technical language, and is specifically designed to help practitioners and agencies integrate FIT into routine clinical practice.   Indeed, the manuals were submitted as part of ICCE’s application for consideration of FIT as an “evidence-based practice” to the National Registry of Evidence-Based Programs and Practices.  The manuals may be purchased separately or as a series in the bookstore.

While on the subject of registries, mention should be made that over the summer the American Psychological Association  contacted me about listing the Outcome and Session Rating Scales in their official database of outcome tools for clinical practice (click here to see the listing).  Taken together, the manuals, NREPP application, listing, and growing body of research evidence provide a compelling case for feedback-informed work.

Filed Under: Behavioral Health, Feedback Informed Treatment - FIT Tagged With: denmark, evidence based practice, icce, Norway

Becoming FIT: The 2011 Training of Trainers

August 10, 2011 By scottdm 1 Comment

August 10th, 2011

Chicago, IL

The first week of August was one of the hottest weeks on record in Chicago.  It was also the location of the hottest training on “feedback-informed treatment” (FIT)–the 5th Annual “Training of Trainers” weeklong intensive training.  We worked intensively over 5 days preparing an international group of administrators, supervisors, researchers, and clinicians to train others in the principles and practices of FIT.  We also played hard: dinners, music, magic, and more.  Here’s what attendee’s said about this years event:

Be sure and join us for the 4-day “Advanced Intensive” scheduled in March.  More information can be found at: scottdmiller.com.

 

Filed Under: Conferences and Training, Feedback Informed Treatment - FIT, PCOMS Tagged With: cdoi, evidence based practice, icce

Yes, More Evidence: Spanish version of the ORS Validated by Chilean Researchers

June 16, 2011 By scottdm Leave a Comment

Last week, Chile.  This week, Perth, Australia.  Yesterday, I landed in Sydney following a 30 hour flight from the United States.  I managed to catch the last flight out to Perth before all air travel was grounded due to another ash clound–this time coming from Chile!  I say “another” as just over a year ago, I was trapped behind the cloud of ash from the Icelandic eruption!  So far so good.  Today, I’ll spend the day talking about “excellence” in behavioral healthcare.

Before heading out to teach for the day, I wanted to upload a report from a recent research project conducted in Chile investigating the statistical properties of the ORS.  I’ve attached the report here so you can read for yourself.  That said, let me present the highlights:

  • The spanish version of the ORS is reliable (alpha coefficients .90-.95).
  • The spanish version of the ORS shows good construct and convergent validity (correlations with the OQ45 .5, .58).
  • The spanish version of the ORS is sensitive to change in a treated population.

The authors of the report that was presented at the Society for Psychotherapy Research meeting conclude, “The ORS is a valid instrument to be used with the Chilean population.”

As asked in my blogpost last week, “how much more evidence is needed?”  Now, more than ever, clinicians needs simple, valid, reliable, and feasible tools for evaluating the process and outcome of behavioral healthcare.  The ORS and SRS FITS the bill!

Filed Under: FIT, PCOMS, Practice Based Evidence Tagged With: behavioral health, cdoi, Chile, evidence based practice, mental health, ors, outcome rating scale, session rating scale, srs

How Much More Evidence Is Needed? A New Meta-Analysis on Feedback-Informed Treatment

June 9, 2011 By scottdm 1 Comment

Received an email from friend and colleague John Norcross, Ph.D.  Attached were the results of a meta-analysis completed by Michael Lambert and Kenichi Shimokawa on Feedback-Informed Treatment (FIT) which will appear in the second edition of his book, Psychotherapy Relationships that Work (Oxford University Press).  For those who cannot wait, you can access the same results in the lastest issue of the APA journal Psychotherapy (Volume 48, Number 1, March 2011, pages 72-79).

Briefly, the chapter begins with a review of the literature on feedback–a body of evidence that, by the way, dates back to 1930’s and has always shown small to moderate effects on the outcome of treatment.  In reviewing studies specific to the ORS and SRS, the authors conclude, “”>the results indicated that those in the feedback group ha[ve] 3.5 times higher odds of experiencing reliable change while having less than half the odds of experiencing deterioration.”  Additionally, Lambert and Shimokawa report few if any meaningful differences between therapies informed by the ORS and SRS and those using the well-established and widely used Outcome Questionnaire (OQ).   Finally, and importantly, the authors note that in “busy practices…the brevity of the [ORS and SRS]…expedite and ease practical difficulties” thereby decreasing barriers to implementation.

How much more evidence will it take before feedback informed treatment becomes standard practice?  All of the available data is summarized in the materials below.

Measures and Feedback January 2011

View more documents from Scott Miller

Be sure and join other clinicians and researchers who are discussing FIT at the International Center for Clinical Excellence–the largest, free, web-based community dedicated to improving the quality and outcome of behavioral health.

Finally, if you are in thinking about or in the process of becoming FIT in your agency or practice, please join us at the upcoming “Training of Trainers” workshop held the first week of August.  Registration is limited to 35 participants and we have only a few spots left!  Here’s what attendees from last year had to say about the event…

Filed Under: Behavioral Health, Feedback Informed Treatment - FIT Tagged With: cdoi, evidence based practice, icce, ors, outcome rating scale, session rating scale, srs

The Mystery of Mastery: Excellence Takes Center Stage in the Psychotherapy Networker

May 16, 2011 By scottdm Leave a Comment

The Psychotherapy Networker has long been the most popular periodical among practicing clinicians.  Rumor has it that the magazine has 80,000+ subscribers and sells over 120,000 copies of each issue.  If you want to know what therapists are thinking and talking about, the Networker magazine is the place to look.  And in the May/June issue, the topic of excellence is front and center.

The reason is obvious: the field of psychotherapy is in trouble.  Think about it for a moment.  What real accomplishments can psychotherapy boast of in recent years? What was the last truly revolutionary discovery in the field of psychotherapy? What “treatment” (analogous to penicillin in medicine) has ever successfully eradicated a mental or emotional disorder? In fact, while we’ve been at our posts, provisioning and parading an army of techniques and methods, rates of depression and anxiety have soared.  Even if one disagrees with this grim assessment of the field’s contributions and influence, it’s hard to be sanguine about our status. Over the last decade, median incomes for psychologists, both applied and academic, have dropped by thousands of dollars. In the same period, workloads have increased, professional autonomy has been subverted, and funding for public behavioral healthcare has all but disappeared.  Meanwhile, the very relevance of psychotherapy is an open question in the minds of many current and prospective consumers. Despite overwhelming evidence that therapy works, and that more than 90 percent of people say they’d prefer to talk about their problems than take psychopharmacological drugs, most people doubt the efficacy of treatment. Perhaps this accounts for the fact that the use of medications has steadily increased, while visits to a psychotherapist have been decreasing.

What can be done?

In 2007, we wrote an article that appeared in the pages of the Networker on the subject of “top performing” clinicians–those that consistently achieve superior results with their clients.  Over the last four years, we’ve continued to research and write on the subject and in the latest issue of the Networker we review the latest findings.  ICCE Associate, Dr. Bob Bertolino, also has an article in the issue detailed the steps required to reac excellence in agencies and healthcare systems.

Scott Miller         Mark Hubble          Bob Bertolino

Never has a moment in the history of the field existed when the need for a “culture of excellence” has been more pressing or when the qualities of that culture are more unambiguous.  Seeing as we spend so much of our lives at work anyway—often more in total than with our families, friends, and in leisure—the question is, “why not?”   If not for ourselves, then for our clients, the very people the research shows benefit the most from top performance and on whom our livelihoods depend.  Don’t wait.  Click on the links above to read both articles.

Filed Under: Behavioral Health, Conferences and Training, excellence Tagged With: cdoi, evidence based practice

The Cryptonite of Behavioral Health: Making Mistakes

May 7, 2011 By scottdm 1 Comment

Most people readily agree that its important to “learn from mistakes.”  In truth, however, few actually believe it.  Mistakes are like cryptonite, making us feel and, more importantly, look stupid and weak.  As a result, despite what we might advise others, we do our best to avoid making and admitting them.  Such avoidance comes with a big cost: personal and professional growth stalls and even atrophies.  We take on less challenging tasks, avoid taking risks, and give up more easily when confronted with situations that might expose our weaknesses.  Far all that, falling a bit on “error-phobic” side of life is hardly an instance of  irrationality.  As Alina Tugend, author of Better by Mistake points out, “As much as people hate to make mistakes, they love pointing out the ones others have made.”  Indeed, for most of us, the glee others take in pointing out our shortcomings only serves to compound our avoidance and deepen our public denial.  And that’s what makes Tony Rousmaniere’s recent blogpost so unusual.

Briefly, Tony is a psychologist in private practice in San Francisco and Palo Alto.  As he tells the story, he was riding in his car, listening to a recording of my presentation at the 2009 Evolution of Psychotherapy conference.  The subject was “Achieving Clinical Excellence.”  The message: routinely seeking feedback from clients about our mistakes decreases dropout rates and improves outcomes in psychotherapy.  Tony took the message to heart.  Unlike many of our peers who say they routinely ask clients for feedback, Tony actually downloaded the outcome and session rating scales and began formally asking his clients for feedback.

The story he relates makes for compelling reading, most of all because the feedback he received was not always easy to hear.  And yet, he persisted, not only asking clients, but recording his work and then seeking input from colleagues.  In the article, he gives step-by-step instructions for making use of the painful and sometimes confusing and contradictory feedback one receives.

Tony’s willingness to share his experience makes it tempting to say he is one brave soul.  In actuality, he’s pragmatic.  He placed outcomes over image.  As he reports in the article, his dropout rate has plummeted and his outcomes improved.  I say, “Bravo!”
________________________

Addendum

If you are thinking of writing to tell me that I misspelled the word, “cyptonite” (the accepted spelling is kryptonite), don’t bother.  I know.  I did it on purpose.  See what I mean?!

Filed Under: deliberate practice, evidence-based practice, Feedback Informed Treatment - FIT Tagged With: evidence based practice, holland, randomized clinical trial

  • 1
  • 2
  • 3
  • Next Page »

SEARCH

Subscribe for updates from my blog.

loader

Email Address*

Name

Upcoming Training

Jun
03

Feedback Informed Treatment (FIT) Intensive ONLINE


Oct
01

Training of Trainers 2025


Nov
20

FIT Implementation Intensive 2025

FIT Software tools

FIT Software tools

LinkedIn

Topics of Interest:

  • Behavioral Health (112)
  • behavioral health (5)
  • Brain-based Research (2)
  • CDOI (14)
  • Conferences and Training (67)
  • deliberate practice (31)
  • Dodo Verdict (9)
  • Drug and Alcohol (3)
  • evidence-based practice (67)
  • excellence (63)
  • Feedback (40)
  • Feedback Informed Treatment – FIT (246)
  • FIT (29)
  • FIT Software Tools (12)
  • ICCE (26)
  • Implementation (7)
  • medication adherence (3)
  • obesity (1)
  • PCOMS (11)
  • Practice Based Evidence (39)
  • PTSD (4)
  • Suicide (1)
  • supervision (1)
  • Termination (1)
  • Therapeutic Relationship (9)
  • Top Performance (40)

Recent Posts

  • Agape
  • Snippets
  • Results from the first bona fide study of deliberate practice
  • Fasten your seatbelt
  • A not so helpful, helping hand

Recent Comments

  • Bea Lopez on The Cryptonite of Behavioral Health: Making Mistakes
  • Anshuman Rawat on Integrity versus Despair
  • Transparency In Therapy and In Life - Mindfully Alive on How Does Feedback Informed Treatment Work? I’m Not Surprised
  • scottdm on Simple, not Easy: Using the ORS and SRS Effectively
  • arthur goulooze on Simple, not Easy: Using the ORS and SRS Effectively

Tags

addiction Alliance behavioral health brief therapy Carl Rogers CBT cdoi common factors conferences continuing education denmark evidence based medicine evidence based practice Evolution of Psychotherapy excellence feedback feedback informed treatment healthcare holland icce international center for cliniclal excellence medicine mental health meta-analysis Norway NREPP ors outcome measurement outcome rating scale post traumatic stress practice-based evidence psychology psychometrics psychotherapy psychotherapy networker public behavioral health randomized clinical trial SAMHSA session rating scale srs supershrinks sweden Therapist Effects therapy Training