SCOTT D Miller - For the latest and greatest information on Feedback Informed Treatment

  • About
    • About Scott
    • Publications
  • Training and Consultation
  • Workshop Calendar
  • FIT Measures Licensing
  • FIT Software Tools
  • Online Store
  • Top Performance Blog
  • Contact Scott
scottdmiller@ talkingcure.com +1.773.454.8511

Is Documentation Helping or Hindering Mental Health Care? Please Let me know.

November 23, 2014 By scottdm 44 Comments

Drowning in paperwork

So, how much time do you spend doing paperwork?  Assessments, progress notes, treatment plans, billing, updates, etc.–the lot?

When I asked the director of the agency I was working at last week, it took him no time to respond. “Fifty percent,” he said, then added without the slightest bit of irony, “It’s a clinic-wide goal, keeping it to 50% of work time.”

Truth is, it’s not the first time I’ve heard this figure.  Wherever I travel–whether in the U.S. or abroad–practitioners are spending more and more time “feeding the bureaucratic beast.”  Each state or federal agency, regulatory body, and payer wants a form of some kind.  Unchecked, regulation has lost touch with reality.

Just a few short years ago, the figure commonly cited was 30%.  In the last edition of The Heart and Soul of Change, published in 2009, we pointed out that in one state, “The forms needed to obtain a marriage certificate, buy a new home, lease an automobile, apply for a passport, open a bank account, and die of natural causes were assembled … altogether weighed 1.4 ounces.  By contrast, the paperwork required for enrolling a single mother in counseling to talk about difficulties her child was experiencing at school came in at 1.25 pounds” (p. 300).

Research shows that a high documentation to clinical service ratio leads to higher rates of:

  • Burnout and job dissatisfaction among clinical staff;
  • Fewer scheduled treatment appointments;
  • No shows, cancellations, and disengagement among consumers.

Some potential solutions have emerged.  “Concurrent ,” a.k.a., “collaborative documentation.”  It’s a great idea: completing assessments, treatment plans, and progress notes together with clients during rather than after the session.  We started doing this to improve transparency and engagement at the Brief Family Therapy Center in Milwaukee, Wisconsin back in the late 1980’s.  At the same time, it’s chief benefit to date seems to be that it saves time on documentation–as though filling out paperwork is an end in and of itself!

Ostensibly, the goal of paperwork and oversight procedures is to improve accountability.  In these evidence-based times, that leads me to say, “show me the data.”  Consider the wide-spread practice–mandate, in most instances–of treatment planning. Simply put, it is less science than science fiction.  Perhaps this practice improves outcomes in a galaxy far, far away but on planet Earth, supporting evidence is spare to non-existent.  Where is the evidence that any of the other documentation improves accountability, benefits consumers, or results in better outcomes?

Put bluntly, the field needs an alternative.  What practice not only insures accountability but simultaneously improves the quality and outcome of behavioral health services?  Routinely and formally seeking feedback from consumers about how they are treated and their progress.

Soliciting feedback need not be time consuming nor difficult.  Last year, two brief, easy-to-use scales were deemed “evidence-based” by  the Substance Abuse and Mental Health Services Administration (SAMHSA).  The International Center for Clinical Excellence received perfect scores for the materials, training, and quality assurance procedures it makes available for implementing the measures into routine clinical practice:

SAMHSA 1

SAMHSA 2

Then again, these two forms add to the paperwork already burdening clinicians.  The main difference?  Unlike everything else, numerous RCT’s document that using these forms increases effectiveness and efficiency while decreasing both cost and risk of deterioration.

Learn more at the official website: www.whatispcoms.com.  Better yet, join us in Chicago for our upcoming intensives in Feedback Informed Treatment and Supervision:

Advanced FIT Training (2015)FIT Supervision Training (2015)

In the meantime, would you please let me know your thoughts?  To paraphrase Goldilocks, is the amount of documentation you are required to complete, “Too much,” Too little,” or “Just about Right!”  Type in your reply below!

Filed Under: Behavioral Health, Conferences and Training, evidence-based practice, Feedback, Feedback Informed Treatment - FIT, Practice Based Evidence

What articles have 140,000 of your colleagues read to improve their practice?

November 21, 2014 By scottdm 1 Comment

Reading

Each week, I upload articles to the web about how to improve effectiveness. There are a lot to choose from, but here are the top ones read by behavioral health professionals around the world:

  • Measures and Feedback 2014

This is the latest version of the most widely-read upload on the site. It summarizes all of the available research about using feedback to improve retention in and outcome of care, including studies using the ORS and SRS.

  • How to Improve your Effectiveness

A short, fun article that highlights the evidence-based steps for improving one’s effectiveness as a behavioral health provider. Feedback, it turns out, is not enough. This article reviews the crucial step that makes all the difference.

Finally, here’s a link to a simple-to-use tool for interpreting scores on the ORS:

  • ORS Reliable Change Chart

That’s it for now. Best wishes in your work. Stay in touch.

Scott Miller (Evolution 2014)
Scott D. Miller, Ph.D.
Director, International Center for Clinical Excellence
info@scottdmiller.com

Advanced FIT Training (2015)
Registration is open for the Advanced Training in Feedback-Informed Treatment (FIT). Learn how to integrate this SAMHSA certified evidence-based practice into your work or agency. We promise you three comprehensive, yet fun-filled days of learning together with colleagues from around the world.

 

Filed Under: Behavioral Health, Conferences and Training, evidence-based practice, Feedback, Feedback Informed Treatment - FIT, FIT, Top Performance

Something New

October 8, 2014 By scottdm 1 Comment

something new ICCE

Actually, it’s more accurate to say, “Everything is new!”  The International Center for Clinical Excellence is coming up on its fifth birthday!   Since its launch in 2010, the ICCE has become the largest, online community of behavioral health practitioners and researchers in the world.  To celebrate, we are launching an entirely new web platform.   All the features you’ve come to expect remain—the discussions with colleagues, the document library, the commercial free atmosphere.   At the same time, everything has been streamlined, made faster, easier, and more intuitive.  Log in today!   Join a forum.  Start a conversation.  Share a presentation or paper with others. As you can see my own website has been completely redone.  The “Top Performance” blog is now front and center.  Plug in your email address and you’ll get regular updates regarding how to improve your effectiveness.   As always, my articles, books, video and audio materials are available with the click of a button.  You can also find an up-to-date schedule of workshops and intensive trainings in feedback informed treatment (FIT).

PCOMS - Partners for change outcome management system Scott D Miller - SAMHSA - NREPP Speaking of FIT, have you visited the www.whatispcoms.com website?  It’s the official website for ICCE’s Partners for Change Outcome Management System.  Here you can learn everything you need to know to get started using the feedback process documented to improve effectiveness and approved by SAMHSA as an evidence-based practice.  What’s new?  Thanks to ICCE members around the world, the site is available in five different languages, including: English, Dutch, Swedish, Norwegian, and Danish.   Until next time!

Filed Under: CDOI, Feedback Informed Treatment - FIT, FIT, ICCE Tagged With: icce, top performance

Using Feedback Informed Treatment to Improve Medication Adherence and Reduce Healthcare Costs

September 10, 2014 By scottdm Leave a Comment

persontakingpill

Medication adherence is a BIG problem.  According to recent research, nearly one-third of the prescriptions written are never filled.  Other data document that more than 60% of people who actually go the pharmacy and get the drug, do not take it as prescribed.

What’s the problem, you may ask?  Inefficiency aside, the health risks are staggering.  Consider, for example, that the prescriptions least likely to be filled are those aimed at treating headache (51 percent), heart disease (51.3 percent), and depression (36.8)percent).

medication adherence

When cost is factored into the equation, the impact of the problem on an already overburdened healthcare system becomes even more obvious.  Research indicates that not taking the medicines costs an estimated $290 billion dollars per year–or nearly $1000 for every man, woman, and child living in the United States.  It’s not hard to imagine more useful ways such money could be spent.

What can be done?

Pringle_Photo 2013

Enter Dr. Jan Pringle, director of the Program Evaluation Research Unit, and Professor of Pharmacy and Therapeutics at the University of Pittsburgh. As I blogged about back in 2009, Jan and I met at a workshop I did on feedback-informed treatment (FIT) in Pittsburgh.  Shortly thereafter, she went to work training pharmacists working in a community pharmacy to use the Session Rating Scale ([SRS] a four-item measure of the therapeutic alliance) in their encounters with customers.

It wasn’t long before Jan had results.  Her first study found that administering and discussing the SRS at the time medications were dispensed resulted in significantly improved adherence (you can read the complete study below).

She didn’t stop there, however.

reading

Just a few weeks ago, Jan forwarded the results from a much larger study, one involving 600 pharmacists and nearly 60,000 patients (via a special arrangement with the publisher, the entire study is available by clicking the link on her publications page of the University website).

Suffice it to say that using the measures, in combination with a brief interview between pharmacist and patient, significantly improved adherence across five medication classes aimed at treating chronic health conditions (e.g., calcium channel blockers, oral diabetes medications, beta-blockers, statins, and renin angiotemsin system antagonists).  In addition to the obvious health benefits, the study also documented significant cost reductions.  She estimates that using the brief, easy-to-use tools would result in an annual savings of $1.4 million for any insurer/payer covering at least 10,000 lives!

Prior to Jan’s research, the evidence-base for the ORS and SRS was focused exclusively on behavioral health services.  These two studies point to exciting possibilities for using feedback to improve the effectiveness and efficiency of healthcare in general.

The tools used in the pharmacy research have been reviewed and deemed evidence-based by the Substance Abuse and Mental Health Services Administration.

PCOMSLogoKnown as PCOMS, detailed information about the measures and feedback process can be found at www.whatispcoms.com.  It’s easy to get started and the measures are free for individual healthcare practitioners!

Filed Under: Feedback Informed Treatment - FIT, medication adherence Tagged With: depression, healthcare, heart disease, medication adherence, medicine, mental health, ors, outcome rating scale, pharmacy, prescriptions, SAMHSA, sesison rating scale, srs

Applying Feedback-Informed Treatment in Diverse Settings around the World

August 14, 2014 By scottdm Leave a Comment

FIT TOT 2014 Liz and SusanneIMG-20110801-00045Norwegian friends at AI 2014

Honestly, I don’t know why I hadn’t noticed it before.  It’s not the first time it happened.  Last week, the ICCE held the “Training of Trainers” and “FIT Implementation” intensive trainings in Chicago, Illinois (USA).  Participants came from all around the world–from the northern-most parts of Alaska to the southern tip of New Zealand.  Geographic diversity aside, what really struck me was the many different clinical settings and populations where feedback-informed treatment (FIT) was being used to improve the quality and outcome of behavioral health services.

Practitioners are applying FIT with adults, adolescents, children, and families being treated in inpatient, outpatient, residential, in-home, and outreach settings for problems ranging from anxiety to early psychosis intervention.  Together with my co-teachers, Danish psychologist Susanne Bargmann, Dutch psychologist Liz Pluut, and ICCE Community Manager Cynthia Maeschalck, we worked, played hard, and learned a great deal.  I’ve pulled together a brief video to give you a sense of the energy and excitement.  I think you’ll be surprised…

Need more information about FIT?  Visit the official website: www.whatispcoms.com.  There you’ll find everything you need: brief video introduction, the empirical support, and a download link for the measures and additional resources.

By the way, registration is now open for the March 2015 “Advanced FIT” and “FIT Supervision” Intensives.  Feel free to e-mail me at info@scottdmiller.com with any questions.  As indicated in the video, the trainings fill up about 3 months in advance so register as soon as possible.

See you in March.

Scott Miller Headshot

Scott

P.S.:  Want to watch something fun?  Take a look at this video about improving one’s skills in listening, influence, and suggestion.  Be sure and leave a comment!

Filed Under: Feedback Informed Treatment - FIT

Want to be more effective? Point North!

July 24, 2014 By scottdm Leave a Comment

2014-06-25 14.22.57

In June, I spent several days in the air traveling to and from Perth, Australia for a conference.  Too tired to read anymore, I turned on the video system and began watching a program from the Discovery Channel about the North American red fox. 

red fox

The furry little creatures were shown hunting rodents hidden under three feet of snow.  Three feet!  Up in the air the foxes would hop, thrusting their noses deep into the drifts.  Most of the time, they came up with nothing.  That is, unless they were facing north.  Then the odds changed considerably.  Seventy-five percent of the time, the fox was guaranteed a meal.  Scientists believe the animal uses the planet’s magnetic field to more accurately calculate and plot it’s trajectory–the same principle as the GPS in your car.  Watch the video.  It’s incredible.

In a similar way, the odds of successful treatment increase considerably when clinicians incorporate feedback into their work.  Asking consumers to assess their progress and the quality of the therapeutic relationship is the “North Pole” of behavioral health services.  Available evidence documents that when providers ask for and accommodate such feedback, dropout and deterioration rates plummet, and effectiveness doubles.  Without it, the same body of evidence shows that likelihood of recovery for consumers is about 15-20%, roughly equivalent to foxes who hunt pointing in the wrong direction.

The process, known as Feedback-Informed Treatment (FIT), is being used around the globe to improve the quality and outcome of therapy.  It’s also listed on SAMHSA’s National Registry of Evidence-Based Programs and Practices.

I have a brand new DVD demonstrating how to introduce, administer, and deal effectively with the feedback consumers provide.  It was filmed live at the most recent Evolution of Psychotherapy Conference.  Thanks to the Erickson Foundation, for a limited time, you can get it here for 29.95 (that’s 50% off the regular price).

2014-07-24 11.01.58

More information about FIT is available at: www.whatispcoms.com.  You can also access the free outcome and alliance tools there.  Gotta go.  I’m re-arranging my office furniture…

Filed Under: Feedback Informed Treatment - FIT Tagged With: evidence based practice, feedback informed treatment

Is Supervision Important to you?

June 20, 2014 By scottdm 1 Comment

How valuable is clinical supervision to you?  In their massive, long-term international study of therapist development, researchers Orlinsky and Rønnestad (2005) found that “practitioners at all experience levels, theoretical orientations, professions, and nationalities report that supervised client experience is highly important for their current and career development” (p. 188).

Despite the value most of us place on the process, the latest review of the literature found no empirical evidence, “that psychotherapy supervision contributes to patient outcome” (Watkins, 2011).  Said another way, supervision does not produce more effective clinicians.  The result?  In the US, at least, opportunities for clinical supervision are in the decline, replaced by growing documentation requirements and administrative oversight–a trend destined to continue if the dearth of evidence persists.

What can be done?  Simply put, solicit formal feedback from clients regarding their experience of progress and the therapeutic relationship.  Such information, in turn, can be used to guide supervision, providing both a focus for the consultation and data supporting its effectiveness.  After all, multiple studies already document that the process improves outcomes while simultaneously decreasing drop out and deterioration rates (Miller, 2013 ).

Getting started is not difficult.  First, access two, free, easy-to-use scales for monitoring client progress and the relationship.   Second, join colleagues in the largest, online community of behavioral health professionals in the world.  It’s free–no hidden costs or secret levels of premium content.  On the ICCE, you can connect and consult with practitioners who are using feedback to improve the quality and outcome of treatment and supervision.  If you are new to feedback-informed work (FIT)–a SAMHSA certified evidence-based practice–you can get a thorough introduction at: www.whatispcoms.com .

Finally, get the  Feedback-Informed supervision manual and newly released, two-hour DVD.  Both provide step-by step instructions and examples of integrating feedback into supervision.  While you are at it, join us for our Feedback-Informed Supervision Intensive.  Last time around, it sold out months advance.  Registration is now open for our next training in March 2015.

Filed Under: Feedback Informed Treatment - FIT Tagged With: clinical supervision, feedback informed treatment, icce, international center for cliniclal excellence, Orlinsky, ors, outcome rating scale, PCOMS, psychotherapy supervision, Rønnestad, SAMHSA, session rating scale, srs

Is your therapy making your clients worse? The Guardian Strikes Again

June 12, 2014 By scottdm 1 Comment

demand-evidence-and-think

Last week, an article appeared in The Guardian, one of the U.K.’s largest daily newspapers.  “Counselling and Therapy can be Harmful,” the headline boldly asserted, citing results of a study yet to be published.  It certainly got my attention.

Do some people in therapy get worse?  The answer is, most assuredly, “Yes.”  Research dating back several decades puts the figure at about 10% (Lambert, 2010).  Said another way, at termination, roughly one out of ten people are functioning more poorly than they were at the beginning of treatment.

The cause?  Here’s what we know.  Despite claims to the contrary (e.g., Lilenfeld, 2007), no psychotherapy approach tested in a clinical trial has ever been shown to reliably lead to or increase the chances of deterioration.  NONE.  Scary stories about dangerous psychological treatments are limited to a handful of fringe therapies–approaches that have been never vetted scientifically and which all practitioners, but a few, avoid.

So, if it’s not about the method, then how to account for deterioration?  As the article points out, “some therapists had a lot more clients [who] deteriorated than others.”  And yet, while that statement is true–lots of prior research shows that some do more harm than others–there are too few such clinicians to account for the total number of clients who worsen.  Moreover, beyond that 10%, between 30 and 50% of people in treatment experience no benefit whatsoever!

Here is where the old adage, “an ounce of prevention is worth a pound of cure,” applies.  Whatever the cause, lack of progress and risk of deterioration are issues for all clinicians.  A growing body of research makes clear, the key to addressing the problem is tracking the progress of clients from visit to visit so that those not improving, or getting worse, can be identified and offered alternatives.

It’s not hard to get started.  You can learn a simple, evidence-based method for tracking progress and the quality of the relationship at: www.whatispcoms.com.  Best of all, practitioners can access the tools for free!

After that, join fellow practitioners from the US, Canada, Europe, and Australia  for one of our intensive trainings  coming up this August in Chicago.  I promise you’ll leave prepared to address the issue of deterioration directly and successfully.

Filed Under: Feedback Informed Treatment - FIT Tagged With: clinical trial, counselling, lilenfeld, michael lambery, psychotherapy, the guardian, therapy, Training, whatispcoms

What’s in an Acronym? CDOI, FIT, PCOMS, ORS, SRS … all BS?

June 7, 2014 By scottdm Leave a Comment

“What’s in a name?”

–William Shakespeare

A little over a week ago, I received an email from Anna Graham Anderson, a graduate student in psychology at Aarhus University in Denmark.  “I’m writing,” she said, “in hopes of receiving some clarifications.”

Anna Graham Anderson
Anna Graham Anderson

Without reading any further, I knew exactly where Anna was going.  I’d fielded the same question before.  As interest in measurement and feedback has expanded, it comes up more and more frequently.

Anna continued,  “I cannot find any literature on the difference between CDOI, FIT, PCOMS, ORS, and SRS.  No matter where I search, I cannot find any satisfying clues.  Is it safe to say they are the same?”  Or, as another asked more pointedly, “Are all these acronyms just a bunch of branding B.S.?”

I answered, “B.S.?  No.  Confusing?  Absolutely.  So, what is the difference?”

As spelled out in each of the six treatment and training manuals, FIT, or feedback-informed treatment, is, “a panetheoretical approach for evaluating and improving the quality and effectiveness of behavioral health services.  It involves routinely and formally soliciting feedback from consumers regarding the therapeutic relationship and outcome of care and using the resulting information to inform and tailor service deliver.”

Importantly, FIT is agnostic regarding both the method of treatment and the particular measures a practitioner may employ.  Some practitioners use the ORS and SRS, two brief, simple-to-use, and free measures of progress and the therapeutic relationship–but any other valid and reliable scales could be used.

Of all the acronyms associated with my work, CDOI is the one I no longer use.  For me, it had always problematic as it came precariously close to being a treatment model, a way of doing therapy.  I wasn’t  interested in creating a new therapeutic approach.  My work and writing on the common factors had long ago convinced me the field needed no more therapeutic schools.  The phrase, “client-directed, outcome-informed”  described the team’s position at the time, with one foot in the past (how to do therapy), the other in the future (feedback).

And PCOMS?  A long time ago, my colleagues and I had a dream of launching a web-based “system for both monitoring and improving the effectiveness of treatment” (Miller et. al, 2005).  We did some testing at an employee assistance program in located in Texas, formed a corporation called PCOMS (Partners for Change Outcome Management System), and even hired a developer to build the site.  In the end, nothing happened.  Overtime, the acronym, PCOMS, began to be used as an overall term referring to the ORS, SRS, and norms for interpreting the scores.  In February 2013, the Substance Abuse and Mental Health Service Adminstration (SAMHSA) formally recognized PCOMS as an evidence-based practice.  You can read more about PCOMS at: www.whatispcoms.com.

I expect there will be new names and acronyms as the work evolves.  While some remain, others, like fossils, are left behind; evidence of what has come before, their sum total a record of development over time.

Filed Under: Feedback Informed Treatment - FIT Tagged With: cdoi, evidence based medicine, evidence based practice, feedback informed treatment, FIT, ors, outcome measurement, outcome rating scale, PCOMS, SAMHSA, session rating scale, srs, Substance Abuse and Mental Health Service Adminstration

What can therapists learn from the CIA? Experts versus the "Wisdom of the Crowd"

May 6, 2014 By scottdm Leave a Comment

Central psychotherapy agency

What can we therapists learn from the CIA?  In a phrase, “When it comes to making predictions about important future events, don’t rely on experts!”

After a spate of embarrassing, high-profile intelligence failures, a recent story showed how a relatively small group of average people made better predictions about critical world events than highly-trained analysts with access to classified information.  The four-year study, known as the Good Judgment Project, adds to mounting evidence regarding the power of aggregating independent guesses of regular folks–or what is known as, “the wisdom of the crowd.”

When it comes to therapy, multiple scientific studies show that inviting the “wisdom of the crowd” into treatment as much as doubles effectiveness, while simultaneously cutting drop out and deterioration rates.

Whatever your profession, work setting, or preferred therapeutic approach, the process involves formally soliciting feedback from clients and then comparing the results to empirically established benchmarks.   Getting started is easy:

  • Download and  begin using two free, easy to use tools–one that charts progress, the other the quality of the therapeutic relationship–both of which are listed on SAMHSA’s National Registry of Evidence Based Programs and Practices.
  • Next, access cutting edge technology available on the web, smartphones, and tablets, that makes it easy to anonymously compare the progress of  your clients to effective patterns of practice worldwide.

You can learn more at: www.whatispcoms.com.  Plus, the ICCE–the world’s largest online community of professionals using feedback to enhance clinical judgment–is available at no cost to support you in your efforts.

While you’re at it, be sure and join fellow practitioners from the US, Canada, Europe, and Australia for the “Training of Trainers” or two-day FIT Implementation Intensive coming up this August in Chicago.  You’ll not only learn how to use the measures, but also tap into the collective wisdom of clients and practitioners around the globe.   Space is limited, and we are filling up quickly, so don’t wait to register.

Filed Under: Feedback, Feedback Informed Treatment - FIT Tagged With: feedback, feedback informed treatment, icce, international center for cliniclal excellence, National Registry of Evidence Based Programs and Practices, NREPP, PCOMS, SAMHSA, therapy, Training

Do you know who said, "Sometimes the magic works, sometimes it doesn’t"?

April 30, 2014 By scottdm Leave a Comment

Dan George

Chief Dan George playing the role of Old Lodge Skins in the 1970 movie, “Little Big Man.”  Whether or not you’ve seen or remember the film, if you’re a practicing therapist, you know the wisdom contained in that quote.  No matter how skilled the clinician or devoted the client, “sometimes therapy works, sometimes it doesn’t.”

Evidence from randomized clinical trials indicates that, on average, clinicians achieve a reliable change–that is, a difference not attributable to chance, maturation, or measurement error–with approximately 50% of people treated.  For the most effective therapists, it’s about 70%.  Said another way, all of us fail between 30-50% of the time.

Of greater concern, however, is the finding that we don’t see the failure coming.  Hannan and colleagues (2005) found, for example, that therapists correctly predicted deterioration in only 1 of 550 people treated, despite having been told beforehand the likely percentage of their clients that would worsen and knowing they were participating in a study on the subject!

It’s one thing when “the magic doesn’t work”–nothing is 100%–but it’s an entirely different matter when we go on believing that something is working, when it’s not.  Put bluntly, we are a terminally, and forever hopeful group of professionals!

What to do?  Hannan et al. (2005) found that simple measures of progress in therapy correctly identified 90% of clients “at risk” for a negative outcome or dropout.  Other studies have found that routinely soliciting feedback from people in treatment regarding progress and their experience of the therapeutic relationship as much as doubles effectiveness while simultaneously reducing dropout and deterioration rates.

You can get two, simple, evidence-based measures for free here.   Get started by connecting with and learning from colleagues on the world’s largest, online network of clinicians: The International Center for Clinical Excellence.  It’s free and signing up takes only a minute or two.

Six FIT Manuals-1

Finally, take advantage of a special offer for the 6 Feedback Informed Treatment and Training Manuals, containing step by step instructions for using the scales to guide and improve the services you offer.  These manuals are the reason the ICCE received the perfect scores when SAMHSA reviewed and approved our application for evidence-based status.

Here’s to knowing when our “magic” is working, and when it’s not!

Filed Under: Feedback Informed Treatment - FIT Tagged With: icce, international center for cliniclal excellence, magic, outcome measurement, randomized clinical trial, therapy

Did you know your clients can tell if you are happy?

January 19, 2014 By scottdm 3 Comments

Are_You_Happy

It’s true.  Adding to a growing literature showing that the person of the therapist is more important than theoretical orientation, years of experience, or discipline, a new study documents that clients are sensitive to the quality of their therapist’s life outside of treament.  In short, they can tell when you are happy or not.  Despite our best efforts to conceal it, they see it in how we interact with them in therapy.  By contrast, therapists’ judgements regarding the quality of the therapy are biased by their own sense of personal well-being. The solution?  Short of being happy, it means we need to check in with our clients on a regular basis regarding the quality of the therapeutic relationship.  Multiple randomized clinical trials show that formally soliciting feedback regarding progress and the alliance improves outcome and continued engagement in treatment.  One approach, “Feedback-Informed Treatment” is now listed on SAMHSA’s National Registry of Evidence-Based Programs and Practices.  Step-by-step instructions and videos for getting started are available on a new website: www.pcomsinternational.com. Seeking feedback from clients not only helps to identify and correct potential problems in therapy, but is also the first step in pushing one’s effectiveness to the next level.  In case you didn’t see it, I review the research and steps for improving performance as a therapist in an article/interview on the Psychotherapy.net website.  It’s sure to make you happy!

Filed Under: CDOI, Feedback, Feedback Informed Treatment - FIT, PCOMS Tagged With: behavioral health, common factors, evidence based practice, excellence, healthcare, productivity, Therapist Effects

Do you do psychotherapy?

September 26, 2013 By scottdm 1 Comment

You know psychotherapy works. Forty years of research evidence backs up your faith in the process. And yet, fewer and fewer people are seeking out the services of professionals. Between 1998 and 2007, psychotherapy use decreased by 35%. People still sought help, they just went elsewhere to get it. For instance, use of psychotropic drugs is up 40% over the last decade.

A recent article in Popular Science traced the decline and outlined 3 provocative steps for saving the field. If you provide psychotherapy, it’s worth a read. The article is dead serious when recommending:

1. It’s time to GO BIG;

2. Getting a cute commercial; and

3. Dropping the biology jargon.

You’ve got to admit that the field’s fascination with biology is curious. A mountain of evidence points instead to the relationship between the provider and recipient of care. Other research shows that psychotherapy promotes more lasting change, at less cost and with fewer side effects than medication.

How to get the message out?

Many people and organizations are making a valiant effort. Ryan Howe almost single-handedly established today, September 25, as National Psychotherapy Day.  The American Psychological Association published a rare, formal resolution on the efficacy of psychotherapy.

Frankly though, the best commercial for psychotherapy is our results. Consider the approach taken by the Colorado Center for Clinical Excellence. They don’t merely cite studies supporting psychotherapy in general, they report their actual results!

You can begin doing the same by downloading two free, simple to use measures here.

Then, learn how to use the scales to determine your effectiveness at an upcoming Feedback Informed Treatment Intensive (FIT) training.

There, you’ll also learn how to use the data to improve both the quality and outcome of your services. That’s why the Substance Abuse and Mental Health Services Administration (SAMHSA) recently listed FIT on the National Registry of Evidence Based Programs and Practices!

So, now is the time GO BIG by joining us. The next training is coming up in March! Register now at: http://ai2014.eventbrite.ie/.

AIMarch2014 FITSupervisionMar2014

 

 

Filed Under: behavioral health, Conferences and Training, Feedback Informed Treatment - FIT Tagged With: American Psychological Association, NREPP, Popular Science, psychotherapy, SAMHSA

What does Golf have to do with Feedback-Informed Treatment? Watch the video!

July 11, 2013 By scottdm 1 Comment

Summer is finally here.  The snow and rain has been replaced by warm, humid days here in Chicago.  The team at ICCE is awaiting the arrival of practitioners from all around the world to participate in the FIT Supervision Intensive training scheduled for August 6-9th.  We have a full house, the event selling out ages ago.  No reason to fret though as a second course has been scheduled for March 2014.  Register now by clicking here.

Soon, more videos of presentations from the 2013 Achieving Clinical Excellence conference will be posted here.  In the meantime, you can find handouts from all the plenary and break out sessions on the official conference website: www.ace2013amsterdam.com.  Once again, a BIG thanks to Dr. Liz Pluut, and the members of the organizing committee for pulling together such a fantastic event!

(Susanne Bargmann, Liz Pluut, Scott Miller, Rick Pluut, and Bogdan Ion)

Speaking of summer, have you been golfing yet?  What, you might ask, has golfing to do with “top performance” as a behavioral health practitioner.  Well, that was the subject of a thought-provoking and engaging presentation delivered by ICCE Associate Jim Walt at the CAMFT Annual meeting.  Lucky for us, the entire thing was caught on tape.  I know you’ll enjoy it!

Filed Under: Feedback Informed Treatment - FIT Tagged With: feedback informed treatment

NIMH Dumps the DSM-5: The No News Big News

May 10, 2013 By scottdm 1 Comment

Almost a year ago, I blogged about results from field trials of the soon-to-be-released, fifth edition of the Diagnostic and Statistical Manual of Mental Disorders.  Turns out, many of the diagnoses in the “new and improved” version were simply unreliable.  In fact, the likelihood of two clinicians, applying the same criteria to assess the same person for the two most common mental health conditions—anxiety and depression—and agreeing, was worse than it was with DSM IV, the ICD-10, or the DSM-III!

The question of validity, that is how well the diagnoses relate to real world phenomena, has never been addressed empirically in any edition.  Essentially, DSM is a collection of symptom clusters, not too dissimilar from categorizing people according to the four humours—and, it turns out, about as helpful in determining the appropriate or likely outcome of any treatment provided.

Despite these serious shortcomings, the volume exerted tremendous power and influence over research and practice for the last three decades.  Nearly all graduate programs teach it, research is organized around its content, and insurance companies and payers (including the Federal government) demand it for reimbursement.  In short, everyone acted “as if” it were true—that is, until last week when NIMH Director, Thomas Insel, announced the organization was abandoning the DSM.  As if having woken up from a thirty-year- nap the reason given was the volume’s lack of validity!  Really?

The day the announcement was made, I received a bunch of emails.   Most of the writers were elated.  They knew I’d been critical of the volume for many years.  “Finally,” one said, “a return to sanity.”  My response?  Not so fast.

To begin, DSM is not going away any time soon.  Sorry, but if you want to be paid, keep your trusty copy nearby.

More troubling— if you read the fine print—NIMH is promising a better system, based on “a new idea everyone should welcome.”   Just what is that idea?   Mental health problems are biological in origin.  To achieve better outcomes, NIMH funded researchers need to map the “cognitive, circuit, and genetic aspects of mental disorders” so as to identify “new and better targets for treatment.”  Insel calls it, “precision medicine.”

Now, I don’t know about you, but the new idea sounds a heck of a lot like the old one to me!  Psychiatry’s biological bandwagon blew into town last century and has been playing the same tune ever since.  Remember the “dexamethasone suppression test” for differentiating endogenous from non-endogenous depression?  How about the claims made about Xanax in the treatment of panic or the “new” anti-psychotics?   There’s always prefrontal lobotomy which like the DSM, proponents continued to use and promote long after its lack of efficacy and brain disabling side effects were known.  Heck, the originator won a Nobel Prize!

As far the promise of something better is concerned, history should chasten any hope one might feel.  Honestly, when was the last time the field failed to claim significant progress was being made?  Each new treatment approach is pitched as a vast improvement over “old ideas.”  CBT is better than psychodynamic,   specific is better than eclectic, evidence-based treatments are better than routine clinical practice, and so on—except none of these widely promulgated notions holds empirical water.

If “news” = new + different, then the NIMH announcement, like so much of what you find on TV and other social media, is definitely not news.  It’s more of the same.  Precision medicine in mental health is: 90% promise + 10% hyperbole, or marketing.

Here are a couple of newsworthy facts with immediate implications for mental health policy, practice, and research:

  1. Treatment works.  Evidence gathered over the last four decades documents that people who receive therapy are better off than 80% of those (with the same problem or concern) as those without the benefit of treatment.
  2. A majority of potential consumers (78%) cite “lack of confidence” in the outcome of treatment as a barrier to seeking help from a mental health professional.
  3. Tracking a consumer’s engagement and progress during treatment enables clinicians to tailor services to the individual, resulting in lower costs, fewer drop outs, and as much as three times the effects!

Just a thought—if we really want to step into the future, rather than geneticists, neurologists, and radiologists perhaps the field could start by listening to consumers.  That’s exactly the point Ernesto Sirolli made at a recent TED talk.  If you haven’t seen it, here it is:

Filed Under: Feedback Informed Treatment - FIT Tagged With: CBT, DSM, ICD-10, NIMH, psychiatry

What to Pay Attention to in Therapy?

March 15, 2013 By scottdm Leave a Comment

A week or so ago, I received an email from my friend, colleague, and mentor Joe Yeager.  He runs a small listserve that sends out interesting and often provocative information.  The email contained pictures from a new and, dare I say, ingenious advertising campaign for Colgate brand dental floss.  Before I give you any of further details, however, take a look at the images yourself:

All right.  So what caught your attention?  If you’re like most people–including me–you probably found yourself staring at the food stuck in the teeth of the men in all three images.  If so, the ad achieved its purpose.  Take a look at the pictures one more time.  In the first, the woman has one too many fingers on her left hand.  The second image has a “phamtom arm” around the man’s shoulder.  Can you see the issue in the third?

The anomalies in the photos are far from minor!  And yet, most of us, captured by the what initially catches our eye, miss them.

Looking beyond the obvious is what Feedback Informed Treatment (FIT) is all about.  Truth is, much of the time therapy works.  What we do pay attention to gets results–except when it doesn’t!  At those times, two things must happen: (1) we have to know when what we usually do isn’t working with a given person; and (2) look beyond the obvious and see a bigger picture.  Doing this takes effort and support.    What can you do?

1. Download two free, brief, simple to use tools for tracking outcome and engagement in care (the ORS and SRS) and begin using them in your work;

2. Join the International Center for Clinical Excellence, the world’s largest, free, online, non-denominational organization of behavioral health professionals;

3. Read the six cutting-edge treatment and training manuals on feedback-informed treatment–a series which helped earn FIT the highest ratings from the Substance Abuse and Mental Health Services Administration (SAMHSA);

4. Attend a training in Chicago or abroad.

 

Filed Under: Feedback Informed Treatment - FIT Tagged With: accountability, Alliance, behavioral health, deliberate practice, evidence based practice, feedback, NREPP, SAMHSA

Are Counseling and Psychotherapy a Con? The Gauntlet is Thrown in New Zealand

February 15, 2013 By scottdm 2 Comments

Earlier this summer, I was contacted by Donna Chisholm, editor of and reporter for Metro and North & South Magazines in New Zealand.  She was doing a feature article on the effectiveness of psychological services.  The State spent scads of money on treatment.  Concerns had been raised by some that “people may be wasting their own and the taxpayers money with ineffective services, therapists, and counselling.”

“Could we talk?” she wanted to know.  After sorting the time difference between New Zealand and Chicago and working around my crazy travel schedule, we connected via Skype.  I learned that her interest in the subject of treatment outcome began when she heard fellow kiwi, and counselor, Steve Taylor , being interviewed on radio about the effectiveness of Social Services.

Over the last few years, Steve had given a number of such interviews, pointedly criticizing the system for failing to measure results.  Time and again, he highlighted popular programs for which there was either no empirical support or which the available evidence indicated did not work.

These gibes did not go unnoticed.  Once he was anonymously attacked on air while commenting on Family Court outcomes in New Zealand.  Throughout, Steve stuck to his stance, using research to make his point, arguing that providers and systems of care needed to produce evidence of real outcomes via the use of routine outcome measurement.

The article Donna wrote appeared in print this week, entitled, “Counselling: Cure or Con?”  Provocative and well-written, the piece puts “Feedback-Informed Treatment (FIT) front and center, concluding that “a profession whose practitioners spend their days analysing others, its about time they started examining themselves.”  It also provides practical, research-based advice for anyone thinking about seeing a therapist.  Anyway, read it for yourself:

North & south counselling outcomes article march 2013

 

Filed Under: Feedback Informed Treatment - FIT Tagged With: New Zealand, Paychotherapy, Social Services, Steve Taylor

S.A.M.S.H.A. designates Feedback-Informed Treatment an "Evidence-based Practice"

February 2, 2013 By scottdm Leave a Comment

February 2, 2013
Chicago, Illinois USA

I am honored to announce that Feedback-Informed Treatment (FIT) has been added to SAMSHA’s official database of evidence-based practices (EBP) known as NREPP (the National Registry of Evidence-based Programs and Practices).  Briefly, NREPP is a searchable online registry of behavioral health interventions that have been reviewed and rated by independent reviewers.  The purpose of the registry is to assist the public, payers, and practitioners in identifying approaches that have both empirical support and materials available to facilitate implementation.

The Institute of Medicine and American Psychological Association define EBP as, “the integration of the best available research with clinical expertise in the context of patient characteristics, culture, and preferences (see American Psychologist, May 2006).  The principles and practices of feedback-informed treatment (FIT) are not only consistent with but provide practitioners with a simple and practical method for operationalizing EBP in their daily work.  To wit, routinely and formally soliciting feedback from consumers regarding the therapeutic alliance and outcome of care and using the resulting information to inform and tailor service delivery.  As reviewed many times on this blog, multiple, carefully-controlled, randomized clinical trials document that FIT improves outcomes while simultaneously decreasing the risk of drop out and deterioration in care.

Scientific evidence is one matter; being able to support practitioners, agencies, and systems of care in implementing an EBP is another.  On this subject, I am proud to say that FIT received perfect ratings (see, “Readiness for Dissemination” tab).  Unlike other similar approaches, “no weaknesses” were identified by reviewers.  Instead, the summary noted, “ICCE…has an array of comprehensive, well-organized, and high-quality materials to support…implementation…The steps for successful implementation are clear and accompanied by tools and guidance to support the entire process, from the determination of organizations readiness through evaluation.”

Such high marks would not been possible without the contribution of ICCE Senior Associates who worked tirelessly to create the materials and complete the application.   A big thanks to Jason Seidel, Psy.D., Bob Bertolino, Ph.D., Susanne Bargmann, Cynthia Maeschalck, Rox Axsen, Bill Robinson, Robbie Babbins-Wagner, Ph.D., and Julie Tilsen, Ph.D..

The formal recognition of FIT as an EBP is a watershed moment in the history of the International Center for Clinical Excellence, further enabling the organization to achieve it’s mission of improving the quality and outcome of behavioral health services.

Filed Under: Feedback Informed Treatment - FIT Tagged With: NREPP, SAMHSA

Curing Clinician Overconfidence: Try Darting and Frowning

January 10, 2013 By scottdm Leave a Comment

Overconfidence.  It’s a problem that leads to systematic errors in judgement.   Long thought to arise out of hubris or the corrupting effects of the emotion, the evidence actually shows it to be built into humans’ evolved cognitive machinery.  Existimo ergo certus sum (I think, therefore I am…certain).

Behavioral health professionals are not immune.  A recently published study by Walfish, McAlister, O’Donnell, and Lambert (2012) asked clinicians how their effectiveness rates compared to other professionals.  Turns out, clinicians, on average, believed their results were better than 80% of their peers.  Not a single practitioner surveyed viewed themselves as below average and a full quarter (25%) thought they fell at the 90th percentile or higher in skill level and effectiveness!

It’s true that we are not alone in this tendency.  As indicated above, it’s how our brains work.  The typical driver, for example, believes themselves to be better than 80% of others on the road.  University professors, it appears, suffer from the most inflated levels of self-esteem, ranking themselves at the 94th percentile on average.

When it comes to learning, the consequences are significant.  Why change, after all, if you’re already pretty darn good and if the real problem is obvious: other drivers, poor students, etc., difficult life circumstances or the complex nature of some mental disorders?

Researchers have discovered a relatively simple solution to overconfidence: frowning.  That’s right.  Turning that smile upside down short circuits our reptilian wiring, making us more analytical and vigilant in our thinking, in the process enabling us to “question stories that we would otherwise unreflectively accept as true because they are facile and coherent” ( Holt, 2011).

What else can clinicians do?  Do something to gain perspective.  Take on another, divergent point of view, for example.  Practically speaking, scan rather than fix your gaze.  Literally, move your eyes.

Everyone has heard of “tunnel vision.”  Turns out, despite pledges to remain open and flexible, it ain’t so easy.  If you don’t agree, try a little experiment.    Fix your eyes on the flashing red and/or green dot at the center of the graphic and notice what happens to the surrounding yellow ones.  Be patient if the image hasn’t loaded.  It can take a minute or two.

They either blinked on and off or disappeared completely.  Interesting enough but here’s what’s really strange: the yellow dots actually never disappear.  They are always there despite what you see.  And no, the computer did not scan your visual field and cause the yellow dots to blink.  Neither is this an optical illusion.  Once again, it’s the way we are wired.  We think we are seeing everything…but we are not.  The result: overconfidence.  It’s why, following an automobile accident, people will say, “the other driver came out of nowhere.”  It’s why surgeons leave sponges inside their patients or miss seeing bleeds or small nicks of the scalpel.  It’s also why behavioral health practitioners routinely fail to detect deterioration and people at risk for dropping out of services (Hannan, et al. 2005).

Now, look again.  This time, however, shift your eyes about while watching the flashing dot in the center.  In other words, don’t fix your gaze.  If that doesn’t change what you see, then step back from the image and view it from a distance.  There, see!  The yellow dots are present the entire time.

Helping busy practitioners step back, shift their gaze, and otherwise improve their critical faculties and skills is the mission of ICCE.  Members connect, learn from, and share with the largest online community of mental health professionals in the world.  Thousands of members, hundreds of discussion forums, a massive and every growing library of research and other supportive documents, and how-to videos are available for free 24-7-365.

Many of the members and associates will be meeting in Amsterdam, Holland for the Achieving Clinical Excellence conference on May 16-18th.  Conference coordinator, Liz Pluut, has organized an line-up of international speakers, researchers, and practitioners that is guaranteed to push your clinical performance to the next level!  Participants are coming from all over Europe, the US, Canada, Asia, Australia, and more.  Don’t wait to register.  Space is limited and the response has been amazing.

OK, here’s something fun.  Take a look at the video below.  Oh yeah, make sure you smile and keep your eyes fixed on my hands!

Filed Under: Conferences and Training, Feedback Informed Treatment - FIT Tagged With: behavioral health, icce

Believing is Seeing: How Wishing Makes Things So

January 3, 2013 By scottdm Leave a Comment

Yesterday evening, my family and I were watching a bit of T.V.  My son, Michael commented about all the ads for nutrional supplements, juicing machines, weight loss programs and devices.  “Oh yeah,” I thought, then explained to him, “It’s the start of a new year.”  Following “spending more time with family,” available evidence shows exercise and weight loss top the bill of resolutions.  Other research shows that a whopping 80% eventually break these well intentioned commitments.  Fully a third won’t even make it to the end of the month!  Most attribute the failure to being too busy, others to a lack of motivation.  Whatever the cause, it’s clear that, when it comes to change, hope and belief will only take you so far. 

What can help?  More on that in a moment.

In the meantime, consider a recent study on the role of hope and belief in research on psychotherapy.  Beginning in the 1970’s, study after study, and studies of studies, have found a substantial association between the effectiveness of particular treatment models and the beliefs of the researchers who conduct the specific investigations.  In the literature, the findings are referred to under the generic label, “research allegiance” or R.A.  Basically, psychotherapy outcome researchers tend to find in favor of the approach they champion, believe in, and have an affinity towards.  Unlike New Year’s resolutions, it seems, the impact of hope and belief in psychotherapy outcome research is not limited; indeed, it carries investigators all the way to success–albeit a result that is completely “in the eye of the beholder.”  That is, if one believes the research.  Some don’t.

Hang with me now as I review the controversy about this finding.  As robust as the results on researcher allegiance appear, an argument can be made that the phenomenon is a reflection rather than a cause of differences in treatment effectiveness.  The argument goes: researcher allegiance is caused by the same factors that lead to differences in outcome between approaches: real differences in outcome betweepproaches.  In short, researchers’ beliefs do not cause the effects, as much as the superior effects of the methods cause researchers to believe.   Makes sense, right?  And the matter has largely nguished there, unresolved for decades.

That is, until recently.  Turns out, believing is seeing.  Using a sample of studies in which treatments with equivalent efficacy were directly compared within the same study, researchers Munder, Fluckiger, Gerger, Wampold, and Barth (2012) found that a researcher’s allegiance to a particular method systemically biases their results in favor of their chosen approach.  The specific methods included in this study were all treatments designated as “Trauma-focused” and deemed “equally effective” by panels of experts such as the U.K.’S National Institute for Clinical Excellence.  Since the TFT approaches are equivalent in outcome, researcher allegiance should not have been predictive of outcome.  Yet, it was–accounting for an incredible 12% of the variance.  When it comes to psychotherapy outcome research, wishing makes it so.

What’s the “take-away” for practitioners?  Belief is powerful stuff: it can either help you see possibilities or blind you to important realities.  Moreover, you cannot check your beliefs at the door of the consulting room, nor would you want to.  Everyday, therapists encourage people to take the first steps toward a happier, more meaningful life by rekindling hope.  However, if researchers, bound by adherence to protocol and subject to peer review can be fooled, so can therapists.  The potentially significant consequences of unchecked belief become apparent when one considers a recently published study by Walfish et al. (2012) which found that therapists on average overestimate their effectiveness by 65%.

When it comes to keeping New Year’s resolutions, experts recommend avoiding broad promises and grand commitments and instead advise setting small, concrete measureable objectives.  Belief, it seems, is most helpful when its aims are clear and effects routinely verified.  One simple way to implement this sage counsel in psychotherapy is to routinely solicit feedback from consumers about the process and outcome of the services offered.  Doing so, research clearly shows, improves both retention and effectiveness.

You can get two, simple, easy-to use scales for free by registering at: http://scottdmiller.com/srs-ors-license/  A world wide community of behavioral health professionals is available to support your efforts at: www.centerforclinicalexcellence.com.

You can also join us in Chicago for four days of intensive training.  We promise to challenge your both beliefs and provide you with the skills and tools necessary for pushing your clinical performance to the next level of effectiveness.

Filed Under: Feedback Informed Treatment - FIT Tagged With: NICE, ors, outome rating scale, psychotherapy, session rating scale, srs, wampold

Feedback in Groups: New Tools, New Evidence

December 29, 2012 By scottdm Leave a Comment

 

Groups are an increasingly popular mode for delivering behavioral health services.  Few would deny that using the same hour to treat mutliple people is more cost effective.  A large body of research shows it to be as effective in general as individually delivered treatments.

Now clinicians can incorporate feedback into the group therapy using a brief, scientifically validated measurement scale: the Group Session Rating Scale.  The measure is part of the packet of FIT tools available in 20+ languages on both my personal and the International Center for Clinical Excellence websites.   Since the alliance is one of the most robust predictors of outcome, the GSRS provides yet another method for helping therapists obtain feedback from consumers of behavior health services.  As readers of this blog know, over a dozen randomized clinical trials document the positive impact of routinely assessing consumers’ experience of progress and the alliance on both retention and outcome of treatment.

The most up-to-date information about incorporating the GSRS into group therapy is covered in Manual 5: Feedback Informed Clinical Work: Specific Populations and Service Settings written together with ICCE Senior Associates Julie Tilsen, Cynthia Maeschalck, Jason Seidel, and Bill Robinson.

Manual 5 is one of six, state-of-the-art, how-to volumes on Feedback-Informed Treatment.  The series covers every aspect of FIT, from supporting research to implementation in agencies and larger systems of care.  The were developed and submitted in partial support of ICCE’s application to SAMSHA for designation as an evidence-based practice.

These popular e-books are being used in agencies and by practitioners around the world.  Right now, they are also available on a limited edition, searchable CD at 50% off the regular price.  As always, individual clinicians can download the GSRS and begin using it in their work for free.  

Advanced FIT Training - March 2013

Using the GSRS to inform and improve the effectiveness of group therapy will also be a focus on the ICCE Advanced Intensive training scheduled for March 18th-21st in Chicago, Illinois (USA).  Registration is simple and easy.  Click here to get started.  Participants from all over the United States, Canada, Europe and elsewhere are already registered to attend.

Click on the link below to read the validation article on the GSRS:

The Group Session Rating Scale (Quirk, Miller, Duncan, Owen, 2013)

Filed Under: Feedback Informed Treatment - FIT Tagged With: behavioral health, feedback informed treatment, ors, outcome rating scale, session rating scale, srs

Dealing with Scientific Objections to the Outcome and Session Rating Scales: Real and Bogus

December 15, 2012 By scottdm Leave a Comment

The available evidence is clear: seeking formal feedback from consumers of behavioral health services decreases drop out and deterioration while simultanesouly improving effectiveness.  When teaching practitioners how to use the ORS and SRS to elicit feedback regarding progress and the therapeutic relationship,  three common and important concerns are raised:

  1. How can such simple and brief scales provide meaningful information?
  2. Are consumers going to be honest?
  3. Aren’t these measures merely assessing satisfaction rather than anything meaninful?

Recently, I was discussing these concerns with ICCE Associate and Certified Trainer, Dan Buccino.

Briefly, Dan is a clinical supervisor and student coordinator in the Adult Outpatience Community Psychiatry program at Johns Hopkins.  He’d not only encountered the concerns noted above but several additional objections.  As he said in his email, “they were at once baffling and yet exciting, because they were so unusal and rigorous.”

“It’s a sign of the times,” I replied, “As FIT (feedback informed treatment) becomes more widespread, the supporting evidence will be scrutinized more carefully.  It’s a good sign.”

Together with Psychologist and ICCE Senior Associate and Trainer, Jason Seidel, Dan crafted detailed response.  When I told them that I believed the ICCE community would value having access to the document they created, both agreed to let me publish it on the Top Performance blog.  So…here it is.  Please read and feel free to pass it along to others.

 

 

 

Filed Under: Feedback Informed Treatment - FIT Tagged With: accountability, behavioral health, Certified Trainers, evidence based practice, feedback, interviews, mental health, ors, practice-based evidence, psychometrics, research, srs

The Importance of "Whoops" in Improving Treatment Outcome

December 2, 2012 By scottdm Leave a Comment

“Ring the bells that still can ring,
Forget your perfect offering
There is a crack in everything,
That’s how the light gets in.”

Leonard Cohen, Anthem

Making mistakes.  We all do it, in both our personal and professional lives.  “To err is human…,” the old saying goes.  And most of us say, if asked, that we agree whole heartedly with the adage–especially when it refers to someone else!  When the principle becomes personal, however, its is much more difficult to be so broad-minded.

Think about it for a minute: can you name five things you are wrong about?  Three?  How about the last mistake you made in your clinical work?  What was it?  Did you share it with the person you were working with?  With your colleagues?

Research shows there are surprising benefits to being wrong, especially when the maker views such errors differently.  As author Alina Tugend points out in her fabulous book, Better by Mistake, custom wrongly defines a mistake as ” the failure of a planned sequence of mental or physical activities to achieve its intended outcome.”  When you forget a client’s name during a session or push a door instead of pull, that counts as  slip or lapse.  A mistake, by contrast, is when “the plan itself is inadequate to achieve it’s objectives” (p. 11).  Knowing the difference, she continues, “can be very helpful in avoiding mistakes in the future” because it leads exploration away from assigning blame to the exploring systems, processes, and conditions that either cause mistakes or thwart their detection.

Last week, I was working with a talented and energetic group of helping professionals in New Bedford, Massachusetts.  The topic was, “Achieving Excellence: Pushing One’s Clinical Performance to the Next Level of Effectiveness.”  As part of my presentation, I talked about becoming more, “error-centric” in our work; specifically, using ongoing measurement of the alliance to identify opportunities for improving our connection with consumers of behavioral health services.  As an example of the benefits of making mistakes the focus of professional development efforts, I showed a brief video of Rachel Hsu and Roger Chen, two talented musicians who performed at the last Achieving Clinical Excellence (ACE) conference.  Rachel plays a piece by Liszt, Roger one by Mozart.  Both compositions are extremely challenging to play.  You tell me how they did (by the way, Rachel is 8 years old, Roger. 9):

Following her performance, I asked Rachel if she’d made any mistakes during her performance.  She laughed, and then said, “Yes, a lot!”  When I asked her what she did about that, she replied, “Well, its impossible to learn from my mistakes while I’m playing.  So I note them and then later practice those small bits, over and over, slow at first, then speeding up, until I get them right.”

After showing the video in New Bedford, a member of the audience raised his hand, “I get it but that whole idea makes me a bit nervous.”  I knew exactly what he was thinking.  Highlighting one’s mistakes in public is risky business.  Studies documenting that the most effective clinicians experience more self-doubt and are more willing to admit making mistakes is simply not convincing when one’s professional self-esteem or job may be on the line.  Neither is research showing that health care professionals who admit making mistakes and apologize to consumers are significantly less likely to be sued.  Becoming error centric, requires a change in culture, one that not only invites discloure but connects it with the kind of support and structure that leads to superior results.

Creating a “whoops-friendly” culture will be a focus of the next Achieving Clinical Excellence conference, scheduled for May 16-18th, 2013 in Amsterdam, Holland.  Researchers and clinicians from around the world will gather to share their data and experience at this unique event.  I promise you don’t want to miss it.  Here’s a short clip of highlights from the last one:

My colleague, Susanne Bargmann and I will also be teaching the latest research and evidence based methods for transforming mistakes into improved clinical performance at the upcoming FIT Advanced Intensive training in Chicago, Illinois.   I look forward to meeting you at one of these upcoming events.  In the meantime, here’s a fun, brief but informative video from the TED talks series on mistakes:

By the way, the house pictured above is real.  My family and I visited it while vacationing in Niagara Falls, Canada in October.  It’s a tourist attraction actually.  Mistakes, it seems, can be profitable.

Filed Under: Feedback Informed Treatment - FIT Tagged With: accountability, Alliance, behavioral health, cdoi, conferences, continuing education, deliberate practice, evidence based practice, feedback, mental health, Therapist Effects, top performance

What is the Real Source of Effectiveness in Smoking Cessation Treatment? New Research on Feedback Informed Treatment

November 24, 2012 By scottdm Leave a Comment

When it rains, it pours!  So much news to relay regarding recent research on Feedback Informed Treatment (FIT).  Just received news this week from ICCE Associate Stephen Michaels that research using the ORS and SRS in smoking cessation treatment is in print!   A few days prior to that, Kelley Quirk sent a copy of our long-awaited article on the validity and reliability of the Group Session Rating Scale.  On that very same day, the editors from the journal Psychotherapy sent proofs of an article written by me, Mark Hubble, Daryl Chow, and Jason Seidel for the 50th anniversary issue of the publication.

Let’s start with the validity and reliability study.  Many clinicians have already downloaded and been using Group Session Rating Scale.  The measure is part of the packet of FIT tools available in 20+ languages on both my personal and the International Center for Clinical Excellence websites.   The article presents the first research on the validity and reliability of the measure.  The data for the study was gathered at two sites I’ve worked with for many years.   Thanks to Kelley Quirk and Jesse Owen for crunching the numbers and writing up the results!   Since the alliance is one of the most robust predictors of outcome, the GSRS provides yet another method for helping therapists obtain feedback from consumers of behavior health services.

Moving on, if there were a Nobel Prize for patience and persistence, it would have to go to Stephen Michaels, the lead author of the study, Assessing Counsellor Effects on Quit Rates and Life Satisfactions Scores at a Tobacco Quitline” (Michael, Seltzer, Miller, and Wampold, 2012).  Over the last four years, Stephen has trained Quitline staff in FIT, implemented the ORS and SRS in Quitline tobacco cessation services, gathered outcome and alliance data on nearly 3,000 Quitline users, completed an in-depth review of the available smoking cessation literature, and finally, organized, analyzed, and written up the results.

What did he find?  Statistically significant differences in quit rates attributable to counselor effects.  In other words, as I’ve been saying for some time, some helpers are more helpful than others–even when the treatment provided is highly manualized and structured.  In short, it’s not the method that matters (including the use of the ORS and SRS), it’s the therapist.

What is responsible for the difference in effectiveness among therapists?  The answer to that question is the subject of the article, “The Outcome of Psychotherapy: Yesterday, Today, and Tomorrow” slated to appear in the 50th anniversary issue of Psychotherapy.  In it, we review controversies surround the question, “What makes therapy work?” and tip findings from another, soon-to-be-published empirical analysis of top performing clinicians.  Stay tuned.

Filed Under: Feedback Informed Treatment - FIT Tagged With: addiction, behavioral health, cdoi, Certified Trainers, evidence based practice, excellence, feedback, healthcare, icce, Smoking cessation, Therapist Effects

Psychotherapy Training: Is it Worth the Bother?

October 29, 2012 By scottdm 2 Comments

Big bucks.  That’s what training in psychotherapy costs.  Take graduate school in psychology as an example.  According to the US Department of Education’s National Center (NCES), a typical doctoral program takes five years to complete and costs between US$ 240,000-300,000.00.

Who has that kind of money laying around after completing four years of college?  The solution? Why, borrow the money, of course!  And students do.  In 2009, the average amount of debt of those doctoral students in psychology who borrowed was a whopping US$ 88,000–an amount nearly double that of the prior decade.  Well, the training must be pretty darn good to warrent such expenditures–especially when one considers that entry level salaries are on the decline and not terribly high to start!

Oh well, so much for high hopes.

Here are the facts, as recounted in a recent, concisely written summary of the evidence by John Malouff:

1. Studies comparing treatments delivered by professionals and paraprofessionals either show that paraprofessionals have better outcomes or that there is no difference between the two groups;

2. There is virtually no evidence that supervision of students by professionals leads to better client outcomes (you should have guessed this after reading the first point);

3. There is no evidence that required coursework in graduate programs leads to better client outcomes.

If you are hoping that post doctoral experience will make up for the shortcomings of professional training, well, keep hoping.  In truth, professional experience does not correlate often or significantly with client therapy outcomes.

What can you do?  As Malouf points out, “For accrediting agencies to operate in the realm of principles of evidence-based practice, they must produce evidence…and this evidence needs to show that…training…contribute(s) to psychotherapy outcomes…[and] has positive benefits for future clients of the students” (p. 31).

In my workshops, I often advise therapists to forgo additional training until they determine just how effective they are right now.  Doing otherwise, risks perceiving progress where, in fact, none exists.  What golfer would buy new clubs or pursue expensive lessions without first knowing their current handicap?  How will you know if the training you attend is “worth the bother” if you can’t accurately measure the impact of it on your performance?

Determining one’s baseline rate of effectiveness is not as hard as it might seem.  Simply download the Outcome Rating Scale and begin using it with your clients.  It’s free.  You can then aggregate and analyze the data yourself or use one of the existing web-based systems (www.fit-outcomes.com or www.myoutcomes.com) to get data regarding your effectiveness in real time.

After that, join your colleagues at the upcoming Advanced Intensive Training in Feedback Informed Treatment.   This is an “evidence-based” training event.  You learn:

• How to use outcome management tools (e.g., the ORS) to inform and improve the treatment services you provide;

• Specific skills for determining your overall clinical success rate;

• How to develop an individualized, evidence-based professional development plan for improving your outcome and retention rate.

There’s a special “early bird” rate available for a few more weeks.  Last year, the event filled up several months ahead of time, so don’t wait.

On another note, just received the schedule for the 2013 Evolution of Psychotherapy conference.  I’m very excited to have been invited once again to the pretigious event and will be bring the latest information and research on acheiving excellence as a behavioral health practitioner.  On that note, the German artist and psychologist, Andreas Steiner has created a really cool poster and card game for the event, featuring all of the various presenters.  Here’s the poster.  Next to it is the “Three of Hearts.”  I’m pictured there with two of my colleagues, mentors, and friends, Michael Yapko and Stephen Gilligan:

Filed Under: Conferences and Training, Feedback Informed Treatment - FIT, Top Performance Tagged With: Andreas Steiner, evidence based medicine, evidence based practice, Evolution of Psychotherapy conference, john malouff, Michael Yapko, ors, outcome management, outcome measurement, outcome rating scale, paraprofessionals, psychology, psychotherapy, session rating scale, srs, Stephen Gilligan, therapy, Training, US Department of Education's National Center (NCES)

Looking for Results in All the Wrong Places: What Makes Feedback Work?

September 16, 2012 By scottdm Leave a Comment

As anyone knows who reads this blog or has been to one of my workshops, I am a fan of feedback.  Back in the mid-1990’s, I began using Lynn Johnson’s 10-item Session Rating Scale in my clinical work.  His book, Psychotherapy in the Age of Accountability, and our long relationship, convinced me that I needed to check in regularly with my clients.  At the same time, I started using the Outcome Questionnaire (OQ-45).  The developer, Michael Lambert, a professor and mentor, was finding that routinely measuring outcome helped clinicians catch and prevent deterioration in treatment.  In time, I worked with colleagues to develop a set of tools, the brevity of which made the process of asking for and receiving feedback about the relationship and outcome of care, feasible.

Initial research on the measures and feedback process was promising.   Formally and routinely asking for feedback was associated with improved outcomes, decreased drop-out rates, and cost savings in service delivery!  As I warned in my blogpost last February, however, such results, while important, were merely “first steps” in a scientific journey.  Most importantly, the research to date said nothing about why the use of the measures improved outcomes.  Given the history of our field, it would be easy to begin thinking of the measures as an “intervention” that, if faithfully adopted and used, would result in better outcomes.  Not surprisingly, this is exactly what has happened, with some claiming that the measures improve outcomes more than anything since the beginning of psychotherapy.  Sadly, such claims rarely live up to their initial promise.  For decades the quest for the holy grail has locked the field into a vicious cycle of hope and despair, one that ultimately eclipses the opportunity to conduct the very research needed to facilitate understanding of the complex processes at work in any intervention.

In February, I wrote about several indirect, but empirically robust, avenues of evidence indicating that another variable might be responsible for the effect found in the initial feedback research.  Now, before I go on, let me remind you that I’m a fan of feedback, a big fan.  At the same time, its important to understand why it works and, specifically, what factors are responsible for the effect.  Doing otherwise risks mistaking method with cause, what we believe with reality.  Yes, it could be the measures.  But, the type research conducted at the time did not make it possible to reach that conclusion.  Plus, it seemed to me, other data pointed elsewhere; namely to the therapist.  Consider, for example, the following findings: (1) therapists did not appear to learn from the feedback provided by measures of the alliance and outcome; (2) therapists did not become more effective over time as a result of being exposed to feedback.  In other words, as with every other “intervention” in the history of psychotherapy, the effect of routinely monitoring the alliance and outcome seems to vary by therapist.

Such results, if true, would have significant implications for the feedback movement (and the field of behavioral health in general).  Instead of focusing on methods and interventions, efforts to improve the outcome of behavioral health practice should focus on those providing the service.  And guess what?  This is precisely what the latest research on routine outcome measurement (ROM) has now found. Hot off the press, in the latest issue of the journal, Psychotherapy Research, Dutch investigators de Jong, van Sluis, Nugter, Heiser, and Spinhoven (2012) found that feedback was not effective under all circumstances.  What variable was responsible for the difference?  You guessed it: the therapist–in particular, their interest in receiving feedback, sense of self-efficacy, commitment to use the tools to receive feedback, and…their gender (with women being more willing to use the measures).  Consistent with ICCE’s emphasis on supporting organizations with implementation, other research points to the significant role setting and structure plays in success.  Simon, Simon, Harris and Lambert (2011), Reimer and Bickman (2012), and de Jong (2012) have all found that organizational and administrative issues loom large in mediating the use and impact of feedback in care.

Together with colleagues, we are currently investigating both the individual therapist and contextual variables that enable clinicians to benefit from feedback.  The results are enticing.  The first will be presented at the upcoming Achieving Clinical Excellence conference in Holland, May 16-18th.  Other results will be reported in the 50th anniversayry issue of the journal, Psychotherapy, to which we’ve been asked to contribute.  Stay tuned.

Filed Under: Feedback Informed Treatment - FIT Tagged With: cdoi, continuing education, holland, icce, Michael Lambert, post traumatic stress

Obesity Redux: The RFL Results and complex Nature of Truth and Science

August 28, 2012 By scottdm 2 Comments

Back in April, I blogged about research published by Ryan Sorrell on the use of feedback-informed treatment in a telephonically-divered weight management program.  The study, which appeared in the journal Disease Management*, not only found that the program and feedback led to weight loss, but also significant improvements in distress, health eating behaviors (70%), exercise (65%), and presenteeism on the job (64%)–the latter being critical to employers who were paying for the service.

Despite these results, the post garnered no attention until four months later during the first week of August when three clinicians posted comments on the very same day–that’s the beauty of the web, a long memory and an even longer reach.

What can I say?  I’m having to eat my hat (or, the bird on my shoulder is…).  I learned a great deal from the feedback:

  • Despite having sourced the figure from the American Academy of Child and Adolescent Psychiatry, the claim that weight gain due to poor diet and a lack of exercise was responsible for 300,000 deaths was false.  According to the comments, the figure is closer to 26,000, a mere 10% of the number claimed!
  • The same was true regarding the reported annual cost of obesity.  The 100 billion dollar figure reported on the AACAP website is, I was told, “grossly inflated” and worse, missed the point.  By focusing on BMI, the writer counseled, “we will have wasted money spent on the 51% of the healthy people who are deemed ‘unhealthy’ based on weight and the 18% unhealthy ones who are overlooked because their weight looks fine (see Wildman et al., 2008).”

Solid points both.  Thankfully, one of the writers noted what was supposed to have been the main point of the post; namely, ” the importance of “practice-based” evidence” in guiding service delivery, “making clear that finding the ‘right’ or ‘evidence-based’ approach for obesity (or any problem for that matter) is less important than finding out “what works” for each person in need of help.”

I want to make sure readers have access to the results of the study because they are an impressive demonstration of what’s possible when the feedback is sought from and used to guide service to people “in care.”  Weight loss aside, Ryan also reported significant improvements in distress, healthy eating behaviors (70%), exercise (65%), and presenteeism on the job (64%).  All this by using two simple, 4-question scales.

*Sorrell, R. (September, 2007).  Application of an Outcome-Directed Behavioral Modification Model for Obesity on a Telephonic, Web-based Platform.Disease Management, 10, Supplement 1, 23-26.

PS: An AP article that came out this last weekend and was discussed on NPR suggests the truth about the “weight of the nation” may be more complicated than either I or those who commented on my blog may realize.  Among the many changes that have occured over the last decades, the piece declares, “Who are we?  Fatter.  The average woman has gained 18 pounds since 1990, to 160 pounds; the average man is up 16 pounds, to 196.”   Hmm.

Filed Under: Feedback Informed Treatment - FIT, obesity Tagged With: American Academy of Child and Adolescent Psychiatry, Chronic Disease, cognitive-behavioral therapy, disease management, evidence based practice, icce, Weight Management

Feedback Informed Treatment: Update

August 16, 2012 By scottdm Leave a Comment

Chicago, IL (USA)

The last two weeks have been a whirlwind of activity here in Chicago.  First, the “Advanced Intensive.”  Next came the annual “Training of Trainers.”  Each week, the room was filled to capacity with practitioners, researchers, supervisors, and agency directors from around the globe receiving in-depth training in feedback-informed practice.  It was a phenomenal experience.  As the video below shows, we worked and played hard!

Already, people are signing up for the next “Advanced Intensive” scheduled for the third week of March 2013 and the new three-day intensive training on FIT supervision scheduled for the 6-9th of August 2013.   Both events follow and are designed to complement the newly released ICCE FIT Treatment and Training Manuals.  In fact, all participants receive copies of the 6 manuals, covering every detail of FIT practice, from the empirical evidence to implementation.  The manuals were developed and submitted to support ICCE’s submission of FIT to the National Registry of Evidence Based Practices (NREPP).  As I blogged about last March, ICCE trainings fill up early.  Register today and get the early bird discount.

Filed Under: CDOI, Conferences and Training, evidence-based practice, Feedback Informed Treatment - FIT, FIT Tagged With: cdoi, icce

The DSM 5: Mental Health’s "Disappointingly Sorry Manual" (Fifth Edition)

June 11, 2012 By scottdm 2 Comments

Have you seen the results from the field trials for the fifth edition of the Diagnostic and Statistical Manual?  The purpose of the research was to test the reliability of the diagnoses contained in the new edition.  Reliable (ri-lahy–uh-buhl), meaning “trustworthy, dependable, consistent.”

Before looking at the data, consider the following question: what are the two most common mental health problems in the United States (and, for that matter, most of the Western world)?  If you answered depression and anxiety, you are right.  The problem is that the degree of agreement between experts trained to used the criteria is unacceptably low.

Briefly, reliability is estimated using what statisticians call the Kappa (k) coefficient, a measure of inter-rater agreement.  Kappa is thought to be a more robust measure than simple percent agreement as it takes into account the likelihood of raters agreeing by chance.

The results?  The likelihood of two clinicians, applying the same criteria to assess the same person, was poor for both depression and anxiety.  Although there is no set standard, experts generally agree that kappa coefficients that fall lower that .40 can be considered poor; .41-.60, fair; .61-.75, good; and .76 and above, excellent.  Look at the numbers below and judge for yourself:

Diagnosis DSM-5 DSM4 ICD-10 DSM-3
Major Depressive Disorder .32 .59 .53 .80
Generalized Anxiety Disorder .20 .65 .30 .72

Now, is it me or do you notice a trend?  The reliability for the two most commonly diagnosed and treated “mental health disorders” has actually worsened over time!  The same was found for a number of the disorders, including schizophrenia (.46, .76, .81), alcohol use disorder (.40, .71, .80), and oppositional defiant disorder (.46, .51., .66).  Antisocial and Obsessive Personality Disorders were so variable as to be deemed unreliable.

Creating a manual of  “all known mental health problems” is a momumental (and difficult) task to be sure.  Plus, not all the news was bad.  A number of diagnoses demonstrated good reliability (autism spectrum disorder, posttraumatic stress disorder (PTSD), and attention-deficit/hyperactivity disorder (ADHD) in children (.69, .67, .61, respectively).  Still, the overall picture is more than a bit disconcerting–especially when one considers that the question of the manual’s validity has never been addressed.  Validity (vuh–lid-i-tee), meaning literally, “having some foundation; based on truth.”  Given the lack of any understanding of or agreement on the pathogenesis or etiology of the 350+ diagnoses contained in the manual, the volume ends up being, at best, a list of symptom clusters–not unlike categorizing people according to the four humours (e.g., phlegmatic, choleric, melancholy, sanquine).

Personally, I’ve always been puzzled by the emphasis placed on psychiatric diagnoses, given the lack of evidence of diagnostic specific treatment effects in psychotherapy outcome research.  Additionally, a increasing number of randomized clinical trials has provided solid evidence that simply monitoring alliance and progress during care significantly improves both quality and outcome of the services delivered.  Here’s the latest summary of feedback-related research.

Filed Under: Feedback Informed Treatment - FIT Tagged With: continuing education, DSM

Feedback Informed Treatment as Evidence-Based Practice

May 23, 2012 By scottdm Leave a Comment

Back in November, I blogged about the ICCE application to SAMSHA’s National Registry for consideration of FIT as an official evidence-based approach (EBP).  Given the definition of EBP by the Institute of Medicine and the American Psychological Association, Feedback Informed Treatment seems a perfect, well, FIT.  According to the IOM and APA, evidence-based practice means using the best evidence and tailoring services to the client, their preferences, culture, and circumstances.  Additionally, when evidence-based, clinicians must monitor “patient progress (and of changes in the patient’s circumstances—e.g.,job loss, major illness) that may suggest the need to adjust the treatment. If progress is not proceeding adequately, the psychologist alters or addresses problematic aspects of the treatment (e.g., problems in the therapeutic relationship or in the implementation of the goals of the treatment) as appropriate.”

In late Summer 2011, ICCE submitted 1000’s of pages of supporting documents, research studies, as well as video in support of the application.  This week, we heard that FIT passed the “Quality of Research” phase of the review.  Now, the committee is looking at the “Readiness for Dissemination” materials, including the six detailed treatment and implementation manuals on feedback informed treatment.  Keep your fingers crossed.  We’ve been told that the entire process should be completed sometime in late fall.

In the meantime, we are preparing for this summer’s Advanced Intensive and Training of Trainer workshops.  Once again, clinicians, educators, and researchers from around the world will be coming together for cutting edge training.  Only a few spots remain, so register now.

Filed Under: Feedback Informed Treatment - FIT Tagged With: American Psychological Association, evidence based medicine, evidence based practice, feedback informed treatment, FIT, icce, Institute of Medicine, NREPP, practice-based evidence, SAMHSA, Training

  • « Previous Page
  • 1
  • …
  • 4
  • 5
  • 6
  • 7
  • 8
  • 9
  • Next Page »

SEARCH

Subscribe for updates from my blog.

[sibwp_form id=1]

Upcoming Training

There are no upcoming Events at this time.

FIT Software tools

FIT Software tools

LinkedIn

Topics of Interest:

  • Behavioral Health (111)
  • behavioral health (5)
  • Brain-based Research (2)
  • CDOI (14)
  • Conferences and Training (67)
  • deliberate practice (31)
  • Dodo Verdict (9)
  • Drug and Alcohol (3)
  • evidence-based practice (67)
  • excellence (63)
  • Feedback (40)
  • Feedback Informed Treatment – FIT (243)
  • FIT (29)
  • FIT Software Tools (12)
  • ICCE (26)
  • Implementation (7)
  • medication adherence (3)
  • obesity (1)
  • PCOMS (11)
  • Practice Based Evidence (39)
  • PTSD (4)
  • Suicide (1)
  • supervision (1)
  • Termination (1)
  • Therapeutic Relationship (9)
  • Top Performance (40)

Recent Posts

  • Agape
  • Snippets
  • Results from the first bona fide study of deliberate practice
  • Fasten your seatbelt
  • A not so helpful, helping hand

Recent Comments

  • Typical Duration of Outpatient Therapy Sessions | The Hope Institute on Is the “50-minute hour” done for?
  • Dr Martin Russell on Agape
  • hima on Simple, not Easy: Using the ORS and SRS Effectively
  • hima on The Cryptonite of Behavioral Health: Making Mistakes
  • himalaya on Alas, it seems everyone comes from Lake Wobegon

Tags

addiction Alliance behavioral health brief therapy Carl Rogers CBT cdoi common factors conferences continuing education denmark evidence based medicine evidence based practice Evolution of Psychotherapy excellence feedback feedback informed treatment healthcare holland icce international center for cliniclal excellence medicine mental health meta-analysis Norway NREPP ors outcome measurement outcome rating scale post traumatic stress practice-based evidence psychology psychometrics psychotherapy psychotherapy networker public behavioral health randomized clinical trial SAMHSA session rating scale srs supershrinks sweden Therapist Effects therapy Training