SCOTT D Miller - For the latest and greatest information on Feedback Informed Treatment

  • About
    • About Scott
    • Publications
  • Training and Consultation
  • Workshop Calendar
  • FIT Measures Licensing
  • FIT Software Tools
  • Online Store
  • Top Performance Blog
  • Contact Scott
scottdmiller@ talkingcure.com +1.773.454.8511

Time for a New Paradigm? Psychotherapy Outcomes Stagnant for 40 years

February 1, 2019 By scottdm 6 Comments

airplane in treeYou’ve heard it said before.  Flying is the safest form of transportation.

Facts back up the claim.  In fact, it’s not even close.  In terms of distance traveled, the fatality rate per billion kilometers is .003, improving dramatically over the years.  Cars, by contrast, are almost 1,000 times more dangerous.  Still, since 1923, the fatality rate in motor vehicle accidents has declined an eye-popping 93%.

How about psychotherapy?  Have outcomes improved?  Judging by the size of the Diagnostic and Statistical Manual and growth in the number of treatment approaches, one would expect success rates to have climbed significantly, if not exponentially.  Not so, as I first presented at the Evolution of Psychotherapy Conference five years ago, and later on this blog, the empirical evidence clearly shows NO improvement.

And now a new study, this time reviewing the evidence regarding treatments for children and adolescents.  Using sophisticated statistical analyses, the researchers examined 453 RCT’s spanning 53 years, involving nearly 32,000 kids treated for anxiety, depression, attention deficit/hyperactivity, and conduct problems.  With the rising popularity of “evidence-based practice,” those conducting the study wanted to know whether “… our methods of developing and testing youth psychological therapies [are] producing improvement” (p. 2).

Can you guess what they found?Books in tree

Outcomes have not changed (much less improved) over the last five decades–that’s 351 in dog years!

Can you imagine the outcry had similar results been published about automobiles or planes?  You would fully expect hearings to be held, and leaders to be called called to account.  The lives of children are on the line.

Nope.  Instead, facing the supersized differences between promises made every year about “advances” in psychotherapy, and the results realized and reported in research studies, the authors meekly call for, “new approaches to treatment design and intervention science” (p. 1).

Really?  Is that what’s required?  Researchers going back to the drawing board of “treatment and intervention?”

No, what’s needed is an entirely different view of what clinicians actually do  — and it starts by giving up the idea that psychotherapy is a form of treatment similar to antibiotics or angioplasty.  Let’s face it.  Psychotherapy is no more a medical treatment than are the facials, salt glows and body wraps one receives at the local spa.  Which is not to say, it doesn’t work.

Eva-Strauss-Ivory-Tower

Outside the halls of academia, millions of therapists worldwide are helping people on a daily basis to live happier, more meaningful and functional lives.  Dozens of studies of real world practitioners document outcomes that meet or exceed benchmarks established in tightly controlled, model-driven, randomized trials — all without following a particular, “evidence-based” protocol (see 1, 2, 3,4).

So, how best to conceptualize the effective work clinicians do?  And, importantly, what could researchers offer that would be of real help to therapists?

That psychotherapy works, says more about humans and our need for connection, meaning, and purpose, than it does about the particulars of any given model or approach.  And that our methods focus on thoughts, feelings, behaviors, and brain chemistry, says more about our Western values and beliefs, than about the ingredients necessary for successful healing.

Simply put, the field does not need to, as the authors of the study argue, “intensify the search for mechanisms of change [and] transdiagnostic … treatments” (p. 1).  Doing so is merely a recipe for “more of the same.”  Rather, to move forward, it should abandon the medical paradigm that has long had a stranglehold on our research and professional discourse, choosing instead to reconnect with the larger, worldwide family of healers, one that has existed since the dawn of history and which, from the outset, has been deeply engaged in the values and beliefs of those they treat, using whatever means necessary, consistent with the culture, to engender change.

What might that look like in practice?

As already documented, practicing clinicians already do a pretty darn good job helping their clients.  There’s nothing wrong with our Westernized approaches when they work.  At the same time, we don’t succeed with everyone.  The problem, studies show, is we’re not particularly good at knowing when we’re not being helpful, when clients are at risk for dropping out or are actually deteriorating while in our care (1, 2).  On this score, research has already provided a solution.  Dozens of studies document, for example, using simple measures at the beginning and end of each visit not only provides clinicians with an opportunity to intervene more successfully with “at risk” clients, but also helps identify opportunities for their own growth and development (1, 2).  If you’re not routinely and formally measuring the quality and outcome of your work, you can get started by accessing two simple tools here.

With outcome as our guide, all that remains is being willing to look outside the profession for possibilities for healing and change unbound by convention and the medical view.  That’s happening already, by the way, in the world’s two most populous countries, India and China, with professionals learning the ways of indigenous healers and government officials tapping local shaman to meet citizen’s mental health and well being needs.

So, what about you?  What you are doing to extend your healing reach?

And, in case you haven’t seen it, the video below is from the most recent Evolution of Psychotherapy conference, where I talk about new research documenting psychics achieving the same or better results as psychotherapists.

Until next time,

Scott

Scott D. Miller, Ph.D.
Director, International Center for Clinical Excellence

P.S.: Want to learn more about using outcome to inform and improve your effectiveness?  Join me and an international group of teachers and researchers in Chicago for our Summer Intensives.  For detailed information and to register, click on the banners below.
FIT Implementation Intensive Aug 2019 - ICCEFIT Training of Trainers Aug 2019 - ICCEFIT Deliberate Practice Aug 2019 - ICCE

Filed Under: deliberate practice, excellence, Feedback, Feedback Informed Treatment - FIT

Beating the Dodo Verdict: Can Psychotherapy Ever Achieve Better Results?

December 18, 2018 By scottdm 2 Comments

rosenzweig and millerNearly two decades have passed since I met Saul Rosenzweig at his home in St. Louis, Missouri.  He was well into his nineties and still working every day.  Truth is, I was surprised to learn he was still alive!

In 1936, he’d penned an article –three and a half pages in total– that became one of the most often cited in psychotherapy research.  He was only 29 years of age at the time.

Then, as now, Rosenzweig’s central premise is controversial: all psychotherapy approaches, regardless of their specific components, produce equivalent outcomes.

Although he didn’t coin the phrase, his observation has since been referred to as, “The Dodo Verdict.”  That’s because he began the article quoting a line uttered by the Dodo from Alice’s Adventures in Wonderland, “Everyone has won, and all must have prizes.”

Over the last eight decades, many have claimed to “beat the dodo verdict” — to have developed an approach more effective than others.   You know them by acronym: CBT, EMDR, ACT, CRT, MI, TFT, SFBT, CDOI, and so on.   Initial research is always promising.  Nevertheless, as I’ve detailed in many blogs over the years, later studies invariably find the “new and improved” is no more effective than the “tried and true” — whatever the accepted standard might be at that moment (1, 2, 3, 4).

Betty crockerThe field’s focus on methods is understandable.  The assumption is psychotherapy works like medicine.  To be effective, an approach must contain ingredients specifically remedial to the disorder being treated.  No one questions whether antibiotics are better than aspirin for strep throat.  Why?  Because the former contains an ingredient that kills the bacteria responsible for the infection.  In a similar way, CBT  is widely believed to work because its methods target the root cause of depression, dysfunctional thoughts.

So critical are the techniques of the various psychotherapy approaches believed to be, developers create protocols and manuals for insuring they are delivered correctly.  Professional, regulatory, and funding bodies (e.g., American Psychological Association, National Institute for Health and Care Excellence [NICE], National Institute of Mental Health) have embraced and, in some instances, mandated their use.

But what do the data say?

In 2005, my colleagues and I reviewed the available evidence and concluded, “Although training in manualized psychotherapies does enhance therapist learning of and technical competence in a given approach, there is no relationship between such manuals and outcome.”

And now, a new, updated study.  Briefly, researchers Truijens, Zühlke‐van Hulzen, and Vanheule, conducted a systematic review of the literature — six studies directly comparing manualized and nonmanualized psychotherapy, and nine meta-analyses.  Their conclusion?  “Manualized treatment is not empirically supported … [and] should not be promoted as being superior to nonmanualized psychotherapy.”  It’s Dodo come back life.

What can a mental health professional do to improve their effectiveness?

Here again, the data point the way to finally “beating the Dodo.”  It involves a change of focus.  Instead of learning the latest treatment approach, work on becoming a more effective version of you.  The process is known as deliberate practice.  It begins by creating a detailed map of your clinical performance; specifically, measuring your results, and then using the information to identify opportunities for professional growth.Research to date documents gradual growth in effectiveness consistent with performance improvements obtained by elite athletes.

Want to learn more?  Click here for a free article–actually, the chapter on the subject from our latest book, The Cycle of Excellence.   Still interested?  Watch the recent interview I did on the subject with YouTube blogger, Chris Dorsano.

That’s it for now.  Best for the Holidays,

Scott

Scott D. Miller, Ph.D.
Director, International Center for Clinical Excellence
ICCE - Advanced FIT Intensive 2019

 

 

 

 


 

Filed Under: Feedback Informed Treatment - FIT

“Clients Won’t Like It” and Other Concerns about Feedback Informed Treatment

December 7, 2018 By scottdm Leave a Comment

help givenIn my travels each year, I meet 1,000’s of clinicians–professionals who truly want to help others, and are willing to try almost anything to do so.

That’s why I always “lean in” whenever one expresses concern about the rising popularity of using formal measures of progress and the therapeutic relationship to inform and improve the quality and effectiveness of behavioral health services.

The clinicians I meet are usually aware of the research behind the call to incorporate client feedback into care: (1) many people who begin in treatment (~50 to 65%), leave without experiencing a measured improvement in their functioning or well being; and (2) randomized controlled trials show that doing so improves outcomes and reduces costs (1, 2).

Still, they wonder, “What do clients think?” “Do they consider filling out the forms helpful, or a burden?”

Those asking the question have a point. After all, the measures must be used every session with every client, despite studies to date showing the effects of asking for feedback are largely confined to those not making progress. Said another way, many asked to complete measures (between 35-50%), will experience no benefit from participating in the process.

When answering this question, I’ve always relied on what I’ve been able to glean from available studies (1, 2) and my personal experience. “Rarely do my client’s object,” I say, adding, “Neither have other clinicians reported that their clients consider it a burden.” And the research to date, although sparse, largely confirms that experience.

Overall, clients report that using measures is both positive and beneficial, enabling them to: (1) play an active in the care they receive; (2) maintain a focus on what matters most to them; and (3) collaborate more effectively with their treatment provider.

That said, problems have been noted. Chief among these are therapists failing to explain the nature and purpose of the scales (e.g., validity, confidentiality of the data, rationale) as well as not using the resulting feedback to guide service delivery (e.g., increase responsiveness to individual client needs, goals, and preferences; promote greater reflection and collaboration between therapist and client; address problems in the therapeutic relationship; and change the nature, frequency, type or provider of services).

fingers in earsNeither of these findings are particularly surprising. If there’s anything more frustrating than being forced to complete seemingly irrelevant paperwork, it is being asked for feedback and then having it ignored. That said, if the results are so damned obvious, “Why do the problems keep happening?”

The answer, in a word, is: integration.

Learning how to administer progress and alliances measures is simple. Instructions for giving, scoring, and plotting the Outcome and Session Rating Scales, literally takes less than 90 seconds. Making the tools an integral part of one’s clinical work–instead of bookends marking the beginning and end of each visit–is an entirely different matter. Back in May, I blogged about a new study showing that such integration takes time, between two to four years. Once done, however, the results are impressive, with clients whose therapists actively use measures two and a half times more likely to experience improvement.

Integrating feedback tools into your clinical style is the subject of the upcoming, three-day “Advanced Intensive” training on Feedback-Informed Treatment in Chicago.

We go far beyond the basics, giving you concrete strategies and skills for engaging clients in the feedback process, and using the resulting information to improve the quality and outcome of the services you offer.

In 2013, the methods you will learn were vetted by the National Registry and deemed evidence-based. As in prior years, the training is on track to sell out early. Click here, or on either of the banners below, to register or learn more.

Until next time,

Scott

Scott D. Miller, Ph.D.
Director, International Center for Clinical Excellence

Advanced FIT Intensive Mar 2019 - ICCEFIT Supervision Intensive Mar 2019 - ICCE

Filed Under: Feedback Informed Treatment - FIT

Aren’t You the Anti-Evidence-Based Practice Guy? My Socks. And Other Crazy Questions.

November 20, 2018 By scottdm 14 Comments

Scott the Anti EBT GuyIt’s just two weeks ago.  I was on a call with movers and shakers from a western state.  They were looking to implement Feedback Informed Treatment (FIT)–that is, using measures of progress and the therapeutic relationship to monitor and improve the quality and outcome of mental health services.

I was in the middle of reviewing the empirical evidence in support of FIT when one of the people on the call broke in.  “I’m a little confused,” they said hesitantly, “I thought you were the anti-evidence-based practice guy.”

It’s not the first time I’ve been asked this question.  In truth, it’s easy to understand why some might believe this about me.  For more than two decades, I have been a vocal critic of the idea that certain treatments are more effective for some problems than others.  Why?  Because of the evidence!  Indeed, one of the most robust findings over the last 40 years is that all approaches work equally well.

Many clinicians, and a host of developers of therapeutic approaches, mistakenly equate the use of a given model with evidence-based practice.  Nothing could be further from the truth.  Evidence-based practice is a verb not a noun.

According to American Psychological Association and the Institute of Medicine, there are three components: (1) using the best evidence; in combination with (2) individual clinical expertise; while ensuring the work is consistent with (3) patient values and expectations.  “FIT,” I responded, “not only is consistent with, but operationalizes the definition of evidence-based practice, providing clinicians with reliable and valid tools for identifying when services need to be adjusted in order to improve the chances of achieving a successful outcome.”condolence cards

Here’s another recent question: “I’ve read somewhere that FIT doesn’t work.”  When I inquired further, the asker indicated they’d been to a conference and heard about a study showing FIT doesn’t improve effectiveness (1).  With the rising popularity of FIT around the world, I understand how someone might be rattled by such a claim.  And yet, from the outset, I’ve always recommended caution.

In 2012, I wrote about findings reported in the first studies of the ORS and SRS, indicating they were simply, “too good to be true.”  Around that same time, I also expressed my belief that therapists were not likely to learn from, nor become more effective as a result of measuring their results on an ongoing basis.   Although later proven prophetic (1, 2), mine wasn’t a particularly brilliant observation.  After all, who would expect using a stopwatch would make you a faster runner?  Or a stethoscope would result in more effective heart surgeries?  Silly, really.

What does the evidence indicate?

    • The latest, most comprehensive meta-analysis of studies published in the prestigious, peer-reviewed journal, Psychotherapy Research, found that routine use of the ORS and SRS resulted in a small, yet significant impact on outcomes.
    • Improving the outcome of care requires more than measurement.  If FIT is to have any effect on engagement and progress in care, clinicians must be free of programmatic and structural barriers that restrict their ability to respond in real time to the feedback they receive.  As obvious as it may seem, studies in which clinicians measure, but cannot change what they are doing in response show little or no effect (1).
    • With one exception, results reported in studies of FIT are confounded by the amount of training therapists receive, and the stage of implementation they (or the agency in which they work) are in, at the time the research is conducted.  In many of the investigations published to date, participating therapists received 1 hour of training or less prior to beginning, and no supervision during, the study (1).  Consistent with findings from the field of implementation science documenting that productive use of new clinical practices takes from three to five years, a new study conducted in Scandinavia found the impact of FIT grew over time, with few results seen in the first and second year of use.  By year four, however, patients were 2.5 times more likely to improve when their therapists used FIT.  In short, it takes time to learn how to do FIT, and for organizations to make the structural changes required for the development and maintenance of a feedback culture.
    • Improving individual therapist effectiveness requires deliberate practice.   It turns out,the best therapists devote twice as much time to the process.  More, when employed purposefully and mindfully, the outcomes of average practitioners steadily rise at a rate consistent with performance improvements obtained by elite athletes (Click here if you want to watch an entertaining and informative video on the subject from the recent Achieving Clinical Excellence conference).

socksBefore ending, let me mention one other question that comes up fairly often. “Why don’t you wear shoes when you present?”  The picture to the left was taken at a workshop in Sweden last week and posted on Facebook!  Over the years, I’ve heard many explanations: (1) it’s a Zen thing; (2) because I’m from California; (3) to make the audience feel comfortable; (3) to show off my colorful socks; and so on.

The truth, it turns out, is like the findings about FIT reported above, much more mundane.  Care to guess?

(You can find my answer below)

Until next time,

Scott

Scott D. Miller, Ph.D.
Director, International Center for Clinical Excellence

P.S.: Registration for the FIT Intensives is open.  As has happened in previous years, we are on track to sell out early.  Email me at info@scottdmiller.com with any questions or click on the icons for more information or sign up.
ICCE - Advanced FIT Intensive 2019FITSUP2019

 

 

 

 

P.P.S: Men’s shoes hurt my feet and back ache.  I get neither when walking about in my stocking feet while standing and presenting all day.

Filed Under: Feedback Informed Treatment - FIT

What Works in Psychotherapy? Valuing “What Works” rather than Working with What We Value

November 2, 2018 By scottdm 17 Comments

The Therapeutic RelationshipMost clinicians agree, the therapeutic relationship is an important ingredient in effective psychotherapy.

However, ask them the last time they: (1) read a study on the subject; (2) attended a postgraduate training specifically aimed at improving their skills in this area; or simply to (3) identify and define the factors contributing to an effective relationship, and the answers you’ll get are far more variable.

Why is that?  Why doesn’t the therapeutic relationship get more attention in coursework and postgraduate training?

The truth is, while clinicians readily acknowledge the bond they form with clients matters, they deeply believe other factors are more critical to outcome.

How do we know?  Research.

As far back as 1996, data began to emerge.  In their very interesting study, researchers Sandra Eugster and Bruce Wampold found that therapists’ evaluations of their clinical work were inversely related to the quality of the working relationship.  Think about that!  The better the relationship, the worse evaluation therapists gave of their clinical work.  What mattered most?  Technical expertise!

reapFor clients, the picture was quite different.  The relationship was the real deal — in particular, their experience of being related to, “in a manner or degree not solely prescribed by the formal role of [the] therapist … subtle clues of authenticity and genuine human relatedness” (p. 1024-5).

While unsettling, such findings should surprise no one.  From the outset of training, therapists are not valued for their humanness or personhood, but rather their theoretical knowledge and technical proficiency.  In fact, a recent study done in Australia finds between 40 and 47% of graduate programs in psychology make no reference to relationship skills in their course syllabi, program descriptions, or list of training competencies (watch the interview below with one of the lead researchers).  These facts, combined with frequent “admonitions against over-involvement, breach of boundaries, …and other such departures from good technique” (Eugster & Wampold, p. 1025), establishes a “vicious cycle” that continues after graduate school  — one in which practitioners, and the field, are forever attempting to improve effectiveness by learning new diagnoses, therapy-related terminology, and treatment models.

The latest issue of the journal Psychotherapy goes a long way toward disrupting “business as usual.”  Every article is focused on the therapeutic relationship.  Here are some of the highlights.   If you want to be more effective, bypass learning the latest treatment technique and focus instead on:

  • Improving your ability to respond emphatically;
  • Putting more of yourself into therapeutic interactions;
  • Becoming better at working collaboratively to develop and maintain an explicit agreement on the goals of treatment as well as the respective roles and tasks of various participants (e.g., the therapist and client/s); and
  • Routinely and formally assessing the quality of the therapeutic relationship, taking time to address any problems/ruptures in real time.

Here’s one additional resource:  my interview with psychologist, Crystal McMullen, the lead researcher of the study mentioned above documenting the dearth of training on the therapeutic relationship.  “It takes decades for the psychology industry to let anything go,” she observes, “but, there is a change in the air…”.   Hear what is at the core of her optimism, as well as detailed suggestions for the future of the field.

Until next time,

Scott

Scott D. Miller, Ph.D.
Director, International Center for Clinical Excellence

Looking for training on the alliance?  That is the focus on our upcoming March intensives:

ICCE - Advanced FIT Intensive 2019Feedback Informed Treatment SupervisionIntensive2019-Scott D Miller

 

 

 

 

 

Filed Under: Feedback Informed Treatment - FIT

“What works” with eating disorders (and how long will it take the field to swallow these results)?

October 20, 2018 By scottdm 7 Comments

Eating DisordersWhat works in the treatment of people with eating disorders?  Search around a bit on the internet, or consult official treatment guidelines, and you’ll find cognitive-behavioral therapy (CBT) and interpersonal therapy (IPT) listed as the “best-supported” or “preferred” psychological approaches for bulimia, anorexia, and binge eating.

Such recommendations strongly imply such approaches contain ingredients specifically remedial to eating disorders which, when applied, result in superior outcomes.  Otherwise, why create the list in the first place?

But what does the evidence actually indicate?  While research in mental health rarely results in definitive findings, in the case of eating disorders, the story is different.  When it comes to psychotherapy, all methods work equally well.   At least, that is the conclusion of the most recent, sophisticated meta-analysis on the subject.  However, if history serves as a guide, many will find the latest results hard to swallow.

Back in 2014, an article penned by proponents of the “specific treatments for specific disorders” — aka the “empirically supported” treatments movement — appeared in The Guardian, claiming science had show that some approaches were “better for certain conditions than others,” in particular eating disorders.   Citing the tremendous cost to sufferers and the healthcare system, they urged the field to “redouble … efforts to identify … and ensure that the most effective therapies are available to all who need them.”

The-use-and-abuse-of-evidenceAs I blogged about at the time, I received a ton of email when that article first appeared.  “Have you seen the Guardian?” they asked.  “What do you make of it?” others inquired.   A few messages were downright snarky, even gloating,  “Scott, research has finally proven certain approaches are more effective than others.  I knew it all along!”

I responded noting that the claims in the article were based on a single study.  One.  And yes, that one study comparing CBT to psychoanalysis found CBT resulted in superior effects in the treatment of bulimia.  Crucially, I pointed out, the authors failed to mention the existence of another, exhaustive investigation available at the time in Clinical Psychology Review—one that used the statistically rigorous method of meta-analysis to review 53 studies of psychological treatments for eating disorders, and found no differences in effect between competing therapeutic approaches.

Four-and-a-half years later, the question of “what works best” in the treatment of eating disorders is being addressed in a brand new study in the top tier journal, Psychotherapy Research.  (As of right now, you can read it for yourself for free by clicking here.  Be prepared, however, as this is not an opinion piece written in a newspaper, but rather an academically rigorous analysis of the evidence).

What did the authors find?  Confirming the results of the prior meta-analysis: (1) any treatment works better than none; (2) real treatments are more effective than sham approaches; (3) and no method works better than any other.

Similar results, have been found across a wide range concerns that bring people into treatment, including trauma, sexual abuse, alcohol abuse and dependence, depression and anxiety.

ill-fitting-suitGiven the evidence, the question is not whether such results can be trusted.  They can.  Indeed, they represent the “state-of-the-art” — the best research has to offer.  The real problem, then as now, is that such findings do not address the question therapists most want answered, “What can I do to better help my clients?”

To answer this question, we have to recognize a simple fact: therapists live in a fundamentally different world than researchers.  We do not deal with groups of people sharing a common diagnosis who are randomized into different treatments.  Neither are we are interested in differences in the means response of aggregate group comparisons.  We deal with individuals.  Confronted daily by their suffering, we want to know how to help the person in our office right now.  The problem comes whenever these two worlds are conflated, as advocates of particular treatment approaches are prone to do.  It’s then our pragmatic focus make us exceptionally vulnerable to anyone claiming to have discovered “a better way.”

So, what can therapists do to improve their effectiveness?

Simply put: find out if what you are doing is helping your client.  Do this by seeking feedback on a formal, session-by-session basis about their progress and experience of the therapeutic relationship–a process known as “Feedback-Informed Treatment” or FIT (you can access two, free, brief and simple-to-use scales by clicking here).  A variety of support materials, and 10,000+ clinicians and administrators are available at no cost via the International Center for Clinical Excellence website.  Importantly, evidence shows clients of therapists who have integrated FIT into their work are 2.5 times more likely to experience improvement over the course of care.

That’s it for now.

Until next time,

Scott

Scott D. Miller, Ph.D.
Director, International Center for Clinical Excellence
Mindless RCTS

 

Filed Under: Feedback Informed Treatment - FIT

What heals trauma?

October 3, 2018 By scottdm 27 Comments

nothing-is-written-in-stone-527756_1920“Exposure!” a choir of professional voices sings, “its the only proven way.”

“No, no,” others insist, “You can tap yourself to emotional freedom.”

“Poppycock!” another group jumps in, “Horizontal saccadic eye movements are the ticket!”

“Beware the dominant discourse,” a few, particularly literate warn, “focusing on what was done to the person can retraumatize, help them reauthor their experiences instead.”

Meanwhile, a smaller and less vocal group shakes their heads in disbelief, saying, “There are no shortcuts.  Healing comes only from identifying and ‘working through’ painful unconscious feelings.”

Turning to the research to answer the question–what heals trauma?”–offers little clarity.  Advocates of most approaches can offer evidence that their preferred approach works–at least one study, and often more, many more–a fact all should find puzzling.  Simply put, how could all approaches work, given they offer competing and often contradictory explanations and techniques?   And yet, no consistent superiority of one particular approach over others is exactly what the latest dismantling and meta-analytic studies show (1, 2, 3, 4, 5, 6, 7).this or that

When attempting to account for why all approaches work equally well, the most common argument made is that different models work for different people.  Said another way, what may be effective in the aggregate may not work for the individual.   “Choice is key,” advocates of this position assert.

More recently, and perhaps in response to the continuing failure to find any meaningful difference in outcome between treatment methods, it has become popular to talk of a set of “mechanistically transdiagnostic…therapeutic strategies…[targeting] the role of a given mechanism in the development and maintenance of a range of psychopathology.”   Ironically, the call for a “universal treatment protocol,” is the “go to” position of those who once advocated for the creation of officially sanctioned lists of specific treatments for specific disorders.

hold waterSo, which explanation holds water?  Here again, the empirical evidence offers little clarity.  What is important, however, is that these two, diametrically opposed perspectives share a common assumption: healing results from the appropriate application of the right treatment methods.

But what if that’s not true?  What if therapeutic techniques–whether specific to a given model or shared by all–have no inherent power to heal?  Where would that leave us as a profession?  Does it mean that our methods are the therapeutic equivalent of Dumbo’s magic feather?

magic feather“A great deal changes, in terms of our ability to help and heal,” psychologist Stephen Bacon suggests, “if we embrace what the research indicates.  Psychotherapy, as a science, is not like engineering.  It operates in a different reality.”

Recently, I had a chance to interview Stephen about his work, and new, thought-provoking, and imminently practical book, Practicing Psychotherapy in a Constructed Reality: Ritual, Charisma, and Enhanced Client Outcomes.  

As you’ll see, he’s a very interesting person–six years in an ashram, a neighbor and student of Krishnamurti, a degree in religious studies, and more.  For me, the “enhanced client outcomes” referenced in the title immediately got my attention.   Wait until you have 30, uninterrupted minutes available, as the interview is one of my longer, and you will want to watch every minute.

Until next time,

Scott

Scott D. Miller, Ph.D.
Director, International Center for Clinical Excellence

Filed Under: Feedback Informed Treatment - FIT

Feedback is NOT Enough: A Brief Update about the Empirical Evidence

September 25, 2018 By scottdm 1 Comment

my way highwayThe use of routine outcome monitoring (ROM) is on the rise.  In the United States and abroad, regulatory bodies are actually mandating the gathering of outcome data as the new “standard of care.”

As agencies rush to implement–often at great cost in terms of time and money–the question remains: just how much does ROM contribute to improved retention and effectiveness?

Over 20 years ago, I began using outcome and alliance scales in my work as a therapist, asking clients at each visit to give me feedback about the qaulity of our relationship and their experience of progress.  Eventually, together with colleagues, I developed two, brief measures: the Outcome and Session Rating Scales.

Concern-signWhen studies using the scales began to appear in the literature, I was immediately concerned.  In my opinion, the results were just “too good to be true.”  First, the results were confounded by allegiance effects, having been done exclusively by people with a significant investment in the results.  More to the point, however, I was worried that the studies focused on the measures rather than on therapists.

Soon, as I predicted, other studies appeared with far more modest results.   And now, a meta-analysis of all studies using the ORS and SRS has been published, confirming that routinely measuring performance, improves outcome but not as much as reported in the original studies (viz., .27 versus .50).

resultsFor those involved in and advocating FIT (Feedback-Informed Treatment), this is an IMPORTANT study.  It makes clear that when working feedback-informed, improving effectiveness requires more than the use of two measures.  Indeed, it’s not really about the measures at all.  Rather, it’s about therapists using feedback to identify opportunities for their own professional development.

As my colleague and fellow psychologist, Birgit Valla, is fond of saying, “A stopwatch will not make you a better runner.  It’s not about the clock.  It’s how you use the information to identify small, specific aspects of your performance that could be improved and then practicing.”

That’s what the team at ICCE and I have been exploring these past 7 years.  The latest article summarizing that research was published just this week.

All the best,

Scott

Scott D. Miller, Ph.D.
Director, International Center for Clinical Excellence

P.S.: Registration for the Spring Intensives is open.  Click on the links below to reserve your spot!
ICCE - Advanced FIT Intensive 2019Feedback Informed Treatment SupervisionIntensive2019-Scott D Miller

 

 

Filed Under: Behavioral Health, deliberate practice, Feedback Informed Treatment - FIT

Science is Real (confusing)

September 17, 2018 By scottdm 8 Comments

Science confirms

The graphic above is a small sample of the many posts I encountered on social media last week.  Obviously, science has a great deal of currency in public discourse.

Now, look at the bottom row.  On the far left, we are told that drinking wine will help you live a longer life.  On the right, the exact opposite claim is made: no level of alcohol consumption is safe.

Can anyone blame us for being confused?  What is the truth?  Isn’t that what science is supposed to help us sort out?  Judging from the slogans printed on T-shirts, posters, and lawn signs, apparently so:

  • Science matters!
  • Science will not be silenced!
  • In science we trust!

Or, in the words of “Science Guy,” Bill Nye, “If you don’t believe in science, you are holding everyone back.”

How can one respond to that, except to say, “Ouch!” 

Believe in HammersAnd yet, at the risk of holding everyone back, I actually think much of the current confusion about what is and is not true comes precisely from believing in science.  To me, its a bit like saying, “I believe in hammers.”  Yes, each word makes sense, but the resulting sentence is absurd.

Science is not something to believe in or not.  Like a hammer, it is merely a tool — one that, as the founder of American psychology, William James (1896), noted, is “first of all a certain dispassionate method.”

William JamesJames then continued, offering a warning particularly suited to our media-saturated times, “To suppose that [science] means a certain set of results that one should pin one’s faith upon and hug forever is sadly to mistake its genius, and degrades the scientific body to the status of a sect.”

Real world science is a messy affair, with partial, inconclusive, and often contradictory results the norm rather than the exception.  When done well and thoroughly understood, it can help tip the scales in one direction or another.  Rarely, however, does it offer us a mirror of the universe.

Here’s a recent example from my own work.  Are superior performers in sports, art, music, programming, and psychotherapy born or made?

About a decade ago, a slew of books and articles appeared boldly asserting, “Greatness isn’t born.  It’s grown” (Coyle, 2009).  Anyone, they promised, could accomplish anything if they just practiced long enough (Colvin, 2009; Gladwell, 2008; Shenk, 2010; Syed, 2010).

Then, in 2014, a group of researchers published a meta-analysis questioning the strength of the association between practice and performance.   In a popular magazine , the banner for an article penned by one of the study’s authors even claimed the whole idea of improving performance via practice,  “perpetuates a cruel myth” as it promotes the false belief, “people can help themselves to the same degree if they just try hard enough.”

What are we to believe?

Sorting out the seemingly contradictory results requires a deep dive into the literature: who did the studies, what questions did they ask, and how was the data analyzed?  In other words, longer than the 2 – 4 minute “reads” promised in the social media posts pictured above.  In fact, from the start to the publication of our new study on the subject, my co-investigators and I spent hundreds of hours spread out over a three year period examining the question.  Here’s what we found:

  • The correlation researchers cited as demonstrating practice is “not as important as has been argued” (.35 [p. 1, Macnamara et al., 2014]) was greater than the association between mortality (e.g., death) and obesity (.13), excessive drinking (.21), and taking prescribed medications correctly (.23).
  • When the data set was reanalyzed including only those studies judged by independent, blind raters to be bona fide instances of research on the link between practice and performance, the correlation increased to.40.

So, you decide: if you want to improve your effectiveness –as a pole vaulter, chess player, surgeon, or psychotherapist — should you practice?  Please share your thoughts below.

WAIT!  Three new science posts just came across my social media feed:

science posts

What to do?

  • Start talking to my dog.  Check!
  • Begin my three day fast. Check!
  • Nah, I’m just going to watch TV.

All the best,

Scott

Scott D. Miller, Ph.D.
Director, International Center for Clinical Excellence
ICCE - Advanced FIT Intensive 2019FITSUP2019

Filed Under: deliberate practice, Feedback Informed Treatment - FIT

Psychotherapy’s Most Closely Held Secret: Some Practitioners are more Effective than Others

August 29, 2018 By scottdm 11 Comments

Take a good look at the picture below.   Do you recognize this person?

David F. Ricks, Ph.D.Let me give you a hint.  In 1974, he published the first empirical study documenting one of psychotherapy’s most closely held secrets: some therapists are more effective than others.

It’s true.  You know it.  I know it.  Everyone knows it.  We just don’t talk about it openly.

The man in the photo is psychologist David F. Ricks, author of “Supershrink: Methods of a Therapist Judged Successful on the Basis of Adult Outcomes of Adolescent Patients.”  And until the publication of this post, no public images of him were available.  Not a single photo on the net.  Hard to believe in our digital age  (I promise to explain how I managed to get this picture later on in the post).

Confirming the controversial and uncomfortable nature of the subject, Rick’s article, though groundbreaking, is rarely cited.  Google Scholar reports a mere 154 citations over the last forty-four years–and most of those are by the same, small group of authors!  More to the point, how to explain the finding that kids treated by one therapist fared far better in adulthood than those cared for by another?

Now, as then, the dominant belief is that any differences in outcome are attributable to the client, their pretreatment level of dysfunction, and the environment in which they live. practically perfect In Rick’s (1974) study, however, extreme care was taken to ensure the adolescents seen by different therapists were matched on all such possible variables (e.g., level of functioning/severity, gender, IQ, economic class, age, ethnic background, time period treated, level of familiar and parental pathology).  The results were dramatic, if not shocking.  One the basis of their level of adjustment as adults, seventy-five percent of those seen by the top performing clinician had a positive outcome.  By contrast, 84% of those treated by the other practitioner were classified as having a “schizophrenic outcome.”

Had the kids been asked at the time, the field would not have had to wait so long to discover the factor responsible for their success.  Indeed, all were aware of the important role their therapist played in their lives. Looking back as adults, they affectionately recalled referring to the clinician who had treated them as “the supershrink”–even going so far as to encourage other kids to seek out this particular person for help.  

Despite these results, thirty-years would pass before another empirical analysis appeared in the literature (Okiishi, Lambert, Nielsen, & Ogles, 2003).  The size and scope of this later study dwarfed Rick’s, examining results from standardized measures administered on an ongoing basis to over 1800 people treated by 91 therapists.  The findings?  Those seen by the most effective clinicians experienced a rate of improvement 10 time greater than the mean for the entire sample.  Meanwhile, those treated by the least effective, could expect to feel the same or worse than when they started, even after attending 3 times as many sessions!

Isn’t it time our field confronts reality and asks, “why are some therapists more effective than others?” Clinicians invest a great deal of time, energy, and money in professional growth. They undergo personal therapy, receive ongoing postgraduate supervision, and attend continuing education (CE) events (Rønnestad & Orlinsky, 2005).  Nevertheless, one searches in vain for any evidence that such efforts help therapists accomplish their goal (Miller, Hubble, & Chow, 2017).

prairie_pioneers_10After learning a bit more about the life and work of David Ricks, I strongly believe he would counsel us to, “Go for it!”  After all, he was a maverick and pioneer.  I mean that literally!  Born in 1927 in Wilson, Wyoming (population, 32), his log cabin house had no indoor plumbing or electricity.  Hot potatoes lovingly prepared by his mother, warmed his bed and hands during the long, cold winter months.

He literally rode a horse to and from the one-room school house he attended–that is, until the family was forced by the Great Depression to move south in search of more economic opportunities.  There, the hardships continued: his father died when he was 15, his mother was often ill, and the family remained poor.  Throughout it all, David persisted.  Although an elementary school teacher once told his parents, “David can’t learn,” he nonetheless was awarded a full scholarship to attend college, eventually earning a Ph.D. in psychology from the University of Chicago.  Over the course of his career, he taught, did research, and was a professor at Harvard, Cornell, and eventually, the University of Cincinnati.Core values against compass

Ever since I first read his study, I’d wondered about the person behind the research.  Internet searches, as I mentioned above, were futile.  I did learn from a brief online obituary that he had died in March 2004–sadly, just a few years before his findings would begin influencing our own work.  I sent letters and emails to various people and Universities, all to no avail.

Recently, I managed to find a potential link to one of his, now adult, children.  I reached out via Facebook, and the rest is history.  We’ve spoken at length on the phone.  In response to my request, I was given a series of photos, including the one in this post.  Most special, however, was a personal history Dr. Ricks wrote for his grandchildren.  Reading it gave me, I believe, insight into the traits that drove him.  When writing about what his parents had taught him to value in life and relationships, he said, first, honesty, and second, courage.

Recent research has finally provided some answers to the question Ricks posed so many years ago (Golberg, Babbins-Wagner, Rousmaniere, Berzins, Hoyt, Whipple et al. 2016): Why are some therapists more effective than others?   Put succinctly, the amount of time they engage in deliberate practice is a significant predictor of how effective they become.  Indeed, top performing clinicians devote twice as much time to this process than their less effective counterparts.  What does it involve?  Three things: (1) ongoing measurement of one’s results; (2) continuous identification of specific errors and targets for improvement; and (3) development, testing, and successive refinement of new ways of working.

Still the topic remains controversial and the subject of much misunderstanding.  “Please don’t mention anything about supershrinks,” an agency manager advised in hushed tones during a recent phone conversation we were having about topics for a potential in-house training.  When I asked, “Why?” they explained, “Clinicians already feel ‘put upon.’  They don’t want to hear about needing to compete with the best.”  No wonder this research, I instantly thought to myself, is so off putting.   I attempted to clarify, “It’s not about competing with others or even becoming a supershrink, it’s about trying to get a grip on what each of us can do to improve our effectiveness.”

My question to you is, “Did I get the job to do the workshop at that agency?!”

Interested in your responses!

Until next time,

Scott

Scott D. Miller, Ph.D.
Director, International Center for Clinical Excellence

P.S.: Registration for the March 2019 Intensives in Chicago is open.  I know it may seem like a long way off in the future, but these trainings have sold out months in advance for the last several years.  Click now on the images below to join colleagues from around the world for the fun, interactive, and learning-rich experiences.
ICCE - Advanced FIT Intensive 2019FITSUP2019

 

 

 

Filed Under: Feedback Informed Treatment - FIT

Just how good are our theories about the causes and alleviation of mental and emotional suffering?

July 12, 2018 By scottdm 7 Comments

wrong way

Does the name Barry Marshall ring a bell?

Probably not if you are a mental health professional.

For decades, the Australian physician was persona non grata in the field of medicine — or perhaps stated more accurately, persona sciocca, a fool.

Beginning in the early 1980’s, Marshall, together with colleague Robin Warren, advanced the hypothesis that the bacteria heliobacter pylori was at root of most stomach ulcers.  That idea proved exceptionally controversial flying, as it did, in the face of years of accepted practice and wisdom.  Ulcers caused by something as simple and obvious as a bacterial infection?  Bunk, the medical community responded, in the process lampooning the two researchers.  After all, everyone knew stress was the culprit.  The also knew the cure: certainly not antibiotics.  Rather, antacids, sedatives, therapy and, in the more chronic and serious cases, gastrectomy–a surgical procedure involving the removal of the lower third of the stomach.

The textbook used in my Introduction to Psychology course in my first year at University boldly declared, “Emotional stress is now known to relate to … such illnesses as … peptic ulcers” (p. 343, Psychology Today: An Introduction 4th Edition [Braun and Linder, 1979]).  The chapter on the subject was full of stories of people whose busy, emotionally demanding lives were clearly the cause of their stomach problems.  I dutifully overlined all the relevant sections with my orange highlighter.  Later, in my clinical career, whenever I saw a person with an ulcer, I told them it was caused by stress and, not surprisingly, taught them “stress-management” strategies.

The only problem is the field, my textbook, and I were wrong, seriously wrong.  Stress was not responsible for stomach ulcers.  And no, antacids, sedatives, and psychotherapy, were not the best treatments.  The problem could be cured much more efficiently and effectively with a standard course of antibiotics, many of which had been available since the 1960’s!   In other words, the cure had been within reach all along.  Which begs the question, how could the field have missed it?  Not only that, even after conclusively demonstrating the link between ulcers and the h.pylori bacterium, the medical community continued to reject Marshall and Warren’s papers and evidence for another 10 years (Klein, 2013)!mark twain

So what was it?  Money, ignorance, hubris–even the normal process by which new scientific findings are disseminated–have all been offered as explanations.   The truth is, however, the field of medicine, and mental health in particular, has a weakness–to paraphrase Mark Twain–for “knowing with certainty things that just ain’t so.”

How about these?

  • Structural abnormalities in the ovaries cause neurosis in women;
  • Psychopathology results from unconscious dynamics originating in childhood;
  • Optimism, anger control, and the expression of emotion reduces the risk of developing cancer;
  • Negative thinking, “cognitive distortions,” and/or a chemical imbalance cause depression;
  • Some psychotherapeutic approaches are more effective than others.

The list is extensive and dates all the way back to the field’s founding nearly 150 years ago.  All, at one point or another, deeply believed and passionately advocated.  All false.

story-magnet-attract-candidatesLooking back, its easy to see that we therapists are suckers for a good story–especially those that appear to offer scientific confirmation of strongly held cultural beliefs and values.

Nowadays, for example, it simply sounds better to say that our work targets, “abnormal activation patterns in dlPFC and amygdala that underlie the cognitive control and emotion regulation impairments observed in Major Depressive Disorder” than, “Hey, I listened attentively and offered some advice which seemed to help.”  And while there’s a mountain of evidence confirming the effectiveness of the latter, and virtually none supporting the former, proponents tell us it’s the former that “holds the promise” (Alvarez & Icoviello, 2015).

What to do?  Our present “neuroenchantment” notwithstanding, is there anything we practitioners and the field can learn from more than 150 years of theorizing?its piss

Given our history, it’s easy to become cynical, either coming to doubt the very existence of Truth or assuming that it’s relative to a particular individual, time, or culture.  The other choice, it seems to me, is humility–not the feigned ignorance believed by some to be a demonstration of respect for individual differences–but rather what results when we closely and carefully examine our actual work.

Take empathy, for example.  Not only do most practitioners consider the ability to understand and share the feelings of another  an “essential” clinical skill, it is one of the most frequently studied aspects of therapeutic work (Norcross, 2011).   And, research shows therapists, when asked, generally give themselves high marks in this area (c.f., Orlinksky & Howard, 2005).   My colleagues, Daryl Chow, Sharon Lu, Geoffrey Tan, and I encountered the same degree of confidence when working with therapists in our recent, Difficult Conversations in Therapy study.  Briefly, therapists were asked to respond empathically to a series of vignettes depicting challenging moments in psychotherapy (e.g., a client expressing anger at them).  Each time, their responses were rated on standardized scale and individualized feedback for improving was provided.

Head_spinNow, here is the absolutely cool part.  The longer therapists participated in the research, the less confident but more demonstrably empathic they became!   The process is known as “The Illusion of Explanatory Depth.”  Simply put, most of us feel we understand the world and our work with far greater detail, coherence, and depth than we really do.  Only when we are forced ourselves to grapple with the details, does this illusion give way to reality, and the possibility of personal and professional growth become possible.

If this makes your head spin, get a cup of coffee and watch the video below in which Dr. Daryl Chow explains these intriguing results.

Until next time,

Scott

Scott D. Miller, Ph.D.
Director, International Center for Clinical Excellence

P.S. Marshall and Warren were awarded the Nobel Prize for their research in 2005.  Better late than never.

FITSUP2019

Filed Under: evidence-based practice, excellence, Feedback, Feedback Informed Treatment - FIT

I have some magic beans for sale…you want them?

May 24, 2018 By scottdm 7 Comments

Thru the woodsSo, you’re out for a walk.  It’s a beautiful day but you’re caught up in your thoughts, feeling a bit discouraged and concerned.

For whatever reason, some of the people you are working with aren’t improving.  You’re no novice clinician.  You know impasses are a common feature of therapeutic work.  Still, this time your knowledge and experience aren’t helping.  You’re stuck.

That’s when you spot someone on the path ahead, leaning comfortably against a tree.  As you are about to pass by, the stranger smiles kindly, then steps forward.

“Good morning,” he says, calling you by name.

Although you can’t quite place him, you reply in a friendly manner, barely slowing your pace.

“I can see that you’ve got a lot on your mind,” he continues, now walking alongside.  It’s his next question that stops you in your tracks.

“Thinking about your clients again, aren’t you?” Slowly shaking his head from left to right, “It’s hard when you’re not as helpful as you mean to be.”

Before you can say, “Jack and the Beanstalk,” the man reaches into his pants pocket.  Removing his hand, he slowly extends it toward you eventually opening it, palm up.

“Quickly,” he demands, “How many beans do you see?”

Still stunned by the whole experience, you reply, “Five.”

“Right you are!” he exclaims excitedly, “And because you are so sharp, you can easily see these are no normal beans.  They’re magical.  Plant them in your office and by morning they’ll grow right up to the sky, providing a pathway for even your most difficult and challenging clients.”

“Really?” you respond, now feeling more than a bit incredulous.

hill_o_beans.0

The man doesn’t miss a beat.  “Of course,” he instantly reassures, “These beans are evidence-based.”  Pointing to a briefcase near the tree, “In there, I have many studies showing beans grow when planted, as well as plethora of PET scan images documenting how climbing the stalks causes real changes in the prefrontal and motor cortex of the brain.”

You move back a step, rub your chin, and eye the man suspiciously.

“Come on,” he says, “You want to help, don’t you?  What you’re doing now isn’t working.  You know that.  What have you got to lose?”

what-have-you-got-to-lose-85818896

That is the question.  So, what’s the answer?

If you’ve been a therapist for more than a few years, you’ve likely discovered our field is full of beans, bean sellers, and bean counters.  As just one example, for three decades CBT has been touted as the ‘treatment of choice” — a revolutionary advance, actually — for a wide array in mental health problems.

networker adRarely does a day pass that I don’t receive a brochure (or email to the left) for a workshop on the approach.   Search the term on Amazon and you’ll find more than 4000 books and related products.  At the same time, regulatory bodies around the world have created practice guidelines heavily skewed toward CBT.

And yet, there is no evidence that any of this leads to better outcomes.  The facts are: (1) CBT is no more effective than any other therapeutic approach (1, 2); (2) training in CBT does not improve therapist effectiveness (1); and finally, (3) guidelines favoring the adoption of CBT over other approaches have not resulted in better outcomes, and may inadvertently have led to a decline (1, 2, 3, 4, 5).

Claims about the novelty and effectiveness of other popular approaches fare similarly, including EMDR and Acceptance and Commitment Therapy (ACT).  Here again, books, workshops, and claims abound.  Ultimately, however, these two methods work about as well, but no better, than any other approach.  Plus, there’s no evidence that training in either improves therapist effectiveness (1, 2, 3).

goose

Returning to the question, it turns out a critical opportunity is lost in the trade for a handful of “magical” beans: individual professional development.  As all practitioners know, and have likely counseled their own clients, it is precisely at those moments when we are feeling most stuck that the greatest possibility for growth exists.  It’s also when we’re most vulnerable to promises of a shortcut —  the proverbial “goose that lays a golden egg.”

Until very recently, there’s been no alternative.  In Chapter 2 of the new book, The Cycle of Excellence, friend and colleague Daryl Chow and I describe how practitioners can use deliberate practice to both identify and move beyond their individual growth edge.   It is not an easy route.  At the same time, however, it is the only approach to professional development that has been shown to lead to measureable improvements in effectiveness on par with rates seen in Olympic atheletes in training (1).

If you’re interested, visit here to receive a copy of the chapter.

Until next time,

Scott

Scott D. Miller, Ph.D.
Director, International Center for Clinical Excellence

P.S.: Daryl and I will be together in Chicago in August for a two-day workshop on deliberate practice.  A few spots remain for this intimate, intensive training.  We’ll presenting the latest research — including findings from the “Difficult Conversations in Therapy” randomized controlled trial — and help each participant develop and refine an individualized deliberate practice plan.  Just click on the image below to register.

FIT Deliberate Practice Intensive 2018

 

 

 

 

Filed Under: Feedback Informed Treatment - FIT

Implementation: The KEY to Improving the Effectiveness of Psychotherapy

May 7, 2018 By scottdm 7 Comments

[Read more…]

Filed Under: Feedback Informed Treatment - FIT

Who cares about you anyway? The Role of the Psychotherapist in the Era of Evidence-based Practice

April 24, 2018 By scottdm 14 Comments

pop-quiz

Which of the following are bad for health and longevity?

A. Smoking;
B. Consuming too much alcohol;
C. Being overweight;
D. Not flossing regularly.

If you answered “yes” to any or all of the items, you are WRONG–that is, at least, if you are determined to rely on evidence derived from randomized controlled trials (RCT’s) alone in making healthcare decisions.

For some time now, RCT’s have been considered the “gold standard” for assessing evidence.  That said, for reasons which are likely obvious to you, no scientist would ever conduct studies in which real people are randomly assigned to either smoke, drink excessively, overeat, floss. or not.

And yet, the Associated Press (AP) recently dismissed flossing because of the paucity of such trials.  Their eye-catching headline?Dont Floss

Medical benefits of dental floss unproven

The story is worth reading.  It has all the qualities of a John Grisham novel: (1) a corrupt government; (2) self-serving business executives; (3) professional organizations with serious conflicts of interest; and best of all (4) secret documents retrieved by valiant news reporters via the Freedom of Information Act.  Seriously!

So, should you stop flossing?  Of course not.  Neither should you take up smoking, begin drinking excessively, or consumer many more calories per day than you burn.  But, surely you knew that.  For many living in the era of evidence-based medicine, however, no RCTs = no evidence.  In fact, this is exactly the thinking behind many of the guidelines steering the practice of psychotherapy today.

Local, state, national, and international regulatory bodies place RCT’s at the top of the hierarchy of scientific methods, generating lists of “approved” methods.  Increasingly, reimbursement and funding decisions are linked to practicing in accordance with these recommendations.   The implicit message is clear.  Where an RCT exists, no thinking on your part is required.  Just do what you are told and all will be well. 

Nothing could be further from the truth.  No evidence exists showing that the widespread adoption of “psychological treatments of known efficacy“– that is, those tested in RCTs, deemed empirically-supported, and listed on regulatory websites — has resulted in any real-world improvement in outcome.  In fact, the overall effectiveness of psychotherapy has remained unchanged for more than 40 years.

superpowerTurns out, what does matter in terms of outcome is the very element of treatment that’s largely been pushed aside, even maligned, in current research environment:  YOU! 

In RCT’s, by contrast, the provider of treatment is literally considered a “nuisance variable”  — an aspect of the process that must be controlled with protocols and blinding because they are “of no particular interest” to investigators.

Importantly, however, studies dating back decades show that who provides psychotherapy matters significantly more than what particular method or approach they use — 5 to 9 times more!  It may be difficult to believe, but its true: even when following detailed treatment protocols, differences in outcome between therapists persist.

For consumers, the implication is clear: choose your provider carefully as they significantly influence the results of the care you receive.  For therapists, it means that improving one’s effectiveness is not a matter of using the right treatment approach, but rather working on you; specifically, identifying your unique constellation of strengths and weaknesses, and building on the former while targeting the latter for remediation.  In a series of ingenious studies, for example, clinicians realized significant gains in their ability to successfully manage challenging moments in psychotherapy when provided with feedback specific to their particular deficits and abilities.   Importantly, participants ability to respond warmly, emphatically, and collaboratively not only improved, but also generalized to novel scenarios they had not encountered previously or been given time to rehearse.

My colleague Daryl Chow, Ph.D., and I will be providing step-by-step guidance as well as tools for mapping one’s clinical performance at the upcoming Deliberate Practice Intensive in Chicago.  Here’s the description of what will be covered.  I do hope you’ll join us.  I promise two, personally meaningful days together with practitioners from around the world.

That said, there’s no reason to wait until then to get started.  A year ago, I offered free access to several resources.  If you didn’t see that post, no worries, simply click here as all are still available.  To these, I’d like to add The Taxonomy of Deliberate Practice.  Daryl and I have been using this tool to help clinicians see what they do that does and doesn’t work, as well as to develop an individual professional development plan.  Just email me at: info@scottdmiller.com and I’ll send you a copy.

In the meantime, take a listen to this interview with Daryl from today.  I know its going to sound like a “come on,” but trust me when I say listen all the way to the end as there’s a real gem in the last minute about improving your results as a therapist.

Scott

Scott D. Miller, Ph.D.
Director, International Center for Clinical Excellence
FIT Deliberate Practice Intensive 2018FIT Training of Trainers 2018

Filed Under: Feedback Informed Treatment - FIT

Finding Meaning in Psychotherapy Amidst the Trivia and Trivial

April 1, 2018 By scottdm 11 Comments

drowningI don’t know if you feel the same way I do.  Looking back, I’m pretty sure its been going on for a while, but somehow I didn’t notice.

Professional books and journals fill my bookshelves and are stacked around my desk.  I am, and always have been, a voracious–even compulsive–reader.  In the last couple of years, the volume of material has only increased–exponentially so, if I include digital items saved to my desktop.

Now, I’ll be the first to admit: it’s hard keeping up.  But that’s really not my problem.

The issue is: I feel like I’m drowning in trivia and the trivial.

How about you?  When was the last time you read something truly meaningful?

guidelinesIncreasingly, research journals are filled with studies that are either so narrow in focus as to defy any real world application, or simply revisit the same questions over and over.   Just how many more studies does the field need, for example, on cognitive-behavioral therapy?  A Google Scholar search on the subject, crossed with the term, “randomized controlled trial,” returns over a million hits!

In terms of translating research into practice, here’s a sample of articles sure to appeal to almost every clinician (and I didn’t have to “dig deep” to find these, by the way, as all were in journals neatly stacked on my desk):

  1. Psychodynamizing and Existentializing Cognitive-Behavioral Interventions
  2. How extraverted is honey.bunny77@hotmail.de? Inferring personality from e-mail addresses
  3. Satisfaction with life moderates the indirect effect of pain intensity on pain interference through pain catastrophizing

I didn’t make these up.  All are real articles in real research journals.  If you don’t believe me, click on the links to see for yourself.

Neologisms (#1) and cuteness (#2) aside, their titles often belie a mind-numbing banality in both scope and findings.  Take the last study.  Can you guess what its about?  Satisfaction with life moderates the indirect effect of pain intensity on pain interference through pain catastrophizing.  And what findings do you think the authors spent 10 double-column, 10-point font pages relating in one of psychology’s most prestigious journals?

wait

 

“Satisfaction with life appears to buffer the effect of pain.”

 

Hmm.  Not particularly earth-shattering.  And, based on these results, what do the authors recommend?  Of course: “Further evaluation in longitudinal and interventional studies”  (I foresee another study on cognitive-behavioral therapy in the near future).

Purpose, belonging, sense-making, transcendence, and growth are the foundations of meaning.  Most of what shows up in my inbox, is taught at professionals workshops, and appears in scholarly publications has, or engenders, none of those qualities.  The cost to our field and the people we serve is staggering.  Worldwide, rates of depression, anxiety, and suicide continue to rise.  At the same time, fewer and fewer people are seeking psychotherapy–34% fewer according to the latest findings.  It is important to note that even when extensive efforts are made, and significant financial support is provided, 85% of those who could benefit choose not go.  I just can’t believe its because therapists haven’t attended the latest “amygdala retraining” workshop, or do not know how to “psychodynamize” their cognitive-behavioral interventions.

This last week, I had the pleasure of interviewing Dr. Ben Caldwell.  His book, Saving Psychotherapy: Bringing the Talking Cure Back from the Brink, speaks directly to the challenges facing the field as well as steps every clinician can take to restore meaning to both research and practice.  Take listen, and then be sure to leave a comment.

Until next time,

Scott

Scott D. Miller, Ph.D.
Director, International Center for Clinical Excellence
FIT Implementation Intensive 2018 FIT Deliberate Practice Intensive 2018

 

 

 

 

Filed Under: Behavioral Health, Conferences and Training, evidence-based practice, Feedback Informed Treatment - FIT

Symptom Reduction or Well-being: What Outcome should Matter Most in Psychotherapy

March 12, 2018 By scottdm 11 Comments

quizSo, what contributes to a living a long, healthy life?

Clean Air?  Being lean versus overweight?  The absence of depression or anxiety?  Exercising regularly?  Getting a flu vaccine?  Abstaining from smoking?  Minimizing alcohol intake?   Personal sense of meaning?  Close interpersonal relationships?  Social integration?

OK, I’ll come clean: all contribute–but not equally.  Far from it.  Some are more important than others.

So, what contributes most?  Before reading on, try rank ordering the list from least to most influential.

Now watch the brief video (If you are one of those that don’t want to try, or can’t wait to know the answer, just scroll past video).

Answer: the items as written are presented in order from the least to most influential, the last three being far more important to living a long and healthy life.   Distinct from the other items on the list, personal sense of meaning, close interpersonal relationships, and social integration form the core of “well-being.”

Given such findings, it is more than a bit curious that the field of mental health and majority of its supporting research are organized around reducing symptoms.  Perhaps this is one reason why, as psychiatrist Robert Cloninger persuasively argues, the profession has, “failed to improve the average levels of happiness and well-being in the general population, despite vast expenditures on psychotropic drugs and psychotherapy manuals.”  Indeed, by all measures, mental health is on the decline.

Could it be that our field has the formula for improving health and well-being backwards?  Instead of focusing on reducing problems or eliminating symptoms maybe we should be working directly on improving people’s personal sense of meaning, close interpersonal relationships, and social integration.Well being effects

The evidence is compelling.  In addition to a longer, healthier life, improved well-being leads to:

  • Faster recovery from illness;
  • Positive health behaviours in adults and children;
  • Quicker return to and more preseentism on the job;
  • Greater wellbeing and mental health of others;
  • Can inform treatment decisions and reduce healthcare costs;
  • May ultimately reduce the healthcare burden.

Twenty years ago, my team and I developed a quick, simple-to-use measure of well-being.  Numerous studies have shown the Outcome Rating Scale (ORS) to be valid and reliable as well as strongly predictive of psychological intervention.  The tool is listed on SAMHSA’s National Registry of Evidence-based Programs and Practices , is available in 30 languages, and in wide use in countries around the world.  Best of all: individual practitioners can download and begin using the tool for free.Denmark well being

Most exciting of all, use of the tool is serving as the impetus for many new innovations in mental health service delivery.  I just spent a week with teams from Slagelse municipality in Denmark who are now using the data generated from routine use of the ORS to transform service delivery at every level.  My Scandinavian co-teacher, psychologist Susanne Bargmann will be talking about these new and exciting developments at this summer’s FIT Implementation and Training of Trainers workshops.  Is it any wonder that Denmark consistently LEADS the world in well-being?

Until next time,

Scott

Scott D. Miller, Ph.D.
Director, International Center for Clinical Excellence
FIT Implementation Intensive 2018FIT Training of Trainers 2018

Filed Under: Behavioral Health, Drug and Alcohol, Feedback Informed Treatment - FIT, Therapeutic Relationship

Ho, Ho, Oh No! Science, politics, and the demise of the National Registry of Evidence-based Programs and Practices

February 7, 2018 By scottdm 13 Comments

End of NREPPWhile you were celebrating the Holidays–shopping and spending time with family–government officials were busy at work.  On December 28th, the Substance Abuse and Mental Health Services (SAMHSA) sent a formal termination notice to the National Registry of Evidence-based Programs and Practices (NREPP).

Ho, ho, oh no…!

Briefly, NREPP is “an evidence-based repository and review system designed to provide the public with reliable information on mental health and substance use interventions.”  In plain English, it’s a government website listing treatment approaches that have scientific support.  SAMHSA is the Federal Agency overseeing behavior health policy.

Back in November, I’d responded to a request from NREPP to update research on the Outcome and Session Rating Scales, two routine outcome measures currently listed on the registry website site.  All’s well until January 4th, when I received a short email stating that “no further review activities will occur” because the program was being ended “for the convenience of the government.”Danger

Like much that comes from our Nation’s capitol, the reason given for the actions taken depends entirely on who you ask.  Democrats are blaming Trump.   Republicans, and the new SAMHSA director, blame the system, calling the registry not only flawed, but potentially dangerous.   As is typical nowadays, everyone is outraged!

As someone whose work was vetted by NREPP, I can personally vouch for the thoroughness of the process and the integrity of the reviewers.  No favors were sought and none were given.  More, while no one knows exactly what will happen in the future, I sincerely believe officials leading the change have the best of intentions.  What I am much less certain of is whether science will finally prevail in communicating “what works” in mental health and substance abuse to the public.

Bottom line: psychological approaches for alleviating human suffering are remarkably effective–on par or better than most medical treatments.  That said, NONE work like a medicine.

salespersonYou have a bacterial infection, antibiotics are the solution.  A virus?  Well, you are just going to have to tough it out.  Take an aspirin and get some rest–and no, the brand you choose doesn’t really matter.   Ask a friend or relative, and they likely have a favorite.  The truth is, however, it doesn’t matter which one you take: Bayer, Econtin, Bufferin, Alka-Selzter, Anacin, a hundred other names, they’re all the same!

Four decades of research shows psychotherapy works much more like aspirin than an antibiotic.  Despite claims, its effects are not targeted nor specific to particular diagnoses.  Ask a friend, relative, your therapist or workshop presenter, and they all have their favorite: CBT, IPT, DBT, PD, TFT, CRT, EMDR, four-hundred additional names.  And yet, meta-analytic studies of head-to-head comparisons find no meaningful difference in outcome between approaches.

What does all this mean for the future of NREPP and SAMHSA?  The evidence makes clear that, when it comes to psychotherapy, any “list” of socially sanctioned approaches is not only unscientific, but seriously misleading.  Would it be too much to hope that future governmental efforts stop offering a marketplace for manufacturers of different brands of aspirin and focus instead on fostering evidence-based practice (EBP)?

Really, it’s not a bridge too far.  bridge too farIt merely means putting policies in place that help practitioners and agencies live up to the values inherent in the definition of EBP accepted by all professional organizations and regulatory bodies; namely, “the integration of the best available research with with clinical expertise in the context of patient characteristics, culture, and preferences” (pp. 273, APA, 2006).

Until next time,

Scott

Scott D. Miller, Ph.D.
Director, International Center for Clinical Excellence 

P.S.: Every other year, the ICCE sponsors the “Training of Trainers” intensive.  Over three days, we focus on helping you become a world class presenter and trainer.  Join me, and colleagues from around the world for this transformational event.
FIT Training of Trainers 2018

 

 

Filed Under: Behavioral Health, evidence-based practice, Feedback Informed Treatment - FIT, PCOMS

Joint Commission and SAMHSA Set New Standard of Care for Measurement Based Care

January 29, 2018 By scottdm 1 Comment

TJCLogo

The Joint Commission has recently revised their standards of care.  To maintain accreditation, organizations are now required to assess outcomes with a standardized measurement tool. main_logo

The Substance Abuse and Mental Health Services Administration is moving in the same direction.

Two scales I developed met the new standard.  Both are listed on the Joint Commission and SAMSHA websites.  The Outcome and Session Rating Scales (ORS, SRS) are brief, well-validated tools in use in clinical settings around the world.

The new standard has the potential to significantly improve the effectiveness and efficiency of care. Studies also show, however, that implementation is a complex process with many challenges. Indeed, despite significant investment of time and resources, many organizations fail.

PCOMS - Partners for change outcome management system Scott D Miller - SAMHSA - NREPPClick here for a free handout to assess the readiness of your agency.  It’s one of the many resources provided at the ICCE Feedback-Informed Treatment Implementation workshop—the only evidence-based implementation training on measurement-based care to receive perfect marks for implementation materials, training and support resources, and quality assurance procedures by the National Registry of Evidence-based Programs and Practices (NREPP).

As always, feel free to email me with any questions.

All the best,

Scott D. Miller, Ph.D.
Director, International Center for Clinical Excellence

Filed Under: Conferences and Training, Feedback Informed Treatment - FIT, Implementation, PCOMS

Better Results through Deliberate Practice

January 16, 2018 By scottdm Leave a Comment

better results

The legendary cellist Pablo Casals was once interviewed by comedian George Carlin.  When asked why, at age 93, he continued to practice three hours a day, Casals replied, “I’m beginning to show some improvement!”

Hard not to feel inspired and humbled by such dedication, eh?  And while humorous, Casals was not joking.  Across a wide variety of domains (e.g., sports, computer programming, teaching), deliberate practice leads to better results.   Indeed, our recent study of mental health practitioners documented a growth in effectiveness consistent with performance improvements obtained by elite atheletes.

practice makes perfectThe January issue of the APA monitor includes a detailed article on the subject.   Staff writer Tori DeAngelis lays out the process of applying deliberate practice strategies to clinical work in clear, step-by-step terms.  Best of all, it’s free–even continuing education credits are available if you need them.

daryl and scottAs mentioned in the article, each summer the International Center for  Clincal Excellence sponsors a two-day, intensive training on deliberate practice for therapists.  Daryl Chow, Ph.D. and I will be teaching together, presenting the latest scientific and practical information from our forthcoming book, Better Results: Using Deliberate Practice to Improve Therapeutic Effectiveness (APA, 2019).

As in prior years, we promise you will be participating in an intimate, cutting-edge, and highly-personalized learning experience.   Many practitioners return to year after year.  “I’ve attended the Deliberate Practice Intensive for three years in a row,” says therapist Jim Reynolds, “because there is such a warm camraderie.  We are all trying to do the best we can with our clients, but we go beyond that.  To do that, I need contact with others who are striving to do better.”

Until next time,

Scott

Scott D. Miller, Ph.D.

FIT Deliberate Practice Intensive 2018

Filed Under: Behavioral Health, deliberate practice, excellence, Feedback, Feedback Informed Treatment - FIT, FIT, Top Performance

We Need MORE Drugs, Right?

January 3, 2018 By scottdm 1 Comment

alteredstates_491x491Being human means being conscious.  Being conscious means knowing, “reality bites.”

Little wonder evidence shows people have sought to alter their consciousness since the Stone Age.  Whether its music, dance, the ingestion of psychoactive plants, or the modern pharmaceuticals, humans evince a strong desire to move beyond their present reality–to transcend it, even if only temporarily.

In the US, legalization of marijuana is in full swing, with sales poised to exceed 10 billion dollars in 2018.  A recent report found that 70% of Americans take at least one prescription drug, with antidepressants and pain-killing opioids among the most widely used.

Meanwhile, overdoses of prescription drugs and heroin continue to be the leading cause of unintentional death, taking more lives than car accidents, breast cancer, and in 2016, more than the entire Vietnam war.flying couch

Yes, reality bites.  More than that, its suffers by comparison.  As an example, consider “talk therapy”–the profession specializing in helping people “get in touch” with themselves.  Over the last decade, numbers are down, with 33% fewer people choosing to see a psychotherapist.  Clear, if altering consciousness is the goal, therapy sucks.

pill-burgerMore than at any other time in history, drugs are plentiful and easily available.  One contributing factor, a recent article in Fortune magazine points out, is the growing number of practitioners authorized to write scripts–groups such as nurse practitioners and physicians assistant that, in a brief 5-year period, managed to double the percentage of drugs they prescribe, accounting for almost a fifth of all retail sales.  One of the newest groups to join the ranks is psychologists.  Although the subject of continuing, contentious debate (1), the American Psychological Association is fully-invested in efforts to pass legislation supporting prescriptive authority.  So far, five states are on board.

Given human nature, and the direction mental health professions are taking, I wonder whether there is a therapeutic alternative to more drugs?  PLEASE SHARE your thoughts by hitting the comment button below.

As you do so, take a moment to watch my interview with Dr. Chris Rowe, a counselor whose research focused on the quality of instructional materials used to train psychologists to prescribe psychotropic drugs.  He address the following questions: (1) do the programs and products present a balanced view of pharmaceutical products? (2) will psychologists be prepared, as advocates suggest, to “choose to prescribe or not?” and (3) will psychologists be able to withstand the market pressures that have dramatically shaped the practice of psychiatry?

Until next time,

Scott

Scott D. Miller, Ph.D.
Director, International Center for Clinical Excellence

 

 

 

 

 

Filed Under: Feedback Informed Treatment - FIT

That’s it. I’m done. It’s time for me to say goodbye.

November 2, 2017 By scottdm 3 Comments

dddb02383d1bbe1e0c3d0ad991bd95b8--alternative-treatments-termination-activities-for-teensEnding psychotherapy.

Whether formal or informal, planned or unplanned, it’s going to happen every time treatment is initiated.

What do we know about the subject?

Nearly 50% of people who start, discontinue without warning.  At the time they end, half have experienced no meaningful improvement in their functioning or well-being. On the other hand, of those who do continue, between 35-40% experience no measurable benefit despite continuous engagement in lengthy episodes of care.

Such findings remind me of the lyrics to the Beatles’ tune, “Hello Goodbye.”

“You say yes, I say no;Hello Goodbye

You say stop and I say go, go, go, oh no!

Hello, hello?

I don’t know why you say goodbye, I say hello.”

Here’s another key research finding: the most effective therapists have significantly more planned terminations.

In a recent study, Norcross, Zimmerman, Greenberg, and Swift identified eight core, pantheoretical processes associated with successful termination. You can read the article here.  Better yet, download and begin using the “termination checklist”–a simple, yet helpful method for ensuring you are putting these evidence-based principles to work with your clients.  Best of all, listen to my recent interview with John Norcross, Ph.D., the study’s first author, as we discuss how therapists can master this vitally important part of the therapeutic experience.

Until next time,

Scott

Scott D. Miller, Ph.D.
Director, International Center for Clinical Excellence

Filed Under: Behavioral Health, evidence-based practice, excellence, Feedback, Feedback Informed Treatment - FIT, Termination

Something BIG is Happening: The Demand for Routine Outcome Measurement from Funders

October 16, 2017 By scottdm 2 Comments

Something in the air

Something is happening.  Something big.

Downloads of the Outcome and Session Rating Scales have skyrocketed.

The number of emails I receive has been steadily increasing.

The subject?  Routine outcome measurement.  The questions:

  • Where can I get copies of your measures?person asking question

Paper and pencil versions are available on my website.

  • What is the cost?

Individual practitioners can access the tools for free.  Group licenses are available for agencies and healthcare systems.

  • Can we incorporate the tools into our electronic healthcare record (E.H.R.)?

Three companies are licensed and authorized to provide an “Application Program Interface” (or API) for integrating the ORS, SRS, data aggregation formulas, and feedback signals directly into your E.H.R.  Detailed information and contact forms are available in a special page on my website.

  • What evidence is available for the validity, reliability, and effectiveness of the measures?

evidenceAlways a good question!  Since the tools were published seventeen years ago, studies have multiplied.  Keeping up with the data can be challenging as the tools are being used in different settings and with diverse clinical populations around the world.

Each year, together with my colleague, New Zealand psychologist, Eeuwe Schuckard, we add the latest research to a comprehensive document available for free online, titled “Measures and Feedback.”

Additionally, the tools have been vetted by an independent group of research scientists and are listed on the Substance Abuse and Mental Health Administration’s National Registry of Evidence-based Programs and Practices.

  • How can I (or my agency) get started?

Although it may sound simple and straightforward, this is the hardest question to answer.  There is often a tone of urgency in the emails I receive, “We need to measure outcomes now,” they say.tortoise-hare1

I nearly always respond with the same advice: the fastest way to succeed is to go slow.

We’ve learned a great deal about implementation over the last 10 years.  Getting practitioners to administer outcome measures is easy.  I can teach them how in less than three minutes.  Making the process more than just another, dreary “administrative task” takes time, patience, and persistence.

I caution against purchasing licenses, software, or onsite training.  Instead, I recommend taking time to explore.  It’s why the reviewers at SAMHSA gave our application for evidence-based status the highest ratings on “implementation support.”

ICCE ImplementationTo succeed, start with:

  1. Accessing a set of the ICCE Feedback Informed Treatment Manuals–the single, most comprehensive resource available on using the ORS and SRS.  Read and discuss them together with colleagues.
  2. Connect with practitioners and agencies around the world who have already implemented.  It’s easy.  Join the International Center for Clinical Excellence–the world’s largest online community dedicated to routine outcome measurement.
  3. Send a few key staff–managers, supervisors, implementation team leaders–to the Feedback-Informed Treatment Intensives.   The Advanced and Supervision workshops are held back-to-back each March in Chicago.  Participants not only leave with a thorough understanding of the ORS and SRS, but ready to kick off a successful implementation at home.  I tell people to sign up early as the courses are limited to 35 participants and always sell out a couple of months in advance.

Feel free to email me with any questions.

Until next time,

Scott

Scott D. Miller, Ph.D.
International Center for Clinical Excellence

 

Filed Under: Behavioral Health, evidence-based practice, Feedback Informed Treatment - FIT, FIT, FIT Software Tools, Implementation, PCOMS

Brave or Foolhardy? Dramatic Implications of a New Psychotherapy Outcome Study

September 4, 2017 By scottdm 15 Comments

researchDoes diagnosis matter?

What about the treatment approach?

Applying particular therapeutic methods to specific psychiatric diagnoses is the considered by many a “best practice”–the core of what some label, “empirically-supported” (EST) or “evidence-based psychological treatments” (EBPT).

Now, imagine a place where diagnosis and prescriptive protocols are not required or even considered essential to clinical practice.  A place where practitioners are free–even encouraged–to focus on helping people in whatever way works.  More on that in a moment.ShangriLa

In the meantime, consider a study just out in the Journal of the American Medical Association (JAMA).   Back in 2004, the lead author coined the term, “psychological treatments,” arguing that the future of the field depended on creating a formulary of “psychological treatments…matched to specific forms of pathology.”  The impact of this idea on clinical practice is nothing less than staggering.  Around the world, practice guidelines and funding for services are based on and restricted to methods applied to specific psychiatric diagnoses.

Participants in the newly released study either were treated with an approach specifically designed for their particular diagnosis or a generic alternative.   The results?   No difference in outcome at termination or 6-month follow-up!  Said another way, diagnostic-specific protocols did not improve the effectiveness of treatment.  In their place, the authors promote “transdiagnostic treatment protocols”–a term, I know you will be hearing more about in the future.  No need to be confused (or impressed) by the sophisticated sounding name.  Given decades of research showing all psychological approaches work equally well, this new one is, if nothing else, is a perfect example of “boldly charging forward into the past.”

things didn't work outThe truly revolutionary implication of this study is not mentioned by the researchers: neither psychiatric diagnosis or diagnostic-specific treatments improve the outcome of psychological care.  That was the promise.  It failed.

Bottom line: it’s time to move on.

That’s exactly what psychologist Birgit Valla has done.  The leader of a large, community mental health center in Stange, Norway, Birgit publically announced neither she or her staff would employ psychiatric diagnoses or standardized treatment protocols.

Was she brave or foolhardy?  For sure, she had the weight of evidence on her side as well as an unwavering commitment to delivering effective services. Still, she was soon accused of failing to follow the “standard of care.”  An investigated was started.  Sanctions and a withdrawal of funding were threatened.

What happened next?  Watch the interview to find out!

That’s it for now.  Until next time,

Scott

Scott . Miller, Ph.D.
Director, International Center for Clinical Excellence

 

 

 

Filed Under: Feedback Informed Treatment - FIT

“What about the Liars and Deniers?” Working Effectively with Mandated and Incarcerated Clients and People who Sexually Abuse

August 24, 2017 By scottdm 7 Comments

man-prison-regretIt was just a little over a month ago.  I was doing a workshop somewhere in the States.  My topic?  Using formal client feedback to guide and improve the quality and outcome of psychotherapy– our SAMHSA-approved, NREPP listed evidence-based practice.

At the first break, I was approached by one of the attendees.  “I’m really enjoying your presentation,” they started, then paused.  I could hear a “but” coming.

“And this sounds like it will work with a lot of different kinds of clients…but what about the liars and deniers?”

It’s not the first time I’d been asked this question–the gist of which is, “Can one really trust the feedback given by some clients?”

“We talking about your ex here?”  I jokingly asked.

“No,” the person said with a laugh, “You know, like people who aren’t there voluntarily, clients who are mandated, or in the criminal justice system, substance abusers, sex offenders, or all of the above.”

“Funny you should ask,” I replied, “I just finished an interview with one of the leading experts on working with people who sexually abuse.  I hope to get a blog up in the next few weeks.”

And here it is…DSPportraitr

David Prescott is a Fellow and past president of the Association for the Treatment of Sexual Abusers, the largest professional organization of its kind in the world.   He’s produced 14 books and numerous articles and chapters in the areas of assessing and treating sexual violence and trauma.   In the interview below, he talks about the use of FIT with people who sexually abuse–a subject we explore in even greater depth and detail in a chapter we penned together in the eight volume series, The Sex Offender.

Listen in and be sure and leave a comment.  It can be fairly challenging material, requiring a shift in mindset and approach–from delivering interventions to developing relationships, gaining compliance to securing engagement, and managing risk to engendering possibilities.

Anyway, I’m interested in your thoughts and experiences.

Meanwhile, registration has just opened for the March 2018 ICCE intensive trainings.  Join colleagues from around the world coming together to learn step-by-step, evidence-based strategies for improving engagement and outcome with people of all stripes, backgrounds, and clinical presentations.

Until next time,

Scott

Scott D. Miller, Ph.D.
Director, International Center for Clinical Excellence

Filed Under: Feedback Informed Treatment - FIT

From Evidence-based Practice to Cultural Change: Steps to Successful Implementation

July 11, 2017 By scottdm Leave a Comment

Chances are your are carrying a smartphone–maybe you’re even reading this post on your Android or Iphone!  One thing I’m almost certain of is that the device you own–can’t live without–is not a Nokia.

The nearly complete absence of the brand is strange.  Not long ago, the company dominated the mobile phone market.  At one time, seventy percent of phones in consumers’ hands were made by Nokia.

“And then,” to quote Agathe Christie, “there were none!”

Today, Nokia’s global market share is an anemic 3 %.

What happened?  Here, the answer is no mystery.  It was not a lack of position, talent, innovative ideas, or know-how.  Rather, the company failed at implementation.  Instead of rapidly adapting to changing conditions, it banked on its brand name and past success to carry it through.  Vague considerations trumped concrete goals.  Spreadsheets and speeches replaced communication, consensus-building, and commitment.   The moral of the story?  No matter how successful the brand or popular the product, implementation is hard.

Nowhere is this truer than in healthcare.  Change is not only constant but accelerating. Each week, hundreds of research findings are published.  Just as frequently, new technologies come online. All have the potential to do good, to improve the quality and outcome of treatment. PCOMS - Partners for change outcome management system Scott D Miller - SAMHSA - NREPP

Research to date, for example, documents that seeking ongoing, formal feedback from those receiving behavioral health services as much as triples the effectiveness of the care offered, while simultaneously cutting the rate of drop out by 50%, and decreasing the risk of deterioration by 33%.  Enough evidence has amassed to warrant the approach–known as, “Feedback Informed Treatment”– being listed on the National Registry of Evidence-Based Programs and Practices.

Any yet, despite the massive amount of time and resources, agencies and practitioners devote to staying “up-to-date,” most implementation efforts struggle, and far too many fail–according to the available evidence, about 70-95% (a figure equivalent to the number of start-up businesses in the United States that belly up annually).

In their chapter in the new book, Feedback Informed Treatment in Clinical Practice, Randy Moss and Vanessa Mousavizadeh, provide step-by-step instructions, based on the latest research and real-world experience, for creating an organizational culture that supports implementation success.  Recently, I had a chance to talk with Randy about the chpater.  Whether you’ve got the book or not, I think you’ll find the knowledge and experience in the video below, helpful:

Online version of the Fidelity Readiness Index and Fidelity Measure

In the meantime, while on the subject of implementation, here’s a cool, electronic version of a tool you can use to track the progress of your efforts.  It helps identify where you and your organization are in the process as well as identify and set goals in order to remain on track (it’s one of the reasons reviewers at SAMHSA gave our application perfect marks for implementation support).  Thanks to my Danish colleague, Rasmus Kern for developing and making it available.  By the way, the program contains both English and Danish versions (we’ll be releasing more languages soon).

Take the FRIFM Assessment

Until next time,

Scott

Scott D. Miller, Ph.D.
Director, International Center for Clinical Excellence

Filed Under: Feedback Informed Treatment - FIT

More Deliberate Practice Resources…

May 30, 2017 By scottdm 1 Comment

what happenedLast week, I blogged about a free, online resource aimed at helping therapists improve their outcomes via deliberate practice.  As the web-based system was doubling as a randomized controlled trial (RCT), participants would not only be accessing a cutting-edge, evidence-based protocol but also contributing to the field’s growing knowledge in this area.

To say interest was high, doesn’t even come close.  Within 45 minutes of the first social media blast, every available spot was filled–including those on the waiting list!  Lead researchers Daryl Chow and Sharon Lu managed to open a few additional spots, and yet demand still far exceeded supply.

I soon started getting emails.  Their content was strikingly similar–like the one I received from Kathy Hardie-Williams, an MFT from Forest Grove, Oregon, “I’m interested in deliberate practice!  Are there other materials, measures, tools that I can access and start using in my practice?”

The answer is, “YES!”  Here they are:

Cycle of Excellence cover - single

Resource #1.  Written for practicing therapists, supervisors, and supervisees, this volume brings together leading researchers and supervisors to teach practical methods for using deliberate practice to improve the effectiveness of psychotherapy.

Written for practicing therapists, supervisors, and supervisees, this volume brings together leading researchers and supervisors to teach practical methods for using deliberate practice to improve the effectiveness of psychotherapy.

Twelve chapters split into four sections covering: (1) the science of expertise and professional development; (2) practical, evidence-based methods for tracking individual performance; (3) step-by-step applications for integrating deliberate practice into clinical practice and supervision; and (4) recommendations for making psychotherapist expertise development routine and expected.

“This book offers a challenge and a roadmap for addressing a fundamental issue in mental health: How can therapists improve and become experts?  Our goal,” the editors of this new volume state, ” is to bring the science of expertise to the field of mental health.  We do this by proposing a model for using the ‘Cycle of Excellence’ throughout therapists’ careers, from supervised training to independent practice.”

The book is due out June 1st.  Order today by clicking here: The Cycle of Excellence: Using Deliberate Practice to Improve Supervision and Training

Resource #2: The MyOutcomes E-Learning Platform

The folks at MyOutcomes have just added a new module on deliberate practice to their already extensive e-learning platform.  The information is cutting edge, and the production values simply fantastic.  More, MyOutcomes is offering free access to the system for the first 25 people who email to support@myoutcomes.com.  Put the words, “Responding to Scott’s Blogpost” in the subject line.  Meanwhile, here’s a taste of the course:

Resource #3:

proDLast but not least, the FIT Professional Development Intensive.  There simply is no better way to learn about deliberate practice than to attend the upcoming intensive in Chicago.  It’s the only such training available.  Together with my colleague, Tony Rousmaniere–author of the new book, Deliberate Practice for Psychotherapists: A Guide to Improving Clinical Effectiveness, we will help you develop an individualized plan for improving your effectiveness based on the latest scientific evidence on expert performance.

We’ve got a few spaces left.  Those already registered are coming from spots all around globe, so you’ll be in good company.  Click here to register today!

OK, that’s it for now.  Wishing you all the best for the Summer,

Scott D. Miller, Ph.D.

 

Filed Under: Behavioral Health, deliberate practice, evidence-based practice, excellence, Feedback, Feedback Informed Treatment - FIT, Practice Based Evidence

Can you tell me what I’m supposed to do? A free deliberate practice resource

May 17, 2017 By scottdm 4 Comments

what can i doYou’ve read the studies.  Maybe you’ve even attended a training.

Deliberate practice is the key to improving your effectiveness as a psychotherapist.  Top performing therapists devote twice as much time to the process. More, when employed purposefully and mindfully, the outcomes of average practitioners steadily rise over time.

But what exactly is a therapist supposed to practice in order to improve?  It’s a question that comes up within minutes of introducing the subject at my workshops–one my colleagues, Daryl Chow, Sharon Lu, Geoffrey Tan, and I have been working on answering.

Just over three years ago, we published preliminary results of a study documenting the impact of individualized feedback and rehearsal on mastering difficult conversations in psychotherapy. Therapists not only improved their ability to respond empathically under especially challenging circumstances, but were able to generalize what they learned to new and different situations.

How to learn from homeNow, the entire deliberate practice program has gone online.  In light of the research, it’s been both expanded and refined.  There’s no need to leave the comfort of your home or office and, best of all, it’s free.

Sign up to participate and you will learn what to practice as well as receive feedback specifically tailored to your professional development.  You will also be helping the field as the program is part of a research study on deliberate practice.

****UPDATE! UPDATE! UPDATE! UPDATE!****

Response to the above post has been overwhelming!  Despite the size of the study, all of the available spots filled within 45 minutes.  I’ve been corresponding with the chief researcher, Daryl Chow, Ph.D.. He tells me 15 more spots have just been added.  If you want to participate, click here.  The password is: DCT.  If all of the spots are taken, please add your name to the wait list.

One more opportunity: join me in Chicago for the upcoming two-day intensive on deliberate practice. For more information or to register, click on the icon below my name.  As with the online program, we are nearly full, so register today.

Until next time,

Scott

Scott D. Miller, Ph.D.
Director, International Center for Clinical Excellence
proD

Filed Under: deliberate practice, evidence-based practice, excellence, Feedback Informed Treatment - FIT

The Illness and the Cure: Two Free, Evidence-based Resources for What Ails and Can Heal Serious Psychological Distress

April 18, 2017 By scottdm 14 Comments

141030125424-mental-illness-hands-on-head-live-videoFindings from several recent studies are sobering. Depression is now the leading cause of ill-health and disability worldwide–more than cancer, heart disease, respiratory problems, and accidents.  Yesterday, researchers reported that serious psychological distress is at an all-time high, significantly affecting not only quality but actual life expectancy.  And who has not heard about the opioid crisis–33,000 deaths in the U.S. in 2015 and rising?

The research is clear:  psychotherapy helps.  Indeed, its effectiveness is on par with coronary artery bypass surgery.  Despite such results, availability of mental health services in the U.S. and other Westernized nations has seriously eroded over the last decade.   Additionally, modern clinical practice is beset by regulation and paperwork, much of which gets in the way of treatment’s most important healing ingredient: the relationship.

What can practitioners do?Students Taking Notes at Desks by VCU_Brandcenter

Completing paperwork together with clients during the visit–a process termed, “collaborative (or concurrent) documentation”–has been shown to save full-time practitioners between 6 and 8 hours per week, thereby improving capacity up to 20%.

It’s a great idea: completing assessments, treatment plans, and progress notes together with clients during rather than after the session. Unfortunately, it’s chief selling point to date seems to be that it saves time on documentation–as though filling out paperwork is an end in and of itself!  Clearly, the real challenges facing mental health services are getting people into and keeping them in care.   Here, the research literature is clear, people are more likely to stay engaged in care that is: (1) organized around their goals; and (2) works.  Collaborating on and coming to a consensus regarding the goals for treatment, for example, has the largest impact on outcome among all of the relationship factors in psychotherapy, including empathy!  Additionally, when documentation FITs the clients’ view of the process and is deemed transparent and respectful, trust–another essential ingredient of the therapeutic relationship–improves.

For the last several years, practitioners and agencies around the world have been using the ICCE “Service Delivery Agreement” and “Progress Note” as part of their documentation of clinical services.  Both were specifically designed to be completed collaboratively with clients at the time the service is provided and both are focused on documenting what matters to people in treatment.  Most important of all, however, both are part of an evidence-based process documented to improve engagement and effectiveness listed on SAMHSA’s National Registry of Evidence-based Programs and Practices.

For the next short while, I’ll send you the forms for free, along with a detailed instruction booklet for incorporating them into your clinical work.  Reduce the “paper curtain” in your practice.  Just email me at scottdmiller@talkingcure.com.   Better yet, register for our upcoming intensive trainings this summer in Chicago.  Click on any of the course icons to the right for detailed information.

Until next time,

Scott

Scott D. Miller, Ph.D.
Director, International Center for Clinical Excellence
Scott D. Miller - Australian Drug and Alcohol Symposium

Filed Under: Behavioral Health, CDOI, Conferences and Training, excellence, Feedback Informed Treatment - FIT, FIT, Implementation

The Missing Link: Why 80% of People who could benefit will never see a Therapist

March 17, 2017 By scottdm 22 Comments


1077-20170313-045746-miller_opener_300x300
The facts are startling.  Despite being on the scene for close to 150 years, the field of mental health–and psychotherapy in particular–does not, and never has had mass appeal.  Epidemiological studies consistently show, for example, the majority of people who could benefit from seeing a therapist, do not go.  And nowadays, fewer and fewer are turning to psychotherapy—33% less than did 20 years ago—and a staggering 56% either don’t follow through after making contact or drop out after a single visit with a therapist (Guadiano & Miller, 2012; Marshall, Quinn, & Child, 2016; Swift & Greenberg, 2014).

For those on the front line, conventional wisdom holds, the real problems lie outside the profession.  Insurance companies, in the best of circumstances, make access to and payment for psychotherapy an ordeal.  Another common refrain is nowadays people are looking for a quick fix.  Big Pharma has obliged, using their deep pockets to market “progress in a pill.”  No work required beyond opening wide and swallowing.  And finally, beyond instant gratification or corporate greed, many point to social disapproval or stigma as a continuing barrier to people getting the help they need.

For all that, were psychotherapy held in high regard, widely respected as the way to a better life, people would overcome their hesitancy, put up with any inconvenience, and choose it over any alternative.  They don’t.

WHY?  Mountains of research published over the last four decades document the effectiveness of the “talk therapies.”  With truly stunning results, and a minimal side effect profile compared to drugs, why do most never make it into a therapist’s office?

For the last two years, my longtime colleague, Mark Hubble and I, have explored this question.  We reviewed the research, consulted experts, and interviewed scores of potential consumers.

Our conclusion?  The secular constructions, reductionistic explanations, and pedestrian techniques that so characterize modern clinical practice fall flat, failing to offer people the kinds of experiences, depth of meaning, and sense of connection they want in their lives.

In sum, most chotarotose not to go to psychotherapy because they are busy doing something else–consulting psychics, mediums, and other spiritual advisers–forms of healing that are a better fit with their beliefs, that “sing to their souls.”

Actually, reports show more people attend and pay out of pocket for such services than see mental health practitioners!

More, as I noted in my plenary address at the last Evolution of Psychotherapy conference, our own, large-Consumer Reports style survey, found people actually rated psychics and other “spiritual advisers” more helpful than therapists, physicians and friends.  While certain to cause controversy, I strongly suggested the field could learn from and gain by joining the larger community of healers outside of our field.

Below — thanks to the Erickson Foundation — you can see that speech, as well as learn exactly what people felt these alternative healers provided that made a difference.  An even deeper dive is available in our article, “How Psychotherapy Lost its Magic.”  Thanks to the gracious folks at the Psychotherapy Networker for making it available for all to read, regardless of whether they subscribe to the magazine or not.

Until next time,

Scott

Scott D. Miller, Ph.D.
Director, International Center for Clinical Excellence
ICCE - Advanced FIT Intensive 2019Feedback Informed Treatment SupervisionIntensive2019-Scott D Miller

Filed Under: Behavioral Health, Dodo Verdict, evidence-based practice, excellence, Feedback Informed Treatment - FIT, Therapeutic Relationship

Would you rather . . . be approved or improved?

February 5, 2017 By scottdm 6 Comments

Bad-SmellSome time ago, my son had a minor obsession.  Whether at the dinner table, in the car, or out for a walk, he was constantly peppering us with, “would you rather” questions?  You know the ones I mean, where you are forced to choose between two equally bizarre or unpleasant alternatives?

“Would you rather always have to say everything that is on your mind or never be able to speak again?”

“Would you rather have the hiccoughs the rest of your life or always feel like you have to sneeze but not be able to?”

And finally:

“Would you rather smell like poop and not know it or know you smell like poop but others can’t smell it?”

Fast forward to today.  fast-forward-button_318-37183

I was re-reading some recent research on the use of deliberate practice (DP) for improving individual clinician effectiveness.  As I’ve blogged about previously , one of the four crucial components of DP is feedback.  Not just any kind of mind you, but negative feedback–in particular, immediate, ongoing information regarding one’s errors and mistakes.

Put bluntly, receiving negative feedback is hard on the ego.  Despite what we may say or believe, a mountain of literature documents we all possess a strong need for social approval as well as a bias toward attributing positive traits to ourselves.

The same research shows that, beyond selective recall and well-known biases thinking-womanassociated with self-assessment, we actively work to limit information that conflicts with how we prefer to see ourselves (e.g., capable versus incompetent, perceptive versus obtuse, intuitive versus plodding, effective versus ineffective, etc.).

As a brief example of just how insidious ours efforts can be, consider an email sent out by the customer service department at a Honda dealership in Richmond, Virginia.

“As you may know,” it began, “we have a wide range of services performed here at our location and strive to do the best we can to accomodate each and everyone of our customers.”   A request for feedback followed, “There may be times we can not meet the needs and we would appreciate any feedback . . . for our company.”

So far so good.  The company was on the way to showing its customers that it cared.  It had sent a follow-up email.  It thanked its customers.  Most importantly, it invited them to provide the type of feedback necessary for improving service in the future.

The correspondence then ended, telling the recipient they would soon receive a survey which, “If you enjoyed or were satisfied with your recent visit and provide a 100% score you will receive a FREE oil change.”

Amazing, eh?  Thanks to my long-time colleague and friend, Arnold Woodruff, for noticing the irony in the email and passing it on to me.

For whatever reason, on reading it, one of those “would you rather” questions immediately came to my mind:

“Would you rather be approved or improved?”

No waffling now.  There is no in-between.  I can hear my son saying, “you have to choose!”

Why not join me and colleagues from around the world who are “choosing to improve” for our two-day intensive on deliberate practice.  Together with Dr. Tony Rousmaniere–the author of the new book Deliberate Practice for Psychotherapists—you’ll learn the latest, evidence-based strategies for improving your effectiveness.  Register today, by clicking here, or on the image below.

Until next time,

Scott D. Miller, Ph.D.
International Center for Clinical Effectiveness
proD

Filed Under: deliberate practice, excellence, Feedback, Feedback Informed Treatment - FIT

  • « Previous Page
  • 1
  • 2
  • 3
  • 4
  • 5
  • 6
  • …
  • 9
  • Next Page »

SEARCH

Subscribe for updates from my blog.

loader

Email Address*

Name

Upcoming Training

There are no upcoming Events at this time.

FIT Software tools

FIT Software tools

LinkedIn

Topics of Interest:

  • behavioral health (5)
  • Behavioral Health (112)
  • Brain-based Research (2)
  • CDOI (14)
  • Conferences and Training (67)
  • deliberate practice (31)
  • Dodo Verdict (9)
  • Drug and Alcohol (3)
  • evidence-based practice (67)
  • excellence (63)
  • Feedback (40)
  • Feedback Informed Treatment – FIT (246)
  • FIT (29)
  • FIT Software Tools (12)
  • ICCE (26)
  • Implementation (7)
  • medication adherence (3)
  • obesity (1)
  • PCOMS (11)
  • Practice Based Evidence (39)
  • PTSD (4)
  • Suicide (1)
  • supervision (1)
  • Termination (1)
  • Therapeutic Relationship (9)
  • Top Performance (40)

Recent Posts

  • Agape
  • Snippets
  • Results from the first bona fide study of deliberate practice
  • Fasten your seatbelt
  • A not so helpful, helping hand

Recent Comments

  • Dr Martin Russell on Agape
  • hima on Simple, not Easy: Using the ORS and SRS Effectively
  • hima on The Cryptonite of Behavioral Health: Making Mistakes
  • himalaya on Alas, it seems everyone comes from Lake Wobegon
  • himalayan on Do certain people respond better to specific forms of psychotherapy?

Tags

addiction Alliance behavioral health brief therapy Carl Rogers CBT cdoi common factors conferences continuing education denmark evidence based medicine evidence based practice Evolution of Psychotherapy excellence feedback feedback informed treatment healthcare holland icce international center for cliniclal excellence medicine mental health meta-analysis Norway NREPP ors outcome measurement outcome rating scale post traumatic stress practice-based evidence psychology psychometrics psychotherapy psychotherapy networker public behavioral health randomized clinical trial SAMHSA session rating scale srs supershrinks sweden Therapist Effects therapy Training