SCOTT D Miller - For the latest and greatest information on Feedback Informed Treatment

  • About
    • About Scott
    • Publications
  • Training and Consultation
  • Workshop Calendar
  • FIT Measures Licensing
  • FIT Software Tools
  • Online Store
  • Top Performance Blog
  • Contact Scott
scottdmiller@ talkingcure.com +1.773.454.8511

How NOT to Achieve Clinical Excellence: The Sorry State of Continuing Professional Education

September 30, 2009 By scottdm 5 Comments

Greg Neimeyer, Ph.D., is causing quite a stir in continuing education circles.  What has he done?  In several scholarly publications, he’s reviewed the existing empirical literature and found that continuing professional education in heavioral health is not particularly, well, …educational.  Indeed, in a soon-to-be published piece in the APA journal, Professional Psychology, he notes, “While the majority of studies report high levels of participants’ satisfaction with their CE experiences, little attention has been paid to assessing actual levels of learning, the translation of learning into practice, or the impact of CE on actual professional service delivery outcomes.”   Neimeyer then goes on to cite a scholarly review published in 2002 by Daniels and Walter which pointed out that “a search [of the research literature] revealed no controlled studies of the impact of continuing education in the…behavioral health disciplines” (p. 368).  Said another way, the near ubiguitous mandate that clinicians attend so many hours per year of approved “CE” events in order to further their knowledge and skill base has no empirical support.

Personally, my guess is that any study that might be done on CE in Behavioral Health would show little or no impact on performance anyway.  Why?  Studies in other fields (i.e., medicine, flight training) have long documented that traditional CE activities (i.e., attending conferences, lectures, reading articles) have no demonstrable effect.  So, what does work?  The same research that calls the efficacy of current CE activities into questions provide clear guidance: namely, brief, circumscribed, skill-based training, followed by observed practice, real-time feedback, and performance measurement. Such characteristics are, in fact, part and parcel of expert performance in any field.  And yet, it is virutally non-existent in behavioral health.

Let me give you an example of a CE offering that arrived in my box just this week.  The oversized, multi-color, tri-fold brochure boldly asserts a workshop on CBT featuring the “top evidence-based techniques.”  Momentarily setting aside the absolute lack of evidence in support of such trainings, consider the promised content–and I’m not kidding: clinical applications of cognitive behavior therapy, motivational interviewing, cognitive therapy, mindfulness and acceptance based therapies, and behavior therapy.  As if that were not enough, the outline for the training indicates that participants will learn 52 other bulleted points, including but not limited to: why CBT, integration of skills intro practice, identifying brain-based CBT strategies, the latest research on CBT, the stages of change, open-ended and reflective listening, behavioral activiation, acceptance and commitment, emotional regulation and distrss tolerance skills, the ABC technique to promote rational beliefs, homework assignments that test core beliefs, rescripting techniques for disturbing memories and images…and so on…AND ALL IN A SINGLE 6 HOUR DAY!  You say you have no money? Your agency has suffered budget cuts?  No worries, the ad states in giant print, as the same content is available via CD, web and podcast.

Such an agenda defies not only the evidence but strains credulity to the breaking point.  Could anyone accomplish so much in so little time?  Clinicians deserve and should demand more from the CE events they register for and, in many instances, are mandated to attend in order to maintain licensure and certification.  The International Center for Clinical Excellence web platform will soon be launched.  The mission of the site, as indicated in my blog post of August 25th, is to “support clinical excellence through creating virtual clinical networks, groups and clinical communities where clinicians can be supported in the key behavior changes required for developing clinical excellence.”  Members of the site will use a variety of social networking and collaborative tools to learn skills, obtain real-time feedback, and measure their performance.    Anyway, kudos to Dr. Greg Neimeyer for confronting the ugly truth about CE in behavioral health and saying it out loud!

Filed Under: Behavioral Health, Conferences and Training, evidence-based practice, Feedback, ICCE Tagged With: behavioral health, brief therapy, CBT, CE, CEUs, continuing professional education, icce, meta-analysis, psychology, psychometrics

Top Resources for Top Performers

September 28, 2009 By scottdm 1 Comment

Since the 1960’s, over 10,000 “how-to” book on psychotherapy have been published.  I joke about this fact at my workshops, stating “Any field that needs ten thousand books to describe what it’s doing…surely doesn’t know what its doing!” I continue, pointing out that, “There aren’t 10,000 plus books on ‘human anatomy,’ for example.  There are a handful!  And the content of each is remarkably similar.”  The mere existence of so many, divergent points of view makes it difficult for any practitioner to sort the proverbial “wheat from the chaff.”

Over the last 100 years or so, the field has employed three solutions to deal with the existence of so many competing theories and approaches.  First, ignore the differences and continue with “business as usual”– this, in fact, is the approach thats been used for most of the history of the field.  Second, force a consolidation or reduction by fiat–this, in my opinion, is what is being attempted with much of the current evidence-based practice (“specific treatments for specific disorders”) movement.  And third, and finally, respect the field’s diverse nature and approaches, while attempting to understand the “DNA” common to all–said another way, identify and train clinicians in the factors common to all approaches so that they can tailor their work to their clients.

Let’s face it: option one is no longer viable.  Changes in both policy and funding make clear that ignoring the problem will result in further erosion of clinical autonomy.  For anyone choosing option two–either enthusistically or by inaction–I will blog later this week about developments in the United States and U.K. on the “evidence-based practice” front that I’m sure will give you pause.  Finally, for those interested in movng beyond the rival factions and delivering the best clinical service to clients, I want to recommend two resources.  First, Derek Truscott’s, Becoming an Effective Psychotherapist.  The title says it all.  Whether you are new to the field or an experienced clinician, this book will help you sort through the various and competing psychotherapy approaches and find a style that works for you and the people you work with.  The second volume, is Mick Cooper’s Essential Research Findings in Counselling and Psychotherapy.  What can I say about this book?  It is a gem.  Thorough, yet readable.  Empirical in nature, but clinically relevant.  When I’m out and about teaching around the globe and people ask me what to read in order to understand the empirical literature on psychotherapy, I recommend this book.

OK, enough for now.  Stay tuned for further updates this week. In the meantime, I did manage to find a new technique making the rounds on the workshop circuit.  Click on the video below.

Filed Under: Behavioral Health, Practice Based Evidence Tagged With: common factors, counselling, Derek Truscott, evidence based practice, icce, Mick Cooper, psychotherapy, randomized clinical trial

On the Path of the Supershrinks: An Article by Bill Robinson

September 24, 2009 By scottdm 1 Comment

Not too long ago, my colleagues and I published some preliminary thoughts and findings from our research into “Supershrinks.”

That differences in effectiveness exist between clinicians is neither surprising or new.  Indeed, “therapist effects”–as they are referred to in the research literature–have been documented for decades and rival the contribution of factors long known to influence successful psychotherapy (e.g., the therapeutic alliance, hope and expectancy, etc.).  Personally, I believe that studying these super-effective clinicians will help practitioners improve the outcome of their clinical work.

Aside from research documenting the existence of “supershrinks,” and our own articles on the subject, little additional information exists documenting how superior performing clinicians achieve the results they do.

Enter Bill Robinson, manager, counselor, and a senior supervsor with Relationships Australia based in Mandurah, Western Australia.  I’m also proud to say that Bill is one of a highly select group of clinicians that have completed the necessary training to be designated an ICCE Certified Trainer.

In any event, in the last issue of Psychotherapy in Australia–a treasure of a publication that every clinician dedicated to improving their work should subscribe to–Bill explores the topic of therapist effects, suggesting possible links between effectiveness and clinicians’ abilities to connect with the phenomenological worlds of the people they work with.  Trust me, this peer reviewed article is worth reading.  Don’t forget to post a comment, by the way, once you’ve finished!

Robinson from Scott Miller

 

Filed Under: Top Performance Tagged With: addiction, australia, brief therapy, conferences, ors, outcome rating scale, session rating scale, srs, supershrinks, theraputic alliance

History doesn’t repeat itself,

September 20, 2009 By scottdm 2 Comments

Mark Twain photo portrait.

Image via Wikipedia

“History doesn’t repeat itself,” the celebrated American author, Mark Twain once observed, “but it does rhyme.” No better example of Twain’s wry comment than recurring claims about specifc therapeutic approaches. As any clinician knows, every year witnesses the introduction of new treatment models.  Invariably, the developers and proponents claim superior effectivess of the approach over existing treatments.  In the last decade or so, such claims, and the publication of randomized clinical trials, has enabled some to assume the designation of an “evidence-based practice” or “empirically supported treatment.”  Training, continuing education, funding, and policy changes follow.

Without exception, in a few short years, other research appears showing the once widely heralded “advance” to be no more effective than what existed at the time.  Few notice, however, as professional attention is once again captured by a “newer” and “more improved” treatment model.  Studies conducted by my colleagues and I (downloadable from the “scholarly publications” are of my website), document this pattern with treatments for kids, alcohol abuse and dependence, and PTSD over the last 30 plus years.

As folks who’ve attended my recent workshops know, I’ve been using DBT as an example of approaches that have garnered significant professional attention (and funding) despite a relatively small number of studies (and participants) and no evidence of differential effectiveness.  In any event, the American Journal of Psychiatry will soon publish, “A Randomized Trial of Dialectical Behavior Therapy versus General Psychiatric Management for Borderline Personality Disorder.”

As described by the authors, this study is “the largest clinical trial comparing dialectical behavior therapy and an active high-standard, coherent, and principled approach derived from APA guidelines and delivered by clinicians with expertise in treating borderline personality disorder.”

And what did these researchers find?

“Dialectical behavior therapy was not superior to general psychiatric management with both intent-to-treat and per-protocol analyses; the two were equally effective across a range of outcomes.”  Interested readers can request a copy of the paper from the lead investigator, Shelley McMain at: Shelley_McMain@camh.net.

Below, readers can also find a set of slides summarizing and critiquing the current research on DBT. In reviewing the slides, ask yourself, “how could an approach based on such a limited and narrow sample of clients and no evidence of differential effectives achieved worldwide prominence?”

Of course, the results summarized here do not mean that there is nothing of value in the ideas and skills associated with DBT.  Rather, it suggests that the field, including clinicians, researchers, and policy makers, needs to adopt a different approach when attempting to improve the process and outcome of behavioral health practices.  Rather than continuously searching for the “specific treatment” for a “specific diagnosis,” research showing the general equivalence of competing therapeutic approaches indicates that emphasis needs to be placed on: (1) studying factors shared by all approaches that account for success; and (2) developing methods for helping clinicians identify what works for individual clients. This is, in fact, the mission of the International Center for Clinical Excellence: identifying the empirical evidence most likely to lead to superior outcomes in behavioral health.

Dbt Handouts 2009 from Scott Miller

Filed Under: Behavioral Health, Dodo Verdict, Practice Based Evidence Tagged With: alcohol abuse, Americal Psychological Association, American Journal of Psychiatry, APA, behavioral health, CEU, continuing education, CPD, evidence based medicine, evidence based practice, mental health, psychiatry, PTSD, randomized control trial, Training

International "Achieving Clinical Excellence" Conference

September 12, 2009 By scottdm 3 Comments

Mark your calendars!  The International Center for Clinical Excellence is pleased to announce the “Achieving Clinical Excellence” (ACE) conference to be held at the Westin Hotel in Kansas City, Missouri on October 20-22nd, 2010.

K. Anders Erickson, Ph.D., the editor of The Cambridge Handbook of Expertise and Expert Performance and recognized “expert on experts,” will keynote the event. Through a combination of plenary presentations and intensive workshops, an internationally renowned faculty of researchers and educators, including Scott D. Miller, Ph.D. and John Norcross, Ph.D., will help participants discover the means to achieve excellence in clinical practice, leadership, ethics, and personal care.

Attendees will also meet and learn directly from internationally ranked performers from a variety of professions, including medicine, science, music, entertainment, and sports.  As just one example, the Head Coach of the Olympic, Gold-Medal-winning Women’s volleyball team, Hugh McCutcheon, will present at the conference.  In addition to a pre-conference day on ethics and law, internationally renowned concert pianist David Helfgott, whose heart-warming story was featured in the award winning film Shine, will perform on Thursday evening, October 21st. Join us in Kansas City for three days of science, skill building, and inspiration.

Filed Under: Behavioral Health, Conferences and Training, deliberate practice, excellence Tagged With: behavioral health, CEU, conference, CPD, excellence, healthcare, John Norcross, K. Anders Erickson, Training

Practice-Based Evidence Goes Mainstream

September 5, 2009 By scottdm 3 Comments

welcome-to-the-real-worldFor years, my colleagues and I have been using the phrase “practice-based evidence” to refer to clinicians’ use of real-time feedback to develop, guide, and evaluate behavioral health services. Against a tidal wave of support from professional and regulatory bodies, we argued that the “evidence-based practice”–the notion that certain treatments work best for certain diagnosis–was not supported by the evidence.

Along the way, I published, along with my colleagues, several meta-analytic studies, showing that all therapies worked about equally well (click here to access recent studies children, alcohol abuse and dependence, and post-traumatic stress disorder). The challenge, it seemed to me, was not finding what worked for a particular disorder or diagnosis, but rather what worked for a particular individual–and that required ongoing monitoring and feedback.  In 2006, following years of controversy and wrangling, the American Psychological Association, finally revised the official definition to be consistent with “practice-based evidence.” You can read the definition in the May-June issue of the American Psychologist, volume 61, pages 271-285.

Now, a recent report on the Medscape journal of medicine channel provides further evidence that practice-based evidence is going mainstream. I think you’ll find the commentary interesting as it provides compelling evidence that an alternative to the dominent paradigm currently guiding professional discourse is taking hold.  Watch it here.

Filed Under: Behavioral Health, evidence-based practice, Practice Based Evidence Tagged With: behavioral health, conference, deliberate practice, evidence based medicine, evidence based practice, mental health, Therapist Effects

The Evolution of Psychotherapy: Twenty-Five Years On

September 1, 2009 By scottdm Leave a Comment

In 1985, I was starting my second year as a doctoral student at the University of Utah.  Like thousands of other graduate students, I’d watched the “Gloria” films.  Carl Roger, Albert Ellis, Fritz Perls were all impressive if not confusing given their radically different styles.  I also knew that I would soon have the opportunity to meet each one live and in person.  Thanks to Jeffrey K. Zeig, Ph.D. and the dedicated staff at the Milton H. Erickson Foundation, nearly every well known therapist, guru, and psychotherapy cult-leader would gather for the first mega-conference ever held, the field’s Woodstock: The Evolution of Psychotherapy.

Having zero resources at my disposal, I wrote to Jeff asking if I could volunteer for the event in exchange for the price of admission.  Soon after completing the multiple-page application, I received notice that I had been chosen to work at event.  I was ecstatic.  When December finally came around, I loaded up my old car with food and a sleeping bag and, together with a long time friend Paul Finch, drove from Salt Lake City to Phoenix.   What can I say?  It was alternately inspiring and confusing.  I learned so very much and also felt challenged to make sense of the disparate theories and approaches.

At that time, I had no idea that some twenty years later, I’d receive a call from Jeff Zeig asking me to participate as one of the “State of the Art” faculty for the 2005 Evolution Conference.  Actually, I can remember where I was when my cell phone rang: driving on highway 12 on southwest Michigan toward Indian Lake, where my family has a small cottage.  In any event, I’m looking forward to attending and presenting at the 2009 conference.  I encourage all of the readers of my blog to attend.  Registration information can be found at the conference website: www.evolutionofpsychotherapy.com.  The highlight of the event for me is a debate/discussion I’ll be having with my friend and colleague, Don Meichenbaum, Ph.D. on the subject of “evidence-based practice.”

One more thing.  To get a feel for the event, I included a clip of a panel discussion from the first Evolution conference featuring Carl Rogers.  Not trying to be hyperbolic, but listening to Rogers speak changed my life.  I won’t bore you with the details but the night following his presentation, I had a dream…(more later)…

Filed Under: Behavioral Health, Conferences and Training, Dodo Verdict, evidence-based practice, excellence Tagged With: albert ellis, carl roger, Don Meichenbaum, erickson, evidence based practice, Evolution of Psychotherapy, fritz perl, jejjrey k. zeig, psychotherapy

Excellence in Behavioral Health in Arizona

August 29, 2009 By scottdm 4 Comments

OLYMPUS DIGITAL CAMERA

For those of you are friends with me on Facebook (and if you’re not already, please do as it’s a blast), you know I was teaching at the 41st Annual Southwestern School for Behavioral Health Studies.

First, let me express my appreciation to the Board and Michelle Brown for bringing me to Tucson to present on “Achieving Clinical Excellence.”  If you’ve never attended this particular event, mark your calendar for next year.

This year, the conference theme was “Staying relevant in the 21st Century.”  By the time I took the microphone to speak, 350 dedicated professionals from all around the country were on their fifth and last day of the conference.  What a crowd!  Excited, energized, and dedicated to doing their personal best for consumers of behavioral health services.

I’ve already heard from several folks who were in attendance, relating a personal or clinical story illustrating the principles and practices I talked about during my presentations.  Thanks very much for sharing these stories with me.

Meanwhile, you can find the slides I used yesterday below.  Feel free to download, use, and forward them to interested friends and colleagues.

In parting, I thought I’d relate one of my own experiences of excellence.  It happened two years ago when I was presenting at this same conference. That morning, as I reached into my suitcase to get my clothes, I quickly discovered I’d left my slacks at home!  Like this year, I’d worn shorts, a T-shirt, and flip flops on the plane, so no help there. Panicked, I called my co-presenter, Dr. David Mee-Lee—after all, he is a psychiatrist.  He offered me an extra pair he had. It was a great idea that we both knew would never work since David is about 8” shorter than me.  So I called the front desk.  Now, the venue for the SWS for Behavioral Health is at the beautiful Loews Ventana Canyon Resort.  It’s nestled in the mountains, miles from the city.  Plus it was 7 am. My presentation started in an hour.  No store was open at this hour, not even the resort gift shop.  But that didn’t stop the dedicated staff at Loews.  Within minutes, the manager of the resort shop was at the hotel.  We found some pants and a shirt to match but the pants were 6 inches too long. “Not to worry,” the store manager said, she’d take care of it.  Within minutes someone from the housekeep staff—not a tailor or seamstress, just a kind, dedicated person—was cutting and sewing the hem on the pants.  I made it to the conference hall to present with 5 minutes to spare! I’ve never forgotten their kindness and dedication.

Achieving Clinical Excellence Handouts from Scott Miller

Filed Under: Conferences and Training, deliberate practice, excellence Tagged With: achieving clinical excellence, behavioral health, brief therapy, michelle brown, psychotherapy

The Debate of the Century

August 27, 2009 By scottdm

doubt_diceWhat causes change in psychotherapy?  Specific treatments applied to specific disorders?  Those in the “evidence-based” say so and have had a huge influence on behavioral healthcare policy and reimbursement.  Over the last 10 years, my colleagues and I have written extensively and traveled the world offering a different perspective: by and large, the effectiveness of care is due to a shared group of factors common to all treatment approaches.

In place of “evidence-based” practice, we’ve argued for “practice-based”evidence.  Said another way, what really matters in the debate is whether clients benefit–not the particular treatment approach.  Here on my website, clinicians can download absolutely free measures that can be used to monitor and improve outcome and retention (click Performance Metrics).

bruce-wampold-364px

Anyway, the message is finally getting through.  Recently, uber-statistician and all around good guy Bruce Wampold, Ph.D. debated prominent EBP proponent Steve Hollon.  Following the exchange, a vote was taken.  Bruce won handily: more than 15:1.

Scroll down to “Closing Debate” (Thursday)

Filed Under: Behavioral Health, Practice Based Evidence Tagged With: bruce wampold, cdoi, evidence based medicine, evidence based practice, ors, outcome rating scale, PCOMS, performance metrics, practice-based evidence, psychotherapy, session rating scale, srs, steve hollon

Announcement: Evolving in a new direction

August 25, 2009 By scottdm Leave a Comment

As those of you who have followed my work and blog know, my perspective is evolving.  The direction I’m heading builds on all of the work done to date including the common factors, measurement of outcome and alliance, and feedback.  Crucially, however, it goes one step further; bridging the common and specific factors divide that has long dominated and splintered the field, and identifying the concrete steps that diverse providers can take to improve their effectiveness and the services they offer consumers.

For the past 10 years much of my work has been available through the Institute for the Study of Therapeutic Change (ISTC) and featured on its website.  In line with the evolution in my perspective my work is now increasingly centered on a new organization, the International Center for Clinical Excellence (ICCE), an international consortium of researchers, educators, and clinicians dedicated to understanding and promoting excellence in behavior healthcare.  My colleague Barry Duncan, co-founder of the ISTC, is also developing his work in new directions and we have therefore decided that the time is now right to dissolve our long-term partnership in the ISTC.  I recognise that for many of you, who have followed my work over the years, that this may come as a surprising development and I am hoping that this post and others to follow will provide guidance, reassurance and most importantly continuity.

Central to the mission of the International Center for Clinical Excellence (ICCE) is the creation of a web-based community of clinicians using the latest Web 2.0 technology where participants can learn from and share with each other.  Based on the principles of Clinical Community Social Software (CCSS) it is specifically designed to support clinical excellence through creating virtual clinical networks, groups and clinical communities where clinicians can be supported in the key behavior changes required for developing clinical excellence.  Participants can, using a variety of social networking and collaborative tools, share clinical insights through discussion forums and video posts as well as improve client outcomes through learning the skills of clinical excellence.

We have finished our first round of beta-testing for the site and you can go to the website at: www.centerforclinicalexcellence.com to register to become a member (its free and you’ll be notified the minute the entire site is live)!

For those of you new to the tremendous opportunities for web-based collaborative social software, let me reassure you that the site will permit access and use at whatever level you desire (everything from the familiar email, to online posts and discussions in real time).  It will provide lots of help to learn how to explore the information and resources on offer as well as the support of colleagues in the community.  I am very excited by this opportunity to interact with behavioral health professionals all over the world in this way. Over the next few days, I’ll be posting more information about the ICCE and our first International Conference on Excellence in Behavioral Health on my blog at www.scottdmiller.com.   I encourage you to follow the updates on my blog and post any questions or comments.

Filed Under: Behavioral Health, evidence-based practice, excellence, Feedback Informed Treatment - FIT, ICCE Tagged With: behavioral health, clinical excellence, e-learning, icce, international center for cliniclal excellence, social networking

Expertise and Excellence: What it Takes to Improve Therapeutic Effectiveness

April 2, 2009 By scottdm 1 Comment

downloadIf you’ve been following my website and the Top Performance Blog you know that my professional interests over the last couples of years have been shifting, away from psychotherapy, the common factors, and feedback and toward the study of expertise and excellence.

Studying this literature (click here for an interesting summary), makes clear that the factors responsible for superior performance are the same regardless of the specific endeavor one sets out to master. The chief principle will come as no surprise: You have to work harder than everyone else at whatever you want to be best at.

In other words, you have to practice.

Hard work is not enough, however.  Research shows that few attain international status as superior performers without access to high levels of support and detailed instruction from exceptional teachers over sustained periods of time. In the massive “Cambridge Handbook of Expertise and Expert Performance,” Feltovich et al. note, “Research on what enabled some individuals to reach expert performance, rather than mediocre achievement, revealed that expert and elite performers seek out teachers and engage in specifically designed training activities…that provide feedback on performance, as well as opportunities for repetition and gradual refinement” (p. 61).

What makes for a “good” teacher? Well, in essence, that is what the “Top Performance” blog is all about. I’m going on a journey, a quest really.  I’ve decided to take up two hoppies–activities I’ve always had a interest in but never had to the time to study seriously–magic and the ukelele.

Practicing is already proving challenging.  Indeed, the process reminds me a lot of when I started out in the field of psychology.  In a word, its daunting.  There are literally thousands of “tricks” and “songs,” (as there are 100’s of treatment models), millions of how-to books, videos, and other instructional media (just as in the therapy world), as well as experts (who, similar to the field of psychotherapy, offer a wide and bewildering array of different and oftentimes contractory opinions).

By starting completely over with subjects I know nothing about, I hope to put into practice the insights gleaned from our study of expertise and expert performance, along the way reporting the challenges, triumphs and failures associated with learning to master new skills.  I’ll review performances, instructional media (live, printed, DVD, etc), and the teachers I met.  Stay tuned.

Filed Under: Behavioral Health, deliberate practice, excellence, Top Performance Tagged With: Feltovich, ors, outcome rating scale, session rating scale, srs

Superior Performance as a Psychotherapist: First Steps

April 1, 2009 By scottdm Leave a Comment

So what is the first step to improving your performance?  Simply put, knowing your baseline.  Whatever the endeavor, you have to keep score.  All great performers do.  As a result, the performance in most fields has been improving steadily over the last 100 years.

Consider, for instance, the Olympics. Over the last century, the best performance for every event has improved–in some cases by 50%!  The Gold Medal winning time for the marathon in the 1896 Olympics was just one minute faster than the entry time currently required just to participate in the Chicago and Boston marathons.

By contrast, the effectiveness of psychological therapies has not improved a single percentage point over the last 30 years.  How, you may wonder, could that be?  During the same time period: (1) more than 10,000 how-to books on psychotherapy have been published; (2) the number of treatment approaches has mushroomed from 60 to 400; and (3) there are presently 145 officially approved, evidenced-based, manualized treatments for 51 of the 397 possible DSM IV diagnostic groups.  Certainly, given such “growth,” we therapists must be more effective with more people than ever before.  Unfortunately, however, instead of advancing, we’ve stagnated, mistaking our feverish peddling for real progress in the Tour de Therapy.

Truth is, no one has been keeping score, least of all we individual practitioners. True, volumes of research now prove beyond any doubt that psychotherapy works.  Relying on such evidence to substantiate the effectiveness of one’s own work, however, is a bit like Tiger Woods telling you the par for a particular hole rather than how many strokes it took him to sink the ball.  The result on outcome, research indicates, is that effectiveness rates plateau very early in most therapists careers while confidence level continue to grow.

In one study, for example, when clinicians were asked to rate their job performance from A+ to F, fully two-thirds considered themselves A or better. No one, not a single person in the lot, rated him or herself as below average. As researchers Sapyta, Riemer, and Bickman (2005) conclude, “most clinicians believe that they produce patient outcomes that are well above average” (p. 146). In another study, Deirdre Hiatt and George Hargrave used peer and provider ratings, as well as a standardized outcome measure, to assess the success rates of therapists in a sample of mental health professionals. As one would expect, providers were found to vary significantly in their effectiveness. What was disturbing is that the least effective therapists in the sample rated themselves on par with the most effective!

The reason for stagnant success rates in psychotherapy should be clear to all: why try to improve when you already think your the best or, barring that, at least above average?

Here again, expanding our search for excellence beyond the narrow field of psychotherapy to the subject of expertise and expert performance in general can provide some helpful insights. In virtually every profession, from carpentry to policework, medicine to mathematics, average performers overestimate their abilities, confidently assigning themselves to the top tier. Therapists are simply doing what everyone else does. Alas, they are average among the average.

Our own work and research proves that clinicians can break away from the crowd of average achievers by using a couple of simple, valid, and reliable tools for assessing outcome. As hard as it may be to believe, the empirical evidence indicates that performance increases between 65-300% (click here to read the studies). Next time, I’ll review these simple tools as well as a few basic methods for determining exactly how effective you are. Subscribe now so you’ll be the first to know.

One more note, after posting last time, I heard from several readers who had difficulty subscribing. After doing some research, we learned that you must use IE 7 or Firefox 3.0.7 or later for the subscribe function to work properly.  Look forward to hearing from you!

In the meantime, the transcript below is of a recent interview I did for Shrinkrap radio.  It’s focused on our current work:

Supershrinks: An Interview with Scott Miller about What Clinicians can Learn from the Field’s Most Effective Practitioners from Scott Miller

 

Filed Under: Behavioral Health, excellence, Top Performance Tagged With: cdoi, evidence based practice, excellence, mental health, outcome measures, psychology, psychotherapy, srs, supershrinks

My New Year’s Resolution: The Study of Expertise

January 2, 2009 By scottdm Leave a Comment

Most of my career has been spent providing and studying psychotherapy.  Together with my colleagues at the Institute for the Study of Therapeutic Change, I’ve now published 8 books and many, many articles and scholarly papers.  If you are interested you can read more about and even download many of my publications here.

Like most clinicians, I spent the early part of my career focused on how to do therapy.  To me, the process was confusing and the prospect of sitting opposite a real, suffering, client, daunting.  I was determined to understand and be helpful so I went graduate school, read books, and attended literally hundreds of seminars.

Unfortunately, as detailed in my article, Losing Faith, written with Mark Hubble, the “secret” to effective clinical practice always seemed to elude me.  Oh, I had ideas and many of the people I worked with claimed our work together helped.  At the same time, doing the work never seemed as simple or effortless as professional books and training it appear.

Each book and paper I’ve authored and co-authored over the last 20 years has been an attempt to mine the “mystery” of how psychotherapy actually works.  Along the way, my colleagues and I have paradoxically uncovered a great deal about what contributes little or nothing to treatment outcome! Topping the list, of course, are treatment models.  In spite of the current emphasis on “evidence-based” practice, there is no evidence that using particular treatment models for specific diagnostic groups improves outcome.  It’s also hugely expensive!  Other factors that occupy a great deal of professional attention but ultimately make little or no difference include: client age, gender, DSM diagnosis, prior treatment history; additionally, therapist age, gender, years of experience, professional discipline, degree, training, amount of supervision, personal therapy, licensure, or certification.

In short, we spend a great deal of time, effort, and money on matters that matter very little.

For the last 10 years, my work has focused on factors common to all therapeutic approaches. The logic guiding these efforts was simple and straightforward. The proven effectiveness of psychotherapy, combined with the failure to find differences between competing approaches, meant that elements shared by all approaches accounted for the success of therapy. And make no mistake, treatment works. The average person in treatment is better off than 80% of those with similar problems that do not get professional help.

In the Heart and Soul of Change, my colleagues and I, joined by some of the field’s leading researchers, summarized what was known about the effective ingredients shared by all therapeutic approaches. The factors included the therapeutic alliance, placebo/hope/expectancy, structure and techniques in combination with a huge, hairy amount of unexplained “stuff” known as “extratherapeutic factors.”

Our argument, at the time, was that effectiveness could be enhanced by practitioners purposefully working to enhance the contribution of these pantheoretical ingredients.  At a minimum, we believed that working in this manner would help move professional practice beyond the schoolism that had long dominated the field.

Ultimately though, we were coming dangerously close to simply proposing a new model of therapy–this one based on the common factors.  In any event, practitioners following the work treated our suggestions as such.  Instead of say, “confronting dysfunctional thinking,” they understood us to be advocating for a “client-directed” or strength-based approach.  Discussion of particular “strategies” and “skills” for accomplishing these objectives did not lag far behind.  Additionally, while the common factors enjoyed overwhelming empirical support (especially as compared to so-called specific factors), their adoption as a guiding framework was de facto illogical.  Think about it.  If the effectiveness of the various and competing treatment approaches is due to a shared set of common factors, and yet all models work equally well, why would anyone need to learn about the common factors?

Since the publication of the first edition of the Heart and Soul of Change in 1999 I’ve struggled to move beyond this point. I’m excited to report that in the last year our understanding of effective clinical practice has taken a dramatic leap forward.  All hype aside, we discovered the reason why our previous efforts had long failed: our research had been too narrow.  Simply put, we’d been focusing on therapy rather than on expertise and expert performance.  The path to excellence, we have learned, will never be found by limiting explorations to the world of psychotherapy, with its attendant theories, tools, and techniques.  Instead, attention needs to be directed to superior performance, regardless of calling or career.

A significant body of research shows that the strategies used by top performers to achieve superior success are the same across a wide array of fields including chess, medicine, sales, sports, computer programming, teaching, music, and therapy!  Not long ago, we published our initial findings from a study of 1000’s of top performing clinicians in an article titled, “Supershrinks.”  I must say, however, that we have just “scratched the surface.”  Using outcome measures to identify and track top performing clinicians over time is enabling us, for the first time in the history of the profession, to “reverse engineer” expertise.  Instead of assuming that popular trainers (and the methods they promote) are effective, we are studying clinicians that have a proven track record.  The results are provocative and revolutionary, and will be reported first here on the Top Performance Blog!  So, stay tuned.  Indeed, why not subscribe? That way, you’ll be among the first to know.

Filed Under: Behavioral Health, excellence, Top Performance Tagged With: behavioral health, cdoi, DSM, feedback informed treatment, mental health, ors, outcome measurement, psychotherapy, routine outcome measurement, srs, supervision, therapeutic alliance, therapy

  • « Previous Page
  • 1
  • …
  • 10
  • 11
  • 12

SEARCH

Subscribe for updates from my blog.

loader

Email Address*

Name

Upcoming Training

There are no upcoming Events at this time.

FIT Software tools

FIT Software tools

LinkedIn

Topics of Interest:

  • Behavioral Health (112)
  • behavioral health (5)
  • Brain-based Research (2)
  • CDOI (14)
  • Conferences and Training (67)
  • deliberate practice (31)
  • Dodo Verdict (9)
  • Drug and Alcohol (3)
  • evidence-based practice (67)
  • excellence (63)
  • Feedback (40)
  • Feedback Informed Treatment – FIT (246)
  • FIT (29)
  • FIT Software Tools (12)
  • ICCE (26)
  • Implementation (7)
  • medication adherence (3)
  • obesity (1)
  • PCOMS (11)
  • Practice Based Evidence (39)
  • PTSD (4)
  • Suicide (1)
  • supervision (1)
  • Termination (1)
  • Therapeutic Relationship (9)
  • Top Performance (40)

Recent Posts

  • Agape
  • Snippets
  • Results from the first bona fide study of deliberate practice
  • Fasten your seatbelt
  • A not so helpful, helping hand

Recent Comments

  • Bea Lopez on The Cryptonite of Behavioral Health: Making Mistakes
  • Anshuman Rawat on Integrity versus Despair
  • Transparency In Therapy and In Life - Mindfully Alive on How Does Feedback Informed Treatment Work? I’m Not Surprised
  • scottdm on Simple, not Easy: Using the ORS and SRS Effectively
  • arthur goulooze on Simple, not Easy: Using the ORS and SRS Effectively

Tags

addiction Alliance behavioral health brief therapy Carl Rogers CBT cdoi common factors conferences continuing education denmark evidence based medicine evidence based practice Evolution of Psychotherapy excellence feedback feedback informed treatment healthcare holland icce international center for cliniclal excellence medicine mental health meta-analysis Norway NREPP ors outcome measurement outcome rating scale post traumatic stress practice-based evidence psychology psychometrics psychotherapy psychotherapy networker public behavioral health randomized clinical trial SAMHSA session rating scale srs supershrinks sweden Therapist Effects therapy Training