SCOTT D Miller - For the latest and greatest information on Feedback Informed Treatment

  • About
    • About Scott
    • Publications
  • Training and Consultation
  • Workshop Calendar
  • FIT Measures Licensing
  • FIT Software Tools
  • Online Store
  • Top Performance Blog
  • Contact Scott
scottdmiller@ talkingcure.com +1.773.454.8511

Expertise and Excellence: What it Takes to Improve Therapeutic Effectiveness

April 2, 2009 By scottdm 1 Comment

downloadIf you’ve been following my website and the Top Performance Blog you know that my professional interests over the last couples of years have been shifting, away from psychotherapy, the common factors, and feedback and toward the study of expertise and excellence.

Studying this literature (click here for an interesting summary), makes clear that the factors responsible for superior performance are the same regardless of the specific endeavor one sets out to master. The chief principle will come as no surprise: You have to work harder than everyone else at whatever you want to be best at.

In other words, you have to practice.

Hard work is not enough, however.  Research shows that few attain international status as superior performers without access to high levels of support and detailed instruction from exceptional teachers over sustained periods of time. In the massive “Cambridge Handbook of Expertise and Expert Performance,” Feltovich et al. note, “Research on what enabled some individuals to reach expert performance, rather than mediocre achievement, revealed that expert and elite performers seek out teachers and engage in specifically designed training activities…that provide feedback on performance, as well as opportunities for repetition and gradual refinement” (p. 61).

What makes for a “good” teacher? Well, in essence, that is what the “Top Performance” blog is all about. I’m going on a journey, a quest really.  I’ve decided to take up two hoppies–activities I’ve always had a interest in but never had to the time to study seriously–magic and the ukelele.

Practicing is already proving challenging.  Indeed, the process reminds me a lot of when I started out in the field of psychology.  In a word, its daunting.  There are literally thousands of “tricks” and “songs,” (as there are 100’s of treatment models), millions of how-to books, videos, and other instructional media (just as in the therapy world), as well as experts (who, similar to the field of psychotherapy, offer a wide and bewildering array of different and oftentimes contractory opinions).

By starting completely over with subjects I know nothing about, I hope to put into practice the insights gleaned from our study of expertise and expert performance, along the way reporting the challenges, triumphs and failures associated with learning to master new skills.  I’ll review performances, instructional media (live, printed, DVD, etc), and the teachers I met.  Stay tuned.

Filed Under: Behavioral Health, deliberate practice, excellence, Top Performance Tagged With: Feltovich, ors, outcome rating scale, session rating scale, srs

Superior Performance as a Psychotherapist: First Steps

April 1, 2009 By scottdm Leave a Comment

So what is the first step to improving your performance?  Simply put, knowing your baseline.  Whatever the endeavor, you have to keep score.  All great performers do.  As a result, the performance in most fields has been improving steadily over the last 100 years.

Consider, for instance, the Olympics. Over the last century, the best performance for every event has improved–in some cases by 50%!  The Gold Medal winning time for the marathon in the 1896 Olympics was just one minute faster than the entry time currently required just to participate in the Chicago and Boston marathons.

By contrast, the effectiveness of psychological therapies has not improved a single percentage point over the last 30 years.  How, you may wonder, could that be?  During the same time period: (1) more than 10,000 how-to books on psychotherapy have been published; (2) the number of treatment approaches has mushroomed from 60 to 400; and (3) there are presently 145 officially approved, evidenced-based, manualized treatments for 51 of the 397 possible DSM IV diagnostic groups.  Certainly, given such “growth,” we therapists must be more effective with more people than ever before.  Unfortunately, however, instead of advancing, we’ve stagnated, mistaking our feverish peddling for real progress in the Tour de Therapy.

Truth is, no one has been keeping score, least of all we individual practitioners. True, volumes of research now prove beyond any doubt that psychotherapy works.  Relying on such evidence to substantiate the effectiveness of one’s own work, however, is a bit like Tiger Woods telling you the par for a particular hole rather than how many strokes it took him to sink the ball.  The result on outcome, research indicates, is that effectiveness rates plateau very early in most therapists careers while confidence level continue to grow.

In one study, for example, when clinicians were asked to rate their job performance from A+ to F, fully two-thirds considered themselves A or better. No one, not a single person in the lot, rated him or herself as below average. As researchers Sapyta, Riemer, and Bickman (2005) conclude, “most clinicians believe that they produce patient outcomes that are well above average” (p. 146). In another study, Deirdre Hiatt and George Hargrave used peer and provider ratings, as well as a standardized outcome measure, to assess the success rates of therapists in a sample of mental health professionals. As one would expect, providers were found to vary significantly in their effectiveness. What was disturbing is that the least effective therapists in the sample rated themselves on par with the most effective!

The reason for stagnant success rates in psychotherapy should be clear to all: why try to improve when you already think your the best or, barring that, at least above average?

Here again, expanding our search for excellence beyond the narrow field of psychotherapy to the subject of expertise and expert performance in general can provide some helpful insights. In virtually every profession, from carpentry to policework, medicine to mathematics, average performers overestimate their abilities, confidently assigning themselves to the top tier. Therapists are simply doing what everyone else does. Alas, they are average among the average.

Our own work and research proves that clinicians can break away from the crowd of average achievers by using a couple of simple, valid, and reliable tools for assessing outcome. As hard as it may be to believe, the empirical evidence indicates that performance increases between 65-300% (click here to read the studies). Next time, I’ll review these simple tools as well as a few basic methods for determining exactly how effective you are. Subscribe now so you’ll be the first to know.

One more note, after posting last time, I heard from several readers who had difficulty subscribing. After doing some research, we learned that you must use IE 7 or Firefox 3.0.7 or later for the subscribe function to work properly.  Look forward to hearing from you!

In the meantime, the transcript below is of a recent interview I did for Shrinkrap radio.  It’s focused on our current work:

Supershrinks: An Interview with Scott Miller about What Clinicians can Learn from the Field’s Most Effective Practitioners from Scott Miller

 

Filed Under: Behavioral Health, excellence, Top Performance Tagged With: cdoi, evidence based practice, excellence, mental health, outcome measures, psychology, psychotherapy, srs, supershrinks

My New Year’s Resolution: The Study of Expertise

January 2, 2009 By scottdm Leave a Comment

Most of my career has been spent providing and studying psychotherapy.  Together with my colleagues at the Institute for the Study of Therapeutic Change, I’ve now published 8 books and many, many articles and scholarly papers.  If you are interested you can read more about and even download many of my publications here.

Like most clinicians, I spent the early part of my career focused on how to do therapy.  To me, the process was confusing and the prospect of sitting opposite a real, suffering, client, daunting.  I was determined to understand and be helpful so I went graduate school, read books, and attended literally hundreds of seminars.

Unfortunately, as detailed in my article, Losing Faith, written with Mark Hubble, the “secret” to effective clinical practice always seemed to elude me.  Oh, I had ideas and many of the people I worked with claimed our work together helped.  At the same time, doing the work never seemed as simple or effortless as professional books and training it appear.

Each book and paper I’ve authored and co-authored over the last 20 years has been an attempt to mine the “mystery” of how psychotherapy actually works.  Along the way, my colleagues and I have paradoxically uncovered a great deal about what contributes little or nothing to treatment outcome! Topping the list, of course, are treatment models.  In spite of the current emphasis on “evidence-based” practice, there is no evidence that using particular treatment models for specific diagnostic groups improves outcome.  It’s also hugely expensive!  Other factors that occupy a great deal of professional attention but ultimately make little or no difference include: client age, gender, DSM diagnosis, prior treatment history; additionally, therapist age, gender, years of experience, professional discipline, degree, training, amount of supervision, personal therapy, licensure, or certification.

In short, we spend a great deal of time, effort, and money on matters that matter very little.

For the last 10 years, my work has focused on factors common to all therapeutic approaches. The logic guiding these efforts was simple and straightforward. The proven effectiveness of psychotherapy, combined with the failure to find differences between competing approaches, meant that elements shared by all approaches accounted for the success of therapy. And make no mistake, treatment works. The average person in treatment is better off than 80% of those with similar problems that do not get professional help.

In the Heart and Soul of Change, my colleagues and I, joined by some of the field’s leading researchers, summarized what was known about the effective ingredients shared by all therapeutic approaches. The factors included the therapeutic alliance, placebo/hope/expectancy, structure and techniques in combination with a huge, hairy amount of unexplained “stuff” known as “extratherapeutic factors.”

Our argument, at the time, was that effectiveness could be enhanced by practitioners purposefully working to enhance the contribution of these pantheoretical ingredients.  At a minimum, we believed that working in this manner would help move professional practice beyond the schoolism that had long dominated the field.

Ultimately though, we were coming dangerously close to simply proposing a new model of therapy–this one based on the common factors.  In any event, practitioners following the work treated our suggestions as such.  Instead of say, “confronting dysfunctional thinking,” they understood us to be advocating for a “client-directed” or strength-based approach.  Discussion of particular “strategies” and “skills” for accomplishing these objectives did not lag far behind.  Additionally, while the common factors enjoyed overwhelming empirical support (especially as compared to so-called specific factors), their adoption as a guiding framework was de facto illogical.  Think about it.  If the effectiveness of the various and competing treatment approaches is due to a shared set of common factors, and yet all models work equally well, why would anyone need to learn about the common factors?

Since the publication of the first edition of the Heart and Soul of Change in 1999 I’ve struggled to move beyond this point. I’m excited to report that in the last year our understanding of effective clinical practice has taken a dramatic leap forward.  All hype aside, we discovered the reason why our previous efforts had long failed: our research had been too narrow.  Simply put, we’d been focusing on therapy rather than on expertise and expert performance.  The path to excellence, we have learned, will never be found by limiting explorations to the world of psychotherapy, with its attendant theories, tools, and techniques.  Instead, attention needs to be directed to superior performance, regardless of calling or career.

A significant body of research shows that the strategies used by top performers to achieve superior success are the same across a wide array of fields including chess, medicine, sales, sports, computer programming, teaching, music, and therapy!  Not long ago, we published our initial findings from a study of 1000’s of top performing clinicians in an article titled, “Supershrinks.”  I must say, however, that we have just “scratched the surface.”  Using outcome measures to identify and track top performing clinicians over time is enabling us, for the first time in the history of the profession, to “reverse engineer” expertise.  Instead of assuming that popular trainers (and the methods they promote) are effective, we are studying clinicians that have a proven track record.  The results are provocative and revolutionary, and will be reported first here on the Top Performance Blog!  So, stay tuned.  Indeed, why not subscribe? That way, you’ll be among the first to know.

Filed Under: Behavioral Health, excellence, Top Performance Tagged With: behavioral health, cdoi, DSM, feedback informed treatment, mental health, ors, outcome measurement, psychotherapy, routine outcome measurement, srs, supervision, therapeutic alliance, therapy

  • « Previous Page
  • 1
  • 2
  • 3

SEARCH

Subscribe for updates from my blog.

loader

Email Address*

Name

Upcoming Training

There are no upcoming Events at this time.

FIT Software tools

FIT Software tools

LinkedIn

Topics of Interest:

  • Behavioral Health (112)
  • behavioral health (5)
  • Brain-based Research (2)
  • CDOI (14)
  • Conferences and Training (67)
  • deliberate practice (31)
  • Dodo Verdict (9)
  • Drug and Alcohol (3)
  • evidence-based practice (67)
  • excellence (63)
  • Feedback (40)
  • Feedback Informed Treatment – FIT (246)
  • FIT (29)
  • FIT Software Tools (12)
  • ICCE (26)
  • Implementation (7)
  • medication adherence (3)
  • obesity (1)
  • PCOMS (11)
  • Practice Based Evidence (39)
  • PTSD (4)
  • Suicide (1)
  • supervision (1)
  • Termination (1)
  • Therapeutic Relationship (9)
  • Top Performance (40)

Recent Posts

  • Agape
  • Snippets
  • Results from the first bona fide study of deliberate practice
  • Fasten your seatbelt
  • A not so helpful, helping hand

Recent Comments

  • Bea Lopez on The Cryptonite of Behavioral Health: Making Mistakes
  • Anshuman Rawat on Integrity versus Despair
  • Transparency In Therapy and In Life - Mindfully Alive on How Does Feedback Informed Treatment Work? I’m Not Surprised
  • scottdm on Simple, not Easy: Using the ORS and SRS Effectively
  • arthur goulooze on Simple, not Easy: Using the ORS and SRS Effectively

Tags

addiction Alliance behavioral health brief therapy Carl Rogers CBT cdoi common factors conferences continuing education denmark evidence based medicine evidence based practice Evolution of Psychotherapy excellence feedback feedback informed treatment healthcare holland icce international center for cliniclal excellence medicine mental health meta-analysis Norway NREPP ors outcome measurement outcome rating scale post traumatic stress practice-based evidence psychology psychometrics psychotherapy psychotherapy networker public behavioral health randomized clinical trial SAMHSA session rating scale srs supershrinks sweden Therapist Effects therapy Training