SCOTT D Miller - For the latest and greatest information on Feedback Informed Treatment

  • About
    • About Scott
    • Publications
  • Training and Consultation
  • Workshop Calendar
  • FIT Measures Licensing
  • FIT Software Tools
  • Online Store
  • Top Performance Blog
  • Contact Scott
info@scottdmiller.com 773.404.5130

What is the Real Source of Effectiveness in Smoking Cessation Treatment? New Research on Feedback Informed Treatment

November 24, 2012 By scottdm Leave a Comment

When it rains, it pours!  So much news to relay regarding recent research on Feedback Informed Treatment (FIT).  Just received news this week from ICCE Associate Stephen Michaels that research using the ORS and SRS in smoking cessation treatment is in print!   A few days prior to that, Kelley Quirk sent a copy of our long-awaited article on the validity and reliability of the Group Session Rating Scale.  On that very same day, the editors from the journal Psychotherapy sent proofs of an article written by me, Mark Hubble, Daryl Chow, and Jason Seidel for the 50th anniversary issue of the publication.

Let’s start with the validity and reliability study.  Many clinicians have already downloaded and been using Group Session Rating Scale.  The measure is part of the packet of FIT tools available in 20+ languages on both my personal and the International Center for Clinical Excellence websites.   The article presents the first research on the validity and reliability of the measure.  The data for the study was gathered at two sites I’ve worked with for many years.   Thanks to Kelley Quirk and Jesse Owen for crunching the numbers and writing up the results!   Since the alliance is one of the most robust predictors of outcome, the GSRS provides yet another method for helping therapists obtain feedback from consumers of behavior health services.

Moving on, if there were a Nobel Prize for patience and persistence, it would have to go to Stephen Michaels, the lead author of the study, Assessing Counsellor Effects on Quit Rates and Life Satisfactions Scores at a Tobacco Quitline” (Michael, Seltzer, Miller, and Wampold, 2012).  Over the last four years, Stephen has trained Quitline staff in FIT, implemented the ORS and SRS in Quitline tobacco cessation services, gathered outcome and alliance data on nearly 3,000 Quitline users, completed an in-depth review of the available smoking cessation literature, and finally, organized, analyzed, and written up the results.

What did he find?  Statistically significant differences in quit rates attributable to counselor effects.  In other words, as I’ve been saying for some time, some helpers are more helpful than others–even when the treatment provided is highly manualized and structured.  In short, it’s not the method that matters (including the use of the ORS and SRS), it’s the therapist.

What is responsible for the difference in effectiveness among therapists?  The answer to that question is the subject of the article, “The Outcome of Psychotherapy: Yesterday, Today, and Tomorrow” slated to appear in the 50th anniversary issue of Psychotherapy.  In it, we review controversies surround the question, “What makes therapy work?” and tip findings from another, soon-to-be-published empirical analysis of top performing clinicians.  Stay tuned.

Filed Under: Feedback Informed Treatment - FIT Tagged With: addiction, behavioral health, cdoi, Certified Trainers, evidence based practice, excellence, feedback, healthcare, icce, Smoking cessation, Therapist Effects

Clinical Support Tools for the ORS and SRS

November 20, 2012 By scottdm 1 Comment

I have so much to be grateful for at this time.  Most of all, I’m happy to be home with my family.  As we have in the past, this year we’ll be spending the holiday at the home of our long time friends John and Renee Dalton.  The two always put out a fantastic spread and our son, Michael, is fast friends with their two kids.

I’m also grateful for the International Center for Clinical Excellence (ICCE) community.  Currently, ICCE has over 4200 members located around the world, making the organization the largest, web-based community of professionals, educators, managers, and clinicians dedicated to using feedback to pursue excellence in the delivery of behavioral health services.  Recently, the site was highlighted as one of the best resources for practitioners available on the web.  Articles, how-to videos, and discussion forums are available everyday, all day–and for free!  No come-ons for books or webinars and no “cult of personality”–just sharing among peers.  If you are not a member, you can join at: www.centerforclinicalexcellence.com

A special thanks goes to several ICCE senior advisors and associates, including Susanne Bargmann, Jason Seidel, Cynthia Maeschalck, Bob Bertolino, Bill Plum, Julie Tilsen, and Robbie Babbins-Wagner.  These folks are the backbone of the organization.  Together, they make it work.  Most recently, we all joined together to create the ICCE Feedback Informed Treatment and Training Manuals, a cutting edge series covering every aspect of FIT–from the empirical foundations to implementation–in support of our application to SAMSHA for recognition as an “evidence-based practice.”

As a way of supporting everyone using the ORS and SRS, I wanted to make a couple of clinical support tools available.  If you are using the measures, the first item will need no introduction.  It’s a 10 cm ruler!  Save the file and print it off and you also have a ready reminder of the upcoming Achieving Clinical Excellence conference, coming up in May 2013.  Like last time, this will feature the latest inforamtion about feedback informed practice!  The second item is a reliable change graph.  If you are using the paper and pencil measures, rather than one of the existing web based systems (www.fit-outcomes.com, www.myoutcomes.com), you can use this tool to determine whether a change in scores from session to session is reliable (that is, greater than chance, the passage of time, and measurement error [and therefore, due to the care being provided]) or even clinically significant (that is, both reliable and indicating recovered).  The last item is an impressive summary of various systems for monitoring progress in treatment.

In addition ACE Health have developed openFIT, a plug-in which seamlessly integrates the ORS, SRS and associated algorithms into any existing Electronic Health Record, Case Management System of eMental Health application.

I wish everyone a peaceful and rewarding Thanksgiving holiday.

 

Filed Under: FIT Software Tools Tagged With: behavioral health, cdoi, excellence, feedback, healthcare, icce, mental health, ors, Outcome, practice-based evidence, srs

The War on Unhappiness Heats Up

November 24, 2010 By scottdm Leave a Comment

Back in September, I blogged about an article by Gary Greenberg published in the August issue of Harper‘s magazine that took aim at the “helping profession.”   He cast a critical eye on the history of the field, it’s colorful characters, constantly shifting theoretical landscape, and claims and counterclaims regarding “best practice.”   Several paragraphs were devoted to my own work; specifically, research documenting the relatively inconsequential role that particular treatment approaches play in successful treatment and the importance of using ongoing feedback to inform and improve mental health services.

Just this last week, while I was overseas teaching in Romania (more on that trip soon), I received an email from Dr. Dave of ShrinkRapRadio who felt the piece by Greenberg was unfair to the field in general and a mischaracterization of the work by many of the clinicians cited in the article, including me.  “I’ve got a blog on the Psychology Today website and I’m planning to take him to task a bit,” he wrote.

If you have not had a chance to read the Greenberg article, you can find it on my original blogpost.  It’s a must read, really.  As I said then, whatever your opinion about the present state of practice, “Greenberg’s review of current and historical trends is sobering to say the least–challenging mental health professionals to look in the mirror and question what we really know for certain–and a must read for any practitioner hoping to survive and thrive in the current practice environment.”  Then, take a moment and read Dr. Dave’s response.  With his permission, I’ve posted it below!

  

Popping The Happiness Bubble: The Backlash Against Positive Psychology

Readers will recall that in Part 1, I suggested that a backlash against the ebullience of the positive psychology movement was probably inevitable. The most visible sign of that rebellion was last year’s best-selling book by Barbara Ehrenreich, Bright-Sided: How The Relentless Promotion of Positive Thinking Has Undermined America. While I found myself in agreement with much of her appraisal of American culture and our historical fascination with “positive thinking,” I thought her critique of positive psychology fell short by equating positive psychology to “positive thinking.” It also seemed to me that she failed to recognize that a huge body of research conducted by an army of independent researchers is emerging on a very diverse range of topics, which have been subsumed under the general heading of positive psychology. And, finally, much of her argument was based on an ad hominem attack on Martin Seligman.

I found further evidence of this backlash in the lead article in the October 2010 issue of Harper’s by psychotherapist Gary Greenberg, “The War on Unhappiness: Goodbye Freud, Hello Positive Thinking.” Greenberg is the author of Manufacturing Depression, a book that came out earlier this year. In addition, he is a prolific writer who has published articles that bridge science, politics, and ethics in a number of leading magazines. So he’s got great credentials both as a psychologist and a writer. Yet, I found this particular article unsatisfying. At least, that was my reaction upon first reading. As I later read it a second time to write about it here, I got a clearer sense of what he was up to and found myself in substantial agreement with his overall thrust.

The stimulus for Greenberg’s piece appears to have been his attendance at the annual Evolution of Psychotherapy Conference in Anaheim earlier this year. He seems to take a pretty dyspeptic view of the whole event: “Wandering the conference, I am acquainted, or reacquainted, with Cognitive Behavioral Therapy, Ericksonian Hypnosis, Emotionally Focused Therapy, Focusing, Buddhist Psychology, Therapist Sculpting, Facilitating Gene Expression, and Meditative methods.” A forty-year veteran of the California personal-growth/therapy scene, myself, it’s easy to develop a jaundiced eye over time as a panoply of approaches come and go. Yet, I have to say my own view, as a result of over 300 podcast interviews with psychologists across a broad spectrum of orientations, is there is more of a developing consensus and that the differences between many approaches are relatively minor.

By contrast, Greenberg seems to go into despair.

As I say, it took two readings of Greenberg’s article to really get the overall sweep. On first reading, it seems to be a bit of a meander, beginning with some slighting anecdotes about Freud. Then we’re on to the Anaheim conference and some handwringing about the seeming tower of Babel created by the profusion of therapeutic approaches. This segues into a discussion of Rozenzwig’s 1936 “Dodo Bird Effect” which asserts that therapeutic orientation doesn’t matter because all orientations work. As the Dodo pronounces in Alice in Wonderland, “Everyone has won and all must have prizes.” According to Greenberg, the Dodo Bird Effect has been borne out in subsequent studies and the requisite common ingredient for therapeutic success is faith, both the client’s and the therapist’s.

Greenberg goes on to describe several of the presentations, most notably by Otto Kernberg, Scott D. Miller, David Burns, and Martin Seligman. Part of what put me off about this article on my first reading is that I have conducted in-depth interviews with the first three of these gentlemen and I would not have recognized them from Greenberg’s somewhat muddled account.

Otto Kernberg, MD, one of the grand old men of psychoanalysis, is characterized as intoning “the old mumbo jumbo about the Almost Untreatable Narcissistic Patient…” In my opinion, this really slights his lifetime commitment to research, his many contributions to object relations theory, and his role as Director of The Institute for Personality Disorders at the Cornell Medical Center.  In my interview with Dr. Kernberg, I was struck by the flexibility of this octogenerian to incorporate the findings of neuroscience, genetics, and even cognitive behavioral therapy in this thinking.

Greenberg seems to use Dr. Scott D. Miller’s research as supporting the Dodo Bird effect. I attended a daylong workshop with Scott Miller a few years ago and it was one of the best presentations I’ve ever seen. I also interviewed him for one of my podcasts. The key takeaway for me from Scott Miller’s work is that the Dodo Bird effect shows up only when therapeutic effectiveness is averaged across therapists. That is, on average, all psychotherapies are moderately effective. However, Miller reports that not all therapists are equally effective and that, if you look at therapists who are consistently rated as effective by their clients vs. therapists who are consistently rated as ineffective, then therapy emerges as a highly worthwhile enterprise.

As Miller said in my interview with him, “If the consumer is able to feed back information to the system about their progress, whether or not progress is being made, those two things together can improve outcomes by as much as 65%.”

As I say, I had difficulty recognizing Miller in Greenberg’s account. Evidently, Greenberg is critical of Miller having developed a standardized set of rating scales for clients to provide feedback to their therapists. Greenberg sees these scales as playing into the hands of managed care and the trend towards “manualized” therapies. However, in my interview with Miller, he is very clearly critical of managed care, at least in terms of their emphasis on particular treatments for particular diagnostic categories. As Miller said in his interview with me, “If there were inter-rater reliability that would be one thing; the major problem with the DSM is that is lacks validity, however. That these groupings of symptoms actually mean anything… and that data is completely lacking… We are clustering symptoms together much the way medicine did in the medieval period: this is the way we treated people and thought about people when we talked about them being phlegmatic for example; or the humors that they had. Essentially they were categorizing illnesses based on clusters of symptoms.”

I also had difficulty recognizing Stanford psychiatry professor, David Burns, from Greenberg’s summary of the session he attended with Burns.  In short, Greenberg portrays Burns, who has developed a Therapist’s Toolkit inventory as wishing to replace “open-ended conversation with a five-item test… to take an X-ray of our inner lives.” This runs counter to my experience of Burns who, for example, in my interview with Dr. Burns about his cognitive therapy approach to couples work said, “…cognitive therapy has become probably the most widely practiced and researched form of psychotherapy in the world. But I really don’t consider myself a cognitive therapist or any other school of therapy; I’m in favor of tools, not schools of therapy. I think all the schools of therapy have had important discoveries and important angles, but the problem is they are headed up by gurus who push too hard trying to say cognitive therapy is the answer to everything, or rational emotive therapy is the answer to everything, or psychoanalysis is the answer to everything. And that is reductionism, and kind of foolish thinking to my point of view.” This hardly sounds like someone who thinks he’s invented a paper-and-pencil test that will be the end-all of psychotherapy.

And then Greenberg goes on to skewer positive psychology, which is what drew me to his article in the first place. After all, the title “The War on Unhappiness” seems to promise that. Like Ehrenreich, however, Greenberg’s critique is largely an ad hominem attack on Seligman. For example, referring to his earlier work subjecting dogs to electric shock boxes to study learned helplessness, Greenberg characterizes Seligman as, “More curious about dogs than about the people who tortured them…” He goes on to recount Seligman’s presentation to the CIA on learned helplessness which became the basis for enhanced “interrogation” techniques in Iraq. Now, we are told Seligman is working with the U.S. Army to teach resilience to our troops. In Greenberg’s view, Seligman would have us going his dogs one better by “thriving on the shocks that come our way rather than merely learning to escape them.”

So, it turns out that Greenberg’s attack on positive psychology is rather incidental to his larger concern which turns out to be that clinical psychology has sold its soul to the evidence-based, managed-care lobby in order to feed at the trough of medical reimbursement.

Greenberg’s article is a circular ramble that begins with slighting references to Freud and psychoanalysis and then ends with Freud as the champion of doubt.

It took me two readings to see that Greenberg is essentially using Miller, Burns, and Seligman as foils to attack smug certainty and blind optimism, the enemies of doubt. Of himself, Greenberg concludes, “I’m wondering now why I’ve always put such faith in doubt itself, or, conversely, what it is about certainty that attracts me so much, that I have spent twenty-seven years, thousands of hours, millions of other people’s dollars to repel it.”

Greenberg evidently values the darker side, the questions, the unknown, the mystery. “Even if Freud could not have anticipated the particulars – the therapists-turned-bureaucrats, the gleaming prepackaged stories, the trauma-eating soldiers-he might have deduced that a country dedicated in its infancy to the pursuit of happiness would grow up to make it a compulsion. He might have figured that American ingenuity would soon, maybe within a century, find a way to turn his gloomy appraisal of humanity into a psychology of winners.”

I think I’m in agreement with at least some of Greenberg’s larger argument. My fear, however, is that the general reader will come away with the impression that psychotherapists don’t know what they are doing and that the whole enterprise is a waste of time and money. That would be too bad. Both because I don’t think it’s true and I don’t think Greenberg does either.

I encourage you to find Greenberg’s article and to post your own reactions here in the comments area.

I had planned to stake out my own position on positive psychology in response to the critiques of Ehrenreich and Greenberg. It’s looking like there may need to be a Part 3. Stay tuned!

Filed Under: Practice Based Evidence Tagged With: Barbara Ehrenreich, evidence based practice, gary greenberg, healthcare, Manufacturing Depression, mental health, psychology today

  • « Previous Page
  • 1
  • 2
  • 3
  • 4
  • 5
  • Next Page »

SEARCH

Subscribe for updates from my blog.

  

Upcoming Training

FIT Implementation Intensive 2020
FIT Supervision Intensive 2020
FIT Implementation Intensive 2020 - ICCE

FIT Masters Course 2020
ICCE FIT Deliberate Practice Intensive 2020
ICCE Webinar Series 2019

FIT Software tools

FIT Software tools

NREPP Certified

HTML tutorial

LinkedIn

Topics of Interest:

  • Behavioral Health (108)
  • behavioral health (4)
  • Brain-based Research (2)
  • CDOI (14)
  • Conferences and Training (67)
  • deliberate practice (22)
  • Dodo Verdict (8)
  • Drug and Alcohol (3)
  • evidence-based practice (63)
  • excellence (59)
  • Feedback (35)
  • Feedback Informed Treatment – FIT (174)
  • FIT (20)
  • FIT Software Tools (11)
  • ICCE (25)
  • Implementation (5)
  • medication adherence (3)
  • obesity (1)
  • PCOMS (11)
  • Practice Based Evidence (38)
  • PTSD (4)
  • Suicide (1)
  • Termination (1)
  • Therapeutic Relationship (6)
  • Top Performance (39)

Recent Posts

  • Feedbak Informed Treatment: Game Changer or Another Therapeutic Fad?
  • Can you help me understand this?
  • Some Common Questions (and Answers) about Feedback Informed Treatment
  • Is THAT true? Judging Evidence by How Often its Repeated
  • The Skill that Heals, or Kills…

Recent Comments

  • Brian on Some Common Questions (and Answers) about Feedback Informed Treatment
  • Bert Munger on Some Common Questions (and Answers) about Feedback Informed Treatment
  • Penelope Walk on Some Common Questions (and Answers) about Feedback Informed Treatment
  • Gina Weydahl on It’s Time to Abandon the “Mean” in Psychotherapy Practice and Research
  • Martha Minter on Is THAT true? Judging Evidence by How Often its Repeated

Tags

addiction Alliance behavioral health brief therapy Carl Rogers CBT cdoi common factors conferences continuing education denmark evidence based medicine evidence based practice Evolution of Psychotherapy excellence feedback feedback informed treatment healthcare holland icce international center for cliniclal excellence medicine mental health meta-analysis Norway NREPP ors outcome measurement outcome rating scale post traumatic stress practice-based evidence psychology psychometrics psychotherapy psychotherapy networker public behavioral health randomized clinical trial SAMHSA session rating scale srs supershrinks sweden Therapist Effects therapy Training