SCOTT D Miller - For the latest and greatest information on Feedback Informed Treatment

  • About
    • About Scott
    • Publications
  • Training and Consultation
  • Workshop Calendar
  • FIT Measures Licensing
  • FIT Software Tools
  • Online Store
  • Top Performance Blog
  • Contact Scott
scottdmiller@ talkingcure.com +1.773.454.8511

Achieving Clinical Excellence Conference 2013: CALL FOR PAPERS

September 20, 2011 By scottdm Leave a Comment

Horsholm, Denmark

Spent the weekend with the planning committe for the 2013 Achieving Clinical Excellence Conference.  Committee members came in from all over the world–the USA, Romania, Holland, the UK, and Denmark–to finalize speakers, the conference venue, and mock up the logo for the conference brochure and advertizing.  Like last time, we are not only bringing in the top researchers to present the latest scientific findings, but also superior performers from a variety of vocations to inspire all of us to achieve our personal best.

Despite all the effort, a significant part of the program remains incomplete.  That part involves YOU!  The conference committee is issuing a formal “call for papers”on expertise and expert performance in the field of behavioral health.  In keeping with the theme of the conference–“Putting the Pieces Together: The Fragile Balance”–the committe is looking for presentations on:

  • Innovative strategies for improving the quality and outcome of behavioral health;
  • Research and experiences of using routine monitoring of progress and the alliance to improve retention and outcome of treatment services;
  • Principles, practices, and experiences regarding maintaining balance between professional and personal life in the achievement of clinical excellence;
  • Implementation of strategies for improving performance in agencies and systems of care
  • How professional development can improve performance of behavioral health professionals;
  • Management and leadership practices associated with superior performance in behavioral health;

Any and all papers may be submitted directly to: info@scottdmiller.com.  The conference website is also available for earlybird registration.

There are so many other developments that I hope to blog in detail about in the coming days.  In the meantime, here’s a short summary of what’s in store:

Filed Under: Conferences and Training, excellence Tagged With: holland, icce, magic

The ICCE Feedback-Informed Treatment Manuals

September 12, 2011 By scottdm 3 Comments

September 12, 2011
Copenhagen, Denmark

Fall is in the air.  For me, that means the start of the travel season.  For the next two weeks, I’ll be traveling throughout Scandanavia–this week in Denmark and Norway.  It’s great to be back on the road meeting clinicians and consulting with agencies about feedback-informed treatment (FIT).

On this trip, I’m finally able to announce the publication of the Feedback-Informed Treatment Manuals.  Over the summer, senior associates of the International Center for Clinical Excellence, together with the talented artists and graphic designers at The Change Companies, worked hard to complete the series.

The six manuals cover every aspect of feedback-informed practice including: empirical foundations, basic and advanced applications (including FIT in groups, couples, and with special populations), supervision, data analysis, and agency implementation.  Each manual is written in clear, step-by-step, non-technical language, and is specifically designed to help practitioners and agencies integrate FIT into routine clinical practice.   Indeed, the manuals were submitted as part of ICCE’s application for consideration of FIT as an “evidence-based practice” to the National Registry of Evidence-Based Programs and Practices.  The manuals may be purchased separately or as a series in the bookstore.

While on the subject of registries, mention should be made that over the summer the American Psychological Association  contacted me about listing the Outcome and Session Rating Scales in their official database of outcome tools for clinical practice (click here to see the listing).  Taken together, the manuals, NREPP application, listing, and growing body of research evidence provide a compelling case for feedback-informed work.

Filed Under: Behavioral Health, Feedback Informed Treatment - FIT Tagged With: denmark, evidence based practice, icce, Norway

Is Psychotherapy Dead?

August 26, 2011 By scottdm 1 Comment


“AMERICANS PREFER DRUGS” screams the headline posted by the Reuters news service and attributed to Consumer Reports–one of the most respected periodical for the average American reader.  “NEARLY 80 PERCENT TAKE A PILL FOR DEPRESSION,” the article continues.  Read a little further and do some searching around on the internet and a different story emerges.  Americans it turns out don’t necessarily prefer drugs but rather, “78 percent of those seeking treatment for depression or anxiety were prescribed antidepressants.”

With respected news agencies advertizing for the pharaceutical companies, is it any wonder why the practice of “talk therapy” is suffering?  AA’s Executive Director for Professional Practice, Dr. Kaherine Nordal, in a recent editorial asked, “Where has all the psychotherapy gone?”  The percentage of Americans who receive outpatinet mental health care has remained unchanged over the last several decades.  Moreover, as Dr. Mark Hubble and I point out in the lead article in the May-June issue of the Psychotherapy Networker, “median incomes for psychologists, both applied and academic, have dropped between 17 and 33 percent at the same time that workloads have increaed, profssional autonomy has been subverted, and funding for public behavioral healthcare has all but disappeared.”

In a recent, highly publicized exchange on psychotherapy that appeared on Medscape: Psychiatry and Health, panel participants (all psychiatrists) repeated the same, old, tired argument about the field.  To wit, “the research base is insufficient.”   How such statements can be made with a straight face, much less by mental health professionals, on a public website, defies explanation.   The truth is, the evidence-base for psychological treatments is as large and robust as any.  What’s more, seeing a talk therapist does not require invasive surgery or a black box warning.  Clearly, the issue is not research.  It is about awareness.

The members and associates of the International Center for Clinical Excellence (ICCE) are working diligently to raise consciousness among the public and policy makers.  Every day, 1000’s of professionals connect to, learn from, and share with colleagues around the world.  The mission of the organization?  To use community to improve the quality and outcome of behavioral health services.  On the ICCE web-based community, clinicians share experiences and real world data regarding the effectiveness of talk therapy.  For example, ICCE associate Dan Buccino shared outcomes from a 7 year project aimed at “promoting recovery and accountability.”  Using the Outcome and Session Ratings Scales, Dan documented effectiveness levels that far exceeded national benchmarks for clinical practice.  Why not email him for a copy of the report?  Meanwhile, providers serving US Airforce personnel began using the same measures in early 2010 and have reported very similar findings.  Finally, to date, more than a dozen randomized clinical trials, involving thousands of clients and numerous therapists, have established that using feedback to inform services increases effectiveness of individual practitioners three fold, cuts dropout rates by 50 percent, reduces the rate of deterioration by 33 percent, and speeds recovery by 66 percent, while simultaensouly improving client satisfaction and reducing the cost of care.

To paraphrase Mark Twain, the rumored death of psychotherapy has been greatly exaggerated.  Now is not the time, however, to merely hope for a better future.  Join the discussion taking place on ICCE  right now.  Membership is free and a strong, supportive community just a few clicks away.

Filed Under: Behavioral Health, Top Performance Tagged With: brief therapy, icce, psychotherapy networker, public behavioral health, randomized clinical trial

Becoming FIT: The 2011 Training of Trainers

August 10, 2011 By scottdm 1 Comment

August 10th, 2011

Chicago, IL

The first week of August was one of the hottest weeks on record in Chicago.  It was also the location of the hottest training on “feedback-informed treatment” (FIT)–the 5th Annual “Training of Trainers” weeklong intensive training.  We worked intensively over 5 days preparing an international group of administrators, supervisors, researchers, and clinicians to train others in the principles and practices of FIT.  We also played hard: dinners, music, magic, and more.  Here’s what attendee’s said about this years event:

Be sure and join us for the 4-day “Advanced Intensive” scheduled in March.  More information can be found at: scottdmiller.com.

 

Filed Under: Conferences and Training, Feedback Informed Treatment - FIT, PCOMS Tagged With: cdoi, evidence based practice, icce

How Much More Evidence Is Needed? A New Meta-Analysis on Feedback-Informed Treatment

June 9, 2011 By scottdm 1 Comment

Received an email from friend and colleague John Norcross, Ph.D.  Attached were the results of a meta-analysis completed by Michael Lambert and Kenichi Shimokawa on Feedback-Informed Treatment (FIT) which will appear in the second edition of his book, Psychotherapy Relationships that Work (Oxford University Press).  For those who cannot wait, you can access the same results in the lastest issue of the APA journal Psychotherapy (Volume 48, Number 1, March 2011, pages 72-79).

Briefly, the chapter begins with a review of the literature on feedback–a body of evidence that, by the way, dates back to 1930’s and has always shown small to moderate effects on the outcome of treatment.  In reviewing studies specific to the ORS and SRS, the authors conclude, “”>the results indicated that those in the feedback group ha[ve] 3.5 times higher odds of experiencing reliable change while having less than half the odds of experiencing deterioration.”  Additionally, Lambert and Shimokawa report few if any meaningful differences between therapies informed by the ORS and SRS and those using the well-established and widely used Outcome Questionnaire (OQ).   Finally, and importantly, the authors note that in “busy practices…the brevity of the [ORS and SRS]…expedite and ease practical difficulties” thereby decreasing barriers to implementation.

How much more evidence will it take before feedback informed treatment becomes standard practice?  All of the available data is summarized in the materials below.

Measures and Feedback January 2011

View more documents from Scott Miller

Be sure and join other clinicians and researchers who are discussing FIT at the International Center for Clinical Excellence–the largest, free, web-based community dedicated to improving the quality and outcome of behavioral health.

Finally, if you are in thinking about or in the process of becoming FIT in your agency or practice, please join us at the upcoming “Training of Trainers” workshop held the first week of August.  Registration is limited to 35 participants and we have only a few spots left!  Here’s what attendees from last year had to say about the event…

Filed Under: Behavioral Health, Feedback Informed Treatment - FIT Tagged With: cdoi, evidence based practice, icce, ors, outcome rating scale, session rating scale, srs

The World Did Not End: What it a Bad Thing?

May 25, 2011 By scottdm Leave a Comment

May 25th, 2011

Chicago, Illinois

On Saturday the 21st of May, 2011 the world was supposed to come to an end.  It did not.  My question: was that a bad thing?  Would it have been better if, as the now twice wrong Prophet Harold Camping predicted, the world had ended.

In the world of public behavioral health, the answer is perhaps. Since the crash of the United States economy in 2008, funding for public behavioral health has been on the chopping block.  It’s not the “end of world in one fell swoop.”  Rather, its more like slowly having the life strangled out of you.  And unlike teachers and prison guards, public behavioral health doesn’t have a strong and vocal lobby.

“It’s sad,” says the director of one agency in the midwest, “I come to work every day feeling weighed down.  We are going to experience very close to another one mission dollar cut, that is, on topic of the same cut last year.”

Agencies are doing everything they can to continue to provide effective treatment in the current environment.  Here’s what the staff and management in Marion-Crawford county, Ohio have done:

As Bob and Shirley make clear, routinely monitoring outcome and alliance and using the information to inform service delivery is a key to survival in these challenging economic times.

At ICCE, we are working with hundreds of agencies around the US and abroad to improve quality, effectiveness, and efficiency.  Soon, we’ll be gathering in Chicago for our annual “Training of Trainers” event.  The hands-on, intensive training is the first step to acquiring the skills necessary for navigatng the troubled waters ahead.  Here’s what attendee’s from last year said about the event:

Read more about the event or register online by clicking here.

Filed Under: Conferences and Training Tagged With: behavioral health, brief therapy, holland, icce

Why is this man laughing?

May 4, 2011 By scottdm 3 Comments

May 4th, 2011
Copenhagen, Denmark

Just finished my first day of a two week trip covering spots in Denmark and Holland.  Yesterday, I traveled to Copenhagen from Hilo, Hawaii where I was presenting for the Hawaiian Association of Marriage and Family Therapy.  Dr. Gay Barflied (pictured on the far left above) spent years lobbying to bring me to the “Big Island” for the conference, where I spoke about the latest research on expertise and excellence in the field of behavioral health.  I met so many dedicated and talented clinicians in Hilo, including marriage and family therapist, Makela Bruno-Kidani (pictured in the middle photo above) who started the day off with a traditional Hawaiian chant and then presented me with two beautiful lei to wear during the event.

On a break, Gay mentioned an article that appeared in the May/June 1995 issue of AHP Perspective.  In it, she said, Maureen O’Hara, president of the Association for Humanistic Psychology, quoted one of the first articles me and my colleagues wrote on the common factors, “No More Bells and Whistles” (I’ll upload a copy to the “publications and handouts” section of the website as soon as I’m back in the States).  Carl Rogers, she said, would have been laughing (happily, that is) had he read the findings we cited documented the lack of differential efficacy of competing treatment approaches.  We had, in essence, proved him right!

“It turns out,” OHara wrote, “that Miller, Hubble, and Duncan come to similar conclusions.  Carl Rogers was right.  After all our forays into the dizzing arcana of paradoxical interventions, inner children, narrative therapy, EMDR, behaviorism, psychopharmacology, bioenergetics, TA, Jungian analysis, psychodrama, Gestalt, and so on down the entire list of hundred brand named therapies, what actually creates change is the…creation of a relationship between client and therapist…”.

I’d never seen the article before.  It brought back very positive memories about the journey that has led most recently to the study of excellence.  Indeed, as we point out in the lead article in the upcoming May/June 2011 issue of the Psychotherapy Networker, relationships are not only the “sine qua non” of healing for clients but are responsible for the professional growth for therapists.

Filed Under: Behavioral Health, evidence-based practice, Feedback Informed Treatment - FIT Tagged With: Carl Rogers, Children, denmark, holland, icce, mark hubble, Outcome, psychology, psychotherapy networker

The Growing Evidence Base for Feedback-Informed Treatment (FIT)

January 25, 2011 By scottdm Leave a Comment

Dateline: February 2, 2011
Location: Anchorage, AK
Greetings from Anchorage, Alaska where I’ve been traveling and teaching about feedback-informed treatment (FIT).  On Monday, I worked with dedicated behavioral health professionals living and working in Barrow–the northern most point in the United States.  FIT has literally reached the “top of the world.”  How incredible is that?

Here I am pictured in front of a sign which locals told me would prove I’d made the long journey to the village of 5,000.  I look forward to returning soon to help the group with the “nuts and bolts” of implementing FIT across various behavioral health services–practitoners were keen to get started.

As I’ve crisscrossed the state, I’ve been proud to share the growing evidence-base for feedback informed work.  Below, the data is summarized in a free, downloadable PDF file, “Measures and Feedback,” which has been updated to include the latest research using the ORS and SRS to improve the quality and outcome of treatment.  If you accessed this file back in 2010, be sure to get this updated version.

Measures and feedback 2016 from Scott Miller

Filed Under: Feedback Informed Treatment - FIT Tagged With: cdoi, evidence based practice, icce

Getting FIT: The Advanced Intensive Training

January 19, 2011 By scottdm Leave a Comment

Dateline: January 19, 2011
Buffalo, New York

The New Year is here and travel/training season is in full swing.  Last week, I was in Ohio and Virginia.  This week New York and Idaho (keep your weather fingers crossed, it’s going to be dicey getting from here to there and home again).

Interest in “Feedback Informed Treatment” continues to grow.  Agencies across the United States and abroad–as my travel schedule attests–are implementing the ORS and SRS in routine clinical practice.  Clinicians are finding the support they need on the International Center for Clinical Excellence web-based community.  As I blogged about a while back, the ICCE is the largest and most diverse group of practitioners working to improve the quality and outcome of behavioral health services.  Many will soon be joining me in Chicago for the 2011 “Advanced Intensive” training.  Once again, clinicians from all over the world will be in attendance–Sweden, Holland, England, Australia and so on.  Interest is high as participants receive a thorough, state-of-the-art grounding in the principles and practice of FIT.  I look forward to meeting everyone soon.

Last summer, I videoblogged about the event.  Ah, summer!   With everything my co-teacher, psychologist Susanne Bargmann, and I have planned, we promise a warm and rewarding event.

Filed Under: Behavioral Health, Conferences and Training, Feedback Informed Treatment - FIT Tagged With: feedback informed treatment, icce, ors, outcome rating scale, session rating scale, srs, Training

Getting FIT in the New Year: The Latest Evidence

January 18, 2011 By scottdm Leave a Comment

 John Norcross, Ph.D.  is without a doubt the researcher that has done the most to highlight the evidence-base supporting the importance of the relationship between clinician and consumer in successful behavioral healthcare.   The second edition of his book, Psychotherapy Relationships that Work, is about to be released. Like the last edition, this volume is a virtual treasure trove of research findings and empirically supported practices.

Among the many gems in the book is a chapter by Michael J. Lambert, Ph.D–pioneering researcher on “feedback-informed treatment” (FIT).  As usual, he does a masterful job summarizing the existing research on the subject. The data are overwhelmingly positive: seeking and using standardized feedback regarding the progress and outcome of treatment cuts drop out and deterioration rates and significantly improves outcome.

Lambert also reports the results of two meta-analyses. One performed on studies using his own OQ System family of measures, the other based on research using the ORS and SRS. Not only did he find ample empirical support for the two systems, but in the case of the ORS and SRS those therapies informed by feedback, “had 3.5 times higher odds of experiencing reliable change.”  Additionally, and importantly, the brief, 4-item ORS and SRS scales performed the same as the longer and more detailed OQ 45.2.

What can you do? First, order John’s book. Second, if you are not FIT, now is the time to register to use the measures.  And if you need support, why not join the International Center for Clinical Excellence? Like the measures, there is no cost. Right now, professionals from different disciplines, working in diverse settings are connecting with and learning from each other. Here’s a nudge: you’ll be able to reach John Norcross there—he’s one of ICCE’s newest members.

Filed Under: Behavioral Health, CDOI, Feedback, PCOMS Tagged With: cdoi, continuing education, icce, randomized clinical trial

Becoming FIT: Simple but not Easy

November 29, 2010 By scottdm Leave a Comment

Becoming FIT (feedback informed in treatment).  Ask any experienced practitioner and they will tell you, “it’s such a simple idea, but it’s not easy.”  In addition to the time it takes to master the administration and interpretation of formal feedback, special skills are required for using the information to guide service delivery.

Implementation in agencies and large healthcare settings is even more challenging.  “What,” you may wonder, “is so difficult?”  All that appears to be involved is the administration of two simple scales: a 4-item outcome and a 4-item alliance measure.  Would that the process were as easy as the forms are simple.

On the International Center for Clinical Excellence community, an international group of supervisors, agency directors, and officers of large healthcare organizations meet routinely to discuss, plan, and help support one another in efforts to develop a feedback-friendly workplace culture.  Ask any and they will tell you that a key element of successful implementation is: communication.  It is also one of the biggest challenges.  Rising case loads, increased documentation requirements, and tight budgets all conspire to keep people chained to their desks, interacting with their desktop computer, and straining just to keep up with the work load.  The proverbial “water-cooler” conversations are, for many, a thing of the past–along with clinical supervision and “advanced training.”

Here’s where ICCE is helping.   The peer-to-peer, web-based community is available to clinicians, managers, researchers, and policy makers 24/7/365.  Signing up is simple and free–and you simply won’t believe the resources available.  Access to an experienced group of professionals ready, willing, and able to answer questions related to FIT.  Discussion groups on everything from using FIT in supervision to the latest research on evidence-based practice.  Training videos, research papers, policy statements, and other documents uploaded by ICCE certified trainers and associates.

In the video below, psychologist and ICCE community manager, Susanne Bargmann describes the community and available resources.  As I blogged about recently, the community is growing at a rapid rate.  We will soon hit 2000 members–and all in less than one year.  So….join us.  And if you are already a member, log onto the site now.  One cool new feature is live chat!  That right.  When you log on, look down in the left hand corner of your screen.  There you’ll be able to see everyone who is “live” on the site at that moment.  With a simple click of the button, you could be chatting with a professional in Washington or Wollongong!

Join us for the upcoming “Advanced Intensive” training in Chicago!  If you are looking for in-depth training in the “how-to” of CDOI/FIT, this is the training for you.  When you leave, you will be on your way to mastering:

  • The empirical foundations of feedback-informed clinical work (i.e., empirically supported factors underlying successful clinical work, the impact of feedback on performance)
  • Clinical skills for enhancing client engagement that cut across different therapeutic orientations and diverse treatment populations
  • How to integrate outcome management tools (including one or more of the following: ORS, SRS, CORE, and OQ 45) into clinical practice
  • How to use the outcome management tools to inform and improve service delivery
  • How to significantly improve your clinical skills and outcomes via feedback and deliberate practice
  • How to use data generated from outcome measures to inform management, supervision, and training decisions
  • Strategies for successful implementation of CDOI and FIT in your organization or practice

Registration is strictly limited to 35 participants.  To reserve your place, click on the icon below!

Filed Under: ICCE Tagged With: conferences, icce, Training

Feedback informed treatment (FIT) takes center stage in Sweden

November 23, 2010 By scottdm Leave a Comment

Just sweden-mapa short entry to highlight recent developments in Sweden…

On November 17th and 18th, over 500 politicians, agency directors, and service managers gathered together to discuss “the future of alcohol and drug treatment” in Sweden.  High on the agenda?  Feedback Informed Treatment!

Psychologist and ICCE Associate, Gun-Eva Langdahl and the rest of the talented crew at Radgivingen Oden, were featured in a video documenting the impact of feedback on retention and outcome of drug and alcohol treatment services.

You may recall, last spring I was on my way to visit this talented group of practitioners when the volcano in Iceland erupted, forcing me to take a long and complicated series of “trains, buses, and automobiles” to get to the beautiful, northern Swedish town of Skelleftea.

Anyway, thanks to the work of the team, the town and surrounding area are something of a hotbed of feedback informed treatment.  For those practitioners, policy makers, and agency directors living and working in Scandinavia, the professionally produced video provides an excellent introduction to the process and benefits of feedback informed work.  You can also read about the work in a feature article that appeared in the daily newspaper, Folkbladet.

In the meantime, take a look at these videos where Gun-Eva Langdahl explains both why clinicians should begin seeking feedback from their clients as well as how to get started.

Filed Under: Feedback Informed Treatment - FIT Tagged With: addiction, icce, sweden

Growing by Leaps and Bounds: ICCE Membership Nearing 2000!

November 9, 2010 By scottdm Leave a Comment

In December 2009, the International Center for Clinical Excellence was officially launched.  From our booth at the Evolution of Psychotherapy conference, the international web-based community “went live,” adding hundreds of members in a few days.  By April, as I reported in my blog, over 1000 clinicians, researchers, policy makers, and adminsitrators had joined the site, making it the largest organization in the world dedicated to improving the quality and outcome of behavioral healthcare.  And now, just shy of a year, the ICCE community is fast approaching 2000 members!

Unlike traditional list-serves dependent on email, limited to a single topic, and often hobbled by irrelevant chatter between participants, the ICCE community uses the latest web 2.0 technology to connect behavioral health practitioners from around the globe.  On the site, clinicians can start a discussion group, upload documents, view videos by the field’s most effective practitioners, and seek counsel regarding their most difficult and challenging questions from a group of experts from around the world.

Right now, members are discussing the recent ACE conference, research on the therapeutic alliance, what the literature says about achieving one’s personal best as a clinician, plus much, much more.  If you’re not yet a member, nows the time to join.  It’s free.  No cost whatsoever to join and you won’t be bombarded with adds for books, webinars, videos, or training.  Look forward to meeting you online!

Filed Under: Behavioral Health, Conferences and Training, ICCE Tagged With: icce

Pushing the Research Envelope: Getting Researchers to Conduct Clinically Meaningful Research

November 5, 2010 By scottdm Leave a Comment

ACE Health Innovations - Developers of openFIT and mFIT

At the recent ACE conference, I had the pleasure of learning from the world’s leading experts on expertise and top performance.  Equally stimulating were conversations in the hallways between presentations with clinicians, policy makers, and researchers attending the event.  One of those was Bill Andrews, the director of the HGI Practice Research Network in the UK who work over the last 3+ years has focused on clinicians whose outcomes consistently fall in the top quartile of effectiveness.

In this brief interview, Bill talks about the “new direction” his research on top performing clinicians is taking.  He is truly “pushing the research envelope, challenging the field to move beyond the simplistic randomized clinical trials comparing different treatment packages.  Take a look:

Filed Under: Behavioral Health, Conferences and Training, evidence-based practice, Feedback Informed Treatment - FIT, Practice Based Evidence Tagged With: behavioral health, cdoi, continuing education, evidence based practice, icce

Am-ACE-ing Events in Kansas City: The First International Achieving Clinical Excellence Conference

October 27, 2010 By scottdm Leave a Comment

Here’s a riddle for you:

What do therapists, researchers, case managers, magicians, surgeons, award winning musicians, counselors, jugglers, behavioral health agency directors, and balloon twisting artists have in common?

Answer:

They all participated in the first “Achieving Clinical Excellence” held last week in Kansas City, Missouri.

It’s true. The “motley” crew of presenters, entertainers, and attendees came to Kansas City learn the latest, evidence-based strategies for helping clinicians achieve their “personal best” and, in the process, improve the quality and outcome of behavioral health services.  Not only did participants and presenters come from all over the globe–Australia, New Zealand, Norway, Sweden, Denmark, Austria, the UK, Ireland, Scotland, Germany, Canada, Holland, and elsewhere–but ICCE web 2.0 technology was used to stream many of the presentations live to a worldwide audience (click on the link to watch the recordings).

“The atmosphere was positively electric,” one participant remarked to me on break, “and so friendly.   First, I was inspired.  Each presentation contained something new, a take-away.  Then I wanted to sit with other attendees and discuss the content.”

And thanks to “Gillis for Children and Families,” who not only sponsored and ran the event, but provided a full breakfast and lunch each day of the conference, participants had ample opportunity to meet, process, and network with each other.


Rich Simon                       Anders Ericsson                     Michael Ammar

Rich Simon, Ph.D., the editor of the Psychotherapy Networker, kicked off the event using his time at the podium to place the conference’s emphasis on excellence within the broader history of the field of psychotherapy.  He was followed by K. Anders Ericsson, the editor of the influential Cambridge Handbook of Expertise and Expert Performance, reviewed research on expert performance gathered over the last 3 decades.  Scott D. Miller, Ph.D., translated existing research on expert performance into steps for improving outcomes in behavioral health. On day 2, professional magician Michael Ammar delivered a stunning performance of close up magic while teaching a specific method of deliberate practice that clinicians can use to improve their skills.  Meanwhile, break out sessions led by psychologists, physicians, counselors, pharmacists, and agency directors addressed “nuts and bolts” applications.

Rachel Hsu                                                  Roger Shen

In between each plenary and breakout session, top performers from a variety of fields entertained and inspired.  Moving performances on the violin and piano by nine year old Rachel Hsu and eleven year old Roger Shen amazed and challenged everyone in attendance.  “It is not talent,” Rachel told me, “It’s a lot of hard work–4 to 5 hours a day, everyday of the week, including weekends.”  The take home lesson from these exception kids was clear: there are no short cuts when it comes to top performance.  If you want to achieve your personal best you must work hard.  Promises otherwise are so much more snake oil.

On Thursday evening, the Australian classical pianist, David Helfott, whose lifestory was the subject of the award winning film, “Shine” entertained conference attendees.  His partner, Gillian, introduced and provided the audience with a brief history of David’s life, unfortunate treatment in the mental health system, and their long marriage.  The audience rose to their feet in a standing ovation at the conclusion of the performance.  There were few dry eyes in the house.  Afterwards, the two spent nearly an hour meeting and greeting attendees personally.  Once again, portions of the performance were broadcast live via ICCE web 2.0 technology to a world wide audience.

The inspiration that conference attendees felt continues on the International Center for Clinical Excellence web-based community.  Join us as we work to help each other achieve our personal best.  Still looking for inspiration?  Take a look at the following two videos; first, a montage of events at ACE; and second, Mr. Ah’ Lee Robinson, the director of the Kansas City Boys Choir, whose story and performance brought the conference to a moving conclusion.

Filed Under: Behavioral Health, Conferences and Training, excellence Tagged With: cdoi, evidence based practice, holland, icce

What is "Best Practice?"

October 20, 2010 By scottdm Leave a Comment

You have to admit the phrase “best practice” is the buzzword of late. Graduate school training programs, professional continuing education events, policy and practice guidelines, and funding decisions are tied in some form or another to the concept. So, what exactly is it? At the State and Federal level, lists of so-called “evidence-based” interventions have been assembled and are being disseminated. In lockstep, as I reviewed recently, are groups like NICE. Their message is simple and straightforward: best practice is about applying specific treatments to specific disorders.
Admittedly, the message has a certain “common sense” appeal.    The problem, of course, is that behavioral health interventions are not the psychological equivalent of penicillin. In addition to the numerous studies highlighted on this blog documenting the failure of the “specific treatments for specific disorders” perspective, consider research published in the Spring 2010 edition of the Journal of Counseling and Development by Scott Nyman, Mark Nafziger, and Timothy Smith. Briefly, the authors examined outcome data to “evaluate treatment effectiveness across counselor training level [and found] no significant outcome differences between professional staff and …. interns, and practicum students” (p. 204). Although the researchers are careful to make all the customary prevarications, the conclusion—especially when combined with years of similar findings reported in the literature– is difficult to escape: counseling and psychotherapy are highly regulated activities requiring years of expensive professional training that ultimately fails to make the practitioner any better than they were at the outset.
What gives? Truth is, the popular conceptualization of “best practice” as a “specific treatment for a specific disorder” is hopelessly outdated. In a report few have read, the American Psychological Association (following the lead of the Institute of Medicine) redefined evidence-based, or best practice, as, “the integration of the best available research with clinical expertise in the context of patient characteristics, culture, and preferences.” Regarding the phrase “clinical expertise” in this definition, the Task Force stated, “Clinical expertise…entails the monitoring of patient progress (and of changes in the patient’s circumstances—e.g., job loss, major illness) that may suggest the need to adjust the treatment (Lambert, Bergin, & Garfield, 2004a). If progress is not proceeding adequately, the psychologist alters or addresses problematic aspects of the treatment (e.g., problems in the therapeutic relationship or in the implementation of the goals of the treatment) as appropriate” (p. 273; emphasis included in the original text).
Said another way, instead of choosing the “specific treatment for the specific disorder” from a list of approved treatments, best practice is:
·         Integrating the best evidence into ongoing clinical practice;
·         Tailoring services to the consumer’s characteristics, culture, and preferences;
·         Formal, ongoing, real-time monitoring of progress and the therapeutic relationship.
In sum, best practice is Feedback Informed Treatment (FIT)—the vision of the International Center for Clinical Excellence. And right now, clinicians, researchers and policy makers are learning, sharing, and discussion implementing FIT in treatment settings around the globe on the ICCE web-based community.
Word is getting out. As just one example, consider Accreditation Canada, which recently identified FIT as a “leading practice” for use in behavioral health services. According to the website, leading practices are defined as “creative, evidence-based innovations [that] are commendable examples of high quality leadership and service delivery.” The accreditation body identified FIT as a “simple, measurable, effective, and feasible outcome-based accountability process,” stating that the approach is a model for the rest of the country! You can read the entire report here.
How exactly did this happen? Put bluntly, people and hard work. ICCE senior associates and certified trainers, Rob Axsen and Cynthia Maeschalck, with the support and backing of Vancouver Coast Health, worked tirelessly over the last 5 years both implementing and working to gain recognition for FIT. Similar recognition is taking place in the United States, Denmark, Sweden, England, and Norway.
You can help. Next time someone—be it colleague, trainer, or researcher—equates “best practice” with using a particular model or list of “approved treatment approaches” share the real, official, “approved” definition noted above.  Second, join Rob, Cynthia, and the hundreds of other practitioners, researchers, and policy makers on the ICCE helping to reshape the behavioral health practice worldwide.

Filed Under: Behavioral Health, evidence-based practice, ICCE, Practice Based Evidence Tagged With: Accreditation Canada, American Psychological Association (APA), cdoi, Cochrane Review, evidence based practice, icce, NICE

No Therapist Left Behind: Improving the Quality and Outcome of Behavioral Health Services One Practitioner at a Time

October 12, 2010 By scottdm Leave a Comment

Staying “up-to-date” isn’t easy in today’s practice environment. In these lean economic times, training budgets are often the first to be cut. On the other hand, trying to separate the “important” from “irrelevant” in our information-rich age can be, as Mitchell Kapor once observed, “a bit like trying to get a drink from a fire hydrant.”

Enter the ICCE—a web-based community of professionals dedicated to improving the quality and outcome of behavioral health services worldwide.  Every day, in forums ranging from “research on psychotherapy” to “marketing and media,” members from around the world meet to learn from and share with each other.   What’s more, groups have been created for practitioners working in specific countries (Sweden, Denmark, Norway, Poland, Netherlands, and so on).  Crucially, in these forums members are able to address issues relevant to the specific environment in which they work and do so in their own language.
In the latest issue of the Psychotherapy Networker, internet and media consultant Elizabeth Doherty Thomas, identified ICCE as one of the “best clinical resources on the internet”—high praise when one considers the tens of thousands of websites featuring content related to behavioral health practice.
So, what are you waiting for?  If you’re not a member, you can request an invitation to join by clicking here. Tapping into the rich knowledge base of clinicians around the globe will insure that you are not “left behind.”

Filed Under: ICCE Tagged With: Elizabeth Doherty Thomas, healthcare, icce, Paychotherapy Networker

Clinician Beware: Ignoring Research Can be Hazardous to Your Professional (and Economic) Health

September 25, 2010 By scottdm Leave a Comment

“Studies show…”
“Available data indicate…”
“This method is evidence-based…”
My how things have changed. Twenty years ago when I entered the field, professional training, continuing education events, and books rarely referred to research or evidence. Now, everyone refers to the “data.”  The equation is simple: no research = no money.  Having “an evidence-base” increasingly determines book sales, attendance at continuing education events, and myriad other funding and reimbursement decisions.

So what do the data actually say? S adly, the answer is often, “it depends on who you ask.”  If you read the latest summary and treatment recommendations for post-traumatic stress disorder (PTSD) posted by the Cochrane Collaboration, you are told that TFCBT and EMDR are the most effective, “state of the art” treatments on offer.  Other summaries, as I recently blogged about, arrive at very—even opposite—conclusions; namely, all psychotherapies (trauma-focused and otherwise) work equally well in the treatment of PTSD.  For the practicing clinician (as well as other consumers of research), the end result is confusion and, dare I say, despair.

Unable to resolve the discrepant findings, the research is either rejected out of hand (“it’s all crap anyway”) or cherry-picked (“your research is crap, mine is good”).  In a world where experts disagree–and vehemently–what is the average Joe or Jane therapist to do?

Fortunately, there is another way, beyond agnosticism and instead of fundamentalism.   In a word, it is engagement. This last week, I spent 5 days teaching an intensive workshop with ICCE Senior Associate Susanne Bargmann to a group of Danish psychologists on “Statistics and Research Design.”  That’s right.  Five days, 6 hours a day spent away from work and clients learning how to understand, read, and conduct research.

The goal of the training was simple and straight-forward: help practitioners learn to evaluate the methods and meanings, strengths and weaknesses, and political and paradigmatic influences associated with research and evidentiary claims. At the conclusion of the five days, none of those assembled had difficulty engaging with and understanding the reasons for the seemingly discrepant findings noted above. As a result, they could state with confidence “what works” with PTSD, helping clarify this not only to colleagues, payers, and policy members but also to consumers of behavioral health services.

The “Statistics and Research Design” course will be held again in Denmark in 2011.  If the experience of this year’s participants proves anything, it is that, “The only thing therapists have to fear about statistics and research design, is fear itself.”  Please contact Vinther and Mosgaard directly for more information.

Finally, as part of the International Center for Clinical Excellence (ICCE) efforts to improve the quality and outcome of behavioral health services worldwide, two additional intensive trainings will be offered in Chicago, Illinois (USA). First, the “Advanced Training in Feedback-Informed Treatment (FIT).”  And second, the annual “Training of Trainers.”   In the Advanced Training, participants learn:

·         The empirical foundations of feedback-informed clinical work (i.e., empirically supported factors underlying successful clinical work, the impact of feedback on performance)
·         Clinical skills for enhancing client engagement that cut across different therapeutic orientations and diverse treatment populations
·         How to integrate outcome management tools (including one or more of the following: ORS, SRS, CORE, and OQ 45) into clinical practice
·         How to use the outcome management tools to inform and improve service delivery
·         How to significantly improve your clinical skills and outcomes via feedback and deliberate practice
·         How to use data generated from outcome measures to inform management, supervision, and training decisions
·         Strategies for successful implementation of CDOI and FIT in your organization or practice
Need more information about the course?  Email us or click on the video below to hear more about the course.  In the meantime, space is limited so register early at: http://www.eventbrite.ie/o/the-international-centre-for-clinical-excellence-298540255.

Filed Under: Behavioral Health, Conferences and Training, evidence-based practice Tagged With: cdoi, continuing education, denmark, icce, reimbursement

What Works in the Treatment of Post Traumatic Stress Disorder? The Definitive Study

September 15, 2010 By scottdm 1 Comment

What works in the treatment of people with post-traumatic stress?  The influential Cochrane Collaboration–an “independent network of people” whose self-professed mission is to help “healthcare providers, policy makers, patients, their advocates and carers, make well-informed decisions, concludes that, “non trauma-focused psychological treatments [do] not reduce PTSD symptoms as significantly…as individual trauma focused cognitive-behavioral therapy (TFCBT), eye movement desensitization and reprocessing, stress mamangement and group TFCBT.”  The same conclusion was reached by the National Institute for Health and Clinical Excellence (or NICE) in the United Kingdom which has developed and disseminated practice guidelines that unequivocally state that , “all people with PTSD should be offered a course of trauma focused psychological treatment (TFCBT) or eye movement desensitization and reprocessing (EMDR).”  And they mean all: adults and kids, young and old.  Little room for left for interpretation here.  No thinking is required.  Like the old Nike ad, you should: “Just do it.”

Wait a minute though…what do the data say? Apparently, the NICE and Cochrane recommendations are not based on, well…the evidence–at least, that is, the latest meta-analytic research!  Meta-analysis, you will recall, is a procedure for aggregating results from similar studies in order to test a hypothesis, such as, “are certain approaches for the treatment of post traumatic stress more effective than others?”  A year ago, I blogged about the publication of a meta-analysis by Benish, Imel, & Wampold which clearly showed that there was no difference in outcome between treatments for PTSD and that the designation of some therapies as “trauma-focused” was devoid of empirical support, a fiction.

So, how to account for the differences?  In a word, allegiance.  Although written by scientists, so-called “scholarly” reviews of the literature and “consensus panel” opinions inevitably reflect the values, beliefs, and theoretical predilections of the authors.  NICE guidelines, for example, read like a well planned advertising campaign for single psychotherapeutic modality: CBT.  Indeed, the organization is quite explicit in it’s objective: “provide support for the local implementation of…appropriate levels of cognitive beheavioral therapy.”   Astonishingly, no other approach is accorded the same level of support or endorsement despite robust evidence of the equivalence of outcomes among treatment approaches.  Meanwhile, the review of the PTSD literature and treatment recommendations published by the Cochrane Collaboration has not been updated since 2007–a full two years following the publication of the Benish et al. (2008) meta-analysis–and that was penned by a prominent advocate of…CBT…Trauma-focused CBT.

As I blogged about back in January, researchers and prominent CBT proponents, published a critique of the Benish et al. (2008) meta-analysis in the March 2010 issue of Clinical Psychology Review (Vol. 30, No. 2, pages 269-76).  Curiously, the authors chose not to replicate the Benish et al. study, but rather claim that bias, arbitrariness, lack of transparency, and poor judgement accounted for the findings.   As I promised at the time, I’m making the response we wrote–which appeared in the most recent issue of Clinical Psychology Review—available here.

Of course, the most important finding of the Benish et al. (2008) and our later response (Wampold et al. 2010) is that mental health treatments work for people with post traumatic stress.  Such a conclusion is unequivocal.  At the same time, as we state in our response to the critique of Benish et al. (2008), “there is little evidence to support the conclusion…that one particular treatment for PTSD is superior to others or that some well defined ingredient is crucial to successful treatments of PTSD.”  Saying otherwise, belies the evidence and diverts attention and scarce resources away from efforts likely to improve the quality and outcome of behavioral health services.

View more documents from Scott Miller.

Filed Under: Behavioral Health, Practice Based Evidence Tagged With: Carl Rogers, continuing education, icce, post traumatic stress, PTSD, reimbursement

Feedback Informed Treatment (FIT): A Worldwide Trend in Behavioral Health

July 14, 2010 By scottdm Leave a Comment

In my prior blogpost, I reviewed exciting developments taking place throughout Canada regarding “feedback-informed treatment” (FIT).  For those following me on Twitter–and if you’re not, please do so by clicking on the link–you already know that last week I was in Tunbridge, England for a two day training sponsored by the Kent-Medway National Healthcare Trust on “Supershrinks: Learning from the Fields Most Effective Practitioners.”  Interest in outcomes is growing exponentially, becoming a worldwide phenomenon.

It was a real pleasure being asked to work with the dedicated–and I must say, long-suffering–physicians, psychologists, counselors, social workers, and nurses of the NHS Trust.  I say “long-suffering” because these healthcare professionals, like others around the globe, are laboring to provide effective services while contending with a back breaking amount of paperwork, oversight, mandated treatment protocols, and regulation.

Much of the mess that behavioral health practitioners find themselves in is due to the way “good practice” is and has been conceptualized.  Simply put, the field–it’s researchers, visionaries, policy makers and sadly, many clinicians–are still stuck in the penicillin era, promoting specific treatments for specific disorders.  The result has been a growing list of protocols, fidelity and adherence measures, and other documentation requirements.  As pointed Bohanske and Franzcak point out in their excellent chapter on transforming behavioral health in the latest edition of The Heart and Soul of Change: Delivering What Works in Therapy, “The forms needed to obtain a marriage certificate, buy a new home, lease an automobile, apply for a passport, open a bank account, and die of natural causes…altogether…weigh 1.4 ounces.  By contrast, the paperwork required for enrolling a single mother in counseling to talk about difficulties her child [is] experiencing [weigh] 1.25 pounds” (p. 300).

Something has to change, and that something is the incessant focus on controlling the process–or “how”– of treatment.  Instead, as the video interview below illustrates, emphasis can be placed on outcome.  Doing so will not only simplify oversight and regulation but, as an increasing number of studies show, result in improved “FIT” and effect of services offered.

 

Filed Under: Behavioral Health, Feedback Informed Treatment - FIT Tagged With: behavioral health, bohanske, Canada, cdoi, England, evidence based practice, feedback informed treatment, franzcak, icce, Kent-Medway National Healthcare Trust, randomized clinical trial

Implementing Consumer-Driven, Outcome-Informed (CDOI) Behavioral Health Services: The ICCE and 2010 Training of Trainers Event

June 8, 2010 By scottdm Leave a Comment

This week I’m in Calgary, Canada. Last week, I was in Charleston, South Carolina. Next week, I’ll be in Marion, Ohio and Bay City, Michigan. In each instance, I’m working with the management and staff of public behavioral health agencies that are busy implementing consumer-driven, outcome-informed clinical work.

Some of the groups are just beginning the process.  Others, as reported here on my blog, have been at it long enough to document significant improvements in outcome, retention, and productivity (i.e., in Ohio and Virginia).  All have told me that implementing the seemingly simple ideas of outcome-informed practice is incredibly hard work–impacting nearly every aspect of agency life.  Being able to access the expertise and experience of fellow clinicians and agency directors in real time when questions and challenges arise is, I’ve also learned, critical in maintaining the momentum necessary for successful implementation.

Enter the ICCE: The International Center for Clinical Excellence.  Briefly, the ICCE is a web-based community of clinicians, researchers, agency managers, and policy makers dedicated to excellence in behavioral health.  Many of the groups I’m working with have joined the site providing them with 24/7/365 access to a deeply knowledgeable world-wide community.  In addition to the numerous topic-specific discussion groups and member-generated videos, organizations can set up private forums where management and clinicians can have confidential discussions and coordinate implementation efforts.

If you are a clinician or agency director and are not already a member, you and/or your organization can access the ICCE community today by visiting the website at: www.centerforclinicalexcellence.com.  Membership is free.  In the video below, I talk with Arjan Van der Weijde, about groups in Holland that are meeting on on the ICCE for practitioners to discuss their implementation of feedback-informed work in the Netherlands.  Check it out.

I’ve also included a brief video about the upcoming “Training of Trainers” course, held each year in August in Chicago.  As in prior years, professionals from all over the world will be joining me and the state-of-the-art faculty for four intensive days of training.  Agencies both public and private, in the U.S. and abroad, are sending staff to the event to learn the skills necessary to lead transformation projects.  Space is already limited so register soon.

The Training of Trainers

Filed Under: Behavioral Health, Conferences and Training, Feedback Informed Treatment - FIT, ICCE Tagged With: addiction, brief therapy, Carl Rogers, cdoi, healthcare, holland, icce, psychometrics, public behavioral health

Finding Feasible Measures for Practice-Based Evidence

May 4, 2010 By scottdm Leave a Comment

Let’s face it.  Clinicians are tired.  Tired of paperwork (electronic or othrwise).  When I’m out and about training–which is every week by the way–and encouraging therapists to monitor and measure outcomes in their daily work few disagree in principle.  The pain is readily apparent however, the minute the paper version of the Outcome Rating Scale flashes on the screen of my PowerPoint presentation.

It’s not uncommon nowadays for clinicians to spend 30-50% of their time completing intake, assessment, treatment planning, insurance, and other regulatory forms.  Recently, I was in Buffalo, New York working with a talented team of children’s mental health professionals.  It was not uncommon, I learned, to spend most of two outpatient visits doing the required paperwork.  When one considers that the modal number of sessions consumers attend is 1 and the average approximately 5 its hard not to conclude that something is seriously amiss.

Much of the “fear and loathing” dissipates when I talk about the time it usually takes to complete the Outcome and Session Ratings Scales.  On average, filling out and scoring the measures takes about a minute a piece.  Back in January, I blogged about research on the ORS and SRS, including a summary in PDF format of all studies to date.  The studies make clear that the scales are valid and reliable.  Most important, however, for day-to-day clinical practice, the ORS and SRS are also the most clinically feasible measures available.

Unfortunately, many of the measures currently in use were never designed for routine clinical practice–certainly few therapists were consulted.  In order to increase “complaince” with such time consuming outcome tools, many agencies advise clinicians to complete the scales occasionally (e.g., “prime numbers” [5,7, 11 and so on]) or only at the beginning and end of treatment.  The very silliness of such ideas will be immediately apparent to anyone who ever actually conducted treatment.  Who can predict a consumer’s last session?  Can you imagine a similar policy ever flying in medicine?  Hey Doc, just measure your patient’s heart rate at the beginning and end of the surgery!  Inbetween? Fahgetabotit.  Moreover, as I blogged about from behind the Icelandic ash plume, the latest research strongly favors routine measurement and feedback.  In real-world clinical settings feasibility is every bit as important as reliability and validity.  Agency managers, regulators, and policy makers ignore it at their own (and their data’s) peril.

How did the ORS and SRS end up so brief and without any numbers?  When asked at workshops, I usually respond, “That’s an interesting story.”  And then continue, “I was in Israel teaching.  I’d just finished a two day workshop on ‘What Works.'” (At the time, I was using and recommending the 10-item SRS and 45-item OQ).

“The audience was filing out of the auditorium and I was shutting down my laptop when the sponsor approached the dais.  ‘Scott,’ she said, ‘one of the participants has a last question…if you don’t mind.'”

“Of course not,” I immediately replied.

“His name is Haim Omer.  Do you know of him?”


Dr. Haim Omer

“Know him?” I responded, “I’m a huge fan!”  And then, feeling a bit weak in the knees asked, “Has he been here the w h o l e time?”

Haim was as gracious as ever when he finally made it to the front of the room.  “Great workshop, Scott.  I’ve not laughed so hard in a long time!”  But then he asked me a very pointed question.  “Scott,” he said and then paused before continuing, “you complained a bit about the length of the two measures you are using.  Why don’t you use a visual analog scale?”

“That’s simple Haim,” I responded, “It’s because I don’t know what a visual analog measure is!”

Haim described such scales in detail, gave me some examples (e.g., smiley and frowny faces), and even provided references.  My review on the flight home reminded me of a simple neuropsychological assessment scale I used on internship called “The Line Bisection Task”–literally a straight line (a measure developed by my neuropsych supervisor, Dr. Tom Schenkenberg).   And the rest is, as they say, history.

Filed Under: deliberate practice, excellence, Feedback Informed Treatment - FIT Tagged With: continuing education, Dr. Haim Omer, Dr. Tom Schenkenberg, evidence based practice, icce, ors, outcome rating scale, session rating scale, srs

Feedback, Friends, and Outcome in Behavioral Health

May 1, 2010 By scottdm Leave a Comment


My first year in college, my declared major was accounting.  What can I say?  My family didn’t have much money and my mother–who chose my major for me–thought that the next best thing to wealth was being close to money.

Much to her disappointment I switched from accounting to psychology in my sophomore year.  That’s when I first met Dr. Michael Lambert.


Michael J. Lambert, Ph.D.

It was 1979 and I was enrolled in a required course taught by him on “tests and measures.”  He made an impression to be sure.  He was young and hip–the only professor I met while earning my Bachelor’s degree who insisted the students call him by his first name.  What’s more, his knowledge and passion made what everyone considered the “deadliest” class in the entire curriculum seem positively exciting.  (The text, Cronbach’s classic Essentials of Psychological Testing, 3rd Edition, still sits on my bookshelf–one of the few from my undergraduate days).  Within a year, I was volunteering as a “research assistant,” reading and then writing up short summaries of research articles.

Even then, Michael was concerned about deterioration in psychotherapy.  “There is ample evidence,” he wrote in his 1979 book, The Effects of Psychotherapy (Volume 1), “that psychotherapy can and does cause harm to a portion of those it is intended to help” (p. 6).  And where the entire field was focused on methods, he was hot on the trail of what later research would firmly establish as the single largest source of variation in outcome: the therapist.  “The therapist’s contribution to effective psychotherapy is evident,” he wrote, “…training and selection on dimensions of…empathy, warmth, and genuineness…is advised, although little research supports the efficacy of current training procedures.”  In a passage that would greatly influence the arc of my own career, he continued, “Client perception…of the relationship correlate more highly with outcome that objective judges’ ratings” (Lambert, 1979, p. 32).

Fast forward 32 years.  Recently, Michael sent me a pre-publication copy of a mega-analysis of his work on using feedback to improve outcome and reduce deterioration in psychotherapy.  Mega-analysis combines original, raw data from multiple studies–in this case 6–to create a large, representative data set of the impact of feedback on outcome.  In his accompanying email, he said, “our new study shows what the individual studies have shown.”  Routine, ongoing feedback from consumers of behavioral health services not only improves overall outcome but reduces risk of deterioration by nearly two thirds!    The article will soon appear in the Journal of Consulting and Clinical Psychology.

Such results were not available when I first began using Lambert’s measure–the OQ 45–in my clinical work.  It was late 1996.  My colleagues and I had just put the finishing touches on Escape from Babel, our first book together on the “common factors.”

That’s when I received a letter from my colleague and mentor, Dr. Lynn Johnson.


Lynn D. Johnson, Ph.D.

In the envelop was a copy of an article Lynn had written for the journal, Psychotherapy entitled, “Improving Quality in Psychotherapy” in which he argued for the routine measurement of outcome in psychotherapy.  He cited three reasons: (1) providing proof of effectiveness to payers; (2) enabling continuous analysis and improvement of service delivery; and (3) giving consumers voice and choice in treatment.  (If you’ve never read the article, I highly recommend it–if for no other reason than its historical significance.  I’m convinced that the field would be in far better shape now had Lynn’s suggestions been heeded then).

Anyway, I was hooked.  I soon had a bootleg copy of the OQ and was using it in combination with Lynn’s Session Rating Scale with every person I met.

It wasn’t always easy.  The measure took time and more than a few of my clients had difficulty reading and comprehending the items on the measure.  I was determined however, and so persisted, occasionally extending sessions to 90 minutes so the client and I could read and score the 45-items together.

Almost immediately, routinely measuring and talking about the alliance and outcome had an impact on my work.  My average number of sessions began slowly “creeping up” as the number of single-session therapies, missed appointments, and no shows dropped.  For the first time in my career, I knew when I was and was not effective.  I was also able to determine my overall success rate as a therapist.  These early experiences also figured prominently in development of the Outcome Rating Scale and revision of the Session Rating Scale.

More on how the two measures–the OQ 45 and original 10-item SRS–changed from lengthy Likert scales to short, 4-item visual analog measures later.  At this point, suffice it to say I’ve been extremely fortunate to have such generous and gifted teachers, mentors, and friends.

Filed Under: Feedback Informed Treatment - FIT Tagged With: behavioral health, cdoi, continuing education, evidence based practice, holland, icce, Michael Lambert, Paychotherapy, public behavioral health

Bringing up Baseline: The Effect of Alliance and Outcome Feedback on Clinical Performance

April 29, 2010 By scottdm 1 Comment

Not long ago, my friend and colleague Dr. Rick Kamins was on vacation in Hawaii.  He was walking along the streets of a small village, enjoying the warm weather and tropical breezes, when the sign on a storefront caught his eye.  Healing Arts Alliance, it read.  The proprietor?  None other than, “Scott Miller, Master of Oriental Medicine.”

“With all the talking you do about the alliance,” Rick emailed me later, “I wondered, could it be the same guy?!”

I responded, “Ha, the story of my life.  You go to Hawaii and all I get is this photo!”

Seriously though, I do spend a fair bit of time when I’m out and about talking about the therapeutic alliance.  As reviewed in the revised edition of The Heart and Soul of Change there are over 1100 studies documenting the importance of the alliance in successful psychotherapy.  Simply put, it is the most evidence-based concept in the treatment literature.

At the same time, whenever I’m presenting, I go to great lengths to point out that I’m not teaching an “alliance-based approach” to treatment.  Indeed–and this can be confusing–I’m not teaching any treatment approach whatsoever.  Why would I?  The research literature is clear: all approaches work equally well.  So, when it comes to method, I recommend that clinicians choose the one that fits their core values and preferences.  Critically, however, the approach must also fit and work for the person in care–and this is where research on the alliance and feedback can inform and improve retention and outcome.


Lynn D. Johnson, Ph.D.

Back in 1994, my long time mentor Dr. Lynn Johnson encouraged me to begin using a simple scale he’d developed.  It was called…(drum roll here)…”The Session Rating Scale!”  The brief, 10-item measure was specifically designed to obtain feedback on a session by session basis regarding the quality of the therapeutic alliance.  “Regular use of [such] scales,” he argued in his book Psychotherapy in the Age of Accountability, “enables patients to be the judge of the…relationship.  The approach is…egalitarian and respectful, supporting and empowering the client” (Johnson, 1995, p. 44).  If you look at the current version of the SRS, you will see Lynn is listed on the copyright line–as Paul Harvey would say, “And now you know…the rest of the story.”  Soon, I’ll tell you how the measure went from a 10-item, Likert scale to a 4-item visual analog scale.

Anyway, some 17 years later, research has now firmly validated Lynn’s idea: formally seeking feedback improves both retention and outcome in behavioral health.  How does it work?  Unfortunately science, as Malcoln Gladwell astutely observes, “all too often produces progress in advance of understanding.”  That said, recent evidence indicates that routinely monitoring outcome and alliance establishes and serves to maintain a higher level of baseline performance.   In other words, regularly seeking feedback helps clinicians attend to core therapeutic principles and processes easily lost in the complex give-and-take of the treatment hour.

Such findings are echoed in the research literature on expertise which shows that superior performers across a variety of domains (physics, computer programming, medicine, etc.) spend more time than average performers reviewing basic core principles and practice.


At an intensive training in Antwerp, Belgium

The implications for improving practice are clear: before reaching for the stars, we should attend to the ground we stand on.  It’s so simple, some might think it stupid.  How can a four item scale given at the end of a session improve anything?  And yet, in medicine, construction, and flight training, there is a growing reliance on such “checklists” to insure that proven steps to success are not overlooked.  Atul Gawande reviews this practice in his new and highly readable book, The Checklist Manifesto: How to Get Things Right.  Thanks go to Dan Buccino, member of the International Center for Clinical Excellence, for bringing this work to my attention.  (By the way, you can connect with Dan and Lynn in the ICCE community.  If you’re not a member, click here to join.  It’s free).

The only question that remains is, I suppose, with all the workshops and training on “advanced methods and specialized techniques,” will practitioners interested in bringing up baseline?

Filed Under: Feedback Informed Treatment - FIT Tagged With: icce, Malcolm Gladwell, ors, outcome rating scale, session rating scale, srs

Eruptions in Europe and in Research

April 18, 2010 By scottdm 3 Comments

Dateline: 11:20 am, April 18th, 2010

Today I was supposed to fly from Stockholm, Sweden to the far northern town of Skelleftea–a flight that takes a little over an hour.  Instead, I’m sitting on a train headed for Sundsvall, the first leg of a 12 hour trip that will include a 6 hour bus ride and then a short stint in a taxi.

If you’ve been following the news coming out of Europe, you know that all flights into, out of, and around Europe have been stopped. Eyjafjallajokull–an Icelandic volcano–erupted the day after I landed in Goteborg spewing an ash cloud that now covers most of Europe disrupting millions of travellers.  People are making due, sleeping on cots in airline, train, and bus terminals and using Facebook and Twitter to connect and arrange travel alternative.

In the meantime, another eruption has taken place with the publication of the latest issue of the Journal of Consulting and Clinical Psychology that threatens to be equally disruptive to the field of psychotherapy–and to proponents of the narrow, specific-treatments-for-specific-disorders or “evidence-based treatments” movement.   Researchers Webb, DeRubeis, and Barber conducted a meta-analysis of studies examining the relationship between adherence to and competence in delivering a particular approach and outcome.  The authors report finding that, “neither adherence nor competence was…related to patient (sic) outcome and indeed that the aggregate estimates of their effects were very close to zero.”

Zero!  I’m not sure what zero means to everyone else, but where I come from it’s pretty close to nothing.  And yet, the romance with the EBT movement continues among politicians, policy makers, and proponents of specific treatment models.  Each year, millions and millions of dollars of scarce resources are poured into an approach to behavioral health that accounts for exactly 0% of the results.

Although it was not a planned part of their investigation, the must-read study by Webb, DeRubeis, and Barber also points to the “magma” at the heart of effective psychotherapy: the alliance, or quality of the relationship between consumer and provider.  The authors report, for example, finding “larger competence-outcome effect size estimates [in studies that]…did not control for the influence of the alliance.”

The alliance will take center stage at the upcoming, “Achieving Clinical Excellence” and “Training of Trainers” events.  Whatever you thought you knew about effective therapeutic relationships will be challenged by the latest research from our study of top performing clinicians worldwide.  I hope you’ll join our international group of trainers, researchers, and presenters by clicking on either of the links above.  And, if you’ve not already done so, be sure and visit the International Center for Clinical Excellence home page and request an invitation to join the community of practitioners and researchers who are learning and sharing their expertise.

Filed Under: Behavioral Health, Practice Based Evidence Tagged With: behavioral health, brief therapy, continuing education, icce, Journal of Consulting and Clinical Psychology, Outcome, public behavioral health

Neurobabble Redux: Comments from Dr. Mark Hubble on the Latest Fad in the World of Therapy Spark Comment and Controversy

April 8, 2010 By scottdm 2 Comments

 


Last week, my long time colleague and friend, Dr. Mark Hubble blogged
about the current interest of non-medically trained therapists in the so-called “neurobiology of human behavior.”  In my intro to his post, I “worried” out loud about the field’s tendency to search for legitimacy by aligning with the medical model.  Over the years, psychotherapy has flirted with biology, physics, religion, philosophy, chaos, and “energy meridians” as both the cause of what ails people and and the source of psychotherapy’s effectiveness.

For whatever reason, biological explanations have always had particular cachet in the world of psychotherapy.  When I first entered the field, the “dexamethasone suppression test” was being touted as the first “blood test” for depression.  Some twenty years on, its hard to remember the hope and excitement surrounding the DST.

Another long-time friend and colleague, psychologist Michael Valentine is fond of citing the many problems–social, physical, and otherwise–attributed to genetics (including but not limited to: anxiety, depression, addictions, promiscuity, completed suicides, thrill seeking obscene phone calls, smoking, gambling, and the amount of time one spends watching TV) for which there is either: (a) precious little or inconsistent evidence; or (b) the variance attributable to genetics is small and insignificant compared to size and scope of the problem.

In any event, I wanted to let readers know that response to Mark’s post has been unusually strong.  The numerous comments can be found on the syndicated version of my blog at the International Center for Clinical Excellence.  Don’t miss them!

Filed Under: Behavioral Health Tagged With: behavioral health, brief therapy, dexamethasone suppression test, icce, mark hubble, meta-analysis, Michael Valentine, psychotherapy, public behavioral health

Problems in Evidence-Based Land: Questioning the Wisdom of "Preferred Treatments"

March 29, 2010 By scottdm Leave a Comment

This last week, Jeremy Laurance, Health Editor for the U.K. Independent published an article entitled, “The big question: Does cognitive therapy work? And should the NHS (National Health Service) provide more of it?” Usually such questions are limited to professional journals and trade magazines. Instead, it ran in the “Life and Style” section of one of Britain’s largest daily newspapers. Why?

In 2007, the government earmarked £173,000,000 (approximately 260,000,000 U.S. dollars) to train up an army of new therapists. Briefly, the money was allocated following an earlier report by Professor Richard Layard of the London School of Economics which found that a staggering 38% of illness and disability claims were accounted for by “mental disorders.” The sticking point—and part of the reason for the article by Laurance—is that training was largely limited to a single treatment approach: cognitive-behavioral therapy (CBT).  And research released this week indicates that the efficacy of the method has been seriously overestimated due to “publication bias.”
Researchers Cuijpers, Smith, Bohlmeijer, Hollon, and Andersson (2010) examined the “effect sizes” of 117 trials and found that the tendency of journals to accept trials that showed positive results and reject those with null or negative findings reduced the reported effectiveness of CBT by as much as 33 percent!
Combine such findings with evidence from multiple meta-analyses showing no difference in outcome between treatment approaches intended to be therapeutic and one has to wonder why CBT continues to enjoy a privileged position among policy makers and regulatory bodies.  Despite the evidence, the governmental body in the UK that is responsible for reviewing research and making policy recommendations—National Institute for Health and Clinical Excellence (NICE)–continues to advocate for CBT.  It’s not only unscientific, its bad policy. Alas, when it comes to treatment methods, CBT enjoys what British psychologist Richard Wiseman calls, the “get out of a null effect free” card.
What would work? If the issue is truly guaranteeing effective treatment, the answer is measurement and feedback.  The single largest contributor to outcome is who provides the treatment and not what treatment approach is employed.  More than a dozen randomized clinical trials—the design of choice of NICE and SAMSHA—indicate that outcomes and retention rates are improved while costs are decreased—in many cases dramatically so.
I respectfully ask, “What is the hold up?”

Filed Under: Practice Based Evidence Tagged With: CBT, cdoi, cognitive-behavioral therapy, conferences, evidence based practice, icce, Jeremy Laurance, National Institute for Health and Clinical Excellence (NICE), randomized clinical trial, Richard Layard, Richard Wiseman

Is Professional Training a Waste of Time?

March 18, 2010 By scottdm 6 Comments

readerEvery year, thousands of students graduate from professional programs with degrees enabling them to work in the field of behavioral health. Many more who have already graduated and are working as a social worker, psychologist, counselor, or marriage and family therapist attend—often by legal mandate—continuing education events. The costs of such training in terms of time and money are not insignificant.

Most graduates enter the professional world in significant debt, taking years to pay back student loans and recoup income that was lost during the years they were out of the job market attending school. Continuing professional education is also costly for agencies and individuals in practice, having to arrange time off from work and pay for training.

To most, the need for training seems self-evident. And yet, in the field of behavioral health the evidence is at best discouraging. While in traveling in New Zealand this week, my long-time colleague and friend, Dr. Bob Bertolino forwarded an article on the subject appearing in the latest issue of the Journal of Counseling and Development (volume 88, number 2, pages 204-209). In it, researchers Nyman and Nafziger reported results of their study on the relationship between therapist effectiveness and level of training.

First, the good news: “clients who obtained services…experienced moderate symptom relief over the course of six sessions.” Now the bad news: it didn’t matter if the client was “seen by a licensed doctoral –level counselor, a pre-doctoral intern, or a practicum student” (p. 206, emphasis added). The authors conclude, “It may be that researchers are loathe to face the possibility that the extensive efforts involved in educating graduate students to become licensed professionals result in no observable differences in client outcome” (p. 208, emphasis added).

In case you were wondering, such findings are not an anomaly.  Not long ago, Atkins and Christensen (2001) reviewed the available evidence in an article published in the Australian Psychologist and concluded much the same (volume 36, pages 122-130); to wit, professional training has little if any impact on outcome.  As for continuing professional education, you know if you’ve been reading my blog that there is not a single supportive study in the literature.

“How,” you may wonder, “could this be?” The answer is: content and methods.  First of all, training at both the graduate and professional level continues to focus on the weakest link in the outcome chain—that is, model and technique. Recall, available evidence indicates that the approach used accounts for 1% or less of the variance in treatment outcome (see Wampold’s chapter in the latest edition of the Heart and Soul of Change).  As just one example, consider workshops being conduced around the United States using precious resources to train clinicians in the methods studied in the “Cannabis Youth Treatment” (CYT) project–a study which found that the treatment methods used contributed zero to the variance in treatment outcome.  Let me just say, where I come from zero is really close to nothing!

Second, and even more important, traditional methods of training (i.e., classroom lecture, reading, attending conferences) simply do not work. And sadly, behavioral health is one of the few professions that continue to rely on such outdated and ineffective training methods.

The literature on expertise and expert performance provides clear, compelling, and evidence-based guidelines about the qualities of effective training. I’ve highlighted such data in a number of recent blogposts. The information has already had a profound impact on the way how the ICCE organizes and conducts trainings.   Thanks to Cynthia Maeschalck, Rob Axsen, and Bob, the entire curriculum and methods used for the annual “Training of Trainers” event have been entirely revamped. Suffice it to say, agencies and individuals who invest precious time and resources attending the training will not only learn but be able to document the impact of the training on performance.  More later.

Filed Under: Top Performance Tagged With: behavioral health, Carl Rogers, cdoi, continuing professional education, healthcare, holland, icce, Journal of Counseling and Development, psychometrics

Deliberate Practice, Expertise, & Excellence

February 3, 2010 By scottdm 2 Comments

Later today, I board United flight 908 on my way to workshops scheduled in Holland and Belgium.  My routine in the days leading up to an international trip is always the same.  I slowly gather together the items I’ll need while away: computer (check); european electric adapter (check); presentation materials (check); clothes (check).   And, oh yeah, two decks of playing cards and close up performance mat.

That’s me (pictured above) practicing a “ribbon spread” in my hotel room following a day of training in Marion, Ohio.  It’s a basic skill in magic and I’ve been working hard on this (and other moves using cards) since last summer.  Along the way, I’ve felt both hopeful and discouraged.  But I’ve kept on nonetheless taking heart from what I’m reading about skill acquisition.

Research on expertise indicates that the best performers (in chess, medicine, music, sports, etc.) practice every day of the week (including weekends) for up to four hours a day.  Sounds tiring for sure.  And yet, the same body of evidence shows that world class performers are able to sustain such high levels of practice because they view the acquisition of expertise as a long-term process.  Indeed, in a study of children, researcher Gary McPherson found that the answer to a simple question determined the musical ability of kids a year later: “how long do you think you’ll play your instrument?”  The factors that were shown to be irrelevant to performance level were: initial musical ability, IQ, aural sensitivity, math skills, sense of rhythm, income level, and sensorimotor skills.

The type of practice also matters.  When researchers Kitsantas and Zimmerman studied the skill acquisition of experts, they found that 90% of the variation in ability could be accounted for by how the performers described their practice; the types of goals they set, how they planned and executed strategies, self-monitored, and adapted their performance in response to feedback.

So, I take my playing cards and close-up mat with me on all of my trips (both domestic and international).  I don’t practice on planes.  Gave that up after getting some strange stares from fellow passengers as they watched me repeat, in obsessive fashion, the same small segment of my performance over, and over, and over again.  It only made matters worse if they found out I was a psychologist.  I’d get that “knowing look,” that seemed to say, “Oh yeah.”  Anyway, I also managed to lose a fair number of cards when the deck–because of my inept handling while trying to master some particular move–went flying all over the cabin (You can imagine why I’ve been less successful in keeping last year’s New Year resolution to learn to play the ukelele).

Once I’m comfortably situated in my room, the mat and cards come out and I work, practice a specific handling for up to 30 minutes followed by a 15-20 minute break.  Believe it or not, learning–or perhaps better said, attempting to learn–magic has really been helpful in understanding the acquisition of expertise in my chosen field: psychology and psychotherapy.  Together with my colleagues, we are translating our experience and the latest research on expertise into steps for improving the performance and outcome of behavioral health services.  This is, in fact, the focus of the newest workshop I’m teaching, “Achieving Clinical Excellence.”   It’s also the organizing theme of the ICCE Achieving Clinical Excellence conference that will be held in Kansas City, Kansas in October 2010.  Click on the photo below for more information.

In the meantime, check out the two videos I’ve uploaded to ICCETV featuring two fun magic effects.  And yes, of course, feedback is always appreciated!

Filed Under: Conferences and Training, deliberate practice, excellence, Feedback Informed Treatment - FIT Tagged With: achieving clinical excellence, Alliance, Belgium, Carl Rogers, common factors, holland, icce, Norway, psychology, psychotherapy, randomized clinical trial, Therapist Effects

The Future of Behavioral Health: Integrated Care & Entrepreneurship

February 2, 2010 By scottdm Leave a Comment


Nicholas Cummings, Ph.D.

Sometime in late 1986 I wrote a letter to Dr. Nicholas Cummings.  As a then student-member of the American Psychological Association (APA), I was automatically subscribed to and receiving the American Psychologist.  In the April issue, Dr. Cummings published an article, provocatively titled, “The Dismantling of Our Health System: Strategies for the Survival of Psychological Practice.”  Change was in the air. “Traditional psychology practice is both inefficient and ineffective,” he argued, and a “growing revolution in heath care” was a clear and present danger to the very survival of the field.

What can I say?  As someone at the beginning of his career (with large student loans to repay and a long time to go before retirement), the five page article spooked me.  So I did what I’d done before: I wrote a letter.  I’d been writing and calling prominent researchers and clinicians ever since I was an undergraduate.  During the 70’s, I’d exchanged letters and even phone calls with B.F. Skinner!

In all honesty, I didn’t know anything about Dr. Cummings–for example, that he was a former president of the APA, launched the Professional Schools of Psychology movement and founded four campuses of the California School of Professional Psychology, wrote the freedom-of-choice legislation requiring insurers to reimburse non-medical, behavioral health providers, and started American Biodyne in the hopes that psychologists could own rather than be owned–as eventually happened–by managed care (read a history here).  Neither did I know that he was a member of Psychology’s famed “Dirty Dozen.” Without a doubt, however, the decision to write him, changed the arc of my career.

Fast forward 25 years, and 86-year-old Nicholas Cummings is at it again–not only sounding a warning klaxon but identifying the opportunities available in the dramatically changing healthcare environment.  Sadly, the field (and professional psychology in particular) ignored the counsel he’d given back in 1986.  As a result, business interests took over managed care, resulting–just as he predicted–in low wages and the near complete lack of professional autonomy.

So, what can clinicians do now to survive and thrive?  According to Dr. Cummings, two words best capture the future of behavioral health: (1) integrated care; and (2) entrepreneurship.  Let’s face the unpleasant reality and say it out loud: independent practice is on life support.  Agency work is no picnic either given the constant threats to funding and never ending amount of regulation and paperwork.  Finally, when it comes to practitioner income, its a buyer’s market.

That said, it’s not all doom and gloom.  Far from it.  There is a tremendous need (and opportunity) in the present reform-driven healthcare marketplace for clinicians who are able to blend behavioral interventions, medical literacy, knowledge about healthcare delivery systems, and entrepreneurship skills.  Possibilities do exist.  The real question is, “Do we have the will to change?”  Here’s where the power of one simple action–in this instance, a phone call–can have such a profound effect on one’s life and success.

Though we never formally worked together, I’ve been calling and writing Nick off and on for the two and a half decades.  Late last fall, my partners and co-creators of the International Center for Clinical Excellence, Brendan Madden and Enda Madden, flew to Reno to seek his advice on our business plan.  We simply called him.  He said, “When can you get here?”  The result?  His sage counsel helped us win the InterTrade Seedcorn Regional Prize for “Best Emerging Company” as well as secure investors in the most restrictive venture capital environment since the Great Depression.  And that’s not all…

Chief Technology Officer Enda Madden    Chief Executive Officer Brendan Madden

Just last week, I flew to Phoenix, Arizona to give a presentation on using outcomes to improve behavioral healthcare service delivery at Arizona State University.  Nick was there to meet me, along with the director of an entirely new program for behavioral health entrepreneurs, Dr. Ron O’Donnell.  Briefly, the “Doctor of Behavioral Health” is the culmination of Nick’s vision of creating a doctoral training program tailored to the emerging need for innovative behavioral clinicians to practice in primary care and medical settings.  Response has been overwhelming to say the least.  Fifty plus post-graduate clinicians are enrolled.   That’s right, post-graduate.  In other words, these are practicing clinicians returning to add “integrated care expert and behavioral health entrepreneur” to their resume.


School of Letters and Sciences

As it turns out, I’ll be traveling from Chicago to Phoenix a fair amount in the future.  When he stood to introduce me, Nick announced that I’d be filling the “Cummings Professor of Behavioral Health” faculty position at ASU.  The power of a single call.

Filed Under: Behavioral Health, Conferences and Training, excellence Tagged With: American Biodyne, American Psychological Association (APA), American Psychologist, Arizona State University, B.F. Skinner, behavioral health, Carl Rogers, healthcare reform, icce, integrated care, managed care, Nick Cummings, Norway, psychometrics, public behavioral health, Ronald O'Donnell

  • « Previous Page
  • 1
  • 2
  • 3
  • Next Page »

SEARCH

Subscribe for updates from my blog.

loader

Email Address*

Name

Upcoming Training

There are no upcoming Events at this time.

FIT Software tools

FIT Software tools

LinkedIn

Topics of Interest:

  • Behavioral Health (112)
  • behavioral health (5)
  • Brain-based Research (2)
  • CDOI (14)
  • Conferences and Training (67)
  • deliberate practice (31)
  • Dodo Verdict (9)
  • Drug and Alcohol (3)
  • evidence-based practice (67)
  • excellence (63)
  • Feedback (40)
  • Feedback Informed Treatment – FIT (246)
  • FIT (29)
  • FIT Software Tools (12)
  • ICCE (26)
  • Implementation (7)
  • medication adherence (3)
  • obesity (1)
  • PCOMS (11)
  • Practice Based Evidence (39)
  • PTSD (4)
  • Suicide (1)
  • supervision (1)
  • Termination (1)
  • Therapeutic Relationship (9)
  • Top Performance (40)

Recent Posts

  • Agape
  • Snippets
  • Results from the first bona fide study of deliberate practice
  • Fasten your seatbelt
  • A not so helpful, helping hand

Recent Comments

  • Bea Lopez on The Cryptonite of Behavioral Health: Making Mistakes
  • Anshuman Rawat on Integrity versus Despair
  • Transparency In Therapy and In Life - Mindfully Alive on How Does Feedback Informed Treatment Work? I’m Not Surprised
  • scottdm on Simple, not Easy: Using the ORS and SRS Effectively
  • arthur goulooze on Simple, not Easy: Using the ORS and SRS Effectively

Tags

addiction Alliance behavioral health brief therapy Carl Rogers CBT cdoi common factors conferences continuing education denmark evidence based medicine evidence based practice Evolution of Psychotherapy excellence feedback feedback informed treatment healthcare holland icce international center for cliniclal excellence medicine mental health meta-analysis Norway NREPP ors outcome measurement outcome rating scale post traumatic stress practice-based evidence psychology psychometrics psychotherapy psychotherapy networker public behavioral health randomized clinical trial SAMHSA session rating scale srs supershrinks sweden Therapist Effects therapy Training