The Extent and Importance of Unintended Consequences Related to Computerized Provider Order Entry

From Clinfowiki
Jump to: navigation, search

First Review

Ash JS, Sittig DF, Poon EG, Guappone K, Campbell E, Dykstra RH J Am Med Inform Assoc. 2007 Jul-Aug;14(4):415-23

Introduction

This article presents qualitative research reporting the range of unintended consequences of CPOE in a large group of health care organizations [1]

Disclosures

There are no explicit disclosures of conflicts of interest. The study received funding from the National Institutes of Health and the National Library of Medicine.

Background

The deployment of CPOE causes dramatic changes in workflow for all members of the health care system. Many changes are intended and can be planned for but there are a large number of unintended consequences which can emerge during and after implementation.

Question

A research question is not explicitly stated but the authors seek to determine the types, frequencies and impact of unintended consequences of CPOE systems.

Objective

The research goals are explicitly stated as "...to identify the types of unintended consequences, so that they can be monitored and managed…"

Methods

The authors conducted two activities in this study. First they directly observed the work flow of clinicians in five sites experienced in the use of CPOE for a total of 390 observer-hours. They then then aggregated their observations using qualitative research methodologies into 9 clusters of consequence types. They eliminated one, "persistant use of paper", as it was felt not to be an unintended consequence, but rather an alternative display modality. They then provided summary statistics of the frequency of the various unintended consequences [1].

Key Findings

The authors drew their respondents from an initial group of 561 hospitals listed in HIMSS Analytics as users of CPOE. CPOE had been in place from 6 months to 25 years with a median of 5 years. Their final group size was 176. There were 6 clusters of unintended consequences and associated frequencies of moderate to high importance (indicated in parentheses): New or More Work (72%), Workflow(88%), System Demands(82%), Communication(84%), Emotions(80%), Dependence on Technology(83%), and two with low ratings: New Kinds of Errors and Power Shifts. There was no correlation with responses and duration of use of CPOE.

Discussion

The authors note that unintended consequences are very frequent, often unanticipated, and can have a large effect on the acceptance and usability of CPOE. They suggest that those contemplating implementation of CPOE will benefit by either planning strategies to avoid these unintended consequences or at least plan, in an informed manner, for the trade offs that result. They further suggest that developers of CPOE systems carefully attend to these unintended consequences and make efforts to mitigate them in their development strategies.

Reviewer Comments

This article is a very valuable resource for health systems which are planning to implement CPOE. It offers the opportunity to normalize the disruptions and stressors of system deployment and mitigate the worst of the unintended consequences. The inclusion of 176 bona fide users of CPOE provides a very broad survey of the current CPOE environment, lending great credibility to the findings. This is a must read for the leaders of any health system that is planning to deploy CPOE.

Second review

Background

This article is a research paper that explores the problems computerized physician order entry (CPOE) systems can cause. The research identifies the errors and unidentified consequences in hospital settings.

Methods

A qualitative study and three years of research consisted of 390 hours of observation and 142 different clinical disciplined individuals. In addition to the observations, a short survey was created and conducted via telephone interview with 561 U.S. hospitals that had an installed CPOE system. The script/survey given to individuals had five questions about their current CPOE system in place and eight questions about possible unintended consequences.

Results

The outcome of this research paper identified eight types of unintended consequences: more work new work, systems demands, workflow, communication, emotions, dependence on the systems, new kind of errors and the power shift. There were a total of 176 full interviews conducted, an overall response rate of 47%. The results showed that the power shift and new kind of errors were not as important as the other six consequences.

Conclusion

CPOE system developers and implementers need to consider all eight types of unintended adverse consequences during their preparation and design. The research has realized the importance of expectation management and managing the unintended.

Comments

This was a very interesting research article. Three years of observation and surveying shed light on eight unintended consequences that even the hospitals that didn't participate in this study can learn from. I have personally seen unintended consequences of CPOE systems. Most of the ambulatory clinics I work with have down time policies. In the event that the internet or power go down, the clinic will be inoperable. This is bad practice and can be very costly. Even CPOE systems that were intended to save money can have a down side. With the growth of CPOEs, managers and directors everywhere need to take notice of these issues and strategize for the unintended.

References

  1. 1.0 1.1 Ash, J. S., D. F. Sittig, E. G. Poon, K. Guappone, E. Campbell, and R. H. Dykstra. “The Extent and Importance of Unintended Consequences Related to Computerized Provider Order Entry.” Journal of the American Medical Informatics Association 14, no. 4 (July 1, 2007): 415–23. doi:10.1197/jamia.M2373.