Difference between revisions of "Assessing performance of an Electronic Health Record (EHR) using Cognitive Task Analysis."

From Clinfowiki
Jump to: navigation, search
(Conclusion)
(Results)
Line 20: Line 20:
 
==Results==  
 
==Results==  
  
The total number of steps for a given task ranged from 41 to 466 with a mean being 106 steps for a task.  The 14 tasks were also analyzed and classified as either physical or mental.  The results showed that 37% of tasks were mental which had an estimated time of 1.2 seconds.
+
The total number of steps for a given task ranged from 41 to 466, with a mean of 106 steps for a task.  The 14 tasks were also analyzed and classified as either physical or mental.  The results showed that 37% of tasks were mental which had an estimated time of 1.2 seconds.
  
The range of estimated time for physical tasks was between 0.57 and 0.94 seconds while the time taken to do all 14 task varied from 35 seconds to 6.5 minutes with the mental operators accounting for 50% of the time.
+
The range of estimated time for physical tasks was between 0.57 and 0.94 seconds, while the time taken to do all 14 task varied from 35 seconds to 6.5 minutes with the mental operators accounting for 50% of the time.
  
 
==Conclusion==
 
==Conclusion==

Revision as of 03:19, 4 October 2015

Himali Saitwal , Xuan Feng, Muhammad Walji , Vimla Patel, Jiajie Zhang

International Journal of Medical Informatics 79 (2010) 501–506


Introduction

This objective of this study was to analyze the user interface of the AHLTA (Armed Forces Health Longitudinal Technology Application) EHR system used by the US Military in order to evaluate its usability and identify any possible areas for improvement.

The AHLTA system was considered difficult to use because of the effort needed to learn and navigate the system, according to Dr Cassells, Assistant Secretary of Defense of Health Affairs [Ref1], which led longer workdays for clinicians who were also then able to only see fewer patients. EHRs can have slow performance usually down to two factors; design of the GUI(Graphical User Interface and system response times. This study investigated the AHLTA GUI independent of system response time.


Methods

This study used a Cognitive Task Analysis method called GOMS (Goals, Operators, Methods and Selection rules) and a method developed by Chung et al [Ref2] to analyze human cognition factors across task performance with the time required to accomplish task measured using KLM (Key-stroke Level Model) to evaluate the AHLTA system.

The KLM model estimated the time to perform each of 14 tasks via the standard 8 operators, of which seven were physical operators such as point mouse to target or double click, one was a combination of physical and mental operator and one was a mental operator. The modeling formulae used are outlined in the paper.

Results

The total number of steps for a given task ranged from 41 to 466, with a mean of 106 steps for a task. The 14 tasks were also analyzed and classified as either physical or mental. The results showed that 37% of tasks were mental which had an estimated time of 1.2 seconds.

The range of estimated time for physical tasks was between 0.57 and 0.94 seconds, while the time taken to do all 14 task varied from 35 seconds to 6.5 minutes with the mental operators accounting for 50% of the time.

Conclusion

This paper found there was a high number of steps combined with a high degree of mental processing needed to complete a task, resulting in the clinician being required to spend 22mins for data entry for any patients that required all 14 tasks.

Such high levels of mental processing for EHR tasks can lead to mental fatigue and human errors. This study indicates that reducing the overall steps involved could reduce the mental steps and consequently the mental workload on the user. This could be achieved with better design such drop down lists instead of free text fields and better screen layout.

This was a very interesting paper as it demonstrated how the user interface design is essential to the usability of an EHR system and that further EHRs might benefit from such a study.