Is a modified Global Trigger Tool method using automatic trigger identification valid when measuring adverse events? A comparison of review methods using automatic and manual trigger identification

This is a pre-copyedited, author-produced version of an article accepted for publication in the >i>International Journal for Quality in Health Care following peer review. The version of record Mevik, K., Hansen, T.E., Deilkås, E.C., Ringdal, A.M. & Vonen, B. (2018). Is a modified Global Tr...

Full description

Bibliographic Details
Published in:International Journal for Quality in Health Care
Main Authors: Mevik, Kjersti, Hansen, Tonje Elisabeth, Deilkås, Ellen C Tveter, Ringdal, Alexander, Vonen, Barthold
Format: Article in Journal/Newspaper
Language:English
Published: Oxford University Press 2018
Subjects:
Online Access:https://hdl.handle.net/10037/15255
https://doi.org/10.1093/intqhc/mzy210
Description
Summary:This is a pre-copyedited, author-produced version of an article accepted for publication in the >i>International Journal for Quality in Health Care following peer review. The version of record Mevik, K., Hansen, T.E., Deilkås, E.C., Ringdal, A.M. & Vonen, B. (2018). Is a modified Global Trigger Tool method using automatic trigger identification valid when measuring adverse events? A comparison of review methods using automatic and manual trigger identification. International Journal for Quality in Health Care , mzy210, is available online at: https://academic.oup.com/intqhc/advance-article/doi/10.1093/intqhc/mzy210/5123532 . Objectives - To evaluate a modified Global Trigger Tool (GTT) method with manual review of automatic triggered records to measure adverse events. Design - A cross-sectional study was performed using the original GTT method as gold standard compared to a modified GTT method. Setting - Medium size hospital trust in Northern Norway. Participants - One thousand two hundred thirty-three records selected between March and December 2013. Main outcome measure - Records with triggers, adverse events and number of adverse events identified. Recall (sensitivity), precision (positive predictive value), specificity and Cohen’s kappa with 95 % confidence interval were calculated. Results - Both methods identified 35 adverse events per 1000 patient days. The modified GTT method with manual review of 658 automatic triggered records identified adverse events ( n = 214) in 189 records and the original GTT method identified adverse events ( n = 216) in 186 records. One hundred and ten identical records were identified with adverse events by both methods. Recall, precision, specificity and reliability for records identified with adverse events were respectively 0.59, 0.58, 0.92 and 0.51 for the modified GTT method. The total manual review time in the modified GTT method was 23 h while the manual review time using the original GTT method was 411 h. Conclusions - The modified GTT method is as good as the original GTT method that complies with the GTTs aim monitoring the rate of adverse events. Resources saved by using the modified GTT method enable for increasing the sample size. The automatic trigger identification system may be developed to assess triggers in real-time to mitigate risk of adverse events.