Foundations for Studying Clinical Workflow: Development of a Composite Inter-Observer Reliability Assessment for Workflow Time Studies

dc.contributor.authorLopetegui, Marcelo
dc.contributor.authorYen, Po-Yin
dc.contributor.authorEmbi, Peter
dc.contributor.authorPayne, Philip
dc.date.accessioned2021-08-31T15:46:26Z
dc.date.available2021-08-31T15:46:26Z
dc.date.issued2019
dc.description.abstractThe ability to understand and measure the complexity of clinical workflow provides hospital managers and researchers with the necessary knowledge to assess some of the most critical issues in healthcare. Given the protagonist role of workflow time studies on influencing decision makers, major efforts are being conducted to address existing methodological inconsistencies of the technique. Among major concerns, the lack of a standardized methodology to ensure the reliability of human observers stands as a priority. In this paper, we highlight the limitations of the current Inter-Observer Reliability Assessments, and propose a novel composite score to systematically conduct them. The composite score is composed of a) the overall agreement based on Kappa that evaluates the naming agreement on virtually created one-seconds tasks, providing a global assessment of the agreement over time, b) a naming agreement based on Kappa, requiring an observation pairing approach based on time-overlap, c) a duration agreement based on the concordance correlation coefficient, that provides means to evaluate the correlation concerning tasks duration, d) a timing agreement, based on descriptive statistics of the gaps between timestamps of same-task classes, and e) a sequence agreement based on the Needleman-Wunsch sequence alignment algorithm. We hereby provide a first step towards standardized reliability reporting in workflow time studies. This new composite IORA protocol is intended to empower workflow researchers with a standardized and comprehensive method for validating observers' reliability and, in turn, the validity of their data and results.es
dc.format.extent10 p.es
dc.identifier.citationAMIA Annual Symposium Proceedings 2019; 2019: 617–626es
dc.identifier.urihttp://hdl.handle.net/11447/4544
dc.language.isoenes
dc.subjectClinical workflowes
dc.titleFoundations for Studying Clinical Workflow: Development of a Composite Inter-Observer Reliability Assessment for Workflow Time Studieses
dc.typeArticlees

Files

Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
Foundations for Studying Clinical Workflow Development of a Composite Inter-Observer Reliability Assessment for Workflow Time Studies.pdf
Size:
1.23 MB
Format:
Adobe Portable Document Format
Description:
Texto completo
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
1.71 KB
Format:
Item-specific license agreed upon to submission
Description: