Browsing by Author "Yen, Po-Yin"

Now showing 1 - 3 of 3
  • Thumbnail Image
    Item
    Foundations for Studying Clinical Workflow: Development of a Composite Inter-Observer Reliability Assessment for Workflow Time Studies
    (2019) Lopetegui, Marcelo; Yen, Po-Yin; Embi, Peter; Payne, Philip
    The ability to understand and measure the complexity of clinical workflow provides hospital managers and researchers with the necessary knowledge to assess some of the most critical issues in healthcare. Given the protagonist role of workflow time studies on influencing decision makers, major efforts are being conducted to address existing methodological inconsistencies of the technique. Among major concerns, the lack of a standardized methodology to ensure the reliability of human observers stands as a priority. In this paper, we highlight the limitations of the current Inter-Observer Reliability Assessments, and propose a novel composite score to systematically conduct them. The composite score is composed of a) the overall agreement based on Kappa that evaluates the naming agreement on virtually created one-seconds tasks, providing a global assessment of the agreement over time, b) a naming agreement based on Kappa, requiring an observation pairing approach based on time-overlap, c) a duration agreement based on the concordance correlation coefficient, that provides means to evaluate the correlation concerning tasks duration, d) a timing agreement, based on descriptive statistics of the gaps between timestamps of same-task classes, and e) a sequence agreement based on the Needleman-Wunsch sequence alignment algorithm. We hereby provide a first step towards standardized reliability reporting in workflow time studies. This new composite IORA protocol is intended to empower workflow researchers with a standardized and comprehensive method for validating observers' reliability and, in turn, the validity of their data and results.
  • Thumbnail Image
    Item
    Nurses’ Stress Associated with Nursing Activities and Electronic Health Records: Data Triangulation from Continuous Stress Monitoring, Perceived Workload, and a Time Motion Study
    (2019) Yen, Po-Yin; Pearl, Nicole; Jethro, Cierra; Cooney, Emily; McNeil, Brittany; Chen, Ling; Lopetegui, Marcelo; Maddox, Thomas M.; Schallom, Marilyn
    As health IT has become overloaded with patient information, provider burnout and stress has accelerated. Studies have shown that EHR usage leads to heightened cognitive workload for nurses, and increases in cognitive workload can result in stronger feelings of exhaustion and burnout. We conducted a time motion study in an oncology division to examine the relationships between nurses’ perceived workload, stress measured by blood pulse wave (BPw), and their time spent on nursing activities, and to identify stress associated with EHR use. We had a total of 33 observations from 7 nurses. We found that EHR-related stress is associated with nurses’ perceived physical demand and frustration. We also found that nurses’ perceived workload is a strong predictor of nurses’ stress as well as how they spent time with their patients. They also experienced higher perceived mental demand, physical demand, and temporal demand when they were assigned to more patients, regardless of patient acuity. Our study presents a unique data triangulation approach from continuous stress monitoring, perceived workload, and a time motion study.
  • Thumbnail Image
    Item
    Usability and Workflow Evaluation of “RhEumAtic Disease Activity” (READY) A Mobile Application for Rheumatology Patients and Providers
    (2016) Yen, Po-Yin; Lara, Bárbara; Lopetegui, Marcelo; Bharat, Aseem; Ardoin, Stacy; Johnson, Bernardette; Mathur, Puneet; Embi, Peter J; Curtis, Jeffrey R
    Background: RhEumAtic Disease activitY (READY) is a mobile health (mHealth) application that aims to create a shared platform integrating data from both patients and physicians, with a particular emphasis on arthritis disease activity. Methods: We made READY available on an iPad and pilot implemented it at a rheumatology outpatient clinic. We conducted 1) a usability evaluation study to explore patients’ and physicians’ interactions with READY, and 2) a time motion study (TMS) to observe the clinical workflow before and after the implementation. Results: A total of 33 patients and 15 physicians participated in the usability evaluation. We found usability problems in navigation, data entry, pain assessment, documentation, and instructions along with error messages. Despite these issues, 25 (75,76%) patients reported they liked READY. Physicians provided mixed feedback because they were concerned about the impact of READY on clinical workflow. Six physicians participated in the TMS. We observed 47 patient visits (44.72 hours) in the pre-implementation phase, and 42 patient visits (37.82 hours) in the post-implementation phase. We found that patients spent more time on READY than paper (4.39mins vs.2.26mins), but overall, READY did not delay the workflow (pre = 52.08 mins vs. post = 45.46 mins). This time difference may be compensated with READY eliminating a workflow step for the staff. Conclusion: Patients preferred READY to paper documents. Many found it easier to input information because of the larger font size and the ease of ‘tapping’ rather than writing-out or circling answers. Even though patients spent more time on READY than using paper documents, the longer usage of READY was mainly due to when troubleshooting was needed. Most patients did not have problems after receiving initial support from the staff. This study not only enabled improvements to the software but also serves as good reference for other researchers or institutional decision makers who are interested in implementing such a technology.

Implementado por OpenGeek Services