Journal of the American Medical Informatics Association

Ratwani, Raj M; Zachary Hettinger, A; Kosydar, Allison; Fairbanks, Rollin J; Hodgkins, Michael L

doi: 10.1093/jamia/ocw092pmid: 27375292

Objective: Currently, there are few resources for electronic health record (EHR) purchasers and end users to understand the usability processes employed by EHR vendors during product design and development. We developed a framework, based on human factors literature and industry standards, to systematically evaluate the user-centered design processes and usability testing methods used by EHR vendors.Materials and Methods: We reviewed current usability certification requirements and the human factors literature to develop a 15-point framework for evaluating EHR products. The framework is based on 3 dimensions: user-centered design process, summative testing methodology, and summative testing results. Two vendor usability reports were retrieved from the Office of the National Coordinator’s Certified Health IT Product List and were evaluated using the framework.Results: One vendor scored low on the framework (5 pts) while the other vendor scored high on the framework (15 pts). The 2 scored vendor reports demonstrate the framework’s ability to discriminate between the variabilities in vendor processes and to determine which vendors are meeting best practices.Discussion: The framework provides a method to more easily comprehend EHR vendors’ usability processes and serves to highlight where EHR vendors may be falling short in terms of best practices. The framework provides a greater level of transparency for both purchasers and end users of EHRs.Conclusion: The framework highlights the need for clearer certification requirements and suggests that the authorized certification bodies that examine vendor usability reports may need to be provided with clearer guidance.

Collins, Sarah A; Rozenblum, Ronen; Leung, Wai Yin; Morrison, Constance RC; Stade, Diana L; McNally, Kelly; Bourie, Patricia Q; Massaro, Anthony; Bokser, Seth; Dwyer, Cindy; Greysen, Ryan S; Agarwal, Priyanka; Thornton, Kevin; Dalal, Anuj K

Unruh, Mark Aaron; Jung, Hye-Young; Kaushal, Rainu; Vest, Joshua R

doi: 10.1093/jamia/ocw139pmid: 28395059

Objective: Follow-up with a primary care provider after hospital discharge has been associated with a reduced likelihood of readmission. However, primary care providers are frequently unaware of their patients’ hospitalizations. Event notification may be an effective tool for reducing readmissions by notifying primary care providers when their patients have been admitted to and discharged from a hospital.Materials and Methods: We examined the effect of an event notification system on 30-day readmissions in the Bronx, New York. The Bronx has among the highest readmission rates in the country and is a particularly challenging setting to improve care due to the low socioeconomic status of the county and high rates of poor health behaviors among its residents. The study cohort included 2559 Medicare fee-for-service beneficiaries associated with 14 141 hospital admissions over the period January 2010 through June 2014. Linear regression models with beneficiary-level fixed-effects were used to estimate the impact of event notifications on readmissions by comparing the likelihood of rehospitalization for a beneficiary before and after event notifications were active.Results: The unadjusted 30-day readmission rate when event notifications were not active was 29.5% compared to 26.5% when alerts were active. Regression estimates indicated that active hospitalization alert services were associated with a 2.9 percentage point reduction in the likelihood of readmission (95% confidence interval: −5.5, −0.4).Conclusions: Alerting providers through event notifications may be an effective tool for improving the quality and efficiency of care among high-risk populations.

Ratwani, Raj M; Hettinger, A Zachary; Fairbanks, Rollin J

doi: 10.1093/jamia/ocw117pmid: 27572813

Despite the widespread adoption of electronic health records (EHRs), usability of many EHRs continues to be suboptimal, with some vendors failing to meet usability standards, resulting in clinician frustration and patient safety hazards. In an effort to increase EHR vendor competition on usability, recommendations have been made and legislation drafted to develop comparison tools that would allow purchasers to better understand the usability of EHR products prior to purchase. Usability comparison can be based on EHR vendor design and development processes, vendor usability testing as part of the Office of the National Coordinator for Health Information Technology certification program, and usability of implemented products. Barriers exist within the current certified health technology program that prevent effective comparison of usability during each of these stages. We describe the importance of providing purchasers with improved information about EHR usability, barriers to making usability comparisons, and solutions to overcome these barriers.

Tieu, Lina; Schillinger, Dean; Sarkar, Urmimala; Hoskote, Mekhala; Hahn, Kenneth J; Ratanawongsa, Neda; Ralston, James D; Lyles, Courtney R

doi: 10.1093/jamia/ocw098pmid: 27402138

Objective: With the rapid rise in the adoption of patient portals, many patients are gaining access to their personal health information online for the first time. The objective of this study was to examine specific usability barriers to patient portal engagement among a diverse group of patients and caregivers.Materials and Methods: We conducted interviews using performance testing and think-aloud methods with 23 patients and 2 caregivers as they first attempted to use features of a newly launched patient portal.Results: In navigating the portal, participants experienced basic computer barriers (eg, difficulty using a mouse), routine computer barriers (eg, mistyping, navigation issues), reading/writing barriers, and medical content barriers. Compared to participants with adequate health literacy, participants with limited health literacy required 2 additional minutes to complete each task and were more likely to experience each type of navigational barrier. They also experienced more inaccuracies in interpreting a test result and finding a treatment plan within an after-visit summary.Discussion: When using a patient portal for the first time, participants with limited health literacy completed fewer tasks unassisted, had a higher prevalence of encountering barriers, took longer to complete tasks, and had more problems accurately interpreting medical information.Conclusion: Our findings suggest a strong need for tailored and accessible training and support to assist all vulnerable patients and/or caregivers with portal registration and use. Measuring the health literacy of a patient population might serve as a strong proxy for identifying patients who need the most support in using health technologies.

Meyerhoefer, Chad D; Sherer, Susan A; Deily, Mary E; Chou, Shin-Yi; Peng, Lizhong; Hu, Tianyan; Nihen, Marion; Sheinberg, Michael; Levick, Donald

doi: 10.1093/jamia/ocw113pmid: 27539200

Objective: To determine the effect of availability of clinical information from an integrated electronic health record system on pregnancy outcomes at the point of care.Materials and methods: We used provider interviews and surveys to evaluate the availability of pregnancy-related clinical information in ambulatory practices and the hospital, and applied multiple regression to determine whether greater clinical information availability is associated with improvements in pregnancy outcomes and changes in care processes. Our regression models are risk adjusted and include physician fixed effects to control for unobservable characteristics of physicians that are constant across patients and time.Results: Making nonstress test results, blood pressure data, antenatal problem lists, and tubal sterilization requests from office records available to hospital-based providers is significantly associated with reductions in the likelihood of obstetric trauma and other adverse pregnancy outcomes. Better access to prenatal records also increases the probability of labor induction and decreases the probability of Cesarean section (C-section). Availability of lab test results and new diagnoses generated in the hospital at ambulatory offices is associated with fewer preterm births and low-birth-weight babies.Discussion and conclusions: Increased availability of specific clinical information enables providers to deliver better care and improve outcomes, but some types of clinical data are more important than others. More available information does not always result from automated integration of electronic records, but rather from the availability of the source records. Providers depend upon information that they trust to be reliable, complete, consistent, and easily retrievable, even if this requires multiple interfaces.

Everson, Jordan; Kocher, Keith E; Adler-Milstein, Julia

doi: 10.1093/jamia/ocw116pmid: 27521368

Objective: To assess whether electronic health information exchange (HIE) is associated with improved emergency department (ED) care processes and utilization through more timely clinician viewing of information from outside organizations.Materials and Methods: Our data included 2163 patients seen in the ED of a large academic medical center for whom clinicians requested and viewed outside information from February 14, 2014, to February 13, 2015. Outside information requests w.ere fulfilled via HIE (Epic’s Care Everywhere) or fax/scan to the electronic health record (EHR). We used EHR audit data to capture the time between the information request and when a clinician accessed the data. We assessed whether the relationship between method of information return and ED outcomes (length of visit, odds of imaging [computed tomography (CT), magnetic resonance imaging (MRI), radiographs] and hospitalization, and total charges) was mediated by request-to-access time, controlling for patient demographics, case mix, and acuity.Results: In multivariate analysis, there was no direct association between return of information via HIE vs fax/scan and ED outcomes. HIE was associated with faster outside information access (58.5 minutes on average), and faster access was associated with changes in ED care. For each 1-hour reduction in access time, visit length was 52.9 minutes shorter, the likelihood of imaging was lower (by 2.5, 1.6, and 2.4 percentage points for CT, MRI, and radiographs, respectively), the likelihood of admission was 2.4 percentage points lower, and average charges were $1187 lower (P ≤ .001 for all).Conclusion: The relationship between HIE and improved care processes and reduced utilization in the ED is mediated by faster accessing of information from outside organizations.

Spratt, Susan E; Pereira, Katherine; Granger, Bradi B; Batch, Bryan C; Phelan, Matthew; Pencina, Michael; Miranda, Marie Lynn; Boulware, Ebony; Lucas, Joseph E; Nelson, Charlotte L; Neely, Benjamin; Goldstein, Benjamin A; Barth, Pamela; Richesson, Rachel L; Riley, Isaretta L;

Wolff, Jennifer L; Darer, Jonathan D; Berger, Andrea; Clarke, Deserae; Green, Jamie A; Stametz, Rebecca A; Delbanco, Tom; Walker, Jan

doi: 10.1093/jamia/ocw108pmid: 27497795

AbstractWe examined the acceptability and effects of delivering doctors’ visit notes electronically (via OpenNotes) to patients and care partners with authorized access to patients’ electronic medical records. Adult patients and care partners at Geisinger Health System were surveyed at baseline and after 12 months of exposure to OpenNotes. Reporting on care partner access to OpenNotes, patients and care partners stated that they had better agreement about patient treatment plans and more productive discussions about their care. At follow-up, patients were more confident in their ability to manage their health, felt better prepared for office visits, and reported understanding their care better than at baseline. Care partners were more likely to access and use patient portal functionality and reported improved communication with patients’ providers at follow-up. Our findings suggest that offering patients and care partners access to doctors’ notes is acceptable and improves communication and patients’ confidence in managing their care.

Motulsky, Aude; Wong, Jenna; Cordeau, Jean-Pierre; Pomalaza, Jorge; Barkun, Jeffrey; Tamblyn, Robyn

doi: 10.1093/jamia/ocw107pmid: 27554824

Objective: To describe the usage of a novel application (The FLOW) that allows mobile devices to be used for rounding and handoffs.Materials and Methods: The FLOW provides a view of patient data and the capacity to enter short notes via personal mobile devices. It was deployed using a “bring-your-own-device” model in 4 pilot units. Social network analysis (SNA) was applied to audit trails in order to visualize usage patterns. A questionnaire was used to describe user experience.Results: Overall, 253 health professionals used The FLOW with their personal mobile devices from October 2013 to March 2015. In pediatric and neonatal intensive care units (ICUs), a median of 26–26.5 notes were entered per user per day. Visual network representation of app entries showed that usage patterns were different between the ICUs. In 127 questionnaires (50%), respondents reported using The FLOW most often to enter notes and for handoffs. The FLOW was perceived as having improved patient care by 57% of respondents, compared to usual care. Most respondents (86%) wished to continue using The FLOW.Discussion: This study shows how a handoff and rounding tool was quickly adopted in pediatric and neonatal ICUs in a hospital setting where patient charts were still paper-based. Originally developed as a tool to support informal documentation using smartphones, it was adapted to local practices and expanded to print sign-out documents and import notes within the medicolegal record with desktop computers. Interestingly, even if not supported by the nursing administrative authorities, the level of use for data entry among nurses and doctors was similar in all units, indicating close collaboration in documentation practices in these ICUs.