Readers Write: Augmented Intelligence: Virtual Assistants Come to Healthcare

Augmented Intelligence: Virtual Assistants Come to Healthcare
By Andrew Rebhan

Andrew Rebhan, MBA is a health IT research consultant with Advisory Board of Washington, DC.

Natural language processing (NLP) techniques allow digital systems to streamline user interactions allowing machines to read text, understand meaning, and generate narratives from existing information. Recent advances in artificial intelligence (AI) technologies have accelerated progress in a broad range of NLP applications for healthcare, including digital assistants for clinical staff, concierge services for patients, and digital scribes to streamline documentation processes.

For example, last Fall Nuance Communications released its Dragon Medical Virtual Assistant to help health care providers interact with clinical workflows using NLP and other conversational AI functionality. Nuance announced at HIMSS18 that it will integrate its virtual assistant technology into Epic’s EHR.

According to the news release, the new partnership allows physicians to use the virtual assistant to ask for information from a patient’s chart, retrieve labs, medication lists, and visit summaries using Epic Haiku. Nurses using Epic Rover can use the assistant to conversationally interact with flowsheets to enter and confirm patient info and vitals. Finally, scheduling staff using Epic Cadence can converse with the assistant to check physician schedules and create or modify patient appointments. Vanderbilt University Medical Center recently announced it is leveraging Nuance’s technology to build a prototype voice assistant called “V-EVA” (Vanderbilt EHR Voice Assistant) to help caregivers navigate the hospital’s Epic EHR using natural dialogue.

A number of other healthcare providers have started piloting voice assistants. Northwell Health is testing Amazon’s Alexa across multiple use cases, including one that helps users determine the wait time at nearby emergency rooms and urgent care centers in Northwell’s system. People can ask their Alexa-enabled home devices to either search for the shortest wait time based on their ZIP code, or can ask for the wait time for a specific location. Once the user asks for this information, Alexa queries Northwell’s database of wait times (which analyzes check-in data every 15 minutes) for the best option. The Alexa feature can respond back with the location’s name, address, and wait time.

In another example, the University of Pittsburgh Medical Center (UPMC) is collaborating with Microsoft to create an intelligent scribe called EmpowerMD. The project is part of Microsoft’s Healthcare NExT initiative, which aims to use AI to accelerate healthcare innovation. The virtual scribe listens to conversations doctors have with patients, analyzing speech for clinically relevant concepts to make suggestions in the medical record. The goal is to allow doctors or other staff to engage with patients face to face, without the need to divert their attention to a computer screen. The scribe can make suggestions or take notes for follow up, which the doctor accepts or modifies after the encounter. Staff can also view a transcript of the conversation for greater context on the assistant’s suggestions. Using machine learning, the virtual assistant improves its performance as suggestions are accepted, rejected, or modified by the user.

Patients are also interested in AI-powered virtual assistants. Accenture recently released the findings of its 2018 Consumer Survey on Digital Health, which polled 2,301 US consumers on topics such as wearables, virtual care, and AI. Among the findings, the survey showed that roughly one in five consumers has experienced health-related AI, and in particular, showed an openness to using intelligent virtual assistants:

• 61 percent said they would use “an intelligent virtual health assistant that helps to estimate out-of-pocket costs, schedule healthcare appointments and explain benefit coverage, bills, and payment options”
• 57 percent would use an intelligent virtual coach
• 55 percent would use “an intelligent virtual nurse that monitors your health condition, medications, and vital signs at home”
• 50 percent would use “an intelligent virtual clinician that helps to diagnose health issues and navigate you to the right treatment options”

Is your team interested? Here are some considerations to get you started.

Identify your Goals

Virtual assistants can perform a variety of tasks described above. In addition, they can set reminders, answer basic patient questions, call for a nurse, or even address loneliness. However, virtual assistants may not always be the best solution for a given problem, particularly complex tasks that may benefit from visual displays (such as on a computer or tablet). Make sure your team is specific about how the technology will improve processes and where it fits into existing workflows.

Explore What’s Possible

The major technology companies such as Google and Amazon are trying to make their software development kits and APIs as open and user-friendly as possible – which means your organization can build new skills into these virtual assistants to better suit your needs, assuming you have the right staff skills to code these features. As you evaluate options, ensure that potential solutions are properly evaluated for HIPAA compliance, as natural language interfaces in a healthcare setting may capture sensitive information whether or not that is not part of their intended use.

Expect Change

The healthcare industry is starting to see rapid advancements in NLP, computer vision, and other subsets of AI, but the use of virtual assistants in hospitals is still nascent. The technology will likely continue to evolve as more organizations adopt and test these devices, and the broader industry forms new ways to implement and regulate their use. Early adopters will have an advantage in getting to use and gain experience with these tools, but may also have to update them more often as vendors release new editions with enhanced capabilities.