Jaxon White's profile

Speech-to-text integration

The Cortext secure messaging platform is HIPAA compliant. To remain compliant dictation through native services (i.e., Siri, Google Now) is blocked. This create's a frustrating user-experience and forces the physician or Nurse to take extra time to enter a message manually. Nuance's Dragon Medical is a HIPAA compliant dictation service and would allow physicians to dictate securely into Cortext.

Nuance provides an API for their technology, complete with two UI options.
Cortext Today
The current UI for Cortext has limited space in the UI, especially in the input bar. During this project, there were simultaneous projects occurring affecting the input field. To see more about the input field project take a look at the Input Field project.
Nuance GUI
Nuance's API provided two options for a GUI, what they labeled as a SpeechBar and a Speech Control.
The GUI options hadn't been implemented in a messaging app before, and after mock-ups showing the integration as defined in the API, it became clear that the default options would not work in Cortext. The SpeechBar covered too much of the UI, especially on smaller devices, and the SpeechControl needed too much of a footprint in the Input Bar, or header, especially with the separate simultaneous projects.

The GUI was provided by Nuance, through the API, so there was zero control over the look and feel, other than the placement.
Final UI
The problematic UI called for some creative thinking, and negotiation with Nuance. After working with the Nuance team, and internal stakeholders, I was able to create a compromise: Use the Speech Control, but with an Imprivata Cortext style mic. The Cortext mic would call the Speech Control, and send it to the recording state. The Speech Control as-is, was also too big for the input bar space, and would have to take over both the mic button and the attachments button, and would have to be artificially reduced in height. 

Nuance had a redesign of their Speech Control on their roadmap. After discussions, the Nuance team was able to deliver the new GUI sooner than expected, which allowed for a more seamless user-experience in Cortext.
Speech-to-text integration
Published:

Speech-to-text integration

Speech-to-text Integration in HIPAA compliant messaging app

Published: