Voice-based interface design – presentation

Rung András’s presentation at the NLP meetup on 22th February 2017.

Find below the excerpt of the presentation.

You can download the presentation here

From whom is this relevant?

  • 16% illiterate
  • 14% younger than the age of 6 years
  • 2% visually impaired
  • 10% dyslexic


  • Occupied hands
  • Cheap gesture
  • Passive
  • Group-based

Why is it interesting?

  • Alexa and Google home will shake things up
  • Still before the starting line in Hungary
  • Moving past IVR
  • The death of VUI or GUI?

Chatting or taking care of business – From butler to friend

  • Situation-dependent adaptation (task, intent)
  • Co-reference and context management
  • A mix of visual and voice-based solutions
  • Expectation management

Sample conversations – Creating the interface’s backbone

  • On-site work and interviews
  • Creating successful conversation paths using diagram drawers
  • Nuance Mix, Api,.ai, Wit.ai
  • Creating visual screens

Constructive grammar – VUI and modern language theory?

  • Wildcards and logical inputs
  • Fillmore, Goldberg
  • Complex opportunity management


  • Three-level feedback
  • Clearly: The weather in San Francisco is…
  • Not a linguistic signal
  • Generic: I’m sorry to hear that
  • Visual

Troubleshooting, assistance

  • No speech
  • No interpreted speech
  • Processed but not managed speech
  • Poorly recognised
  • Beginners and proficient user management
  • Assistance and correction opportunities

Clarification, versions

  • Too much information: I have a headache and nausea…
  • Input variation management: fridge, refrigerator, chiller, cooler, ice-box
  • What is the temperature in Velence? /Call John.
  • Asking back or guessing

Intentions, complex data entry

  • Show me my calendar / add an event / delete event, etc.
  • Emotion detection based on voice and keywords
  • Nonlinear completion of complex forms

Share your opinion with us

    Please type your message

    Please type your email!

    Please type your message

    Send comment

    We create exceptional websites, mobile applications and software to help you realise your business goals.

    Dear Ergo,

    My name is
    . My email is
    . And I have the following message for you:


    Find out more about the topic

    Fintech UX for B2B

    March 30, 2021 | 12 min read

    The Pont Vecchio, or Old Bridge, in Florence has nearly fifty shops across its span. Almost all of them are jewellers of one sort or another. Some sell gems, others watches, or gold and silver items. ...

    The impact of the Coronavirus pandemic on the UX industry

    February 16, 2021 | 17 min read

    The Coronavirus pandemic has resulted in profound changes in the way people throughout the world meet and work. Are these changes permanent, or merely temporary blips? And as masses of people have resorted...