Factors precisely building the technology
Functionalities of VUI
#4
Dialogue management
Algorithms to determine the system's responses based on user input and guide the conversation.
#1
Natural Language
A branch of AI to help VUI system respond to user input in a more conversational and context-aware manner.
#3
Speech to Text (STT)
Language modelling and complex acoustic transcribe spoken words into written text.
#2
Understanding the meaning and intent of the spoken words.
Speech recognition
Behind the VUI technology
Dialogue flow
As the users were kids, I realized conversation can go in many more possible directions. Some of them was non-contextual responses (or for eg. if they ask for unlocked games)
Testing
Kids #2
“Khushi fought with me today, I won’t let her play my puzzleyou anymore.”
Kids #2
“I am not in mood to solve the puzzle right now.”
Kids #3
“Heyy PuzzleYou, play shinchan. Pleaseee?”
Error handling
If the user names a game which hasn’t ever been unlocked-
I believe the puzzle is yet to be solved, let’s try that first!!
If the user says something totally non contextual-
Ah, I see. I believe you should totally discuss this with your mom once.
Initial prompt
Heyy *user’s name* any new puzzle solved?
VUI response language
Let’s see what you did?
Oh it’s okayy, do you wish to watch other cartoons?
Ending conversation on good note
Yayy, had a great time? See you again soon!!
Voicing user interface for PuzzleYou
Software used-
Protopie
Yes, puzzle of VUI
Overview
An addition to my concept of a gaming application “PuzzleYou”. Providing multi modal interactions for kids (3-8 years) to play the solve-scan-interact game via voice integrated feature for hands-free usage.
Project Brief
Include voice based interaction in an interface. Focus on language and responses.
Focus
Dialogue flow, Error handling, Natural language
Duration
3 days (10 hours)
Sector
Multimodality, Voice based interface, Kids gaming application
Understanding VUI
Possible conversations
Language for kids
DESIGN
User interface modified
Prototype
Usability Testing
Dialogue flow
Practical usage
Prompts and responses
Error handling
#1 Kids interfaces require more observation
As my users belong to the younger age group (3-8), they were not able to express how seamless the task flow was. I refined my interface based on observations of their behaviour.
#2 Natural language processing is the hardest part of VUI
Making the interface as human alike as possible, so that kid can comfortably interact with the application. Adding the basic prompts considering how vague a child brain can be.
I'm happy that I was able to work on a project for kids, because it was different than my other projects. Creating a seamless experience for kids which even parents agree to was a bigger task.
Learnings and Takeaways
Factors precisely building the technology
Functionalities of VUI
Storytelling different
eras of poetry
Software used-
Protopie
Yes, puzzle of VUI
Focus
Dialogue flow, Error handling, Natural language
Duration
3 days (10 hours)
Sector
Multimodality, Voice based interface, Kids gaming application
Overview
An addition to my concept of a gaming application “PuzzleYou”. Providing multi modal interactions for kids (3-8 years) to play the solve-scan-interact game via voice integrated feature for hands-free usage.
Project Brief
Include voice based interaction in an interface. Focus on language and responses.
Dialogue flow
Behind the VUI technology
#1
Natural Language
A branch of AI to help VUI system respond to user input in a more conversational and context-aware manner.
#2
Speech recognition
Understanding the meaning and intent of the spoken words.
#3
Speech to Text (STT)
Language modelling and complex acoustic transcribe spoken words into written text.
#4
Dialogue flow
Algorithms to determine the system's responses based on user input and guide the conversation.
Understanding VUI
Possible conversations
Language for kids
DESIGN
UI modified
Prototype
Usability Testing
Dialogue flow
Practical usage
Prompts and responses
Error handling
Initial prompt
Heyy *user’s name* any new puzzle solved?
VUI response language
Let’s see what you did?
Oh it’s okayy, do you wish to watch other cartoons?
Ending conversation on good note
Yayy, had a great time? See you again soon!!
As the users were kids, I realized conversation can go in many more possible directions. Some of them was non-contextual responses (or for eg. if they ask for unlocked games)
Testing
Kids #2
“Khushi fought with me today, I won’t let her play my puzzleyou anymore.”
Kids #2
“I am not in mood to solve the puzzle right now.”
Kids #3
“Heyy PuzzleYou, play shinchan. Pleaseee?”
Error handling
If the user names a game which hasn’t ever been unlocked-
I believe the puzzle is yet to be solved, let’s try that first!!
If the user says something totally non contextual-
Ah, I see. I believe you should totally discuss this with your mom.
Exploring the new emerging technology- VUI in a kids application
Learnings and Takeaways
#1 Kids interfaces require more observation
As my users belong to the younger age group (3-8), they were not able to express how seamless the task flow was. I refined my interface based on observations of their behaviour.
#2 Natural language processing is the hardest part of VUI
Making the interface as human alike as possible, so that kid can comfortably interact with the application. Adding the basic prompts considering how vague a child brain can be.