Capita Selecta bij HMI Over HMI Afstuderen bij HMIStages bij HMI

 

Thomas Visser




Afstudeeropdracht

Titel: Incremental Grounding in Spoken Dialogue Systems (working title)
Instituut: University of Southern California
Plaats: Marina del Rey, CA
Land: USA
Begindatum: 07-11-2011
Voltooid: Nee
Begeleider: Dirk Heylen
Onderwerpen: Multimodal Interactions
Beschrijving:
In this work, we will focus on incrementally processing of user utterances for grounding purposes. This includes the detection of user's grounding actions as well as the generation of grounding actions for system response from partial results from the ASR. To convey those grounding actions, the system will generate overlapping or low-latency responses to user utterances, e.g. backchannels to acknowledge understanding or interrupting the user to signal misunderstanding.

Our effort will lie in 1) determining where in an utterance or after which incremental result grounding is appropriate, e.g. after each installment or when the user pauses, 2) determining when to perform a grounding action as response and how to convey it, e.g. choosing between a head nod, shake or “ok" to provide appropriate listener's feedback, and 3) determining how the common ground is updated based on grounding actions both by the user and the system.

Our goal is to develop a computational model for incremental grounding, supported by a theoretical analysis of previous work and comparison of existing approaches to incremental analysis and incremental grounding in particular. The model will be implemented in the SASO Spoken Dialogue System for testing purposes.




Capita Selectaopdracht

Titel: A survey of XML languages for augmented reality content
Instituut: University of Twente (HMI)
Plaats: Enschede
Land: Nederland
Begindatum: 01-01-2011
Voltooid: Ja
Verslag:http://hmi.ewi.utwente.nl/verslagen/capita-selecta/RT-Visser-Thomas.pdf
Begeleider: Mannes Poel
Onderwerpen: Virtual Reality and Graphics
Beschrijving:
In this paper, a survey of XML languages that are used to store content for augmented reality (AR) applications is presented. The goal of the study was to assess the possibilities for standardising the format of AR content to enable interoperability between different AR browsers. There are AR browsers that use a XML language based on KML, an existing standard, others use their own XML language or do not use XML. It was shown that none of the four treated XML languages did comply to all requirements that were gathered from the analysis of three AR browsers. ARML and KARML, both extensions of KML, were too limited in their functionality, and Junaio XML, which adhered to the most requirements, did reinvent aspects that could have been taken from KML. Further progress into creating a standard for AR content could be made by extending ARML or KARML or by rewriting Junaio XML as an extension of KML.