hmilogo

Adri Wiekens

Email: 


Final project assignment

Title: Feedback generation and presentation for a personal coaching system
Institute: University of Twente (HMI)
Place: Enschede
Country: The Netherlands
Startdate: 01-09-2010
Completed: Yes
Mentor: Rieks op den AkkerBetsy van DijkRandy Klaassen
External mentor:Aart van Halteren
Research themes: Virtual Reality and Graphics, Multimodal Interactions, Intelligent Agents, Speech and Language Technology, Human Factors, Animation
Description:
HMI participates in the European Artemis JU project Smarcos (http://www.smarcos-project.eu).
Smarcos focuses on interusability of multi-device and multi-modal smart service systems.
In this project we develop a personal coaching system that supports office workers in having an active lifestyle. Participants decide upon their own target level of daily activity. The coaching system receives measurements and reports about the actual activities through mobile activity sensors.
Based on the data, the personal user profile and the personal target, the coach must give timely and personalised feedback to the client.

In this project the student will:

  1. first design and implement the feedback system, so that it can recieve the necessary data and send generated feedback to the clients.
  2. In the second part two ways of presenting the feedback will be implemented. One is by means of a text message, the other is a presentation by a humanoid. For the second animated presentation we will use the BML realizer Elckerlyc developed at HMI (see Van Welbergen et al. 2010 [link]).
  3. The final part is a user study in which we measure effectiveness and user perception of the coach's presentation.


Capita selecta and Research Topics assignment

Title: Facial expressions of storytellers (embodied agents)
Institute: University of Twente (HMI)
Place: Enschede
Country: The Netherlands
Startdate: 26-10-2009
Completed: Yes
Report:http://hmi.ewi.utwente.nl/verslagen/capita-selecta/CS-Wiekens-Adri.pdf
Mentor: Mariët Theune
Research themes: Intelligent Agents, Speech and Language Technology, Human Factors, Animation
Description:
Storytellers use various techniques to create certain effects on their audience, to capture their attention and evoke certain emotions. For example, they can use facial expressions to simulate character emotions, eyebrow movements to emphasize certain words, or gaze to indicate different speakers in characters dialogues.

The goal of this research is to systematically study such expressive storyteller behaviour, to model it, and ultimately to implement it in an embodied storytelling agent. (NB: not all these steps can be carried out within the limits of a Capita Selecta research.)

Steps to be taken to answer this question may include:

* Literature study on emotional facial expressions
* Empirical research / data analysis: which expressions do human storytellers use and when? (video material is available)
* Modelling the results for use in a storytelling talking face
* Testing the model (using implementation or simulation)

Some literature:

* Ekman, P. About brows: Emotional and conversational signals. In J. Aschoff, M. von Carnach, K. Foppa, W. Lepenies, & D. Plog (Eds.), Human ethology (pp. 169-202). Cambridge: Cambridge University Press, 1979.
* Paradiso & M. L'Abbate (2001). A model for the generation and combination of emotional expressions. Proc. Workshop on Multi-modal Communication and Context in Embodied Agents, Autonomous Agents 2001, Montréal, Canada, pp. 65-70.
* Poggi & C. Pelachaud (2000). Performative facial expressions in animated faces. In J. Cassell, J. Sullivan, S. Prevost, & E. Churchill (Eds.) Embodied Conversational Agents. Cambridge, MA: MIT Press.
* Various papers on emotions: http://emotion-research.net/dfki_bibliography_view
* Papous, The Virtual Storyteller (diverse publicaties)

old Parlevink website   colophon   [Back] .