hmilogo

Publications by Project SSPNET (122)

 

2014

Journal Papers

Bihan Jiang, M. Valstar, B. Martinez and M. Pantic A dynamic appearance descriptor approach to facial actions temporal modeling, IEEE Transactions on Cybernetics, 44(2):161-174, ISSN 2168-2267, 2014 [ BiBTeX Eprints  DOI>  Download PDF document
R.W. Poppe, S. Van Der Zee, D.K.J. Heylen and P.J. Taylor AMAB: Automated measurement and analysis of body motion, Behavior Research Methods, 46(3):625-633, ISSN 1554-3528, 2014 [ BiBTeX Eprints  DOI>  Download PDF document
I.A. de Kok, R.W. Poppe and D.K.J. Heylen Iterative perceptual learning for social behavior synthesis, Journal on Multimodal User Interfaces , 8(3):231-241, ISSN 1783-7677, 2014 *** ISI Impact 0.830 *** [ BiBTeX Eprints  DOI>  Download PDF document

 

Contributions to Proceedings

B. Rahayudi, R.W. Poppe and D.K.J. Heylen Twente Debate Corpus - A Multimodal Corpus for Head Movement Analysis, in Proceedings of the International Conference on Language Resources and Evaluation (LREC 2014), European Language Resources Association (ELRA), Luxembourg, ISBN 978-2-9517408-8-4, pp. 26-31, 2014 [ BiBTeX Eprints  Download HTML document  Download PDF document
S.M.A. Lamers, K.P. Truong, B. Steunenberg, F.M.G. de Jong and G.J. Westerhof Applying prosodic speech features in mental health care: An exploratory study in a life-review intervention for depression, in Proceedings of the ACL Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality, Association for Computational Linguistics, Baltimore, Maryland, USA, ISBN 978-1-941643-16-7, pp. 61-68, 2014 [ BiBTeX Eprints  [Official URL]  Download PDF document
K.P. Truong and J. Trouvain Investigating prosodic relations between initiating and responding laughs, in Proceedings of the 15th Annual Conference of the International Speech Communication Association (INTERSPEECH 2014), International Speech Communication Association (ISCA), ISSN 2308-457X, pp. 1811-1815, 2014 [ BiBTeX Eprints  Download HTML document  Download PDF document
M. Soleymani, S. Asghari-Esfeden, M. Pantic and Yun Fu Continuous emotion detection using EEG signals and facial expressions, in Proceedings of the IEEE International Conference on Multimedia and Expo (ICME 2014), IEEE Computer Society, USA, ISBN 978-1-4799-4761-4, pp. 1-6, 2014 [ BiBTeX Eprints  DOI>  Download PDF document

 

2013

Dissertations

I.A. de Kok Listening Heads, PhD Thesis, University of Twente, September 12 2013, Twente University Press, Enschede, ISSN 1381-3617, ISBN 978-90-365-0648-9, Pages: 146, Promotors: D.K.J. Heylen and A. Nijholt, 2013 [ BiBTeX Eprints  DOI>  Download PDF document

 

Journal Papers

R.W. Poppe, K.P. Truong and D.K.J. Heylen Perceptual evaluation of backchannel strategies for artificial listeners, Autonomous Agents and Multi-Agent Systems, 27(2):235-253, ISSN 1387-2532, 2013 *** ISI Impact 0.790 *** [ BiBTeX Eprints  DOI>  Download PDF document
B. Martinez, M. Valstar, X. Binefa and M. Pantic Local Evidence Aggregation for Regression-Based Facial Point Detection, IEEE transactions on pattern analysis and machine intelligence, 35(5):1149-1163, ISSN 0162-8828, 2013 *** ISI Impact 4.800 *** [ BiBTeX Eprints  DOI>  Download PDF document
K. Bousmalis, S. Zafeiriou, L.P. Morency and M. Pantic Infinite conditional random fields for human behavior analysis, IEEE Transactions on Neural Networks and Learning Systems, 24(1):170-177, ISSN 2162-237X, 2013 *** ISI Impact 3.770 *** [ BiBTeX Eprints  DOI>  Download PDF document

 

Contributions to Proceedings

J. Trouvain and K.P. Truong Exploring sequences of speech and laughter activity using visualisations of conversations, in Proceedings of the Workshop on Affective Social Speech Signals, Université de Grenoble, Grenoble, pp. 5-9, 2013 [ BiBTeX Eprints  Download PDF document
K.P. Truong, G.J. Westerhof, S.M.A. Lamers, F.M.G. de Jong and A. Sools Emotional expression in oral history narratives: comparing results of automated verbal and nonverbal analyses, in Proceedings of the Workshop on Computational Models of Narrative, CMN 2013, OpenAccess Series in Informatics (OASIcs), volume 32, Schloss Dagstuhl--Leibniz-Zentrum fuer Informatik, Dagstuhl, Germany, ISBN 978-3-939897-57-6, ISSN 2190-6807, pp. 310-314, 2013 [ BiBTeX Eprints  DOI>  Download PDF document
I.A. de Kok and D.K.J. Heylen Controlling the listener response rate of virtual agents, in Proceedings of the 13th International Conference on Intelligent Virtual Agents, IVA 2013, Lecture Notes in Computer Science , volume 8108, Springer Verlag, Berlin, ISBN 978-3-642-40414-6, ISSN 0302-9743, pp. 168-179, 2013 [ BiBTeX Eprints  DOI>  Download PDF document
I.A. de Kok, D.K.J. Heylen and L.-P. Morency Speaker-adaptive multimodal prediction model for listener responses, in Proceedings of the 15th ACM on International conference on multimodal interaction, ICMI 2013, ACM, New York, ISBN 978-1-4503-2129-7, pp. 51-58, 2013 [ BiBTeX Eprints  DOI>  Download PDF document
M. Soleymani and M. Pantic Multimedia implicit tagging using EEG signals, in Proceedings of the IEEE International Conference on Multimedia and Expo, ICME 2013, IEEE Computer Society, USA, ISBN 978-1-4799-0015-2, ISSN 1945-7871, pp. 1-6, 2013 [ BiBTeX Eprints  DOI>  Download PDF document
K. Bousmalis, S. Zafeiriou, L.P. Morency, M. Pantic and Z. Ghahramani Variational Hidden Conditional Random Fields with Coupled Dirichlet Process Mixtures, in European Conference Machine Learning and Knowledge Discovery in Databases, ECML PKDD 2013, Lecture Notes in Computer Science, volume 8189, Springer Verlag, Berlin, ISBN 978-3-642-40990-5, ISSN 0302-9743, pp. 531-547, 2013 [ BiBTeX Eprints  DOI>  Download PDF document
S. Eleftheriadis, O. Rudovic and M. Pantic Shared Gaussian Process Latent Variable Model for Multi-view Facial Expression Recognition, in 9th International Symposium on Advances in Visual Computing, ISVC 2013, Lecture Notes in Computer Science, volume 8033, Springer Verlag, Berlin Heidelberg, ISBN 978-3-642-41913-3, ISSN 0302-9743, pp. 527-538, 2013 [ BiBTeX Eprints  DOI>  Download PDF document
A. Oikonomopoulos and M. Pantic Human Activity Recognition Using Hierarchically-Mined Feature Constellations, in 9th International Symposium on Visual Computing, ISVC 201313, Lecture Notes in Computer Science, volume 8033, Springer Verlag, Berlin, ISBN 978-3-642-41913-3, ISSN 0302-9743, pp. 150-159, 2013 [ BiBTeX Eprints  DOI>  Download PDF document
T.F. Krikke and K.P. Truong Detection of nonverbal vocalizations using Gaussian Mixture Models: looking for fillers and laughter in conversational speech, in Proceedings of the 14th Annual Conference of the International Speech Communication Association, Interspeech 2013, International Speech Communication Association, Baixas, Framce, ISSN 2308-457X, pp. 163-167, 2013 [ BiBTeX Eprints  Download HTML document  Download PDF document
K.P. Truong Classification of cooperative and competitive overlaps in speech using cues from the context, overlapper, and overlappee, in Proceedings of the 14th Annual Conference of the International Speech Communication Association, Interspeech 2013, International Speech Communication Association, Baixas. France, ISSN 2308-457X, pp. 1404-1408, 2013 [ BiBTeX Eprints  Download HTML document  Download PDF document
J. Orozco, B. Martinez and M. Pantic Empirical Analysis of Cascade Deformable Models for Multi-View Face Detection, in Proceedings of the IEEE International Conference on Image Processing, ICIP 2013, IEEE Computer Society, USA, ISBN not assigned, pp. 5, 2013 [ BiBTeX Eprints  [Official URL]  Download PDF document

 

2012

Journal Papers

I.A. de Kok and D.K.J. Heylen Analyzing Nonverbal Listener Responses using Parallel Recordings of Multiple Listeners, Cognitive Processing, 13(Supplement 2):499-506, ISSN 1612-4782, 2012 *** ISI Impact 1.567 *** [ BiBTeX Eprints  DOI>  Download PDF document
K.P. Truong, D.A. van Leeuwen and F.M.G. de Jong Speech-based recognition of self-reported and observed emotion in a dimensional space, Speech communication, 54(9):1049-1063, ISSN 0167-6393, 2012 *** ISI Impact 1.267 *** [ BiBTeX Eprints  DOI>  Download PDF document
P. Brunet, R. Cowie, D.K.J. Heylen, A. Nijholt and M. Schroeder Conceptual Frameworks for Multimodal Social Signal Processing, Journal on Multimodal User Interfaces, J.-C. Martin (eds), 6(3-4):95-99, ISSN 1783-7677, 2012 [ BiBTeX Eprints  DOI>  Download PDF document
A. Nijholt, R. Arkin, S. Brault, R. Kulpa, F. Multon, B. Bideau, D. Traum, Hayley Hung, E. Santos Jr., Deqing Li, Fei Yu, Lina Zhou and Dongsong Zhang Computational Deception and Noncooperation, IEEE Intelligent Systems, A. Nijholt and D. Zeng (eds), 27(6):60-75, ISSN 1541-1672, 2012 *** ISI Impact 2.154 *** [ BiBTeX Eprints  DOI>  Download PDF document
M.F. Valstar, M. Mehu, Bihan Jiang, M. Pantic and K. Scherer Meta-Analysis of the First Facial Expression Recognition Challenge, IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, 42(4):966-979, ISSN 1083-4419, 2012 *** ISI Impact 3.080 *** [ BiBTeX Eprints  DOI>  Download PDF document
M.F. Valstar and M. Pantic Fully Automatic Recognition of the Temporal Phases of Facial Actions, IEEE Transactions on Systems, Man and Cybernetics – Part B: Cybernetics, 42(1):28-43, ISSN 1083-4419, 2012 *** ISI Impact 3.080 *** [ BiBTeX Eprints  DOI>  Download PDF document
A. Vinciarelli, M. Pantic, D.K.J. Heylen, C. Pelachaud, I. Poggi, F. D’Ericco and M. Schroeder Bridging the Gap between Social Animal and Unsocial Machine: A Survey of Social Signal Processing, IEEE Transactions on Affective Computing, 3(1):69-87, ISSN 1949-3045, 2012 [ BiBTeX Eprints  DOI>  Download PDF document
M. Mehu, F. D’Errico and D.K.J. Heylen Conceptual analysis of social signals: the importance of clarifying terminology, Journal of Multimodal User Interfaces, 6(3-4):179-189, ISSN 1783-7677, 2012 [ BiBTeX Eprints  DOI>  Download PDF document

 

Books

Proceedings of the 14th ACM International Conference on Multimodal Interaction, ICMI’12, L.-P. Morency, D. Bohus, H. Aghajan, A. Nijholt, J. Cassell and J. Epps (eds), ACM, New York, ISBN 978-1-4503-1467-1, pp. 618, 2012 [ BiBTeX Eprints  [Official URL]  Download PDF document

 

Book Chapters

H.J.A. op den Akker, D. Gatica Perez and D.K.J. Heylen Multi-modal analysis of small-group conversational dynamics, pp. 155-169. In Multimodal Signal Processing, S. Renals, H. Bourlard, J. Carletta and A. Popescu-Belis (eds), Cambridge University Press, New York, ISBN 978-1-107-02229-4, 2012 [ BiBTeX Eprints  [Official URL]  Download PDF document
D.K.J. Heylen Ambient Utopia, pp. 3-16. In Agents and Ambient Intelligence, T. Bosse (eds), SISWO, Amsterdam, ISSN 1875-4163, ISBN 978-1-61499-049-9, 2012 [ BiBTeX Eprints  DOI>  Download PDF document

 

Contributions to Proceedings

Xiaofan Sun, A. Nijholt and M. Pantic Towards Mimicry Recognition during Human Interactions: Automatic Feature Selection and Representation, in Proceedings 4th International ICST Conference on Intelligent Technologies for Interactive Entertainment (INTETAIN 2011), Revised Selected Papers, A.S. Camurri and C. Costa (eds), Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, volume 78, Springer Verlag, Heidelberg, ISBN 978-3-642-30213-8, ISSN 1867-8211, pp. 160-169, 2012 [ BiBTeX Eprints  DOI>  Download PDF document
A. Nijholt and A. Vinciarelli Measuring Engagement: Affective and Social Cues in Interactive Media, in Proceedings Measuring Behavior 2012, A.J. Spink, F. Grieco, O.E. Krips, L.W.S. Loijens, L.P.J.J. Noldus and P.H. Zimmerman (eds), Noldus Information Technology, Wageningen, ISBN 978-90-74821-87-2, pp. 72-74, 2012 [ BiBTeX Eprints  Download PDF document
J. Trouvain and K.P. Truong Comparing non-verbal vocalisations in conversational speech corpora, in Proceedings of the 4th International Workshop on Corpora for Research on Emotion Sentiment and Social Signals (ES3 2012), L. Devillers, B. Schuller, A. Batliner, P. Rosso, E. Douglas-Cowie, R. Cowie and C. Pelachaud (eds), European Language Resources Association (ELRA), Paris, France, ISBN not assigned, pp. 36-39, 2012 [ BiBTeX Eprints  Download PDF document  Download PDF document
K.P. Truong and J. Trouvain Laughter annotations in conversational speech corpora - possibilities and limitations for phonetic analysis, in Proceedings of the 4th International Workshop on Corpora for Research on Emotion Sentiment and Social Signals (ES3 2012), European Language Resources Association (ELRA), Paris, France, ISBN not assigned, pp. 20-24, 2012 [ BiBTeX Eprints  Download PDF document  Download PDF document
L.-P. Morency, D. Bohus, H. Aghajan, A. Nijholt, J. Cassell and J. Epps ICMI 2012 chairs’ welcome, in Proceedings ICMI’12: 14th ACM International Conference on Multimodal Interaction, L.-P. Morency, D. Bohus, H. Aghajan, A. Nijholt, J. Cassell and J. Epps (eds), ACM, New York, ISBN 978-1-4503-1467-1, pp. 2, 2012 [ BiBTeX Eprints  [Official URL]  Download PDF document
K.P. Truong and D.K.J. Heylen Measuring prosodic alignment in cooperative task-based conversations, in Proceedings of the 13th Annual Conference of the International Speech Communication Association (Interspeech 2012), International Speech Communication Association, France, ISSN 1990-9772, pp. 843-846, 2012 [ BiBTeX Eprints  Download HTML document  Download PDF document
K.P. Truong and J. Trouvain On the acoustics of overlapping laughter in conversational speech, in Proceedings of the 13th Annual Conference of the International Speech Communication Association (Interspeech 2012), International Speech Communication Association, France, ISSN 1990-9772, pp. 851-854, 2012 [ BiBTeX Eprints  Download HTML document  Download PDF document
J. Trouvain and K.P. Truong Convergence of laughter in conversational speech: effects of quantity, temporal alignment and imitation, in Proceedings of the International Symposium on Imitation and Convergence in Speech, ISICS 2012, Laboratoire Parole et Langage, CNRS, Aix-en-Provence, ISBN not assigned, pp. 37-38, 2012 [ BiBTeX Eprints  Download PDF document  Download PDF document
J. Trouvain and K.P. Truong Acoustic, Morphological, and Functional Aspects of ”yeah/ja’ in Dutch, English and German, in Proceedings of the Interdisciplinary Workshop on Feedback Behaviors, University of Texas, El Paso, ISBN not assigned, pp. 77-80, 2012 [ BiBTeX Eprints  Download PDF document  Download PDF document
Bihan Jiang, M. Valstar and M. Pantic Facial action detection using block-based pyramid appearance descriptors, in Proceedings of the IEEE International Conference on Social Computing, SocialCom 2012, IEEE Computer Society, USA, ISBN 978-1-4673-5638-1, pp. 429-434, 2012 [ BiBTeX Eprints  DOI>  Download PDF document
M. Soleymani and M. Pantic Human-Centered Implicit Tagging: Overview and Perspectives, in 2012 IEEE International Conference on Systems, Man, and Cybernetics (SMC), IEEE Computer Society, USA, ISBN 978-1-4673-1713-9, pp. 3304-3309, 2012 [ BiBTeX Eprints  DOI>  Download PDF document

 

Reports

I.A. de Kok, R.W. Poppe and D.K.J. Heylen Iterative Perceptual Learning for Social Behavior Synthesis, Technical Report, TR-CTIT-12-01, Enschede, Centre for Telematics and Information Technology, University of Twente, Pages: 9, 2012 [ BiBTeX Eprints  Download PDF document

 

Misc

J. Lichtenauer, M. Valstar, Xiaofan Sun, A. Nijholt and M. Pantic Mahnob HMI IBug Mimicry Database (MHI-MIMICRY), extreport, 2012 [ BiBTeX Eprints  Download PDF document  Download PDF document

 

2011

Journal Papers

D. Reidsma, I.A. de Kok, D. Neiberg, S. Pammi, B. van Straalen, K.P. Truong and H. van Welbergen Continuous Interaction with a Virtual Human, Journal on Multimodal User Interfaces, A.A. Salah and T. Gevers (eds), 4(2):97-118, ISSN 1783-7677, 2011 [ BiBTeX Eprints  DOI>  Download PDF document
A. Nijholt Intetain 2011: Conference Report, ICaST, ICST’s Global Community Magazine, F. Granelli (eds), pages 1, ISSN 2032-8745, 2011 [ BiBTeX Eprints  [Official URL]  Download PDF document
A. Oikonomopoulos, I. Patras and M. Pantic Spatiotemporal Localization and Categorization of Human Actions in Unsegmented Image Sequences, IEEE Transactions on Image Processing, 20(4):1126-1140, ISSN 1057-7149, 2011 *** ISI Impact 3.042 *** [ BiBTeX Eprints  DOI>  Download PDF document

 

Books

Analysis of Verbal and Nonverbal Communication and Enactment. The Processing Issues, A. Esposito, A. Vinciarelli, K. Vicsi, C. Pelachaud and A. Nijholt (eds), Lecture Notes in Computer Science , Vol: 6800. Springer Verlag, Berlin, ISSN 0302-9743, ISBN 978-3-642-25774-2, pp. 462, 2011 [ BiBTeX Eprints  DOI>  Download PDF document

 

Book Chapters

A. Vinciarelli, H. Salamin, G. Mohammadi and K.P. Truong More Than Words: Inference of Socially Relevant Information from Nonverbal Vocal Cues in Speech, pp. 23-33. In Toward Autonomous, Adaptive, and Context-Aware Multimodal Interfaces. Theoretical and Practical Issues, A. Esposito, A.M. Esposito, R. Martone, V. Muller and G. Scarpetta (eds), Springer Verlag, Berlin, ISBN 978-3-642-18183-2, 2011 [ BiBTeX Eprints  DOI>  Download PDF document
M. Pantic, R. Cowie, F. D’Errico, D.K.J. Heylen, M. Mehu, C. Pelachaud, I. Poggi, M. Schroeder and A. Vinciarelli Social Signal Processing: The Research Agenda, pp. 511-538. In Visual Analysis of Humans, T.B. Moeslund, A. Hilton, V. Kruger and L. Sigal (eds), Springer Verlag, London, ISBN 978-0-85729-996-3, 2011 [ BiBTeX Eprints  DOI>  Download PDF document

 

Contributions to Proceedings

E.M.A.G. van Dijk, J. Zwiers, H.J.A. op den Akker, O. Kulyk, G.H.W. Hondorp, D.H.W. Hofs and A. Nijholt Conveying Directional Gaze Cues to Support Remote Participation in Hybrid Meetings, in Third COST 2102 International Training School, A. Esposito, A.M. Esposito, R. Martone, V.C. Müller and G. Scarpetta (eds), Lecture Notes in Computer Science , volume 6456, Springer Verlag, London, ISBN 978-3-642-18183-2, ISSN 0302-9743, pp. 425-441, 2011 [ BiBTeX Eprints  DOI>  Download PDF document
D. Neiberg and K.P. Truong Online Detection Of Vocal Listener Responses With Maximum Latency Constraints, in Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), IEEE Signal Processing Society, USA, ISBN 978-1-4577-0538-0 , ISSN 1520-6149, pp. 5836-5839, 2011 [ BiBTeX Eprints  DOI>  Download PDF document
Xiaofan Sun, A. Nijholt, K.P. Truong and M. Pantic Automatic visual mimicry expression analysis in interpersonal interaction, in IEEE Computer Vision and Pattern Recognition Workshops, CVPRW 2011, IEEE Computer Society, USA, ISBN 978-1-4577-0529-8, ISSN 2160-7508, pp. 40-46, 2011 [ BiBTeX Eprints  DOI>  Download PDF document
Xiaofan Sun, K.P. Truong, A. Nijholt and M. Pantic Automatic Understanding of Affective and Social Signals by Multimodal Mimicry Recognition, in Proceedings 4th International Conference on Affective Computing and Intelligent Interaction (ACII 2011), S. D’Mello, A. Graesser, B. Schuller and J.-C. Martin (eds), Lecture Notes in Computer Science , volume 6975, Springer Verlag, Berlin, ISBN 978-3-642-24570-1, ISSN 0302-9743, pp. 289-296, 2011 [ BiBTeX Eprints  DOI>  Download PDF document
Xiaofan Sun, J. Lichtenauer, M. Valstar, A. Nijholt and M. Pantic A Multimodal Database for Mimicry Analysis, in Proceedings 4th International Conference on Affective Computing and Intelligent Interaction (ACII2011), Part I, S. D’Mello, A. Graesser, B. Schuller and J.-C. Martin (eds), Lecture Notes in Computer Science , volume 6974, Springer Verlag, Berlin, ISBN 978-3-642-24599-2, ISSN 0302-9743, pp. 367-376, 2011 [ BiBTeX Eprints  DOI>  Download PDF document
K.P. Truong, R.W. Poppe, I.A. de Kok and D.K.J. Heylen A Multimodal Analysis of Vocal and Visual Backchannels in Spontaneous Dialogs, in Proceedings of Interspeech 2011, International Speech Communication Association, France, ISSN 1990-9772, pp. 2973-2976, 2011 [ BiBTeX Eprints  Download HTML document  Download PDF document
Xiaofan Sun, K.P. Truong, M. Pantic and A. Nijholt Towards visual and vocal mimicry recognition in human-human interactions, in IEEE International Conference on Systems, Man, and Cybernetics (SMC 2011): Special Session on Social Signal Processing, E. Tunstel, S. Nahavandi and A. Stoica (eds), IEEE Computer Society, USA, ISBN 978-1-4577-0652-3, ISSN 1062-922X, pp. 367-373, 2011 [ BiBTeX Eprints  DOI>  Download PDF document
A. Esposito, A. Vinciarelli, K. Vicsi, C. Pelachaud and A. Nijholt Preface (to: Analysis of Verbal and Nonverbal Communication and Enactment: The Procesing Issues), in Proceedings International Conference on Analysis of Verbal and Nonverbal Communication and Enactment: The Processing Issues, A. Esposito, A. Vinciarelli, K. Vicsi, C. Pelachaud and A. Nijholt (eds), Lecture Notes in Computer Science , volume 6800, Springer Verlag, Berlin, ISBN 978-3-642-25774-2, ISSN 0302-9743, pp. 3, 2011 [ BiBTeX Eprints  DOI>  Download PDF document
Xiaofan Sun and A. Nijholt Multimodal Embodied Mimicry in Interaction, in International Conference on Analysis of Verbal and Nonverbal Communication and Enactment: The Processing Issues, A. Esposito, A. Vinciarelli, K. Vicsi, C. Pelachaud and A. Nijholt (eds), Lecture Notes in Computer Science , volume 6800, Springer Verlag, Berlin, ISBN 978-3-642-25774-2, ISSN 0302-9743, pp. 147-153, 2011 [ BiBTeX Eprints  DOI>  Download PDF document
K. Bousmalis, L.-P. Morencey and M. Pantic Modeling hidden dynamics of multimodal cues for spontaneous agreement and disagreement recognition, in IEEE International Conference on Automatic Face & Gesture Recognition and Workshops (FG 2011), IEEE Computer Society, USA, ISBN 978-1-4244-9140-7 , pp. 746-752, 2011 [ BiBTeX Eprints  DOI>  Download PDF document
S. Liwicki, S. Zafeiriou, G. Tzimiropoulos and M. Pantic Fast and Robust Appearance-based Tracking, in IEEE International Conference on Automatic Face & Gesture Recognition and Workshops (FG 2011), IEEE Computer Society, USA, ISBN 978-1-4244-9140-7 , pp. 507-513, 2011 [ BiBTeX Eprints  DOI>  Download PDF document
G. Sandbach, S. Zafeiriou, M. Pantic and D. Rueckert A dynamic approach to the recognition of 3D facial expressions and their temporal models , in IEEE International Conference on Automatic Face & Gesture Recognition and Workshops (FG 2011), IEEE Computer Society, USA, ISBN 978-1-4244-9140-7 , pp. 406-413, 2011 [ BiBTeX Eprints  DOI>  Download PDF document
M.F. Valstar, Bihan Jiang, M. Mehu, M. Pantic and K. Scherer The first facial expression recognition and analysis challenge, in IEEE International Conference on Automatic Face & Gesture Recognition and Workshops (FG 2011), IEEE Computer Society, USA, ISBN 978-1-4244-9140-7, pp. 921-926, 2011 [ BiBTeX Eprints  DOI>  Download PDF document
A. Nijholt The Network of Things: People Included, in Proceedings of the 3rd International Conference on Next Generation Networks and Services, NGNS 2011, IEEE Computer Society, USA, ISBN 978-1-4673-0138-1, pp. 1, 2011 [ BiBTeX Eprints  DOI>  Download PDF document

 

2010

Journal Papers

H.J.A. op den Akker, J. Zwiers, G.H.W. Hondorp, E.M.A.G. van Dijk, O. Kulyk, D.H.W. Hofs, A. Nijholt and D. Reidsma Engagement and Floor Control in Hybrid Meetings, AMI Newsletter, V. Devanthéry (eds), 20(20):6-6, ISSN not assigned, 2010 [ BiBTeX Eprints  Download PDF document
D.H.W. Hofs, M. Theune and H.J.A. op den Akker Natural interaction with a virtual guide in a virtual environment: A multimodal dialogue system, Journal on Multimodal User Interfaces, 3(1-2):141-153, ISSN 1783-7677, 2010 [ BiBTeX Eprints  DOI>  Download PDF document
Z.M. Ruttkay, M. Kipp, A. Nijholt and H.H. Vilhjálmsson From the Editors of the Special Issue, Applied Artificial Intelligence, Z.M. Ruttkay, M. Kipp, A. Nijholt and H.H. Vilhjálmsson (eds), 24(6):489-493, ISSN 0883-9514, 2010 *** ISI Impact 0.333 *** [ BiBTeX Eprints  DOI>  Download PDF document
S. Koelstra, M. Pantic and I. Patras A dynamic texture based approach to recognition of facial actions and their temporal models, IEEE transactions on pattern analysis and machine intelligence, 32(11):1940-1954, ISSN 0162-8828, 2010 *** ISI Impact 4.908 *** [ BiBTeX Eprints  DOI>  Download PDF document
A. Vinciarelli and M. Pantic Techware: www.sspnet.eu: A Web Portal for Social Signal Processing, IEEE Signal Processing Magazine, A. Ortega (eds), 27(4):142-144, ISSN 1053-5888, 2010 *** ISI Impact 4.066 *** [ BiBTeX Eprints  DOI>  Download PDF document
H.J.A. Gunes and M. Pantic Automatic, Dimensional and Continuous Emotion Recognition, International Journal of Synthetic Emotions, J. Vallverdú (eds), 1(1):68-99, ISSN 1947-9093, 2010 [ BiBTeX Eprints  DOI>  Download PDF document

 

Book Chapters

M. Theune and C.J. Brandhorst To Beat or Not to Beat: Beat Gestures in Direction Giving, pp. 195-206. In Gesture in Embodied Communication and Human-Computer Interaction, S. Kopp and I. Wachsmuth (eds), Springer Verlag, Berlin Heidelberg, ISSN 0302-9743, ISBN 978-3-642-12552-2, 2010 [ BiBTeX Eprints  DOI>  Download PDF document

 

Contributions to Proceedings

C. Mühl, H. Gürkök, D. Plass-Oude Bos, M.E. Thurlings, L. Scherffig, M. Duvinage, A.A. Elbakyan, SungWook Kang, M. Poel and D.K.J. Heylen Bacteria Hunt: A multimodal, multiparadigm BCI game, in Proceedings of the Fifth International Summer Workshop on Multimodal Interfaces, eNTERFACE'09, A.S. Camurri, M. Mancini and G. Volpe (eds), DIST-University of Genova, Genova, ISBN 978-88-901344-7-0, pp. 41-62, 2010 [ BiBTeX Eprints  [Official URL]  Download PDF document
E.L. van den Broek, A. Nijholt and J.H.D.M. Westerink Symposium: Unveiling Affective Signals, in Proceedings of Measuring Behavior 2010: The 7th International Conference on Methods and Techniques in Behavioral Research, A.J. Spink, F. Grieco, O.E. Krips, L.W.S. Loijens, L.P.J.J. Noldus and P.H. Zimmerman (eds), Noldus Information Technology bv, Wageningen, The Netherlands, ISBN 978-90-74821-86-5, pp. 94-94, 2010 [ BiBTeX Eprints  Download PDF document
M. ter Maat, K.P. Truong and D.K.J. Heylen How turn-taking strategies influence users’ impressions of an agent, in Proceedings of the International Conference on Intelligent Virtual Agents (IVA), J. Allbeck, N. Badler, T. Bickmore, C. Pelachaud and A. Safonova (eds), Lecture Notes in Computer Science, volume 6356, Springer Verlag, Berlin, ISBN 978-3-642-15891-9, pp. 441-453, 2010 [ BiBTeX Eprints  DOI>  Download PDF document
A.I. Niculescu, D.H.W. Hofs, E.M.A.G. van Dijk and A. Nijholt How the agent’s gender influence users’ evaluation of a QA system, in Proceedings of the International Conference on User Science and Engineering 2010, F. Mohd Saman, N.L. Md Noor, H. Haron, A. Yeo and A. Edwards (eds), IEEE, USA, ISBN 978-1-4244-9049-3, pp. 16-20, 2010 [ BiBTeX Eprints  DOI>  Download PDF document
D. Reidsma, A. Nijholt, W. Tschacher and F. Ramseyer Measuring Multimodal Synchrony for Human-Computer Interaction, in Proceedings of the International Conference on CYBERWORLDS 2010, A. Sourin (eds), IEEE Computer Society, Los Alamitos, ISBN 978-0-7695-4215-7, pp. 67-71, 2010 [ BiBTeX Eprints  DOI>  Download PDF document
K.P. Truong and D.K.J. Heylen Disambiguating the functions of conversational sounds with prosody: the case of ’yeah’, in Proceedings of Interspeech 2010, International Speech Communication Association (ISCA), ISSN 1990-9772, pp. 2554-2557, 2010 [ BiBTeX Eprints  Download PDF document
K.P. Truong, R.W. Poppe and D.K.J. Heylen A rule-based backchannel prediction model using pitch and pause information, in Proceedings of Interspeech 2010, International Speech Communication Association (ISCA), ISSN 1990-9772, pp. 3058-3061, 2010 [ BiBTeX Eprints  Download PDF document
D. Reidsma, K.P. Truong, H. van Welbergen, D. Neiberg, S. Pammi, I.A. de Kok and B. van Straalen Continuous Interaction with a Virtual Human, in Proceedings of the 6th International Summer Workshop on Multimodal Interfaces (eNTERFACE’10), A.A. Salah and T. Gevers (eds), University of Amsterdam, Amsterdam, ISBN 978-90-5776-213-0, pp. 24-39, 2010 [ BiBTeX Eprints  [Official URL]  Download PDF document
H. Salamin, A. Viciarelli, K.P. Truong and G. Mohammadi Automatic Role Recognition Based on Conversational and Prosodic Behaviour, in Proceedings of the ACM International Conference on Multimedia, ACM, New York, ISBN 978-1-60558-933-6, pp. 847-850, 2010 [ BiBTeX Eprints  DOI>  Download PDF document
H.J.A. op den Akker, M. Theune, K.P. Truong and I.A. de Kok The Organisation of Floor in Meetings and the Relation with Speaker Addressee Patterns, in Proceedings of the 2nd International Workshop on Social Signal Processing, SSPW ’10, ACM, New York, ISBN 978-1-4503-0174-9, pp. 35-40, 2010 [ BiBTeX Eprints  DOI>  Download PDF document
J. Jiao and M. Pantic Implicit Image Tagging via Facial Information, in Proceedings of the 2nd International Workshop on Social Signal Processing, SSPW 2010, ACM, New York, ISBN 978-1-4503-0174-9 , pp. 59-64, 2010 [ BiBTeX Eprints  DOI>  Download PDF document
A. Oikonomopoulos, I. Patras and M. Pantic Discriminative Space-time Voting for Joint Recognition and Localization of Actions, in Proceedings of the 2nd International Workshop on Social Signal Processing, SSPW 2010, ACM, New York, ISBN 978-1-4503-0174-9, pp. 11-16, 2010 [ BiBTeX Eprints  DOI>  Download PDF document
O. Rudovic, I. Patras and M. Pantic Coupled Gaussian Process Regression for pose-invariant facial expression recognition, in Proceedings of the 11th European Conference on Computer Vision, ECCV 2010, K. Daniilidis, P. Maragos and N. Paragios (eds), Lecture Notes in Computer Science, volume 6312, Springer Verlag, Berlin, ISBN 978-3-642-15551-2, pp. 350-363, 2010 [ BiBTeX Eprints  DOI>  Download PDF document
H. Gunes and M. Pantic Automatic Measurement of Affect in Dimensional and Continuous Spaces: Why, What, and How?, in Proceedings of the 7th International Conference on Methods and Techniques in Behavioral Research, Measuring Behavior 2010, A.J. Spink, F. Grieco, O.E. Krips, L.W.S. Loijens, L.P.J.J. Noldus and P.H. Zimmerman (eds), Noldus, Wageningen, ISBN 978-90-74821-86-5, pp. 122-126, 2010 [ BiBTeX Eprints  Download PDF document  Download PDF document
O. Rudovic, I. Patras and M. Pantic Regression-based Multi-View Facial Expression Recognition, in Proceedings of the 20th International Conference on Pattern Recognition, ICPR 2010, IEEE Computer Society, USA, ISBN 978-0-7695-4109-9, pp. 4121-4124, 2010 [ BiBTeX Eprints  DOI>  Download PDF document
S. Petridis, A. Asghar and M. Pantic Classifying laughter and speech using audio-visual feature prediction, in Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2010), IEEE Computer Society, USA, ISBN 978-1-4244-4295-9 , ISSN 1520-6149, pp. 5254-5257, 2010 [ BiBTeX Eprints  DOI>  Download PDF document
H. Gunes and M. Pantic Dimensional Emotion Recognition from Spontaneous Head Gestures for Interaction with Sensitive Artificial Listeners, in Proceedings of the 10th International Conference on Intelligent Virtual Agents, IVA 2010, J. Allbeck, N. Badler, T. Bickmore, C. Pelachaud and A. Safonova (eds), Lecture Notes in Computer Science, volume 6356, Springer Verlag, Berlin, ISBN 978-3-642-15892-6 , pp. 371-377, 2010 [ BiBTeX Eprints  DOI>  Download PDF document
M. Nicolaou, H. Gunes and M. Pantic Audio-visual Classification and Fusion of Spontaneous Affect Data in Likelihood Space, in 20th International Conference on Pattern Recognition, ICPR 2010, IEEE Computer Society, USA, ISBN 978-0-7695-4109-9, pp. 3695-3699, 2010 [ BiBTeX Eprints  DOI>  Download PDF document
M.A. Nicolaou, H.J.A. Gunes and M. Pantic Automatic Segmentation of Spontaneous Data using Dimensional Labels from Multiple Coders, in Workshop on Multimodal Corpora: Advances in Capturing, Coding and Analyzing Multimodality, M. Kipp, J.-C. Martin, P. Paggio and D.K.J. Heylen (eds), German Research Center for AI (DFKI), Saarbrucken, ISBN not assigned, pp. 43-48, 2010 [ BiBTeX Eprints  Download PDF document  Download PDF document
D. Tax, M.F. Valstar, M. Pantic and E. Hendriks The detection of concept frames using Clustering Multi-Instance Learning, in 20th International Conference on Pattern Recognition, ICPR 2010 , IEEE Computer Society, USA, ISBN 978-1-4244-7542-1, ISSN 1051-4651, pp. 2917-2920, 2010 [ BiBTeX Eprints  DOI>  Download PDF document
G. McKeown, M.F. Valstar, R. Cowie and M. Pantic The SEMAINE corpus of emotionally coloured character interactions, in IEEE International Conference on Multimedia and Expo, ICME 2010, IEEE Computer Society, USA, ISBN 978-1-4244-7491-2, ISSN 1945-7871, pp. 1079-1084, 2010 [ BiBTeX Eprints  DOI>  Download PDF document
O. Rudovic, I. Patras and M. Pantic Facial Expression Invariant Head Pose Normalization using Gaussian Process Regression, in IEEE Conference on Computer Vision and Pattern Recognition (CVPR '10), Workshop CVPR for Human Communicative Behaviour Analysis (CVPR4HB), volume 3, IEEE Computer Society, USA, ISBN 978-1-4244-7029-7, pp. 28-33, 2010 [ BiBTeX Eprints  DOI>  Download PDF document
M.F. Valstar, B. Martinez, X. Binefa and M. Pantic Facial Point Detection using Boosted Regression and Graph Models, in IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2010, IEEE Computer Society, USA, ISBN 978-1-4244-6984-0, ISSN 1063-6919, pp. 2729-2736, 2010 [ BiBTeX Eprints  DOI>  Download PDF document
B. Martinez, X. Binefa and M. Pantic Facial Component Detection in Thermal Imagery, in IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2010, Workshop on Object Tracking & Classification Beyond and in the Visible Spectrum, volume 3, IEEE Computer Society, USA, ISBN 978-1-4244-7029-7, pp. 48-54, 2010 [ BiBTeX Eprints  DOI>  Download PDF document
E.L. van den Broek, A. Nijholt and J.H.D.M. Westerink Unveiling Affective Signals, in Proceedings of the 7th International Conference on Methods and Techniques in Behavioral Research, MB ’10, E. Barakova, B. de Ruyter and A. Spink (eds), ACM, New York, ISBN 978-1-60558-926-8, pp. 6-9, 2010 [ BiBTeX Eprints  DOI>  Download PDF document

 

2009

Journal Papers

M. Pantic Machine analysis of facial behaviour: Naturalistic and dynamic behaviour, Philosophical Transactions of The Royal Society B, 364(1535):3505-3513, ISSN 0962-8436, 2009 *** ISI Impact 6.401 *** [ BiBTeX Eprints  DOI>  Download PDF document
A. Oikonomopoulos, M. Pantic and I. Patras Sparse B-spline polynomial descriptors for human activity recognition, Image and Vision Computing, 27(12):1814-1825, ISSN 0262-8856, 2009 *** ISI Impact 1.723 *** [ BiBTeX Eprints  DOI>  Download PDF document
M. Pantic and A. Vinciarelli Implicit Human-Centered Tagging, IEEE Signal Processing Magazine, 26(6):173-180, ISSN 1053-5888, 2009 *** ISI Impact 4.066 *** [ BiBTeX Eprints  DOI>  Download PDF document
M. Pantic and J.F. Cohn Visual and multimodal analysis of human spontaneous Behaviour: Introduction to the Special Issue, Image and Vision Computing, M. Pantic and J.F. Cohn (eds), 27(12):1741-1742, ISSN 0262-8856, 2009 *** ISI Impact 1.723 *** [ BiBTeX Eprints  DOI>  Download PDF document
A. Vinciarelli, M. Pantic and H. Bourlard Social Signal Processing: Survey of an Emerging Domain, Image and Vision Computing, 27(12):1743-1759, ISSN 0262-8856, 2009 *** ISI Impact 1.723 *** [ BiBTeX Eprints  DOI>  Download PDF document

 

Books

ACII 2009: Affective Computing and Intelligent Interaction. Proceedings of the Doctoral Consortium, A. Vinciarelli, C. Pelachaud, R. Cowie and A. Nijholt (eds), CTIT Workshop Proceedings Series, Centre for Telematics and Information Technology University of Twente, Enschede, ISSN 0929-0672, pp. 105, 2009 [ BiBTeX Eprints  Download PDF document
Intelligent Virtual Agents, 9th International Conference, IVA 2009Z.M. Ruttkay, M. Kipp, A. Nijholt and H.H. Vilhjálmsson (eds), Lecture Notes in Artificial Intelligence, Vol: 5773. Springer Verlag, London, ISSN 0302-9743, ISBN 978-3-642-04379-6, pp. 571, 2009 [ BiBTeX Eprints  DOI>  Download PDF document
3rd International Conference on Affective Computing and Intelligent Interaction - ACII 2009, J.F. Cohn, A. Nijholt and M. Pantic (eds), ACII 2009 Proceedings, Vol: 1. IEEE Computer Society, Los Alamitos, ISBN 978-1-4244-4799-2, pp. 754, 2009 [ BiBTeX Eprints  DOI>  Download PDF document

 

Book Chapters

A. Vinciarelli, C. Pelachaud, R. Cowie and A. Nijholt Preface of the Proceedings of the Doctoral Consortium, pp. 1. In Proceedings of the Doctoral Consortium. ACII 2009: Affective Computing and Intelligent Interaction, Centre for Telematics and Information Technology University of Twente, Enschede, ISSN 1568-7805, ISBN not assigned, 2009 [ BiBTeX Eprints  Download PDF document
Z.M. Ruttkay, M. Kipp, A. Nijholt and H.H. Vilhjálmsson Preface of the IVA 2009 Proceedings, pp. 2. In Intelligent Virtual Agents: 9th International Conference, Z.M. Ruttkay, M. Kipp, A. Nijholt and H.H. Vilhjálmsson (eds), Springer Verlag, London, ISSN 0302-9743, ISBN 978-3-642-04379-6, 2009 [ BiBTeX Eprints  DOI>  Download PDF document
M. Pantic Facial Expression Analysis, pp. 400-406. In Encyclopedia of biometrics, S. Li and A. Jain (eds), Springer Verlag, London, ISBN 978-0-387-73002-8, 2009 [ BiBTeX Eprints  DOI>  Download PDF document
M. Pantic Affective Computing (revisited), pp. 15-21. In Encyclopedia of Multimedia Technology and Networking - 2nd Edition, M. Pagani (eds), Idea Group Reference, Hershey, PA, USA, ISBN 978-1-60566-014-1, 2009 [ BiBTeX Eprints  Download PDF document
M. Pantic Face for Interface (revisited), pp. 560-567. In Encyclopedia of Multimedia Technology and Networking - 2nd Edition, M. Pagani (eds), Idea Group Reference, Hershey, PA, USA, ISBN 978-1-60566-014-1, 2009 [ BiBTeX Eprints  Download PDF document
Zhihong Zeng, M. Pantic and Thomas S. Huang Emotion Recognition based on Multimodal Information, pp. 241-266. In Affective Information Processing, T. Tan and J. Tao (eds), Springer Verlag, London, ISBN 978-1-84800-305-7, 2009 [ BiBTeX Eprints  DOI>  Download PDF document

 

Contributions to Proceedings

J.F. Cohn, A. Nijholt and M. Pantic Foreword 3rd International Conference on Affective Computing and Intelligent Interaction - ACII 2009, in Proceedings 3rd International Conference on Affective Computing and Intelligent Interaction - ACII 2009, J.F. Cohn, A. Nijholt and M. Pantic (eds), IEEE Computer Society, Los Alamitos, ISBN 978-1-4244-4799-2, pp. 1, 2009 [ BiBTeX Eprints  DOI>  Download PDF document
D.K.J. Heylen, M. Theune, H.J.A. op den Akker and A. Nijholt Social Agents: the first generations, in Proceedings 2009 International Workshop on Social Signals Processing, M. Pantic and A. Vinciarello (eds), ACII 2009 Proceedings, volume 2, IEEE Computer Society, Los Alamitos, ISBN 978-1-4244-4799-2, pp. 114-120, 2009 [ BiBTeX Eprints  DOI>  Download PDF document
S. Petridis, H.J.A. Gunes, S. Kaltwang and M. Pantic Static vs. Dynamic Modelling of Human Nonverbal Behaviour from Multiple Cues and Modalities, in Proceedings of the 2009 International Conference on Multimodal Interfaces (ICMI’09), ACM, New York, ISBN 978-1-60558-772-1, pp. 23-30, 2009 [ BiBTeX Eprints  DOI>  Download PDF document
Jie Shen and M. Pantic A Software Framework for Multimodal Human-Computer Interaction Systems, in Proceedings 2009 IEEE International Conference on Systems, Man and Cybernetics (SMC'09), IEEE Computer Society, Los Alamitos, ISBN 978-1-4244-2794-9, pp. 2038-2045, 2009 [ BiBTeX Eprints  DOI>  Download PDF document
K. Bousmalis, M. Mehu and M. Pantic Spotting Agreement and Disagreement: A Survey of Nonverbal Audiovisual Cues and Tools, in Proceedings of IEEE Int’l Conf. Affective Computing and Intelligent Interfaces (ACII’09), volume 2, IEEE Computer Society, Los Alamitos, ISBN 978-1-4244-4799-2, pp. 1-9, 2009 [ BiBTeX Eprints  DOI>  Download PDF document
J. Lichtenauer, M.F. Valstar, Jie Shen and M. Pantic Cost-effective solution to synchronized audio-visual capture using multiple sensors, in Proceedings 6th International Conference on Advanced Video and Signal Based Surveillance (AVSS '09), IEEE Computer Society, Los Alamitos, ISBN 978-0-7695-3718-4, pp. 324-329, 2009 [ BiBTeX Eprints  DOI>  Download PDF document
A. Vinciarelli, N. Suditu and M. Pantic Implicit Human-Centered Tagging, in IEEE International Conference on Multimedia and Expo (ICME'09), IEEE Computer Society, Los Alamitos, ISBN 978-1-4244-4291-1, ISSN 1945-788X, pp. 1428-1431, 2009 [ BiBTeX Eprints  DOI>  Download PDF document
S. Petridis and M. Pantic Is this joke really funny? Judging the mirth by audiovisual laughter analysis, in IEEE International Conference on Multimedia and Expo (ICME'09), IEEE Computer Society, Los Alamitos, ISBN 978-1-4244-4291-1, ISSN 1945-788X, pp. 1444-1447, 2009 [ BiBTeX Eprints  DOI>  Download PDF document
A. Oikonomopoulos, I. Patras and M. Pantic An implicit spatiotemporal shape model for human activity localization and recognition, in IEEE International Conference on Computer Vision and Pattern Recognition, volume 3, IEEE Computer Society, Los Alamitos, ISBN 978-1-4244-3994-2, pp. 27-33, 2009 [ BiBTeX Eprints  DOI>  Download PDF document
A. Vinciarelli, H. Salamin and M. Pantic Social Signal Processing: Understanding Social Actions through nonverbal behaviour analysis, in IEEE International Conference on Computer Vision and Pattern Recognition (CVPR'09), volume 3, IEEE Computer Society, Los Alamitos, ISBN 978-1-4244-3994-2, pp. 42-49, 2009 [ BiBTeX Eprints  DOI>  Download PDF document

old Parlevink website   colophon   [Back] .