CAMeRA

spacer

Coppelia team

spacer

head

Coppélia Project

To make a robot that emotionally is more human-like, it should be capable of balancing simultaneously occurring tendencies of positive and negative affect. This double Ph.D. track shared between Communication Science (Social Sciences) and Artificial Intelligence (Sciences) is about the modeling of robot attitudes and testing the robot’s behavior with real users. Underlying theories are the Interactive model of Perceiving and Experiencing Fictional Characters (I-PEFiC) and Gross’ model of emotion regulation. The primary modeling language is LEADSTO.

The Coppélia project includes two Ph.D. tracks:

 

Virtual Agents for Human Communication - Emotion Regulation and Involvement-Distance Trade-Offs in Embodied Conversational Agents and Robots

Ph.D. student: Matthijs Pontier

Promotors: Peter Vorderer, Jan Treur
Supervisors: Johan Hoorn, Tibor Bosse

 

Abstract PhD project Matthijs
Thus far, conversational agents and social robots were mainly developed from a technical point of view; e.g., ELIZA (Weizenbaum, 1966). The underlying model was almost lay theory, showing that smiles express happiness and frowns sadness (cf. Breazeal, 2002). Yet, most agents and robots fail conversation-wise because they cannot apply the right emotional response to the right situation. In this interdisciplinary research project, we will apply theories and models from mediated interpersonal communication, human-computer interaction and media psychology to embodied conversational agents. In doing so, the agents will be capable of social interaction and human-like communication. Ideally, theory and simulation should be so good that in a Turing Test (Turing, 1964), people will not be able to tell the difference. If there are significant differences, the experiments will show where the used theories and models have to be improved.

 

 

Development of Cognitive Models for Intelligent Virtual Agents

 

Ph.D. student: Ghazanfar Farooq Sidiqui

Promotors: Jan Treur, Peter Vorderer
Supervisors: Tibor Bosse, Johan Hoorn


Abstract PhD project Ghazanfar

Recently, a variety of such cognitive models have been (and are still being) developed for different aspects of human behaviour. Examples include models for reasoning processes (Rips, 1994), visual attention (Itti and Koch, 2001), emotion regulation (Marsella and Gratch, 2003), mindreading (Marsella, Pynadath, and Read, 2004), stress and workload (Endsley, 1995), and moods (Beck, 1987). If such models are represented in a formal format, this opens the possibility to equip IVAs with them. However, the step from existing cognitive models (that are mostly used for simulation purposes) to computational models (that can directly be plugged in to a virtual (3D) environment, in such a way that the IVAs behave according to the cognitive model.
Given the above, the main goal of the current Ph.D. project is to incorporate cognitive models within virtual agents. This goal can be split up into three important sub-goals: 1) to help establishing a library of cognitive models (at a conceptual, implementation-independent level) for a number of cognitive processes (in particular: mindreading, emotion regulation, and moods), 2) to implement these cognitive models into IVAs in one or more virtual environments, and 3) to evaluate the behaviour of the IVAs that are equipped with the cognitive models.

 

 

robotics

 

 
Journal Publication
Bullet

Hoorn, J. F., & Pontier, M. A. (2008). Robot communication - human contact with androids. Information Design Journal 2008, vol. 16, no. 3, pp. 236-241.. pdf

 

 

2009 Conference Publications
Bullet Pontier, M. A., and Siddiqui, G. F., Silicon Coppélia: Integrating three affect-related models for establishing richer agent interaction In: Proceedings of the Eighth IEEE/WIC/ACM International Conference on Intelligent Agent Technology, IAT'09, 2009. To appear.

Bullet

Pontier, M. A., and Siddiqui, G. F., Affective agents perceiving each other’s actions. In: Otamendi, J., Bargiela, A., Montes, J.L., Pedrera, L.M.D. (eds.), Proceedings of the 23rd European Conference on Modelling and Simulation, ECMS'2009. European Council for Modelling and Simulation, 2009, pp. 194-202.
Nominated for best paper award :  pdf

 

2008 Conference Publications

Bullet

Hoorn, J. F., Pontier, M. A., & Siddiqui, G. F. (2008). When the user is instrumental to robot goals. Proceedings of IEEE/WIC/ACM Intelligent Agent Technology 2008. Sydney, AU: IEEE/WIC/ACM.  pdf

Bullet Hoorn, J. F. (2008). A robot’s experience of its user: Theory. In V. Sloutsky, B.C. Love, & K. McRae (Eds.), Proceedings of the 30th Annual Conference of the Cognitive Science Society (pp. 2504-2509). Washington DC: Cognitive Science Society. pdf
Bullet Bosse, T., Hoorn, J. F., Pontier, M. A., & Siddiqui, G. F. (2008). A Robot’s Experience of Another Robot: Simulation. In V. Sloutsky, B. C. Love, & K. McRae (Eds.), Proceedings of the 30th Annual Conference of the Cognitive Science Society (pp. 2498-2503). Washington DC: Cognitive Science Society. pdf
Bullet

Pontier, M., and Siddiqui, G.F., A virtual therapist that responds empathically to your answers. In: Proceedings of the 8th International Conference on Intelligent Virtual Agents, IVA’08, 2008, pp. 417-425. Preliminary version:  pdf

View the Prototype Virtual Therapist application (Downloading and installing Haptek Player is required to view this application)

Bullet Pontier, M. A., Simulating the Effects of Therapies and Traumas on Emotion Regulation. In: Louca, L. S., Chrysanthou, Y., Oplatkova, Z., and Al-Begain, K. (eds.) Proceedings of the 22nd European Conference on Modeling and Simulation, ECMS'08, 2008, pp. 104-110. Preliminary version pdf

 

2007 Conference Publications

Bullet Bosse, T., Pontier, M., Siddiqui, G.F., and Treur, J., Incorporating Emotion Regulation into Virtual Stories. In: Pelachaud, C., Martin, J.C., Andre, E., Chollet, G., Karpouzis, K., and Pele, D. (eds.), Proceedings of the Seventh International Conference on Intelligent Virtual Agents, IVA'07. Lecture Notes in Artificial Intelligence, vol. 4722. Springer Verlag, 2007, pp. 339-347. pdf
Bullet Bosse, T., Pontier, M., and Treur, J., A Computational Model for Adaptive Emotion Regulation. In: Lin, T.Y., Bradshaw, J.M., Klusch, M., Zhang, C., Broder, A., and Ho, H.(eds.), Proceedings of the Sixth IEEE/WIC/ACM International Conference on Intelligent Agent Technology, IAT'07. IEEE Computer Society Press, 2007, pp. 289-293. pdf
Bullet Bosse, T., Pontier, M., and Treur, J., A Dynamical System Modelling Approach to Gross’ Model of Emotion Regulation. In: Lewis, R.L., Polk, T.A., Laird, J.E.(eds.), Proceedings of the 8th International Conference on Cognitive Modeling, ICCM'07. Taylor and Francis, 2007, pp. 187-192. pdf