NECA Project

The NECA Project (Net Environment for Embodied Emotional Conversational Agents) was a research project that focused on multimodal communication with animated agents in a virtual world. NECA was funded by the European Commission from 1998–2002 and the research results were published up to 2005.[1][2][3]

The project focused on communication between animated agents in a virtual world, using characters that exhibit realistic personality traits and natural looking behavior that reflects the emotional features of conversations. The project goal was to combine different research efforts such as situation-based natural language and speech generation, representation of non-verbal expression, and the modeling of emotions and personality.[1][4][5]

Goals and milestones

The underlying research direction of the NECA Project was the development of a computing platform in which animated characters within a virtual world could be capable of realistic behavior. For character interactions to look natural, various factors such the proxemics of the distance between their bodies as they interact, to the kinesics of body language at the individual level, and the level of eye contact between individuals, as well as the paralinguistics of tone and intonation of sentences had to be considered.

Based on that the research there were three main goals for NECA.[2] The first goal was the general development of a platform that allowed the simulation and interaction of conversational characters.

The second goal was the design of a multi-user web-application called the Socialite, that allowed social "face to face" emotion-based interactions between animated agents on the internet.[1][3] The Socialite user could select a set of avatars to interact with and after learning about the user's personal preferences, the avatars helped the user navigate a virtual world and get in touch with other agents and users.[1]

The third component was eShowRoom as an e-commerce platform demonstration that allowed for the display of products in the commercial domain. In the eShowRoom application, two or three virtual agents could be seen discussing various features of a product among themselves in a natural setting.[5]

Examples of NECA research

One of NECA's designs was the Rich Representation Language, specifically designed to facilitate the interaction of two or more animated agents.[6][7] RRL influenced the design of other languages such as the Player Markup Language which extended parts of the design of RRL.[8]

The design of RRL aimed to automatically generate much of the facial animation as well as the skeletal animation based on the content of the conversations. Due to the interdependence of nonverbal communication components such as facial features on the spoken words, no animation is possible in the language without considering the context of the scene in which the animation takes place - e.g. anger versus joy.[9]

gollark: Also, I know basically nothing about OpenCL or anything, just that it can theoretically be done probably.
gollark: I don't actually have one. You just could possibly.
gollark: But for personal details with a narrower possibility space, I don't think you can really do it securely without taking unreasonably large amounts of time for everyone involved.
gollark: argon2 is the trendy recent one, as I said.
gollark: I wouldn't verify personal detail disclosure like this without using a really slow hash anyway.

See also

Sources
  1. Brigitte Krenn, et al. Lifelike Agents for the Internet in "Agent culture: human-agent interaction in a multicultural world" edited by Sabine Payr, Robert Trappl 2004 ISBN 0-8058-4808-8 pages 197-228
  2. NECA Project description
  3. Brigitte Krenn and Barbara Neumayr Incorporating animated conversation into a web-based Community Building Tool in "Intelligent virtual agents: 4th International Workshop, IVA 2003", edited by Thomas Rist ISBN 3-540-20003-7 pages 18-22
  4. Multimodal Intelligent Information Presentation by Oliviero Stock 2005 ISBN 1-4020-3049-5 page 64
  5. Patrick Gebhard, et al. Coloring Multi-character Conversations through the Expression of Emotions in "Affective dialogue systems" edited by Elisabeth André 2004 ISBN pages 125-139
  6. 'Intelligent virtual agents: 6th international working conference by Jonathan Matthew Gratch 2006 ISBN 3-540-37593-7 page 221
  7. Data-driven 3D facial animation by Zhigang Deng, Ulrich Neumann 2007 ISBN 1-84628-906-8 page 54
  8. Technologies for interactive digital storytelling and entertainment by Stefan Göbel 2004 ISBN 3-540-22283-9 page 83
  9. Interactive storytelling: First Joint International Conference, edited by Ulrike Spierling, Nicolas Szilas 2008 ISBN 3-540-89424-1 page 93
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.