?
A robot commenting texts in an emotional way
This paper is dedicated to modeling emotional reactions on a computer agent and a robot. The affective agent software is processing a natural language text (currently in Russian) with a syntactic parser and it operates with semantic structures. The latter represent sentences or events meanings and consist of valencies with semantic markers in each. Basing on input semantic structures, the agent changes its emotional state over time, generating expressive remarks along with gestures. The reactions subsystem operates with emotional criteria and matches the input semantic representation to scenarios from its database, consequently, it selects relevant reactions from a set of multimodal templates. A model of the emotional process is discussed, and observations based on a multimodal corpus of human emotional expressive cues are applied to synthesize combined reactions expressed in gestures, mimics (eyes and eyebrows) and text. The reactions synthesized are passed to a robot control subsystem and then rendered on a robot.
© Springer International Publishing AG 2017.