エノモト　ミカ   榎本　美香    所属   メディア学部 メディア学科    職種   准教授
言語種別	英語
発行・発表の年月	2007/12
形態種別	国際会議論文
標題	When should animated agents give additional instructions to users? - Monitoring user's understanding in multimodal dialogues -
執筆形態	共著
掲載誌名	ICCAS 2007 - International Conference on Control, Automation and Systems
掲載区分	国外
巻・号・頁	pp.733-736
著者・共著者	Kazuyoshi Murata, Mika Enomoto, Yoshiko Arimoto and Yukiko Nakano
概要	In multimodal communication, verbal and nonverbal behaviors such as gestures and manipulating objects in a workspace occur in parallel, and are coordinated in proper timing to each other. This paper focuses on the interaction between a beginner user using a video recorder application on PC and a multimodal animated help agent, and presents a probabilistic model of fine-grained timing dependencies among different behaviors of different modalities. First, we collect user-agent dialogues using a Wizard-of-Oz experimental setting, and then the collected verbal and nonverbal behavior data will be used to build a Bayesian network model, which can predict the likelihood of successful mouse clicks in near future, given evidence associated with the status of speech, agent's gestures and user's mouse actions. Finally, we attempt to determine proper timing when the agent should give additional instructions by estimating the likelihood of a mouse click occurrence.