Multimodal Content Adaptations for Heterogeneous Devices


  • Susan W. McRoy University of Wisconsin-Milwaukee, USA
  • Songsak Channarukul Assumption University, Thailand
  • Syed S. Ali University of Wisconsin-Milwaukee, USA


We present Multiface, a multimodal dialog system that allows users to interact using different devices such as desktop computers, PDAs, and mobile phones. Users can request information and will receive multimodal responses, where the presented content and its modality are customized to individual and the device they are using. In addition, the system will attempt to assess the user's understanding and adapt its future responses accordingly. Multiface uses a plan-based approach to produce adaptive content and modalities from an annotated document and models of the user and device.