Title
A multi-modal mobile device for learning japanese kanji characters through mnemonic stories
Abstract
We describe the design of a novel multi-modal, mobile computer system to support foreign students in learning Japanese kanji characters through creation of mnemonic stories. Our system treats complicated kanji shapes as hierarchical compositions of smaller shapes (following Heisig, 1986) and allows hyperlink navigation to quickly follow whole-part relationships. Visual display of kanji shape and meaning are augmented with user-supplied mnemonic stories in audio form, thereby dividing the learning information multi-modally into visual and audio modalities. A device-naming scheme and color-coding allow for asynchronous sharing of audio mnemonic stories among different users' devices. We describe the design decisions for our mobile multi-modal interface and present initial usability results based on feedback from beginning kanji learners. Our combination of mnemonic stories, audio and video modalities, and mobile device provide a new and effective system for computer-assisted kanji learning.
Year
DOI
Venue
2007
10.1145/1322192.1322250
ICMI
Keywords
Field
DocType
audio modality,audio form,mobile multi-modal interface,mobile computer system,mobile device,mnemonic story,audio mnemonic story,multi-modal mobile device,effective system,user-supplied mnemonic story,design decision,kanji,mobile computing,language education,mobile computer
Mobile computing,Asynchronous communication,Chinese characters,Computer science,Usability,Mobile device,Human–computer interaction,Hyperlink,Mnemonic,Multimedia,Kanji
Conference
Citations 
PageRank 
References 
3
0.65
1
Authors
3
Name
Order
Citations
PageRank
Norman Lin1101.32
Shoji Kajita214721.92
Kenji Mase31066308.34