Title
Sign language animation using TVML
Abstract
The deaf communities in Japan use a visual language called Japanese Sign Language (JSL) as their first language. Learning to read Japanese can be difficult for some deaf people, because JSL has a totally different grammar from Japanese. NHK broadcasts news and other programs in sign language (sign language broadcasts), but there is a strong demand from deaf communities for more sign language broadcasts. This motivated us to pursue technology for generating sign language animation. Our recent work has focused on adapting TVML (TV program Making Language) [Hayashi 1996; TVML Website] for use in producing sign language animation. TVML is a text-based computer language that produces computer graphics (CG) animated TV programs by simply writing a script in TVML. At first, we recorded body movements representing sign language words using an optical motion capture technology. In addition, we improved TVML to express manual movements of sign language and developed a Japanese-to-JSL dictionary with a collection of about 4,900 sign language words. Now in this latest work, we have developed a scheme for combining multiple captured motion data to generate sign language sentences using CG animation.
Year
DOI
Venue
2010
10.1145/1900179.1900240
VRCAI
Keywords
Field
DocType
tvml website,sign language broadcast,cg animation,sign language animation,sign language word,sign language,deaf community,text-based computer language,sign language sentence,visual language,motion capture,computer graphic,language learning
Japanese Sign Language,Visual language,Computer science,Manually coded language,Natural language,Sign language,Natural language processing,Animation,Universal Networking Language,Artificial intelligence,First language
Conference
Citations 
PageRank 
References 
6
0.97
1
Authors
4
Name
Order
Citations
PageRank
Hiroyuki Kaneko182.03
Narichika Hamaguchi2245.46
Mamoru Doke3102.85
Seiki Inoue44912.42