Title
Building a Word Segmenter for Sanskrit Overnight.
Abstract
There is an abundance of digitised texts available in Sanskrit. However, the word segmentation task in such texts are challenging due to the issue of u0027Sandhiu0027. In Sandhi, words in a sentence often fuse together to form a single chunk of text, where the word delimiter vanishes and sounds at the word boundaries undergo transformations, which is also reflected in the written text. Here, we propose an approach that uses a deep sequence to sequence (seq2seq) model that takes only the sandhied string as the input and predicts the unsandhied string. The state of the art models are linguistically involved and have external dependencies for the lexical and morphological analysis of the input. Our model can be trained overnight and be used for production. In spite of the knowledge lean approach, our system preforms better than the current state of the art by gaining a percentage increase of 16.79 % than the current state of the art.
Year
Venue
DocType
2018
LREC
Conference
Volume
Citations 
PageRank 
abs/1802.06185
0
0.34
References 
Authors
10
6
Name
Order
Citations
PageRank
Vikas Reddy100.34
Amrith Krishna265.91
Vishnu Dutt Sharma310.69
Prateek Gupta4898.92
Vineeth M. R500.34
Pawan Goyal66413.01