Name
Title | ||
|---|---|---|
The Machine Translation Toolpack for LoonyBin: Automated Management of Experimental Machine Translation HyperWorkflows |
Abstract | ||
|---|---|---|
Construction of machine translation systems has evolved into a multi-stage workflow in- volving many complicated dependencies. Many decoder distributions have addressed this by including monolithic training scripts -train-factored-model.pl for Moses andmr_runmer.pl for SAMT. However, such scripts can be tricky to modify for novel experiments and typically have limited support for the variety of job schedulers found on academic and commercial com- puter clusters. Further complicating these systems are hyperparameters, which often cannot be directly optimized by conventional methods requiring users to determine which combination of values is best via trial and error. The recently-released LoonyBin open-source workflow man- agement tool addresses these issues by providing: 1) a visual interface for the user to create and modify workflows; 2) a well-defined logging mechanism; 3) a script generator that compiles vi- sual workflows into shell scripts, and 4) the concept of Hyperworkflows, which intuitively and succinctly encodes small experimental variations within a larger workflow. In this paper, we describe the Machine Translation Toolpack for LoonyBin, which exposes state-of-the-art ma- chine translation tools as drag-and-drop components within LoonyBin. |
Year | DOI | Venue |
|---|---|---|
2010 | 10.2478/v10108-010-0002-x | Prague Bull. Math. Linguistics |
Keywords | Field | DocType |
machine translation,workflow management,factor model,job scheduling | Trial and error,Computer science,Machine translation,Shell script,Natural language processing,Transfer-based machine translation,Artificial intelligence,Computer-assisted translation,Workflow,Computer cluster,Scripting language | Journal |
Volume | Issue | Citations |
93 | -1 | 6 |
PageRank | References | Authors |
0.86 | 11 | 7 |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Jonathan H. Clark | 1 | 411 | 16.42 |
| Jonathan Weese | 2 | 6 | 0.86 |
| Byung Gyu Ahn | 3 | 6 | 0.86 |
| Andreas Zollmann | 4 | 406 | 17.49 |
| Qin Gao | 5 | 6 | 0.86 |
| Kenneth Heafield | 6 | 126 | 6.35 |
| alon lavie | 7 | 2606 | 177.91 |