Title
Efficient Large-Scale Domain Classification with Personalized Attention.
Abstract
In this paper, we explore the task of mapping spoken language utterances to one of thousands of natural language understanding domains in intelligent personal digital assistants (IPDAs). This scenario is observed for many mainstream IPDAs in industry that allow third parties to develop thousands of new domains to augment built-in ones to rapidly increase domain coverage and overall IPDA capabilities. We propose a scalable neural model architecture with a shared encoder, a novel attention mechanism that incorporates personalization information and domain-specific classifiers that solves the problem efficiently. Our architecture is designed to efficiently accommodate new domains that appear in-between full model retraining cycles with a rapid bootstrapping mechanism two orders of magnitude faster than retraining. We account for practical constraints in real-time production systems, and design to minimize memory footprint and runtime latency. We demonstrate that incorporating personalization results in significantly more accurate domain classification in the setting with thousands of overlapping domains.
Year
DOI
Venue
2018
10.18653/v1/p18-1206
meeting of the association for computational linguistics
Field
DocType
Volume
Architecture,Computer science,Bootstrapping,Natural language understanding,Artificial intelligence,Encoder,Memory footprint,Spoken language,Machine learning,Personalization,Scalability
Journal
abs/1804.08065
Citations 
PageRank 
References 
1
0.36
24
Authors
4
Name
Order
Citations
PageRank
Young-Bum Kim111213.60
Dongchan Kim221.75
Anjishnu Kumar3152.68
Ruhi Sarikaya469864.49