Title
Deep CNNs with Self-Attention for Speaker Identification
Abstract
Most current works on speaker identification are based on i-vector methods; however, there is a marked shift from the traditional i-vector to deep learning methods, especially in the form of convolutional neural networks (CNNs). Rather than designing features and a subsequent individual classification model, we address the problem by learning features and recognition systems using deep neural networks. Based on the deep convolutional neural network (CNN), this paper presents a novel text-independent speaker identification method for speaker separation. Specifically, this paper is based on the two representative CNNs, called the visual geometry group (VGG) nets and residual neural networks (ResNets). Unlike prior deep neural network-based speaker identification methods that usually rely on a temporal maximum or average pooling across all time steps to map variable-length utterances to a fixed-dimension vector, this paper equips these two CNNs with a structured self-attention mechanism to learn a weighted average across all time steps. Using the structured self-attention layer with multiple attention hops, the proposed deep CNN network is not only capable of handling variable-length segments but also able to learn speaker characteristics from different aspects of the input sequence. The experimental results on the speaker identification benchmark database, VoxCeleb demonstrate the superiority of the proposed method over the traditional i-vector-based methods and the other strong CNN baselines. In addition, the results suggest that it is possible to cluster unknown speakers using the activation of an upper layer of a pre-trained identification CNN as a speaker embedding vector.
Year
DOI
Venue
2019
10.1109/ACCESS.2019.2917470
IEEE ACCESS
Keywords
Field
DocType
Speaker identification,deep neural networks,self-attention,embedding learning
Speaker identification,Computer science,Speech recognition,Distributed computing
Journal
Volume
ISSN
Citations 
7
2169-3536
1
PageRank 
References 
Authors
0.34
0
3
Name
Order
Citations
PageRank
Nguyen Nang An110.68
Nguyen Quang Thanh210.68
Yanbing Liu315516.38