Title
Homogeneous segmentation and classifier ensemble for audio tag annotation and retrieval
Abstract
Audio tags describe different types of musical information such as genre, mood, and instrument. This paper aims to automatically annotate audio clips with tags and retrieve relevant clips from a music database by tags. Given an audio clip, we divide it into several homogeneous segments by using an audio novelty curve, and then extract audio features from each segment with respect to various musical information, such as dynamics, rhythm, timbre, pitch, and tonality. The features in frame-based feature vector sequence format are further represented by their mean and standard deviation such that they can be combined with other segment-based features to form a fixed-dimensional feature vector for a segment. We train an ensemble classifier, which consists of SVM and AdaBoost classifiers, for each tag. For the audio annotation task, the individual classifier outputs are transformed into calibrated probability scores such that probability ensemble can be employed. For the audio retrieval task, we propose using ranking ensemble. We participated in the MIREX 2009 audio tag classification task and our system was ranked first in terms of F-measure and the area under the ROC curve given a tag.
Year
DOI
Venue
2010
10.1109/ICME.2010.5583009
ICME
Keywords
Field
DocType
audio tag annotation,ensemble method,frame-based feature vector sequence format,adaboost classifier,homogeneous segmentation,audio novelty curve,information retrieval,audio segmentation,svm classifier,audio tag retrieval,music database,ensemble classifier,audio feature extraction,feature extraction,signal classification,f-measure,calibrated probability scores,audio signal processing,mirex 2009 audio tag classification task,ranking ensemble,classifier ensemble,support vector machines,probability ensemble,roc curve,probability,f measure,standard deviation,accuracy,classification algorithms,feature vector,measurement
Feature vector,AdaBoost,Pattern recognition,Computer science,Audio mining,Support vector machine,Feature extraction,Speech recognition,Artificial intelligence,Classifier (linguistics),Statistical classification,Audio signal processing
Conference
ISSN
ISBN
Citations 
1945-7871
978-1-4244-7491-2
9
PageRank 
References 
Authors
0.60
11
3
Name
Order
Citations
PageRank
Hung-Yi Lo11188.33
Ju-Chiang Wang221514.46
Hsin-min Wang31201129.62