Title
Exploring the Ideal Depth of Neural Network when Predicting Question Deletion on Community Question Answering
Abstract
In recent years, Community Question Answering (CQA) has emerged as a popular platform for knowledge curation and archival. An interesting aspect of question answering is that it combines aspects from natural language processing, information retrieval, and machine learning. In this paper, we have explored how the depth of the neural network influences the accuracy of prediction of deleted questions in question-answering forums. We have used different shallow and deep models for prediction and analyzed the relationships between number of hidden layers, accuracy, and computational time. The results suggest that while deep networks perform better than shallow networks in modeling complex non-linear functions, increasing the depth may not always produce desired results. We observe that the performance of the deep neural network suffers significantly due to vanishing gradients when large number of hidden layers are present. Constantly increasing the depth of the model increases accuracy initially, after which the accuracy plateaus, and finally drops. Adding each layer is also expensive in terms of the time required to train the model. This research is situated in the domain of neural information retrieval and contributes towards building a theory on how deep neural networks can be efficiently and accurately used for predicting question deletion. We predict deleted questions with more than 90% accuracy using two to ten hidden layers, with less accurate results for shallower and deeper architectures.
Year
DOI
Venue
2019
10.1145/3368567.3368568
Proceedings of the 11th Forum for Information Retrieval Evaluation
Keywords
Field
DocType
Analysis, Artificial Intelligence, Community Question Answering, Deep Learning, Machine Learning, Prediction, Question Deletion
Situated,Data mining,Question answering,Computer science,Artificial intelligence,Deep learning,Artificial neural network,Machine learning,Deep neural networks
Conference
ISBN
Citations 
PageRank 
978-1-4503-7750-8
0
0.34
References 
Authors
0
2
Name
Order
Citations
PageRank
Souvick Ghosh1177.81
Satanu Ghosh200.34