Title
Context-aware Retrieval-based Deep Commit Message Generation
Abstract
AbstractCommit messages recorded in version control systems contain valuable information for software development, maintenance, and comprehension. Unfortunately, developers often commit code with empty or poor quality commit messages. To address this issue, several studies have proposed approaches to generate commit messages from commit diffs. Recent studies make use of neural machine translation algorithms to try and translate git diffs into commit messages and have achieved some promising results. However, these learning-based methods tend to generate high-frequency words but ignore low-frequency ones. In addition, they suffer from exposure bias issues, which leads to a gap between training phase and testing phase.In this article, we propose CoRec to address the above two limitations. Specifically, we first train a context-aware encoder-decoder model that randomly selects the previous output of the decoder or the embedding vector of a ground truth word as context to make the model gradually aware of previous alignment choices. Given a diff for testing, the trained model is reused to retrieve the most similar diff from the training set. Finally, we use the retrieval diff to guide the probability distribution for the final generated vocabulary. Our method combines the advantages of both information retrieval and neural machine translation. We evaluate CoRec on a dataset from Liu et al. and a large-scale dataset crawled from 10K popular Java repositories in Github. Our experimental results show that CoRec significantly outperforms the state-of-the-art method NNGen by 19% on average in terms of BLEU.
Year
DOI
Venue
2021
10.1145/3464689
ACM Transactions on Software Engineering and Methodology
Keywords
DocType
Volume
Commit message generation, neural machine translation, information retrieval
Journal
30
Issue
ISSN
Citations 
4
1049-331X
1
PageRank 
References 
Authors
0.35
0
6
Name
Order
Citations
PageRank
H Wang110.35
Xin Xia227826.27
David Lo35346259.67
Qiang He421723.35
xinyu559030.19
John Grundy614619.78