Name
Title | ||
|---|---|---|
Single- And Multi-Label Classification Of Construction Objects Using Deep Transfer Learning Methods |
Abstract | ||
|---|---|---|
Digital images are extensively used to increase the accuracy and timeliness of progress reports, safety training, requests for information (RFIs), productivity monitoring, and claims and litigation. While these images can be sorted using date and time tags, the task of searching an image dataset for specific visual content is not trivial. In pattern recognition, generating metadata tags describing image contents (objects, scenes) or appearance (colors, context) is referred to as multi-label image annotation. Given the large number and diversity of construction images, it is desirable to generate image tags automatically. Previous work has applied pattern matching to synthetic images or images obtained from constrained settings. In this paper, we present deep learning (particularly, transfer learning) algorithms to annotate construction imagery from unconstrained real-world settings with high fidelity. We propose convolutional neural network (CNN)-based algorithms which take RGB values as input and output the labels of detected objects. Particularly, we have investigated two categories of classification tasks: single-label classification, i.e., a single class (among multiple predefined classes) is assigned to an image, and multi-label classification, i.e., a set of (one or more) classes is assigned to an image. For both cases, the VGG-16 model, pre-trained on the ImageNet dataset, is trained on construction images retrieved with web mining techniques and labeled by human annotators. Testing the trained model on previously unseen photos yields an accuracy of similar to 90% for single-label classification and similar to 85% for multi-label classification, indicating the high sensitivity and specificity of the designed methodology in reliably identifying the contents of construction imagery. |
Year | DOI | Venue |
|---|---|---|
2019 | 10.36680/j.itcon.2019.028 | JOURNAL OF INFORMATION TECHNOLOGY IN CONSTRUCTION |
Keywords | DocType | Volume |
Deep learning, transfer learning, convolutional neural networks, construction photos, web mining, multi-class classification, multi-label classification | Journal | 24 |
Issue | ISSN | Citations |
28 | 1874-4753 | 0 |
PageRank | References | Authors |
0.34 | 0 | 3 |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Nipun D. Nath | 1 | 0 | 0.68 |
| Theodora Chaspari | 2 | 38 | 19.43 |
| Amir H. Behzadan | 3 | 122 | 17.55 |