Title
Analyzing Social Media Texts and Images to Assess the Impact of Flash Floods in Cities
Abstract
Computer Vision and Image Processing are emerging research paradigms. The increasing popularity of social media, micro- blogging services and ubiquitous availability of high-resolution smartphone cameras with pervasive connectivity are propelling our digital footprints and cyber activities. Such online human footprints related with an event-of-interest, if mined appropriately, can provide meaningful information to analyze the current course and pre- and post- impact leading to the organizational planning of various real-time smart city applications. In this paper, we investigate the narrative (texts) and visual (images) components of Twitter feeds to improve the results of queries by exploiting the deep contexts of each data modality. We employ Latent Semantic Analysis (LSA)-based techniques to analyze the texts and Discrete Cosine Transformation (DCT) to analyze the images which help establish the cross-correlations between the textual and image dimensions of a query. While each of the data dimensions helps improve the results of a specific query on its own, the contributions from the dual modalities can potentially provide insights that are greater than what can be obtained from the individual modalities. We validate our proposed approach using real Twitter feeds from a recent devastating flash flood in Ellicott City near the University of Maryland campus. Our results show that the images and texts can be classified with 67\% and 94\% accuracies respectively
Year
DOI
Venue
2017
10.1109/SMARTCOMP.2017.7946987
2017 IEEE International Conference on Smart Computing (SMARTCOMP)
Keywords
Field
DocType
social media texts,flash flood impact assessment,Twitter feeds,latent semantic analysis,discrete cosine transformation,text analysis,image analysis,dual modalities,Ellicott City,texts classification,image classification,social media images,LSA,DCT
Modalities,World Wide Web,Social media,Information retrieval,Computer science,Popularity,Discrete cosine transform,Narrative,Smart city,Latent semantic analysis,Semantics
Conference
ISBN
Citations 
PageRank 
978-1-5090-6518-9
3
0.49
References 
Authors
8
5
Name
Order
Citations
PageRank
Bipendra Basnyat143.57
Amrita Anam241.21
Neha Singh381.94
Aryya Gangopadhyay4391112.49
Nirmalya Roy540542.11