Name
Title | ||
|---|---|---|
Personalized Movie Summarization Using Deep CNN-Assisted Facial Expression Recognition |
Abstract | ||
|---|---|---|
Personalized movie summarization is demand of the current era due to an exponential growth in movies production. The employed methods for movies summarization fail to satisfy the user's requirements due to the subjective nature of movies data. Therefore, in this paper, we present a user-preference based movie summarization scheme. First, we segmented movie into shots using a novel entropy-based shots segmentation mechanism. Next, temporal saliency of shots is computed, resulting in highly salient shots in which character faces are detected. The resultant shots are then forward propagated to our trained deep CNN model for facial expression recognition (FER) to analyze the emotional state of the characters. The final summary is generated based on user-preferred emotional moments from the seven emotions, i.e., afraid, angry, disgust, happy, neutral, sad, and surprise. The subjective evaluation over five Hollywood movies proves the effectiveness of our proposed scheme in terms of user satisfaction. Furthermore, the objective evaluation verifies the superiority of the proposed scheme over state-of-the-art movie summarization methods. |
Year | DOI | Venue |
|---|---|---|
2019 | 10.1155/2019/3581419 | COMPLEXITY |
Field | DocType | Volume |
Automatic summarization,Facial expression recognition,Segmentation,Salience (neuroscience),Disgust,Speech recognition,Artificial intelligence,Surprise,Mathematics,Machine learning,Salient | Journal | 2019 |
ISSN | Citations | PageRank |
1076-2787 | 1 | 0.34 |
References | Authors | |
0 | 5 | |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Ijaz Ul Haq | 1 | 7 | 2.77 |
| Amin Ullah | 2 | 109 | 11.60 |
| Khan Muhammad | 3 | 986 | 67.67 |
| Mi Young Lee | 4 | 2 | 3.06 |
| Sung Wook Baik | 5 | 960 | 57.77 |