TY - GEN
T1 - Movie genre classification based on poster images with deep neural networks
AU - Chu, Wei Ta
AU - Guo, Hung Jui
N1 - Publisher Copyright:
© 2017 ACM.
PY - 2017/10/27
Y1 - 2017/10/27
N2 - We propose to achieve movie genre classification based only on movie poster images. A deep neural network is constructed to jointly describe visual appearance and object information, and classify a given movie poster image into genres. Because a movie may belong to multiple genres, this is a multi-label image classification problem. To facilitate related studies, we collect a large-scale movie poster dataset, associated with various metadata. Based on this dataset, we fine-tune a pretrained convolutional neural network to extract visual representation, and adopt a state-of-the-art framework to detect objects in posters. Two types of information is then integrated by the proposed neural network. In the evaluation, we show that the proposed method yields encouraging performance, which is much better than previous works.
AB - We propose to achieve movie genre classification based only on movie poster images. A deep neural network is constructed to jointly describe visual appearance and object information, and classify a given movie poster image into genres. Because a movie may belong to multiple genres, this is a multi-label image classification problem. To facilitate related studies, we collect a large-scale movie poster dataset, associated with various metadata. Based on this dataset, we fine-tune a pretrained convolutional neural network to extract visual representation, and adopt a state-of-the-art framework to detect objects in posters. Two types of information is then integrated by the proposed neural network. In the evaluation, we show that the proposed method yields encouraging performance, which is much better than previous works.
UR - https://www.scopus.com/pages/publications/85035762136
UR - https://www.scopus.com/pages/publications/85035762136#tab=citedBy
U2 - 10.1145/3132515.3132516
DO - 10.1145/3132515.3132516
M3 - Conference contribution
AN - SCOPUS:85035762136
T3 - MUSA2 2017 - Proceedings of the Workshop on Multimodal Understanding of Social, Affective and Subjective Attributes, co-located with MM 2017
SP - 39
EP - 45
BT - MUSA2 2017 - Proceedings of the Workshop on Multimodal Understanding of Social, Affective and Subjective Attributes, co-located with MM 2017
PB - Association for Computing Machinery, Inc
T2 - 1st ACM MM Workshop on Multimodal Understanding of Social, Affective and Subjective Attributes, MUSA2 2017
Y2 - 27 October 2017
ER -