Photo squarization by deep multi-operator retargeting

Yu Song, Xiaopeng Zhang, Fan Tang, Oliver Deussen, Weiming Dong, Tong Yee Lee

研究成果: Conference contribution

7 引文 斯高帕斯(Scopus)


Squared forms of photos are widely used in social media as album covers or thumbnails of image streams. In this study, we realize photo squarization by modeling Retargeting Visual Perception Issues, which reflect human perception preference toward image ratarget-ing. General image retargeting techniques deal with three common issues, namely, salient content, object shape, and scene composition, to preserve the important information of original image. We propose a new way based on multi-operator techniques to investigate human behavior in balancing the three issues. We establish a new dataset and observe human behavior by inviting investigators to retarget images to square manually. We propose a data-driven approach composed of perception and distillation modules by using deep learning techniques to predict human perception preference. The perception part learns the relations among the three issues, and the distillation part transfers the learned relations to a simple but effective network. Our study contributes to deep learning literature by optimizing a network index and lightening its running burden. Experimental results show that photo squarization results generated by the proposed model are consistent with human visual perception results.

主出版物標題MM 2018 - Proceedings of the 2018 ACM Multimedia Conference
發行者Association for Computing Machinery, Inc
出版狀態Published - 2018 十月 15
事件26th ACM Multimedia conference, MM 2018 - Seoul, Korea, Republic of
持續時間: 2018 十月 222018 十月 26


名字MM 2018 - Proceedings of the 2018 ACM Multimedia Conference


Other26th ACM Multimedia conference, MM 2018
國家/地區Korea, Republic of

All Science Journal Classification (ASJC) codes

  • 電腦繪圖與電腦輔助設計
  • 人機介面


深入研究「Photo squarization by deep multi-operator retargeting」主題。共同形成了獨特的指紋。