Motion-based video retargeting with optimized crop-and-warp

Yu Shuen Wang, Hui Chih Lin, Olga Sorkine, Tong Yee Lee

研究成果: Conference contribution

18 引文 斯高帕斯(Scopus)


We introduce a video retargeting method that achieves high-quality resizing to arbitrary aspect ratios for complex videos containing diverse camera and dynamic motions. Previous content-aware retargeting methods mostly concentrated on spatial considerations, attempting to preserve the shape of salient objects in each frame by removing or distorting homogeneous background content. However, sacrificeable space is fundamentally limited in video, since object motion makes foreground and background regions correlated, causing waving and squeezing artifacts. We solve the retargeting problem by explicitly employing motion information and by distributing distortion in both spatial and temporal dimensions. We combine novel cropping and warping operators, where the cropping removes temporally-recurring contents and the warping utilizes available homogeneous regions to mask deformations while preserving motion. Variational optimization allows to find the best balance between the two operations, enabling retargeting of challenging videos with complex motions, numerous prominent objects and arbitrary depth variability. Our method compares favorably with state-of-the-art retargeting systems, as demonstrated in the examples and widely supported by the conducted user study.

主出版物標題ACM SIGGRAPH 2010 Papers, SIGGRAPH 2010
編輯Hugues Hoppe
發行者Association for Computing Machinery, Inc
出版狀態Published - 2010 七月 26
事件37th International Conference and Exhibition on Computer Graphics and Interactive Techniques, SIGGRAPH 2010 - Los Angeles, United States
持續時間: 2010 七月 262010 七月 30


名字ACM SIGGRAPH 2010 Papers, SIGGRAPH 2010


Other37th International Conference and Exhibition on Computer Graphics and Interactive Techniques, SIGGRAPH 2010
國家United States
城市Los Angeles

All Science Journal Classification (ASJC) codes

  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition
  • Software

指紋 深入研究「Motion-based video retargeting with optimized crop-and-warp」主題。共同形成了獨特的指紋。