Furniture style compatibility recommendation with cross-class triplet loss

Tse Yu Pan, Yi Zhu Dai, Min Chun Hu, Wen Huang Cheng

Research output: Contribution to journalArticlepeer-review

2 Citations (Scopus)

Abstract

Harmonizing the style of all the furniture placed within a constrained space/scene is an important principle for interior design. In this paper, we propose a furniture style compatibility recommendation approach for users to create a harmonic 3D virtual scene based on 2D furniture photos. Most previous works of 3D model style analysis measure the style similarity or compatibility based on predefined geometric features extracted from 3D models. However, “style” is a high-level semantic concept, which is difficult to be described explicitly by hand-crafted geometric features. Moreover, analyzing the style compatibility between two or more furniture belonging to different classes (e.g., table and lamp) is much more challenging since the given furniture may have very distinctive structures or geometric elements. Recently, deep neural network has been claimed to have more powerful ability to mimic the perception of human visual cortex, and therefore we propose to analyze style compatibility between 3D furniture models of different classes based on a Cross-Class Triplet Convolutional Neural Network (CNN). We conducted experiments based on a collected dataset containing 420 textured 3D furniture models. A group of raters were recruited from Amazon Mechanical Turk (AMT) to evaluate the comparative suitability of paired models within the dataset. The experimental results reveal that the proposed furniture style compatibility method based on deep learning performs better than the state-of-the-art method and can be used to efficiently generate harmonic virtual scenes.

Original languageEnglish
Pages (from-to)2645-2665
Number of pages21
JournalMultimedia Tools and Applications
Volume78
Issue number3
DOIs
Publication statusPublished - 2019 Feb 1

All Science Journal Classification (ASJC) codes

  • Software
  • Media Technology
  • Hardware and Architecture
  • Computer Networks and Communications

Fingerprint Dive into the research topics of 'Furniture style compatibility recommendation with cross-class triplet loss'. Together they form a unique fingerprint.

Cite this