The ubiquitous computing concept has gradually become applied on a wide range of fields. A smart home system is a representation to improve people's lives, convenience and entertainment. This study focuses on human behavior and interaction with smart home system on the field of the kitchen table, and aims to establish a new method of objects pattern recognition, a new interactive way, for smart kitchen. Tangible user interfaces (TUIs) operating concept as the human-computer interaction is applied and expanded. Different usage patterns of the objects were recognized through the camera to produce a corresponding feedback to enhance the interaction of the users. Pattern design was investigated by focus group and the usage condition of pattern recognition technology was satisfactorily tested. Some limitations and further expectations were discussed.