Developing an augmented painting interface for enhancing children painting experience

This study proposes a sketch environment for young children using computer vision and augmented reality. Using minimalistic interface, while discounting the time required to master the art form in real life, an AR sketch system presents a friendly way for children to learn and appreciate paintings. The proposed sketch system consists of sketch contour extraction, image processing, and augmented reality (AR) rendering. Pen and paper are the main interface for users to execute strokes; a web camera is used to capture the sketched page of the sketchbook; while the system uses the marker printed on each page to compute the spatial information for further AR rendering. The image processing algorithms extract the stroke contours and brush embellishment to convey the painting influence. Individual painting elements are then segmented and assigned 3D coordinates for positioning within the AR environment. A practical user study was conducted during a formal art class of ten-year-old children in an elementary school. Interviews and questionnaires were used after class to evaluate the level of enjoyment provided and the usability of the system. The survey results showed the sketch system encourages young children to participate and brings the natural painting experience to an educational environment. The outcome of the study potentially opens up alternative opportunities for AR applications.