Mobile learning is an increasingly important source of educational material. However, only scant research has been directed towards how this educational information can be made accessible to the deaf and hearing impaired communities. Sign language is an effective method of communication for normal people to communicate with these two groups. In this paper, we propose to develop a sign language learning system on mobile devices with a 3D agent to provide an adaptive navigation support and multiple points of 3D animation view for learners. This system conducted in the ubiquitous learning environment which utilizes mobile devices, global positioning system (GPS), and wireless networks. Moreover, a series of life gestures has been developed for learners and with personalized and situated learning supports from the system. The preliminary experimental results have shown the effectiveness of the novel 3D agent sign language learning system.