A framework of an agent planning with reinforcement learning for e-pet

Sheng-Tzong Cheng, Tun Yu Chang, Chih Wei Hsu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

E-pet is an animal-type robot companions, he can be physical or electronic. Reinforcement learning (RL) can be applied to the e-pet. However, the interactive instruction is constituted by complex activities. In this study, we proposed a framework that integrated AI planning technology into RL to generate the solution. In the framework, the e-pet interacts with human and includes two components: environment and agent. The agent exploits AI planning to seek goal state and Markov decision process (MDP) to choose the action and updates each Q-value using Q-learning algorithm. And we proposed the three-level subsumption architecture which including instinct level, perception level, and planning level. We build layers corresponding to each level of competence and can simply add a new layer to an existing set to move to the next higher level of overall competence. We implement the e-pet in a 3D model and train the agent. Experimental result shows that the update of Q-table reduces the number of planning states in the framework.

Original languageEnglish
Title of host publicationICOT 2013 - 1st International Conference on Orange Technologies
Pages310-313
Number of pages4
DOIs
Publication statusPublished - 2013 Jul 12
Event1st International Conference on Orange Technologies, ICOT 2013 - Tainan, Taiwan
Duration: 2013 Mar 122013 Mar 16

Publication series

NameICOT 2013 - 1st International Conference on Orange Technologies

Other

Other1st International Conference on Orange Technologies, ICOT 2013
CountryTaiwan
CityTainan
Period13-03-1213-03-16

    Fingerprint

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications

Cite this

Cheng, S-T., Chang, T. Y., & Hsu, C. W. (2013). A framework of an agent planning with reinforcement learning for e-pet. In ICOT 2013 - 1st International Conference on Orange Technologies (pp. 310-313). [6521220] (ICOT 2013 - 1st International Conference on Orange Technologies). https://doi.org/10.1109/ICOT.2013.6521220