Publications

Challenges for the Policy Representation when Applying Reinforcement Learning in Robotics. Kormushev, P., Calinon, S., Ugurlu, B., and Caldwell, D.G., (conference paper, currently being submitted), 2012.
[pdf] [bibtex]

Reinforcement Learning with Evolving Policy Parameterization. Kormushev, P., Ugurlu, B., Calinon, S., Tsagarakis, N., and Caldwell, D.G., (journal paper, currently being submitted), 2012.
[pdf] [bibtex]

Bipedal Walking Energy Minimization by Reinforcement Learning with Evolving Policy Parameterization. Kormushev, P., Ugurlu, B., Calinon, S., Tsagarakis, N., and Caldwell, D.G., Proc. IEEE/RSJ Intl Conf. on Intelligent Robots and Systems (IROS-2011), San Francisco, 2011.
[pdf] [bibtex]

Upper-body Kinesthetic Teaching of a Free-standing Humanoid Robot. Kormushev, P., Nenchev, D.N., Calinon, S., and Caldwell, D.G., IEEE Intl. Conf. on Robotics and Automation (ICRA 2011), pp. 3970-3975, 2011.
[pdf] [bibtex]

Imitation learning of positional and force skills demonstrated via kinesthetic teaching and haptic input. Kormushev, P., Calinon, S., and Caldwell, D.G., Advanced Robotics, Vol. 25, pp. 581-603, 2011.
[pdf] [bibtex]

Time Hopping Technique for Faster Reinforcement Learning in Simulations. Kormushev, P., Nomoto, K., Dong, F., and Hirota, K., International Journal of Cybernetics and Information Technologies (CIT), Vol. 11, No. 3, pp. 42-59, 2011.
[pdf] [bibtex]

Whiteboard Cleaning Task Realization with HOAP-2. Sato, F., Nishii, T., Takahashi, J., Yoshida, Y., Mitsuhashi, M., Kormushev, P., Kanamiya, Y., Proc. SICE System Integration (SI-2010) in Sendai, Japan, pp.426-429, 2010.
[pdf] [bibtex]

Approaches for Learning Human-like Motor Skills which Require Variable Stiffness During Execution. Kormushev, P., Calinon, S., and Caldwell, D.G., Workshop on Humanoid Robots Learning from Human Interaction (link), Humanoids-2010, Nashville, USA, 2010.
[pdf] [bibtex]

Learning the skill of archery by a humanoid robot iCub. Kormushev, P., Calinon, S., Saegusa, R. and Metta, G., Proc. IEEE Intl Conf. on Humanoid Robots (Humanoids-2010), pp. 417-423, 2010.
[pdf] [bibtex]

Robot Motor Skill Coordination with EM-based Reinforcement Learning. Kormushev, P., Calinon, S. and Caldwell, D.G., Proc. IEEE/RSJ Intl Conf. on Intelligent Robots and Systems (IROS-2010), 2010.
[pdf] [bibtex]

Time Hopping Technique for Reinforcement Learning and its Application to Robot Control. Kormushev, P., Dept. of Computational Intelligence and Systems Science, Tokyo Institute of Technology, PhD thesis, September, 2009.

Probability redistribution using time hopping for reinforcement learning. Kormushev, P., K., Dong, F., and Hirota, K., 10th International Symposium on advanced Intelligent Systems ISIS-2009, 2009.

Eligibility propagation to speed up time hopping for reinforcement learning. Kormushev, P., Nomoto, K., Dong, F., and Hirota, K., Journal of Advanced Computational Intelligence and Intelligent Informatics, Vol.13, No.6, 2009.

Time manipulation technique for speeding up reinforcement learning in simulations. Kormushev, P., Nomoto, K., Dong, F., and Hirota, K., International Journal of Cybernetics and Information Technologies, Vol. 8, No. 1, pp. 12-24, January, 2008.

Intent expression using eye robot for mascot robot system. Yamazaki, Y., Dong, F., Masuda, Y., Uehara, Y., Kormushev, P., Vu, H. A., Le, P. Q., and Hirota, K., 8th International Symposium on Advanced Intelligent Systems ISIS-2007, 2007.

Fuzzy inference based mentality estimation for eye robot agent. Yamazaki, Y., Dong, F., Masuda, Y., Uehara, Y., Kormushev, P., Vu, H. A., Le, P. Q., and Hirota, K., Proceedings of 23rd Fuzzy System Symposium FSS-2007, 2007.

INFRAWEBS Axiom editor – a graphical ontology-driven tool for creating complex logical expressions. Agre, G., Kormushev, P. and Dilov, I., International Journal of Information Theories and Applications, Vol. 13, No. 2, pp. 169-178, November, 2006.

Visual approach for data mining on medical information databases using Fastmap algorithm. Kormushev, P., M.Sc. thesis, Faculty of Mathematics and Informatics, Sofia University, March, 2006.

Design, development and implementation of a tool for construction of declarative functional descriptions of semantic web services based on WSMO methodology. Kormushev, P., M.Sc. thesis, Faculty of Mathematics and Informatics, Sofia University, July, 2005.

INFRAWEBS Capability editor – A graphical ontology-driven tool for creating capabilities of Semantic Web Services. Agre, G., Kormushev, P. and Dilov, I., Third International Conference on Information Research, Applications and Education i.TECH-2005, June, 2005.




Download all my publications in one BibTeX file here.

Some of my older publications are also available here on arXiv.org in pdf format.