Main » Curriculum Vitae
Research Statement
Autonomous robots that can assist humans in situations of daily life have been a long standing
vision of robotics, artificial intelligence, and cognitive sciences. A first step towards this goal is to
create robots that can learn a multitude of different tasks, triggered by environmental context
or higher level instruction. Achieving this goal requires the development of novel machine
learning methods for model-, imitation and reinforcement learning that scale into the domain
of humanoid robotics. In order to achieve this goal, we also rely both on the proper evaluation
of robot skill execution from a traditional control perspective as well as on insights into
analytical mechanics and human motor control.
Current Position
Senior Research Scientist, Head of the Robot Learning Group
Dept. Empirical Inference (Dept.Head: Bernhard Schoelkopf), Max Planck Institute for Biological Cybernetics, Tuebingen, Germany
| Educational Background | |||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2001-2007 | Ph.D. in Computer Science | ||||||||||||||||||||||
| University of Southern California, Los Angeles, CA, USA | |||||||||||||||||||||||
| Thesis Title: Machine Learning for Motor Skills in Robotics | |||||||||||||||||||||||
| Defended on March 21, 2007 | |||||||||||||||||||||||
| Thesis Committee: Stefan Schaal, Gaurav Sukhatme, Firdaus Udwadia, Chris Atkeson (CMU) | |||||||||||||||||||||||
| 2004-2005 | M.Sc. in Aerospace & Mechanical Engineering (Dynamics & Control) | ||||||||||||||||||||||
| University of Southern California, Los Angeles, CA, USA | |||||||||||||||||||||||
| 2001-2002 | M.Sc. in Computer Science | ||||||||||||||||||||||
| University of Southern California, Los Angeles, CA, USA | |||||||||||||||||||||||
| 1996-2002 | Diplom-Ingenieur (German M.Eng. in Electrical Engineering) | ||||||||||||||||||||||
| Munich University of Technology, Munich, Germany | |||||||||||||||||||||||
| 2000-2001 | Visiting graduate student | ||||||||||||||||||||||
| National University of Singapore, Singapore | |||||||||||||||||||||||
| 1996-2000 | Diplom-Informatiker (German M.Sc. in Computer Science) | ||||||||||||||||||||||
| Hagen University, Hagen, Germany | |||||||||||||||||||||||
| Thesis Title: Neural Networks in Robot Control | |||||||||||||||||||||||
| Thesis Committee: Patrick van der Smagt (DLR), Gerd Hirzinger (DLR), Christoph Beierle (U.Hagen) | |||||||||||||||||||||||
| Research Positions | |||||||||||||||||||||||
| 2009-now | Senior Research Scientist, Head of the Robot Learning Group | ||||||||||||||||||||||
| Dept. Empirical Inference (Dept.Head: Bernhard Schoelkopf), Max Planck Institute for Biological Cybernetics, Tuebingen, Germany | |||||||||||||||||||||||
| 2007-2009 | Research Scientist, Head of the Robot Learning Group | ||||||||||||||||||||||
| Dept. Empirical Inference (Dept.Head: Bernhard Schoelkopf), Max Planck Institute for Biological Cybernetics, Tuebingen, Germany | |||||||||||||||||||||||
| 2001-2007 | Research Assistant | ||||||||||||||||||||||
| Computational Learning and Motor Control Lab (Head: Stefan Schaal), University of Southern California, Los Angeles, CA, USA | |||||||||||||||||||||||
| 2003 | Visiting Researcher | ||||||||||||||||||||||
| Department of Humanoid Robotics (Head: Gordon Cheng), Advanced Telecommunication Research Center ATR, Kyoto | |||||||||||||||||||||||
| 2001 | Visiting Researcher | ||||||||||||||||||||||
| National University of Singapore, Singapore | |||||||||||||||||||||||
| 2000 | Visiting Researcher | ||||||||||||||||||||||
| Cyberhuman Project (Head: Mitsuo Kawato), Advanced Telecommunication Research Center ATR, Kyoto, Japan | |||||||||||||||||||||||
| 2000 | Student Researcher | ||||||||||||||||||||||
| Institute of Automatic Control Engineering, Munich University of Technology, Munich, Germany | |||||||||||||||||||||||
| 1998-2000 | Student Researcher | ||||||||||||||||||||||
| Institute of Robotics and Mechatronics of the German Aerospace Research Institute DLR, Oberpfaffenhofen, Germany | |||||||||||||||||||||||
| Teaching | |||||||||||||||||||||||
| 2009 | Lecturer, Summer School Course | ||||||||||||||||||||||
| Lecture 1: Introduction for Motor Skill Learning | |||||||||||||||||||||||
| Lecture 2: Reinforcement Learning for Robotics | |||||||||||||||||||||||
| IEEE-RAS TCRL RLSS Robot Learning Summer School at IST Lisbon [link] | |||||||||||||||||||||||
| 2007 | Lecturer, Summer School Course: Policy Learning for Robotics | ||||||||||||||||||||||
| IEEE-RAS / IFRR School of Robotics Science on Learning [link] | |||||||||||||||||||||||
| 2006 | Lectures on Policy Gradient Methods, Graduate course: CS 599 Robot Learning | ||||||||||||||||||||||
| University of Southern California, Los Angeles, CA, USA | |||||||||||||||||||||||
| 2004 | Teaching Assistant, Graduate course: CS 545 Robotics | ||||||||||||||||||||||
| University of Southern California, Los Angeles, CA, USA | |||||||||||||||||||||||
| 2003 | Teaching Assistant, Graduate course: CS 545 Robotics | ||||||||||||||||||||||
| University of Southern California, Los Angeles, CA, USA | |||||||||||||||||||||||
| 1997-1998 | Lab Assistant, Undergraduate course: Informatik Praktikum | ||||||||||||||||||||||
| Lehrstuhl fuer Datenverarbeitung, Munich University of Technology, Munich, Germany | |||||||||||||||||||||||
| Industrial Experience | |||||||||||||||||||||||
| 2000 | Internship at Siemens Advanced Engineering Ltd. | ||||||||||||||||||||||
| Singapore | |||||||||||||||||||||||
| 1998 | Internship at Siemens AG | ||||||||||||||||||||||
| Munich, Germany | |||||||||||||||||||||||
| 1997 | Internship at Siemens AG | ||||||||||||||||||||||
| Munich, Germany | |||||||||||||||||||||||
| 1996 | Internship at Germanischer Lloyd AG | ||||||||||||||||||||||
| Hamburg, Germany | |||||||||||||||||||||||
| 1992-1993 | Software Development for Noelting Gmbh | ||||||||||||||||||||||
| Hamburg, Germany | |||||||||||||||||||||||
| 1992 | Internship at Philips Consumer Electronics Gmbh | ||||||||||||||||||||||
| Hamburg, Germany | |||||||||||||||||||||||
| Technical Committee Organisation | |||||||||||||||||||||||
| 2008-now | IEEE Technical Committee on Robotics and Machine Learning [link] | ||||||||||||||||||||||
| Chair together with Nick Roy (MIT), Russ Tedrake (MIT), Jun Morimoto (ATR). All are also founding chairs. | |||||||||||||||||||||||
| Community Services | |||||||||||||||||||||||
| 2007-now | Administration of the mailing list ROBOTICS-WORLDWIDE (currently the most important robotics mailing list) together with Stefan Schaal (USC) and Michael Mistry (USC). | ||||||||||||||||||||||
| Editing | |||||||||||||||||||||||
| 2008-2009 | Autonomous Robots - Special Issue on Robot Learning [link] | ||||||||||||||||||||||
| Editor together with Andrew Y. Ng (Stanford University) | |||||||||||||||||||||||
| 2008-2009 | From motor to interaction learning in robots, Edited Book in Springer Verlag. | ||||||||||||||||||||||
| Editor together with Olivier Sigaud (U. Paris 6) | |||||||||||||||||||||||
| Conference and Workshop Organization | |||||||||||||||||||||||
| 6/2009 | RSS 2009 Workshop: Bridging the gap between high-level discrete representations and low-level continuous behaviors with Dana Kulic, (U.Tokyo/U. Waterloo) and Pieter Abbeel (U.California in Berkeley). | ||||||||||||||||||||||
| 5/2009 | ICRA 2009 Workshop: Approaches to Sensorimotor Learning on Humanoid Robots | ||||||||||||||||||||||
| Co-Organizer of Ales Ude (Josef Stefan Institute), Tamim Asfour (U. Karlsruhe), Jun Morimoto (ATR) and Stefan Schaal (USC) | |||||||||||||||||||||||
| 9/2008 | IROS 2008 Workshop: Robotics Challenges for Machine Learning II | ||||||||||||||||||||||
| Co-Organizer of Russ Tedrake (MIT), Nick Roy (MIT) and Jun Morimoto (ATR) | |||||||||||||||||||||||
| 9/2008 | IROS 2008 Workshop: From motor to interaction learning in robots [link] | ||||||||||||||||||||||
| Co-Organizer of Olivier Sigaud (U.Paris 6) and Sethu Vijayakumar (U.Edingburgh) | |||||||||||||||||||||||
| 7/2008 | The 6th International Cognitive Robotics Workshop (aka the ECAI 2008 Workshop on Cognitive Robotics) [link] | ||||||||||||||||||||||
| Co-Organizer of Yves Lespérance (U.York), Gerhard Lakemeyer (RWTH Aachen) and Fiora Pirri (U. Rome) | |||||||||||||||||||||||
| 12/2007 | NIPS 2007: Robotics Challenges for Machine Learning [link] | ||||||||||||||||||||||
| Organizing it together with my co-organizer Marc Toussaint (TU Berlin) at the NIPS 2007 conference [link]. | |||||||||||||||||||||||
| 7-8/2007 | PASCAL Workshop: Analysis of reinforcement learning problems | ||||||||||||||||||||||
| Co-Organizer of Peter Auer (U.Leoben) | |||||||||||||||||||||||
| 12/2006 | NIPS 2006: Towards a new reinforcement learning? [link] | ||||||||||||||||||||||
| Organizing it together with my co-organizers Drew Bagnell (CMU) and Stefan Schaal (USC) at the NIPS 2006 conference [link]. | |||||||||||||||||||||||
| 6/2005 | RSS 2005: Learning for Locomotion Workshop [link] | ||||||||||||||||||||||
| Organizing it together with my co-organizers Russ Tedrake (MIT) and Stefan Schaal (USC) at the Robotics 2005 conference [link]. | |||||||||||||||||||||||
| 11/2004 | IEEE International Conference on Humanoid Robotics (HUMANOIDS 2004) [link] | ||||||||||||||||||||||
| Local arrangements with Stefan Schaal, Aaron D'Souza and Peyman Mohajerian | |||||||||||||||||||||||
| External Thesis Committee | |||||||||||||||||||||||
| 11/28/2008 | External Member of Ruben Martinez-Cantin's thesis committee, thesis titled Active Map Learning: Insights into Statistical Consistency at University of Zaragoza. | ||||||||||||||||||||||
| 3/1/2009, 10/7/2009 | External Evaluator of Diego Pardo's thesis committee, thesis titled Learning Rest-to-Rest Motor Coordination in Articulated Mobile Robots at the Technical University of Catalonia (UPC). | ||||||||||||||||||||||
| Program/Scientific Committee of Conferences/Workshops | |||||||||||||||||||||||
| 2010 | Robotics: Science & Systems R:SS (Senior Program Committee, Area Chair) | ||||||||||||||||||||||
| International Conference for Robotics and Automation (ICRA), Associate Editor (AE) for "Learning and Adaptive Systems" | |||||||||||||||||||||||
| 2009 | International Conference for Robotics and Automation (ICRA), Associate Editor (AE) for "Learning and Adaptive Systems" | ||||||||||||||||||||||
| 18th IEEE International Symposium on Robot and Human Interactive Communication RO-MAN (Associate Editor, IPC) | |||||||||||||||||||||||
| ECSIS Symposium on Learning and Adaptive Behavior in Robotic Systems LAB-RS 2009 (Program Committee) | |||||||||||||||||||||||
| Workshop on Abstractions in Reinforcement Learning (Program Committee) | |||||||||||||||||||||||
| International Workshop on Evolutionary and Reinforcement Learning for Autonomous Robot Systems 2009 (ERLARS, Program Committee) | |||||||||||||||||||||||
| International Workshop on Hybrid Control of Autonomous Systems (HYCAS, Program Committee) | |||||||||||||||||||||||
| International Conference on Machine Learning (ICML, Program Committee) International Joint Conference on Artificial Intelligence (IJCAI, Program Committee) 2009 IEEE International Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL,Program Committee) 25th Conference on Uncertainty in Artificial Intelligence (UAI,Program Committee) International Conference on Development and Learning (ICDL,Program Committee) First International Workshop on LEarning and data Mining for Robotics (LEMIR 2009) International Workshop on Hybrid Control of Autonomous Systems (HYCAS,Program Committee) Robotics: Science & Systems R:SS (Program Committee) ICML Workshop on Abstractions in Reinforcement Learning (Program Committee)l | |||||||||||||||||||||||
| 2008 | Robotics: Science & Systems R:SS (Program Committee) | ||||||||||||||||||||||
| Cognitive Information Processing Workshop CIP (Scientific Committee) Twenty-Third AAAI Conference on Artificial Intelligence (Program Committee of both Main Conference and the physically grounded track) International Conference on the Simulation of Adaptive Behavior SAB (Program Committee) International Conference on Cognitive Systems CogSys 2008 (Program Committee) European Workshop on Reinforcement Learning EWRL (Program Committee) 17th IEEE International Symposium on Robot and Human Interactive Communication RO-MAN (Associate Editor, IPC) ERLARS (Program Committee) ECSIS Symposium on Learning and Adaptive Behavior in Robotic Systems LAB-RS 2008 (Program Committee) | |||||||||||||||||||||||
| 2006 | International Conference on Machine Learning (ICML, Program Committee) | ||||||||||||||||||||||
| 2005 | Robotics: Science & Systems (R:SS, Program Committee) | ||||||||||||||||||||||
| Plenary talks and Invited talks at Workshops & Conferences | |||||||||||||||||||||||
| 9/14/2009 | Invited Talk Computational principles of sensorimotor learning at Reinforcement Learning of Motor Skills in Robotics. | ||||||||||||||||||||||
| 9/7/2009 | Invited talk A Roadmap for Machine Learning in Robotics at LEMIR 2009 (Learning and Mining for Robotics workshop at ECML-PKDD). | ||||||||||||||||||||||
| 9/1/2009 | Invited talk Towards Motor Skill Learning in Robotics at the International Symposium on Robotics Research (ISRR 2009). | ||||||||||||||||||||||
| 6/29/2009 | Invited talk Skill Learning with the Barrett WAM at the RSS Workshop on Creative Manipulation: Examples using the WAM. | ||||||||||||||||||||||
| 6/28/2009 | Invited talk Reward-Weighted Regression for Reinforcement Learning at the RSS Workshop on Regression in Robotics - Approaches and Applications. | ||||||||||||||||||||||
| 5/24/2009 | Invited plenary lecture at 4th XVR Workshop & Joint PRESENCCIA and SKILLS PhD Symposium. | ||||||||||||||||||||||
| 10/24/2008 | Invited plenary lecture at Premières Journées Annuelles du GDR Robotique 2008 (French National Conference on Robotics) | ||||||||||||||||||||||
| 9/26/2008 | Invited talk Motor Skill Learning at IROS 2008 Workshop: From motor to interaction learning in robots | ||||||||||||||||||||||
| 7/22/2008 | Invited plenary lecture/Keynote Motor Skill Learning for Cognitive Robotics at Cognitive Robotics 2008. Joint keynote of the ERLARS Workshop. | ||||||||||||||||||||||
| 7/3/2008 | Invited plenary lecture/Keynote Reinforcement Learning for Robotics at the European Workshop on Reinforcement Learning (EWRL). | ||||||||||||||||||||||
| 6/28/2008 | Keynote Motor Skill Learning at the Robotics: Science & Systems (R:SS), Workshop on Interactive Robotic Learning. | ||||||||||||||||||||||
| 6/11/2005 | Invited talk Learning Motor Primitives with Reinforcement Learning at Robotics: Science & Systems (R:SS), Workshop on Modular Foundations for Control and Perception | ||||||||||||||||||||||
| 5/23/2005 | Invited plenary lecture Motor Skills Learning for Humanoid Robots at the First Undergraduate Computer Sciences and Informations Sciences (CS/IS) conference. | ||||||||||||||||||||||
| Invited talks at Labs | |||||||||||||||||||||||
| 10/9/2009 | Invited Talk Towards Motor Skill Learning, Host: C. Rasmussen, University of Cambridge, United Kingdom | ||||||||||||||||||||||
| 10/8/2009 | Invited Talk Towards Motor Skill Learning, Host: C. Angelo, Technical University of Barcelona (UPC), Spain | ||||||||||||||||||||||
| 9/8/2009 | Invited Talk Robot Learning: Algorithms & Experiments, Host: A. Ude, Josef-Stefan-Institute, Slovenia | ||||||||||||||||||||||
| 4/16/2009 | Invited Talk Robot Policy Learning, Informatik Kolloqium, Host: G. Lakemeyer, RWTH Aachen, Germany | ||||||||||||||||||||||
| 11/27/2008 | Invited Talk Policy Learning in Robotics, Host: J.A. Castellano, University of Zaragoza | ||||||||||||||||||||||
| 11/4/2008 | Invited Talk Skill Learning for Humanoid Robotics, Host: M. Gienger, Honda Research International, Offenbach | ||||||||||||||||||||||
| 11/3/2008 | Invited Talk Machine Learning Applications in Robotics, Host: M.Riedmiller, University of Osnabrueck | ||||||||||||||||||||||
| 10/8/2008 | Invited Talk Machine Learning for Robotics, Host: K.-R. Mueller, Frauenhofer FIRST IDA, Berlin | ||||||||||||||||||||||
| 2/13/2008 | Invited Talk Towards Motor Skill Learning in Robotics, Host: A.Zell, University of Tuebingen | ||||||||||||||||||||||
| 11/21/2007 | Invited Talk Motor Skills Learning for Robotics, Host: T.Nakamura, Yamane-Nakamura Lab, The University of Tokyo, Tokyo, Japan | ||||||||||||||||||||||
| 11/20/2007 | Invited Talk Machine Learning of Motor Skills, Host: M. Sugiyama, Tokyo Institute of Technology (TIT), Tokyo, Japan | ||||||||||||||||||||||
| 11/16/2007 | Invited Talk Learning Motor Skills, Host: G.Cheng, Advanced Telecommunications Research Center (ATR), Kyoto, Japan | ||||||||||||||||||||||
| 11/12/2007 | Invited Learning Motor Skills, Host: T.Shibata, Nara Institute of Science and Technology (NAIST), Nara, Japan | ||||||||||||||||||||||
| 9/21/2007 | Invited Talk Learning for Motor Control, ISR, Hosts: I. Ribero, M. Lopes, ISR, Instituto Superior Technical (IST), Lisbon, Portugal | ||||||||||||||||||||||
| 9/20/2007 | Invited Talk Learning Operational Space Control, ISR, Host: R. Cortesao, ISR, University of Coimbra, Coimbra, Portugal | ||||||||||||||||||||||
| 6/12/2007 | Invited Talk Robot Skill Learning, TAMS, Host: J. Zhang, University of Hamburg, Hamburg, Germany | ||||||||||||||||||||||
| 5/22/2007 | Invited talk Towards Motor Skills Learning in Robotics, IAIM, Hosts: R.Dillman & T. Asfour, University of Karlsruhe (TH), Karlsruhe, Germany | ||||||||||||||||||||||
| 12/14/2006 | Invited talk Towards Motor Skills Learning in Robotics, Host: B. Schoelkopf, Max-Planck Institute for Biological Cybernetics (MPI), Tuebingen, Germany | ||||||||||||||||||||||
| 12/1/2006 | Invited talk Towards Motor Skills Learning in Robotics, Hosts: J. Schmidthuber, M.Beetz, Munich University of Technology, Germany | ||||||||||||||||||||||
| 11/30/2006 | Invited talk Towards Motor Skills Learning in Robotics, Host: J. Schmidthuber, Instituto Dalle Molle di Studi sull'Intelligenza Artificiale IDSIA, Lugano, Switzerland | ||||||||||||||||||||||
| 11/13/2006 | Invited talk Towards Motor Skills Learning in Robotics, Host: A. Ng, PAIL Series, SAIL AI Lab, Stanford University | ||||||||||||||||||||||
| 6/9/2005 | Invited talk Learning Motor Primitives with Reinforcement Learning at the The Seung Lab, Host: R. Tedrake, Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology (MIT) | ||||||||||||||||||||||
| 3/9/2004 | Invited talk Reinforcement Learning: neurobiology and methodology guest lecture for CS 499 Exotic Computation invited by M. Arbib. | ||||||||||||||||||||||
| 10/5/2003 | Invited talk Reinforcement Learning for Humanoid Robotics at Robotics & Mechatronics Institute, Host: P. van der Smagt, German Aerospace Research Center (DLR). | ||||||||||||||||||||||
| 7/28/2003 | Invited talk Natural Actor-Critic at Nara Institute of Science and Technology (NAIST), Host: Shin Ishi. | ||||||||||||||||||||||
| 7/17/2003 | Invited talk Natural Actor-Critic at the Advanced Telecommunications Research Center (ATR), Host: Gordon Cheng | ||||||||||||||||||||||
| Oral Conference and Workshop Presentations | |||||||||||||||||||||||
| 6/28/2009 | Workshop presentation Learning to Bridge the GAP with Motor Primitives at Bridging the gap between high-level discrete representations and low-level continuous behaviors. | ||||||||||||||||||||||
| 5/17/2009 | Workshop presentation Reinforcement learning for Sensory-Motor Control at ICRA 2009 Workshop: Approaches to Sensorimotor Learning on Humanoid Robots. | ||||||||||||||||||||||
| 9/22/2008 | Workshop presentation Policy Learning for Robotics: a Unified Perspective at IROS 2008 Workshop: Robotics Challenges for Machine Learning II. | ||||||||||||||||||||||
| 5/23/2008 | Conference presentation Learning resolved velocity control at IEEE Conference on Robotics and Automation (ICRA). | ||||||||||||||||||||||
| 11/14/2007 | Conference presentation Policy Learning for Robotics at the International Conference on Neural Information Processing (ICONIP) | ||||||||||||||||||||||
| 10/19/2007 | Conference presentation Towards Motor Skill Learning at the Fachgespraech Autonome Mobile Systeme | ||||||||||||||||||||||
| 6/22/2007 | Conference presentation Reinforcement Leaning by Reward-Weighted Regression at International Conference on Machine Learning (ICML) | ||||||||||||||||||||||
| 4/26/2007 | Conference presentation Applying the Episodic Natural Actor-Critic Architecture to Motor Primitive Learning at the European Symposium on Artificial Neural Networks (ESANN 2007). | ||||||||||||||||||||||
| 4/12/2007 | Conference presentation Reinforcement Learning for Operational Space Control at IEEE Conference on Robotics and Automation (ICRA). | ||||||||||||||||||||||
| 4/4/2007 | Workshop presentation Using Reward-Weighted Regression for Reinforcement Learning of Task Space Control at the ADPRL 2007 Workshop | ||||||||||||||||||||||
| 4/4/2007 | Workshop presentation Benchmarking of Policy Gradient Methods at the ADPRL 2007 Workshop | ||||||||||||||||||||||
| 12/8/2006 | Workshop presentation Reward-Weighted Regression for Reinforcement Learning at NIPS 2006 Workshop | ||||||||||||||||||||||
| 10/12/2006 | Conference presentation Policy Gradient Methods for Robotics at IEEE/RSJ Conference on Intelligent Robots and Systems (IROS). | ||||||||||||||||||||||
| 10/5/2005 | Conference presentation Natural Actor-Critic at 16th European Conference on Machine Learning. | ||||||||||||||||||||||
| 9/26/2005 | Conference presentation A new methodology for robot controller design at ASME IDECT 5th International Conference on Multibody Systems, Nonlinear Dynamics, and Control (ASME MSNDC). | ||||||||||||||||||||||
| 8/5/2005 | Conference presentation A Unifying Framework for the Control of Robotic Systems at IEEE/RSJ Conference on Intelligent Robots and Systems (IROS). | ||||||||||||||||||||||
| 10/22/2004 | Workshop presentation Learning Motor Primitives with Reinforcement Learning at the AAAI Workshop on Real Life Reinforcement Learning. | ||||||||||||||||||||||
| 12/13/2003 | Workshop presentation Learning Control and Planning from the View of Control Theory and Imitation with S.Schaal at NIPS Workshop on Planning for the Real World: The promises and challenges of dealing with uncertainty. | ||||||||||||||||||||||
| 12/12/2003 | Workshop presentation Recurrent neural networks from learning attractor dynamics with S.Schaal at NIPS Workshop on RNNaissance: Recurrent Neural Networks. | ||||||||||||||||||||||
| 10/2/2003 | Conference presentation Reinforcement Learning for Humanoid Robotics at IEEE International Conference on Humanoid Robotics. | ||||||||||||||||||||||
| 12/6/2000 | Conference presentation A Real Time Model of the Human Knee for a Virtual Orthopaedic Trainer at International Conference on Biomedical Engineering | ||||||||||||||||||||||
| Position Statements | |||||||||||||||||||||||
| 9/4/2008 | Position statement Machine Learning for Cognitive and Intelligent Systems at Third Interlink-Workshop on Intelligent Cognitive Systems, Santa Monica, CA, USA, 4-5 September 2008. | ||||||||||||||||||||||
| Awards and Honors | |||||||||||||||||||||||
| 2008 | IROS 2008 Best Paper Award Finalist for Nguyen, D.; Peters, J. (2008). Local Gaussian Processes Regression for Real-time Model-based Robot Control, International Conference on Intelligent Robot Systems (IROS) | ||||||||||||||||||||||
| 2006 | National Science Foundation Travel Fellowship for IROS 2006 in Beijing, China | ||||||||||||||||||||||
| 2001-2004 | University of Southern California Presidential Fellowship, accepted. | ||||||||||||||||||||||
| 2001-2004 | Carnegie Mellon University Doctoral Fellowship, declined. | ||||||||||||||||||||||
| 2000-2002 | Siemens Student Scholarship (SSP) | ||||||||||||||||||||||
| 2000-2001 | Munich University of Technology's Singapore Scholarship | ||||||||||||||||||||||
| 1994-1995 | Finalist in the 14. Bundeswettbewerb Informatik (German National Computer Science Competition) | ||||||||||||||||||||||
| 1993-1994 | Finalist & St. Augustin Award in the 13. Bundeswettbewerb Informatik (German National Computer Science Competition) | ||||||||||||||||||||||
| Paper Reviewing | |||||||||||||||||||||||
| 2009 | 12th International Conference on Artificial Intelligence and Statistics (AISTATS 2009) | ||||||||||||||||||||||
| International Conference on Robotic Systems (IROS) | |||||||||||||||||||||||
| International Symposium on Robotics Research (ISRR), Advances in Neural Information Processing Systems (NIPS), Autonomous Robots Journal | |||||||||||||||||||||||
| 2008 | Advances in Neural Information Processing Systems (NIPS) | ||||||||||||||||||||||
| 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI 2009) Applied Mathematics and Computation Journal International Conference on Cognitive Systems (CogSys 2008) Autonomous Robots Journal Robotics: Science & Systems (R:SS 2008) 17th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN) Twenty-Third AAAI Conference on Artificial Intelligence (AAAI 2008) International Conference on the Simulation of Adaptive Behavior (SAB 2008) The Snowbird Workshop International Journal of Robotics Research (IJRR) Neurocomputing European Workshop on Reinforcement Learning (EWRL 2008) IEEE Transactions on Robotics Cambridge University Press (Book Proposal Evaluation) | |||||||||||||||||||||||
| 2007 | Advances in Neural Information Processing Systems (NIPS) | ||||||||||||||||||||||
| International Conference on Neural Information Processing (ICONIP) International Joint Conference on Neural Networks IEEE International Symposium on Industrial Electronics Neural Networks Automatica European Symposium on Artificial Neural Networks International Journal of Robotics Research Artificial Intelligence Journal Electronics Letters IEEE Conference on Decision and Control (CDC) International Conference on Robotic Systems (IROS) Adaptive Behavior Artificial Intelligence Review IEEE International Conference on Robotics and Automation (ICRA) IEEE Transactions on Systems, Man and Cybernetics - Part B Neurocomputing Neural Computation Advanced Robotics | |||||||||||||||||||||||
| 2006 | IEEE Robotics & Automation Society Magazine | ||||||||||||||||||||||
| Journal of Artificial Intelligence Research IEEE International Conference on Robotics and Automation (ICRA) International Conference on Machine Learning (ICML) Advances in Neural Information Processing Systems (NIPS) | |||||||||||||||||||||||
| 2005 | IEEE Transactions on Neural Networks | ||||||||||||||||||||||
| Mathematical Problems in Engineering International Conference on Machine Learning (ICML) Advances in Neural Information Processing Systems (NIPS) International Conference on Robotic Systems (IROS) Robotics: Science & Systems (RSS) Autonomous Robots | |||||||||||||||||||||||
| 2004 | International Conference on Machine Learning (ICML) | ||||||||||||||||||||||
| Advances in Neural Information Processing Systems (NIPS) International Conference on Robotic Systems (IROS) IEEE Transactions on Robotics and Automation | |||||||||||||||||||||||
| 2002 | IEEE International Conference on Robotics and Automation (ICRA) | ||||||||||||||||||||||
| IEEE Transactions on Robotics and Automation | |||||||||||||||||||||||
| 2001 | IEEE Transactions on Neural Networks | ||||||||||||||||||||||
| Journal of Neurophysiology | |||||||||||||||||||||||
| 2000 | International Journal of Applied Intelligence | ||||||||||||||||||||||
| International Proposal Reviewing | |||||||||||||||||||||||
| 2008 | NWO Physical Sciences | ||||||||||||||||||||||
| 2007 | STW Dutch Technology Foundation | ||||||||||||||||||||||
| References, etc. | |||||||||||||||||||||||
| References are available upon request, and for coursework see here. | |||||||||||||||||||||||
| Books & Theses | |||||||||||||||||||||||
| |||||||||||||||||||||||
| Journal Papers | |||||||||||||||||||||||
| |||||||||||||||||||||||
| Conference and Workshop Papers | |||||||||||||||||||||||
| |||||||||||||||||||||||