Download or read book Intrinsically Motivated Reinforcement Learning A Promising Framework for Developmental Robot Learning written by and published by . This book was released on 2005 with total page 7 pages. Available in PDF, EPUB and Kindle. Book excerpt: One of the primary challenges of developmental robotics is the question of how to learn and represent increasingly complex behavior in a self-motivated, open-ended way Barto, Singh, and Chentanez (Barto, Singh, & Chentanez 2004; Singh, Barto, & Chentanez 2004) have recently presented an algorithm for intrinsically motivated reinforcement learning that strives to achieve broad competence in an environment in a task-nonspecific manner by incorporating internal reward to build a hierarchical collection of skills. This paper suggests that with its emphasis on task-general, self-motivated, and hierarchical learning, intrinsically motivated reinforcement learning is an obvious choice for organizing behavior in developmental robotics. We present additional preliminary results from a gridworld abstraction of a robot environment and advocate a layered learning architecture for applying the algorithm on a physically embodied system.

Download or read book Intrinsically Motivated Learning in Natural and Artificial Systems written by Gianluca Baldassarre and published by Springer Science & Business Media. This book was released on 2013-03-29 with total page 453 pages. Available in PDF, EPUB and Kindle. Book excerpt: It has become clear to researchers in robotics and adaptive behaviour that current approaches are yielding systems with limited autonomy and capacity for self-improvement. To learn autonomously and in a cumulative fashion is one of the hallmarks of intelligence, and we know that higher mammals engage in exploratory activities that are not directed to pursue goals of immediate relevance for survival and reproduction but are instead driven by intrinsic motivations such as curiosity, interest in novel stimuli or surprising events, and interest in learning new behaviours. The adaptive value of such intrinsically motivated activities lies in the fact that they allow the cumulative acquisition of knowledge and skills that can be used later to accomplish fitness-enhancing goals. Intrinsic motivations continue during adulthood, and in humans they underlie lifelong learning, artistic creativity, and scientific discovery, while they are also the basis for processes that strongly affect human well-being, such as the sense of competence, self-determination, and self-esteem. This book has two aims: to present the state of the art in research on intrinsically motivated learning, and to identify the related scientific and technological open challenges and most promising research directions. The book introduces the concept of intrinsic motivation in artificial systems, reviews the relevant literature, offers insights from the neural and behavioural sciences, and presents novel tools for research. The book is organized into six parts: the chapters in Part I give general overviews on the concept of intrinsic motivations, their function, and possible mechanisms for implementing them; Parts II, III, and IV focus on three classes of intrinsic motivation mechanisms, those based on predictors, on novelty, and on competence; Part V discusses mechanisms that are complementary to intrinsic motivations; and Part VI introduces tools and experimental frameworks for investigating intrinsic motivations. The contributing authors are among the pioneers carrying out fundamental work on this topic, drawn from related disciplines such as artificial intelligence, robotics, artificial life, evolution, machine learning, developmental psychology, cognitive science, and neuroscience. The book will be of value to graduate students and academic researchers in these domains, and to engineers engaged with the design of autonomous, adaptive robots. The contributing authors are among the pioneers carrying out fundamental work on this topic, drawn from related disciplines such as artificial intelligence, robotics, artificial life, evolution, machine learning, developmental psychology, cognitive science, and neuroscience. The book will be of value to graduate students and academic researchers in these domains, and to engineers engaged with the design of autonomous, adaptive robots.

Download or read book Intrinsically Motivated Open Ended Learning in Autonomous Robots written by Vieri Giuliano Santucci and published by Frontiers Media SA. This book was released on 2020-02-19 with total page 286 pages. Available in PDF, EPUB and Kindle. Book excerpt:

Download or read book Neuromorphic and Brain Based Robots written by Jeffrey L. Krichmar and published by Cambridge University Press. This book was released on 2011-09-01 with total page pages. Available in PDF, EPUB and Kindle. Book excerpt: Neuromorphic and brain-based robotics have enormous potential for furthering our understanding of the brain. By embodying models of the brain on robotic platforms, researchers can investigate the roots of biological intelligence and work towards the development of truly intelligent machines. This book provides a broad introduction to this groundbreaking area for researchers from a wide range of fields, from engineering to neuroscience. Case studies explore how robots are being used in current research, including a whisker system that allows a robot to sense its environment and neurally inspired navigation systems that show impressive mapping results. Looking to the future, several chapters consider the development of cognitive, or even conscious robots that display the adaptability and intelligence of biological organisms. Finally, the ethical implications of intelligent robots are explored, from morality and Asimov's three laws to the question of whether robots have rights.

Download or read book Advances in Artificial Life written by Fernando Almeida e Costa and published by Springer. This book was released on 2007-09-04 with total page 1232 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book constitutes the refereed proceedings of the 9th European Conference on Artificial Life, ECAL 2007, held in Lisbon, Portugal. The 125 revised full papers cover morphogenesis and development, robotics and autonomous agents, evolutionary computation and theory, cellular automata, models of biological systems and their applications, ant colony and swarm systems, evolution of communication, simulation of social interactions, self-replication, artificial chemistry.

Download or read book Adaptive and Intelligent Systems written by Abdelhamid Bouchachia and published by Springer Science & Business Media. This book was released on 2011-08-26 with total page 441 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book constitutes the proceedings of the International Conference on Adaptive and Intelligent Systems, ICAIS 2011, held in Klagenfurt, Austria, in September 2011. The 36 full papers included in these proceedings together with the abstracts of 4 invited talks, were carefully reviewed and selected from 72 submissions. The contributions are organized under the following topical sections: incremental learning; adaptive system architecture; intelligent system engineering; data mining and pattern recognition; intelligent agents; and computational intelligence.

Download or read book From Animals to Animats 9 written by Stefano Nolfi and published by Springer Science & Business Media. This book was released on 2006-09-20 with total page 869 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book constitutes the refereed proceedings of the 9th International Conference on Simulation of Adaptive Behavior, SAB 2006. The 35 revised full papers and 35 revised poster papers presented are organized in topical sections on the animat approach to adaptive behaviour, perception and motor control, action selection and behavioral sequences, navigation and internal world models, learning and adaptation, evolution, collective and social behaviours, applied adaptive behavior and more.

Download or read book Brain Inspired Information Technology written by Akitoshi Hanazawa and published by Springer Science & Business Media. This book was released on 2010-09-22 with total page 176 pages. Available in PDF, EPUB and Kindle. Book excerpt: "Brain-inspired information technology" is one of key concepts for the development of information technology in the next generation. Explosive progress of computer technology has been continuing based on a simple principle called "if-then rule". This means that the programmer of software have to direct every action of the computer programs in response to various inputs. There inherently is a limitation of complexity because we human have a limited capacity for managing complex systems. Actually, many bugs, mistakes of programming, exist in computer software, and it is quite difficult to extinguish them. The parts of computer programs where computer viruses attack are also a kind of programming mistakes, called security hole. Of course, human body or nervous system is not perfect. No creator or director, however, exists for us. The function of our brain is equipped by learning, self-organization, natural selection, and etc, resulting in adaptive and flexible information system. Brain-inspired information technology is aiming to realize such nature-made information processing system by using present computer system or specific hardware. To do so, researchers in various research fields are getting together to inspire each other and challenge cooperatively for the same goal.

Download or read book Theory and Novel Applications of Machine Learning written by Er Meng Joo and published by BoD – Books on Demand. This book was released on 2009-01-01 with total page 390 pages. Available in PDF, EPUB and Kindle. Book excerpt: Even since computers were invented, many researchers have been trying to understand how human beings learn and many interesting paradigms and approaches towards emulating human learning abilities have been proposed. The ability of learning is one of the central features of human intelligence, which makes it an important ingredient in both traditional Artificial Intelligence (AI) and emerging Cognitive Science. Machine Learning (ML) draws upon ideas from a diverse set of disciplines, including AI, Probability and Statistics, Computational Complexity, Information Theory, Psychology and Neurobiology, Control Theory and Philosophy. ML involves broad topics including Fuzzy Logic, Neural Networks (NNs), Evolutionary Algorithms (EAs), Probability and Statistics, Decision Trees, etc. Real-world applications of ML are widespread such as Pattern Recognition, Data Mining, Gaming, Bio-science, Telecommunications, Control and Robotics applications. This books reports the latest developments and futuristic trends in ML.

Download or read book Towards Vygotskian Autotelic Agents written by Cédric Colas and published by . This book was released on 2021 with total page 0 pages. Available in PDF, EPUB and Kindle. Book excerpt: Building autonomous machines that can explore large environments, discover interesting interactions and learn open-ended repertoires of skills is a long-standing goal in artificial intelligence. Inspired by the remarkable lifelong learning of humans, the field of developmental machine learning aims at studying the mechanisms enabling autonomous machines to self-organize their own developmental trajectories and grow their own repertoires of skills. This research makes steps towards that goal.Reinforcement learning methods (RL) train learning agents to control their environment by maximizing future rewards and, thus, seem adapted to our purpose. Although it achieved impressive results in the last decade--beating humans at video games, chess, go or controlling robotic agents--it falls short of solving our goal. Indeed, RL agents demonstrate low autonomy and open-endedness because they usually target a (small) set of pre-defined tasks characterized by hand-defined reward functions. In this research, we transfer, adapt and extend ideas from a developmental framework called intrinsically motivated goal exploration process (IMGEP) to the RL setting. The resulting framework builds on goal-conditioned RL techniques to design autotelic RL agents: agents that are intrinsically motivated to represent, generate, pursue and master their own goals as a way to grow repertoires of skills.The efficient acquisition of open-ended repertoires of skills further requires agents to creatively generate novel goals out of the domain of known effects (creative exploration), to readily generalize their understanding of known skills to similar ones (systematic generalization), and to compose known skills to form new ones (composition). Inspired by developmental psychology, we propose to use language as a cognitive tool to support such properties.We organize the manuscript around these two notions: goals and language. The first part focuses on goals. It covers foundational concepts and related work on intrinsic motivations, reinforcement learning and developmental robotics before introducing our framework, goal-conditioned intrinsically motivated goal exploration process (GC-IMGEP), the intersection of RL and IMGEPs. Building on this framework, we present three computational studies of the properties of autotelic agents. We first show that we can use autotelic exploration to solve external hard-exploration tasks (study 1: GEP-PG and 2: ME-ES). We then move on to reward-free environments and propose CURIOUS, an autotelic agent that targets a diversity of goals, transfers knowledge across skills and organizes its own learning trajectory by pursuing goals associated with high learning progress (study 3).The second part focuses on language. Inspired by the pioneering work of Vygotsky and others, we first discuss existing communicative and cognitive uses of language for goal-directed artificial agents. Language facilitates human-agent communications, abstraction, systematic generalization, long-horizon control, but also creativity and mental simulations. In two subsequent computational studies, we propose to implement these two last cognitive uses of language. IMAGINE uses language both to learn goal representations from social interactions (communicative use) and to imagine out-of-distribution goals used to drive its creative exploration and enhance systematic generalization (cognitive use). In our last study, LGB trains a language-conditioned world model to generate a diversity of possible futures conditioned on linguistic descriptions. This leads to behavioral diversity and strategy-switching behaviors.

Download or read book Advances in Neuro Information Processing written by Mario Köppen and published by Springer. This book was released on 2009-07-30 with total page 1273 pages. Available in PDF, EPUB and Kindle. Book excerpt: The two volume set LNCS 5506 and LNCS 5507 constitutes the thoroughly refereed post-conference proceedings of the 15th International Conference on Neural Information Processing, ICONIP 2008, held in Auckland, New Zealand, in November 2008. The 260 revised full papers presented were carefully reviewed and selected from numerous ordinary paper submissions and 15 special organized sessions. 116 papers are published in the first volume and 112 in the second volume. The contributions deal with topics in the areas of data mining methods for cybersecurity, computational models and their applications to machine learning and pattern recognition, lifelong incremental learning for intelligent systems, application of intelligent methods in ecological informatics, pattern recognition from real-world information by svm and other sophisticated techniques, dynamics of neural networks, recent advances in brain-inspired technologies for robotics, neural information processing in cooperative multi-robot systems.

Download or read book Computational Modeling and Simulation of Intellect Current State and Future Perspectives written by Igelnik, Boris and published by IGI Global. This book was released on 2011-05-31 with total page 686 pages. Available in PDF, EPUB and Kindle. Book excerpt: "This book confronts the problem of meaning by fusing together methods specific to different fields and exploring the computational efficiency and scalability of these methods"--Provided by publisher.

Download or read book Intrinsically Motivated Reinforcement Learning written by and published by . This book was released on 2005 with total page 9 pages. Available in PDF, EPUB and Kindle. Book excerpt: Psychologists call behavior intrinsically motivated when it is engaged in for its own sake rather than as a step toward solving a specific problem of clear practical value. But what we learn during intrinsically motivated behavior is essential for our development as competent autonomous entities able to efficiently solve a wide range of practical problems as they arise. In this paper we present initial results from a computational study of intrinsically motivated reinforcement learning aimed at allowing artificial agents to construct and extend hierarchies of reusable skills that are needed for competent autonomy.

Download or read book Advances in Practical Applications of Agents Multi Agent Systems and Cognitive Mimetics The PAAMS Collection written by Philippe Mathieu and published by Springer Nature. This book was released on 2023-07-11 with total page 450 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book constitutes the proceedings of the 21st International Conference on Practical Applications of Agents and Multi-Agent Systems, PAAMS 2023, held in Guimaraes, Portugal, in July 2023. The 32 full papers in this book were reviewed and selected from 70 submissions. 5 demonstration papers are also included in this volume. The papers deal with the application and validation of agent-based models, methods, and technologies in a number of key applications areas, including: advanced models and learning, agent-based programming, decision-making, education and social interactions, formal and theoretic models, health and safety, mobility and the city, swarms and task allocation.

Download or read book Recent Advances in Robot Learning written by Judy A. Franklin and published by Springer Science & Business Media. This book was released on 1996-06-30 with total page 226 pages. Available in PDF, EPUB and Kindle. Book excerpt: Recent Advances in Robot Learning contains seven papers on robot learning written by leading researchers in the field. As the selection of papers illustrates, the field of robot learning is both active and diverse. A variety of machine learning methods, ranging from inductive logic programming to reinforcement learning, is being applied to many subproblems in robot perception and control, often with objectives as diverse as parameter calibration and concept formulation. While no unified robot learning framework has yet emerged to cover the variety of problems and approaches described in these papers and other publications, a clear set of shared issues underlies many robot learning problems. Machine learning, when applied to robotics, is situated: it is embedded into a real-world system that tightly integrates perception, decision making and execution. Since robot learning involves decision making, there is an inherent active learning issue. Robotic domains are usually complex, yet the expense of using actual robotic hardware often prohibits the collection of large amounts of training data. Most robotic systems are real-time systems. Decisions must be made within critical or practical time constraints. These characteristics present challenges and constraints to the learning system. Since these characteristics are shared by other important real-world application domains, robotics is a highly attractive area for research on machine learning. On the other hand, machine learning is also highly attractive to robotics. There is a great variety of open problems in robotics that defy a static, hand-coded solution. Recent Advances in Robot Learning is an edited volume of peer-reviewed original research comprising seven invited contributions by leading researchers. This research work has also been published as a special issue of Machine Learning (Volume 23, Numbers 2 and 3).

Download or read book Nature inspired Inductive Biases in Learning Robots written by Sebastian Blaes and published by . This book was released on 2022 with total page 0 pages. Available in PDF, EPUB and Kindle. Book excerpt: The work presented in this thesis studies various nature-inspired inductive biases in the domain of model-free and model-based reinforcement learning with the goal of designing AI agents that act more efficiently and autonomously in natural environments. The domain of robotic manipulation tasks is particularly interesting as it involves non-trivial system dynamics and requires abundant planning and reasoning. The inductive biases under investigation are primarily inspired by intelligent agents found in nature, such as humans and other animals. The primary sources of inspiration are as follows. (1) Hierarchically organized and specialized cortical structures facilitating efficient skills learning. (2) The self-organized playing of children to form intuitive theories and models about the world. (3) Structured exploration strategies based on various forms of intrinsic motivation and long-lasting temporal correlations in motor commands. (4) Imitation Learning. (5) Uncertainty-aware planning of motor commands in imagined models of a non-deterministic world. Consequently, this work continues a long history of ideas and research efforts that take inspiration from nature to build more competent AI agents. These efforts culminated in research fields such as hierarchical reinforcement learning, developmental robotics, intrinsically motivated reinforcement learning, and representation learning. This work builds on the ideas that were advanced in these fields. It combines them with model-free and model-based reinforcement learning methods to solve challenging robotic manipulation tasks from scratch. Empirical studies are carried out to support the hypothesis that nature-inspired inductive biases might be an essential building block in designing more competent AI agents.

Download or read book How to Grow a Robot written by Mark H. Lee and published by MIT Press. This book was released on 2020-05-26 with total page 385 pages. Available in PDF, EPUB and Kindle. Book excerpt: How to develop robots that will be more like humans and less like computers, more social than machine-like, and more playful and less programmed. Most robots are not very friendly. They vacuum the rug, mow the lawn, dispose of bombs, even perform surgery—but they aren't good conversationalists. It's difficult to make eye contact. If the future promises more human-robot collaboration in both work and play, wouldn't it be better if the robots were less mechanical and more social? In How to Grow a Robot, Mark Lee explores how robots can be more human-like, friendly, and engaging. Developments in artificial intelligence—notably Deep Learning—are widely seen as the foundation on which our robot future will be built. These advances have already brought us self-driving cars and chess match–winning algorithms. But, Lee writes, we need robots that are perceptive, animated, and responsive—more like humans and less like computers, more social than machine-like, and more playful and less programmed. The way to achieve this, he argues, is to “grow” a robot so that it learns from experience—just as infants do. After describing “what's wrong with artificial intelligence” (one key shortcoming: it's not embodied), Lee presents a different approach to building human-like robots: developmental robotics, inspired by developmental psychology and its accounts of early infant behavior. He describes his own experiments with the iCub humanoid robot and its development from newborn helplessness to ability levels equal to a nine-month-old, explaining how the iCub learns from its own experiences. AI robots are designed to know humans as objects; developmental robots will learn empathy. Developmental robots, with an internal model of “self,” will be better interactive partners with humans. That is the kind of future technology we should work toward.