Download or read book A Neural Model of Stochastic Choice in a Mixed Strategy Game written by Ryan Webb and published by . This book was released on 2013 with total page 0 pages. Available in PDF, EPUB and Kindle. Book excerpt: In strategic games with a unique mixed strategy equilibrium, players face both an incentive to best-respond to valuations and to act unpredictably. We developed a model of how neural circuitry represents a balance between these two incentives in the course of a decision. Choice is modelled as the result of the interaction between action value input from upstream brain areas and the noise inherent in neuronal networks: large differences in action valuations between options lead to reliable best-response choices whereas small differences result in a choice selection process dominated by noise. Action value input was measured in superior colliculus activity while monkeys played a saccade version of matching pennies. We found that model simulations based on these measures exhibit similar choice biases as found in behavioural data. Deviations from the mixed equilibrium strategy were predicted by the action value measurements within the model. This yields a neural choice mechanism that is capable of implementing both critical aspects of equilibrium formation in strategic games: best-response and stochastic behaviour.
Download or read book Towards a Neural Measure of Value and the Modelling of Choice in Strategic Games written by Ryan Gregory Webb and published by . This book was released on 2011 with total page 292 pages. Available in PDF, EPUB and Kindle. Book excerpt: Neuroeconomic models take economic theory literally, interpreting hypothesized quantities as observables in the brain in order to provide insight into choice behaviour. This thesis develops a model of the neural decision process in strategic games with a unique mixed strategy equilibrium. In such games, players face both an incentive to best-respond to valuations and to act unpredictably. Similarly, we model choice as the result of the interaction between action value and the noise inherent in networks of spiking neurons. Our neural model generates any ratio of choices through the specification of action value, including the equilibrium ratio, and provides an explanation for why we observe equilibrium behaviour in some contexts and not others. The model generalizes to a random-utility model which gives a structural specification to the error term and makes action value observable in the spike rates of neurons. Action value is measured in the spike activity of the Superior Colliculus (SC) while monkeys play a saccade version of matching pennies. We find SC activity predicts upcoming choices and is influenced by the history of events in the game, correlating with a behaviourally-established model of learning, and choice simulations based on neural measures of value exhibit similar biases to our behavioural data. A neural measure of value yields a glimpse at how valuations are updated in response to new information and compared stochastically, providing us with unique insight into modelling choice in strategic games.
Download or read book Neural Processes Involved in Action Selection During a Mixed strategy Game written by Dhushan Thevarajah and published by . This book was released on 2009 with total page 200 pages. Available in PDF, EPUB and Kindle. Book excerpt: Game theory outlines optimal response strategies during mixed-strategy competitions in which available actions are selected probabilistically. The neural processes involved in choosing individual strategic actions, however, remain poorly understood. Here, actions need to be selected (1) in the absence of sensory instruction or reward cues and (2) independent of previous events. This thesis examines the neural processes involved in action selection during mixed-strategy competition. To do so, we both measured and manipulated presaccadic activity in the primate superior colliculus (SC), a structure involved in the generation of orienting saccadic eye movements, during a strategic game. The first study tested whether the SC is involved in choosing saccades under strategic conditions. Monkeys were free to choose either of two saccade targets as they competed against a computer opponent during the mixed-strategy game 'matching-pennies'. The accuracy with which pre-saccadic SC activity predicted upcoming choice gradually increased in the time leading up to the saccade. Probing the SC with supra-threshold stimulation demonstrated that these evolving signals were functionally involved in preparing strategic saccades. Finally, sub-threshold stimulation of the SC increased the likelihood that contralateral saccades were selected. In the second study, we compared the influence of previous actions and rewards on updating premotor activity in the SC in the strategic condition where eliciting stochastic responses was optimal and in a non-strategic condition where stochastic responses were also elicited but through explicit instruction. To avoid exploitation by opponents during mixed-strategy competitions one should select behaviors unpredictably, that is, independent of previous choices and their outcomes. The iterative updating of neural processes involved in selecting actions to produce mixed-strategy behaviors, however, remain poorly understood In both tasks, premotor activity and behavior were shaped by past actions and rewards with more recent events exerting the largest influence. Importantly, these sequential effects were attenuated under strategic conditions suggesting that updating of selection processes is not entirely automatic but can be tailored to different decision-making contexts. Together our results highlight the active role played by the brain in choosing strategic actions.
Download or read book Neuroeconomics written by Paul W. Glimcher and published by Academic Press. This book was released on 2013-08-13 with total page 606 pages. Available in PDF, EPUB and Kindle. Book excerpt: In the years since it first published, Neuroeconomics: Decision Making and the Brain has become the standard reference and textbook in the burgeoning field of neuroeconomics. The second edition, a nearly complete revision of this landmark book, will set a new standard. This new edition features five sections designed to serve as both classroom-friendly introductions to each of the major subareas in neuroeconomics, and as advanced synopses of all that has been accomplished in the last two decades in this rapidly expanding academic discipline. The first of these sections provides useful introductions to the disciplines of microeconomics, the psychology of judgment and decision, computational neuroscience, and anthropology for scholars and students seeking interdisciplinary breadth. The second section provides an overview of how human and animal preferences are represented in the mammalian nervous systems. Chapters on risk, time preferences, social preferences, emotion, pharmacology, and common neural currencies—each written by leading experts—lay out the foundations of neuroeconomic thought. The third section contains both overview and in-depth chapters on the fundamentals of reinforcement learning, value learning, and value representation. The fourth section, “The Neural Mechanisms for Choice, integrates what is known about the decision-making architecture into state-of-the-art models of how we make choices. The final section embeds these mechanisms in a larger social context, showing how these mechanisms function during social decision-making in both humans and animals. The book provides a historically rich exposition in each of its chapters and emphasizes both the accomplishments and the controversies in the field. A clear explanatory style and a single expository voice characterize all chapters, making core issues in economics, psychology, and neuroscience accessible to scholars from all disciplines. The volume is essential reading for anyone interested in neuroeconomics in particular or decision making in general. Editors and contributing authors are among the acknowledged experts and founders in the field, making this the authoritative reference for neuroeconomics Suitable as an advanced undergraduate or graduate textbook as well as a thorough reference for active researchers Introductory chapters on economics, psychology, neuroscience, and anthropology provide students and scholars from any discipline with the keys to understanding this interdisciplinary field Detailed chapters on subjects that include reinforcement learning, risk, inter-temporal choice, drift-diffusion models, game theory, and prospect theory make this an invaluable reference Published in association with the Society for Neuroeconomics—www.neuroeconomics.org Full-color presentation throughout with numerous carefully selected illustrations to highlight key concepts
Download or read book Stochastic Games and Related Concepts written by T. Parthasarathy and published by Springer Nature. This book was released on 2020-12-08 with total page 127 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book discusses stochastic game theory and related concepts. Topics focused upon in the book include matrix games, finite, infinite, and undiscounted stochastic games, n-player cooperative games, minimax theorem, and more. In addition to important definitions and theorems, the book provides readers with a range of problem-solving techniques and exercises. This book is of value to graduate students and readers of probability and statistics alike.
Download or read book Neuroeconomics written by Paul E. Phillips and published by Frontiers E-books. This book was released on with total page 139 pages. Available in PDF, EPUB and Kindle. Book excerpt: The brain is the organ of decision making, and evolved to maximize the outcomes desirable for the survival and reproduction of the species. Compared to the sensory and motor functions of the brain, however, the process of decision making is less accessible to direct experimental manipulations and hence requires more careful theoretical analyses. Indeed, the principle of optimality and frequent departures of human behaviors from those predicted for optimal rational decision makers have long been studied experimentally as well as theoretically. However, it is only recently that neurobiological studies of decision making started exploiting the framework previously developed in economics and psychology systematically. This cross-disciplinary research program, known as neuroeconomics, has already been enormously successful. Increasingly, neuroscientists benefit from the studies of utility theory, game theory, prospect theory, and reinforcement learning theory, and contribute to the refinement of such theories by providing more relevant empirical data. This Research Topic will showcase the recent advances in neuroeconomics that combine economic and behavioral analyses in neurobiological studies of value-based decision making.
Download or read book Stochastic Multiplayer Games written by Michael Ummels and published by Amsterdam University Press. This book was released on 2010-12 with total page 174 pages. Available in PDF, EPUB and Kindle. Book excerpt: Stochastic games provide a versatile model for reactive systems that are affected by random events. This dissertation advances the algorithmic theory of stochastic games to incorporate multiple players, whose objectives are not necessarily conflicting. The basis of this work is a comprehensive complexity-theoretic analysis of the standard game-theoretic solution concepts in the context of stochastic games over a finite state space. One main result is that the constrained existence of a Nash equilibrium becomes undecidable in this setting. This impossibility result is accompanied by several positive results, including efficient algorithms for natural special cases.
Download or read book Neuroeconomics written by Daeyeol Lee and published by Elsevier Inc. Chapters. This book was released on 2013-08-13 with total page 47 pages. Available in PDF, EPUB and Kindle. Book excerpt: We can often improve the outcomes of decisions in various social contexts as we become more familiar with the motives and strategies of other decision makers. However, the underlying neural mechanisms responsible for such learning remain poorly understood. The neural substrates of learning during social decision making have been studied at the level of single neurons in non-human primates trained in computer-simulated competitive games. The results from these studies have revealed that similar to humans, monkeys adjust their decision-making strategies using both model-free and model-based reinforcement learning algorithms. Neurophysiological recordings also indicate that these computational algorithms are supported by the broad network of cortical and subcortical areas, including the prefrontal cortex, posterior parietal cortex, basal ganglia, and superior colliculus.
Download or read book The Dynamic Brain written by Mingzhou Ding and published by Oxford University Press, USA. This book was released on 2011 with total page 393 pages. Available in PDF, EPUB and Kindle. Book excerpt: Theoretical, experimental and clinical perspectives. Readership: Graduate students, postdocs and research scientists in Neuroscience.
Download or read book Stochastic Games and Applications written by Abraham Neyman and published by Springer Science & Business Media. This book was released on 2012-12-06 with total page 466 pages. Available in PDF, EPUB and Kindle. Book excerpt: This volume is based on lectures given at the NATO Advanced Study Institute on "Stochastic Games and Applications," which took place at Stony Brook, NY, USA, July 1999. It gives the editors great pleasure to present it on the occasion of L.S. Shapley's eightieth birthday, and on the fiftieth "birthday" of his seminal paper "Stochastic Games," with which this volume opens. We wish to thank NATO for the grant that made the Institute and this volume possible, and the Center for Game Theory in Economics of the State University of New York at Stony Brook for hosting this event. We also wish to thank the Hebrew University of Jerusalem, Israel, for providing continuing financial support, without which this project would never have been completed. In particular, we are grateful to our editorial assistant Mike Borns, whose work has been indispensable. We also would like to acknowledge the support of the Ecole Poly tech nique, Paris, and the Israel Science Foundation. March 2003 Abraham Neyman and Sylvain Sorin ix STOCHASTIC GAMES L.S. SHAPLEY University of California at Los Angeles Los Angeles, USA 1. Introduction In a stochastic game the play proceeds by steps from position to position, according to transition probabilities controlled jointly by the two players.
Download or read book Decision Neuroscience written by Jean-Claude Dreher and published by Academic Press. This book was released on 2016-09-27 with total page 442 pages. Available in PDF, EPUB and Kindle. Book excerpt: Decision Neuroscience addresses fundamental questions about how the brain makes perceptual, value-based, and more complex decisions in non-social and social contexts. This book presents compelling neuroimaging, electrophysiological, lesional, and neurocomputational models in combination with hormonal and genetic approaches, which have led to a clearer understanding of the neural mechanisms behind how the brain makes decisions. The five parts of the book address distinct but inter-related topics and are designed to serve both as classroom introductions to major subareas in decision neuroscience and as advanced syntheses of all that has been accomplished in the last decade. Part I is devoted to anatomical, neurophysiological, pharmacological, and optogenetics animal studies on reinforcement-guided decision making, such as the representation of instructions, expectations, and outcomes; the updating of action values; and the evaluation process guiding choices between prospective rewards. Part II covers the topic of the neural representations of motivation, perceptual decision making, and value-based decision making in humans, combining neurcomputational models and brain imaging studies. Part III focuses on the rapidly developing field of social decision neuroscience, integrating recent mechanistic understanding of social decisions in both non-human primates and humans. Part IV covers clinical aspects involving disorders of decision making that link together basic research areas including systems, cognitive, and clinical neuroscience; this part examines dysfunctions of decision making in neurological and psychiatric disorders, such as Parkinson’s disease, schizophrenia, behavioral addictions, and focal brain lesions. Part V focuses on the roles of various hormones (cortisol, oxytocin, ghrelin/leptine) and genes that underlie inter-individual differences observed with stress, food choices, and social decision-making processes. The volume is essential reading for anyone interested in decision making neuroscience. With contributions that are forward-looking assessments of the current and future issues faced by researchers, Decision Neuroscience is essential reading for anyone interested in decision-making neuroscience. Provides comprehensive coverage of approaches to studying individual and social decision neuroscience, including primate neurophysiology, brain imaging in healthy humans and in various disorders, and genetic and hormonal influences on decision making Covers multiple levels of analysis, from molecular mechanisms to neural-systems dynamics and computational models of how we make choices Discusses clinical implications of process dysfunctions, including schizophrenia, Parkinson’s disease, eating disorders, drug addiction, and pathological gambling Features chapters from top international researchers in the field and full-color presentation throughout with numerous illustrations to highlight key concepts
Download or read book An Application of Decision Theoretical Models of Probabilistic Choice to Solving 2x2 Simultaneous Move Noncooperative Games in the Normal Form written by Pavlo R. Blavatskyy and published by . This book was released on 2013 with total page 0 pages. Available in PDF, EPUB and Kindle. Book excerpt: Several models of probabilistic choice under uncertainty allow for deterministic choice if one act state-wise dominates the other. Such models have a natural application in game theory where probabilistic choice corresponds to mixed strategies, deterministic choice -- to pure strategies and state-wise dominance -- to strategic dominance. This paper considers an application to the simplest possible 2x2 simultaneous-move noncooperative game in the normal form. We derive a new equilibrium solution concept that coincides with the standard Nash equilibrium in pure strategies but resembles a quantal response equilibrium in mixed strategies. In particular, players randomize between strategies not in order to keep their opponent indifferent between his or her strategies (as in the mixed strategy Nash equilibrium) but because they are more likely to (but not always) choose strategies yielding higher utility.
Download or read book Foundations of Neuroeconomic Analysis written by Paul W. Glimcher and published by OUP USA. This book was released on 2011 with total page 488 pages. Available in PDF, EPUB and Kindle. Book excerpt: Neuroeconomics has emerged at the border of the social and natural sciences. This book argues that a meaningful interdisciplinary synthesis of the study of human and animal choice is not only desirable, but also well underway, and so it is time to develop formally a foundational approach for the field.
Download or read book Distributed Optimization Game and Learning Algorithms written by Huiwei Wang and published by Springer Nature. This book was released on 2021-01-04 with total page 227 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book provides the fundamental theory of distributed optimization, game and learning. It includes those working directly in optimization,-and also many other issues like time-varying topology, communication delay, equality or inequality constraints,-and random projections. This book is meant for the researcher and engineer who uses distributed optimization, game and learning theory in fields like dynamic economic dispatch, demand response management and PHEV routing of smart grids.
Download or read book Neuroeconomics written by Xiao-Jing Wang and published by Elsevier Inc. Chapters. This book was released on 2013-08-13 with total page 52 pages. Available in PDF, EPUB and Kindle. Book excerpt: All of the models developed in preceding chapters present analyses at the level of action potential firing rates in major output neurons. This is, however, only one kind of neurbiological modeling. A large and dynamic community of theorists also develop more biophysically detailed models that often make detailed and testable predictions about the dynamics of both neuronal firing rates and behavior. This chapter presents an example of that approach in the study of decision making. The chapter begins by developing biophysically plausible accumulator models of the type described in Chapter 19. It then goes on to show how such a circuit can be endowed with realistic reward-dependent learning to guide value-based decision making. A detailed explanation of how models of this kind account for dopamine-dependent reward learning is provided. The chapter concludes with a discussion of the behavior of models of this class in strategic games, during probabilistic inference and during “irrational” decision making.
Download or read book The Complete Idiot s Guide to Game Theory written by Edward C. Rosenthal Ph.D. and published by Penguin. This book was released on 2011-03-01 with total page 419 pages. Available in PDF, EPUB and Kindle. Book excerpt: Gain some insight into the game of life... Game Theory means rigorous strategic thinking. It is based on the idea that everyone acts competitively and in his own best interest. With the help of mathematical models, it is possible to anticipate the actions of others in nearly all life's enterprises. This book includes down-to-earth examples and solutions, as well as charts and illustrations designed to help teach the concept. In The Complete Idiot's Guide® to Game Theory, Dr. Edward C. Rosenthal makes it easy to understand game theory with insights into: • The history of the discipline made popular by John Nash, the mathematician dramatized in the film A Beautiful Mind • The role of social behavior and psychology in this amazing discipline • How important game theory has become in our society and why
Download or read book Proceedings of the Twenty first Annual Conference of the Cognitive Science Society written by Martin Hahn and published by Psychology Press. This book was released on 2020-12-22 with total page 847 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book presents the complete collection of peer-reviewed presentations at the 1999 Cognitive Science Society meeting, including papers, poster abstracts, and descriptions of conference symposia. For students and researchers in all areas of cognitive science.
