Download or read book From Markov Jump Processes to Spatial Queues written by L. Breuer and published by Springer Science & Business Media. This book was released on 2012-12-06 with total page 165 pages. Available in PDF, EPUB and Kindle. Book excerpt: From Markov Jump Processes to Spatial Queues aims to develop a unified theory of spatial queues that yields concrete results for the performance analysis of mobile communication networks. A particular objective is to develop the most natural generalization of existing concepts (e.g. the BMAP) toward the needs of mobile communication networks. To these belong the spatial distribution of batch arrivals and users in the system as well as time-inhomogeneous (e.g. periodic) arrival intensities and user movements. One of the major recent challenges for the stochastic modelling of communication systems is the emergence of wireless networks, which are used by more and more subscribers today. The main new feature of those, which is not covered by classical queuing theory, clearly is the importance of the user location within the area that is served by the base stations of the network. In the framework of queuing theory, this opens up the natural extension of classical queuing models towards queues with a structured space in which users are served. The present book is intended to introduce this extension under the name of spatial queues. The main point of view and the general approach will be that of Markov jump processes. We start with a closer look into the theory. Then we present new results for the theory of stochastic processes as well as for classical queuing theory. Finally we introduce the new concepts of spatial Markovian arrival processes and spatial queues. The main text is divided into three parts. The first part provides a new presentation of the theory of Markov jump processes. We derive a number of new results, especially for time-inhomogeneous processes, which have been neglected too much in the current textbooks on stochastic processes. For the first time, the class of Markov-additive jump processes is analysed in detail. This extends and unifies all Markovian arrival processes that have been proposed up to now (including arrivals for fluid queues) and provides a foundation for the subsequent introduction of spatial Markovian arrival processes. The second part contains new results for classical queues with BMAP input. These include the first explicit formulae for the distribution of periodic queues. The class of fluid Markovian arrival processes is introduced, and we give statistical estimates for the parameters of a BMAP. In the third part, the concepts of spatial Markovian arrival processes (abbreviated: SMAPs) and spatial queues are introduced. After that, periodic spatial Markovian queues are analysed as a model for the cells of a wireless communication network. From Markov Jump Processes to Spatial Queues is intended to reach queuing theorists, researchers in the field of communication systems, as well as engineers with some background in probability theory. Furthermore, it is suitable as a textbook for advanced queuing theory on the graduate or post-graduate level.
Download or read book An Introduction to Queueing Theory written by L. Breuer and published by Springer Science & Business Media. This book was released on 2006-02-23 with total page 274 pages. Available in PDF, EPUB and Kindle. Book excerpt: The present textbook contains the recordsof a two–semester course on que- ing theory, including an introduction to matrix–analytic methods. This course comprises four hours oflectures and two hours of exercises per week andhas been taughtattheUniversity of Trier, Germany, for about ten years in - quence. The course is directed to last year undergraduate and?rst year gr- uate students of applied probability and computer science, who have already completed an introduction to probability theory. Its purpose is to present - terial that is close enough to concrete queueing models and their applications, while providing a sound mathematical foundation for the analysis of these. Thus the goal of the present book is two–fold. On the one hand, students who are mainly interested in applications easily feel bored by elaborate mathematical questions in the theory of stochastic processes. The presentation of the mathematical foundations in our courses is chosen to cover only the necessary results, which are needed for a solid foundation of the methods of queueing analysis. Further, students oriented - wards applications expect to have a justi?cation for their mathematical efforts in terms of immediate use in queueing analysis. This is the main reason why we have decided to introduce new mathematical concepts only when they will be used in the immediate sequel. On the other hand, students of applied probability do not want any heur- tic derivations just for the sake of yielding fast results for the model at hand.
Download or read book Controlled Markov Processes written by Nicolaas M. van Dijk and published by . This book was released on 1983 with total page 264 pages. Available in PDF, EPUB and Kindle. Book excerpt:
Download or read book Information Technologies and Mathematical Modelling Queueing Theory and Applications written by Alexander Dudin and published by Springer. This book was released on 2018-08-27 with total page 411 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book constitutes the proceedings of the 17th International Conference on Information Technologies and Mathematical Modelling, ITMM 2018, named after A.F. Terpugov, and the 12th Workshop on Retrial Queues and Related Topics, held in Tomsk, Russia, in September 2018. The 30 papers presented in this volume were carefully reviewed and selected from 84 submissions. The conference covers various aspects of information technologies, focusing on queueing theory, stochastic processes, Markov processes, renewal theory, network performance equation and network protocols.
Download or read book Continuous Time Markov Decision Processes written by Xianping Guo and published by Springer Science & Business Media. This book was released on 2009-09-18 with total page 240 pages. Available in PDF, EPUB and Kindle. Book excerpt: Continuous-time Markov decision processes (MDPs), also known as controlled Markov chains, are used for modeling decision-making problems that arise in operations research (for instance, inventory, manufacturing, and queueing systems), computer science, communications engineering, control of populations (such as fisheries and epidemics), and management science, among many other fields. This volume provides a unified, systematic, self-contained presentation of recent developments on the theory and applications of continuous-time MDPs. The MDPs in this volume include most of the cases that arise in applications, because they allow unbounded transition and reward/cost rates. Much of the material appears for the first time in book form.
Download or read book Markov Modulated Processes and Semiregenerative Phenomena written by Loon Ching Tang and published by World Scientific. This book was released on 2009 with total page 237 pages. Available in PDF, EPUB and Kindle. Book excerpt: The book presents a coherent treatment of Markov random walks and Markov additive processes together with their applications. Part I provides the foundations of these stochastic processes underpinned by a solid theoretical framework based on Semiregenerative phenomena. Part II presents some applications to queueing and storage systems.
Download or read book Markov Processes for Stochastic Modeling written by Oliver Ibe and published by Newnes. This book was released on 2013-05-22 with total page 515 pages. Available in PDF, EPUB and Kindle. Book excerpt: Markov processes are processes that have limited memory. In particular, their dependence on the past is only through the previous state. They are used to model the behavior of many systems including communications systems, transportation networks, image segmentation and analysis, biological systems and DNA sequence analysis, random atomic motion and diffusion in physics, social mobility, population studies, epidemiology, animal and insect migration, queueing systems, resource management, dams, financial engineering, actuarial science, and decision systems. Covering a wide range of areas of application of Markov processes, this second edition is revised to highlight the most important aspects as well as the most recent trends and applications of Markov processes. The author spent over 16 years in the industry before returning to academia, and he has applied many of the principles covered in this book in multiple research projects. Therefore, this is an applications-oriented book that also includes enough theory to provide a solid ground in the subject for the reader. Presents both the theory and applications of the different aspects of Markov processes Includes numerous solved examples as well as detailed diagrams that make it easier to understand the principle being presented Discusses different applications of hidden Markov models, such as DNA sequence analysis and speech analysis.
Download or read book Markov Processes written by James R. Kirkwood and published by CRC Press. This book was released on 2015-02-09 with total page 336 pages. Available in PDF, EPUB and Kindle. Book excerpt: Clear, rigorous, and intuitive, Markov Processes provides a bridge from an undergraduate probability course to a course in stochastic processes and also as a reference for those that want to see detailed proofs of the theorems of Markov processes. It contains copious computational examples that motivate and illustrate the theorems. The text is desi
Download or read book Continuous Time Markov Decision Processes written by Alexey Piunovskiy and published by Springer Nature. This book was released on 2020-11-09 with total page 605 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book offers a systematic and rigorous treatment of continuous-time Markov decision processes, covering both theory and possible applications to queueing systems, epidemiology, finance, and other fields. Unlike most books on the subject, much attention is paid to problems with functional constraints and the realizability of strategies. Three major methods of investigations are presented, based on dynamic programming, linear programming, and reduction to discrete-time problems. Although the main focus is on models with total (discounted or undiscounted) cost criteria, models with average cost criteria and with impulsive controls are also discussed in depth. The book is self-contained. A separate chapter is devoted to Markov pure jump processes and the appendices collect the requisite background on real analysis and applied probability. All the statements in the main text are proved in detail. Researchers and graduate students in applied probability, operational research, statistics and engineering will find this monograph interesting, useful and valuable.
Download or read book Tools and Algorithms for the Construction and Analysis of Systems written by Jan Friso Groote and published by Springer Nature. This book was released on 2021-04-20 with total page 471 pages. Available in PDF, EPUB and Kindle. Book excerpt: This open access two-volume set constitutes the proceedings of the 27th International Conference on Tools and Algorithms for the Construction and Analysis of Systems, TACAS 2021, which was held during March 27 – April 1, 2021, as part of the European Joint Conferences on Theory and Practice of Software, ETAPS 2021. The conference was planned to take place in Luxembourg and changed to an online format due to the COVID-19 pandemic. The total of 41 full papers presented in the proceedings was carefully reviewed and selected from 141 submissions. The volume also contains 7 tool papers; 6 Tool Demo papers, 9 SV-Comp Competition Papers. The papers are organized in topical sections as follows: Part I: Game Theory; SMT Verification; Probabilities; Timed Systems; Neural Networks; Analysis of Network Communication. Part II: Verification Techniques (not SMT); Case Studies; Proof Generation/Validation; Tool Papers; Tool Demo Papers; SV-Comp Tool Competition Papers.
Download or read book Control of Spatially Structured Random Processes and Random Fields with Applications written by Ruslan K. Chornei and published by Springer Science & Business Media. This book was released on 2006-09-03 with total page 269 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book is devoted to the study and optimization of spatiotemporal stochastic processes - processes which develop simultaneously in space and time under random influences. These processes are seen to occur almost everywhere when studying the global behavior of complex systems. The book presents problems and content not considered in other books on controlled Markov processes, especially regarding controlled Markov fields on graphs.
Download or read book Stochastic Networks and Queues written by Philippe Robert and published by Springer Science & Business Media. This book was released on 2013-04-17 with total page 406 pages. Available in PDF, EPUB and Kindle. Book excerpt: Queues and stochastic networks are analyzed in this book with purely probabilistic methods. The purpose of these lectures is to show that general results from Markov processes, martingales or ergodic theory can be used directly to study the corresponding stochastic processes. Recent developments have shown that, instead of having ad-hoc methods, a better understanding of fundamental results on stochastic processes is crucial to study the complex behavior of stochastic networks. In this book, various aspects of these stochastic models are investigated in depth in an elementary way: Existence of equilibrium, characterization of stationary regimes, transient behaviors (rare events, hitting times) and critical regimes, etc. A simple presentation of stationary point processes and Palm measures is given. Scaling methods and functional limit theorems are a major theme of this book. In particular, a complete chapter is devoted to fluid limits of Markov processes.
Download or read book Advances in Queueing Theory Methods and Open Problems written by Jewgeni H. Dshalalow and published by CRC Press. This book was released on 2023-07-21 with total page 527 pages. Available in PDF, EPUB and Kindle. Book excerpt: The progress of science and technology has placed Queueing Theory among the most popular disciplines in applied mathematics, operations research, and engineering. Although queueing has been on the scientific market since the beginning of this century, it is still rapidly expanding by capturing new areas in technology. Advances in Queueing provides a comprehensive overview of problems in this enormous area of science and focuses on the most significant methods recently developed. Written by a team of 24 eminent scientists, the book examines stochastic, analytic, and generic methods such as approximations, estimates and bounds, and simulation. The first chapter presents an overview of classical queueing methods from the birth of queues to the seventies. It also contains the most comprehensive bibliography of books on queueing and telecommunications to date. Each of the following chapters surveys recent methods applied to classes of queueing systems and networks followed by a discussion of open problems and future research directions. Advances in Queueing is a practical reference that allows the reader quick access to the latest methods.
Download or read book Markov Models Optimization written by M.H.A. Davis and published by Routledge. This book was released on 2018-02-19 with total page 316 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book presents a radically new approach to problems of evaluating and optimizing the performance of continuous-time stochastic systems. This approach is based on the use of a family of Markov processes called Piecewise-Deterministic Processes (PDPs) as a general class of stochastic system models. A PDP is a Markov process that follows deterministic trajectories between random jumps, the latter occurring either spontaneously, in a Poisson-like fashion, or when the process hits the boundary of its state space. This formulation includes an enormous variety of applied problems in engineering, operations research, management science and economics as special cases; examples include queueing systems, stochastic scheduling, inventory control, resource allocation problems, optimal planning of production or exploitation of renewable or non-renewable resources, insurance analysis, fault detection in process systems, and tracking of maneuvering targets, among many others. The first part of the book shows how these applications lead to the PDP as a system model, and the main properties of PDPs are derived. There is particular emphasis on the so-called extended generator of the process, which gives a general method for calculating expectations and distributions of system performance functions. The second half of the book is devoted to control theory for PDPs, with a view to controlling PDP models for optimal performance: characterizations are obtained of optimal strategies both for continuously-acting controllers and for control by intervention (impulse control). Throughout the book, modern methods of stochastic analysis are used, but all the necessary theory is developed from scratch and presented in a self-contained way. The book will be useful to engineers and scientists in the application areas as well as to mathematicians interested in applications of stochastic analysis.
Download or read book Mathematical Reviews written by and published by . This book was released on 2006 with total page 980 pages. Available in PDF, EPUB and Kindle. Book excerpt:
Download or read book Introduction to Stochastic Networks written by Richard Serfozo and published by Springer Science & Business Media. This book was released on 2012-12-06 with total page 312 pages. Available in PDF, EPUB and Kindle. Book excerpt: Beginning with Jackson networks and ending with spatial queuing systems, this book describes several basic stochastic network processes, with the focus on network processes that have tractable expressions for the equilibrium probability distribution of the numbers of units at the stations. Intended for graduate students and researchers in engineering, science and mathematics interested in the basics of stochastic networks that have been developed over the last twenty years, the text assumes a graduate course in stochastic processes without measure theory, emphasising multi-dimensional Markov processes. Alongside self-contained material on point processes involving real analysis, the book also contains complete introductions to reversible Markov processes, Palm probabilities for stationary systems, Little laws for queuing systems and space-time Poisson processes.
Download or read book Numerical Methods in Markov Chains and Bulk Queues written by T. P. Bagchi and published by Springer Science & Business Media. This book was released on 2012-12-06 with total page 100 pages. Available in PDF, EPUB and Kindle. Book excerpt:
