Download or read book Perturbed Semi Markov Type Processes I written by Dmitrii Silvestrov and published by Springer Nature. This book was released on 2022-03-25 with total page 406 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book is the first volume of a two-volume monograph devoted to the study of limit and ergodic theorems for regularly and singularly perturbed Markov chains, semi-Markov processes, and multi-alternating regenerative processes with semi-Markov modulation. The first volume presents necessary and sufficient conditions for weak convergence for first-rare-event times and convergence in the topology J for first-rare-event processes defined on regularly perturbed finite Markov chains and semi-Markov processes. The text introduces new asymptotic recurrent algorithms of phase space reduction. It also addresses both effective conditions of weak convergence for distributions of hitting times as well as convergence of expectations of hitting times for regularly and singularly perturbed finite Markov chains and semi-Markov processes. The book also contains a comprehensive bibliography of major works in the field. It provides an effective reference for both graduate students as well as theoretical and applied researchers studying stochastic processes and their applications.

Download or read book Perturbed Semi Markov Type Processes II written by Dmitrii Silvestrov and published by Springer Nature. This book was released on 2022-03-21 with total page 420 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book is the second volume of a two-volume monograph devoted to the study of limit and ergodic theorems for regularly and singularly perturbed Markov chains, semi-Markov processes, and multi-alternating regenerative processes with semi-Markov modulation. The second volume presents a complete classification of ergodic theorems for alternating regenerative processes, including more than twenty-five such theorems. The text addresses new asymptotic recurrent algorithms of phase space reduction for multi-alternating regenerative processes modulating by regularly and singularly perturbed finite semi-Markov processes. It also features a new study of super-long, long, and short time ergodic theorems for these processes. The book also contains a comprehensive bibliography of major works in the field. It provides an effective reference for both graduate students as well as theoretical and applied researchers studying stochastic processes and their applications.

Download or read book Nonlinearly Perturbed Semi Markov Processes written by Dmitrii Silvestrov and published by Springer. This book was released on 2017-09-06 with total page 143 pages. Available in PDF, EPUB and Kindle. Book excerpt: The book presents new methods of asymptotic analysis for nonlinearly perturbed semi-Markov processes with a finite phase space. These methods are based on special time-space screening procedures for sequential phase space reduction of semi-Markov processes combined with the systematical use of operational calculus for Laurent asymptotic expansions. Effective recurrent algorithms are composed for getting asymptotic expansions, without and with explicit upper bounds for remainders, for power moments of hitting times, stationary and conditional quasi-stationary distributions for nonlinearly perturbed semi-Markov processes. These results are illustrated by asymptotic expansions for birth-death-type semi-Markov processes, which play an important role in various applications. The book will be a useful contribution to the continuing intensive studies in the area. It is an essential reference for theoretical and applied researchers in the field of stochastic processes and their applications that will contribute to continuing extensive studies in the area and remain relevant for years to come.

Download or read book Stochastic Processes and Applications written by Sergei Silvestrov and published by Springer. This book was released on 2018-12-05 with total page 475 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book highlights the latest advances in stochastic processes, probability theory, mathematical statistics, engineering mathematics and algebraic structures, focusing on mathematical models, structures, concepts, problems and computational methods and algorithms important in modern technology, engineering and natural sciences applications. It comprises selected, high-quality, refereed contributions from various large research communities in modern stochastic processes, algebraic structures and their interplay and applications. The chapters cover both theory and applications, illustrated by numerous figures, schemes, algorithms, tables and research results to help readers understand the material and develop new mathematical methods, concepts and computing applications in the future. Presenting new methods and results, reviews of cutting-edge research, and open problems and directions for future research, the book serves as a source of inspiration for a broad spectrum of researchers and research students in probability theory and mathematical statistics, applied algebraic structures, applied mathematics and other areas of mathematics and applications of mathematics. The book is based on selected contributions presented at the International Conference on “Stochastic Processes and Algebraic Structures – From Theory Towards Applications” (SPAS2017) to mark Professor Dmitrii Silvestrov’s 70th birthday and his 50 years of fruitful service to mathematics, education and international cooperation, which was held at Mälardalen University in Västerås and Stockholm University, Sweden, in October 2017.

Download or read book Semi Markov Processes written by Franciszek Grabski and published by Elsevier. This book was released on 2014-09-25 with total page 270 pages. Available in PDF, EPUB and Kindle. Book excerpt: Semi-Markov Processes: Applications in System Reliability and Maintenance is a modern view of discrete state space and continuous time semi-Markov processes and their applications in reliability and maintenance. The book explains how to construct semi-Markov models and discusses the different reliability parameters and characteristics that can be obtained from those models. The book is a useful resource for mathematicians, engineering practitioners, and PhD and MSc students who want to understand the basic concepts and results of semi-Markov process theory. Clearly defines the properties and theorems from discrete state Semi-Markov Process (SMP) theory Describes the method behind constructing Semi-Markov (SM) models and SM decision models in the field of reliability and maintenance Provides numerous individual versions of SM models, including the most recent and their impact on system reliability and maintenance

Download or read book Quasi Stationary Phenomena in Nonlinearly Perturbed Stochastic Systems written by Mats Gyllenberg and published by Walter de Gruyter. This book was released on 2008-10-31 with total page 593 pages. Available in PDF, EPUB and Kindle. Book excerpt: The book is devoted to studies of quasi-stationary phenomena in nonlinearly perturbed stochastic systems. New methods of asymptotic analysis for nonlinearly perturbed stochastic processes based on new types of asymptotic expansions for perturbed renewal equation and recurrence algorithms for construction of asymptotic expansions for Markov type processes with absorption are presented. Asymptotic expansions are given in mixed ergodic (for processes) and large deviation theorems (for absorption times) for nonlinearly perturbed regenerative processes, semi-Markov processes, and Markov chains. Applications to analysis of quasi-stationary phenomena in nonlinearly perturbed queueing systems, population dynamics and epidemic models, and for risk processes are presented. The book also contains an extended bibliography of works in the area. It is an essential reference for theoretical and applied researchers in the field of stochastic processes and their applications and may be also useful for doctoral and advanced undergraduate students.

Download or read book Semi Markov Processes and Reliability written by Nikolaos Limnios and published by Springer Science & Business Media. This book was released on 2001-02-16 with total page 238 pages. Available in PDF, EPUB and Kindle. Book excerpt: At first there was the Markov property. The theory of stochastic processes, which can be considered as an exten sion of probability theory, allows the modeling of the evolution of systems through the time. It cannot be properly understood just as pure mathemat ics, separated from the body of experience and examples that have brought it to life. The theory of stochastic processes entered a period of intensive develop ment, which is not finished yet, when the idea of the Markov property was brought in. Not even a serious study of the renewal processes is possible without using the strong tool of Markov processes. The modern theory of Markov processes has its origins in the studies by A. A: Markov (1856-1922) of sequences of experiments "connected in a chain" and in the attempts to describe mathematically the physical phenomenon known as Brownian mo tion. Later, many generalizations (in fact all kinds of weakenings of the Markov property) of Markov type stochastic processes were proposed. Some of them have led to new classes of stochastic processes and useful applications. Let us mention some of them: systems with complete connections [90, 91, 45, 86]; K-dependent Markov processes [44]; semi-Markov processes, and so forth. The semi-Markov processes generalize the renewal processes as well as the Markov jump processes and have numerous applications, especially in relia bility.

Download or read book Continuous Time Markov Chains and Applications written by George G. Yin and published by Springer. This book was released on 2012-12-06 with total page 358 pages. Available in PDF, EPUB and Kindle. Book excerpt: Using a singular perturbation approach, this is a systematic treatment of those systems that naturally arise in queuing theory, control and optimisation, and manufacturing, gathering a number of ideas which were previously scattered throughout the literature. The book presents results on asymptotic expansions of the corresponding probability distributions, functional occupation measures, exponential upper bounds, and asymptotic normality. To bridge the gap between theory and applications, a large portion of the book is devoted to various applications, thus reducing the dimensionality for problems under Markovian disturbances and providing tools for dealing with large-scale and complex real-world situations. Much of this stems from the authors'recent research, presenting results which have not appeared elsewhere. An important reference for researchers in applied mathematics, probability and stochastic processes, operations research, control theory, and optimisation.

Download or read book Discrete Time Semi Markov Random Evolutions and Their Applications written by Nikolaos Limnios and published by Springer Nature. This book was released on 2023-07-24 with total page 206 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book extends the theory and applications of random evolutions to semi-Markov random media in discrete time, essentially focusing on semi-Markov chains as switching or driving processes. After giving the definitions of discrete-time semi-Markov chains and random evolutions, it presents the asymptotic theory in a functional setting, including weak convergence results in the series scheme, and their extensions in some additional directions, including reduced random media, controlled processes, and optimal stopping. Finally, applications of discrete-time semi-Markov random evolutions in epidemiology and financial mathematics are discussed. This book will be of interest to researchers and graduate students in applied mathematics and statistics, and other disciplines, including engineering, epidemiology, finance and economics, who are concerned with stochastic models of systems.

Download or read book Applied Modeling Techniques and Data Analysis 1 written by Yiannis Dimotikalis and published by John Wiley & Sons. This book was released on 2021-05-11 with total page 306 pages. Available in PDF, EPUB and Kindle. Book excerpt: BIG DATA, ARTIFICIAL INTELLIGENCE AND DATA ANALYSIS SET Coordinated by Jacques Janssen Data analysis is a scientific field that continues to grow enormously, most notably over the last few decades, following rapid growth within the tech industry, as well as the wide applicability of computational techniques alongside new advances in analytic tools. Modeling enables data analysts to identify relationships, make predictions, and to understand, interpret and visualize the extracted information more strategically. This book includes the most recent advances on this topic, meeting increasing demand from wide circles of the scientific community. Applied Modeling Techniques and Data Analysis 1 is a collective work by a number of leading scientists, analysts, engineers, mathematicians and statisticians, working on the front end of data analysis and modeling applications. The chapters cover a cross section of current concerns and research interests in the above scientific areas. The collected material is divided into appropriate sections to provide the reader with both theoretical and applied information on data analysis methods, models and techniques, along with appropriate applications.

Download or read book Engineering Mathematics II written by Sergei Silvestrov and published by Springer. This book was released on 2017-02-10 with total page 436 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book highlights the latest advances in engineering mathematics with a main focus on the mathematical models, structures, concepts, problems and computational methods and algorithms most relevant for applications in modern technologies and engineering. It addresses mathematical methods of algebra, applied matrix analysis, operator analysis, probability theory and stochastic processes, geometry and computational methods in network analysis, data classification, ranking and optimisation. The individual chapters cover both theory and applications, and include a wealth of figures, schemes, algorithms, tables and results of data analysis and simulation. Presenting new methods and results, reviews of cutting-edge research, and open problems for future research, they equip readers to develop new mathematical methods and concepts of their own, and to further compare and analyse the methods and results discussed. The book consists of contributed chapters covering research developed as a result of a focused international seminar series on mathematics and applied mathematics and a series of three focused international research workshops on engineering mathematics organised by the Research Environment in Mathematics and Applied Mathematics at Mälardalen University from autumn 2014 to autumn 2015: the International Workshop on Engineering Mathematics for Electromagnetics and Health Technology; the International Workshop on Engineering Mathematics, Algebra, Analysis and Electromagnetics; and the 1st Swedish-Estonian International Workshop on Engineering Mathematics, Algebra, Analysis and Applications. It serves as a source of inspiration for a broad spectrum of researchers and research students in applied mathematics, as well as in the areas of applications of mathematics considered in the book.

Download or read book Continuous Semi Markov Processes written by Boris Harlamov and published by John Wiley & Sons. This book was released on 2013-03-01 with total page 313 pages. Available in PDF, EPUB and Kindle. Book excerpt: This title considers the special of random processes known as semi-Markov processes. These possess the Markov property with respect to any intrinsic Markov time such as the first exit time from an open set or a finite iteration of these times. The class of semi-Markov processes includes strong Markov processes, Lévy and Smith stepped semi-Markov processes, and some other subclasses. Extensive coverage is devoted to non-Markovian semi-Markov processes with continuous trajectories and, in particular, to semi-Markov diffusion processes. Readers looking to enrich their knowledge on Markov processes will find this book a valuable resource.

Download or read book Mathematical and Statistical Models and Methods in Reliability written by V.V. Rykov and published by Springer Science & Business Media. This book was released on 2010-11-02 with total page 465 pages. Available in PDF, EPUB and Kindle. Book excerpt: The book is a selection of invited chapters, all of which deal with various aspects of mathematical and statistical models and methods in reliability. Written by renowned experts in the field of reliability, the contributions cover a wide range of applications, reflecting recent developments in areas such as survival analysis, aging, lifetime data analysis, artificial intelligence, medicine, carcinogenesis studies, nuclear power, financial modeling, aircraft engineering, quality control, and transportation. Mathematical and Statistical Models and Methods in Reliability is an excellent reference text for researchers and practitioners in applied probability and statistics, industrial statistics, engineering, medicine, finance, transportation, the oil and gas industry, and artificial intelligence.

Download or read book Perturbation Theory and Markovian Decision Processes written by Paul J. Schweitzer and published by . This book was released on 1965 with total page 315 pages. Available in PDF, EPUB and Kindle. Book excerpt: The Howard-Jewell algorithm for programming over a Markov-renewal process is analyzed in terms of a perturbation theory formalism which describes how the stationary distribution changes when the transition probabilities change. The policy improvement technique is derived from this new viewpoint. The relative values may be interpreted as partial derivatives of the gain rate with respect to policy. The value equations are shown to be solvable, with the relative values unique up to one additive constant, if and only if the underlying Markov chain is irreducible. The policy iteration algorithm is shown not to cycle, this guaranteeing convergence. A discussion of the existence, uniqueness, and characterization of the solution to the functional equation of dynamic programming is given. Emphasis is placed upon the value maximization of transient states. The fundamental matrix is developed as a useful tool for doing perturbation theory, describing firstpassage properties of semi-Markov processes, and for dealing with semi-Markov processes with rewards. (Author).

Download or read book Stochastic Processes Statistical Methods and Engineering Mathematics written by Anatoliy Malyarenko and published by Springer Nature. This book was released on 2023-01-26 with total page 907 pages. Available in PDF, EPUB and Kindle. Book excerpt: The goal of the 2019 conference on Stochastic Processes and Algebraic Structures held in SPAS2019, Västerås, Sweden, from September 30th to October 2nd 2019, was to showcase the frontiers of research in several important areas of mathematics, mathematical statistics, and its applications. The conference was organized around the following topics 1. Stochastic processes and modern statistical methods,2. Engineering mathematics,3. Algebraic structures and their applications. The conference brought together a select group of scientists, researchers, and practitioners from the industry who are actively contributing to the theory and applications of stochastic, and algebraic structures, methods, and models. The conference provided early stage researchers with the opportunity to learn from leaders in the field, to present their research, as well as to establish valuable research contacts in order to initiate collaborations in Sweden and abroad. New methods for pricing sophisticated financial derivatives, limit theorems for stochastic processes, advanced methods for statistical analysis of financial data, and modern computational methods in various areas of applied science can be found in this book. The principal reason for the growing interest in these questions comes from the fact that we are living in an extremely rapidly changing and challenging environment. This requires the quick introduction of new methods, coming from different areas of applied science. Advanced concepts in the book are illustrated in simple form with the help of tables and figures. Most of the papers are self-contained, and thus ideally suitable for self-study. Solutions to sophisticated problems located at the intersection of various theoretical and applied areas of the natural sciences are presented in these proceedings.

Download or read book Random Motions in Markov and Semi Markov Random Environments 1 written by Anatoliy Pogorui and published by John Wiley & Sons. This book was released on 2021-03-16 with total page 256 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book is the first of two volumes on random motions in Markov and semi-Markov random environments. This first volume focuses on homogenous random motions. This volume consists of two parts, the first describing the basic concepts and methods that have been developed for random evolutions. These methods are the foundational tools used in both volumes, and this description includes many results in potential operators. Some techniques to find closed-form expressions in relevant applications are also presented. The second part deals with asymptotic results and presents a variety of applications, including random motion with different types of boundaries, the reliability of storage systems and solutions of partial differential equations with constant coefficients, using commutative algebra techniques. It also presents an alternative formulation to the Black-Scholes formula in finance, fading evolutions and telegraph processes, including jump telegraph processes and the estimation of the number of level crossings for telegraph processes.

Download or read book Markov Modulated Processes and Semiregenerative Phenomena written by and published by . This book was released on with total page pages. Available in PDF, EPUB and Kindle. Book excerpt: