Download or read book Workflows for e Science written by Ian J. Taylor and published by Springer Science & Business Media. This book was released on 2007-12-31 with total page 532 pages. Available in PDF, EPUB and Kindle. Book excerpt: This is a timely book presenting an overview of the current state-of-the-art within established projects, presenting many different aspects of workflow from users to tool builders. It provides an overview of active research, from a number of different perspectives. It includes theoretical aspects of workflow and deals with workflow for e-Science as opposed to e-Commerce. The topics covered will be of interest to a wide range of practitioners.
Download or read book Scientific Workflows written by Jun Qin and published by Springer Science & Business Media. This book was released on 2012-08-15 with total page 228 pages. Available in PDF, EPUB and Kindle. Book excerpt: Creating scientific workflow applications is a very challenging task due to the complexity of the distributed computing environments involved, the complex control and data flow requirements of scientific applications, and the lack of high-level languages and tools support. Particularly, sophisticated expertise in distributed computing is commonly required to determine the software entities to perform computations of workflow tasks, the computers on which workflow tasks are to be executed, the actual execution order of workflow tasks, and the data transfer between them. Qin and Fahringer present a novel workflow language called Abstract Workflow Description Language (AWDL) and the corresponding standards-based, knowledge-enabled tool support, which simplifies the development of scientific workflow applications. AWDL is an XML-based language for describing scientific workflow applications at a high level of abstraction. It is designed in a way that allows users to concentrate on specifying such workflow applications without dealing with either the complexity of distributed computing environments or any specific implementation technology. This research monograph is organized into five parts: overview, programming, optimization, synthesis, and conclusion, and is complemented by an appendix and an extensive reference list. The topics covered in this book will be of interest to both computer science researchers (e.g. in distributed programming, grid computing, or large-scale scientific applications) and domain scientists who need to apply workflow technologies in their work, as well as engineers who want to develop distributed and high-throughput workflow applications, languages and tools.
Download or read book Business and Scientific Workflows written by Wei Tan and published by John Wiley & Sons. This book was released on 2013-03-05 with total page 167 pages. Available in PDF, EPUB and Kindle. Book excerpt: Focuses on how to use web service computing and service-based workflow technologies to develop timely, effective workflows for both business and scientific fields Utilizing web computing and Service-Oriented Architecture (SOA), Business and Scientific Workflows: A Web Service Oriented Approach focuses on how to design, analyze, and deploy web service based workflows for both business and scientific applications in many areas of healthcare and biomedicine. It also discusses and presents the recent research and development results. This informative reference features application scenarios that include healthcare and biomedical applications, such as personalized healthcare processing, DNA sequence data processing, and electrocardiogram wave analysis, and presents: Updated research and development results on the composition technologies of web services for ever-sophisticated service requirements from various users and communities Fundamental methods such as Petri nets and social network analysis to advance the theory and applications of workflow design and web service composition Practical and real applications of the developed theory and methods for such platforms as personalized healthcare and Biomedical Informatics Grids The authors' efforts on advancing service composition methods for both business and scientific software systems, with theoretical and empirical contributions With workflow-driven service composition and reuse being a hot topic in both academia and industry, this book is ideal for researchers, engineers, scientists, professionals, and students who work on service computing, software engineering, business and scientific workflow management, the internet, and management information systems (MIS).
Download or read book Automated Optimization Methods for Scientific Workflows in e Science Infrastructures written by Sonja Holl and published by Forschungszentrum Jülich. This book was released on 2014 with total page 207 pages. Available in PDF, EPUB and Kindle. Book excerpt: Scientific workflows have emerged as a key technology that assists scientists with the design, management, execution, sharing and reuse of in silico experiments. Workflow management systems simplify the management of scientific workflows by providing graphical interfaces for their development, monitoring and analysis. Nowadays, e-Science combines such workflow management systems with large-scale data and computing resources into complex research infrastructures. For instance, e-Science allows the conveyance of best practice research in collaborations by providing workflow repositories, which facilitate the sharing and reuse of scientific workflows. However, scientists are still faced with different limitations while reusing workflows. One of the most common challenges they meet is the need to select appropriate applications and their individual execution parameters. If scientists do not want to rely on default or experience-based parameters, the best-effort option is to test different workflow set-ups using either trial and error approaches or parameter sweeps. Both methods may be inefficient or time consuming respectively, especially when tuning a large number of parameters. Therefore, scientists require an effective and efficient mechanism that automatically tests different workflow set-ups in an intelligent way and will help them to improve their scientific results. This thesis addresses the limitation described above by defining and implementing an approach for the optimization of scientific workflows. In the course of this work, scientists’ needs are investigated and requirements are formulated resulting in an appropriate optimization concept. In a following step, this concept is prototypically implemented by extending a workflow management system with an optimization framework, including general mechanisms required to conduct workflow optimization. As optimization is an ongoing research topic, different algorithms are provided by pluggable extensions (plugins) that can be loosely coupled with the framework, resulting in a generic and quickly extendable system. In this thesis, an exemplary plugin is introduced which applies a Genetic Algorithm for parameter optimization. In order to accelerate and therefore make workflow optimization feasible at all, e-Science infrastructures are utilized for the parallel execution of scientific workflows. This is empowered by additional extensions enabling the execution of applications and workflows on distributed computing resources. The actual implementation and therewith the general approach of workflow optimization is experimentally verified by four use cases in the life science domain. All workflows were significantly improved, which demonstrates the advantage of the proposed workflow optimization. Finally, a new collaboration-based approach is introduced that harnesses optimization provenance to make optimization faster and more robust in the future.
Download or read book A Framework for Model Driven Scientific Workflow Engineering written by Guido Scherp and published by BoD – Books on Demand. This book was released on 2013-11-06 with total page 322 pages. Available in PDF, EPUB and Kindle. Book excerpt: Scientific workflows are one important means in the context of data-intensive science for reliable and efficient scientific data processing in distributed computing infrastructures such as Grids. A common trend is to adapt existing and established business workflow technologies instead of developing own technologies from scratch. This thesis provides a model-driven approach for scientific workflow engineering, in which domain-specific languages (DSLs) tailored for a certain scientific domain are used for scientific workflow modeling, and automated mapping techniques for technical execution are developed and evaluated. The Business Process Model and Notation (BPMN) is thereby used at the domain-specific layer and the Web Services Business Process Execution Language (BPEL) at the technical layer. The implementation uses the Eclipse Modeling Framework (EMf) and is evaluated in three application scenarios.
Download or read book Web Semantics for Textual and Visual Information Retrieval written by Singh, Aarti and published by IGI Global. This book was released on 2017-02-22 with total page 311 pages. Available in PDF, EPUB and Kindle. Book excerpt: Modern society exists in a digital era in which high volumes of multimedia information exists. To optimize the management of this data, new methods are emerging for more efficient information retrieval. Web Semantics for Textual and Visual Information Retrieval is a pivotal reference source for the latest academic research on embedding and associating semantics with multimedia information to improve data retrieval techniques. Highlighting a range of pertinent topics such as automation, knowledge discovery, and social networking, this book is ideally designed for researchers, practitioners, students, and professionals interested in emerging trends in information retrieval.
Download or read book Provenance and Annotation of Data and Processes written by Juliana Freire and published by Springer Science & Business Media. This book was released on 2008-12-02 with total page 339 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book constitutes the thoroughly refereed post-conference proceedings of the Second International Provenance and Annotation Workshop, IPAW 2008, held in Salt Lake City, UT, USA, in June 2007. The 14 revised full papers and 15 revised short and demo papers presented together with 2 keynote lectures were carefully reviewed and selected from 40 submissions. The paper are organized in topical sections on provenance: models and querying; provenance: visualization, failures, identity; provenance and workflows; provenance for streams and collaboration; and applications.
Download or read book Temporal QOS Management in Scientific Cloud Workflow Systems written by Xiao Liu and published by Elsevier. This book was released on 2012-02-20 with total page 155 pages. Available in PDF, EPUB and Kindle. Book excerpt: Cloud computing can provide virtually unlimited scalable high performance computing resources. Cloud workflows often underlie many large scale data/computation intensive e-science applications such as earthquake modelling, weather forecasting and astrophysics. During application modelling, these sophisticated processes are redesigned as cloud workflows, and at runtime, the models are executed by employing the supercomputing and data sharing ability of the underlying cloud computing infrastructures. Temporal QOS Management in Scientific Cloud Workflow Systems focuses on real world scientific applications which often must be completed by satisfying a set of temporal constraints such as milestones and deadlines. Meanwhile, activity duration, as a measurement of system performance, often needs to be monitored and controlled. This book demonstrates how to guarantee on-time completion of most, if not all, workflow applications. Offering a comprehensive framework to support the lifecycle of time-constrained workflow applications, this book will enhance the overall performance and usability of scientific cloud workflow systems. - Explains how to reduce the cost to detect and handle temporal violations while delivering high quality of service (QoS) - Offers new concepts, innovative strategies and algorithms to support large-scale sophisticated applications in the cloud - Improves the overall performance and usability of cloud workflow systems
Download or read book Perspectives in Business Informatics Research written by Janis Grabis and published by Springer. This book was released on 2011-10-07 with total page 365 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book constitutes the refereed proceedings of the 10th International Conference on Perspectives in Business Informatics Research (BIR), held in Riga, Latvia, in October 2011. The 25 full papers accepted for this volume were selected from 68 submissions. In addition, two invited papers presented at the conference are also included. The papers have been organized in topical sessions on business intelligence and performance management, data and processes, ontologies, architectures, stakeholders' perspectives, Web information systems and services, and systems approach.
Download or read book Collaborative and Distributed E Research Innovations in Technologies Strategies and Applications written by Juan, Angel A. and published by IGI Global. This book was released on 2012-02-29 with total page 420 pages. Available in PDF, EPUB and Kindle. Book excerpt: "This book offers insight into practical and methodological issues related to collaborative e-research and furthers readers understanding of current and future trends in online research and the types of technologies involved"--Provided by publisher.
Download or read book Grid Computing written by Marios D. Dikaiakos and published by Springer Science & Business Media. This book was released on 2004-10-15 with total page 284 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book constitutes the thoroughly refereed post-proceedings of the Second European AcrossGrid Conference, AxGrids 2004, held in Nicosia, Cyprus in January 2004. The 27 revised full papers and 4 revised short papers presented were carefully selected during two rounds of reviewing and improvement from 57 submissions. The papers address the entire range of current topics in grid computing from computational and data grids to the semantic grid and grid application in various fields.
Download or read book Machine Learning and Knowledge Discovery in Databases written by Peter A. Flach and published by Springer. This book was released on 2012-08-15 with total page 867 pages. Available in PDF, EPUB and Kindle. Book excerpt: This two-volume set LNAI 7523 and LNAI 7524 constitutes the refereed proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases: ECML PKDD 2012, held in Bristol, UK, in September 2012. The 105 revised research papers presented together with 5 invited talks were carefully reviewed and selected from 443 submissions. The final sections of the proceedings are devoted to Demo and Nectar papers. The Demo track includes 10 papers (from 19 submissions) and the Nectar track includes 4 papers (from 14 submissions). The papers grouped in topical sections on association rules and frequent patterns; Bayesian learning and graphical models; classification; dimensionality reduction, feature selection and extraction; distance-based methods and kernels; ensemble methods; graph and tree mining; large-scale, distributed and parallel mining and learning; multi-relational mining and learning; multi-task learning; natural language processing; online learning and data streams; privacy and security; rankings and recommendations; reinforcement learning and planning; rule mining and subgroup discovery; semi-supervised and transductive learning; sensor data; sequence and string mining; social network mining; spatial and geographical data mining; statistical methods and evaluation; time series and temporal data mining; and transfer learning.
Download or read book Data Intensive Workflow Management written by Daniel Oliveira and published by Springer Nature. This book was released on 2022-06-01 with total page 161 pages. Available in PDF, EPUB and Kindle. Book excerpt: Workflows may be defined as abstractions used to model the coherent flow of activities in the context of an in silico scientific experiment. They are employed in many domains of science such as bioinformatics, astronomy, and engineering. Such workflows usually present a considerable number of activities and activations (i.e., tasks associated with activities) and may need a long time for execution. Due to the continuous need to store and process data efficiently (making them data-intensive workflows), high-performance computing environments allied to parallelization techniques are used to run these workflows. At the beginning of the 2010s, cloud technologies emerged as a promising environment to run scientific workflows. By using clouds, scientists have expanded beyond single parallel computers to hundreds or even thousands of virtual machines. More recently, Data-Intensive Scalable Computing (DISC) frameworks (e.g., Apache Spark and Hadoop) and environments emerged and are being used to execute data-intensive workflows. DISC environments are composed of processors and disks in large-commodity computing clusters connected using high-speed communications switches and networks. The main advantage of DISC frameworks is that they support and grant efficient in-memory data management for large-scale applications, such as data-intensive workflows. However, the execution of workflows in cloud and DISC environments raise many challenges such as scheduling workflow activities and activations, managing produced data, collecting provenance data, etc. Several existing approaches deal with the challenges mentioned earlier. This way, there is a real need for understanding how to manage these workflows and various big data platforms that have been developed and introduced. As such, this book can help researchers understand how linking workflow management with Data-Intensive Scalable Computing can help in understanding and analyzing scientific big data. In this book, we aim to identify and distill the body of work on workflow management in clouds and DISC environments. We start by discussing the basic principles of data-intensive scientific workflows. Next, we present two workflows that are executed in a single site and multi-site clouds taking advantage of provenance. Afterward, we go towards workflow management in DISC environments, and we present, in detail, solutions that enable the optimized execution of the workflow using frameworks such as Apache Spark and its extensions.
Download or read book High Performance Computing for Computational Science VECPAR 2010 written by José M. Laginha M. Palma and published by Springer Science & Business Media. This book was released on 2011-02-23 with total page 483 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book constitutes the thoroughly refereed post-conference proceedings of the 9th International Conference on High Performance Computing for Computational Science, VECPAR 2010, held in Berkeley, CA, USA, in June 2010. The 34 revised full papers presented together with five invited contributions were carefully selected during two rounds of reviewing and revision. The papers are organized in topical sections on linear algebra and solvers on emerging architectures, large-scale simulations, parallel and distributed computing, numerical algorithms.
Download or read book Workflow Management written by Kees Van Hee and published by MIT Press. This book was released on 2004-01-30 with total page 484 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book offers a comprehensive introduction to workflow management, the management of business processes with information technology. By defining, analyzing, and redesigning an organization's resources and operations, workflow management systems ensure that the right information reaches the right person or computer application at the right time. The book provides a basic overview of workflow terminology and organization, as well as detailed coverage of workflow modeling with Petri nets. Because Petri nets make definitions easier to understand for nonexperts, they facilitate communication between designers and users. The book includes a chapter of case studies, review exercises, and a glossary. A special Web site developed by the authors, www.workflowcourse.com, features animation, interactive examples, lecture materials, exercises and solutions, relevant links, and other valuable resources for the classroom.
Download or read book High Performance Computing and Communications written by Michael Gerndt and published by Springer. This book was released on 2006-09-09 with total page 960 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book constitutes the refereed proceedings of the Second International Conference on High Performance Computing and Communications, HPCC 2006. The book presents 95 revised full papers, addressing all current issues of parallel and distributed systems and high performance computing and communication. Coverage includes networking protocols, routing, and algorithms, languages and compilers for HPC, parallel and distributed architectures and algorithms, wireless, mobile and pervasive computing, Web services, peer-to-peer computing, and more.
Download or read book Grid Computing written by Lizhe Wang and published by CRC Press. This book was released on 2018-10-03 with total page 521 pages. Available in PDF, EPUB and Kindle. Book excerpt: Identifies Recent Technological Developments Worldwide The field of grid computing has made rapid progress in the past few years, evolving and developing in almost all areas, including concepts, philosophy, methodology, and usages. Grid Computing: Infrastructure, Service, and Applications reflects the recent advances in this field, covering the research aspects that involve infrastructure, middleware, architecture, services, and applications. Grid Systems Across the Globe The first section of the book focuses on infrastructure and middleware and presents several national and international grid systems. The text highlights China Research and Development environment Over Wide-area Network (CROWN), several ongoing cyberinfrastructure efforts in New York State, and Enabling Grids for E-sciencE (EGEE), which is co-funded by the European Commission and the world’s largest multidisciplinary grid infrastructure today. The second part of the book discusses recent grid service advances. The authors examine the UK National Grid Service (NGS), the concept of resource allocation in a grid environment, OMIIBPEL, and the possibility of treating scientific workflow issues using techniques from the data stream community. The book describes an SLA model, reviews portal and workflow technologies, presents an overview of PKIs and their limitations, and introduces PIndex, a peer-to-peer model for grid information services. New Projects and Initiatives The third section includes an analysis of innovative grid applications. Topics covered include the WISDOM initiative, incorporating flow-level networking models into grid simulators, system-level virtualization, grid usage in the high-energy physics environment in the LHC project, and the Service Oriented HLA RTI (SOHR) framework. With a comprehensive summary of past advances, this text is a window into the future of this nascent technology, forging a path for the next generation of cyberinfrastructure developers.
