Download or read book Learning Inductive Representations of Biomedical Data written by Samuel G. Finlayson and published by . This book was released on 2020 with total page 189 pages. Available in PDF, EPUB and Kindle. Book excerpt: Representation learning with neural networks has catalyzed rapid progress in biomedical pattern recognition. This progress, however, has generally been limited to domains where data are abundant, richly structured, and stable. In contrast, much of biomedicine is marked by limited and poorly structured data and by highly dynamic deployment environments. In particular, many of the most compelling problem areas in biomedicine involve the "long tails" of rare diseases and rare events. In this thesis, I confront the challenge of learning data representations whose utility can extend into dynamic and data-poor biomedical domains. I do so through three primary projects: First, I present a novel method for representation learning with subgraphs. This method, called Subgraph Neural Networks (Sub-GNN), learns disentangled representations of subgraph structure, neighborhood, and position through property-aware routing channels. The work is motivated by the desire for methods that can better contextualize patient phenotypes (encoded as subgraphs) into the broader context of biomedical knowledge, which could allow for better diagnostic generalization to novel disorders involving previously unseen phenotypes. Subgraph neural networks provide a principled framework for doing just this, by leveraging the relational inductive biases of the underlying knowledge graph while still respecting subgraphs as independent entities. Next, I present an approach to learning coordinated representations of small molecules and their associated transcriptional signatures. This approach extends a popular paradigm for drug development (known as connectivity mapping) to operate inductively, making predictions involving drugs that have not previously been experimentally assayed. I benchmark the performance of this approach, studying the circumstances under which it can and cannot achieve strong performance. Finally, I present an analysis of the clinical challenges posed by dataset shift, the phenomenon in which the input data to a deployed machine learning algorithm become mismatched with its training data. After introducing the problem of general dataset shift, I turn to a special case—adversarial examples—which reflect the worst-case generalization conditions for a machine learning system. I then build and test the representational robustness of three high-accuracy machine learning systems, constructing adversarial examples that cause their accuracy to drop to 0% on data that is imperceptibly different from the training data. I discuss the implications of these findings for clinical machine learning, offering specific regulatory recommendations. I conclude my thesis with lessons learned from these projects, and provide an extensive appendix with three additional smaller-scale projects that branched off of my research.

Download or read book Graph Representation Learning written by William L. William L. Hamilton and published by Springer Nature. This book was released on 2022-06-01 with total page 141 pages. Available in PDF, EPUB and Kindle. Book excerpt: Graph-structured data is ubiquitous throughout the natural and social sciences, from telecommunication networks to quantum chemistry. Building relational inductive biases into deep learning architectures is crucial for creating systems that can learn, reason, and generalize from this kind of data. Recent years have seen a surge in research on graph representation learning, including techniques for deep graph embeddings, generalizations of convolutional neural networks to graph-structured data, and neural message-passing approaches inspired by belief propagation. These advances in graph representation learning have led to new state-of-the-art results in numerous domains, including chemical synthesis, 3D vision, recommender systems, question answering, and social network analysis. This book provides a synthesis and overview of graph representation learning. It begins with a discussion of the goals of graph representation learning as well as key methodological foundations in graph theory and network analysis. Following this, the book introduces and reviews methods for learning node embeddings, including random-walk-based methods and applications to knowledge graphs. It then provides a technical synthesis and introduction to the highly successful graph neural network (GNN) formalism, which has become a dominant and fast-growing paradigm for deep learning with graph data. The book concludes with a synthesis of recent advancements in deep generative models for graphs—a nascent but quickly growing subset of graph representation learning.

Download or read book On Leveraging Representation Learning Techniques for Data Analytics in Biomedical Informatics written by Xi Hang Cao and published by . This book was released on 2019 with total page 124 pages. Available in PDF, EPUB and Kindle. Book excerpt: Representation Learning is ubiquitous in state-of-the-art machine learning workflow, including data exploration/visualization, data preprocessing, data model learning, and model interpretations. However, the majority of the newly proposed Representation Learning methods are more suitable for problems with a large amount of data. Applying these methods to problems with a limited amount of data may lead to unsatisfactory performance. Therefore, there is a need for developing Representation Learning methods which are tailored for problems with ``small data", such as, clinical and biomedical data analytics. In this dissertation, we describe our studies of tackling the challenging clinical and biomedical data analytics problem from four perspectives: data preprocessing, temporal data representation learning, output representation learning, and joint input-output representation learning. Data scaling is an important component in data preprocessing. The objective in data scaling is to scale/transform the raw features into reasonable ranges such that each feature of an instance will be equally exploited by the machine learning model. For example, in a credit flaw detection task, a machine learning model may utilize a person's credit score and annual income as features, but because the ranges of these two features are different, a machine learning model may consider one more heavily than another. In this dissertation, I thoroughly introduce the problem in data scaling and describe an approach for data scaling which can intrinsically handle the outlier problem and lead to better model prediction performance. Learning new representations for data in the unstandardized form is a common task in data analytics and data science applications. Usually, data come in a tubular form, namely, the data is represented by a table in which each row is a feature (row) vector of an instance. However, it is also common that the data are not in this form; for example, texts, images, and video/audio records. In this dissertation, I describe the challenge of analyzing imperfect multivariate time series data in healthcare and biomedical research and show that the proposed method can learn a powerful representation to encounter various imperfections and lead to an improvement of prediction performance. Learning output representations is a new aspect of Representation Learning, and its applications have shown promising results in complex tasks, including computer vision and recommendation systems. The main objective of an output representation algorithm is to explore the relationship among the target variables, such that a prediction model can efficiently exploit the similarities and potentially improve prediction performance. In this dissertation, I describe a learning framework which incorporates output representation learning to time-to-event estimation. Particularly, the approach learns the model parameters and time vectors simultaneously. Experimental results do not only show the effectiveness of this approach but also show the interpretability of this approach from the visualizations of the time vectors in 2-D space. Learning the input (feature) representation, output representation, and predictive modeling are closely related to each other. Therefore, it is a very natural extension of the state-of-the-art by considering them together in a joint framework. In this dissertation, I describe a large-margin ranking-based learning framework for time-to-event estimation with joint input embedding learning, output embedding learning, and model parameter learning. In the framework, I cast the functional learning problem to a kernel learning problem, and by adopting the theories in Multiple Kernel Learning, I propose an efficient optimization algorithm. Empirical results also show its effectiveness on several benchmark datasets.

Download or read book Leveraging Structure and Knowledge in Clinical and Biomedical Representation Learning written by Matthew Brian Andrew McDermott and published by . This book was released on 2022 with total page 0 pages. Available in PDF, EPUB and Kindle. Book excerpt: Datasets in the machine learning for health and biomedicine domain are often noisy, irregularly sampled, only sparsely labeled, and small relative to the dimensionality of the both the data and the tasks. These problems motivate the use of representation learning in this domain, which encompasses a variety of techniques designed to produce representations of a dataset that are amenable to downstream modelling tasks. Representation learning in this domain can also take advantage of the significant external knowledge in the biomedical domain. In this thesis, I will explore novel pre-training and representation learning strategies for biomedical data which leverage external structure or knowledge to inform learning at both local and global scales. These techniques will be explored in 4 chapters: (1) leveraging unlabeled data to infer distributional constraints in a semi-supervised learning setting; (2) using graph convolutional neural networks over gene-gene co-regulatory networks to improve modelling of gene expression data; (3) adapting pre-training techniques from natural language processing to electronic health record data, and showing that novel methods are needed for electronic health record timeseries data; and (4) asserting global structure in pre-training applications through structure-inducing pre-training.

Download or read book Deep Learning for Biomedical Data Analysis written by Mourad Elloumi and published by Springer Nature. This book was released on 2021-07-13 with total page 358 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book is the first overview on Deep Learning (DL) for biomedical data analysis. It surveys the most recent techniques and approaches in this field, with both a broad coverage and enough depth to be of practical use to working professionals. This book offers enough fundamental and technical information on these techniques, approaches and the related problems without overcrowding the reader's head. It presents the results of the latest investigations in the field of DL for biomedical data analysis. The techniques and approaches presented in this book deal with the most important and/or the newest topics encountered in this field. They combine fundamental theory of Artificial Intelligence (AI), Machine Learning (ML) and DL with practical applications in Biology and Medicine. Certainly, the list of topics covered in this book is not exhaustive but these topics will shed light on the implications of the presented techniques and approaches on other topics in biomedical data analysis. The book finds a balance between theoretical and practical coverage of a wide range of issues in the field of biomedical data analysis, thanks to DL. The few published books on DL for biomedical data analysis either focus on specific topics or lack technical depth. The chapters presented in this book were selected for quality and relevance. The book also presents experiments that provide qualitative and quantitative overviews in the field of biomedical data analysis. The reader will require some familiarity with AI, ML and DL and will learn about techniques and approaches that deal with the most important and/or the newest topics encountered in the field of DL for biomedical data analysis. He/she will discover both the fundamentals behind DL techniques and approaches, and their applications on biomedical data. This book can also serve as a reference book for graduate courses in Bioinformatics, AI, ML and DL. The book aims not only at professional researchers and practitioners but also graduate students, senior undergraduate students and young researchers. This book will certainly show the way to new techniques and approaches to make new discoveries.

Download or read book Biomedical Data Mining for Information Retrieval written by Sujata Dash and published by John Wiley & Sons. This book was released on 2021-08-06 with total page 450 pages. Available in PDF, EPUB and Kindle. Book excerpt: BIOMEDICAL DATA MINING FOR INFORMATION RETRIEVAL This book not only emphasizes traditional computational techniques, but discusses data mining, biomedical image processing, information retrieval with broad coverage of basic scientific applications. Biomedical Data Mining for Information Retrieval comprehensively covers the topic of mining biomedical text, images and visual features towards information retrieval. Biomedical and health informatics is an emerging field of research at the intersection of information science, computer science, and healthcare and brings tremendous opportunities and challenges due to easily available and abundant biomedical data for further analysis. The aim of healthcare informatics is to ensure the high-quality, efficient healthcare, better treatment and quality of life by analyzing biomedical and healthcare data including patient’s data, electronic health records (EHRs) and lifestyle. Previously, it was a common requirement to have a domain expert to develop a model for biomedical or healthcare; however, recent advancements in representation learning algorithms allows us to automatically to develop the model. Biomedical image mining, a novel research area, due to the vast amount of available biomedical images, increasingly generates and stores digitally. These images are mainly in the form of computed tomography (CT), X-ray, nuclear medicine imaging (PET, SPECT), magnetic resonance imaging (MRI) and ultrasound. Patients’ biomedical images can be digitized using data mining techniques and may help in answering several important and critical questions relating to healthcare. Image mining in medicine can help to uncover new relationships between data and reveal new useful information that can be helpful for doctors in treating their patients. Audience Researchers in various fields including computer science, medical informatics, healthcare IOT, artificial intelligence, machine learning, image processing, clinical big data analytics.

Download or read book Foundations of Biomedical Knowledge Representation written by Arjen Hommersom and published by Springer. This book was released on 2016-01-07 with total page 336 pages. Available in PDF, EPUB and Kindle. Book excerpt: Medicine and health care are currently faced with a significant rise in their complexity. This is partly due to the progress made during the past three decades in the fundamental biological understanding of the causes of health and disease at the molecular, (sub)cellular, and organ level. Since the end of the 1970s, when knowledge representation and reasoning in the biomedical field became a separate area of research, huge progress has been made in the development of methods and tools that are finally able to impact on the way medicine is being practiced. Even though there are huge differences in the techniques and methods used by biomedical researchers, there is now an increasing tendency to share research results in terms of formal knowledge representation methods, such as ontologies, statistical models, network models, and mathematical models. As there is an urgent need for health-care professionals to make better decisions, computer-based support using this knowledge is now becoming increasingly important. It may also be the only way to integrate research results from the different parts of the spectrum of biomedical and clinical research. The aim of this book is to shed light on developments in knowledge representation at different levels of biomedical application, ranging from human biology to clinical guidelines, and using different techniques, from probability theory and differential equations to logic. The book starts with two introductory chapters followed by 18 contributions organized in the following topical sections: diagnosis of disease; monitoring of health and disease and conformance; assessment of health and personalization; prediction and prognosis of health and disease; treatment of disease; and recommendations.

Download or read book Learning with Limited Labeled Data in Biomedical Domain by Disentanglement and Semi supervised Learning written by Prashnna Kumar Gyawali and published by . This book was released on 2021 with total page 129 pages. Available in PDF, EPUB and Kindle. Book excerpt: "In this dissertation, we are interested in improving the generalization of deep neural networks for biomedical data (e.g., electrocardiogram signal, x-ray images, etc). Although deep neural networks have attained state-of-the-art performance and, thus, deployment across a variety of domains, similar performance in the clinical setting remains challenging due to its ineptness to generalize across unseen data (e.g., new patient cohort). We address this challenge of generalization in the deep neural network from two perspectives: 1) learning disentangled representations from the deep network, and 2) developing efficient semi-supervised learning (SSL) algorithms using the deep network. In the former, we are interested in designing specific architectures and objective functions to learn representations, where variations in the data are well separated, i.e., disentangled. In the latter, we are interested in designing regularizers that encourage the underlying neural function's behavior toward a common inductive bias to avoid over-fitting the function to small labeled data. Our end goal is to improve the generalization of the deep network for the diagnostic model in both of these approaches. In disentangled representations, this translates to appropriately learning latent representations from the data, capturing the observed input's underlying explanatory factors in an independent and interpretable way. With data's expository factors well separated, such disentangled latent space can then be useful for a large variety of tasks and domains within data distribution even with a small amount of labeled data, thus improving generalization. In developing efficient semi-supervised algorithms, this translates to utilizing a large volume of the unlabelled dataset to assist the learning from the limited labeled dataset, commonly encountered situation in the biomedical domain. By drawing ideas from different areas within deep learning like representation learning (e.g., autoencoder), variational inference (e.g., variational autoencoder), Bayesian nonparametric (e.g., beta-Bernoulli process), learning theory (e.g., analytical learning theory), function smoothing (Lipschitz Smoothness), etc., we propose several leaning algorithms to improve generalization in the associated task. We test our algorithms on real-world clinical data and show that our approach yields significant improvement over existing methods. Moreover, we demonstrate the efficacy of the proposed models in the benchmark data and simulated data to understand different aspects of the proposed learning methods. We conclude by identifying some of the limitations of the proposed methods, areas of further improvement, and broader future directions for the successful adoption of AI models in the clinical environment."--Abstract.

Download or read book Predictive Modeling in Biomedical Data Mining and Analysis written by Sudipta Roy and published by Academic Press. This book was released on 2022-08-28 with total page 346 pages. Available in PDF, EPUB and Kindle. Book excerpt: Predictive Modeling in Biomedical Data Mining and Analysis presents major technical advancements and research findings in the field of machine learning in biomedical image and data analysis. The book examines recent technologies and studies in preclinical and clinical practice in computational intelligence. The authors present leading-edge research in the science of processing, analyzing and utilizing all aspects of advanced computational machine learning in biomedical image and data analysis. As the application of machine learning is spreading to a variety of biomedical problems, including automatic image segmentation, image classification, disease classification, fundamental biological processes, and treatments, this is an ideal reference. Machine Learning techniques are used as predictive models for many types of applications, including biomedical applications. These techniques have shown impressive results across a variety of domains in biomedical engineering research. Biology and medicine are data-rich disciplines, but the data are complex and often ill-understood, hence the need for new resources and information. Includes predictive modeling algorithms for both Supervised Learning and Unsupervised Learning for medical diagnosis, data summarization and pattern identification Offers complete coverage of predictive modeling in biomedical applications, including data visualization, information retrieval, data mining, image pre-processing and segmentation, mathematical models and deep neural networks Provides readers with leading-edge coverage of biomedical data processing, including high dimension data, data reduction, clinical decision-making, deep machine learning in large data sets, multimodal, multi-task, and transfer learning, as well as machine learning with Internet of Biomedical Things applications

Download or read book Signal Processing and Machine Learning for Biomedical Big Data written by Ervin Sejdic and published by CRC Press. This book was released on 2018-07-04 with total page 1235 pages. Available in PDF, EPUB and Kindle. Book excerpt: Within the healthcare domain, big data is defined as any ``high volume, high diversity biological, clinical, environmental, and lifestyle information collected from single individuals to large cohorts, in relation to their health and wellness status, at one or several time points.'' Such data is crucial because within it lies vast amounts of invaluable information that could potentially change a patient's life, opening doors to alternate therapies, drugs, and diagnostic tools. Signal Processing and Machine Learning for Biomedical Big Data thus discusses modalities; the numerous ways in which this data is captured via sensors; and various sample rates and dimensionalities. Capturing, analyzing, storing, and visualizing such massive data has required new shifts in signal processing paradigms and new ways of combining signal processing with machine learning tools. This book covers several of these aspects in two ways: firstly, through theoretical signal processing chapters where tools aimed at big data (be it biomedical or otherwise) are described; and, secondly, through application-driven chapters focusing on existing applications of signal processing and machine learning for big biomedical data. This text aimed at the curious researcher working in the field, as well as undergraduate and graduate students eager to learn how signal processing can help with big data analysis. It is the hope of Drs. Sejdic and Falk that this book will bring together signal processing and machine learning researchers to unlock existing bottlenecks within the healthcare field, thereby improving patient quality-of-life. Provides an overview of recent state-of-the-art signal processing and machine learning algorithms for biomedical big data, including applications in the neuroimaging, cardiac, retinal, genomic, sleep, patient outcome prediction, critical care, and rehabilitation domains. Provides contributed chapters from world leaders in the fields of big data and signal processing, covering topics such as data quality, data compression, statistical and graph signal processing techniques, and deep learning and their applications within the biomedical sphere. This book’s material covers how expert domain knowledge can be used to advance signal processing and machine learning for biomedical big data applications.

Download or read book Handbook of Artificial Intelligence in Biomedical Engineering written by Saravanan Krishnan and published by CRC Press. This book was released on 2021-03-29 with total page 565 pages. Available in PDF, EPUB and Kindle. Book excerpt: Handbook of Artificial Intelligence in Biomedical Engineering focuses on recent AI technologies and applications that provide some very promising solutions and enhanced technology in the biomedical field. Recent advancements in computational techniques, such as machine learning, Internet of Things (IoT), and big data, accelerate the deployment of biomedical devices in various healthcare applications. This volume explores how artificial intelligence (AI) can be applied to these expert systems by mimicking the human expert’s knowledge in order to predict and monitor the health status in real time. The accuracy of the AI systems is drastically increasing by using machine learning, digitized medical data acquisition, wireless medical data communication, and computing infrastructure AI approaches, helping to solve complex issues in the biomedical industry and playing a vital role in future healthcare applications. The volume takes a multidisciplinary perspective of employing these new applications in biomedical engineering, exploring the combination of engineering principles with biological knowledge that contributes to the development of revolutionary and life-saving concepts.

Download or read book Machine Learning for Biomedical Applications written by Maria Deprez and published by Academic Press. This book was released on 2023-09-12 with total page 306 pages. Available in PDF, EPUB and Kindle. Book excerpt: Machine Learning for Biomedical Applications: With Scikit-Learn and PyTorch presents machine learning techniques most commonly used in a biomedical setting. Avoiding a theoretical perspective, it provides a practical and interactive way of learning where concepts are presented in short descriptions followed by simple examples using biomedical data. Interactive Python notebooks are provided with each chapter to complement the text and aid understanding. Sections cover uses in biomedical applications, practical Python coding skills, mathematical tools that underpin the field, core machine learning methods, deep learning concepts with examples in Keras, and much more. This accessible and interactive introduction to machine learning and data analysis skills is suitable for undergraduates and postgraduates in biomedical engineering, computer science, the biomedical sciences and clinicians. Gives a basic understanding of the most fundamental concepts within machine learning and their role in biomedical data analysis Shows how to apply a range of commonly used machine learning and deep learning techniques in biomedical problems Develops practical computational skills that are needed to manipulate complex biomedical data sets Shows how to design machine learning experiments that address specific problems related to biomedical data

Download or read book Handbook of Deep Learning in Biomedical Engineering and Health Informatics written by E. Golden Julie and published by CRC Press. This book was released on 2021-09-22 with total page 344 pages. Available in PDF, EPUB and Kindle. Book excerpt: This new volume discusses state-of-the-art deep learning techniques and approaches that can be applied in biomedical systems and health informatics. Deep learning in the biomedical field is an effective method of collecting and analyzing data that can be used for the accurate diagnosis of disease. This volume delves into a variety of applications, techniques, algorithms, platforms, and tools used in this area, such as image segmentation, classification, registration, and computer-aided analysis. The editors proceed on the principle that accurate diagnosis of disease depends on image acquisition and interpretation. There are many methods to get high resolution radiological images, but we are still lacking in automated image interpretation. Currently deep learning techniques are providing a feasible solution for automatic diagnosis of disease with good accuracy. Analyzing clinical data using deep learning techniques enables clinicians to diagnose diseases at an early stage and treat patients more effectively. Chapters explore such approaches as deep learning algorithms, convolutional neural networks and recurrent neural network architecture, image stitching techniques, deep RNN architectures, and more. This volume also depicts how deep learning techniques can be applied for medical diagnostics of several specific health scenarios, such as cancer, COVID-19, acute neurocutaneous syndrome, cardiovascular and neuro diseases, skin lesions and skin cancer, etc. Key features: Introduces important recent technological advancements in the field Describes the various techniques, platforms, and tools used in biomedical deep learning systems Includes informative case studies that help to explain the new technologies Handbook of Deep Learning in Biomedical Engineering and Health Informatics provides a thorough exploration of biomedical systems applied with deep learning techniques and will provide valuable information for researchers, medical and industry practitioners, academicians, and students.

Download or read book Methods in Biomedical Informatics written by Indra Neil Sarkar and published by Academic Press. This book was released on 2013-09-03 with total page 589 pages. Available in PDF, EPUB and Kindle. Book excerpt: Beginning with a survey of fundamental concepts associated with data integration, knowledge representation, and hypothesis generation from heterogeneous data sets, Methods in Biomedical Informatics provides a practical survey of methodologies used in biological, clinical, and public health contexts. These concepts provide the foundation for more advanced topics like information retrieval, natural language processing, Bayesian modeling, and learning classifier systems. The survey of topics then concludes with an exposition of essential methods associated with engineering, personalized medicine, and linking of genomic and clinical data. Within an overall context of the scientific method, Methods in Biomedical Informatics provides a practical coverage of topics that is specifically designed for: (1) domain experts seeking an understanding of biomedical informatics approaches for addressing specific methodological needs; or (2) biomedical informaticians seeking an approachable overview of methodologies that can be used in scenarios germane to biomedical research. - Contributors represent leading biomedical informatics experts: individuals who have demonstrated effective use of biomedical informatics methodologies in the real-world, high-quality biomedical applications - Material is presented as a balance between foundational coverage of core topics in biomedical informatics with practical "in-the-trenches" scenarios. - Contains appendices that function as primers on: (1) Unix; (2) Ruby; (3) Databases; and (4) Web Services.

Download or read book Similarity Search and Applications written by Nora Reyes and published by Springer Nature. This book was released on 2021-10-21 with total page 415 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book constitutes the refereed proceedings of the 14th International Conference on Similarity Search and Applications, SISAP 2021, held in Dortmund, Germany, in September/October 2021. The conference was held virtually due to the COVID-19 pandemic.The 23 full papers presented together with 5 short and 3 doctoral symposium papers were carefully reviewed and selected from 50 submissions. The papers are organized in the topical sections named: ​Similarity Search and Retrieval; Intrinsic Dimensionality; Clustering and Classification; Applications of Similarity Search; Similarity Search in Graph-Structured Data; Doctoral Symposium.

Download or read book Biomedical Data and Applications written by Amandeep S. Sidhu and published by Springer Science & Business Media. This book was released on 2009-06-16 with total page 344 pages. Available in PDF, EPUB and Kindle. Book excerpt: Compared with data from general application domains, modern biological data has many unique characteristics. The goal of this book is to cover data and applications identifying new issues and directions for future research in biomedical domain.

Download or read book Representation Learning for Natural Language Processing written by Zhiyuan Liu and published by Springer Nature. This book was released on 2023-08-23 with total page 535 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book provides an overview of the recent advances in representation learning theory, algorithms, and applications for natural language processing (NLP), ranging from word embeddings to pre-trained language models. It is divided into four parts. Part I presents the representation learning techniques for multiple language entries, including words, sentences and documents, as well as pre-training techniques. Part II then introduces the related representation techniques to NLP, including graphs, cross-modal entries, and robustness. Part III then introduces the representation techniques for the knowledge that are closely related to NLP, including entity-based world knowledge, sememe-based linguistic knowledge, legal domain knowledge and biomedical domain knowledge. Lastly, Part IV discusses the remaining challenges and future research directions. The theories and algorithms of representation learning presented can also benefit other related domains such as machine learning, social network analysis, semantic Web, information retrieval, data mining and computational biology. This book is intended for advanced undergraduate and graduate students, post-doctoral fellows, researchers, lecturers, and industrial engineers, as well as anyone interested in representation learning and natural language processing. As compared to the first edition, the second edition (1) provides a more detailed introduction to representation learning in Chapter 1; (2) adds four new chapters to introduce pre-trained language models, robust representation learning, legal knowledge representation learning and biomedical knowledge representation learning; (3) updates recent advances in representation learning in all chapters; and (4) corrects some errors in the first edition. The new contents will be approximately 50%+ compared to the first edition. This is an open access book.