Download or read book Using Comparable Corpora for Under Resourced Areas of Machine Translation written by Inguna Skadiņa and published by Springer. This book was released on 2019-02-06 with total page 323 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book provides an overview of how comparable corpora can be used to overcome the lack of parallel resources when building machine translation systems for under-resourced languages and domains. It presents a wealth of methods and open tools for building comparable corpora from the Web, evaluating comparability and extracting parallel data that can be used for the machine translation task. It is divided into several sections, each covering a specific task such as building, processing, and using comparable corpora, focusing particularly on under-resourced language pairs and domains. The book is intended for anyone interested in data-driven machine translation for under-resourced languages and domains, especially for developers of machine translation systems, computational linguists and language workers. It offers a valuable resource for specialists and students in natural language processing, machine translation, corpus linguistics and computer-assisted translation, and promotes the broader use of comparable corpora in natural language processing and computational linguistics.

Download or read book Building and Using Comparable Corpora written by Serge Sharoff and published by Springer Science & Business Media. This book was released on 2013-12-13 with total page 333 pages. Available in PDF, EPUB and Kindle. Book excerpt: The 1990s saw a paradigm change in the use of corpus-driven methods in NLP. In the field of multilingual NLP (such as machine translation and terminology mining) this implied the use of parallel corpora. However, parallel resources are relatively scarce: many more texts are produced daily by native speakers of any given language than translated. This situation resulted in a natural drive towards the use of comparable corpora, i.e. non-parallel texts in the same domain or genre. Nevertheless, this research direction has not produced a single authoritative source suitable for researchers and students coming to the field. The proposed volume provides a reference source, identifying the state of the art in the field as well as future trends. The book is intended for specialists and students in natural language processing, machine translation and computer-assisted translation.

Download or read book Building and Using Comparable Corpora for Multilingual Natural Language Processing written by Serge Sharoff and published by Springer Nature. This book was released on 2023-08-23 with total page 138 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book provides a comprehensive overview of methods to build comparable corpora and of their applications, including machine translation, cross-lingual transfer, and various kinds of multilingual natural language processing. The authors begin with a brief history on the topic followed by a comparison to parallel resources and an explanation of why comparable corpora have become more widely used. In particular, they provide the basis for the multilingual capabilities of pre-trained models, such as BERT or GPT. The book then focuses on building comparable corpora, aligning their sentences to create a database of suitable translations, and using these sentence translations to produce dictionaries and term banks. Then, it is explained how comparable corpora can be used to build machine translation engines and to develop a wide variety of multilingual applications.

Download or read book Parallel Corpora for Contrastive and Translation Studies written by Irene Doval and published by John Benjamins Publishing Company. This book was released on 2019-03-20 with total page 313 pages. Available in PDF, EPUB and Kindle. Book excerpt: This volume assesses the state of the art of parallel corpus research as a whole, reporting on advances in both recent developments of parallel corpora – with some particular references to comparable corpora as well– and in ways of exploiting them for a variety of purposes. The first part of the book is devoted to new roles that parallel corpora can and should assume in translation studies and in contrastive linguistics, to the usefulness and usability of parallel corpora, and to advances in parallel corpus alignment, annotation and retrieval. There follows an up-to-date presentation of a number of parallel corpus projects currently being carried out in Europe, some of them multimodal, with certain chapters illustrating case studies developed on the basis of the corpora at hand. In most of these chapters, attention is paid to specific technical issues of corpus building. The third part of the book reflects on specific applications and on the creation of bilingual resources from parallel corpora. This volume will be welcomed by scholars, postgraduate and PhD students in the fields of contrastive linguistics, translation studies, lexicography, language teaching and learning, machine translation, and natural language processing.

Download or read book Human Language Technologies written by Inguna Skadina and published by IOS Press. This book was released on 2010 with total page 264 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book contains papers from the Fourth International Conference on Human Language Technologies - the Baltic Perspective (Baltic HLT 2010), held in Riga in October 2010. This conference is the latest in a series which provides a forum for sharing recent advances in human language processing, and promotes cooperation between the computer science and linguistics communities of the Baltic countries and the rest of the world. Bringing together scientists, developers, providers and users, the conference is an opportunity to exchange information, discuss problems, find new synergies, and promote i.

Download or read book Corpus Use in Cross linguistic Research written by Marlén Izquierdo and published by John Benjamins Publishing Company. This book was released on 2023-11-02 with total page 245 pages. Available in PDF, EPUB and Kindle. Book excerpt: Cross-linguistic research is a fruitful field of language inquiry that has benefited enormously from the use of corpora. As sources of linguistic data of various kinds and as tools for language processing, corpora have shaped the development of cross-linguistic research, enabling both language description and practical applications. This volume contains twelve studies that emphasize the usefulness and usability of parallel corpora in accurately exploring the structure and use of seven under-researched languages and language varieties. The first part emphasizes the role of corpus-based descriptive analyses at the lexicogrammatical and discursive levels, as a first step on the way towards concrete applications like translation or language teaching. The second part focuses on the role of parallel-corpus-based language processing techniques and applications that facilitate professional communication. This book will be of interest to scholars in contrastive linguistics, translation studies, discourse analysis, language teaching, and natural language processing.

Download or read book Improving Statistical Machine Translation Using Comparable Corpora written by Matthew Garvey Snover and published by . This book was released on 2010 with total page pages. Available in PDF, EPUB and Kindle. Book excerpt:

Download or read book The Croatian Language in the Digital Age written by Georg Rehm and published by Springer Science & Business Media. This book was released on 2012-08-22 with total page 98 pages. Available in PDF, EPUB and Kindle. Book excerpt: This white paper is part of a series that promotes knowledge about language technology and its potential. It addresses educators, journalists, politicians, language communities and others. The availability and use of language technology in Europe varies between languages. Consequently, the actions that are required to further support research and development of language technologies also differ for each language. The required actions depend on many factors, such as the complexity of a given language and the size of its community. META-NET, a Network of Excellence funded by the European Commission, has conducted an analysis of current language resources and technologies. This analysis focused on the 23 official European languages as well as other important national and regional languages in Europe. The results of this analysis suggest that there are many significant research gaps for each language. A more detailed expert analysis and assessment of the current situation will help maximise the impact of additional research and minimize any risks. META-NET consists of 54 research centres from 33 countries that are working with stakeholders from commercial businesses, government agencies, industry, research organisations, software companies, technology providers and European universities. Together, they are creating a common technology vision while developing a strategic research agenda that shows how language technology applications can address any research gaps by 2020.

Download or read book Corpora in Translation and Contrastive Research in the Digital Age written by Julia Lavid-López and published by John Benjamins Publishing Company. This book was released on 2021-12-15 with total page 353 pages. Available in PDF, EPUB and Kindle. Book excerpt: Corpus-based contrastive and translation research are areas that keep evolving in the digital age, as the range of new corpus resources and tools expands, opening up to different approaches and application contexts. The current book contains a selection of papers which focus on corpora and translation research in the digital age, outlining some recent advances and explorations. After an introductory chapter which outlines language technologies applied to translation and interpreting with a view to identifying challenges and research opportunities, the first part of the book is devoted to current advances in the creation of new parallel corpora for under-researched areas, the development of tools to manage parallel corpora or as an alternative to parallel corpora, and new methodologies to improve existing translation memory systems. The contributions in the second part of the book address a number of cutting-edge linguistic issues in the area of contrastive discourse studies and translation analysis on the basis of comparable and parallel corpora in several languages such as English, German, Swedish, French, Italian, Spanish, Portuguese and Turkish, thus showcasing the richness of the linguistic diversity carried out in these recent investigations. Given the multiplicity of topics, methodologies and languages studied in the different chapters, the book will be of interest to a wide audience working in the fields of translation studies, contrastive linguistics and the automatic processing of language.

Download or read book Machine Translation with Minimal Reliance on Parallel Resources written by George Tambouratzis and published by Springer. This book was released on 2017-08-09 with total page 92 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book provides a unified view on a new methodology for Machine Translation (MT). This methodology extracts information from widely available resources (extensive monolingual corpora) while only assuming the existence of a very limited parallel corpus, thus having a unique starting point to Statistical Machine Translation (SMT). In this book, a detailed presentation of the methodology principles and system architecture is followed by a series of experiments, where the proposed system is compared to other MT systems using a set of established metrics including BLEU, NIST, Meteor and TER. Additionally, a free-to-use code is available, that allows the creation of new MT systems. The volume is addressed to both language professionals and researchers. Prerequisites for the readers are very limited and include a basic understanding of the machine translation as well as of the basic tools of natural language processing.​

Download or read book Human Language Technologies The Baltic Perspective written by A. Utka and published by IOS Press. This book was released on 2014-09-12 with total page 276 pages. Available in PDF, EPUB and Kindle. Book excerpt: In the modern information society, there is an ever-growing need for improved natural language processing and human language technologies.This book presents the proceedings of the Sixth International Conference 'Human Language Technologies – The Baltic Perspective' (Baltic HLT 2014) held in Kaunas, Lithuania in September 2014. The Baltic HLT conferences provide an important forum for gathering and consolidating ideas, and are an opportunity for the Baltic countries to present important research results to an international audience. The book contains 39 long and short papers presented at the conference. These cover a wide range of topics: syntactic analysis, sentiment analysis, co-reference resolution, authorship attribution, information extraction, document clustering, machine translation, corpus and parallel corpus compiling, speech recognition, synthesis and others. The book is divided into three main sections: speech technology, methods in computational linguistics, and preparation of language resources. This book will be of interest to anyone whose work involves the use and application of computational linguistics and related disciplines.

Download or read book Parallel Sentence Detection in Comparable Corpora with Bilingual Word Embeddings for Low resource Languages written by John Cadigan and published by . This book was released on 2019 with total page 121 pages. Available in PDF, EPUB and Kindle. Book excerpt: In an emergency, machine translation systems can be useful in facilitating international cooperation during rescue efforts. Unfortunately, training resources (bitexts) for many language pairs are scarce and tend to comprise a limited vocabulary which will result in low quality translation. Finding parallel sentences in comparable corpora is a solution to quickly and cheaply augment bitext, expanding the vocabulary of the translation model. Unfortunately, such out-of-vocabulary words are also a problem for parallel sentence detection in comparable corpora; with features derived from the existing translation models, this makes the task of detecting parallel sentences more challenging for new domains with unseen vocabulary. This is because non-translations and unseen translations are hard to distinguish. Bilingual word embeddings have been recognized as a solution to this problem because they allow the use of the more plentiful monolingual text to derive a representation for words which approximates a translation model. This study quantifies the role of contemporary bilingual word embedding methods in extracting parallel sentences from comparable corpora in low-resource settings. The first dataset is a simulated low-resource dataset of Chinese-English from the BUCC 2017-2018 comparable corpus shared task. Using the methods established by the BUCC shared task, a second synthetic comparable corpus is created with a true low-resource pair composed of data used during an emergency: Haitian Creole and English. With limited resources, languages on both sides of the comparable corpora are representative of low-resource settings. The embedding methods are first evaluated in bilingual lexicon induction, and the best performing ones are applied in downstream tasks. First, they are used in filtering the tremendous amount of candidate parallel sentences in the comparable corpora. Secondly, they are used during the classification of those candidate pairs as parallel or non-parallel. Key contributions are as follows. First, the performance advantage of character-based embeddings over other word-based monolingual embedding methods for bilingual lexicon induction is confirmed--particularly for rare words; these words come from the top 30% of the corpora appearing in this study which is approximately 15 times the (percentile) range of vocabulary examined in other studies' experiments and their respective corpora. Second, classic and new methods to filter candidate pairs are compared and quantified on the same datasets for the first time--as best known to me. A retrieval rate of 95% is possible even in low resource settings. The addition of bilingual word embeddings in candidate filtering did not yield gains in retrieval rate, but it did improve results during classification. For classification, a novel architecture for parallel sentence detection is presented: an extensible 2D residual convolutional neural network; compared to previous Siamese RNN architectures in this task, it effectively incorporates features derived from monolingual data. With an optimized cutoff, the ResNet can be considered in near competition with the best systems from the 2018 edition of the BUCC shared task on the Chinese-English dataset while using less data. Comparisons with a MaxEnt model indicate that the 2D ResNet's explicitly syntactic representation may be a leveraging factor for limited resources. Besides novelty in models, a new matching heuristic is applied to the results of classifiers; it consistently exchanges a small amount of recall for gains in precision for an overall increase in F1 score. The positive results for the Haitian-Creole and English dataset which is truly representative of what is available for low-resource languages during an emergency provide initial evidence that the methods may also be effective for other low-resource languages.

Download or read book Applying Comparable Corpora to Machine Translation written by Krzysztof Wolk and published by LAP Lambert Academic Publishing. This book was released on 2015-07-24 with total page 212 pages. Available in PDF, EPUB and Kindle. Book excerpt: The problem investigated here was how to improve statistical machine language translation between Polish and English speech. While excellent translation systems exist for many popular languages, it is fair to say that the development of such systems for Polish and English has been neglected. The most popular methodologies are not well suited for the Polish language and require adaptation. Polish language resources are lacking in parallel and monolingual data. Therefore, the main objective of the present study was to develop an automatic and robust Polish to English translation system to meet specific translation requirements and to develop bilingual textual resources by mining comparable corpora. Experiments were conducted mostly on casual human speech, consisting of lectures, movie subtitles, European Parliament proceedings, and European Medicines Agency. The aims were to rigorously analyze the various problems and to improve the quality of baseline systems, i.e., adaptation of techniques and training parameters to increase the Bilingual Evaluation Understudy (BLEU) score for maximum performance.

Download or read book Multilingual Processing in Eastern and Southern EU Languages written by Cristina Vertan and published by Cambridge Scholars Publishing. This book was released on 2012-04-25 with total page 410 pages. Available in PDF, EPUB and Kindle. Book excerpt: This volume draws attention to many specific challenges of multilingual processing within the European Union, especially after the recent successive enlargement. Most of the languages considered herein are not only ‘less resourced’ in terms of processing tools and training data, but also have features which are different from the well known international language pairs. The 16 contributions address specific problems and solutions for languages from south-eastern and central Europe in the context of multilingual communication, translation and information retrieval.

Download or read book Chinese Lexical Semantics written by Donghong Ji and published by Springer. This book was released on 2013-02-15 with total page 838 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book constitutes carefully reviewed and revised selected papers from the 13th Chinese Lexical Semantics Workshop, CLSW 2012, held in Wuhan, China, in July 2012. The 67 full papers and 17 short papers presented in this volume were carefully reviewed and selected from 169 submissions. They are organized in topical sections named: applications on natural language processing; corpus linguistics; lexical computation; lexical resources; lexical semantics; new methods for lexical semantics; and other topics.

Download or read book Computational Linguistics and Intelligent Text Processing written by Alexander Gelbukh and published by Springer. This book was released on 2013-03-12 with total page 598 pages. Available in PDF, EPUB and Kindle. Book excerpt: This two-volume set, consisting of LNCS 7816 and LNCS 7817, constitutes the thoroughly refereed proceedings of the 13th International Conference on Computer Linguistics and Intelligent Processing, CICLING 2013, held on Samos, Greece, in March 2013. The total of 91 contributions presented was carefully reviewed and selected for inclusion in the proceedings. The papers are organized in topical sections named: general techniques; lexical resources; morphology and tokenization; syntax and named entity recognition; word sense disambiguation and coreference resolution; semantics and discourse; sentiment, polarity, subjectivity, and opinion; machine translation and multilingualism; text mining, information extraction, and information retrieval; text summarization; stylometry and text simplification; and applications.

Download or read book Human Machine Interaction in Translation written by Bernadette Sharp and published by Samfundslitteratur. This book was released on 2011 with total page 274 pages. Available in PDF, EPUB and Kindle. Book excerpt: Includes 19 papers which were selected for presentation at the workshop and the text of invite keynote lectures. The workshop provided an attractive interdisciplinary forum for fostering interactions among researchers and practitioners in Natural Language Processing (NLP) working within the paradigm of Cognitive Science (CS)