Download or read book Laboratory Experiments in Information Retrieval written by Tetsuya Sakai and published by Springer. This book was released on 2018-09-22 with total page 150 pages. Available in PDF, EPUB and Kindle. Book excerpt: Covering aspects from principles and limitations of statistical significance tests to topic set size design and power analysis, this book guides readers to statistically well-designed experiments. Although classical statistical significance tests are to some extent useful in information retrieval (IR) evaluation, they can harm research unless they are used appropriately with the right sample sizes and statistical power and unless the test results are reported properly. The first half of the book is mainly targeted at undergraduate students, and the second half is suitable for graduate students and researchers who regularly conduct laboratory experiments in IR, natural language processing, recommendations, and related fields. Chapters 1–5 review parametric significance tests for comparing system means, namely, t-tests and ANOVAs, and show how easily they can be conducted using Microsoft Excel or R. These chapters also discuss a few multiple comparison procedures for researchers who are interested in comparing every system pair, including a randomised version of Tukey's Honestly Significant Difference test. The chapters then deal with known limitations of classical significance testing and provide practical guidelines for reporting research results regarding comparison of means. Chapters 6 and 7 discuss statistical power. Chapter 6 introduces topic set size design to enable test collection builders to determine an appropriate number of topics to create. Readers can easily use the author’s Excel tools for topic set size design based on the paired and two-sample t-tests, one-way ANOVA, and confidence intervals. Chapter 7 describes power-analysis-based methods for determining an appropriate sample size for a new experiment based on a similar experiment done in the past, detailing how to utilize the author’s R tools for power analysis and how to interpret the results. Case studies from IR for both Excel-based topic set size design and R-based power analysis are also provided.
Download or read book Evaluating Information Retrieval and Access Tasks written by Tetsuya Sakai and published by Springer Nature. This book was released on 1901 with total page 225 pages. Available in PDF, EPUB and Kindle. Book excerpt: This open access book summarizes the first two decades of the NII Testbeds and Community for Information access Research (NTCIR). NTCIR is a series of evaluation forums run by a global team of researchers and hosted by the National Institute of Informatics (NII), Japan. The book is unique in that it discusses not just what was done at NTCIR, but also how it was done and the impact it has achieved. For example, in some chapters the reader sees the early seeds of what eventually grew to be the search engines that provide access to content on the World Wide Web, todays smartphones that can tailor what they show to the needs of their owners, and the smart speakers that enrich our lives at home and on the move. We also get glimpses into how new search engines can be built for mathematical formulae, or for the digital record of a lived human life. Key to the success of the NTCIR endeavor was early recognition that information access research is an empirical discipline and that evaluation therefore lay at the core of the enterprise. Evaluation is thus at the heart of each chapter in this book. They show, for example, how the recognition that some documents are more important than others has shaped thinking about evaluation design. The thirty-three contributors to this volume speak for the many hundreds of researchers from dozens of countries around the world who together shaped NTCIR as organizers and participants. This book is suitable for researchers, practitioners, and students--anyone who wants to learn about past and present evaluation efforts in information retrieval, information access, and natural language processing, as well as those who want to participate in an evaluation task or even to design and organize one.
Download or read book Information Retrieval Experiment written by Karen Sparck Jones and published by Butterworth-Heinemann. This book was released on 1981 with total page 372 pages. Available in PDF, EPUB and Kindle. Book excerpt:
Download or read book Methods for Evaluating Interactive Information Retrieval Systems with Users written by Diane Kelly and published by Now Publishers Inc. This book was released on 2009 with total page 246 pages. Available in PDF, EPUB and Kindle. Book excerpt: Provides an overview and instruction on the evaluation of interactive information retrieval systems with users.
Download or read book Lectures on Information Retrieval written by Maristella Agosti and published by Springer. This book was released on 2003-05-15 with total page 320 pages. Available in PDF, EPUB and Kindle. Book excerpt: Information Retrieval (IR) is concerned with the effective and efficient retrieval of information based on its semantic content. The central problem in IR is the quest to find the set of relevant documents, among a large collection containing the information sought, satisfying a user's information need usually expressed in a natural language query. Documents may be objects or items in any medium: text, image, audio, or indeed a mixture of all three. This book presents 12 revised lectures given at the Third European Summer School in Information Retrieval, ESSIR 2000, held at the Villa Monastero, Varenna, Italy, in September 2000. The first part of the book is devoted to the foundation of IR and related areas; the second part on advanced topics addresses various current issues, from usability aspects to Web searching and browsing.
Download or read book Introduction to Information Retrieval written by Christopher D. Manning and published by Cambridge University Press. This book was released on 2008-07-07 with total page pages. Available in PDF, EPUB and Kindle. Book excerpt: Class-tested and coherent, this textbook teaches classical and web information retrieval, including web search and the related areas of text classification and text clustering from basic concepts. It gives an up-to-date treatment of all aspects of the design and implementation of systems for gathering, indexing, and searching documents; methods for evaluating systems; and an introduction to the use of machine learning methods on text collections. All the important ideas are explained using examples and figures, making it perfect for introductory courses in information retrieval for advanced undergraduates and graduate students in computer science. Based on feedback from extensive classroom experience, the book has been carefully structured in order to make teaching more natural and effective. Slides and additional exercises (with solutions for lecturers) are also available through the book's supporting website to help course instructors prepare their lectures.
Download or read book Readings in Information Retrieval written by Karen Sparck Jones and published by Morgan Kaufmann. This book was released on 1997 with total page 614 pages. Available in PDF, EPUB and Kindle. Book excerpt: This compilation of original papers on information retrieval presents an overview, covering both general theory and specific methods, of the development and current status of information retrieval systems. Each chapter contains several papers carefully chosen to represent substantive research work that has been carried out in that area, each is preceded by an introductory overview and followed by supported references for further reading.
Download or read book Advanced Topics in Information Retrieval written by Massimo Melucci and published by Springer Science & Business Media. This book was released on 2011-06-10 with total page 295 pages. Available in PDF, EPUB and Kindle. Book excerpt: Information retrieval is the science concerned with the effective and efficient retrieval of documents starting from their semantic content. It is employed to fulfill some information need from a large number of digital documents. Given the ever-growing amount of documents available and the heterogeneous data structures used for storage, information retrieval has recently faced and tackled novel applications. In this book, Melucci and Baeza-Yates present a wide-spectrum illustration of recent research results in advanced areas related to information retrieval. Readers will find chapters on e.g. aggregated search, digital advertising, digital libraries, discovery of spam and opinions, information retrieval in context, multimedia resource discovery, quantum mechanics applied to information retrieval, scalability challenges in web search engines, and interactive information retrieval evaluation. All chapters are written by well-known researchers, are completely self-contained and comprehensive, and are complemented by an integrated bibliography and subject index. With this selection, the editors provide the most up-to-date survey of topics usually not addressed in depth in traditional (text)books on information retrieval. The presentation is intended for a wide audience of people interested in information retrieval: undergraduate and graduate students, post-doctoral researchers, lecturers, and industrial researchers.
Download or read book Information Retrieval Experiment written by and published by . This book was released on 1967 with total page 31 pages. Available in PDF, EPUB and Kindle. Book excerpt:
Download or read book Information Retrieval Evaluation in a Changing World written by Nicola Ferro and published by Springer. This book was released on 2019-08-13 with total page 595 pages. Available in PDF, EPUB and Kindle. Book excerpt: This volume celebrates the twentieth anniversary of CLEF - the Cross-Language Evaluation Forum for the first ten years, and the Conference and Labs of the Evaluation Forum since – and traces its evolution over these first two decades. CLEF’s main mission is to promote research, innovation and development of information retrieval (IR) systems by anticipating trends in information management in order to stimulate advances in the field of IR system experimentation and evaluation. The book is divided into six parts. Parts I and II provide background and context, with the first part explaining what is meant by experimental evaluation and the underlying theory, and describing how this has been interpreted in CLEF and in other internationally recognized evaluation initiatives. Part II presents research architectures and infrastructures that have been developed to manage experimental data and to provide evaluation services in CLEF and elsewhere. Parts III, IV and V represent the core of the book, presenting some of the most significant evaluation activities in CLEF, ranging from the early multilingual text processing exercises to the later, more sophisticated experiments on multimodal collections in diverse genres and media. In all cases, the focus is not only on describing “what has been achieved”, but above all on “what has been learnt”. The final part examines the impact CLEF has had on the research world and discusses current and future challenges, both academic and industrial, including the relevance of IR benchmarking in industrial settings. Mainly intended for researchers in academia and industry, it also offers useful insights and tips for practitioners in industry working on the evaluation and performance issues of IR tools, and graduate students specializing in information retrieval.
Download or read book Information Retrieval written by Pavel Braslavski and published by Springer. This book was released on 2015-12-09 with total page 370 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book constitutes the thoroughly refereed proceedings of the 8th Russian Summer School on Information Retrieval, RuSSIR 2014, held in Nizhniy Novgorod, Russia, in August 2014. The volume includes 6 tutorial papers, summarizing lectures given at the event, and 8 revised papers from the school participants.The papers focus on various aspects of information retrieval.
Download or read book Charting a New Course Natural Language Processing and Information Retrieval written by John I. Tait and published by Springer Science & Business Media. This book was released on 2005-08-01 with total page 301 pages. Available in PDF, EPUB and Kindle. Book excerpt: Karen Spärck Jones is one of the major figures of 20th century and early 21st Century computing and information processing. Her ideas have had an important influence on the development of Internet Search Engines. Her contribution has been recognized by awards from the natural language processing, information retrieval and artificial intelligence communities, including being asked to present the prestigious Grace Hopper lecture. She continues to be an active and influential researcher. Her contribution to the scientific evaluation of the effectiveness of such computer systems has been quite outstanding. This book celebrates the life and work of Karen Spärck Jones in her seventieth year. It consists of fifteen new and original chapters written by leading international authorities reviewing the state of the art and her influence in the areas in which Karen Spärck Jones has been active. Although she has a publication record which goes back over forty years, it is clear even the very early work reviewed in the book can be read with profit by those working on recent developments in information processing like bioinformatics and the semantic web.
Download or read book Organizing Knowledge written by Jennifer Rowley and published by Taylor & Francis. This book was released on 2017-05-15 with total page 392 pages. Available in PDF, EPUB and Kindle. Book excerpt: The fourth edition of this standard student text, Organizing Knowledge, incorporates extensive revisions reflecting the increasing shift towards a networked and digital information environment, and its impact on documents, information, knowledge, users and managers. Offering a broad-based overview of the approaches and tools used in the structuring and dissemination of knowledge, it is written in an accessible style and well illustrated with figures and examples. The book has been structured into three parts and twelve chapters and has been thoroughly updated throughout. Part I discusses the nature, structuring and description of knowledge. Part II, with its five chapters, lies at the core of the book focusing as it does on access to information. Part III explores different types of knowledge organization systems and considers some of the management issues associated with such systems. Each chapter includes learning objectives, a chapter summary and a list of references for further reading. This is a key introductory text for undergraduate and postgraduate students of information management.
Download or read book Introduction to Modern Information Retrieval written by Gobinda G. Chowdhury and published by Facet Publishing. This book was released on 2010 with total page 529 pages. Available in PDF, EPUB and Kindle. Book excerpt: An information retrieval (IR) system is designed to analyse, process and store sources of information and retrieve those that match a particular user's requirements. A bewildering range of techniques is now available to the information professional attempting to successfully retrieve information. It is recognized that today's information professionals need to concentrate their efforts on learning the techniques of computerized IR. However, it is this book's contention that it also benefits them to learn the theory, techniques and tools that constitute the traditional approaches to the organization and processing of information. In fact much of this knowledge may still be applicable in the storage and retrieval of electronic information in digital library environments. The fully revised third edition of this highly regarded textbook has been thoroughly updated to incorporate major changes in this rapidly expanding field since the second edition in 2004, and a complete new chapter on citation indexing has been added. Unique in its scope, the book covers the whole spectrum of information storage and retrieval, including: users of IR and IR options; database technology; bibliographic formats; cataloguing and metadata; subject analysis and representation; automatic indexing and file organization; vocabulary control; abstracts and indexing; searching and retrieval; user-centred models of IR and user interfaces; evaluation of IR systems and evaluation experiments; online and CD-ROM IR; multimedia IR; hypertext and mark-up languages; web IR; intelligent IR; natural language processing and its applications in IR; citation analysis and IR; IR in digital libraries; and trends in IR research. Illustrated with many examples and comprehensively referenced for an international audience, this is an indispensable textbook for students of library and information studies. It is also an invaluable aid for information practitioners wishing to brush up on their skills and keep up to date with the latest techniques.
Download or read book Advances in Information Retrieval written by Leif Azzopardi and published by Springer. This book was released on 2019-04-06 with total page 439 pages. Available in PDF, EPUB and Kindle. Book excerpt: This two-volume set LNCS 11437 and 11438 constitutes the refereed proceedings of the 41st European Conference on IR Research, ECIR 2019, held in Cologne, Germany, in April 2019. The 48 full papers presented together with 2 keynote papers, 44 short papers, 8 demonstration papers, 8 invited CLEF papers, 11 doctoral consortium papers, 4 workshop papers, and 4 tutorials were carefully reviewed and selected from 365 submissions. They were organized in topical sections named: Modeling Relations; Classification and Search; Recommender Systems; Graphs; Query Analytics; Representation; Reproducibility (Systems); Reproducibility (Application); Neural IR; Cross Lingual IR; QA and Conversational Search; Topic Modeling; Metrics; Image IR; Short Papers; Demonstration Papers; CLEF Organizers Lab Track; Doctoral Consortium Papers; Workshops; and Tutorials.
Download or read book Evaluation of Cross Language Information Retrieval Systems written by Martin Braschler and published by Springer. This book was released on 2003-08-02 with total page 606 pages. Available in PDF, EPUB and Kindle. Book excerpt: The second evaluation campaign of the Cross Language Evaluation Forum (CLEF) for European languages was held from January to September 2001. This campaign proved a great success, and showed an increase in participation of around 70% com pared with CLEF 2000. It culminated in a two day workshop in Darmstadt, Germany, 3–4 September, in conjunction with the 5th European Conference on Digital Libraries (ECDL 2001). On the first day of the workshop, the results of the CLEF 2001 evalua tion campaign were reported and discussed in paper and poster sessions. The second day focused on the current needs of cross language systems and how evaluation cam paigns in the future can best be designed to stimulate progress. The workshop was attended by nearly 50 researchers and system developers from both academia and in dustry. It provided an important opportunity for researchers working in the same area to get together and exchange ideas and experiences. Copies of all the presentations are available on the CLEF web site at http://www. clef campaign. org. This volume con tains thoroughly revised and expanded versions of the papers presented at the work shop and provides an exhaustive record of the CLEF 2001 campaign. CLEF 2001 was conducted as an activity of the DELOS Network of Excellence for Digital Libraries, funded by the EC Information Society Technologies program to further research in digital library technologies. The activity was organized in collabo ration with the US National Institute of Standards and Technology (NIST).
Download or read book Advances in Information Retrieval written by Ricardo Baeza-Yates and published by Springer. This book was released on 2012-04-05 with total page 609 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book constitutes the proceedings of the 34th European Conference on IR Research, ECIR 2012, held in Barcelona, Spain, in April 2012. The 37 full papers, 28 poster papers and 7 demonstrations presented in this volume were carefully reviewed and selected from 167 submissions. The contributions are organized in sections named: query representation; blogs and online-community search; semi-structured retrieval; evaluation; applications; retrieval models; image and video retrieval; text and content classification, categorisation, clustering; systems efficiency; industry track; and posters.
