Download or read book Methods for Evaluating Interactive Information Retrieval Systems with Users written by Diane Kelly and published by Now Publishers Inc. This book was released on 2009 with total page 246 pages. Available in PDF, EPUB and Kindle. Book excerpt: Provides an overview and instruction on the evaluation of interactive information retrieval systems with users.
Download or read book Introduction to Information Retrieval written by Christopher D. Manning and published by Cambridge University Press. This book was released on 2008-07-07 with total page pages. Available in PDF, EPUB and Kindle. Book excerpt: Class-tested and coherent, this textbook teaches classical and web information retrieval, including web search and the related areas of text classification and text clustering from basic concepts. It gives an up-to-date treatment of all aspects of the design and implementation of systems for gathering, indexing, and searching documents; methods for evaluating systems; and an introduction to the use of machine learning methods on text collections. All the important ideas are explained using examples and figures, making it perfect for introductory courses in information retrieval for advanced undergraduates and graduate students in computer science. Based on feedback from extensive classroom experience, the book has been carefully structured in order to make teaching more natural and effective. Slides and additional exercises (with solutions for lecturers) are also available through the book's supporting website to help course instructors prepare their lectures.
Download or read book Development of IR Evaluation Methods written by Stephen Edward Robertson and published by . This book was released on 1999 with total page 134 pages. Available in PDF, EPUB and Kindle. Book excerpt:
Download or read book Online Evaluation for Information Retrieval written by Katja Hofmann and published by . This book was released on 2016-06-07 with total page 134 pages. Available in PDF, EPUB and Kindle. Book excerpt: Provides a comprehensive overview of the topic. It shows how online evaluation is used for controlled experiments, segmenting them into experiment designs that allow absolute or relative quality assessments. It also includes an extensive discussion of recent work on data re-use, and experiment estimation based on historical data.
Download or read book Learning to Rank for Information Retrieval written by Tie-Yan Liu and published by Springer Science & Business Media. This book was released on 2011-04-29 with total page 282 pages. Available in PDF, EPUB and Kindle. Book excerpt: Due to the fast growth of the Web and the difficulties in finding desired information, efficient and effective information retrieval systems have become more important than ever, and the search engine has become an essential tool for many people. The ranker, a central component in every search engine, is responsible for the matching between processed queries and indexed documents. Because of its central role, great attention has been paid to the research and development of ranking technologies. In addition, ranking is also pivotal for many other information retrieval applications, such as collaborative filtering, definition ranking, question answering, multimedia retrieval, text summarization, and online advertisement. Leveraging machine learning technologies in the ranking process has led to innovative and more effective ranking models, and eventually to a completely new research area called “learning to rank”. Liu first gives a comprehensive review of the major approaches to learning to rank. For each approach he presents the basic framework, with example algorithms, and he discusses its advantages and disadvantages. He continues with some recent advances in learning to rank that cannot be simply categorized into the three major approaches – these include relational ranking, query-dependent ranking, transfer ranking, and semisupervised ranking. His presentation is completed by several examples that apply these technologies to solve real information retrieval problems, and by theoretical discussions on guarantees for ranking performance. This book is written for researchers and graduate students in both information retrieval and machine learning. They will find here the only comprehensive description of the state of the art in a field that has driven the recent advances in search engine development.
Download or read book Interactive IR User Study Design Evaluation and Reporting written by Jiqun Liu and published by Springer Nature. This book was released on 2022-05-31 with total page 75 pages. Available in PDF, EPUB and Kindle. Book excerpt: Since user study design has been widely applied in search interactions and information retrieval (IR) systems evaluation studies, a deep reflection and meta-evaluation of interactive IR (IIR) user studies is critical for sharpening the instruments of IIR research and improving the reliability and validity of the conclusions drawn from IIR user studies. To this end, we developed a faceted framework for supporting user study design, reporting, and evaluation based on a systematic review of the state-of-the-art IIR research papers recently published in several top IR venues (n=462). Within the framework, we identify three major types of research focuses, extract and summarize facet values from specific cases, and highlight the under-reported user study components which may significantly affect the results of research. Then, we employ the faceted framework in evaluating a series of IIR user studies against their respective research questions and explain the roles and impacts of the underlying connections and "collaborations" among different facet values. Through bridging diverse combinations of facet values with the study design decisions made for addressing research problems, the faceted framework can shed light on IIR user study design, reporting, and evaluation practices and help students and young researchers design and assess their own studies.
Download or read book Information Retrieval Evaluation in a Changing World written by Nicola Ferro and published by Springer. This book was released on 2019-08-13 with total page 595 pages. Available in PDF, EPUB and Kindle. Book excerpt: This volume celebrates the twentieth anniversary of CLEF - the Cross-Language Evaluation Forum for the first ten years, and the Conference and Labs of the Evaluation Forum since – and traces its evolution over these first two decades. CLEF’s main mission is to promote research, innovation and development of information retrieval (IR) systems by anticipating trends in information management in order to stimulate advances in the field of IR system experimentation and evaluation. The book is divided into six parts. Parts I and II provide background and context, with the first part explaining what is meant by experimental evaluation and the underlying theory, and describing how this has been interpreted in CLEF and in other internationally recognized evaluation initiatives. Part II presents research architectures and infrastructures that have been developed to manage experimental data and to provide evaluation services in CLEF and elsewhere. Parts III, IV and V represent the core of the book, presenting some of the most significant evaluation activities in CLEF, ranging from the early multilingual text processing exercises to the later, more sophisticated experiments on multimodal collections in diverse genres and media. In all cases, the focus is not only on describing “what has been achieved”, but above all on “what has been learnt”. The final part examines the impact CLEF has had on the research world and discusses current and future challenges, both academic and industrial, including the relevance of IR benchmarking in industrial settings. Mainly intended for researchers in academia and industry, it also offers useful insights and tips for practitioners in industry working on the evaluation and performance issues of IR tools, and graduate students specializing in information retrieval.
Download or read book Evaluating Information Retrieval and Access Tasks written by Tetsuya Sakai and published by Springer Nature. This book was released on 1901 with total page 225 pages. Available in PDF, EPUB and Kindle. Book excerpt: This open access book summarizes the first two decades of the NII Testbeds and Community for Information access Research (NTCIR). NTCIR is a series of evaluation forums run by a global team of researchers and hosted by the National Institute of Informatics (NII), Japan. The book is unique in that it discusses not just what was done at NTCIR, but also how it was done and the impact it has achieved. For example, in some chapters the reader sees the early seeds of what eventually grew to be the search engines that provide access to content on the World Wide Web, todays smartphones that can tailor what they show to the needs of their owners, and the smart speakers that enrich our lives at home and on the move. We also get glimpses into how new search engines can be built for mathematical formulae, or for the digital record of a lived human life. Key to the success of the NTCIR endeavor was early recognition that information access research is an empirical discipline and that evaluation therefore lay at the core of the enterprise. Evaluation is thus at the heart of each chapter in this book. They show, for example, how the recognition that some documents are more important than others has shaped thinking about evaluation design. The thirty-three contributors to this volume speak for the many hundreds of researchers from dozens of countries around the world who together shaped NTCIR as organizers and participants. This book is suitable for researchers, practitioners, and students--anyone who wants to learn about past and present evaluation efforts in information retrieval, information access, and natural language processing, as well as those who want to participate in an evaluation task or even to design and organize one.
Download or read book Experimental IR Meets Multilinguality Multimodality and Interaction written by Fabio Crestani and published by Springer Nature. This book was released on 2019-09-02 with total page 434 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book constitutes the refereed proceedings of the 10th International Conference of the CLEF Association, CLEF 2019, held in Lugano, Switzerland, in September 2019. The conference has a clear focus on experimental information retrieval with special attention to the challenges of multimodality, multilinguality, and interactive search ranging from unstructured to semi structures and structured data. The 7 full papers and 8 short papers presented in this volume were carefully reviewed and selected from 30 submissions. This year, many contributions tackle the social networks with the detection of stances or early identification of depression signs on Twitter in a cross-lingual context. Further this volume presents 7 “best of the labs” papers which were reviewed as a full paper submission with the same review criteria. The labs represented scientific challenges based on new data sets and real world problems in multimodal and multilingual information access. In addition to this, 9 benchmarking labs reported results of their yearlong activities in overview talks and lab sessions.
Download or read book Emotional Engineering Vol 5 written by Shuichi Fukuda and published by Springer. This book was released on 2017-03-25 with total page 197 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book provides a review of the latest research on emotion in engineering, with a particular focus on design and manufacturing. Topics include experience, happiness, cognitive science, neuroscience, additive manufacturing, universal design, branding, teamwork. Throughout the book, the emotions of the end users of engineering products are discussed, as well as the perspective of the expert. The book provides researchers, students, and practicing engineers with an opportunity to examine research and practice in engineering from a different perspective, and offers pointers to how to collaborate with people from other fields to help achieve a more connected society.
Download or read book Information Retrieval written by William Hersh and published by Springer Science & Business Media. This book was released on 2006-05-04 with total page 524 pages. Available in PDF, EPUB and Kindle. Book excerpt: Coupled with the growth of the World Wide Web, the topic of health information retrieval has had a tremendous impact on consumer health information. With the aid of newly added questions and discussions at the end of each chapter, this Second Edition covers theory practical applications, evaluation, and research directions of all aspects of medical information retireval systems.
Download or read book The Future Internet written by Alex Galis and published by Springer. This book was released on 2013-04-22 with total page 401 pages. Available in PDF, EPUB and Kindle. Book excerpt: Co-editors of the volume are: Federico Álvarez, Alessandro Bassi, Michele Bezzi, Laurent Ciavaglia, Frances Cleary, Petros Daras, Hermann De Meer, Panagiotis Demestichas, John Domingue, Theo G. Kanter, Stamatis Karnouskos, Srdjan Krčo, Laurent Lefevre, Jasper Lentjes, Man-Sze Li, Paul Malone, Antonio Manzalini, Volkmar Lotz, Henning Müller, Karsten Oberle, Noel E. O'Connor, Nick Papanikolaou, Dana Petcu, Rahim Rahmani, Danny Raz, Gaël Richards, Elio Salvadori, Susana Sargento, Hans Schaffers, Joan Serrat, Burkhard Stiller, Antonio F. Skarmeta, Kurt Tutschku, Theodore Zahariadis The Internet is the most vital scientific, technical, economic and societal set of infrastructures in existence and in operation today serving 2.5 billion users. Continuing its developments would secure much of the upcoming innovation and prosperity and it would underpin the sustainable growth in economic values and volumes needed in the future. Future Internet infrastructures research is therefore a must. The Future Internet Assembly (FIA) is a successful conference that brings together participants of over 150 research projects from several distinct yet interrelated areas in the European Union Framework Programme 7 (FP7). The research projects are grouped as follows: the network of the future as infrastructure connecting and orchestrating the future Internet of people, computers, devices, content, clouds and things; cloud computing, Internet of Services and advanced software engineering; the public-private partnership projects on Future Internet; Future Internet Research and Experimentation (FIRE). The 26 full papers included in this volume were selected from 45 submissions. They are organized in topical sections named: software driven networks, virtualization, programmability and autonomic management; computing and networking clouds; internet of things; and enabling technologies and economic incentives.
Download or read book Experimental IR Meets Multilinguality Multimodality and Interaction written by Avi Arampatzis and published by Springer Nature. This book was released on 2020-09-15 with total page 409 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book constitutes the refereed proceedings of the 11th International Conference of the CLEF Association, CLEF 2020, held in Thessaloniki, Greece, in September 2020.* The conference has a clear focus on experimental information retrieval with special attention to the challenges of multimodality, multilinguality, and interactive search ranging from unstructured to semi structures and structured data. The 5 full papers and 2 short papers presented in this volume were carefully reviewed and selected from 9 submissions. This year, the contributions addressed the following challenges: a large-scale evaluation of translation effects in academic search, advancement of assessor-driven aggregation methods for efficient relevance assessments, and development of a new test dataset. In addition to this, the volume presents 7 “best of the labs” papers which were reviewed as full paper submissions with the same review criteria. The 12 lab overview papers were accepted out of 15 submissions and represent scientific challenges based on new data sets and real world problems in multimodal and multilingual information access. * The conference was held virtually due to the COVID-19 pandemic.
Download or read book Web Search Engine Research written by Dirk Lewandowski and published by Emerald Group Publishing. This book was released on 2012-04-19 with total page 337 pages. Available in PDF, EPUB and Kindle. Book excerpt: Provides an understanding of Web search engines from the unique perspective of Library and Information Science. This book explores a range of topics including retrieval effectiveness, user satisfaction, the evaluation of search interfaces, the impact of search on society, and the influence of search engine optimization (SEO) on results quality.
Download or read book Information Retrieval Uncertainty and Logics written by Cornelis Joost van Rijsbergen and published by Springer Science & Business Media. This book was released on 2012-12-06 with total page 332 pages. Available in PDF, EPUB and Kindle. Book excerpt: In recent years, there have been several attempts to define a logic for information retrieval (IR). The aim was to provide a rich and uniform representation of information and its semantics with the goal of improving retrieval effectiveness. The basis of a logical model for IR is the assumption that queries and documents can be represented effectively by logical formulae. To retrieve a document, an IR system has to infer the formula representing the query from the formula representing the document. This logical interpretation of query and document emphasizes that relevance in IR is an inference process. The use of logic to build IR models enables one to obtain models that are more general than earlier well-known IR models. Indeed, some logical models are able to represent within a uniform framework various features of IR systems such as hypermedia links, multimedia data, and user's knowledge. Logic also provides a common approach to the integration of IR systems with logical database systems. Finally, logic makes it possible to reason about an IR model and its properties. This latter possibility is becoming increasingly more important since conventional evaluation methods, although good indicators of the effectiveness of IR systems, often give results which cannot be predicted, or for that matter satisfactorily explained. However, logic by itself cannot fully model IR. The success or the failure of the inference of the query formula from the document formula is not enough to model relevance in IR. It is necessary to take into account the uncertainty inherent in such an inference process. In 1986, Van Rijsbergen proposed the uncertainty logical principle to model relevance as an uncertain inference process. When proposing the principle, Van Rijsbergen was not specific about which logic and which uncertainty theory to use. As a consequence, various logics and uncertainty theories have been proposed and investigated. The choice of an appropriate logic and uncertainty mechanism has been a main research theme in logical IR modeling leading to a number of logical IR models over the years. Information Retrieval: Uncertainty and Logics contains a collection of exciting papers proposing, developing and implementing logical IR models. This book is appropriate for use as a text for a graduate-level course on Information Retrieval or Database Systems, and as a reference for researchers and practitioners in industry.
Download or read book Program Evaluation Theory and Practice written by Donna M. Mertens and published by Guilford Press. This book was released on 2012-02-20 with total page 642 pages. Available in PDF, EPUB and Kindle. Book excerpt: This engaging text takes an evenhanded approach to major theoretical paradigms in evaluation and builds a bridge from them to evaluation practice. Featuring helpful checklists, procedural steps, provocative questions that invite readers to explore their own theoretical assumptions, and practical exercises, the book provides concrete guidance for conducting large- and small-scale evaluations. Numerous sample studies—many with reflective commentary from the evaluators—reveal the process through which an evaluator incorporates a paradigm into an actual research project. The book shows how theory informs methodological choices (the specifics of planning, implementing, and using evaluations). It offers balanced coverage of quantitative, qualitative, and mixed methods approaches. Useful pedagogical features include: *Examples of large- and small-scale evaluations from multiple disciplines. *Beginning-of-chapter reflection questions that set the stage for the material covered. *"Extending your thinking" questions and practical activities that help readers apply particular theoretical paradigms in their own evaluation projects. *Relevant Web links, including pathways to more details about sampling, data collection, and analysis. *Boxes offering a closer look at key evaluation concepts and additional studies. *Checklists for readers to determine if they have followed recommended practice. *A companion website with resources for further learning.
Download or read book Enterprise Search written by Martin White and published by "O'Reilly Media, Inc.". This book was released on 2013 with total page 190 pages. Available in PDF, EPUB and Kindle. Book excerpt: Is your organization rapidly accumulating more information than you know how to manage? This book helps you create an enterprise search solution based on more than just technology. Author Martin White shows you how to plan and implement a managed search environment that meets the needs of your business and your employees. Learn why it's vital to have a dedicated staff manage your search technology and support your users. In one survey, 93% of executives said their organization is losing revenue because they're not fully able to use the information they collect. With this book, business managers, IT managers, and information professionals can maximize the value of corporate information and data assets. Use 12 critical factors to gauge your organization's search needs Learn how to make a business case for search Research your user requirements and evaluate your current search solution Create a support team with technical skills and organizational knowledge to manage your solution Set quality guidelines for organizational content and metadata Get an overview of open source and commercial search technology Choose an application based on your requirements, not for its features Make mobile and location-independent search part of your solution
