Simulating Information Retrieval Test Collections (Synthesis Lectures on Information Concepts, Retrieval, and Services)

Name: Simulating Information Retrieval Test Collections (Synthesis Lectures on Information Concepts, Retrieval, and Services)
Author: David Hawking
ISBN: 9781681739571

David Hawking

Language: English

Published by Morgan & Claypool Publishers, 2020

1681739577 / 9781681739571

Softcover
New

See all details

Seller: Karl Eynon Books Ltd, tywyn, United KingdomKarl Eynon Books Ltd

5-star seller

AbeBooks seller since April 16, 2003

View this seller's items

Softcover

Condition: New

£ 28.20

£ 24.00 shipping

Ships from United Kingdom to U.S.A.

Quantity: 1 available

Add to basket

Free 30-day returns

Save for laterCreate a Want for similar items

Item description from seller

New copies no faults.

Seller Inventory # 103464

Contact seller about this item

Report this item

Title: Simulating Information Retrieval Test Collections (Synthesis Lectures on Information Concepts, Retrieval, and Services)
Author: David Hawking
Publisher: Morgan & Claypool Publishers
Publication year: 2020
Condition: New
Binding: Paperback
Language: English
ISBN 10: 1681739577
ISBN 13: 9781681739571
Dimensions: 0x0x0

Simulated test collections may find application in situations where real datasets cannot easily be accessed due to confidentiality concerns or practical inconvenience. They can potentially support Information Retrieval (IR) experimentation, tuning, validation, performance prediction, and hardware sizing. Naturally, the accuracy and usefulness of results obtained from a simulation depend upon the fidelity and generality of the models which underpin it. The fidelity of emulation of a real corpus is likely to be limited by the requirement that confidential information in the real corpus should not be able to be extracted from the emulated version. We present a range of methods exploring trade-offs between emulation fidelity and degree of preservation of privacy.

We present three different simple types of text generator which work at a micro level: Markov models, neural net models, and substitution ciphers. We also describe macro level methods where we can engineer macro properties of a corpus, giving a range of models for each of the salient properties: document length distribution, word frequency distribution (for independent and non-independent cases), word length and textual representation, and corpus growth.

We present results of emulating existing corpora and for scaling up corpora by two orders of magnitude. We show that simulated collections generated with relatively simple methods are suitable for some purposes and can be generated very quickly. Indeed it may sometimes be feasible to embed a simple lightweight corpus generator into an indexer for the purpose of efficiency studies.

Naturally, a corpus of artificial text cannot support IR experimentation in the absence of a set of compatible queries. We discuss and experiment with published methods for query generation and query log emulation.

We present a proof-of-the-pudding study in which we observe the predictive accuracy of efficiency and effectiveness results obtained on emulated versions of TREC corpora. The study includes three open-source retrieval systems and several TREC datasets. There is a trade-off between confidentiality and prediction accuracy and there are interesting interactions between retrieval systems and datasets. Our tentative conclusion is that there are emulation methods which achieve useful prediction accuracy while providing a level of confidentiality adequate for many applications.

"Synopsis" may belong to another edition of this title.

About the Author

David Hawking is an Honorary Professor in the College of Engineering and Computer Science at the Australian National University in Canberra. His research in Information Retrieval began in the early nineteen-nineties at the Australian National University where he worked on parallel and distributed IR, and proximity models of retrieval. With ANU colleagues, he coordinated the Very Large Collection and Web tracks at TREC and co-created a number of test collections, notably WT10g and VLC2. Between 1998 and 2008 he worked for the government research organisation CSIRO and, with colleagues, developed an internet and enterprise retrieval system which was spun off as Funnelback Pty Ltd. David worked as Chief Scientist for Funnelback until 2013 when he joined Microsoft and worked on the Bing search engine. He retired from paid work in 2018.

Bodo Billerbeck is an applied data scientist at Microsoft Bing, working mostly on core search problems. His interests lie in finding often data-driven solutions to multiple problems in the search stack, including indexing, query reformulation, matching, answer selection and insertion, as well as evaluation. Since completing his Ph.D. at RMIT University in 2005 he briefly worked at Sensis.com.au, but soon moved on to Microsoft. After spending some time embedded at Microsoft Research in Cambridge, UK, he returned to Australia, and recently has come full circle and is enjoying an honorary fellow position at RMIT.

Paul Thomas is an applied scientist at Microsoft. His research is in information retrieval: particularly in how people use web search systems and how we should evaluate these systems, as well as interfaces for search including search with different types of results, search on mobile devices, and search as conversation. He has previously worked at Australia's CSIRO and the Australian National University.

Nick Craswell is a research manager at Microsoft Bing. Since obtaining his Ph.D. from the Australian National University in 2000 on the topic of distributed information retrieval, Nick has worked on enterprise search, expert search, anchor text, click graphs, image search, offline and online evaluation of Web search, query-independent evidence in ranking, evaluation metrics and web ranking and neural ranking models. He has been a driving force in the TREC web tracks and enterprise tracks and was instrumental in creating various widely used test collections.

"About the title" may belong to another edition of this title.

Karl Eynon Books Ltd

tywyn, United Kingdom

5-star seller

AbeBooks seller since April 16, 2003

Shipping rates from United Kingdom to U.S.A.

Item	7 to 14 business days	3 to 10 business days
First item	£ 24.00	£ 29.50

Delivery times are set by sellers and vary by carrier and location. Orders passing through Customs may face delays and buyers are responsible for any associated duties or fees. Sellers may contact you regarding additional charges to cover any increased costs to ship your items.

Payment methods

Paypal

Store description

25 Years experience. 18000 books in store. We buy and sell from our shop in Tywyn Snowdonia North Wales. Tel 01654 711011

Seller's business information

karl eynon books ltd

19 Station Road
tywyn, United Kingdom LL36 9AH

Contact sellerView this seller's itemsView seller's storefront

Terms of sale

The easiest way to pay is via abe using your credit / debit card .We also accept cheques in sterling from UK banks only if you would want to pay via paypal the address to send money to is karleynon@hotmail.com. I will send a paypal request for funds if you choose this option. Any queries please phone 01654 712349.

Right of withdrawal

If you are a consumer you can withdraw from the contract in accordance with the following. Consumer means any natural person who is acting for purposes which are outside his trade, business, craft or profession.

Information regarding the right of withdrawal

Statutory right to withdraw

You have the right to withdraw from this contract within 14 days without giving any reason.

The withdrawal period will expire after 14 days from the day on which you acquire, or a third party other than the carrier and indicated by you acquires, physical possession of the last good or the last lot or piece.

To exercise the right of withdrawal, electronically fill in and submit a clear statement on our website, under "My Purchases" in "My Account". We will communicate to you an acknowledgement of receipt of such a withdrawal on a durable medium (e.g. by e-mail) without delay.

To meet the withdrawal deadline, it is sufficient for you to send your communication concerning your exercise of the right of withdrawal before the withdrawal period has expired.

Effects of withdrawal

If you withdraw from this contract, we will reimburse to you all payments received from you, including the costs of delivery (except for the supplementary costs arising if you chose a type of delivery other than the least expensive type of standard delivery offered by us).

We may make a deduction from the reimbursement for loss in value of any goods supplied, if the loss is the result of unnecessary handling by you.

We will make the reimbursement without undue delay, and not later than 14 days after the day on which we are informed about your decision to withdraw from this contract.

We will make the reimbursement using the same means of payment as you used for the initial transaction, unless you have expressly agreed otherwise; in any event, you will not incur any fees as a result of such reimbursement.

We may withhold reimbursement until we have received the goods back, or you have supplied evidence of having sent back the goods, whichever is the earliest.

You shall send back the goods or hand them over to Karl Eynon Books Ltd, tywyn, United Kingdom, +44 01654 711011, without undue delay and in any event not later than 14 days from the day on which you communicate your withdrawal from this contract to us. The deadline is met if you send back the goods before the period of 14 days has expired. You will have to bear the direct cost of returning the goods. You are only liable for any diminished value of the goods resulting from the handling other than what is necessary to establish the nature, characteristics and functioning of the goods.

Exceptions to the right of withdrawal

The right of withdrawal does not apply to:

The delivery of newspapers, journals or magazines with the exception of subscription contracts; and
The supply of digital content which is not supplied on a tangible medium (e.g. on a CD or DVD) if you accepted when you placed your order that we could start to deliver it, and that you could not withdraw once delivery had started.

Shipping terms

Shipping costs are based on books weighing 2.2 LB, or 1 KG. If your book order is heavy or oversized, we may contact you to let you know extra shipping is required.