Presented at the virtual Cochrane Colloquium 2019 by Harry Scells.
For more information, please visit http://ielab.io/publications/scells-2019-reformulation
#SystematicReviews
This video describes the article "A Comparison of Automatic Boolean Query Formulation", published in Information Retrieval Journal in 2020 (https://link.springer.com/article/10.1007/s10791-020-09381-1) and presented at ECIR 2021. A copy of the article can be found at http://ielab.io/publications/scells-2020-comparison
Presented at the virtual Cochrane Colloquium 2019 by Harry Scells.
For more information, please visit http://ielab.io/publications/scells-2019-queryvis
#SystematicReviews
Title: Smooth Operators for Effective Systematic Review Queries
Authors: Harrisen Scells, Ferdinand Schlatt, Martin Potthast
Paper: https://dl.acm.org/doi/10.1145/3539618.3591768
Abstract:
Effective queries are crucial to minimising the time and cost of medical systematic reviews, as all retrieved documents must be judged for relevance. Boolean queries, developed by expert librarians, are the standard for systematic reviews. They guarantee reproducible and verifiable retrieval and more control than free-text queries. However, the result sets of Boolean queries are unranked and difficult to control due to the strict Boolean operators. We address these problems in a single unified retrieval model by formulating a class of smooth operators that are compatible with and extend existing Boolean operators. Our smooth operators overcome several shortcomings of previous extensions of the Boolean retrieval model. In particular, our operators are independent of the underlying ranking function, so that exact-match and large language model rankers can be combined in the same query. We found that replacing Boolean operators with equivalent or similar smooth operators often improves the effectiveness of queries. Their properties make tuning a query to precision or recall intuitive and allow greater control over how documents are retrieved. This additional control leads to more effective queries and reduces the cost of systematic reviews.
With a deep curiosity for how evidence is found and organized, I explore ways to make complex research easier to navigate. I aim to turn scattered knowledge into clearer paths for discovery.