2 |
Overview of the CLEF eHealth evaluation lab 2018
|
|
Suominen, Hanna; Kelly, Liadh; Goeuriot, Lorraine; Névéol, Aurélie; Ramadier, Lionel; Robert, Aude; Kanoulas, Evangelos; Spijker, Rene; Azzopardi, Leif; Li, Dan; Jimmy; Palotti, João; Zuccon, Guido. - : Springer International Publishing, 2018
|
|
Abstract:
In this paper, we provide an overview of the sixth annual edition of the CLEF eHealth evaluation lab. CLEF eHealth 2018 continues our evaluation resource building efforts around the easing and support of patients, their next-of-kins, clinical staff, and health scientists in understanding, accessing, and authoring eHealth information in a multilingual setting. This year’s lab offered three tasks: Task 1 on multilingual information extraction to extend from last year’s task on French and English corpora to French, Hungarian, and Italian; Task 2 on technologically assisted reviews in empirical medicine building on last year’s pilot task in English; and Task 3 on Consumer Health Search (CHS) in mono- and multilingual settings that builds on the 2013–17 Information Retrieval tasks. In total 28 teams took part in these tasks (14 in Task 1, 7 in Task 2 and 7 in Task 3). Herein, we describe the resources created for these tasks, outline our evaluation methodology adopted and provide a brief summary of participants of this year’s challenges and results obtained. As in previous years, the organizers have made data and tools associated with the lab tasks available for future research and development.
|
|
Keyword:
1700 Computer Science; 2614 Theoretical Computer Science; Entity linking; Evaluation; Health records; Information extraction; Information retrieval; Medical informatics; Self-diagnosis; Systematic reviews; Test-set generation; Text classification; Text segmentation; Total recall
|
|
URL: https://espace.library.uq.edu.au/view/UQ:124546d
|
|
BASE
|
|
Hide details
|
|
4 |
The IR Task at the CLEF eHealth evaluation lab 2016: User-centred health information retrieval
|
|
|
|
BASE
|
|
Show details
|
|
5 |
Overview of the ShARe/CLEF eHealth evaluation lab 2014
|
|
|
|
In: Kelly, Liadh orcid:0000-0003-1131-5238 , Goeuriot, Lorraine orcid:0000-0001-7491-1980 , Suominen, Hanna, Schreck, Tobias, Leroy, Gondy, Mowery, Danielle L., Velupillai, Sumithra, Chapman, Wendy, Martinez, David, Zuccon, Guido and Palotti, Joao (2014) Overview of the ShARe/CLEF eHealth evaluation lab 2014. Lecture Notes in Computer Science, 8685 . pp. 172-191. ISSN 0302-9743 (2014)
|
|
BASE
|
|
Show details
|
|
6 |
Overview of the ShARe/CLEF eHealth evaluation lab 2014
|
|
|
|
In: Kelly, Liadh orcid:0000-0003-1131-5238 , Goeuriot, Lorraine orcid:0000-0001-7491-1980 , Suominen, Hanna, Schreck, Tobias, Leroy, Gondy, Mowery, Danielle L., Velupillai, Sumithra, Chapman, Wendy, Martinez, David, Zuccon, Guido and Palotti, Joao (2014) Overview of the ShARe/CLEF eHealth evaluation lab 2014. In: Conference and Labs for the Evaluation Forum (CLEF 2014), 15-18 Sept 2014, Sheffield, UK. ISBN 978-3-319-11382-1 (2014)
|
|
BASE
|
|
Show details
|
|
7 |
ShARe/CLEF eHealth evaluation lab 2014, task 3: user-centred health information retrieval
|
|
|
|
In: Goeuriot, Lorraine orcid:0000-0001-7491-1980 , Kelly, Liadh orcid:0000-0003-1131-5238 , Li, Wei B. orcid:0000-0001-7347-3501 , Palotti, Joao, Pecina, Pavel, Zuccon, Guido, Hanbury, Allan, Jones, Gareth J.F. orcid:0000-0002-4033-9135 and Mueller, Henning (2014) ShARe/CLEF eHealth evaluation lab 2014, task 3: user-centred health information retrieval. In: Conference and Labs for the Evaluation Forum (CLEF 2014), 15-18 Sept 2014, Sheffield, UK. (2014)
|
|
BASE
|
|
Show details
|
|
8 |
ShARe/CLEF eHealth evaluation lab 2014, task 3: user-centred health information retrieval
|
|
|
|
In: Goeuriot, Lorraine orcid:0000-0001-7491-1980 , Kelly, Liadh orcid:0000-0003-1131-5238 , Li, Wei B. orcid:0000-0001-7347-3501 , Palotti, Joao, Zuccon, Guido, Hanbury, Allan, Jones, Gareth J.F. orcid:0000-0002-4033-9135 and Mueller, Henning (2014) ShARe/CLEF eHealth evaluation lab 2014, task 3: user-centred health information retrieval. CLEF 2014 Online Working Notes, 1180 . pp. 43-61. ISSN 1613-0073 (2014)
|
|
BASE
|
|
Show details
|
|
9 |
ShARe/CLEF eHealth Evaluation Lab 2014, Task 3: User-centred health information retrieval
|
|
|
|
In: Proceedings of CLEF 2014 ; https://hal.archives-ouvertes.fr/hal-01086554 ; Proceedings of CLEF 2014, Sep 2014, Sheffield, United Kingdom (2014)
|
|
BASE
|
|
Show details
|
|
10 |
Overview of the ShARe/CLEF eHealth Evaluation Lab 2014
|
|
|
|
In: Information Access Evaluation : Multilinguality, Multimodality, and Interaction ; 5th International Conference of the CLEF Initiative, CLEF 2014, Sheffield, UK, September 15-18, 2014. Proceedings / Evangelos Kanoulas . (Hrsg.). - Springer International Publishing, 2014. - (Lecture Notes in Computer Science ; 8685). - S. 172-191. - ISBN 978-3-319-11381-4 (2014)
|
|
BASE
|
|
Show details
|
|
11 |
Khresmoi professional: multilingualsSemantic search for medical professionals
|
|
|
|
In: Kelly, Liadh orcid:0000-0003-1131-5238 , Hanbury, Allan, Jones, Gareth J.F. orcid:0000-0003-2923-8365 , Goeuriot, Lorraine orcid:0000-0001-7491-1980 and Mueller, Henning (2013) Khresmoi professional: multilingualsSemantic search for medical professionals. In: SIGIR 2013 Health Search and Discovery HSD workshop, 1 Aug 2013, Dublin, Ireland. (2013)
|
|
BASE
|
|
Show details
|
|
|
|