| 1 |
Studying the Variability of System Setting Effectiveness by Data Analytics and Visualization
|
|
|
|
In: CLEF 2019: Experimental IR Meets Multilinguality, Multimodality, and Interaction ; Conference and Labs of the Evaluation Forum, Living Labs (CLEF 2019) ; https://hal.archives-ouvertes.fr/hal-02930098 ; Conference and Labs of the Evaluation Forum, Living Labs (CLEF 2019), Sep 2019, Lugano, Switzerland. pp.62-74, ⟨10.1007/978-3-030-28577-7_3⟩ (2019)
|
|
Abstract:
International audience ; Search engines differ from their modules and parameters; defining the optimal system setting is challenging the more because of the complexity of a retrieval stream. The main goal of this study is to determine which are the most important system components and parameters in system setting, thus which ones should be tuned as the first priority. We carry out an extensive analysis of 20, 000 different system settings applied to three TREC ad-hoc collections. Our analysis includes zooming in and out the data using various data analysis methods such as ANOVA, CART, and data visualization. We found that the query expansion model is the most significant component that changes the system effectiveness, consistently across collections. Zooming in the queries, we show that the most significant component changes to the retrieval model when considering easy queries only. The results of our study are directly re-usable for the system designers and for system tuning.
|
|
Keyword:
[INFO.INFO-IR]Computer Science [cs]/Information Retrieval [cs.IR]; Data analytics; Effectiveness; Information retrieval; Retrieval system modules
|
|
URL: https://hal.archives-ouvertes.fr/hal-02930098
https://hal.archives-ouvertes.fr/hal-02930098/document
https://doi.org/10.1007/978-3-030-28577-7_3
https://hal.archives-ouvertes.fr/hal-02930098/file/Dejean_26250.pdf
|
|
BASE
|
|
Hide details
|
|
|
| 2 |
Using language models to improve opinion detection
|
|
|
|
In: ISSN: 0306-4573 ; Information Processing and Management ; https://hal.archives-ouvertes.fr/hal-02279437 ; Information Processing and Management, Elsevier, 2018, 54 (6), pp.958-968. ⟨10.1016/j.ipm.2018.07.001⟩ (2018)
|
|
BASE
|
|
Show details
|
|
|
| 3 |
Automatic Detection of Depressive Users in Social Media
|
|
|
|
In: Actes de CORIA 2018 ; Conférence francophone en Recherche d'Information et Applications (CORIA) ; https://hal.archives-ouvertes.fr/hal-02942297 ; Conférence francophone en Recherche d'Information et Applications (CORIA), May 2018, Rennes, France. ⟨10.24348/coria.2018.paper4⟩ (2018)
|
|
BASE
|
|
Show details
|
|
|
| 4 |
IRIT at e-Risk 2018
|
|
|
|
In: CLEF 2018 Working Notes ; 9th Conference and Labs of the Evaluation Forum, Living Labs (CLEF 2018) ; https://hal.archives-ouvertes.fr/hal-02290007 ; 9th Conference and Labs of the Evaluation Forum, Living Labs (CLEF 2018), Sep 2018, Avignon, France. pp.1-12 (2018)
|
|
BASE
|
|
Show details
|
|
|
| 5 |
Living Ranking: from online to real-time information retrieval evaluation
|
|
|
|
In: 7th International Conference of the CLEF Association ; Conference and Labs of the Evaluation Forum (CLEF 2016): "Information access Evaluation meets Multilinguality, Multimodality and Interaction" ; https://hal.sorbonne-universite.fr/hal-01349114 ; Conference and Labs of the Evaluation Forum (CLEF 2016): "Information access Evaluation meets Multilinguality, Multimodality and Interaction", Sep 2016, Evora, Portugal ; http://clef2016.clef-initiative.eu/ (2016)
|
|
BASE
|
|
Show details
|
|
|
| 6 |
A Product Feature-based User-Centric Ranking Model for E-Commerce Search
|
|
|
|
In: Conference on Multilingual and Multimodal Information Access Evaluation (CLEF 2016) ; 7th Conference and Labs of the Evaluation Forum (CLEF 2016): "Information Access Evaluation meets Multilinguality, Multimodality and Interaction" ; https://hal.sorbonne-universite.fr/hal-01349111 ; 7th Conference and Labs of the Evaluation Forum (CLEF 2016): "Information Access Evaluation meets Multilinguality, Multimodality and Interaction", Sep 2016, Evora, Portugal ; http://clef2016.clef-initiative.eu/ (2016)
|
|
BASE
|
|
Show details
|
|
|
| 7 |
A Method for Short Message Contextualization: Experiments at CLEF/INEX
|
|
|
|
In: Experimental IR Meets Multilinguality, Multimodality, and Interaction ; 6th Conference on Multilingual and Multimodal Information Access Evaluation (CLEF 15) ; https://hal.archives-ouvertes.fr/hal-01343032 ; 6th Conference on Multilingual and Multimodal Information Access Evaluation (CLEF 15), Sep 2015, Toulouse, France. pp. 352-363 (2015)
|
|
BASE
|
|
Show details
|
|
|
| 8 |
Report on CLEF 2015: Experimental IR Meets Multilinguality, Multimodality, and Interaction
|
|
|
|
In: ISSN: 0163-5840 ; Sigir Forum ; https://hal.archives-ouvertes.fr/hal-03464323 ; Sigir Forum, Association for Computing Machinery (ACM), 2015, 49 (2), pp.47-56. ⟨10.1145/2888422.2888428⟩ ; https://dl.acm.org/doi/10.1145/2888422.2888428 (2015)
|
|
BASE
|
|
Show details
|
|
|
| 9 |
Détection automatique des sessions de recherche par similarité des résultats provenant d'une collection de documents externe
|
|
|
|
In: Actes de la 15e Rencontre des Étudiants Chercheurs en Informatique pour le Traitement Automatique des Langues (RECITAL 2013) ; 15e Rencontre des Étudiants Chercheurs en Informatique pour le Traitement Automatique des Langues (RECITAL 2013) ; https://hal-univ-tlse2.archives-ouvertes.fr/hal-00982483 ; 15e Rencontre des Étudiants Chercheurs en Informatique pour le Traitement Automatique des Langues (RECITAL 2013), Jun 2013, Les Sables d'Olonne, France. pp.217-230 (2013)
|
|
BASE
|
|
Show details
|
|
|
| 10 |
Effectiveness gain of polarity detection through topic domains
|
|
|
|
In: SEMAPRO 2013 conference ; 7th International Conference on Advances in Semantic Processing (SEMAPRO 2013) ; https://hal.archives-ouvertes.fr/hal-01178567 ; 7th International Conference on Advances in Semantic Processing (SEMAPRO 2013), Sep 2013, Porto, Portugal. pp. 62-67 (2013)
|
|
BASE
|
|
Show details
|
|
|
| 11 |
Fuzzy logic techniques in Multimedia database queyring: a preliminary investigation of the potentials
|
|
|
|
In: ISSN: 1041-4347 ; IEEE Transactions on Knowledge and Data Engineering ; https://hal.archives-ouvertes.fr/hal-03394656 ; IEEE Transactions on Knowledge and Data Engineering, Institute of Electrical and Electronics Engineers, 2001, 13 (3 - May/Jun 2001), pp.383-392. ⟨10.1109/69.929896⟩ ; https://ieeexplore.ieee.org/document/929896 (2001)
|
|
BASE
|
|
Show details
|
|
|
|
|
