Appendix C Results of the Domain Specific Track Prepared by: Giorgio Maria Di Nunzio and Nicola Ferro {dinunzio, ferro}@dei.unipd.it Department of Information Engineering University of Padua Italy 1 2 Introduction 3 4 Results for CLEF 2007 Domain Specific Track The following pages contain the results and graphs for all the experiments that have been officially submitted to the CLEF 2007 campaign for the Domain Specific track. This document is divided in three main parts: 1. List of submitted experiments 2. Track overview results and graphs 3. Individual experiment results and graphs 1. List of Submitted Experiments This section gives a listing of all experiments and their characteristics: Participant: name of the participant who submitted the experiment. Country: country of the participant. Expeirment DOI: Digital Object Identifier (DOI) for each experiment. Task: track/task to which the experiment belongs. Lang.: language of the topics used to create the experiment (ISO identifiers for language). Fields: identifies the parts of the topics used to create the experiment (T = title, D = Description, N = Narrative). Constr.: identifies how the query has been constructed from topic fields (manual/automatic). Pool: specifies if experiment was used for relevance assessment pooling. 2. Track Overview Results and Graphs For each track/task graphs and tables are shown in order to compare the experiments. The graphs and tables contain the following information: - Best experiments of at most top five participants - Interpolated recall vs precision averages plot - Average precision comparison to median plot - All experiments - Average precision box plot - Average precision Tukey t-test plot - Best experiments of at most top five participants - Document cutoff levels (DCL) vs precision at DCL plot - R-Precision comparison to median plot - All experiments - R-Precision box plot - R-Precision Tukey t-test plot - A table with descriptive statistics of performance figures for each topic - Min: The minimum of a set of observations - 1st Q: The first quartile of a set of observations - 2nd Q: The second quartile (median) of a set of observations - 3rd Q: The third quartile of a set of observations - Max: The maximum of a set of observations - Mean: The arithmetic mean of a set of observations - Std: The standard deviation of a set of observations - IQR: Interquartile range, the difference between the 3rd and 1st quartiles - Range: The difference between the maximum and the minimum of a set of observations - C.Var: Coefficient of variation, the spread of a set of data as a proportion of its mean - Geom.: The geometric mean of a set of observations - Harm.: The harmonic mean of a set of observations - MAO: The mean of absolute deviation of the values in a set of observations - LOT: The lower threshold below which values of a set of observations are considered outliers - UOT: The upper threshold below which values of a set of observations are considered outliers - MNO: Mean without outliers, the arithmetic mean of a set of observations without outliers - SNO: Std without outliers, the standard deviation a set of observations without outliers 5 3. Individual Experiment Results and Graphs This section provides the individual results for each official experiment. For each experiment the following tables and graphs are shown: - Overall statistics and information - Interpolated recall vs precision averages plot - Average precision statistics and box plot - Average precision comparison to median plot - Document cutoff levels vs precision at DCL plot - R-Precision statistics and box plot - R-Precision comparison to median plot Topics are identified with DOIs, as well as the experiments. The prefix for the DOI of a topic is 10.2452. The following example shows how to build the DOI for a topic given its number: for topic 200-AH, the corresponding DOI is 10.2452/200-AH 6 List of Submitted Experiments 7 8 Participant Country Experiment DOI Task Lang. Fields Constr. Pool chemnitz Germany 10.2415/DS-MONO-DE- DS-MONO-DE-CLEF2007 de TD AUTOMATIC yes CLEF2007.CHEMNITZ.CUT_DS_MONO_DE_MERGED chemnitz Germany 10.2415/DS-MONO-DE- DS-MONO-DE-CLEF2007 de TD AUTOMATIC yes CLEF2007.CHEMNITZ.CUT_DS_MONO_DE_STRUCT chemnitz Germany 10.2415/DS-MONO-DE- DS-MONO-DE-CLEF2007 de TD AUTOMATIC yes CLEF2007.CHEMNITZ.CUT_DS_MONO_DE_UNSTRUCT cheshire United States 10.2415/DS-MONO-DE- DS-MONO-DE-CLEF2007 de TD AUTOMATIC yes CLEF2007.CHESHIRE.BERKMDECCP15 cheshire United States 10.2415/DS-MONO-DE- DS-MONO-DE-CLEF2007 de TD AUTOMATIC yes CLEF2007.CHESHIRE.BERKMDETHP7 unine Switzerland 10.2415/DS-MONO-DE- DS-MONO-DE-CLEF2007 de TD AUTOMATIC yes CLEF2007.UNINE.UNINEDE1 unine Switzerland 10.2415/DS-MONO-DE- DS-MONO-DE-CLEF2007 de TD AUTOMATIC yes CLEF2007.UNINE.UNINEDE2 unine Switzerland 10.2415/DS-MONO-DE- DS-MONO-DE-CLEF2007 de TD AUTOMATIC yes CLEF2007.UNINE.UNINEDE3 unine Switzerland 10.2415/DS-MONO-DE- DS-MONO-DE-CLEF2007 de TDN AUTOMATIC yes CLEF2007.UNINE.UNINEDE4 xerox France 10.2415/DS-MONO-DE- DS-MONO-DE-CLEF2007 de TD AUTOMATIC yes CLEF2007.XEROX.XRCELEDE xerox France 10.2415/DS-MONO-DE- DS-MONO-DE-CLEF2007 de TD AUTOMATIC yes CLEF2007.XEROX.XRCEPRFDE xerox France 10.2415/DS-MONO-DE- DS-MONO-DE-CLEF2007 de TD AUTOMATIC yes CLEF2007.XEROX.XRCEPRFDELE xerox France 10.2415/DS-MONO-DE- DS-MONO-DE-CLEF2007 de TD AUTOMATIC yes CLEF2007.XEROX.XRCEPRFLEDE chemnitz Germany 10.2415/DS-MONO-EN- DS-MONO-EN-CLEF2007 en TD AUTOMATIC yes CLEF2007.CHEMNITZ.CUT_DS_MONO_EN_MERGED chemnitz Germany 10.2415/DS-MONO-EN- DS-MONO-EN-CLEF2007 en TD AUTOMATIC yes CLEF2007.CHEMNITZ.CUT_DS_MONO_EN_MERGED_S TRUCT chemnitz Germany 10.2415/DS-MONO-EN- DS-MONO-EN-CLEF2007 en TD AUTOMATIC yes CLEF2007.CHEMNITZ.CUT_DS_MONO_EN_MERGED_U NSTRUCT cheshire United States 10.2415/DS-MONO-EN- DS-MONO-EN-CLEF2007 en TD AUTOMATIC yes CLEF2007.CHESHIRE.BERKMENCCP15 cheshire United States 10.2415/DS-MONO-EN- DS-MONO-EN-CLEF2007 en TD AUTOMATIC yes CLEF2007.CHESHIRE.BERKMENTHP15 moscow Russian 10.2415/DS-MONO-EN- DS-MONO-EN-CLEF2007 en TD AUTOMATIC yes Federation CLEF2007.MOSCOW.CIRDSMONOEN moscow Russian 10.2415/DS-MONO-EN- DS-MONO-EN-CLEF2007 en TD AUTOMATIC yes Federation CLEF2007.MOSCOW.CIRDSMONOEN2 unine Switzerland 10.2415/DS-MONO-EN- DS-MONO-EN-CLEF2007 en TD AUTOMATIC yes CLEF2007.UNINE.UNINEEN1 unine Switzerland 10.2415/DS-MONO-EN- DS-MONO-EN-CLEF2007 en TD AUTOMATIC yes CLEF2007.UNINE.UNINEEN2 unine Switzerland 10.2415/DS-MONO-EN- DS-MONO-EN-CLEF2007 en TD AUTOMATIC yes CLEF2007.UNINE.UNINEEN3 unine Switzerland 10.2415/DS-MONO-EN- DS-MONO-EN-CLEF2007 en TDN AUTOMATIC yes CLEF2007.UNINE.UNINEEN4 xerox France 10.2415/DS-MONO-EN- DS-MONO-EN-CLEF2007 en TD AUTOMATIC yes CLEF2007.XEROX.XRCELEEN xerox France 10.2415/DS-MONO-EN- DS-MONO-EN-CLEF2007 en TD AUTOMATIC yes CLEF2007.XEROX.XRCEPRFEN xerox France 10.2415/DS-MONO-EN- DS-MONO-EN-CLEF2007 en TD AUTOMATIC yes CLEF2007.XEROX.XRCEPRFENLE xerox France 10.2415/DS-MONO-EN- DS-MONO-EN-CLEF2007 en TD AUTOMATIC yes CLEF2007.XEROX.XRCEPRFLEEN chemnitz Germany 10.2415/DS-MONO-RU- DS-MONO-RU-CLEF2007 en TD AUTOMATIC yes CLEF2007.CHEMNITZ.CUT_DS_MONO_RU_MERGED chemnitz Germany 10.2415/DS-MONO-RU- DS-MONO-RU-CLEF2007 ru TD AUTOMATIC yes CLEF2007.CHEMNITZ.CUT_DS_MONO_RU_STRUCT chemnitz Germany 10.2415/DS-MONO-RU- DS-MONO-RU-CLEF2007 ru TD AUTOMATIC yes CLEF2007.CHEMNITZ.CUT_DS_MONO_RU_UNSTRUCT cheshire United States 10.2415/DS-MONO-RU- DS-MONO-RU-CLEF2007 ru TD AUTOMATIC yes CLEF2007.CHESHIRE.BERKMRUCCP15 cheshire United States 10.2415/DS-MONO-RU- DS-MONO-RU-CLEF2007 ru TD AUTOMATIC yes CLEF2007.CHESHIRE.BERKMRUTHP7 moscow Russian 10.2415/DS-MONO-RU- DS-MONO-RU-CLEF2007 ru TD AUTOMATIC yes Federation CLEF2007.MOSCOW.CIRDSMONORU moscow Russian 10.2415/DS-MONO-RU- DS-MONO-RU-CLEF2007 ru TD AUTOMATIC yes Federation CLEF2007.MOSCOW.CIRDSMONORU2 unine Switzerland 10.2415/DS-MONO-RU- DS-MONO-RU-CLEF2007 ru TD AUTOMATIC yes CLEF2007.UNINE.UNINERU1 unine Switzerland 10.2415/DS-MONO-RU- DS-MONO-RU-CLEF2007 ru TD AUTOMATIC yes CLEF2007.UNINE.UNINERU2 unine Switzerland 10.2415/DS-MONO-RU- DS-MONO-RU-CLEF2007 ru TD AUTOMATIC yes CLEF2007.UNINE.UNINERU3 unine Switzerland 10.2415/DS-MONO-RU- DS-MONO-RU-CLEF2007 ru TDN AUTOMATIC yes CLEF2007.UNINE.UNINERU4 chemnitz Germany 10.2415/DS-BILI-X2DE- DS-BILI-X2DE-CLEF2007 en TD AUTOMATIC yes CLEF2007.CHEMNITZ.CUT_DS_BILI_EN2DE_MERGE D 9 Participant Country Experiment DOI Task Lang. Fields Constr. Pool chemnitz Germany 10.2415/DS-BILI-X2DE- DS-BILI-X2DE-CLEF2007 en TD AUTOMATIC yes CLEF2007.CHEMNITZ.CUT_DS_BILI_EN2DE_MERGE D_THES chemnitz Germany 10.2415/DS-BILI-X2DE- DS-BILI-X2DE-CLEF2007 ru TD AUTOMATIC yes CLEF2007.CHEMNITZ.CUT_DS_BILI_RU2DE_MERGE D chemnitz Germany 10.2415/DS-BILI-X2DE- DS-BILI-X2DE-CLEF2007 ru TD AUTOMATIC yes CLEF2007.CHEMNITZ.CUT_DS_BILI_RU2DE_MERGE D_THES cheshire United States 10.2415/DS-BILI-X2DE- DS-BILI-X2DE-CLEF2007 en TD AUTOMATIC yes CLEF2007.CHESHIRE.BERKBENDECCP15 cheshire United States 10.2415/DS-BILI-X2DE- DS-BILI-X2DE-CLEF2007 en TD AUTOMATIC yes CLEF2007.CHESHIRE.BERKBENDETHP7 cheshire United States 10.2415/DS-BILI-X2DE- DS-BILI-X2DE-CLEF2007 ru TD AUTOMATIC yes CLEF2007.CHESHIRE.BERKBRUDECCP15 cheshire United States 10.2415/DS-BILI-X2DE- DS-BILI-X2DE-CLEF2007 ru TD AUTOMATIC yes CLEF2007.CHESHIRE.BERKBRUDETHP7 xerox France 10.2415/DS-BILI-X2DE- DS-BILI-X2DE-CLEF2007 en TD AUTOMATIC yes CLEF2007.XEROX.XRCEE2DHCGELE xerox France 10.2415/DS-BILI-X2DE- DS-BILI-X2DE-CLEF2007 en TD AUTOMATIC yes CLEF2007.XEROX.XRCEE2DHCGEPRFLE xerox France 10.2415/DS-BILI-X2DE- DS-BILI-X2DE-CLEF2007 en TD AUTOMATIC yes CLEF2007.XEROX.XRCEE2DHECGPRFLE xerox France 10.2415/DS-BILI-X2DE- DS-BILI-X2DE-CLEF2007 en TD AUTOMATIC yes CLEF2007.XEROX.XRCEE2DMATRAX xerox France 10.2415/DS-BILI-X2DE- DS-BILI-X2DE-CLEF2007 en TD AUTOMATIC yes CLEF2007.XEROX.XRCEE2DMATRAXLE xerox France 10.2415/DS-BILI-X2DE- DS-BILI-X2DE-CLEF2007 en TD AUTOMATIC yes CLEF2007.XEROX.XRCEE2DMATRAXPRFLE chemnitz Germany 10.2415/DS-BILI-X2EN- DS-BILI-X2EN-CLEF2007 de TD AUTOMATIC yes CLEF2007.CHEMNITZ.CUT_DS_BILI_DE2EN_MERGE D chemnitz Germany 10.2415/DS-BILI-X2EN- DS-BILI-X2EN-CLEF2007 de TD AUTOMATIC yes CLEF2007.CHEMNITZ.CUT_DS_BILI_DE2EN_MERGE D_THES chemnitz Germany 10.2415/DS-BILI-X2EN- DS-BILI-X2EN-CLEF2007 ru TD AUTOMATIC yes CLEF2007.CHEMNITZ.CUT_DS_BILI_RU2EN_MERGE D cheshire United States 10.2415/DS-BILI-X2EN- DS-BILI-X2EN-CLEF2007 de TD AUTOMATIC yes CLEF2007.CHESHIRE.BERKBDEENCCP15 cheshire United States 10.2415/DS-BILI-X2EN- DS-BILI-X2EN-CLEF2007 de TD AUTOMATIC yes CLEF2007.CHESHIRE.BERKBDEENTHP7 cheshire United States 10.2415/DS-BILI-X2EN- DS-BILI-X2EN-CLEF2007 ru TD AUTOMATIC yes CLEF2007.CHESHIRE.BERKBRUENCCP15 cheshire United States 10.2415/DS-BILI-X2EN- DS-BILI-X2EN-CLEF2007 ru TD AUTOMATIC yes CLEF2007.CHESHIRE.BERKBRUENTHP7 moscow Russian 10.2415/DS-BILI-X2EN- DS-BILI-X2EN-CLEF2007 ru TD AUTOMATIC yes Federation CLEF2007.MOSCOW.CIRDSBILIRU2EN moscow Russian 10.2415/DS-BILI-X2EN- DS-BILI-X2EN-CLEF2007 ru TD AUTOMATIC yes Federation CLEF2007.MOSCOW.CIRDSBILIRU2EN2 xerox France 10.2415/DS-BILI-X2EN- DS-BILI-X2EN-CLEF2007 de TD AUTOMATIC yes CLEF2007.XEROX.XRCED2EHCGEPRFLE xerox France 10.2415/DS-BILI-X2EN- DS-BILI-X2EN-CLEF2007 de TD AUTOMATIC yes CLEF2007.XEROX.XRCED2EHECGLE xerox France 10.2415/DS-BILI-X2EN- DS-BILI-X2EN-CLEF2007 de TD AUTOMATIC yes CLEF2007.XEROX.XRCED2EHECGPRFLE xerox France 10.2415/DS-BILI-X2EN- DS-BILI-X2EN-CLEF2007 de TD AUTOMATIC yes CLEF2007.XEROX.XRCED2EMATRAX xerox France 10.2415/DS-BILI-X2EN- DS-BILI-X2EN-CLEF2007 de TD AUTOMATIC yes CLEF2007.XEROX.XRCED2EMATRAXLE xerox France 10.2415/DS-BILI-X2EN- DS-BILI-X2EN-CLEF2007 en TD AUTOMATIC yes CLEF2007.XEROX.XRCED2EMATRAXPRFLE chemnitz Germany 10.2415/DS-BILI-X2RU- DS-BILI-X2RU-CLEF2007 de TD AUTOMATIC yes CLEF2007.CHEMNITZ.CUT_DS_BILI_DE2RU_MERGE D chemnitz Germany 10.2415/DS-BILI-X2RU- DS-BILI-X2RU-CLEF2007 de TD AUTOMATIC yes CLEF2007.CHEMNITZ.CUT_DS_BILI_DE2RU_MERGE D_THES chemnitz Germany 10.2415/DS-BILI-X2RU- DS-BILI-X2RU-CLEF2007 en TD AUTOMATIC yes CLEF2007.CHEMNITZ.CUT_DS_BILI_EN2RU_MERGE D cheshire United States 10.2415/DS-BILI-X2RU- DS-BILI-X2RU-CLEF2007 de TD AUTOMATIC yes CLEF2007.CHESHIRE.BERKBDERUCCP15 cheshire United States 10.2415/DS-BILI-X2RU- DS-BILI-X2RU-CLEF2007 de TD AUTOMATIC yes CLEF2007.CHESHIRE.BERKBDERUTHP7 cheshire United States 10.2415/DS-BILI-X2RU- DS-BILI-X2RU-CLEF2007 en TD AUTOMATIC yes CLEF2007.CHESHIRE.BERKBENRUCCP15 cheshire United States 10.2415/DS-BILI-X2RU- DS-BILI-X2RU-CLEF2007 en TD AUTOMATIC yes CLEF2007.CHESHIRE.BERKBENRUTHP7 moscow Russian 10.2415/DS-BILI-X2RU- DS-BILI-X2RU-CLEF2007 en TD AUTOMATIC yes Federation CLEF2007.MOSCOW.CIRDSBILIEN2RU moscow Russian 10.2415/DS-BILI-X2RU- DS-BILI-X2RU-CLEF2007 en TD AUTOMATIC yes Federation CLEF2007.MOSCOW.CIRDSBILIEN2RU2 chemnitz Germany 10.2415/DS-MULTI- DS-MULTI-CLEF2007 de TD AUTOMATIC no CLEF2007.CHEMNITZ.CUT_DS_MULTI_DE2X_MERGE D chemnitz Germany 10.2415/DS-MULTI- DS-MULTI-CLEF2007 en TD AUTOMATIC no CLEF2007.CHEMNITZ.CUT_DS_MULTI_EN2X_MERGE D chemnitz Germany 10.2415/DS-MULTI- DS-MULTI-CLEF2007 ru TD AUTOMATIC no CLEF2007.CHEMNITZ.CUT_DS_MULTI_RU2X_MERGE D 10 Participant Country Experiment DOI Task Lang. Fields Constr. Pool cheshire United States 10.2415/DS-MULTI- DS-MULTI-CLEF2007 de TD AUTOMATIC no CLEF2007.CHESHIRE.BERKMUDEP15 cheshire United States 10.2415/DS-MULTI- DS-MULTI-CLEF2007 de TD AUTOMATIC no CLEF2007.CHESHIRE.BERKMUDETHP7 cheshire United States 10.2415/DS-MULTI- DS-MULTI-CLEF2007 en TD AUTOMATIC no CLEF2007.CHESHIRE.BERKMUENP15 cheshire United States 10.2415/DS-MULTI- DS-MULTI-CLEF2007 en TD AUTOMATIC no CLEF2007.CHESHIRE.BERKMUENTHP7 cheshire United States 10.2415/DS-MULTI- DS-MULTI-CLEF2007 ru TD AUTOMATIC no CLEF2007.CHESHIRE.BERKMURUP15 cheshire United States 10.2415/DS-MULTI- DS-MULTI-CLEF2007 ru TD AUTOMATIC no CLEF2007.CHESHIRE.BERKMURUTHP7 11 Track Overview Results and Graphs 12 13 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-DE-CLEF2007 Domain−Specific Monolingual German Task Top 5 Participants − Standard Recall Levels vs Mean Interpolated Precision 100% xerox [Experiment XRCEPRFLEDE; MAP 50.51%; Pooled] unine [Experiment UNINEDE4; MAP 36.04%; Pooled] 90% cheshire [Experiment BERKMDETHP7; MAP 31.99%; Pooled] chemnitz [Experiment CUT_DS_MONO_DE_MERGED; MAP 29.91%; Pooled] 80% 70% 60% Precision 50% 40% 30% 20% 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Monolingual German Task Top 5 Participants − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) 1 xerox [Experiment XRCEPRFLEDE; MAP 50.51%; Pooled] unine [Experiment UNINEDE4; MAP 36.04%; Pooled] cheshire [Experiment BERKMDETHP7; MAP 31.99%; Pooled] chemnitz [Experiment CUT_DS_MONO_DE_MERGED; MAP 29.91%; Pooled] 0.8 0.6 0.4 0.2 Difference 0 −0.2 −0.4 −0.6 −0.8 −1 176−DS177−DS178−DS179−DS180−DS181−DS182−DS183−DS184−DS185−DS186−DS187−DS188−DS189−DS190−DS191−DS192−DS193−DS194−DS195−DS196−DS197−DS198−DS199−DS200−DS Topic Identifier 14 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-DE-CLEF2007 Domain−Specific Monolingual German Task − Box Plot of the Topics xerox [Experiment XRCEPRFLEDE; MAP 50.51%; Pooled] xerox [Experiment XRCEPRFDELE; MAP 50.14%; Pooled] xerox [Experiment XRCEPRFDE; MAP 44.65%; Pooled] unine [Experiment UNINEDE4; MAP 36.04%; Pooled] unine [Experiment UNINEDE3; MAP 35.35%; Pooled] unine [Experiment UNINEDE2; MAP 35.31%; Pooled] Experiments xerox [Experiment XRCELEDE; MAP 34.75%; Pooled] unine [Experiment UNINEDE1; MAP 34.03%; Pooled] cheshire [Experiment BERKMDETHP7; MAP 31.99%; Pooled] cheshire [Experiment BERKMDECCP15; MAP 31.50%; Pooled] chemnitz [Experiment CUT_DS_MONO_DE_MERGED; MAP 29.91%; Pooled] chemnitz [Experiment CUT_DS_MONO_DE_UNSTRUCT; MAP 28.87%; Pooled] chemnitz [Experiment CUT_DS_MONO_DE_STRUCT; MAP 26.31%; Pooled] 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Average Precision 15 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-DE-CLEF2007 10.2455/TUKEY_T_TEST.67D6904A15764192AAB8A24F7DD2C621 Domain−Specific Monolingual German Task − Tukey T test with "top group" highlighted XRCEPRFLEDE XRCEPRFDELE XRCEPRFDE UNINEDE4 XRCELEDE UNINEDE2 Experiments UNINEDE3 UNINEDE1 BERKMDETHP7 BERKMDECCP15 CUT_DS_MONO_DE_MERGED CUT_DS_MONO_DE_UNSTRUCT CUT_DS_MONO_DE_STRUCT 0.4 0.45 0.5 0.55 0.6 0.65 0.7 0.75 0.8 0.85 0.9 arcsin(sqrt(Average Precsion)) 16 17 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-DE-CLEF2007 Domain−Specific Monolingual German Task Top 5 Participants − Retrieved documents vs Mean Precision 100% xerox [Experiment XRCEPRFLEDE; R−Prec 50.08%; Pooled] unine [Experiment UNINEDE4; R−Prec 39.61%; Pooled] 90% cheshire [Experiment BERKMDETHP7; R−Prec 35.75%; Pooled] chemnitz [Experiment CUT_DS_MONO_DE_MERGED; R−Prec 33.84%; Pooled] 80% 70% 60% Precision 50% 40% 30% 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Monolingual German Task Top 5 Participants − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) 1 xerox [Experiment XRCEPRFLEDE; R−Prec 50.08%; Pooled] unine [Experiment UNINEDE4; R−Prec 39.61%; Pooled] cheshire [Experiment BERKMDETHP7; R−Prec 35.75%; Pooled] chemnitz [Experiment CUT_DS_MONO_DE_MERGED; R−Prec 33.84%; Pooled] 0.8 0.6 0.4 0.2 Difference 0 −0.2 −0.4 −0.6 −0.8 −1 176−DS177−DS178−DS179−DS180−DS181−DS182−DS183−DS184−DS185−DS186−DS187−DS188−DS189−DS190−DS191−DS192−DS193−DS194−DS195−DS196−DS197−DS198−DS199−DS200−DS Topic Identifier 18 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-DE-CLEF2007 Domain−Specific Monolingual German Task − Box Plot of the Topics xerox [Experiment XRCEPRFLEDE; R−Prec 50.08%; Pooled] xerox [Experiment XRCEPRFDELE; R−Prec 48.85%; Pooled] xerox [Experiment XRCEPRFDE; R−Prec 44.90%; Pooled] unine [Experiment UNINEDE4; R−Prec 39.61%; Pooled] unine [Experiment UNINEDE3; R−Prec 38.45%; Pooled] unine [Experiment UNINEDE2; R−Prec 38.18%; Pooled] Experiments xerox [Experiment XRCELEDE; R−Prec 38.04%; Pooled] unine [Experiment UNINEDE1; R−Prec 37.31%; Pooled] cheshire [Experiment BERKMDETHP7; R−Prec 35.75%; Pooled] cheshire [Experiment BERKMDECCP15; R−Prec 34.91%; Pooled] chemnitz [Experiment CUT_DS_MONO_DE_MERGED; R−Prec 33.84%; Pooled] chemnitz [Experiment CUT_DS_MONO_DE_UNSTRUCT; R−Prec 32.97%; Pooled] chemnitz [Experiment CUT_DS_MONO_DE_STRUCT; R−Prec 30.37%; Pooled] 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% R−Precision 19 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-DE-CLEF2007 Domain−Specific Monolingual German Task − Tukey T test with "top group" highlighted XRCEPRFLEDE XRCEPRFDELE XRCEPRFDE UNINEDE4 XRCELEDE UNINEDE3 Experiments UNINEDE2 UNINEDE1 BERKMDETHP7 BERKMDECCP15 CUT_DS_MONO_DE_MERGED CUT_DS_MONO_DE_UNSTRUCT CUT_DS_MONO_DE_STRUCT 0.5 0.55 0.6 0.65 0.7 0.75 0.8 0.85 0.9 arcsin(sqrt(R−Precision)) 20 21 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-DE-CLEF2007 Statistics for Number of relevant retrieved documents Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 55.00 69.75 85.00 85.00 86.00 76.38 11.56 15.25 31.00 0.15 75.50 74.53 9.59 55.00 86.00 76.38 11.56 177-DS 51.00 55.75 57.00 59.50 64.00 57.46 3.55 3.75 13.00 0.06 57.36 57.26 2.65 51.00 64.00 57.46 3.55 178-DS 126.00 133.25 137.00 138.00 139.00 135.31 3.95 4.75 13.00 0.03 135.25 135.20 3.11 130.00 139.00 136.08 2.91 179-DS 114.00 122.75 124.00 125.00 125.00 123.15 3.05 2.25 11.00 0.02 123.12 123.08 1.96 121.00 125.00 123.92 1.38 180-DS 209.00 222.75 226.00 227.50 236.00 225.15 6.52 4.75 27.00 0.03 225.07 224.98 4.43 220.00 233.00 225.64 3.59 181-DS 35.00 41.00 42.00 42.25 44.00 41.54 2.26 1.25 9.00 0.05 41.48 41.41 1.41 40.00 44.00 42.08 1.16 182-DS 205.00 249.00 254.00 259.75 274.00 252.00 16.71 10.75 69.00 0.07 251.45 250.84 10.31 240.00 274.00 255.92 9.34 183-DS 48.00 76.50 85.00 126.00 151.00 95.92 34.31 49.50 103.00 0.36 90.42 85.20 27.75 48.00 151.00 95.92 34.31 184-DS 59.00 65.00 71.00 72.50 77.00 69.15 5.60 7.50 18.00 0.08 68.94 68.72 4.58 59.00 77.00 69.15 5.60 185-DS 27.00 52.75 62.00 66.50 76.00 58.15 14.45 13.75 49.00 0.25 55.97 53.14 10.71 52.00 76.00 63.45 6.99 186-DS 7.00 21.75 24.00 25.25 31.00 22.85 5.91 3.50 24.00 0.26 21.75 19.98 3.88 17.00 29.00 23.55 3.11 187-DS 43.00 52.00 56.00 58.25 64.00 54.85 5.27 6.25 21.00 0.10 54.60 54.35 4.01 43.00 64.00 54.85 5.27 188-DS 141.00 185.75 259.00 287.00 294.00 237.46 55.95 101.25 153.00 0.24 230.64 223.22 49.28 141.00 294.00 237.46 55.95 189-DS 37.00 41.75 46.00 49.25 52.00 45.62 4.48 7.50 15.00 0.10 45.41 45.19 3.64 37.00 52.00 45.62 4.48 190-DS 146.00 219.75 279.00 291.25 311.00 249.54 60.34 71.50 165.00 0.24 241.49 232.22 47.57 146.00 311.00 249.54 60.34 191-DS 26.00 27.75 30.00 33.25 35.00 30.38 3.01 5.50 9.00 0.10 30.25 30.11 2.57 26.00 35.00 30.38 3.01 192-DS 54.00 60.75 70.00 80.00 97.00 72.38 14.36 19.25 43.00 0.20 71.13 69.95 11.64 54.00 97.00 72.38 14.36 193-DS 83.00 105.75 132.00 198.75 220.00 142.62 49.06 93.00 137.00 0.34 135.41 129.05 41.31 83.00 220.00 142.62 49.06 194-DS 53.00 69.75 82.00 88.75 121.00 81.92 18.50 19.00 68.00 0.23 80.08 78.32 13.62 53.00 105.00 78.67 14.93 195-DS 253.00 281.00 304.00 310.25 334.00 296.85 24.01 29.25 81.00 0.08 295.92 294.95 18.83 253.00 334.00 296.85 24.01 196-DS 46.00 75.50 83.00 85.00 89.00 77.69 13.31 9.50 43.00 0.17 76.42 74.89 10.17 62.00 89.00 82.27 7.35 197-DS 136.00 147.50 164.00 168.75 172.00 159.15 12.59 21.25 36.00 0.08 158.68 158.18 10.40 136.00 172.00 159.15 12.59 198-DS 157.00 169.00 179.00 193.00 201.00 181.00 14.08 24.00 44.00 0.08 180.49 179.97 11.38 157.00 201.00 181.00 14.08 199-DS 47.00 53.75 78.00 81.00 81.00 69.00 14.83 27.25 34.00 0.21 67.39 65.68 13.69 47.00 81.00 69.00 14.83 200-DS 47.00 50.75 55.00 70.50 77.00 59.46 10.90 19.75 30.00 0.18 58.57 57.71 9.57 47.00 77.00 59.46 10.90 22 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-DE-CLEF2007 Statistics for Average Precsion Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.2887 0.3701 0.5395 0.8513 0.8565 0.6016 0.2450 0.4812 0.5678 0.4071 0.5530 0.5066 0.2281 0.2887 0.8565 0.6016 0.2450 177-DS 0.1577 0.1735 0.1764 0.1895 0.2371 0.1836 0.0222 0.0160 0.0794 0.1208 0.1824 0.1814 0.0161 0.1577 0.2095 0.1791 0.0159 178-DS 0.4597 0.6084 0.6927 0.7238 0.7707 0.6689 0.0894 0.1154 0.3110 0.1337 0.6627 0.6558 0.0692 0.4597 0.7707 0.6689 0.0894 179-DS 0.4087 0.4942 0.5128 0.5197 0.5506 0.5007 0.0373 0.0255 0.1419 0.0745 0.4993 0.4979 0.0264 0.4686 0.5506 0.5134 0.0205 180-DS 0.5658 0.6277 0.6604 0.6873 0.6977 0.6515 0.0435 0.0596 0.1319 0.0668 0.6501 0.6486 0.0348 0.5658 0.6977 0.6515 0.0435 181-DS 0.2274 0.3851 0.5932 0.6327 0.6785 0.5270 0.1512 0.2477 0.4511 0.2869 0.5016 0.4706 0.1272 0.2274 0.6785 0.5270 0.1512 182-DS 0.3027 0.4956 0.5602 0.6086 0.6732 0.5469 0.1003 0.1130 0.3705 0.1833 0.5369 0.5249 0.0718 0.4588 0.6732 0.5673 0.0713 183-DS 0.0331 0.0776 0.0948 0.2659 0.6104 0.2012 0.2200 0.1883 0.5774 1.0937 0.1262 0.0910 0.1756 0.0331 0.5358 0.1278 0.1401 184-DS 0.1885 0.2339 0.3844 0.4716 0.6841 0.3783 0.1553 0.2376 0.4957 0.4106 0.3489 0.3210 0.1217 0.1885 0.6841 0.3783 0.1553 185-DS 0.0112 0.0968 0.1144 0.1480 0.2849 0.1285 0.0784 0.0512 0.2737 0.6106 0.1010 0.0637 0.0545 0.0370 0.1490 0.1102 0.0362 186-DS 0.0124 0.0315 0.0433 0.0683 0.2541 0.0684 0.0681 0.0369 0.2416 0.9959 0.0497 0.0388 0.0451 0.0124 0.0738 0.0422 0.0179 187-DS 0.0732 0.0888 0.1116 0.1628 0.2528 0.1299 0.0541 0.0740 0.1796 0.4167 0.1210 0.1138 0.0422 0.0732 0.2528 0.1299 0.0541 188-DS 0.1215 0.2493 0.4033 0.5837 0.6389 0.4033 0.1855 0.3344 0.5174 0.4600 0.3547 0.3012 0.1545 0.1215 0.6389 0.4033 0.1855 189-DS 0.1151 0.1537 0.2210 0.2521 0.3139 0.2071 0.0635 0.0984 0.1988 0.3068 0.1978 0.1885 0.0528 0.1151 0.3139 0.2071 0.0635 190-DS 0.2066 0.3274 0.4815 0.5485 0.7309 0.4559 0.1667 0.2211 0.5243 0.3655 0.4246 0.3912 0.1326 0.2066 0.7309 0.4559 0.1667 191-DS 0.1060 0.1579 0.2248 0.2321 0.3192 0.2037 0.0627 0.0742 0.2133 0.3077 0.1937 0.1827 0.0475 0.1060 0.3192 0.2037 0.0627 192-DS 0.1433 0.1506 0.2136 0.3035 0.6654 0.2819 0.1862 0.1528 0.5221 0.6603 0.2407 0.2143 0.1442 0.1433 0.4809 0.2148 0.0967 193-DS 0.0822 0.1196 0.2341 0.5462 0.7143 0.3033 0.2298 0.4266 0.6321 0.7576 0.2332 0.1850 0.1948 0.0822 0.7143 0.3033 0.2298 194-DS 0.0336 0.0563 0.0881 0.1200 0.5213 0.1192 0.1271 0.0637 0.4877 1.0657 0.0891 0.0738 0.0730 0.0336 0.1648 0.0857 0.0412 195-DS 0.2846 0.4279 0.4932 0.5784 0.6056 0.4814 0.1069 0.1506 0.3210 0.2220 0.4690 0.4550 0.0824 0.2846 0.6056 0.4814 0.1069 196-DS 0.1858 0.3032 0.4708 0.5100 0.7419 0.4349 0.1628 0.2068 0.5561 0.3744 0.4026 0.3669 0.1223 0.1858 0.7419 0.4349 0.1628 197-DS 0.4952 0.5350 0.5417 0.5627 0.6543 0.5548 0.0425 0.0277 0.1591 0.0767 0.5533 0.5520 0.0300 0.4952 0.5826 0.5397 0.0223 198-DS 0.2838 0.3215 0.3949 0.4724 0.5814 0.4005 0.1019 0.1509 0.2976 0.2545 0.3892 0.3786 0.0834 0.2838 0.5814 0.4005 0.1019 199-DS 0.1346 0.3039 0.4743 0.5774 0.6570 0.4248 0.1768 0.2735 0.5223 0.4162 0.3795 0.3249 0.1450 0.1346 0.6570 0.4248 0.1768 200-DS 0.0697 0.0914 0.1057 0.1992 0.4332 0.1688 0.1179 0.1078 0.3635 0.6987 0.1410 0.1230 0.0898 0.0697 0.2381 0.1250 0.0537 23 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-DE-CLEF2007 Statistics for R-Precision Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.3371 0.3680 0.5056 0.7978 0.8090 0.5817 0.2063 0.4298 0.4719 0.3547 0.5468 0.5135 0.1925 0.3371 0.8090 0.5817 0.2063 177-DS 0.2121 0.2121 0.2273 0.2576 0.2879 0.2366 0.0259 0.0455 0.0758 0.1095 0.2353 0.2341 0.0217 0.2121 0.2879 0.2366 0.0259 178-DS 0.4500 0.6107 0.6714 0.6946 0.7071 0.6429 0.0767 0.0839 0.2571 0.1193 0.6380 0.6326 0.0582 0.5429 0.7071 0.6589 0.0525 179-DS 0.4524 0.4921 0.5159 0.5238 0.5873 0.5098 0.0309 0.0317 0.1349 0.0607 0.5089 0.5081 0.0212 0.4524 0.5238 0.5033 0.0213 180-DS 0.5738 0.6189 0.6516 0.6670 0.7008 0.6447 0.0406 0.0482 0.1270 0.0630 0.6435 0.6422 0.0317 0.5738 0.7008 0.6447 0.0406 181-DS 0.2955 0.4375 0.5455 0.5739 0.6818 0.5140 0.1142 0.1364 0.3864 0.2222 0.5009 0.4865 0.0912 0.2955 0.6818 0.5140 0.1142 182-DS 0.3701 0.5285 0.5943 0.6121 0.6441 0.5675 0.0712 0.0836 0.2740 0.1254 0.5626 0.5568 0.0511 0.5196 0.6441 0.5839 0.0411 183-DS 0.1274 0.1561 0.1847 0.3025 0.6433 0.2729 0.1942 0.1465 0.5159 0.7117 0.2279 0.2011 0.1553 0.1274 0.2166 0.1720 0.0288 184-DS 0.1625 0.2781 0.4125 0.4969 0.6500 0.3962 0.1470 0.2188 0.4875 0.3710 0.3675 0.3361 0.1182 0.1625 0.6500 0.3962 0.1470 185-DS 0.0460 0.1264 0.1839 0.2586 0.4253 0.2095 0.1178 0.1322 0.3793 0.5621 0.1771 0.1433 0.0913 0.0460 0.4253 0.2095 0.1178 186-DS 0.0286 0.0571 0.0857 0.1214 0.3143 0.1121 0.0944 0.0643 0.2857 0.8420 0.0875 0.0724 0.0673 0.0286 0.1429 0.0753 0.0320 187-DS 0.0725 0.1232 0.1739 0.2355 0.3043 0.1795 0.0728 0.1123 0.2319 0.4058 0.1647 0.1495 0.0595 0.0725 0.3043 0.1795 0.0728 188-DS 0.2507 0.3425 0.4090 0.5530 0.5910 0.4289 0.1204 0.2104 0.3403 0.2807 0.4123 0.3951 0.1004 0.2507 0.5910 0.4289 0.1204 189-DS 0.1538 0.2067 0.2308 0.2740 0.3654 0.2367 0.0584 0.0673 0.2115 0.2469 0.2302 0.2238 0.0448 0.1538 0.3654 0.2367 0.0584 190-DS 0.3173 0.3790 0.5128 0.5264 0.6923 0.4786 0.1163 0.1474 0.3750 0.2431 0.4652 0.4519 0.0930 0.3173 0.6923 0.4786 0.1163 191-DS 0.0833 0.2222 0.2500 0.2569 0.3333 0.2286 0.0710 0.0347 0.2500 0.3104 0.2135 0.1920 0.0477 0.2222 0.2778 0.2472 0.0205 192-DS 0.1515 0.1995 0.2727 0.3485 0.6364 0.3139 0.1608 0.1490 0.4848 0.5124 0.2817 0.2556 0.1177 0.1515 0.4545 0.2571 0.0893 193-DS 0.1787 0.2032 0.3404 0.5468 0.6553 0.3601 0.1760 0.3436 0.4766 0.4889 0.3232 0.2924 0.1450 0.1787 0.6553 0.3601 0.1760 194-DS 0.0813 0.0894 0.1057 0.1585 0.5772 0.1501 0.1324 0.0691 0.4959 0.8819 0.1255 0.1143 0.0740 0.0813 0.1789 0.1145 0.0339 195-DS 0.3114 0.4437 0.5139 0.5627 0.5975 0.4882 0.1037 0.1190 0.2861 0.2124 0.4762 0.4625 0.0804 0.3114 0.5975 0.4882 0.1037 196-DS 0.2921 0.3933 0.5056 0.5449 0.6854 0.4857 0.1158 0.1517 0.3933 0.2384 0.4719 0.4572 0.0884 0.2921 0.6854 0.4857 0.1158 197-DS 0.5075 0.5162 0.5224 0.5448 0.5920 0.5354 0.0298 0.0286 0.0846 0.0557 0.5347 0.5339 0.0231 0.5075 0.5821 0.5307 0.0256 198-DS 0.3377 0.3838 0.4386 0.5241 0.5614 0.4521 0.0794 0.1404 0.2237 0.1756 0.4456 0.4391 0.0699 0.3377 0.5614 0.4521 0.0794 199-DS 0.1358 0.3519 0.4938 0.5185 0.5926 0.4226 0.1514 0.1667 0.4568 0.3582 0.3862 0.3376 0.1200 0.1358 0.5926 0.4226 0.1514 200-DS 0.1294 0.1500 0.1647 0.2941 0.4706 0.2299 0.1119 0.1441 0.3412 0.4867 0.2093 0.1936 0.0911 0.1294 0.4706 0.2299 0.1119 24 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-DE-CLEF2007 Statistics for Binary Preference Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.2964 0.3421 0.4897 0.8582 0.8649 0.5950 0.2551 0.5162 0.5685 0.4288 0.5421 0.4931 0.2396 0.2964 0.8649 0.5950 0.2551 177-DS 0.1506 0.1614 0.1717 0.1824 0.1896 0.1713 0.0130 0.0211 0.0390 0.0756 0.1709 0.1704 0.0107 0.1506 0.1896 0.1713 0.0130 178-DS 0.4548 0.7102 0.7907 0.8159 0.8418 0.7392 0.1141 0.1057 0.3870 0.1544 0.7295 0.7179 0.0836 0.5885 0.8418 0.7629 0.0790 179-DS 0.4244 0.4798 0.4972 0.5086 0.6059 0.4981 0.0431 0.0287 0.1815 0.0865 0.4964 0.4948 0.0282 0.4560 0.5376 0.4950 0.0227 180-DS 0.7442 0.7714 0.8041 0.8152 0.8291 0.7926 0.0289 0.0438 0.0849 0.0364 0.7921 0.7916 0.0233 0.7442 0.8291 0.7926 0.0289 181-DS 0.2350 0.3813 0.5279 0.6001 0.6482 0.4935 0.1373 0.2188 0.4132 0.2782 0.4722 0.4475 0.1116 0.2350 0.6482 0.4935 0.1373 182-DS 0.5195 0.6552 0.7084 0.7514 0.7711 0.6965 0.0716 0.0963 0.2516 0.1028 0.6928 0.6887 0.0531 0.5195 0.7711 0.6965 0.0716 183-DS 0.0998 0.1342 0.1411 0.2935 0.6856 0.2550 0.2220 0.1593 0.5857 0.8707 0.1957 0.1652 0.1778 0.0998 0.1987 0.1394 0.0266 184-DS 0.1283 0.2041 0.3578 0.4523 0.6439 0.3475 0.1626 0.2482 0.5156 0.4679 0.3096 0.2722 0.1321 0.1283 0.6439 0.3475 0.1626 185-DS 0.0234 0.0785 0.1396 0.1555 0.3588 0.1487 0.1008 0.0770 0.3354 0.6779 0.1165 0.0835 0.0653 0.0234 0.1622 0.1121 0.0509 186-DS 0.0269 0.0420 0.0506 0.0753 0.2539 0.0768 0.0650 0.0333 0.2269 0.8465 0.0617 0.0533 0.0443 0.0269 0.0906 0.0519 0.0176 187-DS 0.0466 0.0841 0.0998 0.1724 0.2296 0.1220 0.0579 0.0883 0.1829 0.4749 0.1093 0.0974 0.0492 0.0466 0.2296 0.1220 0.0579 188-DS 0.2351 0.3445 0.4955 0.7066 0.8059 0.5234 0.1980 0.3621 0.5708 0.3783 0.4851 0.4455 0.1667 0.2351 0.8059 0.5234 0.1980 189-DS 0.0987 0.1505 0.2008 0.2069 0.3018 0.1873 0.0555 0.0564 0.2030 0.2962 0.1795 0.1715 0.0418 0.0987 0.2552 0.1777 0.0455 190-DS 0.3789 0.5759 0.6984 0.7711 0.8508 0.6601 0.1653 0.1952 0.4719 0.2504 0.6375 0.6115 0.1282 0.3789 0.8508 0.6601 0.1653 191-DS 0.0810 0.1813 0.2052 0.2226 0.2847 0.1941 0.0574 0.0413 0.2037 0.2955 0.1835 0.1695 0.0399 0.1698 0.2438 0.2076 0.0212 192-DS 0.1345 0.1680 0.2280 0.3038 0.6468 0.2805 0.1718 0.1358 0.5123 0.6125 0.2437 0.2181 0.1304 0.1345 0.4426 0.2182 0.0869 193-DS 0.1898 0.2432 0.3260 0.6776 0.8226 0.4156 0.2371 0.4344 0.6328 0.5705 0.3621 0.3221 0.2035 0.1898 0.8226 0.4156 0.2371 194-DS 0.0549 0.0596 0.0689 0.1163 0.5821 0.1170 0.1420 0.0566 0.5272 1.2138 0.0875 0.0769 0.0724 0.0549 0.1211 0.0782 0.0260 195-DS 0.5188 0.6377 0.6920 0.7221 0.7518 0.6678 0.0801 0.0844 0.2330 0.1200 0.6629 0.6577 0.0614 0.5188 0.7518 0.6678 0.0801 196-DS 0.2277 0.3110 0.4720 0.5139 0.7200 0.4445 0.1434 0.2029 0.4922 0.3226 0.4211 0.3962 0.1087 0.2277 0.7200 0.4445 0.1434 197-DS 0.6143 0.6199 0.6343 0.6534 0.7148 0.6429 0.0319 0.0335 0.1005 0.0496 0.6422 0.6415 0.0241 0.6143 0.6859 0.6369 0.0244 198-DS 0.4484 0.4831 0.5524 0.5795 0.6713 0.5409 0.0727 0.0964 0.2228 0.1345 0.5364 0.5321 0.0602 0.4484 0.6713 0.5409 0.0727 199-DS 0.1195 0.3112 0.4377 0.5224 0.6103 0.4005 0.1653 0.2111 0.4908 0.4127 0.3569 0.3019 0.1303 0.1195 0.6103 0.4005 0.1653 200-DS 0.0825 0.0992 0.1125 0.2090 0.4238 0.1705 0.1099 0.1098 0.3413 0.6446 0.1467 0.1311 0.0834 0.0825 0.3668 0.1493 0.0828 25 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-DE-CLEF2007 Statistics for Precision at the 0% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 0.0000 0.0000 0.0000 0.0000 1.0000 1.0000 0.0000 1.0000 1.0000 1.0000 0.0000 177-DS 0.5000 0.7667 1.0000 1.0000 1.0000 0.8949 0.1752 0.2333 0.5000 0.1958 0.8756 0.8525 0.1456 0.5000 1.0000 0.8949 0.1752 178-DS 0.9200 1.0000 1.0000 1.0000 1.0000 0.9938 0.0222 0.0000 0.0800 0.0223 0.9936 0.9934 0.0114 1.0000 1.0000 1.0000 0.0000 179-DS 0.6512 0.7332 0.7857 1.0000 1.0000 0.8377 0.1426 0.2668 0.3488 0.1702 0.8265 0.8155 0.1248 0.6512 1.0000 0.8377 0.1426 180-DS 0.9091 1.0000 1.0000 1.0000 1.0000 0.9873 0.0312 0.0000 0.0909 0.0316 0.9868 0.9863 0.0215 1.0000 1.0000 1.0000 0.0000 181-DS 0.8000 1.0000 1.0000 1.0000 1.0000 0.9846 0.0555 0.0000 0.2000 0.0563 0.9830 0.9811 0.0284 1.0000 1.0000 1.0000 0.0000 182-DS 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 0.0000 0.0000 0.0000 0.0000 1.0000 1.0000 0.0000 1.0000 1.0000 1.0000 0.0000 183-DS 0.1778 0.3293 0.3548 0.7500 1.0000 0.5492 0.3010 0.4207 0.8222 0.5481 0.4756 0.4122 0.2622 0.1778 1.0000 0.5492 0.3010 184-DS 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 0.0000 0.0000 0.0000 0.0000 1.0000 1.0000 0.0000 1.0000 1.0000 1.0000 0.0000 185-DS 0.0612 0.2444 0.3077 0.7045 1.0000 0.4828 0.3350 0.4601 0.9388 0.6940 0.3707 0.2628 0.2793 0.0612 1.0000 0.4828 0.3350 186-DS 0.1250 0.1667 0.2500 0.3750 1.0000 0.3302 0.2386 0.2083 0.8750 0.7228 0.2756 0.2392 0.1622 0.1250 0.5385 0.2743 0.1339 187-DS 0.4000 0.5000 0.5714 1.0000 1.0000 0.7286 0.2639 0.5000 0.6000 0.3623 0.6838 0.6420 0.2505 0.4000 1.0000 0.7286 0.2639 188-DS 0.6000 0.8397 1.0000 1.0000 1.0000 0.9143 0.1458 0.1603 0.4000 0.1595 0.9018 0.8874 0.1186 0.6000 1.0000 0.9143 0.1458 189-DS 0.7500 1.0000 1.0000 1.0000 1.0000 0.9698 0.0769 0.0000 0.2500 0.0793 0.9666 0.9630 0.0511 1.0000 1.0000 1.0000 0.0000 190-DS 0.8333 1.0000 1.0000 1.0000 1.0000 0.9872 0.0462 0.0000 0.1667 0.0468 0.9861 0.9848 0.0237 1.0000 1.0000 1.0000 0.0000 191-DS 0.4615 1.0000 1.0000 1.0000 1.0000 0.9329 0.1690 0.0000 0.5385 0.1811 0.9133 0.8864 0.1135 1.0000 1.0000 1.0000 0.0000 192-DS 0.7500 1.0000 1.0000 1.0000 1.0000 0.9808 0.0693 0.0000 0.2500 0.0707 0.9781 0.9750 0.0355 1.0000 1.0000 1.0000 0.0000 193-DS 0.6667 0.9500 1.0000 1.0000 1.0000 0.9397 0.1178 0.0500 0.3333 0.1253 0.9319 0.9231 0.0927 1.0000 1.0000 1.0000 0.0000 194-DS 0.1463 0.1696 0.2941 1.0000 1.0000 0.5161 0.4044 0.8304 0.8537 0.7836 0.3717 0.2766 0.3722 0.1463 1.0000 0.5161 0.4044 195-DS 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 0.0000 0.0000 0.0000 0.0000 1.0000 1.0000 0.0000 1.0000 1.0000 1.0000 0.0000 196-DS 0.8000 1.0000 1.0000 1.0000 1.0000 0.9692 0.0751 0.0000 0.2000 0.0775 0.9663 0.9630 0.0521 1.0000 1.0000 1.0000 0.0000 197-DS 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 0.0000 0.0000 0.0000 0.0000 1.0000 1.0000 0.0000 1.0000 1.0000 1.0000 0.0000 198-DS 0.6774 0.8705 1.0000 1.0000 1.0000 0.9418 0.1016 0.1295 0.3226 0.1078 0.9360 0.9295 0.0806 0.6774 1.0000 0.9418 0.1016 199-DS 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 0.0000 0.0000 0.0000 0.0000 1.0000 1.0000 0.0000 1.0000 1.0000 1.0000 0.0000 200-DS 0.5000 1.0000 1.0000 1.0000 1.0000 0.9423 0.1498 0.0000 0.5000 0.1590 0.9273 0.9070 0.0976 1.0000 1.0000 1.0000 0.0000 26 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-DE-CLEF2007 Statistics for Precision at the 10% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.5000 0.9861 1.0000 1.0000 1.0000 0.9530 0.1377 0.0139 0.5000 0.1445 0.9398 0.9208 0.0723 1.0000 1.0000 1.0000 0.0000 177-DS 0.3103 0.3600 0.3889 0.4252 0.5385 0.3984 0.0582 0.0652 0.2281 0.1462 0.3947 0.3913 0.0418 0.3103 0.4667 0.3867 0.0421 178-DS 0.7727 0.8940 0.9200 0.9375 0.9524 0.9062 0.0482 0.0435 0.1797 0.0532 0.9049 0.9035 0.0328 0.8571 0.9524 0.9173 0.0279 179-DS 0.6296 0.6771 0.7222 0.7537 0.8824 0.7245 0.0644 0.0766 0.2527 0.0888 0.7220 0.7195 0.0451 0.6296 0.7647 0.7114 0.0454 180-DS 0.8857 0.9000 0.9259 0.9615 1.0000 0.9311 0.0350 0.0615 0.1143 0.0376 0.9305 0.9299 0.0287 0.8857 1.0000 0.9311 0.0350 181-DS 0.5000 0.8036 1.0000 1.0000 1.0000 0.8901 0.1752 0.1964 0.5000 0.1968 0.8705 0.8469 0.1404 0.6000 1.0000 0.9226 0.1360 182-DS 0.6154 0.7436 0.7692 0.8280 0.9429 0.7906 0.0953 0.0844 0.3275 0.1205 0.7854 0.7802 0.0682 0.7083 0.9429 0.8052 0.0830 183-DS 0.1429 0.2376 0.2909 0.5090 0.8235 0.3884 0.2476 0.2714 0.6807 0.6375 0.3278 0.2824 0.1959 0.1429 0.8235 0.3884 0.2476 184-DS 0.4706 0.7875 0.8889 0.9559 1.0000 0.8436 0.1689 0.1684 0.5294 0.2003 0.8243 0.8007 0.1263 0.7500 1.0000 0.9058 0.0804 185-DS 0.0362 0.1595 0.2778 0.3791 0.6061 0.3028 0.1695 0.2195 0.5699 0.5597 0.2489 0.1772 0.1276 0.0362 0.6061 0.3028 0.1695 186-DS 0.0122 0.0559 0.0816 0.1534 0.5385 0.1369 0.1452 0.0975 0.5262 1.0603 0.0911 0.0595 0.1003 0.0122 0.2000 0.0835 0.0505 187-DS 0.0935 0.1754 0.2059 0.3312 0.4500 0.2471 0.1167 0.1558 0.3565 0.4721 0.2220 0.1983 0.0942 0.0935 0.4500 0.2471 0.1167 188-DS 0.3776 0.6793 0.8732 0.9461 1.0000 0.7937 0.2113 0.2667 0.6224 0.2662 0.7611 0.7217 0.1670 0.3776 1.0000 0.7937 0.2113 189-DS 0.1667 0.3325 0.5000 0.7083 0.8571 0.4930 0.2194 0.3758 0.6905 0.4450 0.4422 0.3884 0.1746 0.1667 0.8571 0.4930 0.2194 190-DS 0.6190 0.7269 0.8148 0.8473 0.9114 0.7907 0.0878 0.1204 0.2923 0.1110 0.7860 0.7810 0.0695 0.6190 0.9114 0.7907 0.0878 191-DS 0.1000 0.4423 0.8000 0.8000 1.0000 0.6294 0.2992 0.3577 0.9000 0.4753 0.5197 0.3650 0.2453 0.1000 1.0000 0.6294 0.2992 192-DS 0.3571 0.5000 0.5652 0.7844 1.0000 0.6369 0.2172 0.2844 0.6429 0.3411 0.6052 0.5766 0.1728 0.3571 1.0000 0.6369 0.2172 193-DS 0.3165 0.3764 0.7353 0.8683 0.9655 0.6464 0.2512 0.4919 0.6491 0.3887 0.5972 0.5485 0.2220 0.3165 0.9655 0.6464 0.2512 194-DS 0.0984 0.1204 0.1451 0.2098 0.6857 0.2025 0.1582 0.0894 0.5874 0.7813 0.1711 0.1539 0.0966 0.0984 0.3256 0.1622 0.0656 195-DS 0.6147 0.8643 0.9091 0.9727 1.0000 0.8884 0.1172 0.1085 0.3853 0.1319 0.8803 0.8711 0.0824 0.8400 1.0000 0.9312 0.0557 196-DS 0.4231 0.5990 0.6667 0.7192 1.0000 0.6778 0.1558 0.1203 0.5769 0.2298 0.6617 0.6458 0.1097 0.4231 0.8000 0.6275 0.1029 197-DS 0.8974 0.9679 0.9773 1.0000 1.0000 0.9735 0.0286 0.0321 0.1026 0.0294 0.9731 0.9727 0.0190 0.9444 1.0000 0.9798 0.0179 198-DS 0.6389 0.6765 0.7317 0.8366 0.9259 0.7523 0.1042 0.1602 0.2870 0.1385 0.7460 0.7401 0.0851 0.6389 0.9259 0.7523 0.1042 199-DS 0.4737 0.7088 0.8182 0.9333 1.0000 0.8099 0.1649 0.2245 0.5263 0.2037 0.7922 0.7722 0.1318 0.4737 1.0000 0.8099 0.1649 200-DS 0.1500 0.1884 0.2439 0.4068 1.0000 0.3608 0.2694 0.2184 0.8500 0.7466 0.2964 0.2573 0.1997 0.1500 0.5625 0.2611 0.1198 27 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-DE-CLEF2007 Statistics for Precision at the 20% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.5000 0.8665 0.9565 1.0000 1.0000 0.9046 0.1442 0.1335 0.5000 0.1594 0.8909 0.8730 0.1016 0.7317 1.0000 0.9383 0.0810 177-DS 0.2283 0.2337 0.2500 0.2842 0.3182 0.2621 0.0308 0.0506 0.0899 0.1173 0.2605 0.2589 0.0272 0.2283 0.3182 0.2621 0.0308 178-DS 0.7500 0.8201 0.8864 0.8975 0.9200 0.8583 0.0570 0.0773 0.1700 0.0664 0.8565 0.8546 0.0458 0.7500 0.9200 0.8583 0.0570 179-DS 0.6279 0.6577 0.6829 0.6994 0.7429 0.6834 0.0328 0.0417 0.1150 0.0480 0.6827 0.6820 0.0243 0.6279 0.7429 0.6834 0.0328 180-DS 0.7778 0.8289 0.8611 0.8979 0.9444 0.8613 0.0461 0.0690 0.1667 0.0535 0.8601 0.8590 0.0365 0.7778 0.9444 0.8613 0.0461 181-DS 0.4286 0.6780 0.9000 1.0000 1.0000 0.8300 0.1882 0.3220 0.5714 0.2267 0.8063 0.7780 0.1526 0.4286 1.0000 0.8300 0.1882 182-DS 0.5607 0.6537 0.7595 0.8070 0.8923 0.7447 0.1057 0.1533 0.3316 0.1419 0.7377 0.7305 0.0826 0.5607 0.8923 0.7447 0.1057 183-DS 0.0857 0.1532 0.1762 0.3553 0.8235 0.3038 0.2729 0.2020 0.7378 0.8982 0.2266 0.1852 0.2188 0.0857 0.2237 0.1616 0.0400 184-DS 0.1694 0.3177 0.6071 0.7649 0.9500 0.5628 0.2751 0.4472 0.7806 0.4889 0.4888 0.4110 0.2309 0.1694 0.9500 0.5628 0.2751 185-DS 0.0333 0.0852 0.1739 0.2763 0.6061 0.2322 0.1860 0.1911 0.5728 0.8009 0.1716 0.1228 0.1375 0.0333 0.2778 0.1642 0.0920 186-DS 0.0075 0.0491 0.0741 0.0894 0.5385 0.1210 0.1465 0.0403 0.5310 1.2102 0.0757 0.0445 0.0954 0.0075 0.1077 0.0647 0.0268 187-DS 0.0935 0.1566 0.1807 0.2761 0.3830 0.2125 0.0898 0.1195 0.2895 0.4228 0.1956 0.1797 0.0745 0.0935 0.3830 0.2125 0.0898 188-DS 0.3088 0.5679 0.7701 0.9285 0.9775 0.7270 0.2354 0.3606 0.6688 0.3238 0.6831 0.6314 0.1905 0.3088 0.9775 0.7270 0.2354 189-DS 0.1553 0.2110 0.3077 0.4196 0.7333 0.3363 0.1651 0.2086 0.5780 0.4910 0.3031 0.2744 0.1230 0.1553 0.5000 0.3032 0.1193 190-DS 0.5431 0.6434 0.8101 0.8473 0.9114 0.7539 0.1297 0.2038 0.3683 0.1720 0.7428 0.7311 0.1131 0.5431 0.9114 0.7539 0.1297 191-DS 0.0840 0.2776 0.4211 0.5000 0.6154 0.3723 0.1638 0.2224 0.5314 0.4400 0.3233 0.2573 0.1352 0.0840 0.6154 0.3723 0.1638 192-DS 0.1420 0.2377 0.3774 0.5022 0.9643 0.4328 0.2773 0.2645 0.8223 0.6408 0.3604 0.3017 0.2078 0.1420 0.7586 0.3396 0.1738 193-DS 0.1588 0.2127 0.4211 0.8224 0.9398 0.4823 0.2993 0.6097 0.7810 0.6204 0.3994 0.3322 0.2484 0.1588 0.9398 0.4823 0.2993 194-DS 0.0727 0.1143 0.1419 0.1581 0.6852 0.1753 0.1577 0.0438 0.6125 0.8997 0.1451 0.1302 0.0852 0.0727 0.2195 0.1329 0.0393 195-DS 0.5603 0.7590 0.8737 0.9223 0.9778 0.8356 0.1255 0.1633 0.4175 0.1502 0.8260 0.8154 0.1008 0.5603 0.9778 0.8356 0.1255 196-DS 0.3818 0.5000 0.6111 0.6947 0.9200 0.6117 0.1466 0.1947 0.5382 0.2397 0.5954 0.5791 0.1096 0.3818 0.9200 0.6117 0.1466 197-DS 0.8654 0.9500 0.9773 0.9802 1.0000 0.9573 0.0383 0.0302 0.1346 0.0400 0.9565 0.9558 0.0275 0.9362 1.0000 0.9712 0.0180 198-DS 0.5000 0.5511 0.5974 0.7441 0.9020 0.6507 0.1345 0.1930 0.4020 0.2067 0.6388 0.6278 0.1086 0.5000 0.9020 0.6507 0.1345 199-DS 0.0809 0.4812 0.6071 0.7668 0.9167 0.5802 0.2680 0.2856 0.8358 0.4619 0.4754 0.3165 0.1987 0.0809 0.9167 0.5802 0.2680 200-DS 0.1010 0.1604 0.1789 0.3406 0.8182 0.2828 0.2128 0.1803 0.7172 0.7527 0.2325 0.2013 0.1538 0.1010 0.3425 0.2026 0.0812 28 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-DE-CLEF2007 Statistics for Precision at the 30% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.4026 0.6304 0.7317 0.9732 1.0000 0.7794 0.2187 0.3427 0.5974 0.2806 0.7468 0.7106 0.1870 0.4026 1.0000 0.7794 0.2187 177-DS 0.1783 0.1991 0.2245 0.2356 0.2717 0.2209 0.0274 0.0364 0.0934 0.1242 0.2193 0.2177 0.0218 0.1783 0.2717 0.2209 0.0274 178-DS 0.6667 0.8036 0.8462 0.8901 0.9200 0.8342 0.0729 0.0865 0.2533 0.0874 0.8310 0.8277 0.0538 0.7500 0.9200 0.8481 0.0551 179-DS 0.5789 0.6180 0.6418 0.6548 0.6780 0.6347 0.0305 0.0368 0.0990 0.0481 0.6340 0.6333 0.0243 0.5789 0.6780 0.6347 0.0305 180-DS 0.7184 0.8192 0.8496 0.8617 0.8837 0.8317 0.0487 0.0425 0.1653 0.0586 0.8303 0.8288 0.0354 0.8115 0.8837 0.8499 0.0213 181-DS 0.2917 0.6250 0.7895 0.8768 1.0000 0.7240 0.2047 0.2518 0.7083 0.2827 0.6895 0.6458 0.1596 0.2917 1.0000 0.7240 0.2047 182-DS 0.4009 0.6376 0.7328 0.7850 0.8614 0.7078 0.1233 0.1475 0.4604 0.1742 0.6960 0.6818 0.0900 0.6028 0.8614 0.7334 0.0855 183-DS 0.0502 0.1053 0.1244 0.3446 0.7869 0.2681 0.2862 0.2393 0.7367 1.0675 0.1742 0.1301 0.2296 0.0502 0.2094 0.1188 0.0427 184-DS 0.1684 0.2656 0.4800 0.6824 0.9000 0.4940 0.2566 0.4167 0.7316 0.5194 0.4248 0.3567 0.2106 0.1684 0.9000 0.4940 0.2566 185-DS 0.0278 0.0695 0.1638 0.2474 0.5094 0.1890 0.1514 0.1779 0.4817 0.8008 0.1369 0.0942 0.1116 0.0278 0.5094 0.1890 0.1514 186-DS 0.0000 0.0350 0.0560 0.0747 0.4074 0.0974 0.1222 0.0397 0.4074 1.2545 0.0355 0.0001 0.0825 0.0000 0.0764 0.0486 0.0238 187-DS 0.0935 0.1196 0.1628 0.1976 0.3134 0.1714 0.0690 0.0780 0.2199 0.4023 0.1600 0.1500 0.0510 0.0935 0.3134 0.1714 0.0690 188-DS 0.1747 0.4087 0.5667 0.8595 0.9633 0.5940 0.2886 0.4508 0.7886 0.4860 0.5150 0.4294 0.2382 0.1747 0.9633 0.5940 0.2886 189-DS 0.1404 0.1482 0.1700 0.2553 0.4571 0.2159 0.0913 0.1071 0.3168 0.4230 0.2018 0.1909 0.0686 0.1404 0.3065 0.1958 0.0580 190-DS 0.3534 0.4957 0.7231 0.7880 0.8796 0.6542 0.1834 0.2923 0.5262 0.2803 0.6270 0.5971 0.1591 0.3534 0.8796 0.6542 0.1834 191-DS 0.0585 0.1522 0.2167 0.2296 0.4074 0.1944 0.0898 0.0774 0.3489 0.4619 0.1724 0.1471 0.0620 0.0585 0.2373 0.1766 0.0658 192-DS 0.1152 0.1471 0.2727 0.4262 0.8684 0.3529 0.2608 0.2791 0.7532 0.7391 0.2819 0.2326 0.1983 0.1152 0.8333 0.3100 0.2192 193-DS 0.0997 0.1702 0.3719 0.7731 0.9398 0.4297 0.3108 0.6028 0.8400 0.7233 0.3315 0.2579 0.2605 0.0997 0.9398 0.4297 0.3108 194-DS 0.0617 0.1089 0.1419 0.1499 0.6852 0.1718 0.1593 0.0409 0.6235 0.9273 0.1398 0.1233 0.0863 0.0617 0.1567 0.1208 0.0321 195-DS 0.3218 0.5387 0.7437 0.8311 0.9528 0.6819 0.2277 0.2924 0.6309 0.3340 0.6384 0.5881 0.1820 0.3218 0.9528 0.6819 0.2277 196-DS 0.1531 0.4853 0.5667 0.6716 0.8824 0.5605 0.1887 0.1862 0.7293 0.3366 0.5202 0.4625 0.1349 0.3214 0.8824 0.5945 0.1500 197-DS 0.7848 0.8570 0.9000 0.9694 0.9759 0.9019 0.0645 0.1124 0.1911 0.0715 0.8997 0.8975 0.0521 0.7848 0.9759 0.9019 0.0645 198-DS 0.3730 0.4503 0.5820 0.6627 0.8750 0.5820 0.1634 0.2125 0.5020 0.2807 0.5619 0.5431 0.1300 0.3730 0.8750 0.5820 0.1634 199-DS 0.0641 0.4187 0.5208 0.6566 0.8621 0.4930 0.2489 0.2379 0.7980 0.5049 0.3892 0.2474 0.1800 0.0641 0.8621 0.4930 0.2489 200-DS 0.0843 0.1220 0.1469 0.2784 0.6667 0.2363 0.1833 0.1564 0.5823 0.7758 0.1911 0.1637 0.1363 0.0843 0.3421 0.1672 0.0756 29 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-DE-CLEF2007 Statistics for Precision at the 40% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.2449 0.3226 0.6667 0.9732 0.9744 0.6723 0.3112 0.6506 0.7295 0.4629 0.5930 0.5117 0.2750 0.2449 0.9744 0.6723 0.3112 177-DS 0.1534 0.1656 0.1837 0.1879 0.2231 0.1805 0.0197 0.0223 0.0697 0.1093 0.1795 0.1786 0.0148 0.1534 0.2042 0.1770 0.0157 178-DS 0.4958 0.7790 0.8077 0.8602 0.8889 0.7904 0.1051 0.0812 0.3931 0.1330 0.7826 0.7730 0.0690 0.6786 0.8889 0.8150 0.0592 179-DS 0.5100 0.5542 0.5644 0.5935 0.6628 0.5736 0.0392 0.0394 0.1528 0.0683 0.5724 0.5713 0.0287 0.5100 0.6207 0.5662 0.0299 180-DS 0.6346 0.8106 0.8361 0.8496 0.8673 0.8094 0.0730 0.0390 0.2326 0.0902 0.8059 0.8022 0.0494 0.8080 0.8673 0.8384 0.0179 181-DS 0.1570 0.4829 0.6667 0.7679 0.8571 0.6065 0.2314 0.2851 0.7001 0.3815 0.5460 0.4645 0.1836 0.1570 0.8571 0.6065 0.2314 182-DS 0.3392 0.5727 0.7063 0.7595 0.8248 0.6651 0.1310 0.1868 0.4856 0.1969 0.6504 0.6319 0.0990 0.3392 0.8248 0.6651 0.1310 183-DS 0.0000 0.0924 0.1086 0.3201 0.7412 0.2384 0.2796 0.2278 0.7412 1.1729 0.0413 0.0001 0.2223 0.0000 0.1988 0.0939 0.0589 184-DS 0.1441 0.2466 0.4384 0.5847 0.8140 0.4392 0.2229 0.3381 0.6699 0.5075 0.3805 0.3218 0.1788 0.1441 0.8140 0.4392 0.2229 185-DS 0.0000 0.0695 0.1042 0.2248 0.4353 0.1577 0.1424 0.1553 0.4353 0.9032 0.0341 0.0001 0.1074 0.0000 0.4353 0.1577 0.1424 186-DS 0.0000 0.0330 0.0400 0.0640 0.3167 0.0748 0.0888 0.0310 0.3167 1.1861 0.0295 0.0001 0.0585 0.0000 0.0725 0.0403 0.0192 187-DS 0.0786 0.0892 0.1241 0.1710 0.2788 0.1440 0.0688 0.0818 0.2003 0.4782 0.1312 0.1210 0.0534 0.0786 0.2788 0.1440 0.0688 188-DS 0.1416 0.2806 0.4141 0.6934 0.8766 0.4800 0.2529 0.4128 0.7351 0.5269 0.4118 0.3445 0.2145 0.1416 0.8766 0.4800 0.2529 189-DS 0.0946 0.1334 0.1560 0.2324 0.2692 0.1733 0.0554 0.0989 0.1746 0.3195 0.1654 0.1581 0.0453 0.0946 0.2692 0.1733 0.0554 190-DS 0.1903 0.3291 0.5943 0.6965 0.7683 0.5139 0.2163 0.3674 0.5780 0.4208 0.4596 0.3975 0.1813 0.1903 0.7683 0.5139 0.2163 191-DS 0.0387 0.0906 0.1127 0.1473 0.2830 0.1206 0.0620 0.0567 0.2444 0.5140 0.1070 0.0936 0.0423 0.0387 0.1698 0.1071 0.0399 192-DS 0.0820 0.1391 0.2000 0.3108 0.7636 0.2862 0.2400 0.1717 0.6817 0.8388 0.2199 0.1799 0.1870 0.0820 0.5556 0.2002 0.1275 193-DS 0.0000 0.1293 0.2611 0.6945 0.8991 0.3628 0.3141 0.5651 0.8991 0.8657 0.1324 0.0001 0.2641 0.0000 0.8991 0.3628 0.3141 194-DS 0.0547 0.1002 0.1333 0.1436 0.6538 0.1639 0.1528 0.0434 0.5992 0.9319 0.1326 0.1163 0.0839 0.0547 0.1497 0.1143 0.0314 195-DS 0.3194 0.4997 0.6023 0.7299 0.8316 0.5959 0.1786 0.2302 0.5122 0.2997 0.5672 0.5351 0.1408 0.3194 0.8316 0.5959 0.1786 196-DS 0.0981 0.3760 0.5522 0.6353 0.8085 0.5081 0.2107 0.2594 0.7104 0.4146 0.4483 0.3628 0.1616 0.0981 0.8085 0.5081 0.2107 197-DS 0.6560 0.7287 0.7664 0.9348 0.9759 0.8139 0.1113 0.2061 0.3199 0.1368 0.8070 0.8002 0.0978 0.6560 0.9759 0.8139 0.1113 198-DS 0.3262 0.3888 0.5111 0.6180 0.7333 0.5040 0.1407 0.2292 0.4071 0.2792 0.4861 0.4691 0.1183 0.3262 0.7333 0.5040 0.1407 199-DS 0.0533 0.3236 0.5000 0.5848 0.7907 0.4361 0.2273 0.2612 0.7374 0.5213 0.3369 0.2059 0.1761 0.0533 0.7907 0.4361 0.2273 200-DS 0.0689 0.1063 0.1250 0.1870 0.5397 0.1807 0.1408 0.0807 0.4708 0.7793 0.1489 0.1305 0.0975 0.0689 0.2112 0.1259 0.0403 30 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-DE-CLEF2007 Statistics for Precision at the 50% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.1297 0.2458 0.5294 0.9192 0.9574 0.5871 0.3355 0.6734 0.8278 0.5714 0.4780 0.3706 0.3052 0.1297 0.9574 0.5871 0.3355 177-DS 0.1189 0.1293 0.1447 0.1553 0.2036 0.1470 0.0228 0.0260 0.0847 0.1549 0.1455 0.1441 0.0160 0.1189 0.1710 0.1423 0.0158 178-DS 0.4142 0.7345 0.7889 0.8108 0.8571 0.7489 0.1223 0.0764 0.4429 0.1633 0.7371 0.7219 0.0811 0.7320 0.8571 0.7941 0.0432 179-DS 0.3953 0.4952 0.5289 0.5437 0.6500 0.5221 0.0565 0.0486 0.2547 0.1082 0.5192 0.5162 0.0375 0.4884 0.5575 0.5219 0.0242 180-DS 0.5882 0.7302 0.7771 0.8126 0.8378 0.7588 0.0785 0.0824 0.2496 0.1035 0.7547 0.7503 0.0589 0.6219 0.8378 0.7730 0.0621 181-DS 0.1090 0.3864 0.5946 0.7338 0.8148 0.5425 0.2344 0.3475 0.7058 0.4321 0.4721 0.3776 0.1945 0.1090 0.8148 0.5425 0.2344 182-DS 0.2940 0.5498 0.6400 0.7083 0.7421 0.6168 0.1202 0.1586 0.4481 0.1949 0.6026 0.5834 0.0859 0.5277 0.7421 0.6437 0.0742 183-DS 0.0000 0.0598 0.0927 0.2973 0.7288 0.2175 0.2762 0.2374 0.7288 1.2701 0.0190 0.0000 0.2190 0.0000 0.6328 0.1259 0.1775 184-DS 0.1291 0.2296 0.3761 0.5108 0.7885 0.3857 0.1970 0.2812 0.6593 0.5106 0.3376 0.2910 0.1548 0.1291 0.7885 0.3857 0.1970 185-DS 0.0000 0.0695 0.0888 0.1646 0.3761 0.1311 0.1145 0.0951 0.3761 0.8736 0.0300 0.0001 0.0857 0.0000 0.1818 0.0899 0.0597 186-DS 0.0000 0.0256 0.0334 0.0552 0.3167 0.0671 0.0920 0.0296 0.3167 1.3705 0.0139 0.0001 0.0609 0.0000 0.0621 0.0311 0.0191 187-DS 0.0739 0.0857 0.1019 0.1579 0.2387 0.1201 0.0513 0.0722 0.1648 0.4273 0.1118 0.1054 0.0416 0.0739 0.2387 0.1201 0.0513 188-DS 0.0000 0.1615 0.3534 0.6297 0.7384 0.3688 0.2637 0.4681 0.7384 0.7151 0.0376 0.0000 0.2152 0.0000 0.7384 0.3688 0.2637 189-DS 0.0788 0.1057 0.1307 0.1830 0.2680 0.1463 0.0575 0.0774 0.1893 0.3926 0.1369 0.1285 0.0446 0.0788 0.2680 0.1463 0.0575 190-DS 0.0000 0.2956 0.5182 0.5587 0.7429 0.4233 0.2388 0.2631 0.7429 0.5642 0.0896 0.0001 0.1927 0.0000 0.7429 0.4233 0.2388 191-DS 0.0367 0.0704 0.0817 0.1115 0.1714 0.0930 0.0429 0.0411 0.1347 0.4611 0.0842 0.0756 0.0323 0.0367 0.1714 0.0930 0.0429 192-DS 0.0566 0.1089 0.1488 0.2634 0.7391 0.2386 0.2229 0.1545 0.6825 0.9342 0.1738 0.1376 0.1709 0.0566 0.4464 0.1565 0.1047 193-DS 0.0000 0.0000 0.1772 0.6113 0.8310 0.2661 0.3273 0.6113 0.8310 1.2298 0.0030 0.0000 0.2771 0.0000 0.8310 0.2661 0.3273 194-DS 0.0000 0.0841 0.1202 0.1329 0.6408 0.1481 0.1561 0.0488 0.6408 1.0542 0.0621 0.0001 0.0868 0.0707 0.1416 0.1065 0.0247 195-DS 0.3006 0.4430 0.5351 0.6276 0.7122 0.5221 0.1350 0.1846 0.4116 0.2587 0.5035 0.4829 0.1039 0.3006 0.7122 0.5221 0.1350 196-DS 0.0503 0.2683 0.5172 0.5721 0.7727 0.4548 0.2240 0.3038 0.7224 0.4926 0.3704 0.2488 0.1787 0.0503 0.7727 0.4548 0.2240 197-DS 0.5206 0.5530 0.5580 0.6610 0.8707 0.6149 0.1036 0.1080 0.3501 0.1685 0.6078 0.6014 0.0787 0.5206 0.7594 0.5936 0.0726 198-DS 0.2372 0.3031 0.3872 0.5406 0.6264 0.4198 0.1384 0.2375 0.3892 0.3296 0.3984 0.3776 0.1208 0.2372 0.6264 0.4198 0.1384 199-DS 0.0494 0.2063 0.5000 0.5368 0.6721 0.3967 0.2169 0.3305 0.6228 0.5468 0.2977 0.1790 0.1835 0.0494 0.6721 0.3967 0.2169 200-DS 0.0567 0.0773 0.0929 0.1500 0.4388 0.1443 0.1197 0.0727 0.3820 0.8295 0.1153 0.0990 0.0865 0.0567 0.1982 0.0981 0.0399 31 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-DE-CLEF2007 Statistics for Precision at the 60% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0605 0.1707 0.4186 0.8594 0.8730 0.4973 0.3604 0.6887 0.8125 0.7247 0.3427 0.2143 0.3354 0.0605 0.8730 0.4973 0.3604 177-DS 0.0993 0.1092 0.1166 0.1303 0.1655 0.1232 0.0201 0.0211 0.0663 0.1628 0.1218 0.1205 0.0152 0.0993 0.1538 0.1196 0.0162 178-DS 0.3691 0.6659 0.7521 0.7706 0.8317 0.6943 0.1358 0.1047 0.4626 0.1955 0.6790 0.6599 0.1009 0.5638 0.8317 0.7421 0.0708 179-DS 0.3812 0.4314 0.4724 0.5144 0.5923 0.4740 0.0555 0.0830 0.2111 0.1171 0.4710 0.4682 0.0438 0.3812 0.5923 0.4740 0.0555 180-DS 0.5547 0.6404 0.6944 0.7475 0.7914 0.6833 0.0751 0.1071 0.2367 0.1099 0.6794 0.6752 0.0567 0.5547 0.7914 0.6833 0.0751 181-DS 0.0864 0.2400 0.5094 0.5891 0.7317 0.4369 0.2244 0.3492 0.6454 0.5137 0.3634 0.2787 0.1916 0.0864 0.7317 0.4369 0.2244 182-DS 0.2564 0.4915 0.6041 0.6256 0.6654 0.5539 0.1107 0.1341 0.4089 0.1998 0.5402 0.5215 0.0822 0.4580 0.6654 0.5787 0.0681 183-DS 0.0000 0.0000 0.0000 0.2619 0.6934 0.1640 0.2668 0.2619 0.6934 1.6263 0.0005 0.0000 0.2113 0.0000 0.6333 0.1199 0.2237 184-DS 0.1116 0.1801 0.2634 0.3981 0.7000 0.3141 0.1738 0.2180 0.5884 0.5534 0.2731 0.2373 0.1360 0.1116 0.7000 0.3141 0.1738 185-DS 0.0000 0.0427 0.0867 0.1269 0.1773 0.0835 0.0592 0.0843 0.1773 0.7094 0.0121 0.0000 0.0470 0.0000 0.1773 0.0835 0.0592 186-DS 0.0000 0.0233 0.0282 0.0368 0.2958 0.0565 0.0840 0.0135 0.2958 1.4870 0.0116 0.0001 0.0551 0.0227 0.0369 0.0292 0.0052 187-DS 0.0461 0.0739 0.0807 0.1182 0.1727 0.0968 0.0380 0.0443 0.1266 0.3923 0.0908 0.0855 0.0296 0.0461 0.1727 0.0968 0.0380 188-DS 0.0000 0.0000 0.3241 0.5120 0.5776 0.2939 0.2287 0.5120 0.5776 0.7782 0.0155 0.0000 0.1933 0.0000 0.5776 0.2939 0.2287 189-DS 0.0574 0.0821 0.1119 0.1379 0.2105 0.1158 0.0451 0.0558 0.1531 0.3890 0.1081 0.1009 0.0365 0.0574 0.2105 0.1158 0.0451 190-DS 0.0000 0.2262 0.4437 0.4715 0.7059 0.3665 0.2336 0.2453 0.7059 0.6373 0.0388 0.0000 0.1801 0.0000 0.7059 0.3665 0.2336 191-DS 0.0367 0.0599 0.0712 0.0874 0.1009 0.0717 0.0206 0.0275 0.0642 0.2867 0.0686 0.0651 0.0155 0.0367 0.1009 0.0717 0.0206 192-DS 0.0000 0.0823 0.1064 0.2187 0.6703 0.1972 0.2220 0.1364 0.6703 1.1260 0.0373 0.0001 0.1694 0.0000 0.3974 0.1153 0.1053 193-DS 0.0000 0.0000 0.0000 0.4861 0.7360 0.1825 0.2914 0.4861 0.7360 1.5972 0.0003 0.0000 0.2526 0.0000 0.7360 0.1825 0.2914 194-DS 0.0000 0.0000 0.0925 0.1159 0.5474 0.1007 0.1515 0.1159 0.5474 1.5040 0.0018 0.0000 0.0942 0.0000 0.2176 0.0635 0.0733 195-DS 0.2684 0.3711 0.4407 0.5292 0.5985 0.4401 0.1112 0.1581 0.3301 0.2527 0.4258 0.4106 0.0866 0.2684 0.5985 0.4401 0.1112 196-DS 0.0000 0.2171 0.4538 0.5252 0.7632 0.4012 0.2288 0.3082 0.7632 0.5703 0.1628 0.0001 0.1804 0.0000 0.7632 0.4012 0.2288 197-DS 0.3487 0.3844 0.4172 0.4825 0.5913 0.4394 0.0787 0.0980 0.2426 0.1791 0.4333 0.4278 0.0640 0.3487 0.5913 0.4394 0.0787 198-DS 0.1997 0.2358 0.2968 0.4429 0.5415 0.3409 0.1143 0.2071 0.3418 0.3351 0.3234 0.3069 0.0984 0.1997 0.5415 0.3409 0.1143 199-DS 0.0000 0.0806 0.4623 0.5025 0.6071 0.3375 0.2305 0.4219 0.6071 0.6830 0.1230 0.0001 0.2094 0.0000 0.6071 0.3375 0.2305 200-DS 0.0000 0.0387 0.0618 0.1267 0.3377 0.0962 0.0991 0.0881 0.3377 1.0299 0.0121 0.0000 0.0720 0.0000 0.2419 0.0761 0.0704 32 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-DE-CLEF2007 Statistics for Precision at the 70% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0910 0.3889 0.8396 0.8667 0.4408 0.3827 0.7486 0.8667 0.8681 0.0374 0.0000 0.3534 0.0000 0.8667 0.4408 0.3827 177-DS 0.0682 0.0767 0.0950 0.1051 0.1655 0.0985 0.0270 0.0283 0.0973 0.2740 0.0955 0.0928 0.0188 0.0682 0.1281 0.0929 0.0187 178-DS 0.2816 0.5295 0.6689 0.7001 0.7424 0.6057 0.1404 0.1706 0.4608 0.2318 0.5864 0.5619 0.1105 0.2816 0.7424 0.6057 0.1404 179-DS 0.3699 0.4046 0.4198 0.4269 0.5562 0.4247 0.0449 0.0223 0.1863 0.1057 0.4227 0.4210 0.0268 0.3958 0.4279 0.4133 0.0115 180-DS 0.4613 0.5124 0.5797 0.6417 0.7095 0.5820 0.0775 0.1293 0.2482 0.1332 0.5773 0.5725 0.0632 0.4613 0.7095 0.5820 0.0775 181-DS 0.0864 0.1559 0.4306 0.5547 0.5849 0.3719 0.1979 0.3988 0.4986 0.5320 0.3084 0.2426 0.1761 0.0864 0.5849 0.3719 0.1979 182-DS 0.2091 0.4320 0.5265 0.5513 0.5858 0.4867 0.1046 0.1194 0.3767 0.2150 0.4725 0.4526 0.0773 0.3870 0.5858 0.5099 0.0660 183-DS 0.0000 0.0000 0.0000 0.2191 0.6011 0.1367 0.2383 0.2191 0.6011 1.7437 0.0003 0.0000 0.1892 0.0000 0.4382 0.0531 0.1350 184-DS 0.0875 0.1456 0.1993 0.2986 0.5490 0.2296 0.1321 0.1530 0.4615 0.5751 0.1992 0.1736 0.0988 0.0875 0.3889 0.2030 0.0948 185-DS 0.0000 0.0000 0.0670 0.0895 0.1245 0.0583 0.0443 0.0895 0.1245 0.7588 0.0051 0.0000 0.0359 0.0000 0.1245 0.0583 0.0443 186-DS 0.0000 0.0000 0.0000 0.0281 0.1025 0.0221 0.0329 0.0281 0.1025 1.4865 0.0005 0.0000 0.0238 0.0000 0.0285 0.0098 0.0137 187-DS 0.0000 0.0610 0.0708 0.0929 0.1424 0.0760 0.0341 0.0319 0.1424 0.4488 0.0396 0.0001 0.0231 0.0594 0.1126 0.0768 0.0194 188-DS 0.0000 0.0000 0.2830 0.4235 0.4485 0.2315 0.1989 0.4235 0.4485 0.8588 0.0065 0.0000 0.1781 0.0000 0.4485 0.2315 0.1989 189-DS 0.0430 0.0540 0.0710 0.1015 0.1659 0.0861 0.0385 0.0475 0.1229 0.4476 0.0791 0.0732 0.0303 0.0430 0.1659 0.0861 0.0385 190-DS 0.0000 0.1958 0.3904 0.4249 0.6909 0.3359 0.2223 0.2291 0.6909 0.6618 0.0361 0.0000 0.1665 0.0000 0.6909 0.3359 0.2223 191-DS 0.0316 0.0350 0.0459 0.0679 0.0870 0.0533 0.0201 0.0329 0.0554 0.3767 0.0500 0.0471 0.0172 0.0316 0.0870 0.0533 0.0201 192-DS 0.0000 0.0000 0.0738 0.1458 0.5263 0.1288 0.1893 0.1458 0.5263 1.4693 0.0019 0.0000 0.1418 0.0000 0.2710 0.0579 0.0840 193-DS 0.0000 0.0000 0.0000 0.3953 0.5810 0.1485 0.2364 0.3953 0.5810 1.5916 0.0003 0.0000 0.2056 0.0000 0.5810 0.1485 0.2364 194-DS 0.0000 0.0000 0.0000 0.0305 0.4350 0.0571 0.1278 0.0305 0.4350 2.2392 0.0001 0.0000 0.0878 0.0000 0.0000 0.0000 0.0000 195-DS 0.0000 0.2332 0.3588 0.4173 0.4956 0.2971 0.1759 0.1842 0.4956 0.5920 0.0335 0.0000 0.1371 0.0000 0.4956 0.2971 0.1759 196-DS 0.0000 0.1831 0.4114 0.4649 0.6702 0.3356 0.2160 0.2818 0.6702 0.6437 0.0361 0.0000 0.1718 0.0000 0.6702 0.3356 0.2160 197-DS 0.0000 0.1961 0.3126 0.3302 0.4352 0.2718 0.1153 0.1341 0.4352 0.4242 0.1280 0.0001 0.0868 0.0000 0.4352 0.2718 0.1153 198-DS 0.0000 0.1886 0.2204 0.3314 0.4156 0.2536 0.1161 0.1428 0.4156 0.4577 0.1194 0.0001 0.0929 0.0000 0.4156 0.2536 0.1161 199-DS 0.0000 0.0000 0.3718 0.4359 0.5614 0.2702 0.2310 0.4359 0.5614 0.8549 0.0071 0.0000 0.2078 0.0000 0.5614 0.2702 0.2310 200-DS 0.0000 0.0000 0.0000 0.1128 0.1869 0.0569 0.0718 0.1128 0.1869 1.2617 0.0007 0.0000 0.0613 0.0000 0.1869 0.0569 0.0718 33 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-DE-CLEF2007 Statistics for Precision at the 80% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0561 0.3318 0.8005 0.8372 0.4123 0.3777 0.7445 0.8372 0.9161 0.0330 0.0000 0.3524 0.0000 0.8372 0.4123 0.3777 177-DS 0.0000 0.0627 0.0804 0.0907 0.1294 0.0773 0.0329 0.0280 0.1294 0.4261 0.0404 0.0001 0.0231 0.0552 0.1294 0.0837 0.0244 178-DS 0.2025 0.4473 0.5685 0.6158 0.6707 0.5115 0.1495 0.1685 0.4681 0.2923 0.4848 0.4507 0.1159 0.2025 0.6707 0.5115 0.1495 179-DS 0.3333 0.3594 0.3662 0.3820 0.4764 0.3783 0.0367 0.0226 0.1431 0.0971 0.3768 0.3754 0.0247 0.3333 0.3930 0.3650 0.0153 180-DS 0.3121 0.3926 0.4289 0.4700 0.5584 0.4329 0.0614 0.0774 0.2463 0.1419 0.4288 0.4246 0.0468 0.3121 0.5584 0.4329 0.0614 181-DS 0.0000 0.1023 0.3600 0.3822 0.4800 0.2652 0.1624 0.2799 0.4800 0.6122 0.1090 0.0001 0.1439 0.0000 0.4800 0.2652 0.1624 182-DS 0.0000 0.3588 0.4253 0.4566 0.4935 0.3838 0.1283 0.0977 0.4935 0.3342 0.1817 0.0001 0.0839 0.2972 0.4935 0.4157 0.0587 183-DS 0.0000 0.0000 0.0000 0.0707 0.4773 0.0935 0.1828 0.0707 0.4773 1.9563 0.0001 0.0000 0.1438 0.0000 0.0000 0.0000 0.0000 184-DS 0.0000 0.0735 0.1285 0.1420 0.3598 0.1264 0.1010 0.0685 0.3598 0.7993 0.0164 0.0000 0.0656 0.0000 0.1625 0.0931 0.0618 185-DS 0.0000 0.0000 0.0000 0.0000 0.0960 0.0130 0.0321 0.0000 0.0960 2.4666 0.0000 0.0000 0.0221 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0000 0.0000 0.0722 0.0102 0.0250 0.0000 0.0722 2.4521 0.0000 0.0000 0.0173 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.0000 0.0561 0.0639 0.1141 0.0382 0.0395 0.0639 0.1141 1.0332 0.0012 0.0000 0.0353 0.0000 0.1141 0.0382 0.0395 188-DS 0.0000 0.0000 0.0000 0.3247 0.3791 0.1306 0.1726 0.3247 0.3791 1.3217 0.0006 0.0000 0.1608 0.0000 0.3791 0.1306 0.1726 189-DS 0.0000 0.0319 0.0650 0.0818 0.1500 0.0631 0.0450 0.0500 0.1500 0.7127 0.0098 0.0000 0.0330 0.0000 0.1500 0.0631 0.0450 190-DS 0.0000 0.0000 0.3133 0.3879 0.6284 0.2350 0.2425 0.3879 0.6284 1.0318 0.0031 0.0000 0.2169 0.0000 0.6284 0.2350 0.2425 191-DS 0.0000 0.0000 0.0341 0.0506 0.0593 0.0310 0.0233 0.0506 0.0593 0.7520 0.0033 0.0000 0.0194 0.0000 0.0593 0.0310 0.0233 192-DS 0.0000 0.0000 0.0000 0.0528 0.4167 0.0794 0.1582 0.0528 0.4167 1.9908 0.0001 0.0000 0.1222 0.0000 0.0000 0.0000 0.0000 193-DS 0.0000 0.0000 0.0000 0.2740 0.4821 0.1178 0.1914 0.2740 0.4821 1.6247 0.0003 0.0000 0.1631 0.0000 0.4821 0.1178 0.1914 194-DS 0.0000 0.0000 0.0000 0.0261 0.2886 0.0417 0.0884 0.0261 0.2886 2.1212 0.0001 0.0000 0.0641 0.0000 0.0000 0.0000 0.0000 195-DS 0.0000 0.0000 0.0000 0.0000 0.4142 0.0565 0.1393 0.0000 0.4142 2.4643 0.0001 0.0000 0.0956 0.0000 0.0000 0.0000 0.0000 196-DS 0.0000 0.1367 0.2590 0.3940 0.5573 0.2568 0.1787 0.2573 0.5573 0.6957 0.0288 0.0000 0.1446 0.0000 0.5573 0.2568 0.1787 197-DS 0.0000 0.0000 0.1693 0.2160 0.2274 0.1232 0.1032 0.2160 0.2274 0.8373 0.0044 0.0000 0.0948 0.0000 0.2274 0.1232 0.1032 198-DS 0.0000 0.0000 0.0000 0.2240 0.3205 0.1152 0.1336 0.2240 0.3205 1.1595 0.0011 0.0000 0.1241 0.0000 0.3205 0.1152 0.1336 199-DS 0.0000 0.0000 0.2941 0.3936 0.5328 0.2357 0.2069 0.3936 0.5328 0.8778 0.0065 0.0000 0.1824 0.0000 0.5328 0.2357 0.2069 200-DS 0.0000 0.0000 0.0000 0.0762 0.1354 0.0305 0.0495 0.0762 0.1354 1.6219 0.0002 0.0000 0.0422 0.0000 0.1354 0.0305 0.0495 34 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-DE-CLEF2007 Statistics for Precision at the 90% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.2005 0.7364 0.7455 0.3516 0.3672 0.7364 0.7455 1.0444 0.0038 0.0000 0.3478 0.0000 0.7455 0.3516 0.3672 177-DS 0.0000 0.0000 0.0000 0.0191 0.0930 0.0190 0.0363 0.0191 0.0930 1.9109 0.0001 0.0000 0.0292 0.0000 0.0000 0.0000 0.0000 178-DS 0.1277 0.2624 0.4131 0.4766 0.5408 0.3722 0.1327 0.2143 0.4131 0.3566 0.3441 0.3097 0.1078 0.1277 0.5408 0.3722 0.1327 179-DS 0.1427 0.2747 0.3083 0.3300 0.3403 0.2909 0.0534 0.0553 0.1976 0.1836 0.2849 0.2767 0.0382 0.2468 0.3403 0.3032 0.0308 180-DS 0.0000 0.2387 0.2686 0.3015 0.3226 0.2532 0.0823 0.0628 0.3226 0.3251 0.1242 0.0001 0.0490 0.2229 0.3226 0.2743 0.0328 181-DS 0.0000 0.0593 0.1533 0.3299 0.4396 0.1795 0.1413 0.2706 0.4396 0.7872 0.0712 0.0001 0.1174 0.0000 0.4396 0.1795 0.1413 182-DS 0.0000 0.0000 0.2663 0.3194 0.3640 0.1888 0.1586 0.3194 0.3640 0.8400 0.0057 0.0000 0.1453 0.0000 0.3640 0.1888 0.1586 183-DS 0.0000 0.0000 0.0000 0.0000 0.3303 0.0469 0.1151 0.0000 0.3303 2.4507 0.0000 0.0000 0.0795 0.0000 0.0000 0.0000 0.0000 184-DS 0.0000 0.0000 0.0000 0.0833 0.2892 0.0537 0.0877 0.0833 0.2892 1.6342 0.0004 0.0000 0.0661 0.0000 0.1562 0.0341 0.0542 185-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.0000 0.0000 0.0000 0.0875 0.0067 0.0243 0.0000 0.0875 3.6056 0.0000 0.0000 0.0124 0.0000 0.0000 0.0000 0.0000 188-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 189-DS 0.0000 0.0000 0.0000 0.0575 0.0820 0.0300 0.0347 0.0575 0.0820 1.1575 0.0006 0.0000 0.0323 0.0000 0.0820 0.0300 0.0347 190-DS 0.0000 0.0000 0.0000 0.3230 0.5802 0.1829 0.2213 0.3230 0.5802 1.2100 0.0013 0.0000 0.1969 0.0000 0.5802 0.1829 0.2213 191-DS 0.0000 0.0000 0.0000 0.0371 0.0479 0.0127 0.0199 0.0371 0.0479 1.5731 0.0001 0.0000 0.0175 0.0000 0.0479 0.0127 0.0199 192-DS 0.0000 0.0000 0.0000 0.0303 0.3061 0.0506 0.1034 0.0303 0.3061 2.0430 0.0001 0.0000 0.0779 0.0000 0.0000 0.0000 0.0000 193-DS 0.0000 0.0000 0.0000 0.0000 0.3392 0.0453 0.1122 0.0000 0.3392 2.4736 0.0000 0.0000 0.0767 0.0000 0.0000 0.0000 0.0000 194-DS 0.0000 0.0000 0.0000 0.0000 0.1944 0.0150 0.0539 0.0000 0.1944 3.6056 0.0000 0.0000 0.0276 0.0000 0.0000 0.0000 0.0000 195-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 196-DS 0.0000 0.0000 0.1171 0.2832 0.4880 0.1677 0.1578 0.2832 0.4880 0.9410 0.0097 0.0000 0.1362 0.0000 0.4880 0.1677 0.1578 197-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 198-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 199-DS 0.0000 0.0000 0.2085 0.3464 0.4066 0.1806 0.1648 0.3464 0.4066 0.9128 0.0054 0.0000 0.1464 0.0000 0.4066 0.1806 0.1648 200-DS 0.0000 0.0000 0.0000 0.0000 0.0770 0.0059 0.0214 0.0000 0.0770 3.6056 0.0000 0.0000 0.0109 0.0000 0.0000 0.0000 0.0000 35 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-DE-CLEF2007 Statistics for Precision at the 100% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 177-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 180-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 181-DS 0.0000 0.0000 0.0000 0.0000 0.1679 0.0223 0.0553 0.0000 0.1679 2.4765 0.0000 0.0000 0.0378 0.0000 0.0000 0.0000 0.0000 182-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 183-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 184-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 185-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 188-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 189-DS 0.0000 0.0000 0.0000 0.0000 0.0537 0.0041 0.0149 0.0000 0.0537 3.6056 0.0000 0.0000 0.0076 0.0000 0.0000 0.0000 0.0000 190-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 193-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 194-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 195-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 196-DS 0.0000 0.0000 0.0000 0.0000 0.2094 0.0315 0.0769 0.0000 0.2094 2.4417 0.0000 0.0000 0.0533 0.0000 0.0000 0.0000 0.0000 197-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 198-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 199-DS 0.0000 0.0000 0.0000 0.1058 0.2368 0.0605 0.0895 0.1058 0.2368 1.4806 0.0004 0.0000 0.0744 0.0000 0.2368 0.0605 0.0895 200-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 36 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-DE-CLEF2007 Statistics for P@5 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.8000 1.0000 1.0000 1.0000 1.0000 0.9692 0.0751 0.0000 0.2000 0.0775 0.9663 0.9630 0.0521 1.0000 1.0000 1.0000 0.0000 177-DS 0.4000 0.4000 0.4000 0.6000 0.8000 0.4769 0.1301 0.2000 0.4000 0.2728 0.4633 0.4522 0.1065 0.4000 0.8000 0.4769 0.1301 178-DS 0.4000 0.6000 1.0000 1.0000 1.0000 0.8308 0.2136 0.4000 0.6000 0.2572 0.8004 0.7647 0.1822 0.4000 1.0000 0.8308 0.2136 179-DS 0.0000 0.5500 0.6000 0.8000 0.8000 0.5846 0.2230 0.2500 0.8000 0.3815 0.2642 0.0001 0.1467 0.4000 0.8000 0.6333 0.1435 180-DS 0.8000 0.8000 1.0000 1.0000 1.0000 0.9385 0.0961 0.2000 0.2000 0.1024 0.9336 0.9286 0.0852 0.8000 1.0000 0.9385 0.0961 181-DS 0.6000 0.8000 1.0000 1.0000 1.0000 0.8923 0.1552 0.2000 0.4000 0.1740 0.8780 0.8619 0.1325 0.6000 1.0000 0.8923 0.1552 182-DS 0.4000 0.6000 0.8000 1.0000 1.0000 0.7846 0.1908 0.4000 0.6000 0.2432 0.7602 0.7324 0.1444 0.4000 1.0000 0.7846 0.1908 183-DS 0.0000 0.0000 0.2000 0.6000 1.0000 0.3231 0.3113 0.6000 1.0000 0.9636 0.0154 0.0000 0.2556 0.0000 1.0000 0.3231 0.3113 184-DS 0.6000 0.8000 1.0000 1.0000 1.0000 0.8769 0.1536 0.2000 0.4000 0.1751 0.8631 0.8478 0.1325 0.6000 1.0000 0.8769 0.1536 185-DS 0.0000 0.0000 0.2000 0.4500 0.6000 0.2615 0.2501 0.4500 0.6000 0.9564 0.0067 0.0000 0.2201 0.0000 0.6000 0.2615 0.2501 186-DS 0.0000 0.0000 0.2000 0.2500 0.4000 0.1846 0.1519 0.2500 0.4000 0.8229 0.0111 0.0000 0.1136 0.0000 0.4000 0.1846 0.1519 187-DS 0.2000 0.2000 0.2000 0.4000 0.8000 0.3385 0.1895 0.2000 0.6000 0.5598 0.2997 0.2713 0.1491 0.2000 0.6000 0.3000 0.1348 188-DS 0.6000 0.7500 0.8000 1.0000 1.0000 0.8308 0.1601 0.2500 0.4000 0.1927 0.8157 0.8000 0.1302 0.6000 1.0000 0.8308 0.1601 189-DS 0.2000 0.6000 0.6000 0.8000 0.8000 0.6154 0.1725 0.2000 0.6000 0.2803 0.5839 0.5379 0.1136 0.4000 0.8000 0.6500 0.1243 190-DS 0.2000 0.7500 0.8000 0.8000 0.8000 0.7231 0.1739 0.0500 0.6000 0.2406 0.6879 0.6240 0.1183 0.8000 0.8000 0.8000 0.0000 191-DS 0.4000 0.4000 0.8000 0.8000 1.0000 0.6769 0.2242 0.4000 0.6000 0.3312 0.6400 0.6023 0.1941 0.4000 1.0000 0.6769 0.2242 192-DS 0.6000 0.6000 0.8000 1.0000 1.0000 0.8154 0.1725 0.4000 0.4000 0.2115 0.7978 0.7800 0.1420 0.6000 1.0000 0.8154 0.1725 193-DS 0.6000 0.6000 0.8000 0.8000 1.0000 0.7692 0.1377 0.2000 0.4000 0.1791 0.7578 0.7464 0.1041 0.6000 1.0000 0.7692 0.1377 194-DS 0.0000 0.0000 0.0000 0.2000 0.8000 0.1538 0.2332 0.2000 0.8000 1.5155 0.0011 0.0000 0.1657 0.0000 0.4000 0.1000 0.1348 195-DS 0.8000 1.0000 1.0000 1.0000 1.0000 0.9692 0.0751 0.0000 0.2000 0.0775 0.9663 0.9630 0.0521 1.0000 1.0000 1.0000 0.0000 196-DS 0.4000 0.6000 0.8000 0.8500 1.0000 0.7692 0.1797 0.2500 0.6000 0.2337 0.7472 0.7222 0.1349 0.4000 1.0000 0.7692 0.1797 197-DS 0.8000 1.0000 1.0000 1.0000 1.0000 0.9692 0.0751 0.0000 0.2000 0.0775 0.9663 0.9630 0.0521 1.0000 1.0000 1.0000 0.0000 198-DS 0.0000 0.8000 0.8000 1.0000 1.0000 0.8000 0.2582 0.2000 1.0000 0.3227 0.3595 0.0001 0.1231 0.8000 1.0000 0.8667 0.0985 199-DS 0.8000 0.8000 1.0000 1.0000 1.0000 0.9231 0.1013 0.2000 0.2000 0.1097 0.9178 0.9123 0.0947 0.8000 1.0000 0.9231 0.1013 200-DS 0.2000 0.4000 0.6000 0.6500 1.0000 0.5538 0.2184 0.2500 0.8000 0.3943 0.5129 0.4699 0.1728 0.2000 1.0000 0.5538 0.2184 37 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-DE-CLEF2007 Statistics for P@10 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.7000 0.9000 1.0000 1.0000 1.0000 0.9538 0.0877 0.1000 0.3000 0.0919 0.9496 0.9446 0.0639 0.9000 1.0000 0.9750 0.0452 177-DS 0.3000 0.4000 0.4000 0.4000 0.5000 0.4000 0.0577 0.0000 0.2000 0.1443 0.3960 0.3920 0.0308 0.4000 0.4000 0.4000 0.0000 178-DS 0.7000 0.8000 0.8000 1.0000 1.0000 0.8615 0.1121 0.2000 0.3000 0.1301 0.8548 0.8480 0.0970 0.7000 1.0000 0.8615 0.1121 179-DS 0.4000 0.6000 0.7000 0.7250 0.8000 0.6615 0.1193 0.1250 0.4000 0.1803 0.6503 0.6375 0.0935 0.5000 0.8000 0.6833 0.0937 180-DS 0.8000 0.8750 1.0000 1.0000 1.0000 0.9308 0.0855 0.1250 0.2000 0.0918 0.9270 0.9231 0.0746 0.8000 1.0000 0.9308 0.0855 181-DS 0.4000 0.6750 0.9000 0.9250 1.0000 0.8077 0.1847 0.2500 0.6000 0.2286 0.7841 0.7555 0.1456 0.4000 1.0000 0.8077 0.1847 182-DS 0.4000 0.6500 0.8000 0.9000 1.0000 0.7538 0.1941 0.2500 0.6000 0.2575 0.7275 0.6982 0.1574 0.4000 1.0000 0.7538 0.1941 183-DS 0.0000 0.1000 0.2000 0.5250 0.7000 0.3077 0.2362 0.4250 0.7000 0.7675 0.1174 0.0001 0.2083 0.0000 0.7000 0.3077 0.2362 184-DS 0.6000 0.7750 0.8000 0.9000 0.9000 0.7923 0.1038 0.1250 0.3000 0.1310 0.7855 0.7781 0.0734 0.6000 0.9000 0.7923 0.1038 185-DS 0.0000 0.1000 0.2000 0.4000 0.4000 0.2308 0.1548 0.3000 0.4000 0.6710 0.0963 0.0001 0.1408 0.0000 0.4000 0.2308 0.1548 186-DS 0.1000 0.1000 0.2000 0.2000 0.5000 0.1769 0.1092 0.1000 0.4000 0.6172 0.1558 0.1413 0.0710 0.1000 0.2000 0.1500 0.0522 187-DS 0.1000 0.2000 0.3000 0.4000 0.5000 0.2923 0.1115 0.2000 0.4000 0.3815 0.2705 0.2461 0.0864 0.1000 0.5000 0.2923 0.1115 188-DS 0.5000 0.6500 0.9000 0.9250 1.0000 0.8000 0.1915 0.2750 0.5000 0.2394 0.7756 0.7483 0.1538 0.5000 1.0000 0.8000 0.1915 189-DS 0.3000 0.4000 0.5000 0.6250 0.7000 0.4923 0.1441 0.2250 0.4000 0.2927 0.4730 0.4542 0.1160 0.3000 0.7000 0.4923 0.1441 190-DS 0.5000 0.6000 0.6000 0.7000 0.8000 0.6231 0.0832 0.1000 0.3000 0.1335 0.6181 0.6131 0.0627 0.5000 0.8000 0.6231 0.0832 191-DS 0.3000 0.3750 0.5000 0.6000 0.6000 0.4769 0.1166 0.2250 0.3000 0.2444 0.4620 0.4457 0.0935 0.3000 0.6000 0.4769 0.1166 192-DS 0.5000 0.6000 0.7000 0.7500 1.0000 0.7000 0.1683 0.1500 0.5000 0.2405 0.6827 0.6669 0.1231 0.5000 0.9000 0.6455 0.1128 193-DS 0.5000 0.6000 0.7000 0.8250 1.0000 0.7077 0.1552 0.2250 0.5000 0.2194 0.6924 0.6776 0.1183 0.5000 1.0000 0.7077 0.1552 194-DS 0.0000 0.1000 0.2000 0.2250 0.8000 0.2077 0.2100 0.1250 0.8000 1.0111 0.0426 0.0001 0.1349 0.0000 0.4000 0.1583 0.1165 195-DS 0.8000 0.9000 1.0000 1.0000 1.0000 0.9462 0.0776 0.1000 0.2000 0.0820 0.9430 0.9398 0.0663 0.8000 1.0000 0.9462 0.0776 196-DS 0.3000 0.7000 0.7000 0.8000 1.0000 0.7077 0.1706 0.1000 0.7000 0.2411 0.6836 0.6518 0.1030 0.7000 0.9000 0.7400 0.0699 197-DS 0.9000 0.9750 1.0000 1.0000 1.0000 0.9769 0.0439 0.0250 0.1000 0.0449 0.9760 0.9750 0.0355 1.0000 1.0000 1.0000 0.0000 198-DS 0.4000 0.7000 0.8000 0.9000 0.9000 0.7615 0.1446 0.2000 0.5000 0.1898 0.7459 0.7264 0.1089 0.6000 0.9000 0.7917 0.0996 199-DS 0.7000 0.8000 0.8000 0.9000 1.0000 0.8462 0.0877 0.1000 0.3000 0.1037 0.8421 0.8381 0.0722 0.7000 1.0000 0.8462 0.0877 200-DS 0.2000 0.3000 0.4000 0.5250 1.0000 0.4615 0.2293 0.2250 0.8000 0.4967 0.4157 0.3759 0.1680 0.2000 0.8000 0.4167 0.1697 38 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-DE-CLEF2007 Statistics for P@15 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.4667 0.9333 1.0000 1.0000 1.0000 0.9282 0.1502 0.0667 0.5333 0.1618 0.9124 0.8900 0.0907 0.9333 1.0000 0.9818 0.0311 177-DS 0.2667 0.3333 0.4000 0.4000 0.4667 0.3846 0.0555 0.0667 0.2000 0.1442 0.3807 0.3764 0.0418 0.2667 0.4667 0.3846 0.0555 178-DS 0.6667 0.8500 0.8667 0.9333 0.9333 0.8615 0.0837 0.0833 0.2667 0.0972 0.8575 0.8530 0.0592 0.7333 0.9333 0.8778 0.0625 179-DS 0.5333 0.6000 0.6667 0.7333 0.8667 0.6769 0.0854 0.1333 0.3333 0.1262 0.6720 0.6672 0.0639 0.5333 0.8667 0.6769 0.0854 180-DS 0.8667 0.8667 0.9333 1.0000 1.0000 0.9333 0.0609 0.1333 0.1333 0.0652 0.9315 0.9297 0.0513 0.8667 1.0000 0.9333 0.0609 181-DS 0.4667 0.6500 0.8000 0.8667 0.9333 0.7538 0.1450 0.2167 0.4667 0.1923 0.7392 0.7228 0.1183 0.4667 0.9333 0.7538 0.1450 182-DS 0.5333 0.6000 0.7333 0.8833 1.0000 0.7538 0.1573 0.2833 0.4667 0.2086 0.7390 0.7246 0.1278 0.5333 1.0000 0.7538 0.1573 183-DS 0.0667 0.1333 0.2667 0.5167 0.7333 0.3436 0.2432 0.3833 0.6667 0.7078 0.2639 0.1996 0.2059 0.0667 0.7333 0.3436 0.2432 184-DS 0.4667 0.5333 0.6667 0.7500 0.9333 0.6718 0.1527 0.2167 0.4667 0.2272 0.6563 0.6416 0.1191 0.4667 0.9333 0.6718 0.1527 185-DS 0.0000 0.1333 0.2667 0.3333 0.4667 0.2513 0.1418 0.2000 0.4667 0.5644 0.1123 0.0001 0.1191 0.0000 0.4667 0.2513 0.1418 186-DS 0.0667 0.1167 0.1333 0.1333 0.4667 0.1487 0.1024 0.0167 0.4000 0.6885 0.1291 0.1159 0.0568 0.1333 0.1333 0.1333 0.0000 187-DS 0.0667 0.1333 0.2000 0.3500 0.4000 0.2359 0.1142 0.2167 0.3333 0.4842 0.2089 0.1812 0.0955 0.0667 0.4000 0.2359 0.1142 188-DS 0.4667 0.6333 0.8667 0.9500 1.0000 0.7897 0.1997 0.3167 0.5333 0.2529 0.7630 0.7334 0.1665 0.4667 1.0000 0.7897 0.1997 189-DS 0.2667 0.3333 0.4000 0.4833 0.7333 0.4205 0.1259 0.1500 0.4667 0.2993 0.4050 0.3909 0.0899 0.2667 0.5333 0.3944 0.0874 190-DS 0.5333 0.5333 0.6000 0.7333 0.7333 0.6154 0.0867 0.2000 0.2000 0.1409 0.6099 0.6048 0.0726 0.5333 0.7333 0.6154 0.0867 191-DS 0.2000 0.3333 0.4667 0.4667 0.5333 0.4103 0.1117 0.1333 0.3333 0.2723 0.3924 0.3703 0.0899 0.2000 0.5333 0.4103 0.1117 192-DS 0.4667 0.4667 0.5333 0.7833 1.0000 0.6359 0.1974 0.3167 0.5333 0.3105 0.6110 0.5899 0.1625 0.4667 1.0000 0.6359 0.1974 193-DS 0.4667 0.5333 0.7333 0.8833 1.0000 0.7179 0.1908 0.3500 0.5333 0.2658 0.6935 0.6689 0.1625 0.4667 1.0000 0.7179 0.1908 194-DS 0.0000 0.0667 0.1333 0.3333 0.7333 0.2205 0.2044 0.2667 0.7333 0.9268 0.0834 0.0001 0.1586 0.0000 0.7333 0.2205 0.2044 195-DS 0.8000 0.8667 0.9333 1.0000 1.0000 0.9231 0.0658 0.1333 0.2000 0.0713 0.9209 0.9187 0.0536 0.8000 1.0000 0.9231 0.0658 196-DS 0.2667 0.5333 0.6000 0.6500 0.9333 0.6103 0.1718 0.1167 0.6667 0.2815 0.5862 0.5587 0.1183 0.5333 0.8000 0.5867 0.0820 197-DS 0.8667 0.9167 0.9333 1.0000 1.0000 0.9487 0.0555 0.0833 0.1333 0.0585 0.9472 0.9456 0.0473 0.8667 1.0000 0.9487 0.0555 198-DS 0.5333 0.7167 0.8000 0.8167 0.8667 0.7538 0.1032 0.1000 0.3333 0.1369 0.7467 0.7389 0.0805 0.6000 0.8667 0.7722 0.0827 199-DS 0.5333 0.6667 0.6667 0.8667 0.9333 0.7436 0.1410 0.2000 0.4000 0.1896 0.7309 0.7181 0.1239 0.5333 0.9333 0.7436 0.1410 200-DS 0.2000 0.2500 0.2667 0.4333 0.8667 0.3795 0.2115 0.1833 0.6667 0.5573 0.3373 0.3067 0.1594 0.2000 0.5333 0.3030 0.1048 39 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-DE-CLEF2007 Statistics for P@20 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.4500 0.8500 0.9500 0.9625 1.0000 0.8923 0.1512 0.1125 0.5500 0.1694 0.8761 0.8539 0.1030 0.7500 1.0000 0.9292 0.0753 177-DS 0.2500 0.3000 0.3500 0.4000 0.4000 0.3462 0.0519 0.1000 0.1500 0.1499 0.3424 0.3385 0.0432 0.2500 0.4000 0.3462 0.0519 178-DS 0.7500 0.8375 0.8500 0.9000 0.9500 0.8577 0.0641 0.0625 0.2000 0.0747 0.8554 0.8532 0.0479 0.7500 0.9500 0.8577 0.0641 179-DS 0.5500 0.5875 0.7000 0.7000 0.8000 0.6692 0.0805 0.1125 0.2500 0.1202 0.6646 0.6597 0.0657 0.5500 0.8000 0.6692 0.0805 180-DS 0.8500 0.9000 0.9500 0.9625 1.0000 0.9308 0.0522 0.0625 0.1500 0.0561 0.9294 0.9280 0.0438 0.8500 1.0000 0.9308 0.0522 181-DS 0.4000 0.6250 0.7500 0.7625 0.8500 0.6962 0.1314 0.1375 0.4500 0.1888 0.6828 0.6673 0.1047 0.5500 0.8500 0.7208 0.1010 182-DS 0.5500 0.6000 0.7000 0.8375 0.9500 0.7346 0.1449 0.2375 0.4000 0.1972 0.7219 0.7098 0.1219 0.5500 0.9500 0.7346 0.1449 183-DS 0.1000 0.1875 0.3000 0.4875 0.8000 0.3654 0.2453 0.3000 0.7000 0.6713 0.2984 0.2462 0.1905 0.1000 0.8000 0.3654 0.2453 184-DS 0.4000 0.4000 0.6500 0.7625 0.9500 0.6269 0.1986 0.3625 0.5500 0.3167 0.5970 0.5676 0.1669 0.4000 0.9500 0.6269 0.1986 185-DS 0.0000 0.1375 0.2000 0.3625 0.4500 0.2385 0.1431 0.2250 0.4500 0.6001 0.1051 0.0001 0.1183 0.0000 0.4500 0.2385 0.1431 186-DS 0.0500 0.1000 0.1000 0.1250 0.3500 0.1308 0.0778 0.0250 0.3000 0.5952 0.1161 0.1058 0.0550 0.1000 0.1000 0.1000 0.0000 187-DS 0.1000 0.1375 0.1500 0.3125 0.4500 0.2154 0.1214 0.1750 0.3500 0.5638 0.1877 0.1661 0.1036 0.1000 0.4500 0.2154 0.1214 188-DS 0.4000 0.6125 0.8500 0.9625 1.0000 0.7846 0.2115 0.3500 0.6000 0.2696 0.7536 0.7184 0.1805 0.4000 1.0000 0.7846 0.2115 189-DS 0.2000 0.2875 0.4000 0.4250 0.6000 0.3692 0.1200 0.1375 0.4000 0.3249 0.3506 0.3317 0.0947 0.2000 0.6000 0.3692 0.1200 190-DS 0.5000 0.5000 0.5000 0.7500 0.8000 0.6000 0.1225 0.2500 0.3000 0.2041 0.5891 0.5789 0.1077 0.5000 0.8000 0.6000 0.1225 191-DS 0.1500 0.2875 0.4000 0.4125 0.4500 0.3423 0.1058 0.1250 0.3000 0.3090 0.3228 0.2987 0.0864 0.1500 0.4500 0.3423 0.1058 192-DS 0.4000 0.5000 0.5000 0.7000 0.9500 0.5962 0.1865 0.2000 0.5500 0.3128 0.5724 0.5521 0.1491 0.4000 0.9500 0.5962 0.1865 193-DS 0.4500 0.5000 0.7500 0.9125 1.0000 0.7231 0.2068 0.4125 0.5500 0.2860 0.6939 0.6642 0.1793 0.4500 1.0000 0.7231 0.2068 194-DS 0.0000 0.0875 0.2000 0.2750 0.6500 0.2154 0.1897 0.1875 0.6500 0.8808 0.0816 0.0001 0.1420 0.0000 0.5000 0.1792 0.1437 195-DS 0.8000 0.9000 0.9500 1.0000 1.0000 0.9308 0.0630 0.1000 0.2000 0.0677 0.9287 0.9267 0.0515 0.8000 1.0000 0.9308 0.0630 196-DS 0.3500 0.5000 0.5000 0.6250 0.9000 0.5654 0.1533 0.1250 0.5500 0.2711 0.5478 0.5317 0.1136 0.3500 0.8000 0.5375 0.1208 197-DS 0.8500 0.9375 0.9500 1.0000 1.0000 0.9500 0.0456 0.0625 0.1500 0.0480 0.9490 0.9479 0.0308 0.8500 1.0000 0.9500 0.0456 198-DS 0.6000 0.6875 0.7500 0.8125 0.9000 0.7538 0.0877 0.1250 0.3000 0.1163 0.7490 0.7442 0.0663 0.6000 0.9000 0.7538 0.0877 199-DS 0.4500 0.5875 0.6500 0.8125 0.9000 0.6769 0.1467 0.2250 0.4500 0.2166 0.6616 0.6458 0.1178 0.4500 0.9000 0.6769 0.1467 200-DS 0.1500 0.2000 0.2500 0.4125 0.8000 0.3462 0.1994 0.2125 0.6500 0.5762 0.3051 0.2751 0.1491 0.1500 0.7000 0.3083 0.1520 40 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-DE-CLEF2007 Statistics for P@30 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.4333 0.7250 0.8000 0.9667 1.0000 0.8282 0.1688 0.2417 0.5667 0.2038 0.8093 0.7867 0.1381 0.4333 1.0000 0.8282 0.1688 177-DS 0.2667 0.3000 0.3000 0.3000 0.3333 0.2974 0.0165 0.0000 0.0667 0.0553 0.2970 0.2966 0.0095 0.3000 0.3000 0.3000 0.0000 178-DS 0.7000 0.8000 0.8333 0.9000 0.9000 0.8385 0.0575 0.1000 0.2000 0.0686 0.8366 0.8346 0.0422 0.7000 0.9000 0.8385 0.0575 179-DS 0.5667 0.6167 0.6667 0.7000 0.7333 0.6538 0.0570 0.0833 0.1667 0.0872 0.6515 0.6490 0.0465 0.5667 0.7333 0.6538 0.0570 180-DS 0.8667 0.9000 0.9000 0.9083 1.0000 0.9103 0.0370 0.0083 0.1333 0.0406 0.9096 0.9089 0.0260 0.9000 0.9000 0.9000 0.0000 181-DS 0.3333 0.5167 0.6000 0.7083 0.7333 0.5974 0.1330 0.1917 0.4000 0.2225 0.5816 0.5637 0.1057 0.3333 0.7333 0.5974 0.1330 182-DS 0.6000 0.7000 0.7667 0.8583 0.9333 0.7744 0.1098 0.1583 0.3333 0.1419 0.7672 0.7601 0.0864 0.6000 0.9333 0.7744 0.1098 183-DS 0.1333 0.2333 0.3000 0.4750 0.8000 0.3769 0.2149 0.2417 0.6667 0.5701 0.3295 0.2921 0.1680 0.1333 0.8000 0.3769 0.2149 184-DS 0.2667 0.3000 0.6000 0.7000 0.9000 0.5410 0.2253 0.4000 0.6333 0.4165 0.4947 0.4498 0.1917 0.2667 0.9000 0.5410 0.2253 185-DS 0.0333 0.1583 0.2333 0.3667 0.5667 0.2692 0.1680 0.2083 0.5333 0.6241 0.2117 0.1464 0.1314 0.0333 0.5667 0.2692 0.1680 186-DS 0.0333 0.0667 0.0667 0.1333 0.3667 0.1154 0.0959 0.0667 0.3333 0.8307 0.0920 0.0781 0.0675 0.0333 0.1333 0.0788 0.0308 187-DS 0.1000 0.1250 0.2000 0.2417 0.4000 0.2000 0.0923 0.1167 0.3000 0.4615 0.1817 0.1655 0.0667 0.1000 0.4000 0.2000 0.0923 188-DS 0.4667 0.6833 0.9000 0.9417 1.0000 0.8000 0.1900 0.2583 0.5333 0.2375 0.7757 0.7482 0.1538 0.4667 1.0000 0.8000 0.1900 189-DS 0.1667 0.2583 0.3333 0.3750 0.4333 0.3103 0.0854 0.1167 0.2667 0.2753 0.2987 0.2865 0.0710 0.1667 0.4333 0.3103 0.0854 190-DS 0.6000 0.6667 0.6667 0.7667 0.8000 0.6974 0.0645 0.1000 0.2000 0.0925 0.6947 0.6921 0.0533 0.6000 0.8000 0.6974 0.0645 191-DS 0.1000 0.2667 0.2667 0.3000 0.3667 0.2615 0.0768 0.0333 0.2667 0.2936 0.2459 0.2236 0.0497 0.2667 0.3000 0.2833 0.0176 192-DS 0.3333 0.4000 0.4667 0.5833 0.9000 0.5308 0.1907 0.1833 0.5667 0.3594 0.5044 0.4831 0.1452 0.3333 0.7333 0.4636 0.1069 193-DS 0.4000 0.4250 0.7000 0.8250 0.9333 0.6564 0.2114 0.4000 0.5333 0.3221 0.6230 0.5895 0.1819 0.4000 0.9333 0.6564 0.2114 194-DS 0.0667 0.1000 0.1667 0.2417 0.6333 0.2026 0.1524 0.1417 0.5667 0.7525 0.1650 0.1384 0.1057 0.0667 0.3333 0.1667 0.0841 195-DS 0.8333 0.8667 0.9333 0.9750 1.0000 0.9282 0.0606 0.1083 0.1667 0.0653 0.9263 0.9245 0.0481 0.8333 1.0000 0.9282 0.0606 196-DS 0.3667 0.5000 0.5667 0.6333 0.8667 0.5795 0.1214 0.1333 0.5000 0.2094 0.5681 0.5568 0.0856 0.3667 0.7000 0.5556 0.0891 197-DS 0.8667 0.9583 0.9667 0.9750 1.0000 0.9615 0.0356 0.0167 0.1333 0.0370 0.9609 0.9603 0.0233 0.9333 0.9667 0.9593 0.0147 198-DS 0.6333 0.6917 0.7000 0.8167 0.9000 0.7436 0.0865 0.1250 0.2667 0.1163 0.7391 0.7349 0.0706 0.6333 0.9000 0.7436 0.0865 199-DS 0.3000 0.4583 0.5667 0.7167 0.8333 0.5769 0.1702 0.2583 0.5333 0.2950 0.5507 0.5217 0.1341 0.3000 0.8333 0.5769 0.1702 200-DS 0.1667 0.1667 0.2000 0.3333 0.7000 0.2872 0.1675 0.1667 0.5333 0.5833 0.2548 0.2329 0.1227 0.1667 0.5667 0.2528 0.1176 41 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-DE-CLEF2007 Statistics for P@100 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.3200 0.3375 0.4800 0.7550 0.7800 0.5546 0.2050 0.4175 0.4600 0.3696 0.5182 0.4833 0.1911 0.3200 0.7800 0.5546 0.2050 177-DS 0.1700 0.1975 0.2100 0.2200 0.2500 0.2077 0.0205 0.0225 0.0800 0.0986 0.2068 0.2058 0.0151 0.1700 0.2500 0.2077 0.0205 178-DS 0.5100 0.7250 0.7700 0.7825 0.8300 0.7392 0.0866 0.0575 0.3200 0.1172 0.7338 0.7275 0.0595 0.7100 0.8300 0.7709 0.0351 179-DS 0.5100 0.5300 0.5500 0.5625 0.6500 0.5538 0.0350 0.0325 0.1400 0.0632 0.5529 0.5520 0.0232 0.5100 0.5800 0.5458 0.0207 180-DS 0.7300 0.8050 0.8300 0.8500 0.8600 0.8177 0.0415 0.0450 0.1300 0.0507 0.8167 0.8156 0.0309 0.7400 0.8600 0.8250 0.0334 181-DS 0.1700 0.2475 0.3500 0.3725 0.4000 0.3100 0.0782 0.1250 0.2300 0.2523 0.2995 0.2877 0.0677 0.1700 0.4000 0.3100 0.0782 182-DS 0.5400 0.6275 0.7400 0.7900 0.8600 0.7223 0.0966 0.1625 0.3200 0.1338 0.7161 0.7096 0.0775 0.5400 0.8600 0.7223 0.0966 183-DS 0.1300 0.1675 0.2200 0.3575 0.7300 0.3115 0.2284 0.1900 0.6000 0.7331 0.2560 0.2224 0.1824 0.1300 0.2500 0.1930 0.0419 184-DS 0.1600 0.2525 0.3900 0.4475 0.5500 0.3546 0.1292 0.1950 0.3900 0.3643 0.3298 0.3031 0.1066 0.1600 0.5500 0.3546 0.1292 185-DS 0.0400 0.1175 0.1600 0.2425 0.4000 0.1962 0.1081 0.1250 0.3600 0.5509 0.1674 0.1365 0.0851 0.0400 0.4000 0.1962 0.1081 186-DS 0.0200 0.0400 0.0600 0.0800 0.2200 0.0785 0.0609 0.0400 0.2000 0.7767 0.0635 0.0533 0.0409 0.0200 0.0800 0.0545 0.0186 187-DS 0.0800 0.1450 0.1600 0.2050 0.2700 0.1708 0.0557 0.0600 0.1900 0.3264 0.1621 0.1531 0.0425 0.0800 0.2700 0.1708 0.0557 188-DS 0.3700 0.5675 0.7400 0.8900 0.9700 0.7177 0.2085 0.3225 0.6000 0.2904 0.6853 0.6493 0.1640 0.3700 0.9700 0.7177 0.2085 189-DS 0.1300 0.1400 0.1700 0.2125 0.2600 0.1785 0.0418 0.0725 0.1300 0.2342 0.1741 0.1701 0.0353 0.1300 0.2600 0.1785 0.0418 190-DS 0.5400 0.6200 0.7900 0.8375 0.8900 0.7369 0.1243 0.2175 0.3500 0.1687 0.7266 0.7157 0.1084 0.5400 0.8900 0.7369 0.1243 191-DS 0.0700 0.1075 0.1200 0.1425 0.1700 0.1215 0.0305 0.0350 0.1000 0.2510 0.1176 0.1132 0.0247 0.0700 0.1700 0.1215 0.0305 192-DS 0.1500 0.1975 0.2700 0.3450 0.6300 0.3108 0.1592 0.1475 0.4800 0.5124 0.2789 0.2530 0.1166 0.1500 0.4500 0.2545 0.0884 193-DS 0.2600 0.3150 0.4100 0.7625 0.9000 0.4992 0.2402 0.4475 0.6400 0.4812 0.4524 0.4151 0.2051 0.2600 0.9000 0.4992 0.2402 194-DS 0.0700 0.0975 0.1000 0.1750 0.6300 0.1577 0.1473 0.0775 0.5600 0.9339 0.1286 0.1152 0.0845 0.0700 0.1900 0.1183 0.0411 195-DS 0.6000 0.7700 0.8500 0.9125 0.9700 0.8315 0.1127 0.1425 0.3700 0.1355 0.8240 0.8159 0.0889 0.6000 0.9700 0.8315 0.1127 196-DS 0.2600 0.3875 0.5000 0.5250 0.6400 0.4654 0.1135 0.1375 0.3800 0.2440 0.4507 0.4342 0.0879 0.2600 0.6400 0.4654 0.1135 197-DS 0.7100 0.7675 0.7800 0.8625 0.9400 0.8100 0.0649 0.0950 0.2300 0.0802 0.8076 0.8053 0.0538 0.7100 0.9400 0.8100 0.0649 198-DS 0.4800 0.5325 0.5800 0.6500 0.8000 0.6085 0.1057 0.1175 0.3200 0.1737 0.6005 0.5931 0.0830 0.4800 0.8000 0.6085 0.1057 199-DS 0.1100 0.3175 0.4700 0.4950 0.5500 0.3962 0.1509 0.1775 0.4400 0.3808 0.3561 0.3020 0.1217 0.1100 0.5500 0.3962 0.1509 200-DS 0.1200 0.1575 0.1700 0.2625 0.4300 0.2192 0.0981 0.1050 0.3100 0.4475 0.2026 0.1897 0.0775 0.1200 0.3900 0.2017 0.0783 42 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-DE-CLEF2007 Statistics for P@200 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.1900 0.2287 0.3400 0.4200 0.4200 0.3223 0.0989 0.1912 0.2300 0.3067 0.3075 0.2927 0.0914 0.1900 0.4200 0.3223 0.0989 177-DS 0.1450 0.1450 0.1450 0.1575 0.1700 0.1519 0.0099 0.0125 0.0250 0.0652 0.1516 0.1514 0.0080 0.1450 0.1700 0.1519 0.0099 178-DS 0.3800 0.5162 0.5600 0.5850 0.6050 0.5385 0.0655 0.0688 0.2250 0.1217 0.5343 0.5296 0.0491 0.4500 0.6050 0.5517 0.0470 179-DS 0.3800 0.4200 0.4250 0.4350 0.4900 0.4277 0.0251 0.0150 0.1100 0.0586 0.4270 0.4264 0.0160 0.4050 0.4500 0.4264 0.0116 180-DS 0.5800 0.6838 0.7100 0.7425 0.7700 0.7023 0.0533 0.0588 0.1900 0.0759 0.7003 0.6982 0.0379 0.6200 0.7700 0.7125 0.0404 181-DS 0.1050 0.1513 0.1950 0.2025 0.2150 0.1777 0.0356 0.0512 0.1100 0.2002 0.1739 0.1697 0.0305 0.1050 0.2150 0.1777 0.0356 182-DS 0.4200 0.5662 0.6450 0.7062 0.7200 0.6331 0.0873 0.1400 0.3000 0.1379 0.6268 0.6196 0.0665 0.4200 0.7200 0.6331 0.0873 183-DS 0.1100 0.1525 0.1700 0.2662 0.5750 0.2473 0.1719 0.1137 0.4650 0.6949 0.2084 0.1849 0.1374 0.1100 0.1900 0.1580 0.0236 184-DS 0.1450 0.2100 0.2500 0.2812 0.3400 0.2415 0.0577 0.0713 0.1950 0.2389 0.2345 0.2269 0.0435 0.1450 0.3400 0.2415 0.0577 185-DS 0.0300 0.0800 0.1400 0.1925 0.2450 0.1396 0.0663 0.1125 0.2150 0.4752 0.1225 0.1019 0.0527 0.0300 0.2450 0.1396 0.0663 186-DS 0.0100 0.0387 0.0500 0.0662 0.1150 0.0565 0.0290 0.0275 0.1050 0.5136 0.0491 0.0396 0.0206 0.0100 0.0700 0.0464 0.0164 187-DS 0.0800 0.1087 0.1300 0.1600 0.1950 0.1327 0.0330 0.0512 0.1150 0.2483 0.1289 0.1251 0.0260 0.0800 0.1950 0.1327 0.0330 188-DS 0.3300 0.4563 0.5250 0.6838 0.7650 0.5535 0.1525 0.2275 0.4350 0.2756 0.5332 0.5127 0.1266 0.3300 0.7650 0.5535 0.1525 189-DS 0.1000 0.1187 0.1300 0.1462 0.1750 0.1331 0.0220 0.0275 0.0750 0.1656 0.1314 0.1298 0.0179 0.1000 0.1750 0.1331 0.0220 190-DS 0.4050 0.4750 0.6000 0.6600 0.7400 0.5738 0.1062 0.1850 0.3350 0.1850 0.5645 0.5550 0.0866 0.4050 0.7400 0.5738 0.1062 191-DS 0.0550 0.0775 0.0850 0.0950 0.1050 0.0838 0.0154 0.0175 0.0500 0.1840 0.0824 0.0809 0.0120 0.0550 0.1050 0.0838 0.0154 192-DS 0.1250 0.1437 0.2000 0.2450 0.4050 0.2200 0.0956 0.1013 0.2800 0.4347 0.2038 0.1908 0.0715 0.1250 0.3200 0.1868 0.0557 193-DS 0.1850 0.2188 0.3700 0.5912 0.7300 0.3912 0.1926 0.3725 0.5450 0.4925 0.3504 0.3161 0.1578 0.1850 0.7300 0.3912 0.1926 194-DS 0.0800 0.0975 0.1250 0.1500 0.4350 0.1435 0.0920 0.0525 0.3550 0.6410 0.1284 0.1197 0.0517 0.0800 0.1750 0.1192 0.0292 195-DS 0.4750 0.5775 0.6650 0.7450 0.8100 0.6615 0.1103 0.1675 0.3350 0.1667 0.6526 0.6433 0.0891 0.4750 0.8100 0.6615 0.1103 196-DS 0.1500 0.2462 0.3250 0.3675 0.4050 0.3069 0.0816 0.1213 0.2550 0.2658 0.2948 0.2804 0.0658 0.1500 0.4050 0.3069 0.0816 197-DS 0.5100 0.5187 0.5250 0.5475 0.5900 0.5373 0.0293 0.0288 0.0800 0.0545 0.5366 0.5359 0.0228 0.5100 0.5900 0.5373 0.0293 198-DS 0.3550 0.4137 0.4800 0.5563 0.6000 0.4785 0.0836 0.1425 0.2450 0.1746 0.4717 0.4649 0.0717 0.3550 0.6000 0.4785 0.0836 199-DS 0.0750 0.1963 0.3050 0.3550 0.3700 0.2669 0.1082 0.1587 0.2950 0.4053 0.2377 0.2002 0.0915 0.0750 0.3700 0.2669 0.1082 200-DS 0.1000 0.1225 0.1300 0.1788 0.2700 0.1554 0.0534 0.0563 0.1700 0.3434 0.1482 0.1423 0.0420 0.1000 0.2450 0.1458 0.0426 43 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-DE-CLEF2007 Statistics for P@500 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.1000 0.1195 0.1680 0.1700 0.1720 0.1443 0.0294 0.0505 0.0720 0.2034 0.1414 0.1383 0.0271 0.1000 0.1720 0.1443 0.0294 177-DS 0.0840 0.0880 0.0940 0.0995 0.1140 0.0954 0.0088 0.0115 0.0300 0.0923 0.0950 0.0947 0.0069 0.0840 0.1140 0.0954 0.0088 178-DS 0.2180 0.2520 0.2640 0.2680 0.2740 0.2582 0.0164 0.0160 0.0560 0.0634 0.2576 0.2571 0.0124 0.2380 0.2740 0.2615 0.0115 179-DS 0.2220 0.2335 0.2400 0.2420 0.2440 0.2371 0.0064 0.0085 0.0220 0.0270 0.2370 0.2369 0.0053 0.2220 0.2440 0.2371 0.0064 180-DS 0.3700 0.3910 0.4040 0.4065 0.4200 0.3988 0.0129 0.0155 0.0500 0.0325 0.3986 0.3984 0.0099 0.3700 0.4200 0.3988 0.0129 181-DS 0.0640 0.0750 0.0820 0.0845 0.0880 0.0792 0.0076 0.0095 0.0240 0.0959 0.0789 0.0785 0.0062 0.0640 0.0880 0.0792 0.0076 182-DS 0.2880 0.4105 0.4420 0.4540 0.4640 0.4246 0.0466 0.0435 0.1760 0.1098 0.4218 0.4184 0.0318 0.3900 0.4640 0.4360 0.0231 183-DS 0.0720 0.1005 0.1100 0.1990 0.2880 0.1480 0.0774 0.0985 0.2160 0.5233 0.1326 0.1210 0.0637 0.0720 0.2880 0.1480 0.0774 184-DS 0.1020 0.1160 0.1280 0.1305 0.1520 0.1257 0.0143 0.0145 0.0500 0.1142 0.1249 0.1242 0.0105 0.1020 0.1520 0.1257 0.0143 185-DS 0.0340 0.0580 0.0840 0.1120 0.1220 0.0845 0.0300 0.0540 0.0880 0.3551 0.0787 0.0722 0.0254 0.0340 0.1220 0.0845 0.0300 186-DS 0.0100 0.0295 0.0340 0.0400 0.0600 0.0355 0.0127 0.0105 0.0500 0.3568 0.0330 0.0297 0.0090 0.0280 0.0400 0.0336 0.0050 187-DS 0.0700 0.0755 0.0800 0.0955 0.1120 0.0851 0.0127 0.0200 0.0420 0.1498 0.0842 0.0835 0.0106 0.0700 0.1120 0.0851 0.0127 188-DS 0.1960 0.2655 0.3500 0.4485 0.4580 0.3475 0.1008 0.1830 0.2620 0.2901 0.3324 0.3161 0.0833 0.1960 0.4580 0.3475 0.1008 189-DS 0.0580 0.0675 0.0720 0.0815 0.0900 0.0745 0.0100 0.0140 0.0320 0.1339 0.0738 0.0732 0.0085 0.0580 0.0900 0.0745 0.0100 190-DS 0.2220 0.3075 0.4140 0.4240 0.5700 0.3832 0.1094 0.1165 0.3480 0.2853 0.3678 0.3515 0.0856 0.2220 0.5700 0.3832 0.1094 191-DS 0.0320 0.0475 0.0500 0.0560 0.0560 0.0491 0.0085 0.0085 0.0240 0.1726 0.0483 0.0474 0.0062 0.0460 0.0560 0.0522 0.0041 192-DS 0.0800 0.1000 0.1140 0.1420 0.1860 0.1228 0.0351 0.0420 0.1060 0.2856 0.1185 0.1146 0.0272 0.0800 0.1860 0.1228 0.0351 193-DS 0.1080 0.1515 0.2180 0.3490 0.4040 0.2362 0.1055 0.1975 0.2960 0.4466 0.2158 0.1982 0.0876 0.1080 0.4040 0.2362 0.1055 194-DS 0.0580 0.0970 0.1180 0.1310 0.2160 0.1192 0.0422 0.0340 0.1580 0.3541 0.1126 0.1062 0.0284 0.0580 0.1780 0.1112 0.0320 195-DS 0.3180 0.4115 0.4560 0.4960 0.5300 0.4415 0.0738 0.0845 0.2120 0.1672 0.4352 0.4282 0.0557 0.3180 0.5300 0.4415 0.0738 196-DS 0.0740 0.1355 0.1580 0.1685 0.1780 0.1463 0.0333 0.0330 0.1040 0.2276 0.1420 0.1366 0.0251 0.0980 0.1780 0.1523 0.0264 197-DS 0.2560 0.2685 0.2900 0.2945 0.3020 0.2829 0.0150 0.0260 0.0460 0.0529 0.2826 0.2822 0.0127 0.2560 0.3020 0.2829 0.0150 198-DS 0.2340 0.2540 0.2800 0.3225 0.3560 0.2914 0.0413 0.0685 0.1220 0.1418 0.2887 0.2860 0.0353 0.2340 0.3560 0.2914 0.0413 199-DS 0.0580 0.0915 0.1520 0.1565 0.1620 0.1258 0.0411 0.0650 0.1040 0.3267 0.1182 0.1094 0.0368 0.0580 0.1620 0.1258 0.0411 200-DS 0.0680 0.0835 0.0880 0.1105 0.1320 0.0957 0.0203 0.0270 0.0640 0.2126 0.0938 0.0921 0.0165 0.0680 0.1320 0.0957 0.0203 44 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-DE-CLEF2007 Statistics for P@1000 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0550 0.0697 0.0850 0.0850 0.0860 0.0764 0.0116 0.0153 0.0310 0.1513 0.0755 0.0745 0.0096 0.0550 0.0860 0.0764 0.0116 177-DS 0.0510 0.0558 0.0570 0.0595 0.0640 0.0575 0.0036 0.0037 0.0130 0.0618 0.0574 0.0573 0.0027 0.0510 0.0640 0.0575 0.0036 178-DS 0.1260 0.1333 0.1370 0.1380 0.1390 0.1353 0.0039 0.0047 0.0130 0.0292 0.1353 0.1352 0.0031 0.1300 0.1390 0.1361 0.0029 179-DS 0.1140 0.1228 0.1240 0.1250 0.1250 0.1232 0.0031 0.0022 0.0110 0.0248 0.1231 0.1231 0.0020 0.1210 0.1250 0.1239 0.0014 180-DS 0.2090 0.2228 0.2260 0.2275 0.2360 0.2252 0.0065 0.0047 0.0270 0.0289 0.2251 0.2250 0.0044 0.2200 0.2330 0.2256 0.0036 181-DS 0.0350 0.0410 0.0420 0.0422 0.0440 0.0415 0.0023 0.0012 0.0090 0.0544 0.0415 0.0414 0.0014 0.0400 0.0440 0.0421 0.0012 182-DS 0.2050 0.2490 0.2540 0.2598 0.2740 0.2520 0.0167 0.0107 0.0690 0.0663 0.2514 0.2508 0.0103 0.2400 0.2740 0.2559 0.0093 183-DS 0.0480 0.0765 0.0850 0.1260 0.1510 0.0959 0.0343 0.0495 0.1030 0.3577 0.0904 0.0852 0.0278 0.0480 0.1510 0.0959 0.0343 184-DS 0.0590 0.0650 0.0710 0.0725 0.0770 0.0692 0.0056 0.0075 0.0180 0.0809 0.0689 0.0687 0.0046 0.0590 0.0770 0.0692 0.0056 185-DS 0.0270 0.0527 0.0620 0.0665 0.0760 0.0582 0.0145 0.0138 0.0490 0.2485 0.0560 0.0531 0.0107 0.0520 0.0760 0.0635 0.0070 186-DS 0.0070 0.0217 0.0240 0.0253 0.0310 0.0228 0.0059 0.0035 0.0240 0.2589 0.0218 0.0200 0.0039 0.0170 0.0290 0.0235 0.0031 187-DS 0.0430 0.0520 0.0560 0.0582 0.0640 0.0548 0.0053 0.0062 0.0210 0.0961 0.0546 0.0543 0.0040 0.0430 0.0640 0.0548 0.0053 188-DS 0.1410 0.1858 0.2590 0.2870 0.2940 0.2375 0.0559 0.1013 0.1530 0.2356 0.2306 0.2232 0.0493 0.1410 0.2940 0.2375 0.0559 189-DS 0.0370 0.0417 0.0460 0.0492 0.0520 0.0456 0.0045 0.0075 0.0150 0.0983 0.0454 0.0452 0.0036 0.0370 0.0520 0.0456 0.0045 190-DS 0.1460 0.2197 0.2790 0.2913 0.3110 0.2495 0.0603 0.0715 0.1650 0.2418 0.2415 0.2322 0.0476 0.1460 0.3110 0.2495 0.0603 191-DS 0.0260 0.0278 0.0300 0.0333 0.0350 0.0304 0.0030 0.0055 0.0090 0.0992 0.0302 0.0301 0.0026 0.0260 0.0350 0.0304 0.0030 192-DS 0.0540 0.0608 0.0700 0.0800 0.0970 0.0724 0.0144 0.0192 0.0430 0.1983 0.0711 0.0699 0.0116 0.0540 0.0970 0.0724 0.0144 193-DS 0.0830 0.1057 0.1320 0.1987 0.2200 0.1426 0.0491 0.0930 0.1370 0.3440 0.1354 0.1290 0.0413 0.0830 0.2200 0.1426 0.0491 194-DS 0.0530 0.0697 0.0820 0.0887 0.1210 0.0819 0.0185 0.0190 0.0680 0.2258 0.0801 0.0783 0.0136 0.0530 0.1050 0.0787 0.0149 195-DS 0.2530 0.2810 0.3040 0.3102 0.3340 0.2968 0.0240 0.0292 0.0810 0.0809 0.2959 0.2950 0.0188 0.2530 0.3340 0.2968 0.0240 196-DS 0.0460 0.0755 0.0830 0.0850 0.0890 0.0777 0.0133 0.0095 0.0430 0.1713 0.0764 0.0749 0.0102 0.0620 0.0890 0.0823 0.0073 197-DS 0.1360 0.1475 0.1640 0.1687 0.1720 0.1592 0.0126 0.0212 0.0360 0.0791 0.1587 0.1582 0.0104 0.1360 0.1720 0.1592 0.0126 198-DS 0.1570 0.1690 0.1790 0.1930 0.2010 0.1810 0.0141 0.0240 0.0440 0.0778 0.1805 0.1800 0.0114 0.1570 0.2010 0.1810 0.0141 199-DS 0.0470 0.0537 0.0780 0.0810 0.0810 0.0690 0.0148 0.0273 0.0340 0.2150 0.0674 0.0657 0.0137 0.0470 0.0810 0.0690 0.0148 200-DS 0.0470 0.0507 0.0550 0.0705 0.0770 0.0595 0.0109 0.0197 0.0300 0.1833 0.0586 0.0577 0.0096 0.0470 0.0770 0.0595 0.0109 45 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-EN-CLEF2007 Domain−Specific Monolingual English Task Top 5 Participants − Standard Recall Levels vs Mean Interpolated Precision 100% unine [Experiment UNINEEN4; MAP 35.34%; Pooled] xerox [Experiment XRCEPRFENLE; MAP 32.37%; Pooled] 90% chemnitz [Experiment CUT_DS_MONO_EN_MERGED; MAP 29.85%; Pooled] cheshire [Experiment BERKMENCCP15; MAP 28.14%; Pooled] moscow [Experiment CIRDSMONOEN2; MAP 19.50%; Pooled] 80% 70% 60% Precision 50% 40% 30% 20% 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Monolingual English Task Top 5 Participants − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) 1 unine [Experiment UNINEEN4; MAP 35.34%; Pooled] xerox [Experiment XRCEPRFENLE; MAP 32.37%; Pooled] chemnitz [Experiment CUT_DS_MONO_EN_MERGED; MAP 29.85%; Pooled] cheshire [Experiment BERKMENCCP15; MAP 28.14%; Pooled] moscow [Experiment CIRDSMONOEN2; MAP 19.50%; Pooled] 0.8 0.6 0.4 0.2 Difference 0 −0.2 −0.4 −0.6 −0.8 −1 176−DS177−DS178−DS179−DS180−DS181−DS182−DS183−DS184−DS185−DS186−DS187−DS188−DS189−DS190−DS191−DS192−DS193−DS194−DS195−DS196−DS197−DS198−DS199−DS200−DS Topic Identifier 46 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-EN-CLEF2007 Domain−Specific Monolingual English Task − Box Plot of the Topics unine [Experiment UNINEEN4; MAP 35.34%; Pooled] unine [Experiment UNINEEN1; MAP 34.72%; Pooled] unine [Experiment UNINEEN3; MAP 33.99%; Pooled] xerox [Experiment XRCEPRFENLE; MAP 32.37%; Pooled] xerox [Experiment XRCEPRFLEEN; MAP 30.51%; Pooled] unine [Experiment UNINEEN2; MAP 30.38%; Pooled] chemnitz [Experiment CUT_DS_MONO_EN_MERGED; MAP 29.85%; Pooled] Experiments chemnitz [Experiment CUT_DS_MONO_EN_MERGED_UNSTRUCT; MAP 29.52%; Pooled] xerox [Experiment XRCEPRFEN; MAP 29.34%; Pooled] cheshire [Experiment BERKMENCCP15; MAP 28.14%; Pooled] cheshire [Experiment BERKMENTHP15; MAP 27.33%; Pooled] xerox [Experiment XRCELEEN; MAP 27.22%; Pooled] moscow [Experiment CIRDSMONOEN2; MAP 19.50%; Pooled] moscow [Experiment CIRDSMONOEN; MAP 18.91%; Pooled] chemnitz [Experiment CUT_DS_MONO_EN_MERGED_STRUCT; MAP 18.50%; Pooled] 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Average Precision 47 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-EN-CLEF2007 10.2455/TUKEY_T_TEST.B47646E5768CAC0AEA31D9943095E16F Domain−Specific Monolingual English Task − Tukey T test with "top group" highlighted UNINEEN4 UNINEEN1 UNINEEN3 XRCEPRFENLE UNINEEN2 XRCEPRFLEEN CUT_DS_MONO_EN_MERGED Experiments CUT_DS_MONO_EN_MERGED_UNSTRUCT XRCEPRFEN BERKMENCCP15 BERKMENTHP15 XRCELEEN CIRDSMONOEN2 CIRDSMONOEN CUT_DS_MONO_EN_MERGED_STRUCT 0.35 0.4 0.45 0.5 0.55 0.6 0.65 0.7 arcsin(sqrt(Average Precsion)) 48 49 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-EN-CLEF2007 Domain−Specific Monolingual English Task Top 5 Participants − Retrieved documents vs Mean Precision 100% unine [Experiment UNINEEN4; R−Prec 39.54%; Pooled] xerox [Experiment XRCEPRFENLE; R−Prec 36.03%; Pooled] 90% chemnitz [Experiment CUT_DS_MONO_EN_MERGED; R−Prec 34.55%; Pooled] cheshire [Experiment BERKMENCCP15; R−Prec 33.69%; Pooled] moscow [Experiment CIRDSMONOEN2; R−Prec 27.69%; Pooled] 80% 70% 60% Precision 50% 40% 30% 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Monolingual English Task Top 5 Participants − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) 1 unine [Experiment UNINEEN4; R−Prec 39.54%; Pooled] xerox [Experiment XRCEPRFENLE; R−Prec 36.03%; Pooled] chemnitz [Experiment CUT_DS_MONO_EN_MERGED; R−Prec 34.55%; Pooled] cheshire [Experiment BERKMENCCP15; R−Prec 33.69%; Pooled] moscow [Experiment CIRDSMONOEN2; R−Prec 27.69%; Pooled] 0.8 0.6 0.4 0.2 Difference 0 −0.2 −0.4 −0.6 −0.8 −1 176−DS177−DS178−DS179−DS180−DS181−DS182−DS183−DS184−DS185−DS186−DS187−DS188−DS189−DS190−DS191−DS192−DS193−DS194−DS195−DS196−DS197−DS198−DS199−DS200−DS Topic Identifier 50 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-EN-CLEF2007 Domain−Specific Monolingual English Task − Box Plot of the Topics unine [Experiment UNINEEN4; R−Prec 39.54%; Pooled] unine [Experiment UNINEEN1; R−Prec 39.14%; Pooled] unine [Experiment UNINEEN3; R−Prec 38.65%; Pooled] xerox [Experiment XRCEPRFENLE; R−Prec 36.03%; Pooled] chemnitz [Experiment CUT_DS_MONO_EN_MERGED_UNSTRUCT; R−Prec 35.09%; Pooled] chemnitz [Experiment CUT_DS_MONO_EN_MERGED; R−Prec 34.55%; Pooled] xerox [Experiment XRCEPRFEN; R−Prec 34.28%; Pooled] Experiments xerox [Experiment XRCEPRFLEEN; R−Prec 34.06%; Pooled] unine [Experiment UNINEEN2; R−Prec 33.75%; Pooled] cheshire [Experiment BERKMENCCP15; R−Prec 33.69%; Pooled] cheshire [Experiment BERKMENTHP15; R−Prec 33.10%; Pooled] xerox [Experiment XRCELEEN; R−Prec 32.28%; Pooled] moscow [Experiment CIRDSMONOEN2; R−Prec 27.69%; Pooled] moscow [Experiment CIRDSMONOEN; R−Prec 27.11%; Pooled] chemnitz [Experiment CUT_DS_MONO_EN_MERGED_STRUCT; R−Prec 25.65%; Pooled] 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% R−Precision 51 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-EN-CLEF2007 Domain−Specific Monolingual English Task − Tukey T test with "top group" highlighted UNINEEN4 UNINEEN1 UNINEEN3 XRCEPRFENLE CUT_DS_MONO_EN_MERGED_UNSTRUCT CUT_DS_MONO_EN_MERGED XRCEPRFEN Experiments XRCEPRFLEEN BERKMENCCP15 UNINEEN2 BERKMENTHP15 XRCELEEN CIRDSMONOEN2 CIRDSMONOEN CUT_DS_MONO_EN_MERGED_STRUCT 0.45 0.5 0.55 0.6 0.65 0.7 0.75 arcsin(sqrt(R−Precision)) 52 53 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-EN-CLEF2007 Statistics for Number of relevant retrieved documents Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 50.00 79.00 86.00 89.00 90.00 79.87 13.11 10.00 40.00 0.16 78.66 77.23 9.78 64.00 90.00 84.15 7.10 177-DS 17.00 32.00 39.00 42.75 47.00 36.67 8.64 10.75 30.00 0.24 35.49 34.05 6.93 17.00 47.00 36.67 8.64 178-DS 27.00 60.50 69.00 97.75 104.00 74.67 23.72 37.25 77.00 0.32 70.44 65.33 19.87 27.00 104.00 74.67 23.72 179-DS 83.00 101.25 104.00 104.00 105.00 100.00 7.53 2.75 22.00 0.08 99.71 99.40 5.60 101.00 105.00 103.50 1.38 180-DS 235.00 285.25 303.00 316.75 336.00 296.87 29.60 31.50 101.00 0.10 295.38 293.79 22.03 284.00 336.00 306.31 17.27 181-DS 14.00 16.00 17.00 17.00 17.00 16.53 0.83 1.00 3.00 0.05 16.51 16.49 0.62 16.00 17.00 16.71 0.47 182-DS 15.00 44.00 49.00 56.00 63.00 48.53 11.46 12.00 48.00 0.24 46.57 43.31 7.96 42.00 63.00 50.93 6.98 183-DS 53.00 101.75 114.00 121.75 133.00 109.47 20.09 20.00 80.00 0.18 107.23 104.26 14.18 90.00 133.00 113.50 13.11 184-DS 161.00 214.75 235.00 253.50 264.00 232.53 26.80 38.75 103.00 0.12 230.92 229.11 19.76 161.00 264.00 232.53 26.80 185-DS 15.00 25.75 33.00 48.75 66.00 38.40 15.46 23.00 51.00 0.40 35.54 32.76 12.48 15.00 66.00 38.40 15.46 186-DS 19.00 28.50 36.00 37.00 43.00 33.20 6.11 8.50 24.00 0.18 32.60 31.92 4.96 19.00 43.00 33.20 6.11 187-DS 200.00 318.50 351.00 358.50 406.00 332.27 59.31 40.00 206.00 0.18 326.33 319.23 43.11 290.00 406.00 351.85 31.39 188-DS 162.00 270.25 277.00 285.75 291.00 269.20 31.48 15.50 129.00 0.12 266.95 264.01 17.55 251.00 291.00 276.86 10.96 189-DS 21.00 24.75 28.00 33.50 42.00 29.80 6.49 8.75 21.00 0.22 29.17 28.59 5.09 21.00 42.00 29.80 6.49 190-DS 52.00 104.50 106.00 106.00 106.00 98.67 18.56 1.50 54.00 0.19 96.40 93.31 12.18 104.00 106.00 105.69 0.75 191-DS 31.00 47.00 52.00 58.75 63.00 51.60 9.13 11.75 32.00 0.18 50.75 49.80 7.36 31.00 63.00 51.60 9.13 192-DS 33.00 79.00 83.00 91.75 97.00 77.27 22.24 12.75 64.00 0.29 73.07 67.56 16.64 79.00 97.00 87.67 6.17 193-DS 187.00 302.00 319.00 352.25 367.00 318.20 44.75 50.25 180.00 0.14 314.61 310.16 30.85 288.00 367.00 327.57 27.16 194-DS 71.00 143.75 170.00 188.50 201.00 161.87 34.22 44.75 130.00 0.21 157.50 151.68 26.41 130.00 201.00 168.36 24.10 195-DS 117.00 304.75 346.00 357.75 366.00 322.93 63.32 53.00 249.00 0.20 313.57 298.13 41.42 282.00 366.00 337.64 28.67 196-DS 18.00 41.50 44.00 44.00 45.00 39.87 9.04 2.50 27.00 0.23 38.43 36.38 6.08 38.00 45.00 43.23 1.83 197-DS 98.00 112.00 148.00 151.00 157.00 135.00 21.50 39.00 59.00 0.16 133.27 131.43 18.80 98.00 157.00 135.00 21.50 198-DS 146.00 175.75 188.00 201.00 207.00 185.13 18.88 25.25 61.00 0.10 184.18 183.17 14.49 146.00 207.00 185.13 18.88 199-DS 21.00 52.25 61.00 65.50 68.00 55.27 14.92 13.25 47.00 0.27 52.43 48.31 10.54 48.00 68.00 60.46 6.36 200-DS 47.00 73.75 80.00 87.25 92.00 78.67 11.43 13.50 45.00 0.15 77.74 76.62 8.18 67.00 92.00 80.93 7.62 54 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-EN-CLEF2007 Statistics for Average Precsion Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.2570 0.4177 0.5316 0.6543 0.7119 0.5256 0.1491 0.2366 0.4549 0.2837 0.5025 0.4764 0.1206 0.2570 0.7119 0.5256 0.1491 177-DS 0.0137 0.0265 0.0700 0.0932 0.1330 0.0671 0.0386 0.0667 0.1192 0.5758 0.0540 0.0408 0.0326 0.0137 0.1330 0.0671 0.0386 178-DS 0.0385 0.0849 0.1356 0.1501 0.1596 0.1141 0.0404 0.0652 0.1211 0.3541 0.1058 0.0958 0.0361 0.0385 0.1596 0.1141 0.0404 179-DS 0.2723 0.3784 0.4134 0.4570 0.5349 0.4067 0.0700 0.0786 0.2627 0.1721 0.4005 0.3939 0.0513 0.2723 0.5349 0.4067 0.0700 180-DS 0.4285 0.5406 0.5632 0.5924 0.6459 0.5572 0.0602 0.0518 0.2175 0.1081 0.5539 0.5503 0.0417 0.5387 0.6459 0.5768 0.0333 181-DS 0.0724 0.2145 0.3582 0.3969 0.4562 0.3048 0.1226 0.1824 0.3838 0.4022 0.2696 0.2198 0.1022 0.0724 0.4562 0.3048 0.1226 182-DS 0.0278 0.0546 0.0797 0.1426 0.1592 0.0911 0.0441 0.0879 0.1314 0.4841 0.0810 0.0715 0.0379 0.0278 0.1592 0.0911 0.0441 183-DS 0.0832 0.2014 0.3087 0.3942 0.4646 0.3029 0.1127 0.1928 0.3815 0.3719 0.2785 0.2475 0.0910 0.0832 0.4646 0.3029 0.1127 184-DS 0.2011 0.2688 0.2906 0.3768 0.4607 0.3136 0.0704 0.1080 0.2596 0.2246 0.3065 0.2997 0.0571 0.2011 0.4607 0.3136 0.0704 185-DS 0.0123 0.0406 0.0516 0.0729 0.2248 0.0712 0.0634 0.0323 0.2125 0.8916 0.0536 0.0414 0.0417 0.0123 0.0813 0.0482 0.0205 186-DS 0.0206 0.0443 0.0521 0.0589 0.2420 0.0635 0.0518 0.0145 0.2214 0.8151 0.0537 0.0480 0.0281 0.0344 0.0723 0.0503 0.0104 187-DS 0.2397 0.3565 0.4551 0.5066 0.6106 0.4311 0.1111 0.1502 0.3709 0.2577 0.4163 0.4001 0.0890 0.2397 0.6106 0.4311 0.1111 188-DS 0.1769 0.5153 0.5583 0.5674 0.6411 0.5187 0.1167 0.0521 0.4641 0.2249 0.4997 0.4697 0.0782 0.5109 0.6411 0.5669 0.0373 189-DS 0.0323 0.0472 0.1016 0.1583 0.2217 0.1049 0.0615 0.1111 0.1893 0.5870 0.0880 0.0736 0.0519 0.0323 0.2217 0.1049 0.0615 190-DS 0.0642 0.1816 0.2209 0.2358 0.2641 0.1977 0.0595 0.0542 0.1998 0.3012 0.1846 0.1652 0.0427 0.1656 0.2641 0.2179 0.0287 191-DS 0.0840 0.0989 0.1405 0.3148 0.4301 0.2068 0.1237 0.2159 0.3461 0.5979 0.1751 0.1502 0.1070 0.0840 0.4301 0.2068 0.1237 192-DS 0.0414 0.1689 0.2131 0.2589 0.3591 0.2081 0.0899 0.0900 0.3176 0.4320 0.1834 0.1505 0.0674 0.0414 0.3591 0.2081 0.0899 193-DS 0.2090 0.4059 0.4755 0.5228 0.5879 0.4557 0.1022 0.1170 0.3789 0.2242 0.4423 0.4255 0.0770 0.3228 0.5879 0.4733 0.0789 194-DS 0.0649 0.2029 0.2648 0.4099 0.4965 0.2923 0.1278 0.2070 0.4316 0.4372 0.2609 0.2221 0.1095 0.0649 0.4965 0.2923 0.1278 195-DS 0.0776 0.4774 0.5466 0.5749 0.6356 0.5063 0.1387 0.0975 0.5580 0.2739 0.4677 0.3797 0.0927 0.3938 0.6356 0.5370 0.0746 196-DS 0.0734 0.1611 0.1934 0.2078 0.2499 0.1819 0.0505 0.0466 0.1766 0.2776 0.1726 0.1598 0.0367 0.1566 0.2499 0.1985 0.0267 197-DS 0.1508 0.1952 0.4037 0.4848 0.5641 0.3617 0.1523 0.2895 0.4132 0.4210 0.3274 0.2921 0.1324 0.1508 0.5641 0.3617 0.1523 198-DS 0.1897 0.3788 0.4736 0.5330 0.5804 0.4409 0.1175 0.1543 0.3907 0.2664 0.4223 0.3991 0.0953 0.1897 0.5804 0.4409 0.1175 199-DS 0.0936 0.2267 0.2500 0.2866 0.3396 0.2434 0.0706 0.0598 0.2460 0.2901 0.2300 0.2114 0.0473 0.2131 0.3396 0.2664 0.0393 200-DS 0.0325 0.0993 0.1349 0.1592 0.1739 0.1262 0.0392 0.0599 0.1414 0.3108 0.1179 0.1054 0.0299 0.0325 0.1739 0.1262 0.0392 55 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-EN-CLEF2007 Statistics for R-Precision Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.2778 0.4917 0.5556 0.6500 0.7000 0.5504 0.1118 0.1583 0.4222 0.2032 0.5379 0.5228 0.0870 0.2778 0.7000 0.5504 0.1118 177-DS 0.0175 0.0482 0.1228 0.1711 0.2105 0.1181 0.0668 0.1228 0.1930 0.5654 0.0912 0.0603 0.0547 0.0175 0.2105 0.1181 0.0668 178-DS 0.0732 0.1723 0.2195 0.2500 0.2805 0.2065 0.0558 0.0777 0.2073 0.2704 0.1974 0.1850 0.0440 0.0732 0.2805 0.2065 0.0558 179-DS 0.3670 0.4610 0.4954 0.5138 0.5505 0.4801 0.0521 0.0528 0.1835 0.1085 0.4773 0.4741 0.0379 0.4495 0.5505 0.4968 0.0299 180-DS 0.4973 0.5428 0.5642 0.5929 0.6497 0.5688 0.0407 0.0501 0.1524 0.0716 0.5674 0.5661 0.0320 0.4973 0.6497 0.5688 0.0407 181-DS 0.1111 0.2778 0.3333 0.4444 0.4444 0.3296 0.1159 0.1667 0.3333 0.3516 0.3036 0.2693 0.0933 0.1111 0.4444 0.3296 0.1159 182-DS 0.0658 0.0954 0.1316 0.2138 0.2500 0.1491 0.0618 0.1184 0.1842 0.4148 0.1374 0.1267 0.0544 0.0658 0.2500 0.1491 0.0618 183-DS 0.1788 0.3079 0.3576 0.4371 0.4768 0.3695 0.0829 0.1291 0.2980 0.2244 0.3593 0.3470 0.0675 0.1788 0.4768 0.3695 0.0829 184-DS 0.3092 0.3705 0.3983 0.4401 0.4903 0.4039 0.0551 0.0696 0.1811 0.1363 0.4003 0.3967 0.0423 0.3092 0.4903 0.4039 0.0551 185-DS 0.0472 0.0866 0.1024 0.1339 0.3780 0.1360 0.0972 0.0472 0.3307 0.7149 0.1153 0.1023 0.0632 0.0472 0.1496 0.1005 0.0284 186-DS 0.0566 0.0755 0.0943 0.0943 0.2642 0.0956 0.0502 0.0189 0.2075 0.5247 0.0881 0.0831 0.0272 0.0566 0.1132 0.0836 0.0192 187-DS 0.3400 0.4406 0.4930 0.5387 0.6358 0.4907 0.0856 0.0981 0.2958 0.1744 0.4834 0.4758 0.0649 0.3400 0.6358 0.4907 0.0856 188-DS 0.2807 0.5212 0.5585 0.5819 0.6023 0.5300 0.0870 0.0607 0.3216 0.1641 0.5213 0.5100 0.0593 0.4854 0.6023 0.5596 0.0343 189-DS 0.0455 0.0909 0.1136 0.1989 0.2955 0.1394 0.0791 0.1080 0.2500 0.5677 0.1192 0.1014 0.0646 0.0455 0.2955 0.1394 0.0791 190-DS 0.1604 0.2170 0.2547 0.2783 0.3113 0.2415 0.0462 0.0613 0.1509 0.1913 0.2371 0.2323 0.0372 0.1604 0.3113 0.2415 0.0462 191-DS 0.1250 0.1719 0.2031 0.3594 0.4844 0.2573 0.1181 0.1875 0.3594 0.4590 0.2351 0.2169 0.0993 0.1250 0.4844 0.2573 0.1181 192-DS 0.1308 0.2173 0.2804 0.2991 0.4206 0.2729 0.0766 0.0818 0.2897 0.2807 0.2624 0.2511 0.0578 0.1308 0.4206 0.2729 0.0766 193-DS 0.3015 0.4431 0.5206 0.5727 0.5944 0.5015 0.0832 0.1296 0.2928 0.1659 0.4942 0.4857 0.0652 0.3015 0.5944 0.5015 0.0832 194-DS 0.1806 0.3304 0.3921 0.5154 0.5771 0.4079 0.1147 0.1850 0.3965 0.2812 0.3909 0.3716 0.0921 0.1806 0.5771 0.4079 0.1147 195-DS 0.1685 0.5213 0.5888 0.6045 0.6584 0.5452 0.1149 0.0831 0.4899 0.2108 0.5255 0.4904 0.0692 0.4899 0.6584 0.5721 0.0504 196-DS 0.1556 0.1556 0.2222 0.2611 0.2889 0.2148 0.0515 0.1056 0.1333 0.2400 0.2089 0.2031 0.0444 0.1556 0.2889 0.2148 0.0515 197-DS 0.2500 0.3096 0.4651 0.5291 0.5872 0.4244 0.1184 0.2195 0.3372 0.2789 0.4080 0.3912 0.1031 0.2500 0.5872 0.4244 0.1184 198-DS 0.2929 0.3808 0.5063 0.5523 0.5690 0.4714 0.0969 0.1715 0.2762 0.2056 0.4609 0.4492 0.0822 0.2929 0.5690 0.4714 0.0969 199-DS 0.1972 0.2289 0.2958 0.3204 0.3380 0.2751 0.0535 0.0915 0.1408 0.1943 0.2699 0.2645 0.0473 0.1972 0.3380 0.2751 0.0535 200-DS 0.1288 0.2008 0.2273 0.2803 0.3030 0.2303 0.0509 0.0795 0.1742 0.2209 0.2246 0.2184 0.0396 0.1288 0.3030 0.2303 0.0509 56 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-EN-CLEF2007 Statistics for Binary Preference Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.2411 0.4314 0.5468 0.6581 0.7541 0.5507 0.1450 0.2267 0.5130 0.2633 0.5297 0.5049 0.1174 0.2411 0.7541 0.5507 0.1450 177-DS 0.0049 0.0202 0.0840 0.1049 0.1354 0.0726 0.0471 0.0846 0.1305 0.6486 0.0452 0.0191 0.0384 0.0049 0.1354 0.0726 0.0471 178-DS 0.0686 0.1464 0.1688 0.1969 0.2197 0.1675 0.0403 0.0505 0.1511 0.2408 0.1617 0.1541 0.0304 0.1156 0.2197 0.1746 0.0307 179-DS 0.2936 0.3932 0.4247 0.4528 0.5116 0.4156 0.0603 0.0596 0.2180 0.1450 0.4111 0.4062 0.0431 0.3836 0.5116 0.4342 0.0378 180-DS 0.4794 0.5937 0.6206 0.6492 0.6585 0.6083 0.0568 0.0555 0.1791 0.0935 0.6055 0.6025 0.0414 0.5883 0.6585 0.6277 0.0265 181-DS 0.0988 0.1798 0.3117 0.3642 0.4321 0.2776 0.1136 0.1844 0.3333 0.4093 0.2511 0.2214 0.0990 0.0988 0.4321 0.2776 0.1136 182-DS 0.0429 0.0620 0.0867 0.1481 0.1968 0.1029 0.0486 0.0861 0.1539 0.4729 0.0924 0.0832 0.0424 0.0429 0.1968 0.1029 0.0486 183-DS 0.1678 0.2447 0.3287 0.4017 0.4705 0.3302 0.0926 0.1571 0.3028 0.2805 0.3170 0.3031 0.0774 0.1678 0.4705 0.3302 0.0926 184-DS 0.4155 0.4443 0.4716 0.5560 0.6197 0.4959 0.0645 0.1116 0.2042 0.1300 0.4922 0.4886 0.0521 0.4155 0.6197 0.4959 0.0645 185-DS 0.0308 0.0735 0.0876 0.1005 0.3075 0.1096 0.0786 0.0270 0.2767 0.7172 0.0924 0.0806 0.0508 0.0566 0.1174 0.0851 0.0171 186-DS 0.0228 0.0431 0.0552 0.0670 0.2154 0.0636 0.0441 0.0239 0.1926 0.6932 0.0559 0.0510 0.0234 0.0228 0.0730 0.0528 0.0140 187-DS 0.3579 0.5366 0.6324 0.6700 0.7460 0.5968 0.1156 0.1334 0.3881 0.1937 0.5846 0.5704 0.0900 0.3579 0.7460 0.5968 0.1156 188-DS 0.3123 0.5544 0.6469 0.7149 0.7622 0.6134 0.1330 0.1605 0.4499 0.2168 0.5970 0.5772 0.1028 0.3952 0.7622 0.6349 0.1076 189-DS 0.0362 0.0562 0.0785 0.1573 0.2381 0.1065 0.0640 0.1011 0.2020 0.6014 0.0899 0.0763 0.0535 0.0362 0.2381 0.1065 0.0640 190-DS 0.0901 0.1282 0.1602 0.1828 0.2315 0.1574 0.0414 0.0545 0.1414 0.2630 0.1519 0.1461 0.0315 0.0901 0.2315 0.1574 0.0414 191-DS 0.0952 0.1073 0.1423 0.2679 0.4199 0.1967 0.1147 0.1606 0.3247 0.5833 0.1707 0.1516 0.0955 0.0952 0.4199 0.1967 0.1147 192-DS 0.0924 0.1599 0.2057 0.2330 0.3647 0.2097 0.0702 0.0731 0.2723 0.3346 0.1989 0.1880 0.0507 0.0924 0.3209 0.1986 0.0576 193-DS 0.3520 0.5843 0.6260 0.6518 0.7062 0.6053 0.0895 0.0675 0.3542 0.1479 0.5977 0.5884 0.0629 0.5094 0.7062 0.6234 0.0578 194-DS 0.1911 0.2986 0.3921 0.5493 0.6272 0.4262 0.1400 0.2507 0.4361 0.3284 0.4032 0.3793 0.1216 0.1911 0.6272 0.4262 0.1400 195-DS 0.2016 0.5734 0.6944 0.7127 0.7351 0.6357 0.1373 0.1393 0.5336 0.2160 0.6125 0.5726 0.0939 0.5391 0.7351 0.6667 0.0690 196-DS 0.0830 0.1052 0.1565 0.1740 0.2143 0.1451 0.0432 0.0688 0.1314 0.2979 0.1388 0.1324 0.0367 0.0830 0.2143 0.1451 0.0432 197-DS 0.2443 0.2798 0.4611 0.5417 0.5954 0.4189 0.1292 0.2618 0.3512 0.3084 0.3990 0.3787 0.1132 0.2443 0.5954 0.4189 0.1292 198-DS 0.3929 0.4712 0.6066 0.6204 0.6728 0.5546 0.0893 0.1492 0.2798 0.1609 0.5474 0.5396 0.0777 0.3929 0.6728 0.5546 0.0893 199-DS 0.1625 0.1853 0.2392 0.2541 0.3003 0.2253 0.0452 0.0688 0.1379 0.2009 0.2209 0.2165 0.0382 0.1625 0.3003 0.2253 0.0452 200-DS 0.0732 0.1309 0.1685 0.2143 0.2327 0.1703 0.0478 0.0835 0.1594 0.2805 0.1629 0.1542 0.0377 0.0732 0.2327 0.1703 0.0478 57 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-EN-CLEF2007 Statistics for Precision at the 0% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.7222 1.0000 1.0000 1.0000 1.0000 0.9620 0.0841 0.0000 0.2778 0.0874 0.9581 0.9537 0.0607 1.0000 1.0000 1.0000 0.0000 177-DS 0.0523 0.0890 0.2055 0.3250 0.6000 0.2398 0.1707 0.2360 0.5477 0.7118 0.1824 0.1328 0.1306 0.0523 0.6000 0.2398 0.1707 178-DS 0.6364 1.0000 1.0000 1.0000 1.0000 0.9758 0.0939 0.0000 0.3636 0.0962 0.9703 0.9633 0.0453 1.0000 1.0000 1.0000 0.0000 179-DS 0.5370 0.6184 0.7778 1.0000 1.0000 0.7849 0.1950 0.3816 0.4630 0.2484 0.7621 0.7398 0.1741 0.5370 1.0000 0.7849 0.1950 180-DS 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 0.0000 0.0000 0.0000 0.0000 1.0000 1.0000 0.0000 1.0000 1.0000 1.0000 0.0000 181-DS 0.3636 0.5000 1.0000 1.0000 1.0000 0.7645 0.2671 0.5000 0.6364 0.3494 0.7160 0.6662 0.2512 0.3636 1.0000 0.7645 0.2671 182-DS 0.2000 0.2946 0.5000 1.0000 1.0000 0.6552 0.3483 0.7054 0.8000 0.5316 0.5518 0.4500 0.3218 0.2000 1.0000 0.6552 0.3483 183-DS 0.5714 0.8333 1.0000 1.0000 1.0000 0.9025 0.1369 0.1667 0.4286 0.1517 0.8912 0.8781 0.1081 0.6667 1.0000 0.9262 0.1056 184-DS 0.6744 1.0000 1.0000 1.0000 1.0000 0.9783 0.0841 0.0000 0.3256 0.0859 0.9741 0.9688 0.0405 1.0000 1.0000 1.0000 0.0000 185-DS 0.5000 0.5000 0.6250 0.7292 1.0000 0.6717 0.1870 0.2292 0.5000 0.2784 0.6500 0.6311 0.1418 0.5000 1.0000 0.6717 0.1870 186-DS 0.0682 0.1875 1.0000 1.0000 1.0000 0.6629 0.4001 0.8125 0.9318 0.6037 0.4857 0.2990 0.3601 0.0682 1.0000 0.6629 0.4001 187-DS 0.8889 1.0000 1.0000 1.0000 1.0000 0.9926 0.0287 0.0000 0.1111 0.0289 0.9922 0.9917 0.0138 1.0000 1.0000 1.0000 0.0000 188-DS 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 0.0000 0.0000 0.0000 0.0000 1.0000 1.0000 0.0000 1.0000 1.0000 1.0000 0.0000 189-DS 0.1000 0.3125 0.6667 1.0000 1.0000 0.6563 0.3426 0.6875 0.9000 0.5220 0.5343 0.3879 0.2840 0.1000 1.0000 0.6563 0.3426 190-DS 0.2500 0.3333 0.5882 1.0000 1.0000 0.6387 0.3223 0.6667 0.7500 0.5046 0.5589 0.4873 0.2890 0.2500 1.0000 0.6387 0.3223 191-DS 0.5000 0.5000 0.7000 1.0000 1.0000 0.7600 0.2384 0.5000 0.5000 0.3137 0.7240 0.6893 0.2240 0.5000 1.0000 0.7600 0.2384 192-DS 0.4286 1.0000 1.0000 1.0000 1.0000 0.9219 0.1763 0.0000 0.5714 0.1912 0.8999 0.8696 0.1250 1.0000 1.0000 1.0000 0.0000 193-DS 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 0.0000 0.0000 0.0000 0.0000 1.0000 1.0000 0.0000 1.0000 1.0000 1.0000 0.0000 194-DS 0.3590 0.4858 0.6300 0.9314 1.0000 0.6640 0.2354 0.4455 0.6410 0.3546 0.6261 0.5907 0.1939 0.3590 1.0000 0.6640 0.2354 195-DS 0.8077 1.0000 1.0000 1.0000 1.0000 0.9746 0.0671 0.0000 0.1923 0.0689 0.9722 0.9695 0.0441 1.0000 1.0000 1.0000 0.0000 196-DS 0.2581 0.3333 0.3333 0.4821 1.0000 0.4813 0.2754 0.1488 0.7419 0.5723 0.4275 0.3918 0.2100 0.2581 0.5000 0.3517 0.0696 197-DS 0.4545 1.0000 1.0000 1.0000 1.0000 0.9106 0.1893 0.0000 0.5455 0.2079 0.8862 0.8544 0.1430 1.0000 1.0000 1.0000 0.0000 198-DS 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 0.0000 0.0000 0.0000 0.0000 1.0000 1.0000 0.0000 1.0000 1.0000 1.0000 0.0000 199-DS 0.5217 1.0000 1.0000 1.0000 1.0000 0.9586 0.1263 0.0000 0.4783 0.1318 0.9478 0.9326 0.0718 1.0000 1.0000 1.0000 0.0000 200-DS 0.1489 0.3271 0.4211 0.4861 1.0000 0.4802 0.2862 0.1590 0.8511 0.5960 0.4126 0.3571 0.2106 0.1489 0.5000 0.3502 0.1101 58 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-EN-CLEF2007 Statistics for Precision at the 10% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.6364 0.7292 0.8182 0.8911 0.9500 0.8066 0.0966 0.1619 0.3136 0.1198 0.8010 0.7952 0.0788 0.6364 0.9500 0.8066 0.0966 177-DS 0.0380 0.0607 0.1684 0.2264 0.5455 0.1995 0.1641 0.1657 0.5075 0.8224 0.1436 0.1022 0.1183 0.0380 0.3333 0.1463 0.0916 178-DS 0.0346 0.2834 0.3205 0.3995 0.7391 0.3549 0.1671 0.1161 0.7045 0.4709 0.3054 0.2143 0.1117 0.2152 0.4186 0.3247 0.0607 179-DS 0.5312 0.5592 0.6176 0.7193 0.8571 0.6428 0.1054 0.1601 0.3259 0.1639 0.6353 0.6284 0.0844 0.5312 0.8571 0.6428 0.1054 180-DS 0.8824 0.9028 0.9231 0.9366 0.9474 0.9185 0.0210 0.0339 0.0650 0.0228 0.9183 0.9181 0.0176 0.8824 0.9474 0.9185 0.0210 181-DS 0.3333 0.4821 0.5000 0.6310 1.0000 0.5439 0.1589 0.1488 0.6667 0.2921 0.5256 0.5098 0.1099 0.3333 0.6667 0.5113 0.1002 182-DS 0.1047 0.1214 0.2051 0.3193 0.4167 0.2192 0.1056 0.1979 0.3120 0.4820 0.1958 0.1754 0.0924 0.1047 0.4167 0.2192 0.1056 183-DS 0.3091 0.4536 0.7083 0.8399 0.8889 0.6477 0.2092 0.3863 0.5798 0.3230 0.6108 0.5702 0.1782 0.3091 0.8889 0.6477 0.2092 184-DS 0.3159 0.4406 0.6500 0.7808 0.9474 0.6258 0.1924 0.3402 0.6314 0.3075 0.5963 0.5657 0.1560 0.3159 0.9474 0.6258 0.1924 185-DS 0.0153 0.0656 0.1275 0.1640 0.5909 0.1696 0.1771 0.0985 0.5756 1.0444 0.1139 0.0758 0.1158 0.0153 0.2031 0.1054 0.0555 186-DS 0.0455 0.0721 0.0840 0.1087 0.5000 0.1141 0.1092 0.0366 0.4545 0.9572 0.0938 0.0844 0.0533 0.0455 0.1277 0.0866 0.0240 187-DS 0.6870 0.7780 0.8736 0.9249 0.9516 0.8436 0.0910 0.1469 0.2647 0.1078 0.8388 0.8338 0.0789 0.6870 0.9516 0.8436 0.0910 188-DS 0.4600 0.8195 0.9324 0.9572 1.0000 0.8789 0.1386 0.1377 0.5400 0.1577 0.8654 0.8475 0.0975 0.7377 1.0000 0.9088 0.0789 189-DS 0.0435 0.0698 0.1481 0.6076 0.8333 0.2963 0.2951 0.5378 0.7899 0.9961 0.1771 0.1155 0.2615 0.0435 0.8333 0.2963 0.2951 190-DS 0.1875 0.2309 0.2712 0.3098 0.5500 0.2983 0.1040 0.0788 0.3625 0.3485 0.2843 0.2727 0.0715 0.1875 0.3636 0.2634 0.0512 191-DS 0.1509 0.1973 0.3571 0.6412 0.8462 0.4301 0.2525 0.4439 0.6952 0.5869 0.3610 0.3033 0.2215 0.1509 0.8462 0.4301 0.2525 192-DS 0.1833 0.3761 0.4231 0.5542 0.8000 0.4660 0.1599 0.1781 0.6167 0.3432 0.4402 0.4129 0.1188 0.1833 0.8000 0.4660 0.1599 193-DS 0.6452 0.7964 0.9054 0.9196 0.9818 0.8590 0.1030 0.1232 0.3367 0.1199 0.8527 0.8460 0.0804 0.6452 0.9818 0.8590 0.1030 194-DS 0.3086 0.4215 0.4811 0.6215 0.7255 0.5128 0.1257 0.2000 0.4168 0.2452 0.4984 0.4843 0.1063 0.3086 0.7255 0.5128 0.1257 195-DS 0.2695 0.8324 0.9016 0.9343 0.9811 0.8569 0.1714 0.1019 0.7117 0.2000 0.8281 0.7754 0.0961 0.8077 0.9811 0.8989 0.0564 196-DS 0.1808 0.2312 0.2941 0.3523 0.4615 0.2980 0.0803 0.1211 0.2807 0.2693 0.2882 0.2787 0.0606 0.1808 0.4615 0.2980 0.0803 197-DS 0.3434 0.4752 0.6923 0.7555 0.9600 0.6582 0.1915 0.2802 0.6166 0.2909 0.6296 0.5989 0.1514 0.3434 0.9600 0.6582 0.1915 198-DS 0.4615 0.8697 0.9231 0.9528 1.0000 0.8773 0.1362 0.0831 0.5385 0.1552 0.8642 0.8467 0.0863 0.8276 1.0000 0.9225 0.0508 199-DS 0.4444 0.5237 0.6154 0.6859 0.8182 0.6096 0.1186 0.1622 0.3737 0.1946 0.5989 0.5885 0.0980 0.4444 0.8182 0.6096 0.1186 200-DS 0.1489 0.2423 0.3333 0.4075 0.4828 0.3236 0.0958 0.1652 0.3338 0.2962 0.3087 0.2924 0.0782 0.1489 0.4828 0.3236 0.0958 59 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-EN-CLEF2007 Statistics for Precision at the 20% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.3725 0.5898 0.6897 0.8645 0.9500 0.7001 0.1652 0.2747 0.5775 0.2359 0.6807 0.6598 0.1371 0.3725 0.9500 0.7001 0.1652 177-DS 0.0189 0.0553 0.1316 0.1717 0.2182 0.1193 0.0698 0.1164 0.1993 0.5850 0.0960 0.0717 0.0619 0.0189 0.2182 0.1193 0.0698 178-DS 0.0000 0.1671 0.2378 0.3265 0.3667 0.2267 0.1059 0.1594 0.3667 0.4670 0.1155 0.0001 0.0859 0.0000 0.3667 0.2267 0.1059 179-DS 0.4000 0.5592 0.5897 0.6383 0.8125 0.5918 0.1054 0.0790 0.4125 0.1781 0.5827 0.5732 0.0721 0.5370 0.7353 0.6048 0.0557 180-DS 0.8175 0.8695 0.8800 0.8999 0.9375 0.8799 0.0329 0.0304 0.1200 0.0374 0.8793 0.8787 0.0237 0.8333 0.9375 0.8843 0.0291 181-DS 0.0360 0.3141 0.4483 0.5000 0.6667 0.3933 0.1688 0.1859 0.6306 0.4291 0.3251 0.2048 0.1287 0.0360 0.6667 0.3933 0.1688 182-DS 0.0000 0.0920 0.1374 0.2184 0.4103 0.1561 0.0986 0.1264 0.4103 0.6314 0.0783 0.0001 0.0736 0.0000 0.2540 0.1380 0.0717 183-DS 0.1584 0.4211 0.5636 0.6984 0.8421 0.5502 0.1933 0.2774 0.6837 0.3512 0.5097 0.4573 0.1571 0.1584 0.8421 0.5502 0.1933 184-DS 0.3159 0.4256 0.5538 0.7079 0.8696 0.5693 0.1728 0.2823 0.5536 0.3035 0.5447 0.5208 0.1430 0.3159 0.8696 0.5693 0.1728 185-DS 0.0000 0.0071 0.0517 0.0769 0.4815 0.1012 0.1567 0.0698 0.4815 1.5489 0.0076 0.0000 0.1043 0.0000 0.1317 0.0434 0.0386 186-DS 0.0386 0.0544 0.0650 0.0723 0.4783 0.0901 0.1081 0.0179 0.4397 1.1993 0.0701 0.0635 0.0518 0.0386 0.0855 0.0624 0.0124 187-DS 0.6329 0.7134 0.8347 0.8602 0.9231 0.7908 0.0920 0.1468 0.2902 0.1164 0.7856 0.7802 0.0789 0.6329 0.9231 0.7908 0.0920 188-DS 0.4083 0.7605 0.9125 0.9338 0.9722 0.8298 0.1544 0.1733 0.5639 0.1860 0.8127 0.7903 0.1203 0.6552 0.9722 0.8599 0.1050 189-DS 0.0435 0.0673 0.0938 0.2267 0.3667 0.1412 0.0993 0.1593 0.3232 0.7029 0.1145 0.0957 0.0806 0.0435 0.3667 0.1412 0.0993 190-DS 0.1875 0.2238 0.2712 0.2971 0.3731 0.2651 0.0500 0.0734 0.1856 0.1888 0.2606 0.2561 0.0383 0.1875 0.3731 0.2651 0.0500 191-DS 0.1215 0.1777 0.2419 0.3930 0.8333 0.3264 0.2213 0.2153 0.7118 0.6780 0.2732 0.2371 0.1715 0.1215 0.5758 0.2558 0.1275 192-DS 0.0455 0.2309 0.3086 0.3863 0.4898 0.2989 0.1287 0.1554 0.4442 0.4307 0.2600 0.2019 0.1013 0.0455 0.4898 0.2989 0.1287 193-DS 0.5569 0.7404 0.8739 0.8939 0.9495 0.8056 0.1272 0.1535 0.3926 0.1579 0.7951 0.7834 0.1043 0.5569 0.9495 0.8056 0.1272 194-DS 0.1474 0.3887 0.4811 0.6215 0.7179 0.4922 0.1554 0.2329 0.5705 0.3158 0.4628 0.4229 0.1246 0.1474 0.7179 0.4922 0.1554 195-DS 0.1498 0.8094 0.8692 0.8841 0.9238 0.8162 0.1891 0.0747 0.7740 0.2317 0.7678 0.6544 0.0979 0.7899 0.9238 0.8639 0.0438 196-DS 0.1261 0.2178 0.2812 0.3136 0.4231 0.2708 0.0775 0.0958 0.2970 0.2863 0.2594 0.2469 0.0587 0.1261 0.4231 0.2708 0.0775 197-DS 0.3419 0.4167 0.6271 0.7364 0.8537 0.5918 0.1790 0.3197 0.5118 0.3024 0.5646 0.5364 0.1521 0.3419 0.8537 0.5918 0.1790 198-DS 0.4571 0.6518 0.8136 0.8549 0.9153 0.7427 0.1452 0.2031 0.4581 0.1955 0.7274 0.7099 0.1170 0.4571 0.9153 0.7427 0.1452 199-DS 0.1154 0.2438 0.3571 0.4423 0.6000 0.3507 0.1421 0.1985 0.4846 0.4053 0.3186 0.2816 0.1109 0.1154 0.6000 0.3507 0.1421 200-DS 0.0891 0.2151 0.2755 0.3223 0.3836 0.2622 0.0807 0.1072 0.2945 0.3075 0.2475 0.2285 0.0626 0.0891 0.3836 0.2622 0.0807 60 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-EN-CLEF2007 Statistics for Precision at the 30% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.3063 0.5898 0.6279 0.8057 0.8919 0.6720 0.1578 0.2158 0.5856 0.2348 0.6518 0.6275 0.1259 0.3063 0.8919 0.6720 0.1578 177-DS 0.0000 0.0523 0.1044 0.1332 0.1900 0.0966 0.0547 0.0809 0.1900 0.5661 0.0497 0.0001 0.0456 0.0000 0.1900 0.0966 0.0547 178-DS 0.0000 0.0784 0.1250 0.1583 0.2427 0.1246 0.0729 0.0799 0.2427 0.5850 0.0377 0.0001 0.0554 0.0000 0.2427 0.1246 0.0729 179-DS 0.3913 0.5297 0.5600 0.6039 0.6981 0.5587 0.0860 0.0742 0.3068 0.1539 0.5520 0.5449 0.0594 0.5050 0.6981 0.5839 0.0587 180-DS 0.7793 0.8199 0.8310 0.8634 0.8906 0.8337 0.0333 0.0434 0.1113 0.0400 0.8331 0.8324 0.0268 0.7793 0.8906 0.8337 0.0333 181-DS 0.0350 0.2884 0.4483 0.5000 0.5333 0.3738 0.1665 0.2116 0.4983 0.4454 0.2970 0.1670 0.1344 0.0350 0.5333 0.3738 0.1665 182-DS 0.0000 0.0758 0.0983 0.1512 0.2300 0.1105 0.0601 0.0754 0.2300 0.5434 0.0586 0.0001 0.0456 0.0000 0.2300 0.1105 0.0601 183-DS 0.1117 0.3240 0.4381 0.5611 0.6351 0.4334 0.1472 0.2371 0.5235 0.3397 0.4022 0.3582 0.1195 0.1117 0.6351 0.4334 0.1472 184-DS 0.3159 0.4143 0.4866 0.5808 0.7667 0.4934 0.1195 0.1665 0.4507 0.2422 0.4804 0.4679 0.0931 0.3159 0.7667 0.4934 0.1195 185-DS 0.0000 0.0000 0.0000 0.0656 0.4468 0.0706 0.1408 0.0656 0.4468 1.9947 0.0004 0.0000 0.0910 0.0000 0.0763 0.0186 0.0300 186-DS 0.0216 0.0435 0.0547 0.0663 0.2687 0.0673 0.0574 0.0227 0.2471 0.8530 0.0567 0.0508 0.0279 0.0216 0.0721 0.0529 0.0142 187-DS 0.4658 0.5575 0.6466 0.7467 0.8398 0.6570 0.1202 0.1892 0.3739 0.1830 0.6466 0.6364 0.1026 0.4658 0.8398 0.6570 0.1202 188-DS 0.2697 0.7392 0.8268 0.8737 0.9545 0.7680 0.1783 0.1345 0.6848 0.2322 0.7396 0.6965 0.1269 0.5556 0.9545 0.8036 0.1174 189-DS 0.0435 0.0580 0.0793 0.1418 0.3261 0.1185 0.0905 0.0838 0.2826 0.7641 0.0949 0.0804 0.0700 0.0435 0.2500 0.0909 0.0570 190-DS 0.0976 0.2105 0.2558 0.2761 0.3267 0.2384 0.0642 0.0657 0.2292 0.2693 0.2274 0.2128 0.0473 0.2000 0.3267 0.2591 0.0361 191-DS 0.1053 0.1090 0.1838 0.3706 0.6286 0.2567 0.1830 0.2615 0.5233 0.7128 0.2076 0.1746 0.1523 0.1053 0.6286 0.2567 0.1830 192-DS 0.0337 0.2086 0.2482 0.3018 0.4684 0.2405 0.1282 0.0932 0.4346 0.5331 0.1878 0.1198 0.0948 0.2081 0.4022 0.2752 0.0641 193-DS 0.3082 0.6375 0.7596 0.8000 0.8686 0.6971 0.1572 0.1625 0.5604 0.2254 0.6755 0.6473 0.1213 0.4767 0.8686 0.7249 0.1189 194-DS 0.0811 0.3477 0.4570 0.6134 0.7130 0.4639 0.1801 0.2657 0.6319 0.3883 0.4166 0.3423 0.1445 0.0811 0.7130 0.4639 0.1801 195-DS 0.0000 0.7336 0.8221 0.8480 0.8645 0.7449 0.2161 0.1144 0.8645 0.2901 0.3748 0.0001 0.1209 0.6667 0.8645 0.7981 0.0676 196-DS 0.1261 0.2131 0.2333 0.2728 0.3182 0.2360 0.0509 0.0597 0.1921 0.2157 0.2302 0.2237 0.0391 0.1261 0.3182 0.2360 0.0509 197-DS 0.2149 0.3247 0.5806 0.6601 0.8000 0.5131 0.1990 0.3355 0.5851 0.3878 0.4721 0.4289 0.1738 0.2149 0.8000 0.5131 0.1990 198-DS 0.2908 0.5092 0.6964 0.7404 0.8471 0.6267 0.1719 0.2312 0.5562 0.2743 0.5996 0.5671 0.1380 0.2908 0.8471 0.6267 0.1719 199-DS 0.0000 0.2143 0.3113 0.3381 0.4490 0.2717 0.1268 0.1238 0.4490 0.4666 0.1311 0.0001 0.0977 0.0341 0.4490 0.2911 0.1059 200-DS 0.0587 0.1663 0.2116 0.2691 0.3083 0.2104 0.0695 0.1028 0.2496 0.3301 0.1964 0.1769 0.0517 0.0587 0.3083 0.2104 0.0695 61 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-EN-CLEF2007 Statistics for Precision at the 40% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.3019 0.5365 0.5968 0.7746 0.8571 0.6304 0.1460 0.2381 0.5553 0.2315 0.6124 0.5913 0.1162 0.3019 0.8571 0.6304 0.1460 177-DS 0.0000 0.0473 0.0763 0.1242 0.1361 0.0790 0.0428 0.0769 0.1361 0.5420 0.0416 0.0001 0.0363 0.0000 0.1361 0.0790 0.0428 178-DS 0.0000 0.0000 0.0699 0.1307 0.1784 0.0768 0.0661 0.1307 0.1784 0.8607 0.0049 0.0000 0.0549 0.0000 0.1784 0.0768 0.0661 179-DS 0.3860 0.5094 0.5366 0.5878 0.6471 0.5368 0.0757 0.0784 0.2611 0.1409 0.5314 0.5256 0.0543 0.4947 0.6471 0.5598 0.0490 180-DS 0.6008 0.7338 0.7626 0.7765 0.8115 0.7425 0.0562 0.0426 0.2107 0.0757 0.7403 0.7380 0.0400 0.7051 0.8115 0.7610 0.0288 181-DS 0.0350 0.2455 0.4231 0.4940 0.5333 0.3581 0.1678 0.2485 0.4983 0.4685 0.2826 0.1622 0.1353 0.0350 0.5333 0.3581 0.1678 182-DS 0.0000 0.0615 0.0729 0.1312 0.1594 0.0881 0.0438 0.0697 0.1594 0.4975 0.0480 0.0001 0.0356 0.0000 0.1594 0.0881 0.0438 183-DS 0.0000 0.2582 0.3506 0.4885 0.5289 0.3561 0.1479 0.2304 0.5289 0.4154 0.1807 0.0001 0.1165 0.0000 0.5289 0.3561 0.1479 184-DS 0.2657 0.3656 0.4000 0.4768 0.6606 0.4208 0.1015 0.1112 0.3949 0.2411 0.4100 0.3997 0.0750 0.2657 0.5647 0.4037 0.0797 185-DS 0.0000 0.0000 0.0000 0.0000 0.2898 0.0420 0.0987 0.0000 0.2898 2.3483 0.0001 0.0000 0.0673 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0384 0.0541 0.0579 0.2222 0.0574 0.0488 0.0195 0.2222 0.8502 0.0299 0.0001 0.0246 0.0278 0.0706 0.0492 0.0131 187-DS 0.2060 0.4671 0.5399 0.6369 0.8156 0.5468 0.1690 0.1698 0.6096 0.3091 0.5162 0.4776 0.1240 0.2506 0.8156 0.5712 0.1456 188-DS 0.2108 0.6556 0.7296 0.7772 0.8687 0.6778 0.1783 0.1216 0.6580 0.2630 0.6446 0.5937 0.1275 0.5129 0.8687 0.7358 0.0918 189-DS 0.0278 0.0532 0.0595 0.0826 0.2466 0.0846 0.0591 0.0294 0.2188 0.6989 0.0716 0.0632 0.0419 0.0278 0.0837 0.0584 0.0144 190-DS 0.0976 0.1940 0.2028 0.2333 0.2606 0.2027 0.0462 0.0393 0.1630 0.2278 0.1964 0.1882 0.0312 0.1889 0.2606 0.2180 0.0242 191-DS 0.0492 0.0894 0.1656 0.3410 0.5652 0.2230 0.1680 0.2516 0.5160 0.7533 0.1686 0.1272 0.1374 0.0492 0.5652 0.2230 0.1680 192-DS 0.0000 0.1878 0.2075 0.2814 0.4300 0.2097 0.1292 0.0936 0.4300 0.6160 0.0333 0.0000 0.0914 0.1845 0.3839 0.2469 0.0616 193-DS 0.2002 0.4858 0.6407 0.7068 0.8356 0.5988 0.1646 0.2209 0.6353 0.2749 0.5704 0.5307 0.1267 0.2002 0.8356 0.5988 0.1646 194-DS 0.0000 0.2889 0.3948 0.5809 0.6866 0.4195 0.1896 0.2921 0.6866 0.4520 0.2081 0.0001 0.1486 0.0000 0.6866 0.4195 0.1896 195-DS 0.0000 0.6870 0.7306 0.7803 0.8230 0.6818 0.1999 0.0932 0.8230 0.2932 0.3448 0.0001 0.1142 0.5831 0.8230 0.7305 0.0687 196-DS 0.0280 0.1866 0.2149 0.2268 0.3182 0.1993 0.0794 0.0401 0.2902 0.3983 0.1687 0.1147 0.0526 0.1657 0.2439 0.2109 0.0215 197-DS 0.1772 0.2283 0.5000 0.6354 0.6636 0.4393 0.1922 0.4072 0.4864 0.4375 0.3940 0.3483 0.1696 0.1772 0.6636 0.4393 0.1922 198-DS 0.2034 0.3648 0.5740 0.6638 0.7385 0.5312 0.1766 0.2990 0.5351 0.3324 0.4964 0.4545 0.1495 0.2034 0.7385 0.5312 0.1766 199-DS 0.0000 0.2006 0.2542 0.2949 0.3333 0.2240 0.1013 0.0943 0.3333 0.4519 0.0658 0.0001 0.0711 0.1921 0.3333 0.2585 0.0480 200-DS 0.0000 0.1191 0.1519 0.2151 0.2398 0.1589 0.0636 0.0960 0.2398 0.4000 0.0859 0.0001 0.0489 0.0000 0.2398 0.1589 0.0636 62 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-EN-CLEF2007 Statistics for Precision at the 50% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.3019 0.4960 0.5897 0.6913 0.7797 0.5875 0.1391 0.1953 0.4778 0.2367 0.5705 0.5516 0.1119 0.3019 0.7797 0.5875 0.1391 177-DS 0.0000 0.0422 0.0582 0.0859 0.1074 0.0593 0.0332 0.0437 0.1074 0.5603 0.0199 0.0001 0.0271 0.0000 0.1074 0.0593 0.0332 178-DS 0.0000 0.0000 0.0000 0.1186 0.1258 0.0478 0.0606 0.1186 0.1258 1.2687 0.0004 0.0000 0.0573 0.0000 0.1258 0.0478 0.0606 179-DS 0.2820 0.4249 0.4622 0.5377 0.6322 0.4639 0.0942 0.1129 0.3502 0.2031 0.4540 0.4430 0.0677 0.2820 0.6322 0.4639 0.0942 180-DS 0.4960 0.5942 0.6775 0.6872 0.7391 0.6411 0.0747 0.0930 0.2431 0.1166 0.6368 0.6323 0.0615 0.4960 0.7391 0.6411 0.0747 181-DS 0.0350 0.1874 0.4231 0.4940 0.5238 0.3452 0.1738 0.3067 0.4888 0.5034 0.2682 0.1563 0.1479 0.0350 0.5238 0.3452 0.1738 182-DS 0.0000 0.0536 0.0679 0.0944 0.1301 0.0719 0.0321 0.0408 0.1301 0.4463 0.0405 0.0001 0.0243 0.0000 0.1301 0.0719 0.0321 183-DS 0.0000 0.2150 0.2821 0.3772 0.4639 0.2856 0.1243 0.1622 0.4639 0.4352 0.1461 0.0001 0.0958 0.0000 0.4639 0.2856 0.1243 184-DS 0.0000 0.3009 0.3455 0.3992 0.4878 0.3443 0.1166 0.0983 0.4878 0.3387 0.1802 0.0001 0.0737 0.2796 0.4878 0.3689 0.0698 185-DS 0.0000 0.0000 0.0000 0.0000 0.0850 0.0109 0.0288 0.0000 0.0850 2.6412 0.0000 0.0000 0.0189 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0325 0.0435 0.0534 0.1958 0.0517 0.0430 0.0209 0.1958 0.8321 0.0272 0.0001 0.0225 0.0274 0.0698 0.0445 0.0121 187-DS 0.0000 0.4124 0.4911 0.5677 0.7307 0.4550 0.2117 0.1554 0.7307 0.4653 0.1211 0.0001 0.1439 0.3614 0.7307 0.5250 0.1117 188-DS 0.0000 0.5495 0.6049 0.6706 0.7339 0.5639 0.1856 0.1211 0.7339 0.3291 0.2856 0.0001 0.1208 0.4676 0.7339 0.6243 0.0751 189-DS 0.0000 0.0416 0.0537 0.0640 0.1364 0.0619 0.0373 0.0224 0.1364 0.6030 0.0335 0.0001 0.0265 0.0309 0.0657 0.0497 0.0102 190-DS 0.0000 0.1841 0.1943 0.2174 0.2276 0.1803 0.0602 0.0334 0.2276 0.3339 0.0980 0.0001 0.0370 0.1779 0.2276 0.2014 0.0167 191-DS 0.0000 0.0804 0.1289 0.2804 0.4444 0.1839 0.1406 0.2000 0.4444 0.7643 0.0809 0.0001 0.1141 0.0000 0.4444 0.1839 0.1406 192-DS 0.0000 0.1554 0.1782 0.2498 0.3750 0.1829 0.1149 0.0945 0.3750 0.6283 0.0297 0.0000 0.0841 0.1528 0.3750 0.2286 0.0735 193-DS 0.0000 0.4101 0.5524 0.6390 0.7647 0.5159 0.1841 0.2289 0.7647 0.3569 0.2613 0.0001 0.1330 0.3854 0.7647 0.5528 0.1207 194-DS 0.0000 0.2344 0.3726 0.5315 0.6183 0.3697 0.1794 0.2970 0.6183 0.4854 0.1818 0.0001 0.1422 0.0000 0.6183 0.3697 0.1794 195-DS 0.0000 0.5691 0.6697 0.6987 0.7740 0.5971 0.1887 0.1297 0.7740 0.3159 0.3029 0.0001 0.1194 0.4628 0.7740 0.6398 0.0946 196-DS 0.0000 0.1647 0.2101 0.2153 0.3077 0.1833 0.0852 0.0506 0.3077 0.4648 0.0551 0.0001 0.0583 0.1513 0.2872 0.2035 0.0358 197-DS 0.1180 0.1996 0.4416 0.5670 0.6370 0.3870 0.1853 0.3674 0.5191 0.4787 0.3379 0.2870 0.1595 0.1180 0.6370 0.3870 0.1853 198-DS 0.1877 0.3253 0.5085 0.5939 0.6359 0.4685 0.1490 0.2686 0.4481 0.3180 0.4412 0.4090 0.1254 0.1877 0.6359 0.4685 0.1490 199-DS 0.0000 0.1676 0.2082 0.2544 0.3025 0.1915 0.0903 0.0868 0.3025 0.4713 0.0571 0.0001 0.0631 0.1525 0.3025 0.2210 0.0495 200-DS 0.0000 0.0904 0.1192 0.1415 0.1654 0.1133 0.0428 0.0511 0.1654 0.3773 0.0630 0.0001 0.0303 0.0754 0.1654 0.1214 0.0302 63 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-EN-CLEF2007 Statistics for Precision at the 60% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.3077 0.5897 0.6873 0.7467 0.4962 0.2441 0.3796 0.7467 0.4918 0.2268 0.0001 0.1998 0.0000 0.7467 0.4962 0.2441 177-DS 0.0000 0.0000 0.0510 0.0662 0.0799 0.0380 0.0332 0.0662 0.0799 0.8746 0.0019 0.0000 0.0304 0.0000 0.0799 0.0380 0.0332 178-DS 0.0000 0.0000 0.0000 0.0000 0.1158 0.0214 0.0443 0.0000 0.1158 2.0754 0.0001 0.0000 0.0342 0.0000 0.0000 0.0000 0.0000 179-DS 0.2820 0.3515 0.3729 0.4248 0.5000 0.3828 0.0619 0.0733 0.2180 0.1618 0.3781 0.3735 0.0481 0.2820 0.5000 0.3828 0.0619 180-DS 0.3368 0.4913 0.5282 0.5833 0.6757 0.5252 0.0927 0.0920 0.3388 0.1765 0.5166 0.5068 0.0652 0.4777 0.6757 0.5538 0.0580 181-DS 0.0350 0.1571 0.4231 0.4483 0.5238 0.3296 0.1752 0.2911 0.4888 0.5316 0.2523 0.1493 0.1501 0.0350 0.5238 0.3296 0.1752 182-DS 0.0000 0.0000 0.0535 0.0773 0.1038 0.0446 0.0401 0.0773 0.1038 0.8986 0.0021 0.0000 0.0357 0.0000 0.1038 0.0446 0.0401 183-DS 0.0000 0.1697 0.2327 0.2920 0.4062 0.2240 0.1250 0.1223 0.4062 0.5580 0.0630 0.0001 0.0957 0.0000 0.4062 0.2240 0.1250 184-DS 0.0000 0.0579 0.2596 0.3603 0.4277 0.2358 0.1578 0.3024 0.4277 0.6692 0.0199 0.0000 0.1263 0.0000 0.4277 0.2358 0.1578 185-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0382 0.0473 0.1818 0.0360 0.0464 0.0473 0.1818 1.2874 0.0017 0.0000 0.0289 0.0000 0.0597 0.0256 0.0238 187-DS 0.0000 0.3471 0.4149 0.4901 0.6849 0.3728 0.2143 0.1430 0.6849 0.5749 0.0534 0.0000 0.1554 0.3449 0.6849 0.4660 0.1053 188-DS 0.0000 0.4282 0.5123 0.5697 0.6095 0.4708 0.1545 0.1415 0.6095 0.3283 0.2415 0.0001 0.1026 0.3021 0.6095 0.5044 0.0864 189-DS 0.0000 0.0070 0.0360 0.0534 0.0986 0.0399 0.0340 0.0464 0.0986 0.8522 0.0051 0.0000 0.0254 0.0000 0.0986 0.0399 0.0340 190-DS 0.0000 0.1841 0.1943 0.2174 0.2276 0.1703 0.0740 0.0334 0.2276 0.4346 0.0521 0.0001 0.0526 0.1836 0.2276 0.2032 0.0160 191-DS 0.0000 0.0630 0.1164 0.2075 0.3451 0.1399 0.0964 0.1445 0.3451 0.6890 0.0661 0.0001 0.0793 0.0000 0.3451 0.1399 0.0964 192-DS 0.0000 0.1226 0.1484 0.2202 0.3171 0.1512 0.0949 0.0977 0.3171 0.6279 0.0255 0.0000 0.0711 0.0000 0.3171 0.1512 0.0949 193-DS 0.0000 0.3537 0.4124 0.5516 0.5832 0.4220 0.1515 0.1979 0.5832 0.3589 0.2165 0.0001 0.1111 0.3008 0.5832 0.4522 0.1001 194-DS 0.0000 0.1807 0.2671 0.4286 0.5708 0.2848 0.1708 0.2478 0.5708 0.5997 0.0764 0.0001 0.1402 0.0000 0.5708 0.2848 0.1708 195-DS 0.0000 0.3971 0.5681 0.6145 0.7317 0.5031 0.1751 0.2174 0.7317 0.3480 0.2557 0.0001 0.1249 0.3745 0.7317 0.5390 0.1102 196-DS 0.0000 0.1639 0.2015 0.2107 0.2967 0.1763 0.0843 0.0469 0.2967 0.4779 0.0530 0.0001 0.0584 0.1144 0.2154 0.1873 0.0301 197-DS 0.0000 0.1563 0.3838 0.5016 0.5746 0.3246 0.1946 0.3453 0.5746 0.5995 0.0842 0.0001 0.1656 0.0000 0.5746 0.3246 0.1946 198-DS 0.1690 0.2820 0.3924 0.4845 0.5254 0.3678 0.1209 0.2025 0.3563 0.3288 0.3466 0.3231 0.1024 0.1690 0.5254 0.3678 0.1209 199-DS 0.0000 0.1002 0.1792 0.2146 0.2263 0.1497 0.0786 0.1144 0.2263 0.5247 0.0447 0.0001 0.0655 0.0000 0.2263 0.1497 0.0786 200-DS 0.0000 0.0000 0.0826 0.0999 0.1244 0.0649 0.0490 0.0999 0.1244 0.7550 0.0045 0.0000 0.0432 0.0000 0.1244 0.0649 0.0490 64 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-EN-CLEF2007 Statistics for Precision at the 70% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.2182 0.5403 0.5897 0.7079 0.4362 0.2461 0.3716 0.7079 0.5641 0.1095 0.0001 0.2097 0.0000 0.7079 0.4362 0.2461 177-DS 0.0000 0.0000 0.0000 0.0561 0.0723 0.0247 0.0318 0.0561 0.0723 1.2863 0.0003 0.0000 0.0296 0.0000 0.0723 0.0247 0.0318 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.2558 0.2926 0.3208 0.3528 0.4699 0.3264 0.0546 0.0602 0.2141 0.1674 0.3225 0.3189 0.0393 0.2558 0.3920 0.3161 0.0389 180-DS 0.0000 0.3712 0.4119 0.4875 0.5982 0.3870 0.1709 0.1163 0.5982 0.4416 0.1060 0.0001 0.1115 0.3511 0.5982 0.4466 0.0726 181-DS 0.0311 0.1495 0.3611 0.4211 0.4815 0.2944 0.1660 0.2717 0.4504 0.5638 0.2135 0.1174 0.1420 0.0311 0.4815 0.2944 0.1660 182-DS 0.0000 0.0000 0.0000 0.0601 0.0860 0.0268 0.0346 0.0601 0.0860 1.2922 0.0003 0.0000 0.0321 0.0000 0.0860 0.0268 0.0346 183-DS 0.0000 0.0275 0.1408 0.1893 0.3475 0.1400 0.1111 0.1618 0.3475 0.7936 0.0131 0.0000 0.0789 0.0000 0.3475 0.1400 0.1111 184-DS 0.0000 0.0000 0.0000 0.2635 0.3182 0.0944 0.1389 0.2635 0.3182 1.4720 0.0003 0.0000 0.1258 0.0000 0.3182 0.0944 0.1389 185-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0000 0.0000 0.0727 0.0102 0.0223 0.0000 0.0727 2.1831 0.0001 0.0000 0.0164 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.0000 0.3573 0.3800 0.5437 0.2451 0.2154 0.3800 0.5437 0.8786 0.0058 0.0000 0.1961 0.0000 0.5437 0.2451 0.2154 188-DS 0.0000 0.3580 0.4174 0.4439 0.4969 0.3805 0.1209 0.0859 0.4969 0.3177 0.1987 0.0001 0.0765 0.2629 0.4969 0.4077 0.0617 189-DS 0.0000 0.0000 0.0000 0.0372 0.0800 0.0200 0.0317 0.0372 0.0800 1.5831 0.0002 0.0000 0.0267 0.0000 0.0800 0.0200 0.0317 190-DS 0.0000 0.1841 0.1912 0.2174 0.2276 0.1700 0.0739 0.0334 0.2276 0.4349 0.0520 0.0001 0.0525 0.1836 0.2276 0.2028 0.0164 191-DS 0.0000 0.0565 0.0777 0.1770 0.2788 0.1072 0.0833 0.1205 0.2788 0.7772 0.0181 0.0000 0.0693 0.0000 0.2788 0.1072 0.0833 192-DS 0.0000 0.0996 0.1221 0.1776 0.2483 0.1246 0.0795 0.0780 0.2483 0.6382 0.0217 0.0000 0.0588 0.0000 0.2483 0.1246 0.0795 193-DS 0.0000 0.0000 0.0000 0.4301 0.4799 0.1999 0.2231 0.4301 0.4799 1.1163 0.0014 0.0000 0.2132 0.0000 0.4799 0.1999 0.2231 194-DS 0.0000 0.0000 0.1879 0.3370 0.4877 0.1777 0.1843 0.3370 0.4877 1.0367 0.0025 0.0000 0.1659 0.0000 0.4877 0.1777 0.1843 195-DS 0.0000 0.0816 0.4413 0.5117 0.6008 0.3455 0.2250 0.4301 0.6008 0.6513 0.0265 0.0000 0.1868 0.0000 0.6008 0.3455 0.2250 196-DS 0.0000 0.1543 0.1758 0.1983 0.2500 0.1577 0.0739 0.0440 0.2500 0.4684 0.0482 0.0001 0.0512 0.0947 0.2500 0.1820 0.0398 197-DS 0.0000 0.0000 0.2723 0.3997 0.4337 0.2213 0.1770 0.3997 0.4337 0.8000 0.0101 0.0000 0.1534 0.0000 0.4337 0.2213 0.1770 198-DS 0.0000 0.2042 0.2867 0.3577 0.4289 0.2460 0.1419 0.1535 0.4289 0.5769 0.0381 0.0000 0.1082 0.0000 0.4289 0.2460 0.1419 199-DS 0.0000 0.0759 0.1449 0.1775 0.2082 0.1203 0.0724 0.1016 0.2082 0.6020 0.0212 0.0000 0.0572 0.0000 0.2082 0.1203 0.0724 200-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 65 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-EN-CLEF2007 Statistics for Precision at the 80% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.1301 0.4898 0.5724 0.6916 0.3780 0.2607 0.4423 0.6916 0.6897 0.0498 0.0000 0.2318 0.0000 0.6916 0.3780 0.2607 177-DS 0.0000 0.0000 0.0000 0.0000 0.0554 0.0068 0.0179 0.0000 0.0554 2.6519 0.0000 0.0000 0.0117 0.0000 0.0000 0.0000 0.0000 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0000 0.1639 0.2643 0.2848 0.3359 0.2228 0.1076 0.1209 0.3359 0.4832 0.0645 0.0001 0.0850 0.0000 0.3359 0.2228 0.1076 180-DS 0.0000 0.0000 0.3128 0.3937 0.4539 0.2250 0.1948 0.3937 0.4539 0.8658 0.0055 0.0000 0.1800 0.0000 0.4539 0.2250 0.1948 181-DS 0.0000 0.0861 0.2632 0.2865 0.3404 0.1987 0.1164 0.2004 0.3404 0.5859 0.0897 0.0001 0.1036 0.0000 0.3404 0.1987 0.1164 182-DS 0.0000 0.0000 0.0000 0.0000 0.0637 0.0042 0.0164 0.0000 0.0637 3.8730 0.0000 0.0000 0.0079 0.0000 0.0000 0.0000 0.0000 183-DS 0.0000 0.0000 0.0000 0.0999 0.2257 0.0464 0.0821 0.0999 0.2257 1.7676 0.0001 0.0000 0.0681 0.0000 0.2257 0.0464 0.0821 184-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 185-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0000 0.0000 0.0561 0.0037 0.0145 0.0000 0.0561 3.8730 0.0000 0.0000 0.0070 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.0000 0.0000 0.0000 0.4270 0.0566 0.1493 0.0000 0.4270 2.6391 0.0000 0.0000 0.0981 0.0000 0.0000 0.0000 0.0000 188-DS 0.0000 0.0000 0.2880 0.3355 0.3800 0.1938 0.1657 0.3355 0.3800 0.8551 0.0051 0.0000 0.1550 0.0000 0.3800 0.1938 0.1657 189-DS 0.0000 0.0000 0.0000 0.0000 0.0800 0.0126 0.0267 0.0000 0.0800 2.1214 0.0001 0.0000 0.0201 0.0000 0.0000 0.0000 0.0000 190-DS 0.0000 0.1823 0.1912 0.2107 0.2276 0.1687 0.0732 0.0284 0.2276 0.4336 0.0516 0.0001 0.0520 0.1813 0.2276 0.2012 0.0155 191-DS 0.0000 0.0000 0.0524 0.1528 0.2093 0.0721 0.0799 0.1528 0.2093 1.1082 0.0015 0.0000 0.0704 0.0000 0.2093 0.0721 0.0799 192-DS 0.0000 0.0000 0.0000 0.1262 0.1814 0.0610 0.0698 0.1262 0.1814 1.1452 0.0008 0.0000 0.0650 0.0000 0.1814 0.0610 0.0698 193-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 194-DS 0.0000 0.0000 0.0000 0.2408 0.3396 0.1052 0.1376 0.2408 0.3396 1.3078 0.0006 0.0000 0.1263 0.0000 0.3396 0.1052 0.1376 195-DS 0.0000 0.0000 0.0000 0.3789 0.4004 0.1284 0.1880 0.3789 0.4004 1.4646 0.0003 0.0000 0.1712 0.0000 0.4004 0.1284 0.1880 196-DS 0.0000 0.1195 0.1593 0.1912 0.2081 0.1377 0.0680 0.0717 0.2081 0.4939 0.0422 0.0001 0.0512 0.0622 0.2081 0.1589 0.0418 197-DS 0.0000 0.0000 0.1935 0.2722 0.3110 0.1518 0.1338 0.2722 0.3110 0.8817 0.0043 0.0000 0.1214 0.0000 0.3110 0.1518 0.1338 198-DS 0.0000 0.0000 0.0000 0.2558 0.3243 0.1088 0.1406 0.2558 0.3243 1.2924 0.0006 0.0000 0.1306 0.0000 0.3243 0.1088 0.1406 199-DS 0.0000 0.0000 0.1051 0.1213 0.1625 0.0710 0.0631 0.1213 0.1625 0.8878 0.0027 0.0000 0.0572 0.0000 0.1625 0.0710 0.0631 200-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 66 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-EN-CLEF2007 Statistics for Precision at the 90% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.1875 0.4603 0.5586 0.2516 0.2249 0.4603 0.5586 0.8938 0.0104 0.0000 0.2055 0.0000 0.5586 0.2516 0.2249 177-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0000 0.1185 0.1984 0.2351 0.2758 0.1617 0.0942 0.1166 0.2758 0.5827 0.0271 0.0000 0.0762 0.0000 0.2758 0.1617 0.0942 180-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 181-DS 0.0000 0.0000 0.0283 0.0611 0.1735 0.0418 0.0490 0.0611 0.1735 1.1712 0.0029 0.0000 0.0363 0.0000 0.1083 0.0324 0.0340 182-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 183-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 184-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 185-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 188-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 189-DS 0.0000 0.0000 0.0000 0.0000 0.0602 0.0073 0.0194 0.0000 0.0602 2.6526 0.0000 0.0000 0.0127 0.0000 0.0000 0.0000 0.0000 190-DS 0.0000 0.1433 0.1882 0.2093 0.2212 0.1635 0.0727 0.0661 0.2212 0.4447 0.0501 0.0001 0.0542 0.1165 0.2212 0.1887 0.0320 191-DS 0.0000 0.0000 0.0000 0.0981 0.1415 0.0394 0.0600 0.0981 0.1415 1.5235 0.0002 0.0000 0.0525 0.0000 0.1415 0.0394 0.0600 192-DS 0.0000 0.0000 0.0000 0.0000 0.0974 0.0065 0.0251 0.0000 0.0974 3.8730 0.0000 0.0000 0.0121 0.0000 0.0000 0.0000 0.0000 193-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 194-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 195-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 196-DS 0.0000 0.0681 0.1175 0.1424 0.1559 0.0989 0.0574 0.0743 0.1559 0.5799 0.0183 0.0000 0.0476 0.0000 0.1559 0.0989 0.0574 197-DS 0.0000 0.0000 0.0000 0.0000 0.1834 0.0122 0.0474 0.0000 0.1834 3.8730 0.0000 0.0000 0.0228 0.0000 0.0000 0.0000 0.0000 198-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 199-DS 0.0000 0.0000 0.0000 0.0925 0.1350 0.0386 0.0507 0.0925 0.1350 1.3136 0.0004 0.0000 0.0464 0.0000 0.1350 0.0386 0.0507 200-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 67 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-EN-CLEF2007 Statistics for Precision at the 100% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0000 0.1118 0.0075 0.0289 0.0000 0.1118 3.8730 0.0000 0.0000 0.0139 0.0000 0.0000 0.0000 0.0000 177-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 180-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 183-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 184-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 185-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 188-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 189-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 190-DS 0.0000 0.0281 0.1472 0.1631 0.1863 0.1122 0.0726 0.1350 0.1863 0.6473 0.0116 0.0000 0.0598 0.0000 0.1863 0.1122 0.0726 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 193-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 194-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 195-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 196-DS 0.0000 0.0000 0.0000 0.0000 0.0851 0.0057 0.0220 0.0000 0.0851 3.8730 0.0000 0.0000 0.0106 0.0000 0.0000 0.0000 0.0000 197-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 198-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 199-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 200-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 68 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-EN-CLEF2007 Statistics for P@5 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.4000 0.8000 0.8000 0.8000 1.0000 0.8133 0.1407 0.0000 0.6000 0.1730 0.7987 0.7792 0.0747 0.8000 0.8000 0.8000 0.0000 177-DS 0.0000 0.0000 0.0000 0.2000 0.6000 0.1333 0.1799 0.2000 0.6000 1.3496 0.0011 0.0000 0.1422 0.0000 0.4000 0.1000 0.1301 178-DS 0.4000 0.4500 0.6000 0.8000 1.0000 0.6400 0.2028 0.3500 0.6000 0.3169 0.6106 0.5825 0.1600 0.4000 1.0000 0.6400 0.2028 179-DS 0.2000 0.4000 0.4000 0.6000 0.8000 0.4667 0.1952 0.2000 0.6000 0.4182 0.4255 0.3830 0.1600 0.2000 0.8000 0.4667 0.1952 180-DS 0.6000 0.8000 0.8000 1.0000 1.0000 0.8800 0.1265 0.2000 0.4000 0.1437 0.8709 0.8612 0.1120 0.6000 1.0000 0.8800 0.1265 181-DS 0.0000 0.4000 0.4000 0.4000 0.6000 0.3600 0.1352 0.0000 0.6000 0.3756 0.1849 0.0001 0.0907 0.4000 0.4000 0.4000 0.0000 182-DS 0.0000 0.2000 0.4000 0.4000 0.6000 0.3067 0.2120 0.2000 0.6000 0.6914 0.0433 0.0000 0.1796 0.0000 0.6000 0.3067 0.2120 183-DS 0.4000 0.6000 0.8000 0.8000 1.0000 0.7200 0.1821 0.2000 0.6000 0.2528 0.6959 0.6691 0.1493 0.4000 1.0000 0.7200 0.1821 184-DS 0.2000 0.6000 0.8000 1.0000 1.0000 0.7600 0.2849 0.4000 0.8000 0.3748 0.6835 0.5732 0.2347 0.2000 1.0000 0.7600 0.2849 185-DS 0.2000 0.2500 0.4000 0.6000 0.8000 0.4667 0.2093 0.3500 0.6000 0.4485 0.4175 0.3673 0.1778 0.2000 0.8000 0.4667 0.2093 186-DS 0.0000 0.0500 0.2000 0.4000 0.8000 0.2400 0.2165 0.3500 0.8000 0.9019 0.0188 0.0000 0.1600 0.0000 0.8000 0.2400 0.2165 187-DS 0.4000 0.8000 0.8000 1.0000 1.0000 0.8533 0.1598 0.2000 0.6000 0.1872 0.8352 0.8108 0.1173 0.8000 1.0000 0.8857 0.1027 188-DS 0.8000 0.8000 1.0000 1.0000 1.0000 0.9333 0.0976 0.2000 0.2000 0.1046 0.9283 0.9231 0.0889 0.8000 1.0000 0.9333 0.0976 189-DS 0.0000 0.2500 0.6000 0.6000 0.8000 0.4267 0.2604 0.3500 0.8000 0.6103 0.0581 0.0000 0.2116 0.0000 0.8000 0.4267 0.2604 190-DS 0.0000 0.2000 0.2000 0.2000 0.4000 0.2133 0.1187 0.0000 0.4000 0.5565 0.0613 0.0001 0.0747 0.2000 0.2000 0.2000 0.0000 191-DS 0.2000 0.4000 0.6000 0.8000 0.8000 0.5467 0.2200 0.4000 0.6000 0.4024 0.4983 0.4444 0.1902 0.2000 0.8000 0.5467 0.2200 192-DS 0.2000 0.6000 0.6000 0.8000 0.8000 0.6267 0.1668 0.2000 0.6000 0.2661 0.5974 0.5538 0.1156 0.4000 0.8000 0.6571 0.1222 193-DS 0.6000 0.8000 1.0000 1.0000 1.0000 0.9200 0.1265 0.2000 0.4000 0.1375 0.9107 0.9000 0.1067 0.6000 1.0000 0.9200 0.1265 194-DS 0.0000 0.2000 0.2000 0.3500 0.8000 0.2667 0.2350 0.1500 0.8000 0.8814 0.0367 0.0000 0.1778 0.0000 0.4000 0.1667 0.1155 195-DS 0.4000 0.6500 0.8000 1.0000 1.0000 0.8267 0.1981 0.3500 0.6000 0.2396 0.8003 0.7692 0.1618 0.4000 1.0000 0.8267 0.1981 196-DS 0.0000 0.2000 0.2000 0.2000 0.4000 0.2267 0.1033 0.0000 0.4000 0.4556 0.1187 0.0001 0.0693 0.2000 0.2000 0.2000 0.0000 197-DS 0.2000 0.4000 0.6000 0.9500 1.0000 0.6533 0.2875 0.5500 0.8000 0.4401 0.5800 0.4959 0.2436 0.2000 1.0000 0.6533 0.2875 198-DS 0.4000 1.0000 1.0000 1.0000 1.0000 0.9333 0.1633 0.0000 0.6000 0.1750 0.9132 0.8824 0.1067 1.0000 1.0000 1.0000 0.0000 199-DS 0.4000 0.6000 0.6000 0.8000 0.8000 0.6667 0.1447 0.2000 0.4000 0.2171 0.6501 0.6316 0.1244 0.4000 0.8000 0.6667 0.1447 200-DS 0.0000 0.0500 0.2000 0.4000 0.6000 0.2400 0.2028 0.3500 0.6000 0.8452 0.0190 0.0000 0.1600 0.0000 0.6000 0.2400 0.2028 69 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-EN-CLEF2007 Statistics for P@10 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.6000 0.7000 0.8000 0.8000 0.9000 0.7667 0.0976 0.1000 0.3000 0.1273 0.7607 0.7545 0.0800 0.6000 0.9000 0.7667 0.0976 177-DS 0.0000 0.0000 0.1000 0.2750 0.5000 0.1467 0.1885 0.2750 0.5000 1.2851 0.0021 0.0000 0.1556 0.0000 0.5000 0.1467 0.1885 178-DS 0.3000 0.3000 0.4000 0.5000 0.8000 0.4400 0.1765 0.2000 0.5000 0.4011 0.4121 0.3896 0.1413 0.3000 0.6000 0.3846 0.1068 179-DS 0.3000 0.4000 0.5000 0.7000 0.9000 0.5533 0.1846 0.3000 0.6000 0.3337 0.5252 0.4987 0.1636 0.3000 0.9000 0.5533 0.1846 180-DS 0.8000 0.8000 0.9000 0.9000 1.0000 0.8733 0.0704 0.1000 0.2000 0.0806 0.8707 0.8682 0.0587 0.8000 1.0000 0.8733 0.0704 181-DS 0.2000 0.2000 0.4000 0.4000 0.5000 0.3333 0.1113 0.2000 0.3000 0.3338 0.3148 0.2961 0.0978 0.2000 0.5000 0.3333 0.1113 182-DS 0.1000 0.1250 0.3000 0.3000 0.4000 0.2400 0.1056 0.1750 0.3000 0.4398 0.2145 0.1875 0.0907 0.1000 0.4000 0.2400 0.1056 183-DS 0.4000 0.4250 0.7000 0.8750 0.9000 0.6733 0.2017 0.4500 0.5000 0.2995 0.6418 0.6083 0.1689 0.4000 0.9000 0.6733 0.2017 184-DS 0.3000 0.8000 0.9000 0.9000 1.0000 0.8133 0.2200 0.1000 0.7000 0.2704 0.7694 0.7031 0.1440 0.8000 1.0000 0.8923 0.0760 185-DS 0.2000 0.3000 0.5000 0.6000 0.7000 0.4533 0.1598 0.3000 0.5000 0.3524 0.4248 0.3955 0.1431 0.2000 0.7000 0.4533 0.1598 186-DS 0.0000 0.1000 0.2000 0.2000 0.5000 0.1733 0.1163 0.1000 0.5000 0.6709 0.0855 0.0001 0.0818 0.0000 0.3000 0.1500 0.0760 187-DS 0.5000 0.8250 0.9000 1.0000 1.0000 0.8867 0.1302 0.1750 0.5000 0.1468 0.8755 0.8612 0.0862 0.8000 1.0000 0.9143 0.0770 188-DS 0.8000 0.8250 0.9000 0.9750 1.0000 0.9000 0.0756 0.1500 0.2000 0.0840 0.8970 0.8940 0.0533 0.8000 1.0000 0.9000 0.0756 189-DS 0.0000 0.2000 0.3000 0.5000 0.6000 0.3133 0.1727 0.3000 0.6000 0.5510 0.1510 0.0001 0.1378 0.0000 0.6000 0.3133 0.1727 190-DS 0.1000 0.1000 0.2000 0.3000 0.5000 0.2400 0.1502 0.2000 0.4000 0.6260 0.2013 0.1711 0.1200 0.1000 0.5000 0.2400 0.1502 191-DS 0.3000 0.3250 0.4000 0.6000 0.8000 0.4867 0.1685 0.2750 0.5000 0.3462 0.4601 0.4355 0.1458 0.3000 0.8000 0.4867 0.1685 192-DS 0.3000 0.5000 0.5000 0.6000 0.8000 0.5333 0.1496 0.1000 0.5000 0.2805 0.5115 0.4874 0.1156 0.5000 0.7000 0.5727 0.0786 193-DS 0.6000 0.8000 0.9000 0.9750 1.0000 0.8800 0.1082 0.1750 0.4000 0.1230 0.8731 0.8654 0.0800 0.6000 1.0000 0.8800 0.1082 194-DS 0.1000 0.2000 0.3000 0.3750 0.6000 0.2933 0.1486 0.1750 0.5000 0.5067 0.2587 0.2256 0.1138 0.1000 0.6000 0.2933 0.1486 195-DS 0.7000 0.8000 0.9000 1.0000 1.0000 0.8667 0.1175 0.2000 0.3000 0.1356 0.8591 0.8514 0.1022 0.7000 1.0000 0.8667 0.1175 196-DS 0.1000 0.1000 0.2000 0.3000 0.4000 0.2133 0.1060 0.2000 0.3000 0.4969 0.1888 0.1667 0.0844 0.1000 0.4000 0.2133 0.1060 197-DS 0.3000 0.4250 0.7000 0.8750 0.9000 0.6467 0.2232 0.4500 0.6000 0.3451 0.6051 0.5597 0.1902 0.3000 0.9000 0.6467 0.2232 198-DS 0.4000 0.9000 1.0000 1.0000 1.0000 0.9133 0.1642 0.1000 0.6000 0.1798 0.8932 0.8634 0.1040 0.9000 1.0000 0.9692 0.0480 199-DS 0.4000 0.5250 0.6000 0.7000 0.8000 0.6267 0.1163 0.1750 0.4000 0.1856 0.6160 0.6046 0.0951 0.4000 0.8000 0.6267 0.1163 200-DS 0.0000 0.1000 0.3000 0.3750 0.6000 0.2667 0.1799 0.2750 0.6000 0.6748 0.1215 0.0001 0.1422 0.0000 0.6000 0.2667 0.1799 70 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-EN-CLEF2007 Statistics for P@15 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.6000 0.6667 0.7333 0.8500 0.9333 0.7467 0.0982 0.1833 0.3333 0.1316 0.7408 0.7351 0.0800 0.6000 0.9333 0.7467 0.0982 177-DS 0.0000 0.0167 0.1333 0.2667 0.4000 0.1467 0.1407 0.2500 0.4000 0.9596 0.0123 0.0000 0.1156 0.0000 0.4000 0.1467 0.1407 178-DS 0.2000 0.2667 0.3333 0.5833 0.8000 0.4178 0.2023 0.3167 0.6000 0.4843 0.3779 0.3460 0.1724 0.2000 0.8000 0.4178 0.2023 179-DS 0.4000 0.4667 0.5333 0.6500 0.8000 0.5511 0.1391 0.1833 0.4000 0.2524 0.5359 0.5222 0.1126 0.4000 0.8000 0.5511 0.1391 180-DS 0.8667 0.8667 0.8667 0.9333 0.9333 0.8978 0.0344 0.0667 0.0667 0.0383 0.8972 0.8966 0.0332 0.8667 0.9333 0.8978 0.0344 181-DS 0.1333 0.2833 0.4000 0.4000 0.5333 0.3422 0.1151 0.1167 0.4000 0.3363 0.3189 0.2898 0.0883 0.1333 0.5333 0.3422 0.1151 182-DS 0.1333 0.2000 0.2000 0.2667 0.4000 0.2356 0.0707 0.0667 0.2667 0.3000 0.2268 0.2190 0.0563 0.1333 0.3333 0.2238 0.0561 183-DS 0.3333 0.4333 0.6667 0.8000 0.9333 0.6578 0.1998 0.3667 0.6000 0.3037 0.6257 0.5910 0.1630 0.3333 0.9333 0.6578 0.1998 184-DS 0.3333 0.8000 0.8000 0.8667 0.9333 0.7733 0.1916 0.0667 0.6000 0.2477 0.7409 0.6951 0.1316 0.8000 0.9333 0.8556 0.0557 185-DS 0.2000 0.3333 0.4667 0.5333 0.6667 0.4356 0.1354 0.2000 0.4667 0.3108 0.4125 0.3860 0.1084 0.2000 0.6667 0.4356 0.1354 186-DS 0.0000 0.0833 0.1333 0.1333 0.4000 0.1378 0.0890 0.0500 0.4000 0.6457 0.0700 0.0001 0.0516 0.0667 0.2000 0.1282 0.0427 187-DS 0.6000 0.8667 0.8667 0.9333 1.0000 0.8844 0.1022 0.0667 0.4000 0.1156 0.8782 0.8710 0.0723 0.8000 1.0000 0.9048 0.0678 188-DS 0.6000 0.8667 0.8667 0.9833 1.0000 0.8933 0.1033 0.1167 0.4000 0.1156 0.8869 0.8796 0.0729 0.8000 1.0000 0.9143 0.0663 189-DS 0.0000 0.1333 0.2000 0.3333 0.4000 0.2222 0.1226 0.2000 0.4000 0.5516 0.1110 0.0001 0.1007 0.0000 0.4000 0.2222 0.1226 190-DS 0.0667 0.2000 0.2000 0.3167 0.6000 0.2578 0.1591 0.1167 0.5333 0.6172 0.2155 0.1766 0.1215 0.0667 0.4667 0.2103 0.1049 191-DS 0.2000 0.2833 0.3333 0.5167 0.8000 0.4222 0.1913 0.2333 0.6000 0.4532 0.3859 0.3544 0.1511 0.2000 0.8000 0.4222 0.1913 192-DS 0.3333 0.4667 0.5333 0.5333 0.8000 0.5200 0.1132 0.0667 0.4667 0.2178 0.5090 0.4984 0.0782 0.4000 0.6000 0.5000 0.0603 193-DS 0.7333 0.8000 0.8667 0.9833 1.0000 0.8756 0.0972 0.1833 0.2667 0.1110 0.8705 0.8655 0.0818 0.7333 1.0000 0.8756 0.0972 194-DS 0.1333 0.2667 0.3333 0.4667 0.6000 0.3556 0.1325 0.2000 0.4667 0.3728 0.3321 0.3080 0.1096 0.1333 0.6000 0.3556 0.1325 195-DS 0.6667 0.8667 0.8667 0.9333 1.0000 0.8800 0.0950 0.0667 0.3333 0.1079 0.8749 0.8695 0.0693 0.8000 1.0000 0.9077 0.0641 196-DS 0.0667 0.1500 0.2000 0.2667 0.4000 0.2133 0.0843 0.1167 0.3333 0.3953 0.1967 0.1780 0.0622 0.0667 0.4000 0.2133 0.0843 197-DS 0.2667 0.4667 0.6667 0.8000 0.9333 0.6356 0.2209 0.3333 0.6667 0.3476 0.5926 0.5432 0.1796 0.2667 0.9333 0.6356 0.2209 198-DS 0.3333 0.8833 1.0000 1.0000 1.0000 0.9022 0.1815 0.1167 0.6667 0.2011 0.8753 0.8323 0.1167 0.8667 1.0000 0.9641 0.0517 199-DS 0.4667 0.4667 0.5333 0.6000 0.7333 0.5467 0.0843 0.1333 0.2667 0.1543 0.5409 0.5355 0.0693 0.4667 0.7333 0.5467 0.0843 200-DS 0.0000 0.1333 0.2667 0.3833 0.5333 0.2533 0.1516 0.2500 0.5333 0.5984 0.1203 0.0001 0.1209 0.0000 0.5333 0.2533 0.1516 71 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-EN-CLEF2007 Statistics for P@20 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.6000 0.6125 0.6500 0.8375 0.9500 0.7200 0.1207 0.2250 0.3500 0.1677 0.7110 0.7026 0.1040 0.6000 0.9500 0.7200 0.1207 177-DS 0.0000 0.0125 0.1500 0.2000 0.4000 0.1400 0.1242 0.1875 0.4000 0.8872 0.0124 0.0000 0.0973 0.0000 0.4000 0.1400 0.1242 178-DS 0.2500 0.2500 0.2500 0.4875 0.7500 0.3767 0.1731 0.2375 0.5000 0.4595 0.3459 0.3223 0.1453 0.2500 0.7500 0.3767 0.1731 179-DS 0.3500 0.4625 0.5500 0.6625 0.8000 0.5467 0.1302 0.2000 0.4500 0.2382 0.5322 0.5178 0.0969 0.3500 0.8000 0.5467 0.1302 180-DS 0.8500 0.9000 0.9000 0.9375 0.9500 0.9100 0.0280 0.0375 0.1000 0.0308 0.9096 0.9092 0.0213 0.8500 0.9500 0.9100 0.0280 181-DS 0.1000 0.2500 0.3500 0.4500 0.5000 0.3400 0.1326 0.2000 0.4000 0.3899 0.3071 0.2639 0.1053 0.1000 0.5000 0.3400 0.1326 182-DS 0.1000 0.1500 0.2000 0.2500 0.3500 0.2133 0.0694 0.1000 0.2500 0.3251 0.2026 0.1918 0.0560 0.1000 0.3500 0.2133 0.0694 183-DS 0.3000 0.3625 0.6500 0.8000 0.8500 0.6133 0.2117 0.4375 0.5500 0.3451 0.5729 0.5289 0.1822 0.3000 0.8500 0.6133 0.2117 184-DS 0.4000 0.6625 0.8000 0.8500 0.9500 0.7400 0.1628 0.1875 0.5500 0.2200 0.7200 0.6963 0.1267 0.4000 0.9500 0.7400 0.1628 185-DS 0.1500 0.3125 0.4500 0.4875 0.6000 0.4000 0.1323 0.1750 0.4500 0.3307 0.3724 0.3369 0.1067 0.1500 0.6000 0.4000 0.1323 186-DS 0.0000 0.1000 0.1000 0.1500 0.4000 0.1267 0.0863 0.0500 0.4000 0.6815 0.0649 0.0001 0.0520 0.0500 0.1500 0.1154 0.0315 187-DS 0.5500 0.8500 0.9000 0.9000 1.0000 0.8733 0.1116 0.0500 0.4500 0.1278 0.8654 0.8560 0.0720 0.8500 0.9000 0.8800 0.0258 188-DS 0.6500 0.8625 0.9000 0.9875 1.0000 0.9000 0.1018 0.1250 0.3500 0.1131 0.8941 0.8875 0.0733 0.7500 1.0000 0.9179 0.0775 189-DS 0.1000 0.1000 0.2000 0.3250 0.4000 0.2067 0.1083 0.2250 0.3000 0.5242 0.1816 0.1606 0.0889 0.1000 0.4000 0.2067 0.1083 190-DS 0.1000 0.1500 0.2500 0.3750 0.5500 0.2667 0.1371 0.2250 0.4500 0.5143 0.2370 0.2118 0.1089 0.1000 0.5500 0.2667 0.1371 191-DS 0.1500 0.2500 0.3500 0.4375 0.7500 0.3633 0.1695 0.1875 0.6000 0.4666 0.3324 0.3065 0.1244 0.1500 0.7000 0.3357 0.1365 192-DS 0.2500 0.4125 0.4500 0.5375 0.7000 0.4767 0.1083 0.1250 0.4500 0.2273 0.4646 0.4516 0.0787 0.2500 0.7000 0.4767 0.1083 193-DS 0.7000 0.8500 0.9000 0.9500 1.0000 0.8800 0.0941 0.1000 0.3000 0.1069 0.8751 0.8701 0.0747 0.7500 1.0000 0.8929 0.0829 194-DS 0.1500 0.3000 0.3500 0.5375 0.6000 0.3933 0.1335 0.2375 0.4500 0.3393 0.3701 0.3444 0.1129 0.1500 0.6000 0.3933 0.1335 195-DS 0.6000 0.8500 0.8500 0.9375 1.0000 0.8500 0.1150 0.0875 0.4000 0.1352 0.8419 0.8330 0.0800 0.8500 1.0000 0.9000 0.0522 196-DS 0.1500 0.1625 0.2500 0.2500 0.4000 0.2333 0.0748 0.0875 0.2500 0.3206 0.2229 0.2132 0.0578 0.1500 0.3500 0.2214 0.0611 197-DS 0.2500 0.4250 0.6500 0.7500 0.9500 0.6267 0.2145 0.3250 0.7000 0.3423 0.5864 0.5410 0.1747 0.2500 0.9500 0.6267 0.2145 198-DS 0.3500 0.9000 0.9500 0.9500 1.0000 0.8933 0.1635 0.0500 0.6500 0.1830 0.8711 0.8353 0.0973 0.8500 1.0000 0.9462 0.0431 199-DS 0.4000 0.4500 0.5000 0.5375 0.6000 0.4933 0.0530 0.0875 0.2000 0.1074 0.4907 0.4881 0.0413 0.4000 0.6000 0.4933 0.0530 200-DS 0.0500 0.1625 0.3000 0.3500 0.4500 0.2700 0.1251 0.1875 0.4000 0.4632 0.2343 0.1886 0.1053 0.0500 0.4500 0.2700 0.1251 72 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-EN-CLEF2007 Statistics for P@30 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.4667 0.5333 0.6667 0.8167 0.8667 0.6578 0.1545 0.2833 0.4000 0.2349 0.6408 0.6242 0.1384 0.4667 0.8667 0.6578 0.1545 177-DS 0.0000 0.0250 0.1333 0.1833 0.3000 0.1244 0.0947 0.1583 0.3000 0.7608 0.0121 0.0000 0.0696 0.0000 0.3000 0.1244 0.0947 178-DS 0.2000 0.2417 0.2667 0.3667 0.6667 0.3244 0.1324 0.1250 0.4667 0.4081 0.3048 0.2898 0.0960 0.2000 0.3667 0.2795 0.0602 179-DS 0.3667 0.5000 0.5667 0.6333 0.8000 0.5756 0.1137 0.1333 0.4333 0.1976 0.5649 0.5541 0.0862 0.3667 0.8000 0.5756 0.1137 180-DS 0.9000 0.9000 0.9000 0.9333 0.9333 0.9156 0.0172 0.0333 0.0333 0.0188 0.9154 0.9153 0.0166 0.9000 0.9333 0.9156 0.0172 181-DS 0.1000 0.2167 0.4000 0.4000 0.4333 0.3222 0.1193 0.1833 0.3333 0.3702 0.2926 0.2535 0.0993 0.1000 0.4333 0.3222 0.1193 182-DS 0.1000 0.1333 0.2333 0.2917 0.3667 0.2111 0.0842 0.1583 0.2667 0.3989 0.1948 0.1789 0.0726 0.1000 0.3667 0.2111 0.0842 183-DS 0.3333 0.3667 0.6333 0.7833 0.8333 0.6000 0.1919 0.4167 0.5000 0.3198 0.5682 0.5352 0.1600 0.3333 0.8333 0.6000 0.1919 184-DS 0.4667 0.5667 0.6667 0.8000 0.9667 0.6844 0.1522 0.2333 0.5000 0.2223 0.6686 0.6528 0.1256 0.4667 0.9667 0.6844 0.1522 185-DS 0.1000 0.2750 0.3333 0.3333 0.5667 0.3156 0.1253 0.0583 0.4667 0.3970 0.2888 0.2574 0.0836 0.2667 0.3667 0.3233 0.0274 186-DS 0.0333 0.0667 0.1000 0.1250 0.4000 0.1067 0.0875 0.0583 0.3667 0.8200 0.0877 0.0750 0.0498 0.0333 0.1333 0.0857 0.0339 187-DS 0.6333 0.7417 0.8667 0.9333 1.0000 0.8356 0.1192 0.1917 0.3667 0.1426 0.8273 0.8189 0.1043 0.6333 1.0000 0.8356 0.1192 188-DS 0.5333 0.8500 0.9333 0.9667 1.0000 0.8956 0.1265 0.1167 0.4667 0.1413 0.8853 0.8728 0.0910 0.7667 1.0000 0.9214 0.0802 189-DS 0.0667 0.1000 0.1333 0.2333 0.3667 0.1622 0.0872 0.1333 0.3000 0.5373 0.1421 0.1247 0.0702 0.0667 0.3667 0.1622 0.0872 190-DS 0.1333 0.1667 0.2000 0.2917 0.4333 0.2378 0.0991 0.1250 0.3000 0.4168 0.2207 0.2061 0.0770 0.1333 0.4333 0.2378 0.0991 191-DS 0.1667 0.1750 0.3000 0.3917 0.6000 0.3178 0.1547 0.2167 0.4333 0.4870 0.2859 0.2593 0.1236 0.1667 0.6000 0.3178 0.1547 192-DS 0.2333 0.3417 0.3667 0.4833 0.5667 0.3956 0.0907 0.1417 0.3333 0.2294 0.3857 0.3756 0.0708 0.2333 0.5667 0.3956 0.0907 193-DS 0.6667 0.8083 0.8667 0.9250 1.0000 0.8667 0.0909 0.1167 0.3333 0.1048 0.8620 0.8571 0.0667 0.6667 1.0000 0.8667 0.0909 194-DS 0.2333 0.3167 0.3667 0.4667 0.6667 0.3956 0.1167 0.1500 0.4333 0.2951 0.3798 0.3643 0.0886 0.2333 0.6667 0.3956 0.1167 195-DS 0.5333 0.8333 0.9000 0.9333 1.0000 0.8511 0.1308 0.1000 0.4667 0.1537 0.8402 0.8275 0.0963 0.8333 1.0000 0.9083 0.0534 196-DS 0.1000 0.1750 0.2000 0.2917 0.3667 0.2267 0.0747 0.1167 0.2667 0.3298 0.2147 0.2021 0.0596 0.1000 0.3667 0.2267 0.0747 197-DS 0.3333 0.5000 0.6333 0.7167 0.9333 0.6244 0.1879 0.2167 0.6000 0.3009 0.5953 0.5638 0.1396 0.3333 0.9333 0.6244 0.1879 198-DS 0.5000 0.8417 0.8667 0.9000 0.9333 0.8422 0.1158 0.0583 0.4333 0.1375 0.8329 0.8212 0.0759 0.8000 0.9333 0.8821 0.0399 199-DS 0.3333 0.4000 0.4000 0.4333 0.5333 0.4200 0.0561 0.0333 0.2000 0.1335 0.4167 0.4136 0.0418 0.3667 0.4667 0.4083 0.0289 200-DS 0.1000 0.2167 0.3000 0.3667 0.4667 0.2978 0.1130 0.1500 0.3667 0.3795 0.2714 0.2385 0.0874 0.1000 0.4667 0.2978 0.1130 73 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-EN-CLEF2007 Statistics for P@100 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.2700 0.4625 0.5600 0.6100 0.6900 0.5393 0.1126 0.1475 0.4200 0.2088 0.5265 0.5110 0.0887 0.2700 0.6900 0.5393 0.1126 177-DS 0.0400 0.0500 0.1300 0.1500 0.1900 0.1060 0.0533 0.1000 0.1500 0.5028 0.0920 0.0787 0.0483 0.0400 0.1900 0.1060 0.0533 178-DS 0.1100 0.2325 0.2700 0.3275 0.3500 0.2687 0.0656 0.0950 0.2400 0.2440 0.2592 0.2470 0.0521 0.1100 0.3500 0.2687 0.0656 179-DS 0.3800 0.4900 0.5000 0.5325 0.5800 0.4953 0.0548 0.0425 0.2000 0.1105 0.4923 0.4889 0.0363 0.4700 0.5800 0.5131 0.0307 180-DS 0.7800 0.8525 0.8700 0.8800 0.9300 0.8633 0.0412 0.0275 0.1500 0.0477 0.8624 0.8615 0.0293 0.8500 0.9200 0.8755 0.0197 181-DS 0.0300 0.1300 0.1600 0.1600 0.1700 0.1360 0.0440 0.0300 0.1400 0.3239 0.1237 0.1032 0.0320 0.1100 0.1700 0.1515 0.0172 182-DS 0.0900 0.1025 0.1400 0.1800 0.2300 0.1420 0.0449 0.0775 0.1400 0.3163 0.1357 0.1299 0.0371 0.0900 0.2300 0.1420 0.0449 183-DS 0.2300 0.3900 0.4500 0.5250 0.5600 0.4353 0.0985 0.1350 0.3300 0.2262 0.4235 0.4099 0.0796 0.2300 0.5600 0.4353 0.0985 184-DS 0.2500 0.3850 0.6000 0.7050 0.8200 0.5573 0.1858 0.3200 0.5700 0.3334 0.5250 0.4903 0.1575 0.2500 0.8200 0.5573 0.1858 185-DS 0.0500 0.1000 0.1200 0.1375 0.4300 0.1527 0.1045 0.0375 0.3800 0.6845 0.1313 0.1172 0.0683 0.0500 0.1700 0.1146 0.0288 186-DS 0.0400 0.0600 0.0700 0.0800 0.2200 0.0767 0.0424 0.0200 0.1800 0.5527 0.0701 0.0656 0.0227 0.0400 0.0900 0.0664 0.0155 187-DS 0.6700 0.7100 0.8700 0.8950 0.9200 0.8167 0.0975 0.1850 0.2500 0.1194 0.8110 0.8050 0.0867 0.6700 0.9200 0.8167 0.0975 188-DS 0.4600 0.7525 0.8600 0.9150 0.9600 0.8107 0.1362 0.1625 0.5000 0.1680 0.7980 0.7827 0.1059 0.6400 0.9600 0.8357 0.0992 189-DS 0.0400 0.0550 0.0900 0.1375 0.1900 0.0987 0.0482 0.0825 0.1500 0.4889 0.0872 0.0762 0.0399 0.0400 0.1900 0.0987 0.0482 190-DS 0.1600 0.2125 0.2400 0.2875 0.3200 0.2427 0.0471 0.0750 0.1600 0.1942 0.2381 0.2334 0.0375 0.1600 0.3200 0.2427 0.0471 191-DS 0.1200 0.1500 0.1800 0.2875 0.3800 0.2167 0.0865 0.1375 0.2600 0.3992 0.2024 0.1904 0.0742 0.1200 0.3800 0.2167 0.0865 192-DS 0.1400 0.2150 0.2800 0.3175 0.4300 0.2780 0.0771 0.1025 0.2900 0.2774 0.2677 0.2571 0.0595 0.1400 0.4300 0.2780 0.0771 193-DS 0.6000 0.7175 0.8700 0.8975 0.9400 0.8207 0.1055 0.1800 0.3400 0.1286 0.8138 0.8064 0.0898 0.6000 0.9400 0.8207 0.1055 194-DS 0.2800 0.3650 0.4500 0.6025 0.7000 0.4827 0.1400 0.2375 0.4200 0.2901 0.4635 0.4447 0.1215 0.2800 0.7000 0.4827 0.1400 195-DS 0.3800 0.8100 0.8600 0.8800 0.9200 0.8273 0.1303 0.0700 0.5400 0.1575 0.8129 0.7911 0.0732 0.7900 0.9200 0.8593 0.0423 196-DS 0.1200 0.1650 0.2000 0.2100 0.2700 0.1953 0.0393 0.0450 0.1500 0.2010 0.1916 0.1878 0.0276 0.1200 0.2700 0.1953 0.0393 197-DS 0.3400 0.3800 0.5600 0.6175 0.6800 0.5167 0.1255 0.2375 0.3400 0.2428 0.5015 0.4857 0.1080 0.3400 0.6800 0.5167 0.1255 198-DS 0.4500 0.5925 0.7000 0.7275 0.7900 0.6573 0.1064 0.1350 0.3400 0.1619 0.6484 0.6384 0.0862 0.4500 0.7900 0.6573 0.1064 199-DS 0.1400 0.2000 0.2700 0.2800 0.3000 0.2400 0.0568 0.0800 0.1600 0.2368 0.2327 0.2246 0.0493 0.1400 0.3000 0.2400 0.0568 200-DS 0.1400 0.1925 0.2700 0.3000 0.3200 0.2487 0.0564 0.1075 0.1800 0.2269 0.2420 0.2346 0.0456 0.1400 0.3200 0.2487 0.0564 74 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-EN-CLEF2007 Statistics for P@200 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.2450 0.2800 0.3700 0.4137 0.4250 0.3540 0.0687 0.1337 0.1800 0.1940 0.3473 0.3402 0.0605 0.2450 0.4250 0.3540 0.0687 177-DS 0.0300 0.0463 0.0900 0.1150 0.1250 0.0813 0.0351 0.0688 0.0950 0.4319 0.0728 0.0636 0.0311 0.0300 0.1250 0.0813 0.0351 178-DS 0.0650 0.1525 0.1950 0.2162 0.2450 0.1840 0.0490 0.0637 0.1800 0.2665 0.1760 0.1650 0.0384 0.0650 0.2450 0.1840 0.0490 179-DS 0.2350 0.3375 0.3550 0.3638 0.4100 0.3443 0.0440 0.0263 0.1750 0.1279 0.3413 0.3379 0.0296 0.3200 0.3900 0.3546 0.0174 180-DS 0.6800 0.7263 0.7600 0.7650 0.7900 0.7450 0.0318 0.0387 0.1100 0.0427 0.7444 0.7437 0.0260 0.6800 0.7900 0.7450 0.0318 181-DS 0.0200 0.0800 0.0800 0.0800 0.0850 0.0713 0.0216 0.0000 0.0650 0.3026 0.0658 0.0566 0.0152 0.0800 0.0800 0.0800 0.0000 182-DS 0.0500 0.0825 0.0950 0.1313 0.1550 0.1040 0.0301 0.0488 0.1050 0.2897 0.0998 0.0955 0.0241 0.0500 0.1550 0.1040 0.0301 183-DS 0.1550 0.2775 0.3400 0.3750 0.4350 0.3277 0.0719 0.0975 0.2800 0.2195 0.3188 0.3079 0.0555 0.1550 0.4350 0.3277 0.0719 184-DS 0.2200 0.3687 0.4800 0.5700 0.6750 0.4717 0.1200 0.2013 0.4550 0.2544 0.4554 0.4366 0.0936 0.2200 0.6750 0.4717 0.1200 185-DS 0.0300 0.0612 0.0750 0.1000 0.2600 0.1007 0.0676 0.0388 0.2300 0.6719 0.0859 0.0753 0.0451 0.0300 0.1250 0.0765 0.0246 186-DS 0.0300 0.0500 0.0550 0.0637 0.1650 0.0617 0.0307 0.0137 0.1350 0.4986 0.0571 0.0539 0.0164 0.0300 0.0750 0.0543 0.0117 187-DS 0.5700 0.6300 0.7100 0.7450 0.8250 0.6937 0.0811 0.1150 0.2550 0.1170 0.6892 0.6848 0.0688 0.5700 0.8250 0.6937 0.0811 188-DS 0.3750 0.6663 0.7150 0.7488 0.7800 0.6830 0.1088 0.0825 0.4050 0.1593 0.6728 0.6597 0.0773 0.5900 0.7800 0.7181 0.0524 189-DS 0.0300 0.0513 0.0650 0.0787 0.1250 0.0720 0.0281 0.0275 0.0950 0.3900 0.0672 0.0627 0.0207 0.0300 0.1100 0.0638 0.0195 190-DS 0.1450 0.1962 0.2000 0.2175 0.2350 0.2000 0.0260 0.0213 0.0900 0.1299 0.1982 0.1963 0.0167 0.1900 0.2350 0.2085 0.0143 191-DS 0.1000 0.1050 0.1450 0.1988 0.2350 0.1540 0.0472 0.0938 0.1350 0.3063 0.1472 0.1406 0.0416 0.1000 0.2350 0.1540 0.0472 192-DS 0.0850 0.1950 0.2050 0.2450 0.3200 0.2110 0.0680 0.0500 0.2350 0.3221 0.1987 0.1842 0.0504 0.1950 0.3200 0.2379 0.0434 193-DS 0.5000 0.6688 0.7400 0.7637 0.8550 0.7060 0.0998 0.0950 0.3550 0.1413 0.6988 0.6909 0.0767 0.5400 0.8550 0.7207 0.0850 194-DS 0.2000 0.3413 0.4200 0.5388 0.6100 0.4317 0.1205 0.1975 0.4100 0.2792 0.4143 0.3951 0.0978 0.2000 0.6100 0.4317 0.1205 195-DS 0.2350 0.7225 0.7700 0.8125 0.8300 0.7283 0.1480 0.0900 0.5950 0.2032 0.7039 0.6607 0.0884 0.6300 0.8300 0.7636 0.0594 196-DS 0.0800 0.1513 0.1650 0.1775 0.1950 0.1557 0.0359 0.0263 0.1150 0.2303 0.1507 0.1444 0.0258 0.1200 0.1950 0.1673 0.0200 197-DS 0.2300 0.2862 0.4300 0.5075 0.5350 0.3953 0.1128 0.2212 0.3050 0.2854 0.3791 0.3623 0.0983 0.2300 0.5350 0.3953 0.1128 198-DS 0.3250 0.4325 0.5400 0.5938 0.6250 0.5153 0.1012 0.1613 0.3000 0.1963 0.5047 0.4926 0.0849 0.3250 0.6250 0.5153 0.1012 199-DS 0.0800 0.1713 0.1950 0.2087 0.2200 0.1803 0.0441 0.0375 0.1400 0.2448 0.1731 0.1631 0.0303 0.1700 0.2200 0.1958 0.0184 200-DS 0.1000 0.1713 0.2000 0.2312 0.2550 0.1977 0.0421 0.0600 0.1550 0.2131 0.1927 0.1868 0.0308 0.1000 0.2550 0.1977 0.0421 75 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-EN-CLEF2007 Statistics for P@500 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.1000 0.1345 0.1620 0.1720 0.1780 0.1533 0.0270 0.0375 0.0780 0.1760 0.1508 0.1479 0.0221 0.1000 0.1780 0.1533 0.0270 177-DS 0.0160 0.0445 0.0580 0.0675 0.0740 0.0541 0.0164 0.0230 0.0580 0.3035 0.0509 0.0462 0.0132 0.0160 0.0740 0.0541 0.0164 178-DS 0.0340 0.0905 0.1040 0.1315 0.1500 0.1073 0.0309 0.0410 0.1160 0.2879 0.1018 0.0939 0.0236 0.0340 0.1500 0.1073 0.0309 179-DS 0.1600 0.1710 0.1960 0.2015 0.2020 0.1887 0.0161 0.0305 0.0420 0.0853 0.1880 0.1873 0.0143 0.1600 0.2020 0.1887 0.0161 180-DS 0.4220 0.4665 0.4820 0.5110 0.5380 0.4839 0.0335 0.0445 0.1160 0.0692 0.4828 0.4817 0.0255 0.4220 0.5380 0.4839 0.0335 181-DS 0.0260 0.0320 0.0320 0.0340 0.0340 0.0324 0.0020 0.0020 0.0080 0.0626 0.0323 0.0323 0.0013 0.0320 0.0340 0.0329 0.0010 182-DS 0.0220 0.0600 0.0680 0.0800 0.0960 0.0691 0.0179 0.0200 0.0740 0.2592 0.0660 0.0614 0.0129 0.0580 0.0960 0.0724 0.0128 183-DS 0.0940 0.1755 0.1860 0.2050 0.2380 0.1865 0.0367 0.0295 0.1440 0.1970 0.1825 0.1774 0.0256 0.1440 0.2380 0.1931 0.0274 184-DS 0.2780 0.3285 0.3500 0.3825 0.4300 0.3555 0.0446 0.0540 0.1520 0.1255 0.3528 0.3502 0.0359 0.2780 0.4300 0.3555 0.0446 185-DS 0.0200 0.0380 0.0500 0.0700 0.1200 0.0580 0.0290 0.0320 0.1000 0.5000 0.0522 0.0472 0.0211 0.0200 0.0760 0.0485 0.0156 186-DS 0.0260 0.0325 0.0480 0.0535 0.0740 0.0453 0.0130 0.0210 0.0480 0.2862 0.0436 0.0419 0.0104 0.0260 0.0740 0.0453 0.0130 187-DS 0.3380 0.4385 0.4900 0.5365 0.6360 0.4892 0.0851 0.0980 0.2980 0.1740 0.4820 0.4745 0.0646 0.3380 0.6360 0.4892 0.0851 188-DS 0.2420 0.4200 0.4560 0.4620 0.4900 0.4313 0.0635 0.0420 0.2480 0.1472 0.4257 0.4185 0.0425 0.4100 0.4900 0.4528 0.0235 189-DS 0.0340 0.0425 0.0440 0.0550 0.0720 0.0491 0.0112 0.0125 0.0380 0.2274 0.0480 0.0469 0.0087 0.0340 0.0720 0.0491 0.0112 190-DS 0.0900 0.1760 0.1860 0.2015 0.2080 0.1748 0.0393 0.0255 0.1180 0.2248 0.1695 0.1628 0.0292 0.1740 0.2080 0.1930 0.0110 191-DS 0.0440 0.0685 0.0880 0.1095 0.1220 0.0883 0.0252 0.0410 0.0780 0.2853 0.0845 0.0805 0.0208 0.0440 0.1220 0.0883 0.0252 192-DS 0.0440 0.1265 0.1380 0.1585 0.1740 0.1285 0.0416 0.0320 0.1300 0.3233 0.1195 0.1075 0.0305 0.1260 0.1740 0.1473 0.0161 193-DS 0.2860 0.4305 0.5020 0.5485 0.5680 0.4823 0.0804 0.1180 0.2820 0.1667 0.4750 0.4667 0.0632 0.2860 0.5680 0.4823 0.0804 194-DS 0.1100 0.2295 0.2720 0.3270 0.3520 0.2709 0.0674 0.0975 0.2420 0.2488 0.2611 0.2483 0.0523 0.1100 0.3520 0.2709 0.0674 195-DS 0.1580 0.4830 0.5460 0.5665 0.6160 0.5104 0.1082 0.0835 0.4580 0.2119 0.4919 0.4590 0.0675 0.4500 0.6160 0.5356 0.0487 196-DS 0.0320 0.0765 0.0840 0.0875 0.0880 0.0763 0.0188 0.0110 0.0560 0.2466 0.0730 0.0682 0.0129 0.0680 0.0880 0.0831 0.0060 197-DS 0.1540 0.1825 0.2480 0.2735 0.2840 0.2312 0.0484 0.0910 0.1300 0.2091 0.2260 0.2205 0.0423 0.1540 0.2840 0.2312 0.0484 198-DS 0.1960 0.2840 0.3180 0.3435 0.3580 0.3065 0.0466 0.0595 0.1620 0.1521 0.3028 0.2986 0.0370 0.1960 0.3580 0.3065 0.0466 199-DS 0.0360 0.0910 0.1080 0.1155 0.1300 0.0980 0.0278 0.0245 0.0940 0.2836 0.0925 0.0847 0.0203 0.0780 0.1300 0.1074 0.0136 200-DS 0.0720 0.1115 0.1260 0.1330 0.1420 0.1212 0.0179 0.0215 0.0700 0.1478 0.1197 0.1180 0.0132 0.1060 0.1420 0.1247 0.0121 76 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-EN-CLEF2007 Statistics for P@1000 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0500 0.0790 0.0860 0.0890 0.0900 0.0799 0.0131 0.0100 0.0400 0.1641 0.0787 0.0772 0.0098 0.0790 0.0900 0.0858 0.0039 177-DS 0.0170 0.0320 0.0390 0.0428 0.0470 0.0367 0.0086 0.0107 0.0300 0.2357 0.0355 0.0340 0.0069 0.0170 0.0470 0.0367 0.0086 178-DS 0.0270 0.0605 0.0690 0.0977 0.1040 0.0747 0.0237 0.0372 0.0770 0.3177 0.0704 0.0653 0.0199 0.0270 0.1040 0.0747 0.0237 179-DS 0.0830 0.1013 0.1040 0.1040 0.1050 0.1000 0.0075 0.0027 0.0220 0.0753 0.0997 0.0994 0.0056 0.1010 0.1050 0.1035 0.0014 180-DS 0.2350 0.2853 0.3030 0.3168 0.3360 0.2969 0.0296 0.0315 0.1010 0.0997 0.2954 0.2938 0.0220 0.2840 0.3360 0.3063 0.0173 181-DS 0.0140 0.0160 0.0170 0.0170 0.0170 0.0165 0.0008 0.0010 0.0030 0.0504 0.0165 0.0165 0.0006 0.0160 0.0170 0.0167 0.0005 182-DS 0.0150 0.0440 0.0490 0.0560 0.0630 0.0485 0.0115 0.0120 0.0480 0.2361 0.0466 0.0433 0.0080 0.0420 0.0630 0.0509 0.0070 183-DS 0.0530 0.1018 0.1140 0.1218 0.1330 0.1095 0.0201 0.0200 0.0800 0.1835 0.1072 0.1043 0.0142 0.0900 0.1330 0.1135 0.0131 184-DS 0.1610 0.2147 0.2350 0.2535 0.2640 0.2325 0.0268 0.0388 0.1030 0.1152 0.2309 0.2291 0.0198 0.1610 0.2640 0.2325 0.0268 185-DS 0.0150 0.0258 0.0330 0.0488 0.0660 0.0384 0.0155 0.0230 0.0510 0.4026 0.0355 0.0328 0.0125 0.0150 0.0660 0.0384 0.0155 186-DS 0.0190 0.0285 0.0360 0.0370 0.0430 0.0332 0.0061 0.0085 0.0240 0.1840 0.0326 0.0319 0.0050 0.0190 0.0430 0.0332 0.0061 187-DS 0.2000 0.3185 0.3510 0.3585 0.4060 0.3323 0.0593 0.0400 0.2060 0.1785 0.3263 0.3192 0.0431 0.2900 0.4060 0.3518 0.0314 188-DS 0.1620 0.2703 0.2770 0.2858 0.2910 0.2692 0.0315 0.0155 0.1290 0.1169 0.2670 0.2640 0.0175 0.2510 0.2910 0.2769 0.0110 189-DS 0.0210 0.0248 0.0280 0.0335 0.0420 0.0298 0.0065 0.0088 0.0210 0.2179 0.0292 0.0286 0.0051 0.0210 0.0420 0.0298 0.0065 190-DS 0.0520 0.1045 0.1060 0.1060 0.1060 0.0987 0.0186 0.0015 0.0540 0.1881 0.0964 0.0933 0.0122 0.1040 0.1060 0.1057 0.0008 191-DS 0.0310 0.0470 0.0520 0.0587 0.0630 0.0516 0.0091 0.0118 0.0320 0.1770 0.0508 0.0498 0.0074 0.0310 0.0630 0.0516 0.0091 192-DS 0.0330 0.0790 0.0830 0.0917 0.0970 0.0773 0.0222 0.0127 0.0640 0.2879 0.0731 0.0676 0.0166 0.0790 0.0970 0.0877 0.0062 193-DS 0.1870 0.3020 0.3190 0.3522 0.3670 0.3182 0.0447 0.0502 0.1800 0.1406 0.3146 0.3102 0.0309 0.2880 0.3670 0.3276 0.0272 194-DS 0.0710 0.1438 0.1700 0.1885 0.2010 0.1619 0.0342 0.0447 0.1300 0.2114 0.1575 0.1517 0.0264 0.1300 0.2010 0.1684 0.0241 195-DS 0.1170 0.3047 0.3460 0.3578 0.3660 0.3229 0.0633 0.0530 0.2490 0.1961 0.3136 0.2981 0.0414 0.2820 0.3660 0.3376 0.0287 196-DS 0.0180 0.0415 0.0440 0.0440 0.0450 0.0399 0.0090 0.0025 0.0270 0.2267 0.0384 0.0364 0.0061 0.0380 0.0450 0.0432 0.0018 197-DS 0.0980 0.1120 0.1480 0.1510 0.1570 0.1350 0.0215 0.0390 0.0590 0.1592 0.1333 0.1314 0.0188 0.0980 0.1570 0.1350 0.0215 198-DS 0.1460 0.1757 0.1880 0.2010 0.2070 0.1851 0.0189 0.0253 0.0610 0.1020 0.1842 0.1832 0.0145 0.1460 0.2070 0.1851 0.0189 199-DS 0.0210 0.0522 0.0610 0.0655 0.0680 0.0553 0.0149 0.0133 0.0470 0.2700 0.0524 0.0483 0.0105 0.0480 0.0680 0.0605 0.0064 200-DS 0.0470 0.0737 0.0800 0.0872 0.0920 0.0787 0.0114 0.0135 0.0450 0.1453 0.0777 0.0766 0.0082 0.0670 0.0920 0.0809 0.0076 77 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-RU-CLEF2007 Domain−Specific Monolingual Russian Task Top 5 Participants − Standard Recall Levels vs Mean Interpolated Precision 100% unine [Experiment UNINERU4; MAP 19.71%; Pooled] cheshire [Experiment BERKMRUTHP7; MAP 14.01%; Pooled] 90% chemnitz [Experiment CUT_DS_MONO_RU_MERGED; MAP 13.12%; Pooled] moscow [Experiment CIRDSMONORU2; MAP 9.86%; Pooled] 80% 70% 60% Precision 50% 40% 30% 20% 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Monolingual Russian Task Top 5 Participants − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) 1 unine [Experiment UNINERU4; MAP 19.71%; Pooled] cheshire [Experiment BERKMRUTHP7; MAP 14.01%; Pooled] chemnitz [Experiment CUT_DS_MONO_RU_MERGED; MAP 13.12%; Pooled] moscow [Experiment CIRDSMONORU2; MAP 9.86%; Pooled] 0.8 0.6 0.4 0.2 Difference 0 −0.2 −0.4 −0.6 −0.8 −1 176−DS177−DS178−DS179−DS180−DS181−DS182−DS183−DS184−DS185−DS186−DS187−DS188−DS189−DS190−DS191−DS192−DS193−DS194−DS195−DS196−DS197−DS198−DS199−DS200−DS Topic Identifier 78 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-RU-CLEF2007 Domain−Specific Monolingual Russian Task − Box Plot of the Topics unine [Experiment UNINERU4; MAP 19.71%; Pooled] unine [Experiment UNINERU3; MAP 14.50%; Pooled] cheshire [Experiment BERKMRUTHP7; MAP 14.01%; Pooled] cheshire [Experiment BERKMRUCCP15; MAP 13.90%; Pooled] unine [Experiment UNINERU1; MAP 13.73%; Pooled] Experiments unine [Experiment UNINERU2; MAP 13.38%; Pooled] chemnitz [Experiment CUT_DS_MONO_RU_MERGED; MAP 13.12%; Pooled] chemnitz [Experiment CUT_DS_MONO_RU_UNSTRUCT; MAP 12.83%; Pooled] moscow [Experiment CIRDSMONORU2; MAP 9.86%; Pooled] moscow [Experiment CIRDSMONORU; MAP 9.77%; Pooled] chemnitz [Experiment CUT_DS_MONO_RU_STRUCT; MAP 8.98%; Pooled] 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Average Precision 79 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-RU-CLEF2007 10.2455/TUKEY_T_TEST.06F081572F0ACBB10C17EDF4171B893E Domain−Specific Monolingual Russian Task − Tukey T test with "top group" highlighted UNINERU4 UNINERU3 BERKMRUTHP7 BERKMRUCCP15 UNINERU1 Experiments UNINERU2 CUT_DS_MONO_RU_MERGED CUT_DS_MONO_RU_UNSTRUCT CIRDSMONORU2 CIRDSMONORU CUT_DS_MONO_RU_STRUCT 0.2 0.25 0.3 0.35 0.4 0.45 0.5 arcsin(sqrt(Average Precsion)) 80 81 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-RU-CLEF2007 Domain−Specific Monolingual Russian Task Top 5 Participants − Retrieved documents vs Mean Precision 100% unine [Experiment UNINERU4; R−Prec 21.72%; Pooled] cheshire [Experiment BERKMRUTHP7; R−Prec 15.84%; Pooled] 90% chemnitz [Experiment CUT_DS_MONO_RU_MERGED; R−Prec 16.52%; Pooled] moscow [Experiment CIRDSMONORU2; R−Prec 12.66%; Pooled] 80% 70% 60% Precision 50% 40% 30% 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Monolingual Russian Task Top 5 Participants − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) 1 unine [Experiment UNINERU4; R−Prec 21.72%; Pooled] cheshire [Experiment BERKMRUTHP7; R−Prec 15.84%; Pooled] chemnitz [Experiment CUT_DS_MONO_RU_MERGED; R−Prec 16.52%; Pooled] moscow [Experiment CIRDSMONORU2; R−Prec 12.66%; Pooled] 0.8 0.6 0.4 0.2 Difference 0 −0.2 −0.4 −0.6 −0.8 −1 176−DS177−DS178−DS179−DS180−DS181−DS182−DS183−DS184−DS185−DS186−DS187−DS188−DS189−DS190−DS191−DS192−DS193−DS194−DS195−DS196−DS197−DS198−DS199−DS200−DS Topic Identifier 82 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-RU-CLEF2007 Domain−Specific Monolingual Russian Task − Box Plot of the Topics unine [Experiment UNINERU4; R−Prec 21.72%; Pooled] chemnitz [Experiment CUT_DS_MONO_RU_MERGED; R−Prec 16.52%; Pooled] unine [Experiment UNINERU2; R−Prec 16.52%; Pooled] unine [Experiment UNINERU1; R−Prec 16.14%; Pooled] unine [Experiment UNINERU3; R−Prec 16.02%; Pooled] Experiments cheshire [Experiment BERKMRUTHP7; R−Prec 15.84%; Pooled] chemnitz [Experiment CUT_DS_MONO_RU_UNSTRUCT; R−Prec 15.77%; Pooled] cheshire [Experiment BERKMRUCCP15; R−Prec 15.70%; Pooled] moscow [Experiment CIRDSMONORU; R−Prec 13.01%; Pooled] moscow [Experiment CIRDSMONORU2; R−Prec 12.66%; Pooled] chemnitz [Experiment CUT_DS_MONO_RU_STRUCT; R−Prec 11.47%; Pooled] 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% R−Precision 83 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-RU-CLEF2007 Domain−Specific Monolingual Russian Task − Tukey T test with "top group" highlighted UNINERU4 UNINERU2 CUT_DS_MONO_RU_MERGED BERKMRUTHP7 UNINERU1 Experiments BERKMRUCCP15 CUT_DS_MONO_RU_UNSTRUCT UNINERU3 CIRDSMONORU CIRDSMONORU2 CUT_DS_MONO_RU_STRUCT 0.2 0.25 0.3 0.35 0.4 0.45 0.5 arcsin(sqrt(R−Precision)) 84 85 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-RU-CLEF2007 Statistics for Number of relevant retrieved documents Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.00 0.00 0.00 1.00 1.00 0.36 0.50 1.00 1.00 1.39 0.00 0.00 0.46 0.00 1.00 0.36 0.50 177-DS 6.00 9.25 10.00 10.00 10.00 9.45 1.21 0.75 4.00 0.13 9.37 9.25 0.79 9.00 10.00 9.80 0.42 178-DS 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 N/D 0.00 0.00 0.00 0.00 0.00 0.00 0.00 179-DS 42.00 54.25 88.00 94.25 96.00 77.64 22.60 40.00 54.00 0.29 73.88 69.50 18.89 42.00 96.00 77.64 22.60 180-DS 9.00 48.25 66.00 68.00 68.00 53.36 23.00 19.75 59.00 0.43 44.08 29.98 17.47 46.00 68.00 63.22 7.73 181-DS 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 N/D 0.00 0.00 0.00 0.00 0.00 0.00 0.00 182-DS 27.00 34.25 39.00 40.00 42.00 36.36 5.33 5.75 15.00 0.15 35.97 35.54 4.33 27.00 42.00 36.36 5.33 183-DS 45.00 48.00 51.00 51.00 53.00 49.64 2.58 3.00 8.00 0.05 49.57 49.51 2.21 45.00 53.00 49.64 2.58 184-DS 18.00 23.25 27.00 31.75 48.00 28.36 8.55 8.50 30.00 0.30 27.31 26.35 6.40 18.00 36.00 26.40 5.83 185-DS 0.00 8.00 8.00 9.00 10.00 7.00 3.52 1.00 10.00 0.50 0.71 0.00 2.55 8.00 10.00 8.56 0.73 186-DS 3.00 3.00 3.00 3.00 4.00 3.18 0.40 0.00 1.00 0.13 3.16 3.14 0.30 3.00 3.00 3.00 0.00 187-DS 51.00 129.25 199.00 274.25 285.00 197.73 82.69 145.00 234.00 0.42 176.41 149.43 67.26 51.00 285.00 197.73 82.69 188-DS 22.00 55.00 59.00 86.00 86.00 64.73 20.00 31.00 64.00 0.31 61.04 56.03 15.47 22.00 86.00 64.73 20.00 189-DS 2.00 4.25 8.00 12.25 16.00 8.27 4.50 8.00 14.00 0.54 7.03 5.77 3.75 2.00 16.00 8.27 4.50 190-DS 120.00 122.00 123.00 123.00 125.00 122.55 1.51 1.00 5.00 0.01 122.54 122.53 1.12 122.00 124.00 122.88 0.64 191-DS 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 N/D 0.00 0.00 0.00 0.00 0.00 0.00 0.00 192-DS 0.00 0.00 1.00 1.00 1.00 0.55 0.52 1.00 1.00 0.96 0.01 0.00 0.50 0.00 1.00 0.55 0.52 193-DS 11.00 15.00 17.00 25.00 25.00 18.55 5.35 10.00 14.00 0.29 17.85 17.19 4.69 11.00 25.00 18.55 5.35 194-DS 46.00 70.50 85.00 94.00 104.00 81.64 17.29 23.50 58.00 0.21 79.71 77.48 13.19 46.00 104.00 81.64 17.29 195-DS 19.00 50.00 86.00 99.00 113.00 76.55 30.49 49.00 94.00 0.40 69.00 58.87 25.40 19.00 113.00 76.55 30.49 196-DS 3.00 4.75 7.00 7.00 8.00 6.18 1.89 2.25 5.00 0.31 5.84 5.44 1.55 3.00 8.00 6.18 1.89 197-DS 0.00 17.50 28.00 29.00 29.00 22.09 11.77 11.50 29.00 0.53 1.80 0.00 9.50 14.00 29.00 27.00 4.90 198-DS 57.00 67.00 85.00 86.75 93.00 77.45 12.81 19.75 36.00 0.17 76.41 75.30 10.78 57.00 93.00 77.45 12.81 199-DS 1.00 2.25 3.00 3.00 3.00 2.64 0.67 0.75 2.00 0.26 2.52 2.36 0.53 2.00 3.00 2.80 0.42 200-DS 73.00 76.00 76.00 80.00 81.00 77.36 2.69 4.00 8.00 0.03 77.32 77.28 2.28 73.00 81.00 77.36 2.69 86 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-RU-CLEF2007 Statistics for Average Precsion Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0010 0.0083 0.0012 0.0026 0.0010 0.0083 2.1111 0.0001 0.0000 0.0017 0.0000 0.0011 0.0002 0.0004 177-DS 0.0121 0.2267 0.3281 0.3473 0.3864 0.2794 0.1056 0.1206 0.3743 0.3780 0.2243 0.0945 0.0771 0.2242 0.3864 0.3061 0.0605 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0209 0.0508 0.1938 0.2831 0.5727 0.1990 0.1699 0.2324 0.5518 0.8536 0.1277 0.0726 0.1292 0.0209 0.5727 0.1990 0.1699 180-DS 0.0447 0.0742 0.2179 0.2581 0.2863 0.1789 0.0947 0.1839 0.2416 0.5294 0.1475 0.1138 0.0823 0.0447 0.2863 0.1789 0.0947 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.0820 0.1083 0.1315 0.1548 0.2102 0.1375 0.0399 0.0465 0.1282 0.2903 0.1325 0.1276 0.0300 0.0820 0.2102 0.1375 0.0399 183-DS 0.1418 0.1863 0.2535 0.2627 0.3082 0.2293 0.0515 0.0764 0.1664 0.2244 0.2236 0.2176 0.0439 0.1418 0.3082 0.2293 0.0515 184-DS 0.0270 0.0532 0.0760 0.0899 0.3047 0.1030 0.0868 0.0368 0.2776 0.8424 0.0808 0.0670 0.0614 0.0270 0.0918 0.0655 0.0209 185-DS 0.0000 0.0076 0.0131 0.0163 0.0561 0.0147 0.0151 0.0087 0.0561 1.0307 0.0039 0.0001 0.0089 0.0000 0.0198 0.0105 0.0066 186-DS 0.0008 0.0025 0.0039 0.0048 0.0103 0.0040 0.0025 0.0023 0.0095 0.6227 0.0034 0.0027 0.0016 0.0008 0.0054 0.0034 0.0015 187-DS 0.0076 0.0636 0.2573 0.4569 0.5689 0.2746 0.2078 0.3933 0.5613 0.7566 0.1504 0.0468 0.1783 0.0076 0.5689 0.2746 0.2078 188-DS 0.0081 0.0868 0.1492 0.7958 0.8392 0.3560 0.3594 0.7090 0.8311 1.0096 0.1774 0.0588 0.3270 0.0081 0.8392 0.3560 0.3594 189-DS 0.0003 0.0012 0.0047 0.0192 0.0339 0.0110 0.0117 0.0180 0.0336 1.0577 0.0047 0.0016 0.0099 0.0003 0.0339 0.0110 0.0117 190-DS 0.3634 0.3975 0.4975 0.5368 0.6115 0.4765 0.0878 0.1393 0.2481 0.1843 0.4691 0.4618 0.0772 0.3634 0.6115 0.4765 0.0878 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0000 0.0000 0.0012 0.0013 0.0038 0.0010 0.0012 0.0013 0.0038 1.2061 0.0002 0.0000 0.0009 0.0000 0.0021 0.0007 0.0008 193-DS 0.0088 0.0423 0.0586 0.2632 0.4032 0.1324 0.1377 0.2210 0.3944 1.0400 0.0704 0.0348 0.1194 0.0088 0.4032 0.1324 0.1377 194-DS 0.0471 0.0631 0.1060 0.1166 0.1563 0.0967 0.0356 0.0535 0.1091 0.3686 0.0904 0.0839 0.0298 0.0471 0.1563 0.0967 0.0356 195-DS 0.0069 0.0440 0.1216 0.2054 0.5085 0.1599 0.1635 0.1614 0.5016 1.0228 0.0877 0.0372 0.1218 0.0069 0.4140 0.1250 0.1219 196-DS 0.0027 0.0203 0.0341 0.0431 0.0507 0.0313 0.0159 0.0228 0.0481 0.5087 0.0245 0.0143 0.0124 0.0027 0.0507 0.0313 0.0159 197-DS 0.0000 0.0255 0.1276 0.1687 0.2596 0.1178 0.0915 0.1432 0.2596 0.7765 0.0206 0.0001 0.0755 0.0000 0.2596 0.1178 0.0915 198-DS 0.1095 0.1534 0.1809 0.2213 0.4609 0.2072 0.0952 0.0679 0.3514 0.4593 0.1923 0.1807 0.0612 0.1095 0.2614 0.1818 0.0469 199-DS 0.0004 0.0037 0.0064 0.0413 0.0889 0.0217 0.0281 0.0376 0.0885 1.2973 0.0085 0.0026 0.0223 0.0004 0.0889 0.0217 0.0281 200-DS 0.1031 0.1556 0.2385 0.3113 0.3394 0.2351 0.0834 0.1558 0.2363 0.3547 0.2199 0.2037 0.0706 0.1031 0.3394 0.2351 0.0834 87 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-RU-CLEF2007 Statistics for R-Precision Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 177-DS 0.0000 0.2250 0.3000 0.3000 0.3000 0.2545 0.0934 0.0750 0.3000 0.3670 0.1092 0.0001 0.0661 0.2000 0.3000 0.2800 0.0422 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0208 0.0781 0.1979 0.3411 0.5833 0.2282 0.1937 0.2630 0.5625 0.8486 0.1427 0.0742 0.1543 0.0208 0.5833 0.2282 0.1937 180-DS 0.0882 0.1324 0.2794 0.3199 0.3382 0.2353 0.0978 0.1875 0.2500 0.4155 0.2127 0.1884 0.0856 0.0882 0.3382 0.2353 0.0978 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.1224 0.1276 0.1633 0.2143 0.2449 0.1707 0.0440 0.0867 0.1224 0.2580 0.1657 0.1610 0.0354 0.1224 0.2449 0.1707 0.0440 183-DS 0.1321 0.2123 0.2453 0.2972 0.3019 0.2436 0.0563 0.0849 0.1698 0.2310 0.2367 0.2287 0.0433 0.1321 0.3019 0.2436 0.0563 184-DS 0.0727 0.1318 0.1818 0.1955 0.3273 0.1818 0.0727 0.0636 0.2545 0.4000 0.1690 0.1562 0.0496 0.0727 0.2909 0.1673 0.0574 185-DS 0.0000 0.0000 0.0000 0.0556 0.0556 0.0253 0.0290 0.0556 0.0556 1.1489 0.0005 0.0000 0.0275 0.0000 0.0556 0.0253 0.0290 186-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 187-DS 0.0388 0.1157 0.4776 0.5015 0.6030 0.3593 0.2139 0.3858 0.5642 0.5953 0.2611 0.1546 0.1907 0.0388 0.6030 0.3593 0.2139 188-DS 0.0465 0.0901 0.1744 0.7326 0.8140 0.3531 0.3257 0.6424 0.7674 0.9224 0.2184 0.1380 0.2929 0.0465 0.8140 0.3531 0.3257 189-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 190-DS 0.4762 0.4940 0.5317 0.6012 0.6111 0.5397 0.0537 0.1071 0.1349 0.0995 0.5373 0.5349 0.0462 0.4762 0.6111 0.5397 0.0537 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 193-DS 0.0000 0.0400 0.1200 0.3200 0.4000 0.1636 0.1544 0.2800 0.4000 0.9433 0.0253 0.0001 0.1355 0.0000 0.4000 0.1636 0.1544 194-DS 0.0866 0.0984 0.1575 0.1870 0.2126 0.1453 0.0469 0.0886 0.1260 0.3227 0.1380 0.1307 0.0419 0.0866 0.2126 0.1453 0.0469 195-DS 0.0073 0.0474 0.2774 0.3157 0.6058 0.2256 0.2028 0.2682 0.5985 0.8990 0.1180 0.0431 0.1693 0.0073 0.6058 0.2256 0.2028 196-DS 0.0000 0.0000 0.0000 0.0000 0.1250 0.0227 0.0506 0.0000 0.1250 2.2249 0.0001 0.0000 0.0372 0.0000 0.0000 0.0000 0.0000 197-DS 0.0000 0.0323 0.1613 0.2177 0.2581 0.1378 0.0990 0.1855 0.2581 0.7183 0.0126 0.0000 0.0784 0.0000 0.2581 0.1378 0.0990 198-DS 0.1440 0.1720 0.2320 0.2940 0.5680 0.2589 0.1203 0.1220 0.4240 0.4648 0.2390 0.2233 0.0846 0.1440 0.3280 0.2280 0.0664 199-DS 0.0000 0.0000 0.0000 0.1250 0.1667 0.0455 0.0778 0.1250 0.1667 1.7127 0.0001 0.0000 0.0661 0.0000 0.1667 0.0455 0.0778 200-DS 0.1220 0.2317 0.3171 0.4024 0.4512 0.3038 0.1064 0.1707 0.3293 0.3502 0.2844 0.2629 0.0899 0.1220 0.4512 0.3038 0.1064 88 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-RU-CLEF2007 Statistics for Binary Preference Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 177-DS 0.0000 0.2100 0.2800 0.3000 0.3000 0.2418 0.0896 0.0900 0.3000 0.3707 0.1042 0.0001 0.0598 0.2000 0.3000 0.2660 0.0422 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0152 0.0417 0.0980 0.2046 0.6026 0.1716 0.1924 0.1630 0.5875 1.1207 0.0959 0.0530 0.1409 0.0152 0.2201 0.0909 0.0690 180-DS 0.0491 0.1128 0.2135 0.2243 0.2519 0.1717 0.0679 0.1115 0.2029 0.3957 0.1557 0.1358 0.0597 0.0491 0.2519 0.1717 0.0679 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.0508 0.0567 0.1200 0.1434 0.1812 0.1082 0.0486 0.0866 0.1304 0.4492 0.0976 0.0876 0.0417 0.0508 0.1812 0.1082 0.0486 183-DS 0.0602 0.1119 0.1841 0.2192 0.2431 0.1696 0.0626 0.1073 0.1830 0.3690 0.1561 0.1399 0.0501 0.0602 0.2431 0.1696 0.0626 184-DS 0.0393 0.0943 0.1369 0.1473 0.2618 0.1371 0.0698 0.0530 0.2225 0.5092 0.1212 0.1050 0.0484 0.0393 0.1488 0.1095 0.0372 185-DS 0.0000 0.0000 0.0000 0.0239 0.0401 0.0115 0.0156 0.0239 0.0401 1.3526 0.0003 0.0000 0.0135 0.0000 0.0401 0.0115 0.0156 186-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 187-DS 0.0812 0.2350 0.4635 0.7124 0.7522 0.4662 0.2551 0.4774 0.6709 0.5471 0.3786 0.2794 0.2141 0.0812 0.7522 0.4662 0.2551 188-DS 0.0187 0.0665 0.1462 0.8128 0.8717 0.3583 0.3725 0.7463 0.8530 1.0398 0.1809 0.0873 0.3390 0.0187 0.8717 0.3583 0.3725 189-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 190-DS 0.4255 0.4792 0.5445 0.6046 0.6834 0.5467 0.0848 0.1254 0.2579 0.1551 0.5408 0.5350 0.0686 0.4255 0.6834 0.5467 0.0848 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 193-DS 0.0000 0.0020 0.0432 0.2460 0.3664 0.1135 0.1371 0.2440 0.3664 1.2081 0.0107 0.0001 0.1205 0.0000 0.3664 0.1135 0.1371 194-DS 0.0555 0.0676 0.0958 0.1110 0.1293 0.0908 0.0244 0.0434 0.0738 0.2690 0.0877 0.0846 0.0209 0.0555 0.1293 0.0908 0.0244 195-DS 0.0050 0.0292 0.2327 0.2657 0.5849 0.1980 0.2006 0.2365 0.5799 1.0134 0.0883 0.0290 0.1589 0.0050 0.5849 0.1980 0.2006 196-DS 0.0000 0.0000 0.0000 0.0000 0.0625 0.0071 0.0190 0.0000 0.0625 2.6698 0.0000 0.0000 0.0116 0.0000 0.0000 0.0000 0.0000 197-DS 0.0000 0.0146 0.1113 0.1574 0.2008 0.0980 0.0757 0.1428 0.2008 0.7721 0.0096 0.0000 0.0607 0.0000 0.2008 0.0980 0.0757 198-DS 0.1085 0.1502 0.1983 0.2486 0.5213 0.2196 0.1119 0.0983 0.4128 0.5096 0.2007 0.1866 0.0714 0.1085 0.2641 0.1894 0.0527 199-DS 0.0000 0.0000 0.0000 0.0625 0.1389 0.0278 0.0497 0.0625 0.1389 1.7889 0.0001 0.0000 0.0404 0.0000 0.1389 0.0278 0.0497 200-DS 0.0741 0.1507 0.2344 0.3285 0.3615 0.2335 0.1013 0.1777 0.2875 0.4338 0.2103 0.1850 0.0869 0.0741 0.3615 0.2335 0.1013 89 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-RU-CLEF2007 Statistics for Precision at the 0% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0019 0.0167 0.0024 0.0051 0.0019 0.0167 2.1111 0.0001 0.0000 0.0033 0.0000 0.0021 0.0004 0.0008 177-DS 0.0350 1.0000 1.0000 1.0000 1.0000 0.9123 0.2910 0.0000 0.9650 0.3190 0.7372 0.2850 0.1595 1.0000 1.0000 1.0000 0.0000 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.1433 0.1608 0.2653 0.3906 0.7143 0.3115 0.1833 0.2298 0.5710 0.5886 0.2701 0.2382 0.1406 0.1433 0.7143 0.3115 0.1833 180-DS 0.4000 0.5625 1.0000 1.0000 1.0000 0.8318 0.2473 0.4375 0.6000 0.2972 0.7902 0.7416 0.2140 0.4000 1.0000 0.8318 0.2473 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.1489 0.2001 0.3333 1.0000 1.0000 0.5723 0.4118 0.7999 0.8511 0.7196 0.4262 0.3192 0.3888 0.1489 1.0000 0.5723 0.4118 183-DS 0.6667 1.0000 1.0000 1.0000 1.0000 0.9394 0.1348 0.0000 0.3333 0.1435 0.9289 0.9167 0.0992 1.0000 1.0000 1.0000 0.0000 184-DS 0.3333 0.4750 1.0000 1.0000 1.0000 0.7848 0.3023 0.5250 0.6667 0.3852 0.7175 0.6417 0.2738 0.3333 1.0000 0.7848 0.3023 185-DS 0.0000 0.0350 0.0645 0.1165 0.1795 0.0751 0.0613 0.0815 0.1795 0.8159 0.0152 0.0001 0.0491 0.0000 0.1795 0.0751 0.0613 186-DS 0.0042 0.0104 0.0219 0.0278 0.0556 0.0216 0.0145 0.0175 0.0513 0.6719 0.0171 0.0127 0.0103 0.0042 0.0312 0.0182 0.0097 187-DS 0.0696 0.2324 0.5207 0.9082 1.0000 0.5736 0.3597 0.6759 0.9304 0.6271 0.4210 0.2589 0.3079 0.0696 1.0000 0.5736 0.3597 188-DS 0.0556 0.2727 0.7500 1.0000 1.0000 0.6683 0.3777 0.7273 0.9444 0.5652 0.5080 0.2973 0.3313 0.0556 1.0000 0.6683 0.3777 189-DS 0.0031 0.0074 0.0172 0.0513 0.0862 0.0302 0.0271 0.0440 0.0831 0.8994 0.0189 0.0111 0.0224 0.0031 0.0862 0.0302 0.0271 190-DS 0.5000 0.5242 0.6747 0.8250 1.0000 0.6993 0.1886 0.3008 0.5000 0.2696 0.6772 0.6568 0.1562 0.5000 1.0000 0.6993 0.1886 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0000 0.0000 0.0012 0.0013 0.0038 0.0010 0.0012 0.0013 0.0038 1.2061 0.0002 0.0000 0.0009 0.0000 0.0021 0.0007 0.0008 193-DS 0.0400 0.0930 0.1538 1.0000 1.0000 0.4290 0.4544 0.9070 0.9600 1.0591 0.2163 0.1163 0.4153 0.0400 1.0000 0.4290 0.4544 194-DS 0.2727 0.5250 1.0000 1.0000 1.0000 0.8066 0.2788 0.4750 0.7273 0.3457 0.7478 0.6735 0.2461 0.2727 1.0000 0.8066 0.2788 195-DS 0.0529 0.1275 0.4286 0.9167 1.0000 0.4814 0.3809 0.7891 0.9471 0.7911 0.3194 0.1913 0.3165 0.0529 1.0000 0.4814 0.3809 196-DS 0.0101 0.0509 0.1000 0.1250 0.2000 0.0938 0.0541 0.0741 0.1899 0.5766 0.0740 0.0481 0.0413 0.0101 0.2000 0.0938 0.0541 197-DS 0.0000 0.0758 0.5000 1.0000 1.0000 0.5011 0.4313 0.9242 1.0000 0.8606 0.0628 0.0001 0.3628 0.0000 1.0000 0.5011 0.4313 198-DS 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 0.0000 0.0000 0.0000 0.0000 1.0000 1.0000 0.0000 1.0000 1.0000 1.0000 0.0000 199-DS 0.0022 0.0106 0.0238 0.2232 0.5000 0.1122 0.1608 0.2126 0.4978 1.4332 0.0333 0.0113 0.1262 0.0022 0.5000 0.1122 0.1608 200-DS 0.3333 0.6667 0.6667 1.0000 1.0000 0.7545 0.2272 0.3333 0.6667 0.3011 0.7185 0.6769 0.1868 0.3333 1.0000 0.7545 0.2272 90 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-RU-CLEF2007 Statistics for Precision at the 10% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0019 0.0167 0.0024 0.0051 0.0019 0.0167 2.1111 0.0001 0.0000 0.0033 0.0000 0.0021 0.0004 0.0008 177-DS 0.0350 1.0000 1.0000 1.0000 1.0000 0.9123 0.2910 0.0000 0.9650 0.3190 0.7372 0.2850 0.1595 1.0000 1.0000 1.0000 0.0000 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0469 0.1440 0.2653 0.3906 0.7143 0.2900 0.2046 0.2467 0.6673 0.7054 0.2228 0.1615 0.1602 0.0469 0.7143 0.2900 0.2046 180-DS 0.0879 0.2948 0.3333 0.3742 0.4167 0.3183 0.0915 0.0794 0.3288 0.2875 0.2985 0.2658 0.0630 0.2424 0.4167 0.3413 0.0531 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.1489 0.1965 0.2162 0.5824 1.0000 0.4076 0.3250 0.3859 0.8511 0.7975 0.3189 0.2656 0.2635 0.1489 1.0000 0.4076 0.3250 183-DS 0.2143 0.2615 0.3279 0.4446 0.6667 0.3639 0.1337 0.1832 0.4524 0.3674 0.3439 0.3262 0.1024 0.2143 0.6667 0.3639 0.1337 184-DS 0.0565 0.2404 0.3235 0.4382 1.0000 0.3836 0.2671 0.1979 0.9435 0.6963 0.3057 0.2259 0.1897 0.0565 0.7273 0.3219 0.1811 185-DS 0.0000 0.0193 0.0426 0.0800 0.1795 0.0557 0.0521 0.0607 0.1795 0.9344 0.0114 0.0001 0.0393 0.0000 0.0909 0.0434 0.0338 186-DS 0.0042 0.0068 0.0117 0.0200 0.0556 0.0160 0.0145 0.0132 0.0513 0.9066 0.0121 0.0097 0.0097 0.0042 0.0219 0.0120 0.0065 187-DS 0.0552 0.1955 0.5207 0.7922 0.8824 0.5153 0.3159 0.5967 0.8272 0.6130 0.3775 0.2269 0.2646 0.0552 0.8824 0.5153 0.3159 188-DS 0.0385 0.2070 0.5000 0.9470 0.9630 0.5380 0.3615 0.7400 0.9245 0.6720 0.3833 0.2102 0.3028 0.0385 0.9630 0.5380 0.3615 189-DS 0.0031 0.0058 0.0172 0.0513 0.0862 0.0298 0.0275 0.0455 0.0831 0.9238 0.0177 0.0099 0.0227 0.0031 0.0862 0.0298 0.0275 190-DS 0.5000 0.5242 0.5932 0.7103 0.8235 0.6217 0.1070 0.1861 0.3235 0.1720 0.6136 0.6059 0.0878 0.5000 0.8235 0.6217 0.1070 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0000 0.0000 0.0012 0.0013 0.0038 0.0010 0.0012 0.0013 0.0038 1.2061 0.0002 0.0000 0.0009 0.0000 0.0021 0.0007 0.0008 193-DS 0.0230 0.0930 0.1212 0.4750 1.0000 0.2959 0.3276 0.3820 0.9770 1.1070 0.1584 0.0840 0.2666 0.0230 1.0000 0.2959 0.3276 194-DS 0.0720 0.1102 0.1806 0.2049 0.2231 0.1589 0.0541 0.0947 0.1511 0.3406 0.1487 0.1370 0.0452 0.0720 0.2231 0.1589 0.0541 195-DS 0.0314 0.0948 0.4286 0.4913 0.8095 0.3479 0.2797 0.3965 0.7782 0.8039 0.2213 0.1230 0.2392 0.0314 0.8095 0.3479 0.2797 196-DS 0.0101 0.0509 0.1000 0.1250 0.2000 0.0938 0.0541 0.0741 0.1899 0.5766 0.0740 0.0481 0.0413 0.0101 0.2000 0.0938 0.0541 197-DS 0.0000 0.0640 0.2045 0.3113 0.8000 0.2396 0.2302 0.2473 0.8000 0.9606 0.0362 0.0001 0.1619 0.0000 0.4286 0.1836 0.1432 198-DS 0.1899 0.4098 0.5652 0.8208 0.8824 0.5887 0.2353 0.4110 0.6925 0.3997 0.5387 0.4811 0.1999 0.1899 0.8824 0.5887 0.2353 199-DS 0.0022 0.0106 0.0238 0.2232 0.5000 0.1122 0.1608 0.2126 0.4978 1.4332 0.0333 0.0113 0.1262 0.0022 0.5000 0.1122 0.1608 200-DS 0.1282 0.3014 0.4783 0.6054 0.6667 0.4550 0.1883 0.3040 0.5385 0.4139 0.4097 0.3547 0.1616 0.1282 0.6667 0.4550 0.1883 91 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-RU-CLEF2007 Statistics for Precision at the 20% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0019 0.0167 0.0024 0.0051 0.0019 0.0167 2.1111 0.0001 0.0000 0.0033 0.0000 0.0021 0.0004 0.0008 177-DS 0.0350 0.6875 1.0000 1.0000 1.0000 0.8138 0.3120 0.3125 0.9650 0.3834 0.6499 0.2721 0.2370 0.5000 1.0000 0.8917 0.1845 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0469 0.0814 0.2653 0.3906 0.7143 0.2775 0.2160 0.3092 0.6673 0.7784 0.1962 0.1312 0.1715 0.0469 0.7143 0.2775 0.2160 180-DS 0.0000 0.0614 0.3333 0.3694 0.4054 0.2334 0.1643 0.3080 0.4054 0.7039 0.0381 0.0001 0.1459 0.0000 0.4054 0.2334 0.1643 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.1408 0.1653 0.1953 0.2383 0.3030 0.2034 0.0511 0.0730 0.1622 0.2514 0.1979 0.1928 0.0399 0.1408 0.3030 0.2034 0.0511 183-DS 0.2143 0.2463 0.2750 0.3279 0.4074 0.2930 0.0658 0.0815 0.1931 0.2245 0.2867 0.2808 0.0529 0.2143 0.4074 0.2930 0.0658 184-DS 0.0246 0.0516 0.1618 0.2885 0.6471 0.2149 0.2048 0.2369 0.6225 0.9531 0.1332 0.0773 0.1545 0.0246 0.5238 0.1717 0.1542 185-DS 0.0000 0.0110 0.0181 0.0263 0.1795 0.0313 0.0505 0.0152 0.1795 1.6145 0.0059 0.0001 0.0285 0.0000 0.0396 0.0164 0.0121 186-DS 0.0042 0.0061 0.0100 0.0200 0.0224 0.0124 0.0072 0.0139 0.0182 0.5788 0.0105 0.0089 0.0063 0.0042 0.0224 0.0124 0.0072 187-DS 0.0000 0.1709 0.5207 0.7764 0.8214 0.4888 0.3185 0.6055 0.8214 0.6516 0.1637 0.0001 0.2733 0.0000 0.8214 0.4888 0.3185 188-DS 0.0257 0.1417 0.2076 0.9470 0.9630 0.4488 0.4035 0.8053 0.9373 0.8990 0.2720 0.1385 0.3654 0.0257 0.9630 0.4488 0.4035 189-DS 0.0000 0.0048 0.0168 0.0513 0.0862 0.0285 0.0285 0.0466 0.0862 0.9981 0.0096 0.0001 0.0239 0.0000 0.0862 0.0285 0.0285 190-DS 0.5000 0.5242 0.5932 0.6709 0.7377 0.6050 0.0861 0.1466 0.2377 0.1423 0.5995 0.5941 0.0733 0.5000 0.7377 0.6050 0.0861 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0000 0.0000 0.0012 0.0013 0.0038 0.0010 0.0012 0.0013 0.0038 1.2061 0.0002 0.0000 0.0009 0.0000 0.0021 0.0007 0.0008 193-DS 0.0230 0.0930 0.1159 0.4330 0.8182 0.2490 0.2533 0.3400 0.7951 1.0175 0.1467 0.0829 0.2082 0.0230 0.8182 0.2490 0.2533 194-DS 0.0720 0.0937 0.1745 0.1827 0.2231 0.1508 0.0521 0.0889 0.1511 0.3454 0.1409 0.1297 0.0433 0.0720 0.2231 0.1508 0.0521 195-DS 0.0000 0.0948 0.3636 0.4394 0.7595 0.3152 0.2594 0.3446 0.7595 0.8228 0.1002 0.0001 0.2153 0.0000 0.7595 0.3152 0.2594 196-DS 0.0069 0.0455 0.0750 0.1039 0.1333 0.0732 0.0399 0.0585 0.1264 0.5456 0.0584 0.0368 0.0320 0.0069 0.1333 0.0732 0.0399 197-DS 0.0000 0.0464 0.1765 0.2497 0.3500 0.1578 0.1173 0.2033 0.3500 0.7438 0.0277 0.0001 0.0931 0.0000 0.3500 0.1578 0.1173 198-DS 0.1068 0.1575 0.3425 0.4399 0.8462 0.3577 0.2282 0.2824 0.7393 0.6379 0.2943 0.2402 0.1732 0.1068 0.8462 0.3577 0.2282 199-DS 0.0000 0.0066 0.0138 0.0207 0.0308 0.0139 0.0090 0.0141 0.0308 0.6507 0.0069 0.0001 0.0072 0.0000 0.0308 0.0139 0.0090 200-DS 0.1097 0.2432 0.3846 0.5673 0.6071 0.3901 0.1829 0.3241 0.4975 0.4689 0.3440 0.2938 0.1593 0.1097 0.6071 0.3901 0.1829 92 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-RU-CLEF2007 Statistics for Precision at the 30% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0019 0.0167 0.0024 0.0051 0.0019 0.0167 2.1111 0.0001 0.0000 0.0033 0.0000 0.0021 0.0004 0.0008 177-DS 0.0350 0.1803 0.7500 1.0000 1.0000 0.6250 0.4099 0.8197 0.9650 0.6558 0.4111 0.1888 0.3636 0.0350 1.0000 0.6250 0.4099 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0469 0.0777 0.2653 0.3906 0.7045 0.2756 0.2152 0.3129 0.6576 0.7808 0.1925 0.1261 0.1715 0.0469 0.7045 0.2756 0.2152 180-DS 0.0000 0.0614 0.3200 0.3333 0.3607 0.2124 0.1502 0.2719 0.3607 0.7071 0.0356 0.0001 0.1341 0.0000 0.3607 0.2124 0.1502 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.0458 0.1036 0.1739 0.1953 0.2162 0.1513 0.0618 0.0917 0.1704 0.4087 0.1346 0.1134 0.0511 0.0458 0.2162 0.1513 0.0618 183-DS 0.2143 0.2357 0.2676 0.3132 0.3279 0.2702 0.0422 0.0775 0.1136 0.1564 0.2672 0.2643 0.0353 0.2143 0.3279 0.2702 0.0422 184-DS 0.0225 0.0284 0.0449 0.0868 0.3913 0.0958 0.1135 0.0584 0.3688 1.1845 0.0611 0.0453 0.0770 0.0225 0.0895 0.0488 0.0259 185-DS 0.0000 0.0102 0.0139 0.0188 0.1795 0.0280 0.0509 0.0086 0.1795 1.8184 0.0050 0.0001 0.0275 0.0000 0.0274 0.0128 0.0084 186-DS 0.0000 0.0000 0.0000 0.0000 0.0051 0.0009 0.0019 0.0000 0.0051 2.2347 0.0000 0.0000 0.0014 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.1567 0.5207 0.6449 0.8203 0.4296 0.2930 0.4882 0.8203 0.6820 0.0653 0.0001 0.2548 0.0000 0.8203 0.4296 0.2930 188-DS 0.0000 0.1243 0.2068 0.9470 0.9630 0.4338 0.4143 0.8227 0.9630 0.9550 0.1248 0.0001 0.3763 0.0000 0.9630 0.4338 0.4143 189-DS 0.0000 0.0000 0.0110 0.0507 0.0654 0.0247 0.0262 0.0507 0.0654 1.0606 0.0017 0.0000 0.0234 0.0000 0.0654 0.0247 0.0262 190-DS 0.5000 0.5242 0.5867 0.6533 0.7377 0.5931 0.0773 0.1291 0.2377 0.1303 0.5887 0.5843 0.0629 0.5000 0.7377 0.5931 0.0773 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0000 0.0000 0.0012 0.0013 0.0038 0.0010 0.0012 0.0013 0.0038 1.2061 0.0002 0.0000 0.0009 0.0000 0.0021 0.0007 0.0008 193-DS 0.0200 0.0930 0.1099 0.3219 0.8182 0.2191 0.2357 0.2289 0.7982 1.0755 0.1292 0.0713 0.1774 0.0200 0.3913 0.1592 0.1336 194-DS 0.0541 0.0809 0.1515 0.1694 0.1992 0.1303 0.0499 0.0885 0.1451 0.3828 0.1204 0.1100 0.0446 0.0541 0.1992 0.1303 0.0499 195-DS 0.0000 0.0948 0.2176 0.3387 0.7595 0.2670 0.2424 0.2438 0.7595 0.9076 0.0869 0.0001 0.1809 0.0000 0.6462 0.2178 0.1887 196-DS 0.0042 0.0227 0.0448 0.0566 0.0750 0.0409 0.0244 0.0339 0.0708 0.5955 0.0296 0.0160 0.0193 0.0042 0.0750 0.0409 0.0244 197-DS 0.0000 0.0462 0.1667 0.2257 0.2889 0.1436 0.1014 0.1795 0.2889 0.7064 0.0261 0.0001 0.0825 0.0000 0.2889 0.1436 0.1014 198-DS 0.0828 0.1265 0.1514 0.2927 0.8125 0.2436 0.2097 0.1661 0.7297 0.8609 0.1923 0.1618 0.1414 0.0828 0.3704 0.1867 0.0965 199-DS 0.0000 0.0066 0.0138 0.0207 0.0308 0.0139 0.0090 0.0141 0.0308 0.6507 0.0069 0.0001 0.0072 0.0000 0.0308 0.0139 0.0090 200-DS 0.0979 0.2139 0.3846 0.4868 0.5208 0.3419 0.1524 0.2730 0.4229 0.4456 0.3039 0.2611 0.1354 0.0979 0.5208 0.3419 0.1524 93 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-RU-CLEF2007 Statistics for Precision at the 40% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0019 0.0167 0.0024 0.0051 0.0019 0.0167 2.1111 0.0001 0.0000 0.0033 0.0000 0.0021 0.0004 0.0008 177-DS 0.0327 0.0400 0.0746 0.1509 0.1731 0.0895 0.0553 0.1109 0.1404 0.6181 0.0746 0.0626 0.0469 0.0327 0.1731 0.0895 0.0553 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0429 0.0706 0.2653 0.3906 0.6774 0.2712 0.2121 0.3200 0.6345 0.7821 0.1845 0.1145 0.1705 0.0429 0.6774 0.2712 0.2121 180-DS 0.0000 0.0614 0.2240 0.2826 0.3441 0.1849 0.1289 0.2212 0.3441 0.6972 0.0324 0.0001 0.1106 0.0000 0.3441 0.1849 0.1289 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.0458 0.0919 0.1429 0.1659 0.2015 0.1333 0.0537 0.0740 0.1557 0.4027 0.1202 0.1042 0.0414 0.0458 0.2015 0.1333 0.0537 183-DS 0.2130 0.2277 0.2614 0.3004 0.3194 0.2637 0.0388 0.0727 0.1065 0.1470 0.2611 0.2585 0.0332 0.2130 0.3194 0.2637 0.0388 184-DS 0.0000 0.0237 0.0409 0.0608 0.2651 0.0624 0.0790 0.0371 0.2651 1.2657 0.0111 0.0001 0.0538 0.0000 0.0657 0.0299 0.0216 185-DS 0.0000 0.0101 0.0131 0.0171 0.1250 0.0213 0.0349 0.0070 0.1250 1.6392 0.0044 0.0001 0.0189 0.0000 0.0190 0.0109 0.0065 186-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.0406 0.5207 0.5666 0.7598 0.3828 0.2824 0.5260 0.7598 0.7379 0.0258 0.0000 0.2489 0.0000 0.7598 0.3828 0.2824 188-DS 0.0000 0.1175 0.2068 0.9351 0.9487 0.4259 0.4088 0.8176 0.9487 0.9599 0.1217 0.0001 0.3711 0.0000 0.9487 0.4259 0.4088 189-DS 0.0000 0.0000 0.0092 0.0388 0.0580 0.0193 0.0230 0.0388 0.0580 1.1890 0.0008 0.0000 0.0194 0.0000 0.0580 0.0193 0.0230 190-DS 0.5000 0.5240 0.5577 0.6457 0.7083 0.5829 0.0715 0.1217 0.2083 0.1227 0.5791 0.5753 0.0588 0.5000 0.7083 0.5829 0.0715 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0000 0.0000 0.0012 0.0013 0.0038 0.0010 0.0012 0.0013 0.0038 1.2061 0.0002 0.0000 0.0009 0.0000 0.0021 0.0007 0.0008 193-DS 0.0125 0.0446 0.0940 0.3163 0.5000 0.1747 0.1675 0.2716 0.4875 0.9588 0.0976 0.0469 0.1439 0.0125 0.5000 0.1747 0.1675 194-DS 0.0000 0.0809 0.1286 0.1490 0.1799 0.1116 0.0504 0.0681 0.1799 0.4520 0.0502 0.0001 0.0400 0.0000 0.1799 0.1116 0.0504 195-DS 0.0000 0.0000 0.1167 0.2513 0.7595 0.2001 0.2607 0.2513 0.7595 1.3030 0.0060 0.0000 0.1934 0.0000 0.6222 0.1442 0.1931 196-DS 0.0000 0.0077 0.0112 0.0142 0.0727 0.0184 0.0230 0.0065 0.0727 1.2487 0.0041 0.0001 0.0162 0.0000 0.0143 0.0085 0.0055 197-DS 0.0000 0.0254 0.1111 0.1519 0.2889 0.1070 0.0915 0.1265 0.2889 0.8548 0.0190 0.0001 0.0708 0.0000 0.2889 0.1070 0.0915 198-DS 0.0705 0.0992 0.1260 0.2074 0.7143 0.1869 0.1823 0.1082 0.6437 0.9753 0.1463 0.1261 0.1074 0.0705 0.2125 0.1342 0.0541 199-DS 0.0000 0.0008 0.0033 0.0058 0.0101 0.0041 0.0036 0.0050 0.0101 0.8683 0.0009 0.0000 0.0028 0.0000 0.0101 0.0041 0.0036 200-DS 0.0979 0.1570 0.2619 0.4445 0.4853 0.2957 0.1437 0.2875 0.3874 0.4861 0.2605 0.2257 0.1251 0.0979 0.4853 0.2957 0.1437 94 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-RU-CLEF2007 Statistics for Precision at the 50% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0019 0.0167 0.0024 0.0051 0.0019 0.0167 2.1111 0.0001 0.0000 0.0033 0.0000 0.0021 0.0004 0.0008 177-DS 0.0327 0.0400 0.0746 0.1509 0.1731 0.0889 0.0556 0.1109 0.1404 0.6256 0.0739 0.0620 0.0473 0.0327 0.1731 0.0889 0.0556 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0000 0.0352 0.2653 0.3906 0.6579 0.2548 0.2223 0.3554 0.6579 0.8722 0.0184 0.0000 0.1795 0.0000 0.6579 0.2548 0.2223 180-DS 0.0000 0.0614 0.1753 0.2665 0.3238 0.1645 0.1187 0.2051 0.3238 0.7216 0.0295 0.0001 0.0981 0.0000 0.3238 0.1645 0.1187 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.0458 0.0722 0.1313 0.1659 0.2015 0.1268 0.0559 0.0936 0.1557 0.4408 0.1128 0.0972 0.0446 0.0458 0.2015 0.1268 0.0559 183-DS 0.1737 0.1985 0.2460 0.2765 0.2903 0.2398 0.0423 0.0780 0.1167 0.1765 0.2362 0.2323 0.0347 0.1737 0.2903 0.2398 0.0423 184-DS 0.0000 0.0000 0.0000 0.0454 0.1657 0.0374 0.0572 0.0454 0.1657 1.5277 0.0005 0.0000 0.0419 0.0000 0.0463 0.0134 0.0205 185-DS 0.0000 0.0000 0.0000 0.0103 0.0233 0.0049 0.0077 0.0103 0.0233 1.5660 0.0001 0.0000 0.0063 0.0000 0.0233 0.0049 0.0077 186-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.0000 0.4765 0.5122 0.6895 0.3343 0.2712 0.5122 0.6895 0.8115 0.0100 0.0000 0.2431 0.0000 0.6895 0.3343 0.2712 188-DS 0.0000 0.0992 0.2068 0.8754 0.9167 0.4043 0.3916 0.7762 0.9167 0.9688 0.1144 0.0001 0.3551 0.0000 0.9167 0.4043 0.3916 189-DS 0.0000 0.0000 0.0000 0.0238 0.0417 0.0121 0.0151 0.0238 0.0417 1.2433 0.0004 0.0000 0.0132 0.0000 0.0417 0.0121 0.0151 190-DS 0.4884 0.5160 0.5526 0.6267 0.6701 0.5661 0.0611 0.1106 0.1817 0.1080 0.5631 0.5603 0.0511 0.4884 0.6701 0.5661 0.0611 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0000 0.0000 0.0012 0.0013 0.0038 0.0010 0.0012 0.0013 0.0038 1.2061 0.0002 0.0000 0.0009 0.0000 0.0021 0.0007 0.0008 193-DS 0.0000 0.0415 0.0927 0.1440 0.1918 0.0929 0.0634 0.1025 0.1918 0.6825 0.0360 0.0001 0.0504 0.0000 0.1918 0.0929 0.0634 194-DS 0.0000 0.0719 0.1162 0.1335 0.1675 0.0950 0.0548 0.0616 0.1675 0.5768 0.0206 0.0001 0.0433 0.0000 0.1675 0.0950 0.0548 195-DS 0.0000 0.0000 0.1049 0.1767 0.7273 0.1684 0.2308 0.1767 0.7273 1.3704 0.0054 0.0000 0.1594 0.0000 0.1821 0.0725 0.0748 196-DS 0.0000 0.0077 0.0112 0.0142 0.0727 0.0184 0.0230 0.0065 0.0727 1.2487 0.0041 0.0001 0.0162 0.0000 0.0143 0.0085 0.0055 197-DS 0.0000 0.0130 0.1026 0.1246 0.2237 0.0897 0.0768 0.1115 0.2237 0.8567 0.0087 0.0000 0.0624 0.0000 0.2237 0.0897 0.0768 198-DS 0.0000 0.0712 0.1079 0.1389 0.6429 0.1397 0.1744 0.0677 0.6429 1.2484 0.0235 0.0001 0.0938 0.0000 0.1493 0.0894 0.0535 199-DS 0.0000 0.0008 0.0033 0.0058 0.0101 0.0041 0.0036 0.0050 0.0101 0.8683 0.0009 0.0000 0.0028 0.0000 0.0101 0.0041 0.0036 200-DS 0.0936 0.1463 0.2071 0.2893 0.3796 0.2260 0.0904 0.1430 0.2860 0.4000 0.2088 0.1914 0.0740 0.0936 0.3796 0.2260 0.0904 95 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-RU-CLEF2007 Statistics for Precision at the 60% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 177-DS 0.0070 0.0307 0.0746 0.1509 0.1731 0.0834 0.0614 0.1201 0.1661 0.7362 0.0589 0.0347 0.0513 0.0070 0.1731 0.0834 0.0614 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0000 0.0346 0.2387 0.3833 0.5800 0.2398 0.2026 0.3487 0.5800 0.8450 0.0178 0.0000 0.1665 0.0000 0.5800 0.2398 0.2026 180-DS 0.0000 0.0614 0.1414 0.2327 0.2733 0.1414 0.1007 0.1713 0.2733 0.7126 0.0264 0.0001 0.0855 0.0000 0.2733 0.1414 0.1007 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.0000 0.0506 0.1190 0.1488 0.1961 0.1044 0.0677 0.0982 0.1961 0.6480 0.0213 0.0001 0.0551 0.0000 0.1961 0.1044 0.0677 183-DS 0.1481 0.1768 0.2238 0.2531 0.2701 0.2122 0.0437 0.0763 0.1219 0.2057 0.2079 0.2034 0.0369 0.1481 0.2701 0.2122 0.0437 184-DS 0.0000 0.0000 0.0000 0.0000 0.1137 0.0142 0.0354 0.0000 0.1137 2.4923 0.0000 0.0000 0.0232 0.0000 0.0000 0.0000 0.0000 185-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.0000 0.0000 0.4085 0.6030 0.2007 0.2380 0.4085 0.6030 1.1862 0.0013 0.0000 0.2189 0.0000 0.6030 0.2007 0.2380 188-DS 0.0000 0.0903 0.1106 0.8365 0.9167 0.3681 0.3909 0.7462 0.9167 1.0619 0.0950 0.0001 0.3559 0.0000 0.9167 0.3681 0.3909 189-DS 0.0000 0.0000 0.0000 0.0110 0.0248 0.0050 0.0090 0.0110 0.0248 1.7803 0.0001 0.0000 0.0073 0.0000 0.0248 0.0050 0.0090 190-DS 0.4084 0.4949 0.5473 0.6172 0.6340 0.5478 0.0713 0.1223 0.2256 0.1301 0.5434 0.5387 0.0547 0.4084 0.6340 0.5478 0.0713 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0000 0.0000 0.0012 0.0013 0.0038 0.0010 0.0012 0.0013 0.0038 1.2061 0.0002 0.0000 0.0009 0.0000 0.0021 0.0007 0.0008 193-DS 0.0000 0.0311 0.0915 0.1405 0.1899 0.0851 0.0633 0.1094 0.1899 0.7440 0.0170 0.0001 0.0517 0.0000 0.1899 0.0851 0.0633 194-DS 0.0000 0.0195 0.0938 0.1164 0.1548 0.0790 0.0545 0.0968 0.1548 0.6904 0.0085 0.0000 0.0432 0.0000 0.1548 0.0790 0.0545 195-DS 0.0000 0.0000 0.0899 0.1238 0.6058 0.1276 0.1911 0.1238 0.6058 1.4969 0.0021 0.0000 0.1288 0.0000 0.1267 0.0489 0.0588 196-DS 0.0000 0.0019 0.0112 0.0135 0.0532 0.0140 0.0165 0.0116 0.0532 1.1767 0.0020 0.0000 0.0112 0.0000 0.0138 0.0072 0.0057 197-DS 0.0000 0.0114 0.0917 0.1146 0.1570 0.0745 0.0576 0.1032 0.1570 0.7724 0.0078 0.0000 0.0499 0.0000 0.1570 0.0745 0.0576 198-DS 0.0000 0.0000 0.0962 0.1112 0.3191 0.0859 0.0932 0.1112 0.3191 1.0857 0.0040 0.0000 0.0626 0.0000 0.1242 0.0625 0.0548 199-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 200-DS 0.0928 0.1085 0.1712 0.2246 0.2688 0.1715 0.0646 0.1161 0.1761 0.3770 0.1599 0.1486 0.0561 0.0928 0.2688 0.1715 0.0646 96 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-RU-CLEF2007 Statistics for Precision at the 70% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 177-DS 0.0000 0.0232 0.0746 0.1509 0.1731 0.0808 0.0643 0.1277 0.1731 0.7956 0.0296 0.0001 0.0532 0.0000 0.1731 0.0808 0.0643 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0000 0.0315 0.2141 0.3431 0.5000 0.2070 0.1705 0.3116 0.5000 0.8236 0.0161 0.0000 0.1421 0.0000 0.5000 0.2070 0.1705 180-DS 0.0000 0.0185 0.1167 0.1942 0.2330 0.1151 0.0895 0.1757 0.2330 0.7771 0.0107 0.0000 0.0768 0.0000 0.2330 0.1151 0.0895 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.0000 0.0103 0.0706 0.1191 0.1311 0.0671 0.0518 0.1088 0.1311 0.7718 0.0073 0.0000 0.0435 0.0000 0.1311 0.0671 0.0518 183-DS 0.0974 0.1173 0.1502 0.1763 0.2632 0.1572 0.0493 0.0590 0.1657 0.3140 0.1507 0.1447 0.0351 0.0974 0.2632 0.1572 0.0493 184-DS 0.0000 0.0000 0.0000 0.0000 0.0766 0.0070 0.0231 0.0000 0.0766 3.3166 0.0000 0.0000 0.0127 0.0000 0.0000 0.0000 0.0000 185-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.0000 0.0000 0.3642 0.4927 0.1715 0.2027 0.3642 0.4927 1.1820 0.0012 0.0000 0.1870 0.0000 0.4927 0.1715 0.2027 188-DS 0.0000 0.0000 0.0000 0.7471 0.8481 0.2856 0.3840 0.7471 0.8481 1.3443 0.0014 0.0000 0.3471 0.0000 0.8481 0.2856 0.3840 189-DS 0.0000 0.0000 0.0000 0.0000 0.0248 0.0023 0.0075 0.0000 0.0248 3.3166 0.0000 0.0000 0.0041 0.0000 0.0000 0.0000 0.0000 190-DS 0.3048 0.4846 0.5205 0.6086 0.6340 0.5212 0.1000 0.1240 0.3292 0.1918 0.5111 0.4994 0.0739 0.3048 0.6340 0.5212 0.1000 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0000 0.0000 0.0012 0.0013 0.0038 0.0010 0.0012 0.0013 0.0038 1.2061 0.0002 0.0000 0.0009 0.0000 0.0021 0.0007 0.0008 193-DS 0.0000 0.0000 0.0000 0.0803 0.1266 0.0338 0.0485 0.0803 0.1266 1.4350 0.0003 0.0000 0.0431 0.0000 0.1266 0.0338 0.0485 194-DS 0.0000 0.0000 0.0000 0.0978 0.1391 0.0404 0.0571 0.0978 0.1391 1.4128 0.0003 0.0000 0.0514 0.0000 0.1391 0.0404 0.0571 195-DS 0.0000 0.0000 0.0000 0.1057 0.2857 0.0648 0.1024 0.1057 0.2857 1.5799 0.0003 0.0000 0.0825 0.0000 0.2182 0.0427 0.0754 196-DS 0.0000 0.0019 0.0112 0.0135 0.0488 0.0136 0.0155 0.0116 0.0488 1.1360 0.0020 0.0000 0.0106 0.0000 0.0138 0.0072 0.0057 197-DS 0.0000 0.0114 0.0726 0.1096 0.1358 0.0635 0.0494 0.0982 0.1358 0.7782 0.0070 0.0000 0.0408 0.0000 0.1358 0.0635 0.0494 198-DS 0.0000 0.0000 0.0000 0.0000 0.0967 0.0088 0.0292 0.0000 0.0967 3.3166 0.0000 0.0000 0.0160 0.0000 0.0000 0.0000 0.0000 199-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 200-DS 0.0833 0.0995 0.1482 0.1793 0.2086 0.1428 0.0440 0.0799 0.1253 0.3082 0.1364 0.1300 0.0388 0.0833 0.2086 0.1428 0.0440 97 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-RU-CLEF2007 Statistics for Precision at the 80% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 177-DS 0.0000 0.0223 0.0746 0.1509 0.1731 0.0790 0.0654 0.1285 0.1731 0.8285 0.0284 0.0001 0.0545 0.0000 0.1731 0.0790 0.0654 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0000 0.0249 0.1635 0.2912 0.4968 0.1776 0.1571 0.2663 0.4968 0.8843 0.0142 0.0000 0.1252 0.0000 0.4968 0.1776 0.1571 180-DS 0.0000 0.0172 0.1024 0.1750 0.1978 0.1015 0.0789 0.1578 0.1978 0.7774 0.0098 0.0000 0.0671 0.0000 0.1978 0.1015 0.0789 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.0000 0.0000 0.0000 0.0555 0.0658 0.0255 0.0300 0.0555 0.0658 1.1740 0.0005 0.0000 0.0278 0.0000 0.0658 0.0255 0.0300 183-DS 0.0658 0.0907 0.1086 0.1416 0.2402 0.1215 0.0492 0.0509 0.1744 0.4052 0.1138 0.1072 0.0355 0.0658 0.1629 0.1097 0.0312 184-DS 0.0000 0.0000 0.0000 0.0000 0.0707 0.0064 0.0213 0.0000 0.0707 3.3166 0.0000 0.0000 0.0117 0.0000 0.0000 0.0000 0.0000 185-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.0000 0.0000 0.2370 0.3485 0.0902 0.1547 0.2370 0.3485 1.7146 0.0002 0.0000 0.1312 0.0000 0.3485 0.0902 0.1547 188-DS 0.0000 0.0000 0.0000 0.6769 0.8235 0.2644 0.3709 0.6769 0.8235 1.4029 0.0006 0.0000 0.3365 0.0000 0.8235 0.2644 0.3709 189-DS 0.0000 0.0000 0.0000 0.0000 0.0228 0.0021 0.0069 0.0000 0.0228 3.3166 0.0000 0.0000 0.0038 0.0000 0.0000 0.0000 0.0000 190-DS 0.2399 0.4111 0.4787 0.5291 0.6159 0.4658 0.1090 0.1180 0.3759 0.2341 0.4522 0.4362 0.0778 0.2399 0.6159 0.4658 0.1090 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0000 0.0000 0.0012 0.0013 0.0038 0.0010 0.0012 0.0013 0.0038 1.2061 0.0002 0.0000 0.0009 0.0000 0.0021 0.0007 0.0008 193-DS 0.0000 0.0000 0.0000 0.0736 0.1266 0.0319 0.0469 0.0736 0.1266 1.4685 0.0003 0.0000 0.0406 0.0000 0.1266 0.0319 0.0469 194-DS 0.0000 0.0000 0.0000 0.0000 0.1056 0.0096 0.0318 0.0000 0.1056 3.3166 0.0000 0.0000 0.0175 0.0000 0.0000 0.0000 0.0000 195-DS 0.0000 0.0000 0.0000 0.0000 0.1357 0.0242 0.0539 0.0000 0.1357 2.2253 0.0001 0.0000 0.0396 0.0000 0.0000 0.0000 0.0000 196-DS 0.0000 0.0018 0.0109 0.0127 0.0193 0.0086 0.0064 0.0109 0.0193 0.7414 0.0017 0.0000 0.0051 0.0000 0.0193 0.0086 0.0064 197-DS 0.0000 0.0083 0.0395 0.0679 0.1020 0.0436 0.0350 0.0596 0.1020 0.8027 0.0053 0.0000 0.0273 0.0000 0.1020 0.0436 0.0350 198-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 199-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 200-DS 0.0789 0.0936 0.1012 0.1239 0.1404 0.1068 0.0193 0.0303 0.0615 0.1802 0.1053 0.1038 0.0164 0.0789 0.1404 0.1068 0.0193 98 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-RU-CLEF2007 Statistics for Precision at the 90% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 177-DS 0.0000 0.0215 0.0746 0.1509 0.1731 0.0782 0.0661 0.1293 0.1731 0.8454 0.0275 0.0001 0.0551 0.0000 0.1731 0.0782 0.0661 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0000 0.0000 0.0970 0.1925 0.4394 0.1124 0.1397 0.1925 0.4394 1.2431 0.0021 0.0000 0.1050 0.0000 0.4394 0.1124 0.1397 180-DS 0.0000 0.0000 0.0853 0.1303 0.1694 0.0749 0.0669 0.1303 0.1694 0.8935 0.0038 0.0000 0.0556 0.0000 0.1694 0.0749 0.0669 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 183-DS 0.0000 0.0482 0.0643 0.0875 0.1491 0.0634 0.0424 0.0393 0.1491 0.6691 0.0144 0.0001 0.0304 0.0000 0.0934 0.0548 0.0332 184-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 185-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 188-DS 0.0000 0.0000 0.0000 0.5947 0.7879 0.2396 0.3370 0.5947 0.7879 1.4065 0.0006 0.0000 0.3049 0.0000 0.7879 0.2396 0.3370 189-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 190-DS 0.1738 0.3507 0.4270 0.5146 0.5787 0.4139 0.1287 0.1639 0.4048 0.3109 0.3918 0.3654 0.0975 0.1738 0.5787 0.4139 0.1287 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0000 0.0000 0.0012 0.0013 0.0038 0.0010 0.0012 0.0013 0.0038 1.2061 0.0002 0.0000 0.0009 0.0000 0.0021 0.0007 0.0008 193-DS 0.0000 0.0000 0.0000 0.0565 0.0970 0.0250 0.0368 0.0565 0.0970 1.4680 0.0002 0.0000 0.0319 0.0000 0.0970 0.0250 0.0368 194-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 195-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 196-DS 0.0000 0.0000 0.0000 0.0000 0.0112 0.0019 0.0042 0.0000 0.0112 2.2335 0.0000 0.0000 0.0031 0.0000 0.0000 0.0000 0.0000 197-DS 0.0000 0.0074 0.0325 0.0407 0.0515 0.0276 0.0188 0.0333 0.0515 0.6820 0.0040 0.0000 0.0150 0.0000 0.0515 0.0276 0.0188 198-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 199-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 200-DS 0.0000 0.0819 0.0883 0.0944 0.0991 0.0811 0.0278 0.0126 0.0991 0.3423 0.0389 0.0001 0.0156 0.0764 0.0991 0.0893 0.0072 99 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-RU-CLEF2007 Statistics for Precision at the 100% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 177-DS 0.0000 0.0069 0.0279 0.0641 0.0752 0.0363 0.0292 0.0572 0.0752 0.8036 0.0046 0.0000 0.0245 0.0000 0.0752 0.0363 0.0292 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0000 0.0000 0.0000 0.0000 0.1294 0.0207 0.0465 0.0000 0.1294 2.2505 0.0001 0.0000 0.0338 0.0000 0.0000 0.0000 0.0000 180-DS 0.0000 0.0000 0.0000 0.0827 0.1441 0.0364 0.0534 0.0827 0.1441 1.4662 0.0003 0.0000 0.0463 0.0000 0.1441 0.0364 0.0534 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 183-DS 0.0000 0.0000 0.0000 0.0000 0.1071 0.0147 0.0347 0.0000 0.1071 2.3654 0.0001 0.0000 0.0240 0.0000 0.0000 0.0000 0.0000 184-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 185-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 188-DS 0.0000 0.0000 0.0000 0.1078 0.1441 0.0444 0.0623 0.1078 0.1441 1.4046 0.0003 0.0000 0.0565 0.0000 0.1441 0.0444 0.0623 189-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 190-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0000 0.0000 0.0012 0.0013 0.0038 0.0010 0.0012 0.0013 0.0038 1.2061 0.0002 0.0000 0.0009 0.0000 0.0021 0.0007 0.0008 193-DS 0.0000 0.0000 0.0000 0.0358 0.0569 0.0155 0.0222 0.0358 0.0569 1.4327 0.0002 0.0000 0.0197 0.0000 0.0569 0.0155 0.0222 194-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 195-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 196-DS 0.0000 0.0000 0.0000 0.0000 0.0112 0.0019 0.0042 0.0000 0.0112 2.2335 0.0000 0.0000 0.0031 0.0000 0.0000 0.0000 0.0000 197-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 198-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 199-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 200-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 100 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-RU-CLEF2007 Statistics for P@5 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 177-DS 0.0000 0.4000 0.6000 0.6000 0.6000 0.4727 0.1849 0.2000 0.6000 0.3911 0.1904 0.0001 0.1388 0.4000 0.6000 0.5200 0.1033 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0000 0.0000 0.0000 0.2000 0.4000 0.0909 0.1375 0.2000 0.4000 1.5126 0.0004 0.0000 0.1157 0.0000 0.4000 0.0909 0.1375 180-DS 0.2000 0.4000 0.4000 0.6000 0.6000 0.4545 0.1293 0.2000 0.4000 0.2845 0.4352 0.4125 0.1058 0.2000 0.6000 0.4545 0.1293 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.0000 0.0000 0.2000 0.6000 1.0000 0.3636 0.4081 0.6000 1.0000 1.1223 0.0040 0.0000 0.3603 0.0000 1.0000 0.3636 0.4081 183-DS 0.2000 0.4000 0.4000 0.5500 0.8000 0.4545 0.2018 0.1500 0.6000 0.4440 0.4150 0.3771 0.1521 0.2000 0.6000 0.3778 0.1202 184-DS 0.2000 0.2000 0.2000 0.4000 1.0000 0.3273 0.2412 0.2000 0.8000 0.7370 0.2797 0.2529 0.1620 0.2000 0.4000 0.2600 0.0966 185-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.0000 0.2000 0.6000 0.8000 0.3455 0.3357 0.6000 0.8000 0.9719 0.0095 0.0000 0.3041 0.0000 0.8000 0.3455 0.3357 188-DS 0.0000 0.0000 0.6000 0.8000 0.8000 0.4545 0.3698 0.8000 0.8000 0.8135 0.0122 0.0000 0.3306 0.0000 0.8000 0.4545 0.3698 189-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 190-DS 0.0000 0.0000 0.2000 0.6000 0.8000 0.3273 0.3259 0.6000 0.8000 0.9957 0.0091 0.0000 0.2843 0.0000 0.8000 0.3273 0.3259 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 193-DS 0.0000 0.0000 0.0000 0.3500 0.8000 0.1818 0.2892 0.3500 0.8000 1.5906 0.0005 0.0000 0.2314 0.0000 0.8000 0.1818 0.2892 194-DS 0.2000 0.3000 0.6000 0.6000 0.8000 0.5091 0.2071 0.3000 0.6000 0.4069 0.4564 0.3940 0.1686 0.2000 0.8000 0.5091 0.2071 195-DS 0.0000 0.0000 0.0000 0.5000 0.6000 0.2000 0.2683 0.5000 0.6000 1.3416 0.0012 0.0000 0.2182 0.0000 0.6000 0.2000 0.2683 196-DS 0.0000 0.0000 0.0000 0.0000 0.2000 0.0182 0.0603 0.0000 0.2000 3.3166 0.0000 0.0000 0.0331 0.0000 0.0000 0.0000 0.0000 197-DS 0.0000 0.0000 0.2000 0.4000 0.8000 0.2364 0.2656 0.4000 0.8000 1.1237 0.0032 0.0000 0.2215 0.0000 0.8000 0.2364 0.2656 198-DS 0.8000 0.8000 0.8000 1.0000 1.0000 0.8727 0.1009 0.2000 0.2000 0.1156 0.8676 0.8627 0.0926 0.8000 1.0000 0.8727 0.1009 199-DS 0.0000 0.0000 0.0000 0.1500 0.2000 0.0545 0.0934 0.1500 0.2000 1.7127 0.0001 0.0000 0.0793 0.0000 0.2000 0.0545 0.0934 200-DS 0.2000 0.2000 0.2000 0.5500 0.8000 0.3636 0.2157 0.3500 0.6000 0.5933 0.3142 0.2779 0.1785 0.2000 0.8000 0.3636 0.2157 101 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-RU-CLEF2007 Statistics for P@10 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 177-DS 0.0000 0.2250 0.3000 0.3000 0.3000 0.2545 0.0934 0.0750 0.3000 0.3670 0.1092 0.0001 0.0661 0.2000 0.3000 0.2800 0.0422 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0000 0.1000 0.1000 0.1000 0.6000 0.1364 0.1629 0.0000 0.6000 1.1948 0.0235 0.0001 0.0959 0.1000 0.1000 0.1000 0.0000 180-DS 0.2000 0.3000 0.3000 0.4000 0.4000 0.3273 0.0786 0.1000 0.2000 0.2402 0.3176 0.3070 0.0661 0.2000 0.4000 0.3273 0.0786 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.0000 0.1000 0.3000 0.4750 0.6000 0.2818 0.2316 0.3750 0.6000 0.8218 0.0427 0.0001 0.2017 0.0000 0.6000 0.2818 0.2316 183-DS 0.1000 0.2250 0.3000 0.5000 0.6000 0.3545 0.1572 0.2750 0.5000 0.4435 0.3169 0.2739 0.1322 0.1000 0.6000 0.3545 0.1572 184-DS 0.1000 0.2000 0.2000 0.3000 1.0000 0.3273 0.2760 0.1000 0.9000 0.8434 0.2555 0.2098 0.1901 0.1000 0.3000 0.2111 0.0782 185-DS 0.0000 0.0000 0.0000 0.0000 0.1000 0.0182 0.0405 0.0000 0.1000 2.2249 0.0001 0.0000 0.0298 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.0000 0.2000 0.6750 0.8000 0.3455 0.3328 0.6750 0.8000 0.9632 0.0095 0.0000 0.3041 0.0000 0.8000 0.3455 0.3328 188-DS 0.0000 0.1250 0.5000 0.8000 0.9000 0.4818 0.3545 0.6750 0.9000 0.7357 0.0685 0.0001 0.2959 0.0000 0.9000 0.4818 0.3545 189-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 190-DS 0.0000 0.0000 0.3000 0.4750 0.7000 0.3000 0.2720 0.4750 0.7000 0.9068 0.0091 0.0000 0.2182 0.0000 0.7000 0.3000 0.2720 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 193-DS 0.0000 0.0000 0.0000 0.4000 0.8000 0.2000 0.2793 0.4000 0.8000 1.3964 0.0012 0.0000 0.2364 0.0000 0.8000 0.2000 0.2793 194-DS 0.2000 0.3000 0.3000 0.3750 0.4000 0.3182 0.0603 0.0750 0.2000 0.1895 0.3127 0.3070 0.0446 0.2000 0.4000 0.3182 0.0603 195-DS 0.0000 0.0250 0.2000 0.5250 0.8000 0.2818 0.2926 0.5000 0.8000 1.0384 0.0179 0.0000 0.2347 0.0000 0.8000 0.2818 0.2926 196-DS 0.0000 0.0000 0.1000 0.1000 0.1000 0.0545 0.0522 0.1000 0.1000 0.9574 0.0015 0.0000 0.0496 0.0000 0.1000 0.0545 0.0522 197-DS 0.0000 0.0000 0.2000 0.3000 0.4000 0.1818 0.1662 0.3000 0.4000 0.9143 0.0065 0.0000 0.1471 0.0000 0.4000 0.1818 0.1662 198-DS 0.5000 0.8000 0.8000 0.8750 0.9000 0.8000 0.1095 0.0750 0.4000 0.1369 0.7916 0.7811 0.0545 0.8000 0.9000 0.8300 0.0483 199-DS 0.0000 0.0000 0.0000 0.1000 0.1000 0.0364 0.0505 0.1000 0.1000 1.3874 0.0003 0.0000 0.0463 0.0000 0.1000 0.0364 0.0505 200-DS 0.2000 0.3000 0.4000 0.5000 0.5000 0.3818 0.1168 0.2000 0.3000 0.3058 0.3630 0.3420 0.0959 0.2000 0.5000 0.3818 0.1168 102 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-RU-CLEF2007 Statistics for P@15 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 177-DS 0.0000 0.1500 0.2000 0.2000 0.2000 0.1697 0.0623 0.0500 0.2000 0.3670 0.0755 0.0001 0.0441 0.1333 0.2000 0.1867 0.0281 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0667 0.0667 0.1333 0.1333 0.6667 0.1576 0.1745 0.0667 0.6000 1.1077 0.1169 0.0987 0.1003 0.0667 0.2000 0.1067 0.0466 180-DS 0.1333 0.2667 0.2667 0.3333 0.4000 0.2970 0.0752 0.0667 0.2667 0.2533 0.2865 0.2733 0.0573 0.2667 0.4000 0.3133 0.0549 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.0000 0.0667 0.2000 0.3833 0.4000 0.2121 0.1601 0.3167 0.4000 0.7545 0.0351 0.0001 0.1344 0.0000 0.4000 0.2121 0.1601 183-DS 0.0667 0.2333 0.3333 0.4000 0.4667 0.3091 0.1239 0.1667 0.4000 0.4009 0.2741 0.2238 0.0959 0.0667 0.4667 0.3091 0.1239 184-DS 0.0667 0.2000 0.2000 0.4333 0.6667 0.3091 0.1938 0.2333 0.6000 0.6271 0.2549 0.2044 0.1554 0.0667 0.6667 0.3091 0.1938 185-DS 0.0000 0.0000 0.0000 0.0667 0.0667 0.0242 0.0336 0.0667 0.0667 1.3874 0.0002 0.0000 0.0309 0.0000 0.0667 0.0242 0.0336 186-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.0167 0.2000 0.6667 0.8667 0.3636 0.3417 0.6500 0.8667 0.9397 0.0215 0.0000 0.3118 0.0000 0.8667 0.3636 0.3417 188-DS 0.0000 0.1000 0.4667 0.8667 0.9333 0.4848 0.3616 0.7667 0.9333 0.7458 0.1457 0.0001 0.2986 0.0000 0.9333 0.4848 0.3616 189-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 190-DS 0.0000 0.0000 0.4667 0.6333 0.8000 0.3758 0.3187 0.6333 0.8000 0.8482 0.0107 0.0000 0.2733 0.0000 0.8000 0.3758 0.3187 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 193-DS 0.0000 0.0000 0.0667 0.3833 0.6000 0.1758 0.2176 0.3833 0.6000 1.2381 0.0025 0.0000 0.1873 0.0000 0.6000 0.1758 0.2176 194-DS 0.2000 0.2000 0.2000 0.2667 0.4000 0.2485 0.0673 0.0667 0.2000 0.2707 0.2413 0.2353 0.0529 0.2000 0.3333 0.2333 0.0471 195-DS 0.0000 0.0167 0.2000 0.4333 0.7333 0.2545 0.2647 0.4167 0.7333 1.0399 0.0166 0.0000 0.2149 0.0000 0.7333 0.2545 0.2647 196-DS 0.0000 0.0000 0.0667 0.0667 0.1333 0.0485 0.0431 0.0667 0.1333 0.8892 0.0029 0.0000 0.0353 0.0000 0.1333 0.0485 0.0431 197-DS 0.0000 0.0333 0.2000 0.2667 0.4000 0.1879 0.1455 0.2333 0.4000 0.7745 0.0155 0.0000 0.1124 0.0000 0.4000 0.1879 0.1455 198-DS 0.3333 0.6167 0.6667 0.8000 0.8667 0.6970 0.1560 0.1833 0.5333 0.2238 0.6769 0.6512 0.1179 0.6000 0.8667 0.7333 0.1042 199-DS 0.0000 0.0000 0.0000 0.0667 0.0667 0.0242 0.0336 0.0667 0.0667 1.3874 0.0002 0.0000 0.0309 0.0000 0.0667 0.0242 0.0336 200-DS 0.1333 0.2667 0.4000 0.6000 0.6667 0.4182 0.1888 0.3333 0.5333 0.4514 0.3730 0.3247 0.1653 0.1333 0.6667 0.4182 0.1888 103 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-RU-CLEF2007 Statistics for P@20 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 177-DS 0.0000 0.1125 0.1500 0.1500 0.1500 0.1273 0.0467 0.0375 0.1500 0.3670 0.0581 0.0001 0.0331 0.1000 0.1500 0.1400 0.0211 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0500 0.1000 0.1000 0.1500 0.7000 0.1773 0.1862 0.0500 0.6500 1.0505 0.1299 0.1050 0.1174 0.0500 0.1500 0.1056 0.0391 180-DS 0.1000 0.3000 0.3000 0.3000 0.3500 0.2864 0.0636 0.0000 0.2500 0.2221 0.2753 0.2567 0.0339 0.3000 0.3000 0.3000 0.0000 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.0500 0.0625 0.1500 0.3000 0.3500 0.1818 0.1146 0.2375 0.3000 0.6304 0.1435 0.1087 0.0983 0.0500 0.3500 0.1818 0.1146 183-DS 0.0500 0.1750 0.3000 0.4000 0.4500 0.2818 0.1383 0.2250 0.4000 0.4909 0.2377 0.1810 0.1107 0.0500 0.4500 0.2818 0.1383 184-DS 0.0500 0.1500 0.2500 0.3750 0.5500 0.2682 0.1617 0.2250 0.5000 0.6028 0.2190 0.1684 0.1289 0.0500 0.5500 0.2682 0.1617 185-DS 0.0000 0.0000 0.0000 0.0500 0.0500 0.0227 0.0261 0.0500 0.0500 1.1489 0.0005 0.0000 0.0248 0.0000 0.0500 0.0227 0.0261 186-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.0125 0.3500 0.6875 0.9000 0.3773 0.3503 0.6750 0.9000 0.9284 0.0216 0.0000 0.3116 0.0000 0.9000 0.3773 0.3503 188-DS 0.0000 0.2000 0.4500 0.9000 0.9500 0.5091 0.3534 0.7000 0.9500 0.6942 0.1728 0.0001 0.3008 0.0000 0.9500 0.5091 0.3534 189-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 190-DS 0.0000 0.0000 0.4500 0.6500 0.7000 0.3636 0.3034 0.6500 0.7000 0.8343 0.0105 0.0000 0.2645 0.0000 0.7000 0.3636 0.3034 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 193-DS 0.0000 0.0000 0.1000 0.3500 0.5000 0.1636 0.1859 0.3500 0.5000 1.1358 0.0054 0.0000 0.1628 0.0000 0.5000 0.1636 0.1859 194-DS 0.1500 0.1500 0.2000 0.2375 0.3000 0.2000 0.0500 0.0875 0.1500 0.2500 0.1946 0.1897 0.0364 0.1500 0.3000 0.2000 0.0500 195-DS 0.0000 0.0500 0.1500 0.4750 0.8000 0.2682 0.2969 0.4250 0.8000 1.1070 0.0339 0.0001 0.2504 0.0000 0.8000 0.2682 0.2969 196-DS 0.0000 0.0125 0.0500 0.1000 0.1000 0.0545 0.0416 0.0875 0.1000 0.7619 0.0063 0.0000 0.0331 0.0000 0.1000 0.0545 0.0416 197-DS 0.0000 0.0250 0.1500 0.2500 0.3500 0.1591 0.1241 0.2250 0.3500 0.7803 0.0136 0.0000 0.1008 0.0000 0.3500 0.1591 0.1241 198-DS 0.2500 0.5500 0.6000 0.6875 0.8500 0.6000 0.1581 0.1375 0.6000 0.2635 0.5759 0.5444 0.1091 0.4500 0.8500 0.6350 0.1132 199-DS 0.0000 0.0000 0.0000 0.0500 0.0500 0.0182 0.0252 0.0500 0.0500 1.3874 0.0002 0.0000 0.0231 0.0000 0.0500 0.0182 0.0252 200-DS 0.1500 0.2500 0.4000 0.5875 0.6500 0.4091 0.1729 0.3375 0.5000 0.4227 0.3722 0.3340 0.1463 0.1500 0.6500 0.4091 0.1729 104 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-RU-CLEF2007 Statistics for P@30 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 177-DS 0.0000 0.1000 0.1000 0.1000 0.1000 0.0909 0.0302 0.0000 0.1000 0.3317 0.0433 0.0001 0.0165 0.1000 0.1000 0.1000 0.0000 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0333 0.0667 0.0667 0.1333 0.6667 0.1606 0.1965 0.0667 0.6333 1.2237 0.1004 0.0738 0.1355 0.0333 0.1333 0.0778 0.0373 180-DS 0.1000 0.2667 0.2667 0.3250 0.3667 0.2727 0.0696 0.0583 0.2667 0.2553 0.2611 0.2439 0.0441 0.2333 0.3667 0.2900 0.0417 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.0667 0.1000 0.1667 0.2250 0.2667 0.1636 0.0706 0.1250 0.2000 0.4317 0.1493 0.1353 0.0579 0.0667 0.2667 0.1636 0.0706 183-DS 0.0667 0.1667 0.2667 0.3000 0.3667 0.2485 0.1026 0.1333 0.3000 0.4129 0.2209 0.1858 0.0810 0.0667 0.3667 0.2485 0.1026 184-DS 0.0667 0.2000 0.2667 0.3000 0.5000 0.2545 0.1276 0.1000 0.4333 0.5013 0.2181 0.1747 0.0920 0.0667 0.4000 0.2300 0.1036 185-DS 0.0000 0.0083 0.0333 0.0667 0.1000 0.0394 0.0327 0.0583 0.1000 0.8306 0.0049 0.0000 0.0259 0.0000 0.1000 0.0394 0.0327 186-DS 0.0000 0.0000 0.0000 0.0000 0.0333 0.0030 0.0101 0.0000 0.0333 3.3166 0.0000 0.0000 0.0055 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.1083 0.3667 0.7667 0.9000 0.4182 0.3538 0.6583 0.9000 0.8461 0.0570 0.0001 0.3168 0.0000 0.9000 0.4182 0.3538 188-DS 0.0000 0.2000 0.3667 0.9333 0.9333 0.4879 0.3680 0.7333 0.9333 0.7542 0.1637 0.0001 0.3240 0.0000 0.9333 0.4879 0.3680 189-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 190-DS 0.0000 0.0000 0.5667 0.5917 0.6667 0.3667 0.2944 0.5917 0.6667 0.8029 0.0107 0.0000 0.2667 0.0000 0.6667 0.3667 0.2944 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 193-DS 0.0000 0.0333 0.1000 0.2917 0.3333 0.1424 0.1367 0.2583 0.3333 0.9598 0.0222 0.0001 0.1207 0.0000 0.3333 0.1424 0.1367 194-DS 0.1000 0.1333 0.1667 0.1667 0.2333 0.1606 0.0443 0.0333 0.1333 0.2756 0.1550 0.1495 0.0320 0.1000 0.1667 0.1444 0.0289 195-DS 0.0000 0.0667 0.4000 0.4500 0.7333 0.3000 0.2582 0.3833 0.7333 0.8607 0.0866 0.0001 0.2242 0.0000 0.7333 0.3000 0.2582 196-DS 0.0000 0.0333 0.0333 0.0667 0.0667 0.0424 0.0262 0.0333 0.0667 0.6178 0.0105 0.0001 0.0220 0.0000 0.0667 0.0424 0.0262 197-DS 0.0000 0.0333 0.1667 0.2250 0.2667 0.1394 0.0987 0.1917 0.2667 0.7079 0.0127 0.0000 0.0782 0.0000 0.2667 0.1394 0.0987 198-DS 0.2667 0.4000 0.4667 0.6417 0.8000 0.5061 0.1590 0.2417 0.5333 0.3143 0.4839 0.4624 0.1289 0.2667 0.8000 0.5061 0.1590 199-DS 0.0000 0.0000 0.0000 0.0333 0.0333 0.0121 0.0168 0.0333 0.0333 1.3874 0.0002 0.0000 0.0154 0.0000 0.0333 0.0121 0.0168 200-DS 0.1667 0.2750 0.3667 0.5583 0.5667 0.3909 0.1469 0.2833 0.4000 0.3758 0.3638 0.3357 0.1234 0.1667 0.5667 0.3909 0.1469 105 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-RU-CLEF2007 Statistics for P@100 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0000 0.0100 0.0009 0.0030 0.0000 0.0100 3.3166 0.0000 0.0000 0.0017 0.0000 0.0000 0.0000 0.0000 177-DS 0.0100 0.0325 0.0600 0.0900 0.0900 0.0591 0.0291 0.0575 0.0800 0.4931 0.0501 0.0383 0.0246 0.0100 0.0900 0.0591 0.0291 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0200 0.0825 0.2000 0.3425 0.5800 0.2291 0.1925 0.2600 0.5600 0.8402 0.1433 0.0729 0.1536 0.0200 0.5800 0.2291 0.1925 180-DS 0.0800 0.0900 0.2600 0.2700 0.3300 0.2055 0.0988 0.1800 0.2500 0.4810 0.1792 0.1527 0.0868 0.0800 0.3300 0.2055 0.0988 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.1100 0.1325 0.1600 0.1700 0.1800 0.1518 0.0232 0.0375 0.0700 0.1525 0.1501 0.1482 0.0195 0.1100 0.1800 0.1518 0.0232 183-DS 0.1900 0.2125 0.2400 0.2700 0.2800 0.2409 0.0302 0.0575 0.0900 0.1252 0.2391 0.2373 0.0246 0.1900 0.2800 0.2409 0.0302 184-DS 0.0500 0.0725 0.1100 0.1350 0.2400 0.1173 0.0548 0.0625 0.1900 0.4672 0.1068 0.0975 0.0388 0.0500 0.1800 0.1050 0.0387 185-DS 0.0000 0.0125 0.0200 0.0300 0.0800 0.0236 0.0216 0.0175 0.0800 0.9128 0.0060 0.0001 0.0137 0.0000 0.0300 0.0180 0.0114 186-DS 0.0000 0.0025 0.0100 0.0100 0.0200 0.0082 0.0060 0.0075 0.0200 0.7370 0.0016 0.0000 0.0045 0.0000 0.0200 0.0082 0.0060 187-DS 0.0200 0.1850 0.3500 0.7675 0.8100 0.4518 0.3167 0.5825 0.7900 0.7009 0.2681 0.0897 0.2820 0.0200 0.8100 0.4518 0.3167 188-DS 0.0400 0.0775 0.1800 0.6675 0.7800 0.3236 0.2994 0.5900 0.7400 0.9252 0.1989 0.1242 0.2683 0.0400 0.7800 0.3236 0.2994 189-DS 0.0000 0.0000 0.0100 0.0450 0.0600 0.0191 0.0239 0.0450 0.0600 1.2496 0.0008 0.0000 0.0207 0.0000 0.0600 0.0191 0.0239 190-DS 0.4000 0.4525 0.5500 0.6025 0.6500 0.5336 0.0862 0.1500 0.2500 0.1615 0.5271 0.5203 0.0724 0.4000 0.6500 0.5336 0.0862 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 193-DS 0.0100 0.0800 0.0800 0.1375 0.1700 0.0936 0.0497 0.0575 0.1600 0.5303 0.0738 0.0462 0.0385 0.0100 0.1700 0.0936 0.0497 194-DS 0.0900 0.1100 0.1400 0.1750 0.2200 0.1464 0.0439 0.0650 0.1300 0.2998 0.1405 0.1350 0.0360 0.0900 0.2200 0.1464 0.0439 195-DS 0.0100 0.0400 0.3200 0.3650 0.7200 0.2618 0.2426 0.3250 0.7100 0.9268 0.1328 0.0522 0.2017 0.0100 0.7200 0.2618 0.2426 196-DS 0.0100 0.0200 0.0300 0.0300 0.0500 0.0282 0.0108 0.0100 0.0400 0.3828 0.0261 0.0238 0.0078 0.0100 0.0400 0.0260 0.0084 197-DS 0.0000 0.0400 0.1100 0.1350 0.1800 0.0955 0.0628 0.0950 0.1800 0.6582 0.0195 0.0001 0.0512 0.0000 0.1800 0.0955 0.0628 198-DS 0.1600 0.2025 0.2600 0.3500 0.6400 0.2955 0.1353 0.1475 0.4800 0.4580 0.2730 0.2550 0.0950 0.1600 0.3700 0.2610 0.0764 199-DS 0.0000 0.0025 0.0100 0.0175 0.0200 0.0100 0.0077 0.0150 0.0200 0.7746 0.0018 0.0000 0.0055 0.0000 0.0200 0.0100 0.0077 200-DS 0.1100 0.2225 0.2900 0.3450 0.3900 0.2773 0.0881 0.1225 0.2800 0.3177 0.2619 0.2436 0.0739 0.1100 0.3900 0.2773 0.0881 106 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-RU-CLEF2007 Statistics for P@200 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0000 0.0050 0.0009 0.0020 0.0000 0.0050 2.2249 0.0000 0.0000 0.0015 0.0000 0.0000 0.0000 0.0000 177-DS 0.0250 0.0263 0.0450 0.0500 0.0500 0.0391 0.0111 0.0238 0.0250 0.2850 0.0375 0.0359 0.0101 0.0250 0.0500 0.0391 0.0111 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0150 0.0625 0.2600 0.3375 0.4350 0.2114 0.1485 0.2750 0.4200 0.7024 0.1439 0.0773 0.1331 0.0150 0.4350 0.2114 0.1485 180-DS 0.0450 0.0488 0.1650 0.2125 0.2350 0.1418 0.0778 0.1638 0.1900 0.5483 0.1166 0.0916 0.0677 0.0450 0.2350 0.1418 0.0778 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.0700 0.0925 0.1300 0.1400 0.1650 0.1214 0.0334 0.0475 0.0950 0.2752 0.1166 0.1113 0.0267 0.0700 0.1650 0.1214 0.0334 183-DS 0.1500 0.1612 0.1800 0.1850 0.2300 0.1782 0.0227 0.0238 0.0800 0.1275 0.1769 0.1758 0.0165 0.1500 0.2000 0.1730 0.0157 184-DS 0.0350 0.0400 0.0700 0.0838 0.1400 0.0736 0.0356 0.0438 0.1050 0.4840 0.0662 0.0594 0.0267 0.0350 0.1400 0.0736 0.0356 185-DS 0.0000 0.0100 0.0150 0.0200 0.0400 0.0159 0.0114 0.0100 0.0400 0.7142 0.0046 0.0001 0.0083 0.0000 0.0250 0.0135 0.0085 186-DS 0.0000 0.0050 0.0050 0.0150 0.0150 0.0082 0.0060 0.0100 0.0150 0.7370 0.0026 0.0001 0.0053 0.0000 0.0150 0.0082 0.0060 187-DS 0.0150 0.1275 0.4500 0.6038 0.7400 0.3991 0.2598 0.4763 0.7250 0.6510 0.2470 0.0894 0.2212 0.0150 0.7400 0.3991 0.2598 188-DS 0.0350 0.1100 0.1300 0.4087 0.4100 0.2182 0.1549 0.2987 0.3750 0.7098 0.1664 0.1219 0.1386 0.0350 0.4100 0.2182 0.1549 189-DS 0.0000 0.0050 0.0100 0.0375 0.0400 0.0191 0.0167 0.0325 0.0400 0.8751 0.0074 0.0001 0.0154 0.0000 0.0400 0.0191 0.0167 190-DS 0.3950 0.4663 0.4850 0.5212 0.5750 0.4886 0.0550 0.0550 0.1800 0.1127 0.4858 0.4829 0.0394 0.3950 0.5750 0.4886 0.0550 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 193-DS 0.0200 0.0500 0.0750 0.0838 0.1000 0.0659 0.0255 0.0337 0.0800 0.3866 0.0595 0.0513 0.0198 0.0200 0.1000 0.0659 0.0255 194-DS 0.0550 0.0900 0.1600 0.1650 0.1800 0.1323 0.0468 0.0750 0.1250 0.3535 0.1226 0.1111 0.0389 0.0550 0.1800 0.1323 0.0468 195-DS 0.0250 0.0575 0.2100 0.2587 0.4400 0.1859 0.1450 0.2012 0.4150 0.7799 0.1248 0.0753 0.1208 0.0250 0.4400 0.1859 0.1450 196-DS 0.0050 0.0150 0.0150 0.0150 0.0300 0.0164 0.0074 0.0000 0.0250 0.4551 0.0148 0.0132 0.0050 0.0150 0.0150 0.0150 0.0000 197-DS 0.0000 0.0375 0.0900 0.1075 0.1150 0.0714 0.0437 0.0700 0.1150 0.6117 0.0158 0.0001 0.0358 0.0000 0.1150 0.0714 0.0437 198-DS 0.1200 0.1325 0.1600 0.2275 0.3700 0.1891 0.0734 0.0950 0.2500 0.3884 0.1784 0.1698 0.0545 0.1200 0.3700 0.1891 0.0734 199-DS 0.0000 0.0050 0.0100 0.0100 0.0100 0.0077 0.0034 0.0050 0.0100 0.4449 0.0044 0.0001 0.0029 0.0000 0.0100 0.0077 0.0034 200-DS 0.1000 0.1562 0.2050 0.2288 0.2550 0.1950 0.0486 0.0725 0.1550 0.2491 0.1886 0.1812 0.0400 0.1000 0.2550 0.1950 0.0486 107 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-RU-CLEF2007 Statistics for P@500 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0015 0.0020 0.0005 0.0009 0.0015 0.0020 1.7127 0.0000 0.0000 0.0008 0.0000 0.0020 0.0005 0.0009 177-DS 0.0100 0.0185 0.0200 0.0200 0.0200 0.0182 0.0036 0.0015 0.0100 0.1995 0.0178 0.0172 0.0026 0.0180 0.0200 0.0198 0.0007 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0420 0.0710 0.1540 0.1790 0.1900 0.1309 0.0566 0.1080 0.1480 0.4321 0.1156 0.0975 0.0459 0.0420 0.1900 0.1309 0.0566 180-DS 0.0180 0.0425 0.1080 0.1250 0.1360 0.0875 0.0456 0.0825 0.1180 0.5217 0.0707 0.0510 0.0385 0.0180 0.1360 0.0875 0.0456 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.0420 0.0550 0.0680 0.0730 0.0760 0.0644 0.0117 0.0180 0.0340 0.1822 0.0633 0.0620 0.0094 0.0420 0.0760 0.0644 0.0117 183-DS 0.0760 0.0860 0.0880 0.0935 0.1060 0.0893 0.0076 0.0075 0.0300 0.0846 0.0890 0.0887 0.0054 0.0760 0.0940 0.0876 0.0054 184-DS 0.0140 0.0310 0.0380 0.0470 0.0740 0.0402 0.0170 0.0160 0.0600 0.4220 0.0368 0.0331 0.0122 0.0140 0.0620 0.0368 0.0134 185-DS 0.0000 0.0100 0.0120 0.0155 0.0200 0.0111 0.0062 0.0055 0.0200 0.5608 0.0036 0.0001 0.0044 0.0100 0.0200 0.0136 0.0033 186-DS 0.0020 0.0060 0.0060 0.0060 0.0060 0.0055 0.0013 0.0000 0.0040 0.2371 0.0052 0.0049 0.0009 0.0060 0.0060 0.0060 0.0000 187-DS 0.0580 0.1160 0.3940 0.4070 0.4800 0.2987 0.1642 0.2910 0.4220 0.5497 0.2349 0.1642 0.1463 0.0580 0.4800 0.2987 0.1642 188-DS 0.0200 0.0930 0.1040 0.1675 0.1680 0.1173 0.0467 0.0745 0.1480 0.3982 0.1040 0.0819 0.0365 0.0200 0.1680 0.1173 0.0467 189-DS 0.0020 0.0040 0.0100 0.0200 0.0200 0.0116 0.0080 0.0160 0.0180 0.6867 0.0084 0.0056 0.0072 0.0020 0.0200 0.0116 0.0080 190-DS 0.2080 0.2370 0.2440 0.2460 0.2460 0.2391 0.0111 0.0090 0.0380 0.0466 0.2388 0.2386 0.0071 0.2340 0.2460 0.2422 0.0045 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0000 0.0000 0.0000 0.0000 0.0020 0.0004 0.0008 0.0000 0.0020 2.2249 0.0000 0.0000 0.0006 0.0000 0.0000 0.0000 0.0000 193-DS 0.0160 0.0270 0.0320 0.0465 0.0500 0.0336 0.0121 0.0195 0.0340 0.3595 0.0314 0.0291 0.0097 0.0160 0.0500 0.0336 0.0121 194-DS 0.0580 0.0775 0.1160 0.1275 0.1520 0.1045 0.0317 0.0500 0.0940 0.3035 0.0998 0.0948 0.0278 0.0580 0.1520 0.1045 0.0317 195-DS 0.0280 0.0865 0.1120 0.1500 0.2020 0.1178 0.0548 0.0635 0.1740 0.4649 0.1032 0.0854 0.0431 0.0280 0.2020 0.1178 0.0548 196-DS 0.0040 0.0060 0.0060 0.0120 0.0140 0.0084 0.0037 0.0060 0.0100 0.4386 0.0076 0.0069 0.0033 0.0040 0.0140 0.0084 0.0037 197-DS 0.0000 0.0270 0.0460 0.0520 0.0540 0.0375 0.0205 0.0250 0.0540 0.5467 0.0097 0.0001 0.0164 0.0000 0.0540 0.0375 0.0205 198-DS 0.0800 0.0940 0.1080 0.1255 0.1640 0.1116 0.0245 0.0315 0.0840 0.2197 0.1093 0.1071 0.0192 0.0800 0.1640 0.1116 0.0245 199-DS 0.0020 0.0040 0.0040 0.0055 0.0060 0.0044 0.0012 0.0015 0.0040 0.2764 0.0042 0.0040 0.0009 0.0020 0.0060 0.0044 0.0012 200-DS 0.0900 0.1030 0.1240 0.1280 0.1320 0.1165 0.0148 0.0250 0.0420 0.1266 0.1156 0.1147 0.0125 0.0900 0.1320 0.1165 0.0148 108 DS-MONO-CLEF2007 Track Overview Results and Graphs DS-MONO-RU-CLEF2007 Statistics for P@1000 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0010 0.0010 0.0004 0.0005 0.0010 0.0010 1.3874 0.0001 0.0000 0.0005 0.0000 0.0010 0.0004 0.0005 177-DS 0.0060 0.0092 0.0100 0.0100 0.0100 0.0095 0.0012 0.0008 0.0040 0.1284 0.0094 0.0093 0.0008 0.0090 0.0100 0.0098 0.0004 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0420 0.0543 0.0880 0.0942 0.0960 0.0776 0.0226 0.0400 0.0540 0.2911 0.0739 0.0695 0.0189 0.0420 0.0960 0.0776 0.0226 180-DS 0.0090 0.0482 0.0660 0.0680 0.0680 0.0534 0.0230 0.0198 0.0590 0.4309 0.0441 0.0300 0.0175 0.0460 0.0680 0.0632 0.0077 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.0270 0.0343 0.0390 0.0400 0.0420 0.0364 0.0053 0.0057 0.0150 0.1467 0.0360 0.0355 0.0043 0.0270 0.0420 0.0364 0.0053 183-DS 0.0450 0.0480 0.0510 0.0510 0.0530 0.0496 0.0026 0.0030 0.0080 0.0520 0.0496 0.0495 0.0022 0.0450 0.0530 0.0496 0.0026 184-DS 0.0180 0.0233 0.0270 0.0318 0.0480 0.0284 0.0085 0.0085 0.0300 0.3013 0.0273 0.0263 0.0064 0.0180 0.0360 0.0264 0.0058 185-DS 0.0000 0.0080 0.0080 0.0090 0.0100 0.0070 0.0035 0.0010 0.0100 0.5031 0.0025 0.0001 0.0025 0.0080 0.0100 0.0086 0.0007 186-DS 0.0030 0.0030 0.0030 0.0030 0.0040 0.0032 0.0004 0.0000 0.0010 0.1271 0.0032 0.0031 0.0003 0.0030 0.0030 0.0030 0.0000 187-DS 0.0510 0.1292 0.1990 0.2742 0.2850 0.1977 0.0827 0.1450 0.2340 0.4182 0.1764 0.1494 0.0673 0.0510 0.2850 0.1977 0.0827 188-DS 0.0220 0.0550 0.0590 0.0860 0.0860 0.0647 0.0200 0.0310 0.0640 0.3089 0.0610 0.0560 0.0155 0.0220 0.0860 0.0647 0.0200 189-DS 0.0020 0.0043 0.0080 0.0123 0.0160 0.0083 0.0045 0.0080 0.0140 0.5435 0.0070 0.0058 0.0038 0.0020 0.0160 0.0083 0.0045 190-DS 0.1200 0.1220 0.1230 0.1230 0.1250 0.1225 0.0015 0.0010 0.0050 0.0123 0.1225 0.1225 0.0011 0.1220 0.1240 0.1229 0.0006 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0000 0.0000 0.0010 0.0010 0.0010 0.0005 0.0005 0.0010 0.0010 0.9574 0.0001 0.0000 0.0005 0.0000 0.0010 0.0005 0.0005 193-DS 0.0110 0.0150 0.0170 0.0250 0.0250 0.0185 0.0054 0.0100 0.0140 0.2887 0.0179 0.0172 0.0047 0.0110 0.0250 0.0185 0.0054 194-DS 0.0460 0.0705 0.0850 0.0940 0.1040 0.0816 0.0173 0.0235 0.0580 0.2118 0.0797 0.0775 0.0132 0.0460 0.1040 0.0816 0.0173 195-DS 0.0190 0.0500 0.0860 0.0990 0.1130 0.0765 0.0305 0.0490 0.0940 0.3983 0.0690 0.0589 0.0254 0.0190 0.1130 0.0765 0.0305 196-DS 0.0030 0.0048 0.0070 0.0070 0.0080 0.0062 0.0019 0.0023 0.0050 0.3054 0.0058 0.0054 0.0016 0.0030 0.0080 0.0062 0.0019 197-DS 0.0000 0.0175 0.0280 0.0290 0.0290 0.0221 0.0118 0.0115 0.0290 0.5327 0.0063 0.0001 0.0095 0.0140 0.0290 0.0270 0.0049 198-DS 0.0570 0.0670 0.0850 0.0867 0.0930 0.0775 0.0128 0.0198 0.0360 0.1654 0.0764 0.0753 0.0108 0.0570 0.0930 0.0775 0.0128 199-DS 0.0010 0.0023 0.0030 0.0030 0.0030 0.0026 0.0007 0.0007 0.0020 0.2557 0.0025 0.0024 0.0005 0.0020 0.0030 0.0028 0.0004 200-DS 0.0730 0.0760 0.0760 0.0800 0.0810 0.0774 0.0027 0.0040 0.0080 0.0348 0.0773 0.0773 0.0023 0.0730 0.0810 0.0774 0.0027 109 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2DE-CLEF2007 Domain−Specific Bilingual German Task Top 5 Participants − Standard Recall Levels vs Mean Interpolated Precision 100% xerox [Experiment XRCEE2DHECGPRFLE; MAP 45.68%; Pooled] chemnitz [Experiment CUT_DS_BILI_EN2DE_MERGED_THES; MAP 27.21%; Pooled] 90% cheshire [Experiment BERKBENDETHP7; MAP 25.14%; Pooled] 80% 70% 60% Precision 50% 40% 30% 20% 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Bilingual German Task Top 5 Participants − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) 1 xerox [Experiment XRCEE2DHECGPRFLE; MAP 45.68%; Pooled] chemnitz [Experiment CUT_DS_BILI_EN2DE_MERGED_THES; MAP 27.21%; Pooled] cheshire [Experiment BERKBENDETHP7; MAP 25.14%; Pooled] 0.8 0.6 0.4 0.2 Difference 0 −0.2 −0.4 −0.6 −0.8 −1 176−DS177−DS178−DS179−DS180−DS181−DS182−DS183−DS184−DS185−DS186−DS187−DS188−DS189−DS190−DS191−DS192−DS193−DS194−DS195−DS196−DS197−DS198−DS199−DS200−DS Topic Identifier 110 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2DE-CLEF2007 Domain−Specific Bilingual German Task − Box Plot of the Topics xerox [Experiment XRCEE2DHECGPRFLE; MAP 45.68%; Pooled] xerox [Experiment XRCEE2DHCGEPRFLE; MAP 44.47%; Pooled] xerox [Experiment XRCEE2DMATRAXLE; MAP 43.36%; Pooled] xerox [Experiment XRCEE2DMATRAXPRFLE; MAP 42.98%; Pooled] xerox [Experiment XRCEE2DMATRAX; MAP 40.01%; Pooled] xerox [Experiment XRCEE2DHCGELE; MAP 39.05%; Pooled] chemnitz [Experiment CUT_DS_BILI_EN2DE_MERGED_THES; MAP 27.21%; Pooled] Experiments cheshire [Experiment BERKBENDETHP7; MAP 25.14%; Pooled] cheshire [Experiment BERKBENDECCP15; MAP 24.12%; Pooled] chemnitz [Experiment CUT_DS_BILI_RU2DE_MERGED_THES; MAP 20.47%; Pooled] chemnitz [Experiment CUT_DS_BILI_EN2DE_MERGED; MAP 20.11%; Pooled] chemnitz [Experiment CUT_DS_BILI_RU2DE_MERGED; MAP 18.83%; Pooled] cheshire [Experiment BERKBRUDECCP15; MAP 15.20%; Pooled] cheshire [Experiment BERKBRUDETHP7; MAP 15.01%; Pooled] 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Average Precision 111 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2DE-CLEF2007 10.2455/TUKEY_T_TEST.5A5D29284220057CD5133ABAAE37A8F4 Domain−Specific Bilingual German Task − Tukey T test with "top group" highlighted XRCEE2DHECGPRFLE XRCEE2DHCGEPRFLE XRCEE2DMATRAXLE XRCEE2DMATRAXPRFLE XRCEE2DMATRAX XRCEE2DHCGELE Experiments CUT_DS_BILI_EN2DE_MERGED_THES BERKBENDETHP7 BERKBENDECCP15 CUT_DS_BILI_EN2DE_MERGED CUT_DS_BILI_RU2DE_MERGED_THES CUT_DS_BILI_RU2DE_MERGED BERKBRUDECCP15 BERKBRUDETHP7 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 arcsin(sqrt(Average Precsion)) 112 113 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2DE-CLEF2007 Domain−Specific Bilingual German Task Top 5 Participants − Retrieved documents vs Mean Precision 100% xerox [Experiment XRCEE2DHECGPRFLE; R−Prec 45.18%; Pooled] chemnitz [Experiment CUT_DS_BILI_EN2DE_MERGED_THES; R−Prec 31.34%; Pooled] 90% cheshire [Experiment BERKBENDETHP7; R−Prec 29.19%; Pooled] 80% 70% 60% Precision 50% 40% 30% 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Bilingual German Task Top 5 Participants − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) 1 xerox [Experiment XRCEE2DHECGPRFLE; R−Prec 45.18%; Pooled] chemnitz [Experiment CUT_DS_BILI_EN2DE_MERGED_THES; R−Prec 31.34%; Pooled] cheshire [Experiment BERKBENDETHP7; R−Prec 29.19%; Pooled] 0.8 0.6 0.4 0.2 Difference 0 −0.2 −0.4 −0.6 −0.8 −1 176−DS177−DS178−DS179−DS180−DS181−DS182−DS183−DS184−DS185−DS186−DS187−DS188−DS189−DS190−DS191−DS192−DS193−DS194−DS195−DS196−DS197−DS198−DS199−DS200−DS Topic Identifier 114 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2DE-CLEF2007 Domain−Specific Bilingual German Task − Box Plot of the Topics xerox [Experiment XRCEE2DHECGPRFLE; R−Prec 45.18%; Pooled] xerox [Experiment XRCEE2DHCGEPRFLE; R−Prec 43.86%; Pooled] xerox [Experiment XRCEE2DMATRAXLE; R−Prec 43.47%; Pooled] xerox [Experiment XRCEE2DMATRAXPRFLE; R−Prec 42.69%; Pooled] xerox [Experiment XRCEE2DMATRAX; R−Prec 41.05%; Pooled] xerox [Experiment XRCEE2DHCGELE; R−Prec 39.75%; Pooled] chemnitz [Experiment CUT_DS_BILI_EN2DE_MERGED_THES; R−Prec 31.34%; Pooled] Experiments cheshire [Experiment BERKBENDETHP7; R−Prec 29.19%; Pooled] cheshire [Experiment BERKBENDECCP15; R−Prec 28.17%; Pooled] chemnitz [Experiment CUT_DS_BILI_EN2DE_MERGED; R−Prec 24.93%; Pooled] chemnitz [Experiment CUT_DS_BILI_RU2DE_MERGED_THES; R−Prec 24.23%; Pooled] chemnitz [Experiment CUT_DS_BILI_RU2DE_MERGED; R−Prec 22.77%; Pooled] cheshire [Experiment BERKBRUDETHP7; R−Prec 18.59%; Pooled] cheshire [Experiment BERKBRUDECCP15; R−Prec 18.58%; Pooled] 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% R−Precision 115 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2DE-CLEF2007 Domain−Specific Bilingual German Task − Tukey T test with "top group" highlighted XRCEE2DHECGPRFLE XRCEE2DHCGEPRFLE XRCEE2DMATRAXLE XRCEE2DMATRAXPRFLE XRCEE2DMATRAX XRCEE2DHCGELE Experiments CUT_DS_BILI_EN2DE_MERGED_THES BERKBENDETHP7 BERKBENDECCP15 CUT_DS_BILI_EN2DE_MERGED CUT_DS_BILI_RU2DE_MERGED_THES CUT_DS_BILI_RU2DE_MERGED BERKBRUDETHP7 BERKBRUDECCP15 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 arcsin(sqrt(R−Precision)) 116 117 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2DE-CLEF2007 Statistics for Number of relevant retrieved documents Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 4.00 6.00 78.00 85.00 86.00 53.50 37.25 79.00 82.00 0.70 32.22 14.63 34.43 4.00 86.00 53.50 37.25 177-DS 25.00 44.00 57.50 61.00 63.00 51.93 12.94 17.00 38.00 0.25 49.92 47.31 10.10 25.00 63.00 51.93 12.94 178-DS 6.00 29.00 111.00 131.00 139.00 86.71 52.71 102.00 133.00 0.61 59.29 27.76 46.65 6.00 139.00 86.71 52.71 179-DS 15.00 121.00 123.50 125.00 125.00 107.93 39.40 4.00 110.00 0.37 91.33 60.72 26.55 121.00 125.00 123.42 1.56 180-DS 13.00 152.00 203.00 231.00 233.00 168.36 80.39 79.00 220.00 0.48 127.85 66.31 63.97 58.00 233.00 194.00 51.15 181-DS 14.00 41.00 41.00 44.00 44.00 39.29 7.98 3.00 30.00 0.20 38.04 35.97 4.80 40.00 44.00 42.08 1.51 182-DS 7.00 225.00 234.00 260.00 270.00 214.21 71.40 35.00 263.00 0.33 176.37 69.43 49.52 225.00 270.00 245.73 16.35 183-DS 73.00 90.00 128.00 147.00 149.00 118.86 29.37 57.00 76.00 0.25 115.19 111.34 26.45 73.00 149.00 118.86 29.37 184-DS 55.00 56.00 69.50 77.00 78.00 68.00 9.07 21.00 23.00 0.13 67.41 66.80 7.57 55.00 78.00 68.00 9.07 185-DS 0.00 8.00 13.50 23.00 38.00 14.86 11.13 15.00 38.00 0.75 1.92 0.00 9.00 0.00 38.00 14.86 11.13 186-DS 7.00 10.00 13.50 19.00 24.00 14.86 5.27 9.00 17.00 0.36 13.96 13.08 4.55 7.00 24.00 14.86 5.27 187-DS 44.00 45.00 56.00 59.00 64.00 53.50 7.62 14.00 20.00 0.14 52.99 52.48 6.86 44.00 64.00 53.50 7.62 188-DS 175.00 268.00 285.00 298.00 306.00 277.86 32.89 30.00 131.00 0.12 275.61 272.79 20.76 264.00 306.00 285.77 14.92 189-DS 4.00 13.00 36.00 49.00 52.00 32.43 17.21 36.00 48.00 0.53 25.39 16.43 14.22 4.00 52.00 32.43 17.21 190-DS 89.00 257.00 306.00 310.00 311.00 266.71 77.56 53.00 222.00 0.29 249.49 223.22 55.69 237.00 311.00 295.92 24.41 191-DS 17.00 22.00 26.00 28.00 30.00 25.14 4.19 6.00 13.00 0.17 24.78 24.36 3.24 17.00 30.00 25.14 4.19 192-DS 3.00 64.00 73.00 97.00 97.00 68.93 31.33 33.00 94.00 0.45 49.24 17.02 22.23 54.00 97.00 79.92 15.42 193-DS 54.00 98.00 122.50 149.00 221.00 134.29 48.95 51.00 167.00 0.36 125.96 117.48 38.76 54.00 221.00 134.29 48.95 194-DS 16.00 44.00 66.50 89.00 113.00 67.64 30.92 45.00 97.00 0.46 58.41 46.58 24.31 16.00 113.00 67.64 30.92 195-DS 5.00 262.00 278.00 303.00 331.00 242.29 105.92 41.00 326.00 0.44 157.27 31.58 75.12 262.00 331.00 290.09 23.38 196-DS 1.00 62.00 81.00 83.00 88.00 65.43 29.63 21.00 87.00 0.45 40.50 6.47 21.88 47.00 88.00 76.17 12.53 197-DS 120.00 148.00 171.00 179.00 193.00 164.57 23.45 31.00 73.00 0.14 162.87 161.01 18.06 120.00 193.00 164.57 23.45 198-DS 97.00 177.00 188.50 197.00 204.00 176.43 34.20 20.00 107.00 0.19 172.34 167.03 22.76 173.00 204.00 189.42 9.66 199-DS 4.00 5.00 69.50 81.00 81.00 54.71 33.75 76.00 77.00 0.62 33.29 13.52 28.69 4.00 81.00 54.71 33.75 200-DS 8.00 18.00 22.00 43.00 68.00 29.79 17.54 25.00 60.00 0.59 25.00 20.68 15.04 8.00 68.00 29.79 17.54 118 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2DE-CLEF2007 Statistics for Average Precsion Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0006 0.0039 0.5040 0.8061 0.8509 0.4346 0.3800 0.8022 0.8503 0.8744 0.0855 0.0036 0.3456 0.0006 0.8509 0.4346 0.3800 177-DS 0.0152 0.0841 0.1408 0.1721 0.2036 0.1301 0.0616 0.0880 0.1884 0.4736 0.1047 0.0660 0.0479 0.0152 0.2036 0.1301 0.0616 178-DS 0.0009 0.0059 0.2838 0.5503 0.7823 0.3293 0.3054 0.5444 0.7813 0.9275 0.0787 0.0054 0.2585 0.0009 0.7823 0.3293 0.3054 179-DS 0.0047 0.3831 0.4620 0.5138 0.6121 0.4108 0.1865 0.1307 0.6075 0.4539 0.2444 0.0308 0.1282 0.3797 0.6121 0.4785 0.0781 180-DS 0.0017 0.2000 0.4968 0.6856 0.7074 0.4248 0.2756 0.4856 0.7058 0.6489 0.1800 0.0114 0.2354 0.0017 0.7074 0.4248 0.2756 181-DS 0.0482 0.4819 0.5685 0.6495 0.7046 0.5125 0.2008 0.1676 0.6564 0.3918 0.4265 0.2666 0.1394 0.4784 0.7046 0.5863 0.0774 182-DS 0.0016 0.3216 0.3629 0.6115 0.6518 0.4075 0.2042 0.2899 0.6501 0.5010 0.2717 0.0216 0.1690 0.0016 0.6518 0.4075 0.2042 183-DS 0.0670 0.0789 0.4804 0.6851 0.7750 0.4209 0.2880 0.6062 0.7080 0.6842 0.2927 0.1818 0.2600 0.0670 0.7750 0.4209 0.2880 184-DS 0.0570 0.1917 0.4086 0.6746 0.7184 0.4040 0.2428 0.4830 0.6615 0.6008 0.3106 0.2052 0.2079 0.0570 0.7184 0.4040 0.2428 185-DS 0.0000 0.0010 0.0102 0.0193 0.0391 0.0127 0.0130 0.0182 0.0391 1.0194 0.0029 0.0001 0.0105 0.0000 0.0391 0.0127 0.0130 186-DS 0.0040 0.0079 0.0121 0.0164 0.0492 0.0166 0.0143 0.0084 0.0452 0.8652 0.0125 0.0099 0.0099 0.0040 0.0224 0.0113 0.0055 187-DS 0.0582 0.0645 0.0942 0.1429 0.1734 0.1051 0.0420 0.0784 0.1152 0.3996 0.0976 0.0909 0.0361 0.0582 0.1734 0.1051 0.0420 188-DS 0.1909 0.5130 0.5580 0.6336 0.6685 0.5448 0.1239 0.1206 0.4776 0.2274 0.5250 0.4940 0.0859 0.4233 0.6685 0.5720 0.0734 189-DS 0.0003 0.0078 0.0462 0.1169 0.3212 0.0825 0.0887 0.1091 0.3209 1.0752 0.0289 0.0022 0.0661 0.0003 0.1731 0.0641 0.0583 190-DS 0.0483 0.5131 0.7514 0.8040 0.8564 0.6307 0.2710 0.2909 0.8081 0.4297 0.4905 0.2474 0.2046 0.4762 0.8564 0.7274 0.1242 191-DS 0.0142 0.0242 0.0706 0.0774 0.2355 0.0787 0.0633 0.0532 0.2213 0.8037 0.0571 0.0395 0.0430 0.0142 0.1236 0.0574 0.0332 192-DS 0.0002 0.1220 0.2021 0.5555 0.6463 0.2812 0.2257 0.4336 0.6461 0.8028 0.0953 0.0013 0.1918 0.0002 0.6463 0.2812 0.2257 193-DS 0.0404 0.1454 0.1743 0.2458 0.7585 0.2630 0.2155 0.1004 0.7181 0.8193 0.2022 0.1551 0.1563 0.0404 0.2458 0.1636 0.0596 194-DS 0.0023 0.0235 0.0681 0.2677 0.3840 0.1328 0.1324 0.2442 0.3817 0.9968 0.0560 0.0128 0.1161 0.0023 0.3840 0.1328 0.1324 195-DS 0.0002 0.3184 0.3637 0.4574 0.5787 0.3372 0.1798 0.1390 0.5785 0.5331 0.1239 0.0012 0.1308 0.1387 0.5787 0.3934 0.1187 196-DS 0.0000 0.2038 0.3125 0.3791 0.6168 0.2989 0.1796 0.1752 0.6168 0.6008 0.0854 0.0002 0.1356 0.0000 0.6168 0.2989 0.1796 197-DS 0.2223 0.3261 0.4527 0.6004 0.7410 0.4670 0.1792 0.2743 0.5188 0.3836 0.4335 0.4003 0.1519 0.2223 0.7410 0.4670 0.1792 198-DS 0.0746 0.3879 0.4610 0.4803 0.6055 0.4125 0.1546 0.0923 0.5308 0.3749 0.3592 0.2690 0.1056 0.3683 0.6055 0.4684 0.0663 199-DS 0.0002 0.0004 0.4595 0.6138 0.6519 0.3511 0.2789 0.6134 0.6518 0.7943 0.0525 0.0008 0.2564 0.0002 0.6519 0.3511 0.2789 200-DS 0.0012 0.0063 0.0252 0.0501 0.2059 0.0400 0.0535 0.0438 0.2047 1.3352 0.0171 0.0062 0.0345 0.0012 0.0700 0.0273 0.0251 119 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2DE-CLEF2007 Statistics for R-Precision Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0225 0.5281 0.7753 0.7978 0.4286 0.3465 0.7528 0.7978 0.8085 0.0681 0.0001 0.3160 0.0000 0.7978 0.4286 0.3465 177-DS 0.0455 0.1515 0.1818 0.2424 0.2879 0.1851 0.0778 0.0909 0.2424 0.4201 0.1625 0.1318 0.0600 0.0455 0.2879 0.1851 0.0778 178-DS 0.0071 0.0286 0.3571 0.5214 0.7286 0.3418 0.2834 0.4929 0.7214 0.8289 0.1473 0.0346 0.2399 0.0071 0.7286 0.3418 0.2834 179-DS 0.0556 0.4127 0.4921 0.5000 0.6190 0.4274 0.1689 0.0873 0.5635 0.3952 0.3561 0.2298 0.1135 0.4127 0.6190 0.4894 0.0663 180-DS 0.0287 0.3156 0.5061 0.6434 0.6557 0.4415 0.2381 0.3279 0.6270 0.5394 0.3121 0.1393 0.1971 0.0287 0.6557 0.4415 0.2381 181-DS 0.1364 0.4773 0.5227 0.5909 0.6364 0.4870 0.1609 0.1136 0.5000 0.3303 0.4447 0.3786 0.1104 0.4545 0.6364 0.5455 0.0671 182-DS 0.0178 0.3701 0.4075 0.6014 0.6299 0.4365 0.1712 0.2313 0.6121 0.3924 0.3590 0.1627 0.1317 0.2847 0.6299 0.4687 0.1266 183-DS 0.1529 0.1656 0.4873 0.6433 0.7261 0.4486 0.2272 0.4777 0.5732 0.5065 0.3825 0.3151 0.2007 0.1529 0.7261 0.4486 0.2272 184-DS 0.0750 0.2750 0.4250 0.6250 0.6375 0.4107 0.1998 0.3500 0.5625 0.4865 0.3430 0.2523 0.1663 0.0750 0.6375 0.4107 0.1998 185-DS 0.0000 0.0000 0.0115 0.0575 0.1149 0.0287 0.0334 0.0575 0.1149 1.1609 0.0030 0.0000 0.0263 0.0000 0.1149 0.0287 0.0334 186-DS 0.0000 0.0000 0.0286 0.0286 0.0857 0.0224 0.0229 0.0286 0.0857 1.0205 0.0018 0.0000 0.0160 0.0000 0.0286 0.0176 0.0145 187-DS 0.0870 0.1304 0.1377 0.2029 0.2754 0.1563 0.0540 0.0725 0.1884 0.3453 0.1482 0.1407 0.0420 0.0870 0.2754 0.1563 0.0540 188-DS 0.3015 0.5194 0.5552 0.6030 0.6149 0.5407 0.0856 0.0836 0.3134 0.1582 0.5329 0.5229 0.0606 0.4507 0.6149 0.5591 0.0528 189-DS 0.0000 0.0192 0.0769 0.1538 0.3654 0.1140 0.1081 0.1346 0.3654 0.9483 0.0258 0.0001 0.0834 0.0000 0.2500 0.0947 0.0836 190-DS 0.1186 0.5481 0.6779 0.7500 0.7885 0.6058 0.2181 0.2019 0.6699 0.3600 0.5349 0.4161 0.1571 0.5224 0.7885 0.6856 0.0865 191-DS 0.0278 0.0556 0.1250 0.1389 0.2778 0.1270 0.0753 0.0833 0.2500 0.5927 0.1036 0.0793 0.0556 0.0278 0.2500 0.1154 0.0640 192-DS 0.0000 0.1818 0.2576 0.5253 0.6263 0.3045 0.2046 0.3434 0.6263 0.6721 0.0723 0.0001 0.1692 0.0000 0.6263 0.3045 0.2046 193-DS 0.0936 0.2213 0.2447 0.3532 0.6809 0.3207 0.1683 0.1319 0.5872 0.5249 0.2842 0.2507 0.1270 0.0936 0.4681 0.2645 0.0966 194-DS 0.0163 0.0325 0.1341 0.3902 0.4309 0.1887 0.1667 0.3577 0.4146 0.8833 0.1078 0.0543 0.1437 0.0163 0.4309 0.1887 0.1667 195-DS 0.0101 0.3089 0.4570 0.4962 0.5570 0.3761 0.1799 0.1873 0.5468 0.4782 0.2491 0.0617 0.1435 0.2380 0.5570 0.4371 0.0991 196-DS 0.0000 0.2809 0.3876 0.4270 0.5730 0.3443 0.1717 0.1461 0.5730 0.4988 0.0862 0.0001 0.1266 0.2584 0.5730 0.4017 0.0986 197-DS 0.3333 0.4129 0.4900 0.5522 0.6766 0.4936 0.1126 0.1393 0.3433 0.2281 0.4817 0.4699 0.0906 0.3333 0.6766 0.4936 0.1126 198-DS 0.1711 0.4561 0.4846 0.5044 0.5833 0.4524 0.1218 0.0482 0.4123 0.2693 0.4292 0.3955 0.0780 0.4518 0.5702 0.4900 0.0339 199-DS 0.0000 0.0000 0.4630 0.5556 0.5926 0.3316 0.2551 0.5556 0.5926 0.7695 0.0203 0.0000 0.2348 0.0000 0.5926 0.3316 0.2551 200-DS 0.0118 0.0353 0.0706 0.1294 0.2941 0.0899 0.0785 0.0941 0.2824 0.8734 0.0604 0.0381 0.0607 0.0118 0.1647 0.0742 0.0542 120 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2DE-CLEF2007 Statistics for Binary Preference Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0206 0.4833 0.8216 0.8548 0.4431 0.3786 0.8010 0.8548 0.8544 0.0650 0.0001 0.3402 0.0000 0.8548 0.4431 0.3786 177-DS 0.0250 0.0916 0.1220 0.1644 0.2062 0.1244 0.0581 0.0728 0.1811 0.4669 0.1062 0.0820 0.0459 0.0250 0.2062 0.1244 0.0581 178-DS 0.0082 0.0112 0.3591 0.6019 0.8522 0.3717 0.3300 0.5907 0.8440 0.8877 0.1355 0.0292 0.2754 0.0082 0.8522 0.3717 0.3300 179-DS 0.0342 0.3666 0.4851 0.5021 0.6563 0.4168 0.1839 0.1355 0.6221 0.4411 0.3245 0.1660 0.1350 0.3648 0.6563 0.4806 0.0943 180-DS 0.0285 0.4380 0.6705 0.8110 0.8215 0.5645 0.2951 0.3730 0.7929 0.5226 0.3939 0.1574 0.2428 0.0285 0.8215 0.5645 0.2951 181-DS 0.1080 0.4308 0.5072 0.6116 0.6384 0.4699 0.1719 0.1808 0.5305 0.3659 0.4182 0.3363 0.1256 0.4251 0.6384 0.5301 0.0850 182-DS 0.0179 0.5404 0.5759 0.7235 0.7651 0.5621 0.2050 0.1831 0.7472 0.3647 0.4577 0.1776 0.1418 0.3421 0.7651 0.6040 0.1376 183-DS 0.1035 0.1364 0.5510 0.7449 0.8059 0.4766 0.2791 0.6085 0.7024 0.5857 0.3733 0.2705 0.2502 0.1035 0.8059 0.4766 0.2791 184-DS 0.0464 0.2078 0.3746 0.6373 0.6772 0.3826 0.2273 0.4295 0.6308 0.5940 0.2915 0.1818 0.1917 0.0464 0.6772 0.3826 0.2273 185-DS 0.0000 0.0000 0.0115 0.0436 0.0654 0.0209 0.0226 0.0436 0.0654 1.0801 0.0021 0.0000 0.0199 0.0000 0.0654 0.0209 0.0226 186-DS 0.0000 0.0000 0.0114 0.0204 0.0612 0.0142 0.0172 0.0204 0.0612 1.2060 0.0012 0.0000 0.0131 0.0000 0.0286 0.0106 0.0110 187-DS 0.0506 0.0725 0.0804 0.1285 0.1863 0.0982 0.0407 0.0561 0.1357 0.4145 0.0911 0.0848 0.0342 0.0506 0.1863 0.0982 0.0407 188-DS 0.4167 0.6417 0.6910 0.7797 0.8366 0.6885 0.1134 0.1380 0.4199 0.1647 0.6786 0.6672 0.0886 0.5526 0.8366 0.7094 0.0855 189-DS 0.0000 0.0174 0.0418 0.1058 0.2848 0.0767 0.0826 0.0884 0.2848 1.0764 0.0179 0.0001 0.0624 0.0000 0.1901 0.0607 0.0592 190-DS 0.1871 0.6774 0.8950 0.9244 0.9345 0.7614 0.2594 0.2471 0.7474 0.3407 0.6870 0.5673 0.1941 0.6262 0.9345 0.8564 0.1033 191-DS 0.0116 0.0309 0.0826 0.1019 0.2230 0.0895 0.0668 0.0710 0.2114 0.7459 0.0637 0.0402 0.0475 0.0116 0.1466 0.0680 0.0417 192-DS 0.0000 0.1237 0.2115 0.5097 0.6123 0.2714 0.2113 0.3861 0.6123 0.7785 0.0618 0.0001 0.1785 0.0000 0.6123 0.2714 0.2113 193-DS 0.1097 0.2442 0.3261 0.4667 0.8367 0.3961 0.2219 0.2225 0.7270 0.5602 0.3445 0.2984 0.1725 0.1097 0.5872 0.3229 0.1317 194-DS 0.0075 0.0134 0.0850 0.3736 0.3962 0.1588 0.1610 0.3602 0.3887 1.0140 0.0712 0.0272 0.1389 0.0075 0.3962 0.1588 0.1610 195-DS 0.0096 0.5394 0.5951 0.6512 0.7546 0.5271 0.2383 0.1118 0.7450 0.4521 0.3348 0.0615 0.1679 0.3864 0.7546 0.6134 0.1015 196-DS 0.0000 0.2188 0.3019 0.3748 0.5388 0.2975 0.1622 0.1560 0.5388 0.5453 0.0749 0.0001 0.1242 0.0000 0.5388 0.2975 0.1622 197-DS 0.4050 0.5104 0.5945 0.7063 0.8195 0.6035 0.1348 0.1959 0.4145 0.2233 0.5893 0.5750 0.1113 0.4050 0.8195 0.6035 0.1348 198-DS 0.2615 0.5377 0.5908 0.5993 0.6862 0.5476 0.1279 0.0616 0.4247 0.2336 0.5283 0.5020 0.0851 0.5314 0.6862 0.5951 0.0460 199-DS 0.0000 0.0000 0.4249 0.5758 0.6080 0.3294 0.2699 0.5758 0.6080 0.8193 0.0193 0.0000 0.2490 0.0000 0.6080 0.3294 0.2699 200-DS 0.0062 0.0136 0.0409 0.0757 0.2039 0.0528 0.0534 0.0621 0.1976 1.0102 0.0331 0.0202 0.0376 0.0062 0.1071 0.0412 0.0322 121 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2DE-CLEF2007 Statistics for Precision at the 0% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0115 0.2000 1.0000 1.0000 1.0000 0.6957 0.4304 0.8000 0.9885 0.6187 0.3890 0.0752 0.3913 0.0115 1.0000 0.6957 0.4304 177-DS 0.0714 0.2857 0.5000 1.0000 1.0000 0.5467 0.3359 0.7143 0.9286 0.6144 0.4233 0.2830 0.2661 0.0714 1.0000 0.5467 0.3359 178-DS 0.0335 0.0769 1.0000 1.0000 1.0000 0.6647 0.4671 0.9231 0.9665 0.7027 0.3596 0.1352 0.4311 0.0335 1.0000 0.6647 0.4671 179-DS 0.0833 0.8333 1.0000 1.0000 1.0000 0.8203 0.3217 0.1667 0.9167 0.3921 0.6647 0.3802 0.2109 0.8182 1.0000 0.9432 0.0840 180-DS 0.0667 0.6667 1.0000 1.0000 1.0000 0.7872 0.3747 0.3333 0.9333 0.4759 0.5943 0.3102 0.3040 0.2162 1.0000 0.9069 0.2377 181-DS 0.3571 1.0000 1.0000 1.0000 1.0000 0.9541 0.1718 0.0000 0.6429 0.1801 0.9291 0.8861 0.0853 1.0000 1.0000 1.0000 0.0000 182-DS 0.2500 1.0000 1.0000 1.0000 1.0000 0.9464 0.2004 0.0000 0.7500 0.2118 0.9057 0.8235 0.0995 1.0000 1.0000 1.0000 0.0000 183-DS 0.3333 0.6429 1.0000 1.0000 1.0000 0.8435 0.2666 0.3571 0.6667 0.3160 0.7882 0.7159 0.2235 0.3333 1.0000 0.8435 0.2666 184-DS 0.1667 0.6250 1.0000 1.0000 1.0000 0.8274 0.3105 0.3750 0.8333 0.3752 0.7239 0.5556 0.2466 0.1667 1.0000 0.8274 0.3105 185-DS 0.0000 0.0117 0.1629 1.0000 1.0000 0.3614 0.4339 0.9883 1.0000 1.2006 0.0372 0.0001 0.3649 0.0000 1.0000 0.3614 0.4339 186-DS 0.0139 0.0327 0.0629 0.0909 1.0000 0.1938 0.3429 0.0582 0.9861 1.7699 0.0769 0.0474 0.2304 0.0139 0.1250 0.0594 0.0334 187-DS 0.1714 0.2500 0.5833 1.0000 1.0000 0.6331 0.3533 0.7500 0.8286 0.5580 0.5243 0.4197 0.3193 0.1714 1.0000 0.6331 0.3533 188-DS 0.5806 1.0000 1.0000 1.0000 1.0000 0.9656 0.1120 0.0000 0.4194 0.1160 0.9575 0.9467 0.0590 1.0000 1.0000 1.0000 0.0000 189-DS 0.0045 0.1667 0.2083 0.2857 1.0000 0.3034 0.3117 0.1190 0.9955 1.0274 0.1567 0.0323 0.2093 0.0045 0.3750 0.1873 0.1090 190-DS 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 0.0000 0.0000 0.0000 0.0000 1.0000 1.0000 0.0000 1.0000 1.0000 1.0000 0.0000 191-DS 0.0588 0.1250 0.3000 0.5000 1.0000 0.3579 0.2754 0.3750 0.9412 0.7695 0.2544 0.1662 0.2123 0.0588 1.0000 0.3579 0.2754 192-DS 0.0074 0.7500 1.0000 1.0000 1.0000 0.8165 0.3587 0.2500 0.9926 0.4393 0.4720 0.0493 0.2621 0.6667 1.0000 0.9514 0.1149 193-DS 0.6667 0.7500 1.0000 1.0000 1.0000 0.9024 0.1397 0.2500 0.3333 0.1548 0.8914 0.8796 0.1255 0.6667 1.0000 0.9024 0.1397 194-DS 0.0252 0.0751 0.2846 1.0000 1.0000 0.4981 0.4628 0.9249 0.9748 0.9291 0.2376 0.0976 0.4302 0.0252 1.0000 0.4981 0.4628 195-DS 0.0238 0.9583 1.0000 1.0000 1.0000 0.8423 0.3500 0.0417 0.9762 0.4155 0.5867 0.1641 0.2419 0.9583 1.0000 0.9962 0.0126 196-DS 0.0023 0.5283 1.0000 1.0000 1.0000 0.7901 0.3740 0.4717 0.9977 0.4733 0.3873 0.0170 0.2998 0.0023 1.0000 0.7901 0.3740 197-DS 0.6000 1.0000 1.0000 1.0000 1.0000 0.9462 0.1370 0.0000 0.4000 0.1448 0.9347 0.9203 0.0922 1.0000 1.0000 1.0000 0.0000 198-DS 0.5000 1.0000 1.0000 1.0000 1.0000 0.9206 0.1806 0.0000 0.5000 0.1962 0.8981 0.8682 0.1247 1.0000 1.0000 1.0000 0.0000 199-DS 0.0044 0.0078 1.0000 1.0000 1.0000 0.7161 0.4659 0.9922 0.9956 0.6506 0.2325 0.0202 0.4056 0.0044 1.0000 0.7161 0.4659 200-DS 0.0244 0.0463 0.1537 0.5000 1.0000 0.3328 0.3843 0.4537 0.9756 1.1547 0.1603 0.0801 0.3099 0.0244 1.0000 0.3328 0.3843 122 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2DE-CLEF2007 Statistics for Precision at the 10% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.9524 1.0000 1.0000 0.6062 0.4765 1.0000 1.0000 0.7860 0.0287 0.0000 0.4364 0.0000 1.0000 0.6062 0.4765 177-DS 0.0523 0.1928 0.2715 0.3478 0.4737 0.2574 0.1209 0.1551 0.4214 0.4696 0.2190 0.1679 0.0933 0.0523 0.4737 0.2574 0.1209 178-DS 0.0000 0.0320 0.5926 0.9091 1.0000 0.5268 0.4182 0.8771 1.0000 0.7939 0.0804 0.0001 0.3636 0.0000 1.0000 0.5268 0.4182 179-DS 0.0311 0.5652 0.6293 0.7727 0.8235 0.5872 0.2558 0.2075 0.7924 0.4356 0.4331 0.1699 0.1750 0.5000 0.8235 0.6799 0.1082 180-DS 0.0000 0.4615 0.8262 0.9783 1.0000 0.6674 0.3812 0.5167 1.0000 0.5711 0.1406 0.0001 0.3188 0.0000 1.0000 0.6674 0.3812 181-DS 0.3571 0.8750 1.0000 1.0000 1.0000 0.8862 0.2311 0.1250 0.6429 0.2607 0.8429 0.7793 0.1625 0.8182 1.0000 0.9744 0.0609 182-DS 0.0000 0.4853 0.6235 0.8800 0.9737 0.6508 0.2610 0.3947 0.9737 0.4011 0.3058 0.0001 0.2059 0.0000 0.9737 0.6508 0.2610 183-DS 0.1620 0.2128 0.9428 1.0000 1.0000 0.6841 0.3661 0.7872 0.8380 0.5352 0.5526 0.4123 0.3300 0.1620 1.0000 0.6841 0.3661 184-DS 0.0909 0.3636 0.9750 1.0000 1.0000 0.7067 0.3651 0.6364 0.9091 0.5166 0.5566 0.3545 0.3280 0.0909 1.0000 0.7067 0.3651 185-DS 0.0000 0.0000 0.0177 0.0338 0.1324 0.0263 0.0346 0.0338 0.1324 1.3184 0.0028 0.0000 0.0221 0.0000 0.0500 0.0181 0.0170 186-DS 0.0133 0.0248 0.0368 0.0479 0.1000 0.0400 0.0231 0.0232 0.0867 0.5780 0.0349 0.0306 0.0164 0.0133 0.0727 0.0354 0.0160 187-DS 0.0982 0.1356 0.1687 0.2600 0.3889 0.1954 0.0864 0.1244 0.2907 0.4421 0.1797 0.1663 0.0696 0.0982 0.3889 0.1954 0.0864 188-DS 0.5806 0.8974 0.9146 0.9512 1.0000 0.8997 0.1033 0.0538 0.4194 0.1148 0.8929 0.8846 0.0607 0.8810 1.0000 0.9332 0.0387 189-DS 0.0000 0.0261 0.1200 0.2400 0.5833 0.1596 0.1676 0.2139 0.5833 1.0496 0.0331 0.0001 0.1243 0.0000 0.4074 0.1271 0.1196 190-DS 0.1441 0.8511 0.9294 0.9600 0.9730 0.8146 0.2858 0.1089 0.8288 0.3508 0.7113 0.5266 0.1907 0.8372 0.9730 0.9259 0.0450 191-DS 0.0388 0.0612 0.1667 0.2667 0.6667 0.2339 0.2174 0.2054 0.6278 0.9293 0.1582 0.1088 0.1663 0.0388 0.5000 0.1618 0.1270 192-DS 0.0000 0.2381 0.6905 1.0000 1.0000 0.5817 0.3791 0.7619 1.0000 0.6517 0.1236 0.0001 0.3352 0.0000 1.0000 0.5817 0.3791 193-DS 0.0930 0.4737 0.5722 0.7812 1.0000 0.6085 0.2476 0.3076 0.9070 0.4069 0.5396 0.4260 0.1919 0.0930 1.0000 0.6085 0.2476 194-DS 0.0170 0.0751 0.1559 0.5246 0.6522 0.2602 0.2338 0.4495 0.6351 0.8982 0.1495 0.0713 0.2033 0.0170 0.6522 0.2602 0.2338 195-DS 0.0000 0.5769 0.6866 0.9355 0.9778 0.6382 0.3265 0.3586 0.9778 0.5116 0.1448 0.0001 0.2450 0.3162 0.9778 0.7446 0.1989 196-DS 0.0000 0.4043 0.5066 0.6000 1.0000 0.5135 0.2983 0.1957 1.0000 0.5809 0.1186 0.0001 0.2068 0.3409 0.8235 0.5190 0.1317 197-DS 0.6000 0.6154 0.7956 1.0000 1.0000 0.8069 0.1802 0.3846 0.4000 0.2234 0.7879 0.7692 0.1613 0.6000 1.0000 0.8069 0.1802 198-DS 0.2264 0.7353 0.8495 0.8889 1.0000 0.7532 0.2364 0.1536 0.7736 0.3138 0.6961 0.6084 0.1677 0.6418 1.0000 0.8397 0.0946 199-DS 0.0000 0.0000 0.9167 0.9286 1.0000 0.5713 0.4599 0.9286 1.0000 0.8050 0.0287 0.0000 0.4335 0.0000 1.0000 0.5713 0.4599 200-DS 0.0000 0.0329 0.0474 0.1607 0.3448 0.1001 0.1018 0.1278 0.3448 1.0176 0.0362 0.0001 0.0814 0.0000 0.3448 0.1001 0.1018 123 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2DE-CLEF2007 Statistics for Precision at the 20% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.8944 0.9524 1.0000 0.5664 0.4673 0.9524 1.0000 0.8251 0.0252 0.0000 0.4382 0.0000 1.0000 0.5664 0.4673 177-DS 0.0366 0.1333 0.1972 0.2680 0.3469 0.2004 0.0978 0.1347 0.3104 0.4882 0.1684 0.1263 0.0778 0.0366 0.3469 0.2004 0.0978 178-DS 0.0000 0.0299 0.4688 0.8250 0.9444 0.4550 0.3778 0.7951 0.9444 0.8303 0.0712 0.0001 0.3204 0.0000 0.9444 0.4550 0.3778 179-DS 0.0000 0.4615 0.5392 0.6667 0.7708 0.5044 0.2385 0.2051 0.7708 0.4728 0.1207 0.0001 0.1684 0.4416 0.7708 0.5885 0.1151 180-DS 0.0000 0.4397 0.7955 0.9245 0.9524 0.6375 0.3685 0.4849 0.9524 0.5780 0.1308 0.0001 0.3088 0.0000 0.9524 0.6375 0.3685 181-DS 0.0427 0.7500 0.9000 0.9333 1.0000 0.7780 0.3071 0.1833 0.9573 0.3947 0.6203 0.3081 0.2073 0.7500 1.0000 0.8943 0.0894 182-DS 0.0000 0.4646 0.5155 0.8451 0.9194 0.5992 0.2572 0.3805 0.9194 0.4293 0.2807 0.0001 0.2103 0.0000 0.9194 0.5992 0.2572 183-DS 0.1078 0.1860 0.8493 0.9333 1.0000 0.6347 0.3685 0.7473 0.8922 0.5806 0.4856 0.3284 0.3363 0.1078 1.0000 0.6347 0.3685 184-DS 0.0909 0.3023 0.7143 0.9259 0.9500 0.6157 0.3338 0.6236 0.8591 0.5421 0.4867 0.3272 0.2970 0.0909 0.9500 0.6157 0.3338 185-DS 0.0000 0.0000 0.0000 0.0236 0.0657 0.0126 0.0205 0.0236 0.0657 1.6246 0.0002 0.0000 0.0162 0.0000 0.0425 0.0085 0.0142 186-DS 0.0101 0.0168 0.0231 0.0348 0.0986 0.0296 0.0229 0.0180 0.0885 0.7732 0.0242 0.0207 0.0153 0.0101 0.0479 0.0243 0.0119 187-DS 0.0946 0.1053 0.1356 0.2195 0.3137 0.1628 0.0742 0.1142 0.2191 0.4559 0.1492 0.1383 0.0624 0.0946 0.3137 0.1628 0.0742 188-DS 0.4891 0.8137 0.8618 0.9080 0.9867 0.8404 0.1182 0.0943 0.4976 0.1407 0.8306 0.8183 0.0760 0.7449 0.9867 0.8674 0.0638 189-DS 0.0000 0.0135 0.1000 0.1786 0.4231 0.1382 0.1394 0.1651 0.4231 1.0082 0.0279 0.0001 0.1041 0.0000 0.4231 0.1382 0.1394 190-DS 0.1171 0.8171 0.9163 0.9388 0.9730 0.7957 0.2889 0.1217 0.8559 0.3631 0.6816 0.4748 0.1921 0.7952 0.9730 0.9077 0.0535 191-DS 0.0302 0.0359 0.1353 0.1778 0.4000 0.1433 0.1181 0.1419 0.3698 0.8244 0.1025 0.0725 0.0857 0.0302 0.3704 0.1236 0.0960 192-DS 0.0000 0.1528 0.2895 0.7714 0.9167 0.4089 0.3370 0.6187 0.9167 0.8241 0.0844 0.0001 0.2945 0.0000 0.9167 0.4089 0.3370 193-DS 0.0599 0.2733 0.3346 0.5747 0.9688 0.4484 0.2750 0.3015 0.9088 0.6134 0.3654 0.2715 0.2221 0.0599 0.9688 0.4484 0.2750 194-DS 0.0000 0.0580 0.1555 0.5000 0.5682 0.2299 0.2151 0.4420 0.5682 0.9357 0.0458 0.0001 0.1845 0.0000 0.5682 0.2299 0.2151 195-DS 0.0000 0.5287 0.6639 0.8889 0.9412 0.5990 0.3171 0.3602 0.9412 0.5294 0.1357 0.0001 0.2446 0.0000 0.9412 0.5990 0.3171 196-DS 0.0000 0.4043 0.4669 0.5294 0.9545 0.4719 0.2639 0.1252 0.9545 0.5593 0.1111 0.0001 0.1799 0.3158 0.5294 0.4557 0.0705 197-DS 0.5062 0.5526 0.7332 0.9643 1.0000 0.7590 0.2060 0.4117 0.4938 0.2714 0.7324 0.7063 0.1850 0.5062 1.0000 0.7590 0.2060 198-DS 0.1538 0.6806 0.7367 0.8125 0.8493 0.6758 0.2240 0.1319 0.6955 0.3315 0.6105 0.5016 0.1513 0.6329 0.8493 0.7605 0.0670 199-DS 0.0000 0.0000 0.7157 0.8095 0.9200 0.4825 0.3899 0.8095 0.9200 0.8080 0.0256 0.0000 0.3630 0.0000 0.9200 0.4825 0.3899 200-DS 0.0000 0.0180 0.0383 0.1278 0.3034 0.0767 0.0857 0.1097 0.3034 1.1181 0.0101 0.0000 0.0677 0.0000 0.1513 0.0592 0.0579 124 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2DE-CLEF2007 Statistics for Precision at the 30% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.8438 0.9000 0.9737 0.5289 0.4601 0.9000 0.9737 0.8698 0.0133 0.0000 0.4362 0.0000 0.9737 0.5289 0.4601 177-DS 0.0293 0.1048 0.1835 0.2381 0.2800 0.1726 0.0822 0.1333 0.2507 0.4761 0.1454 0.1087 0.0674 0.0293 0.2800 0.1726 0.0822 178-DS 0.0000 0.0000 0.3852 0.8113 0.9412 0.4171 0.3785 0.8113 0.9412 0.9075 0.0118 0.0000 0.3276 0.0000 0.9412 0.4171 0.3785 179-DS 0.0000 0.4375 0.5392 0.6324 0.7600 0.4825 0.2272 0.1949 0.7600 0.4709 0.1163 0.0001 0.1609 0.4286 0.7600 0.5630 0.1078 180-DS 0.0000 0.3362 0.7265 0.8605 0.8889 0.5719 0.3531 0.5242 0.8889 0.6174 0.0639 0.0000 0.2990 0.0000 0.8889 0.5719 0.3531 181-DS 0.0185 0.6552 0.8007 0.8824 0.9333 0.6843 0.2824 0.2272 0.9148 0.4127 0.5200 0.1787 0.2010 0.5600 0.9333 0.7873 0.1130 182-DS 0.0000 0.4171 0.4550 0.7798 0.8614 0.5282 0.2560 0.3628 0.8614 0.4847 0.2431 0.0001 0.2155 0.0000 0.8614 0.5282 0.2560 183-DS 0.0938 0.1215 0.7760 0.9057 1.0000 0.5825 0.3689 0.7841 0.9062 0.6332 0.4206 0.2665 0.3396 0.0938 1.0000 0.5825 0.3689 184-DS 0.0870 0.3023 0.5357 0.8929 0.9286 0.5526 0.3178 0.5905 0.8416 0.5750 0.4358 0.3010 0.2779 0.0870 0.9286 0.5526 0.3178 185-DS 0.0000 0.0000 0.0000 0.0000 0.0444 0.0056 0.0143 0.0000 0.0444 2.5695 0.0000 0.0000 0.0096 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0181 0.0278 0.0385 0.0175 0.0136 0.0278 0.0385 0.7794 0.0025 0.0000 0.0111 0.0000 0.0385 0.0175 0.0136 187-DS 0.0818 0.0926 0.1201 0.1913 0.2561 0.1383 0.0565 0.0987 0.1743 0.4085 0.1287 0.1205 0.0473 0.0818 0.2561 0.1383 0.0565 188-DS 0.3051 0.7669 0.8048 0.8632 0.9714 0.7789 0.1619 0.0963 0.6663 0.2078 0.7559 0.7210 0.1024 0.7273 0.9714 0.8317 0.0722 189-DS 0.0000 0.0000 0.0779 0.1778 0.3818 0.1087 0.1118 0.1778 0.3818 1.0284 0.0085 0.0000 0.0831 0.0000 0.3818 0.1087 0.1118 190-DS 0.0000 0.7540 0.8806 0.9388 0.9515 0.7601 0.3093 0.1848 0.9515 0.4070 0.3314 0.0001 0.2072 0.7422 0.9515 0.8790 0.0695 191-DS 0.0227 0.0302 0.0805 0.0894 0.2821 0.0881 0.0713 0.0592 0.2594 0.8092 0.0676 0.0524 0.0455 0.0227 0.1062 0.0632 0.0302 192-DS 0.0000 0.1304 0.2562 0.6977 0.8571 0.3553 0.3037 0.5672 0.8571 0.8549 0.0739 0.0001 0.2593 0.0000 0.8571 0.3553 0.3037 193-DS 0.0000 0.1533 0.1991 0.4128 0.9579 0.3428 0.3002 0.2594 0.9579 0.8755 0.1359 0.0001 0.2328 0.0000 0.6379 0.2433 0.1754 194-DS 0.0000 0.0478 0.1096 0.4691 0.5125 0.2040 0.2037 0.4213 0.5125 0.9986 0.0227 0.0000 0.1740 0.0000 0.5125 0.2040 0.2037 195-DS 0.0000 0.3391 0.5432 0.6742 0.8333 0.4734 0.2635 0.3350 0.8333 0.5565 0.1099 0.0001 0.2102 0.0000 0.8333 0.4734 0.2635 196-DS 0.0000 0.2812 0.4057 0.5283 0.8182 0.4103 0.2457 0.2471 0.8182 0.5989 0.0963 0.0001 0.1888 0.0000 0.8182 0.4103 0.2457 197-DS 0.3405 0.4769 0.6813 0.9118 0.9851 0.6907 0.2365 0.4348 0.6445 0.3424 0.6490 0.6053 0.2032 0.3405 0.9851 0.6907 0.2365 198-DS 0.1312 0.6195 0.6635 0.6765 0.8182 0.6026 0.2062 0.0570 0.6870 0.3422 0.5411 0.4388 0.1378 0.5565 0.7000 0.6516 0.0404 199-DS 0.0000 0.0000 0.5611 0.6304 0.8611 0.4063 0.3298 0.6304 0.8611 0.8117 0.0227 0.0000 0.3017 0.0000 0.8611 0.4063 0.3298 200-DS 0.0000 0.0000 0.0000 0.1023 0.3034 0.0553 0.0858 0.1023 0.3034 1.5520 0.0005 0.0000 0.0632 0.0000 0.1169 0.0362 0.0494 125 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2DE-CLEF2007 Statistics for Precision at the 40% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.7200 0.8889 0.9737 0.5013 0.4480 0.8889 0.9737 0.8937 0.0123 0.0000 0.4214 0.0000 0.9737 0.5013 0.4480 177-DS 0.0000 0.0841 0.1571 0.1972 0.2593 0.1407 0.0759 0.1131 0.2593 0.5391 0.0393 0.0001 0.0567 0.0000 0.2593 0.1407 0.0759 178-DS 0.0000 0.0000 0.3631 0.6867 0.8955 0.3851 0.3565 0.6867 0.8955 0.9258 0.0111 0.0000 0.3028 0.0000 0.8955 0.3851 0.3565 179-DS 0.0000 0.4286 0.5352 0.5686 0.6867 0.4587 0.2126 0.1401 0.6867 0.4636 0.1116 0.0001 0.1483 0.4252 0.6867 0.5352 0.0938 180-DS 0.0000 0.2481 0.6104 0.8250 0.8444 0.5171 0.3437 0.5769 0.8444 0.6646 0.0576 0.0000 0.2931 0.0000 0.8444 0.5171 0.3437 181-DS 0.0000 0.5455 0.6310 0.7200 0.8400 0.5703 0.2537 0.1745 0.8400 0.4449 0.2445 0.0001 0.1716 0.5143 0.8400 0.6616 0.1111 182-DS 0.0000 0.3735 0.4106 0.7338 0.8071 0.4815 0.2474 0.3603 0.8071 0.5139 0.2194 0.0001 0.2069 0.0000 0.8071 0.4815 0.2474 183-DS 0.0864 0.1109 0.5744 0.8690 0.9697 0.5268 0.3503 0.7581 0.8833 0.6650 0.3764 0.2401 0.3117 0.0864 0.9697 0.5268 0.3503 184-DS 0.0870 0.2025 0.4615 0.8049 0.8718 0.4899 0.3049 0.6023 0.7848 0.6224 0.3784 0.2679 0.2706 0.0870 0.8718 0.4899 0.3049 185-DS 0.0000 0.0000 0.0000 0.0000 0.0415 0.0030 0.0111 0.0000 0.0415 3.7417 0.0000 0.0000 0.0055 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0084 0.0239 0.0348 0.0127 0.0140 0.0239 0.0348 1.1026 0.0005 0.0000 0.0127 0.0000 0.0348 0.0127 0.0140 187-DS 0.0704 0.0731 0.1134 0.1487 0.1883 0.1133 0.0402 0.0756 0.1179 0.3549 0.1068 0.1008 0.0340 0.0704 0.1883 0.1133 0.0402 188-DS 0.2339 0.6204 0.7092 0.8024 0.8766 0.6882 0.1663 0.1820 0.6428 0.2416 0.6606 0.6182 0.1165 0.5214 0.8766 0.7232 0.1069 189-DS 0.0000 0.0000 0.0634 0.1236 0.3818 0.0880 0.1002 0.1236 0.3818 1.1394 0.0072 0.0000 0.0685 0.0000 0.1618 0.0654 0.0560 190-DS 0.0000 0.6579 0.8318 0.8904 0.9388 0.7105 0.3141 0.2325 0.9388 0.4421 0.1634 0.0001 0.2212 0.6355 0.9388 0.8289 0.0976 191-DS 0.0172 0.0297 0.0487 0.0649 0.1923 0.0599 0.0466 0.0352 0.1751 0.7766 0.0480 0.0395 0.0311 0.0172 0.0818 0.0441 0.0196 192-DS 0.0000 0.1156 0.1638 0.6029 0.7843 0.3010 0.2729 0.4873 0.7843 0.9067 0.0621 0.0001 0.2381 0.0000 0.7843 0.3010 0.2729 193-DS 0.0000 0.1053 0.1677 0.3098 0.9515 0.2917 0.2999 0.2046 0.9515 1.0281 0.1091 0.0001 0.2222 0.0000 0.5647 0.1864 0.1467 194-DS 0.0000 0.0000 0.0796 0.3571 0.4513 0.1707 0.1771 0.3571 0.4513 1.0378 0.0111 0.0000 0.1517 0.0000 0.4513 0.1707 0.1771 195-DS 0.0000 0.3391 0.5101 0.5977 0.7257 0.4314 0.2294 0.2586 0.7257 0.5319 0.1027 0.0001 0.1809 0.0000 0.7257 0.4314 0.2294 196-DS 0.0000 0.2093 0.3960 0.4675 0.6727 0.3615 0.2218 0.2582 0.6727 0.6136 0.0855 0.0001 0.1807 0.0000 0.6727 0.3615 0.2218 197-DS 0.2531 0.4227 0.6226 0.8182 0.9213 0.6101 0.2326 0.3955 0.6682 0.3812 0.5626 0.5110 0.1986 0.2531 0.9213 0.6101 0.2326 198-DS 0.1144 0.5278 0.5438 0.5924 0.7419 0.5118 0.1828 0.0646 0.6275 0.3572 0.4556 0.3633 0.1192 0.4717 0.5974 0.5478 0.0355 199-DS 0.0000 0.0000 0.5205 0.5893 0.8049 0.3692 0.2958 0.5893 0.8049 0.8014 0.0215 0.0000 0.2703 0.0000 0.8049 0.3692 0.2958 200-DS 0.0000 0.0000 0.0000 0.0700 0.2677 0.0447 0.0743 0.0700 0.2677 1.6599 0.0005 0.0000 0.0512 0.0000 0.1054 0.0276 0.0389 126 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2DE-CLEF2007 Statistics for Precision at the 50% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.5844 0.8846 0.9400 0.4643 0.4306 0.8846 0.9400 0.9273 0.0063 0.0000 0.3980 0.0000 0.9400 0.4643 0.4306 177-DS 0.0000 0.0803 0.1388 0.1803 0.2276 0.1259 0.0695 0.1000 0.2276 0.5518 0.0354 0.0001 0.0534 0.0000 0.2276 0.1259 0.0695 178-DS 0.0000 0.0000 0.3021 0.5635 0.8659 0.3506 0.3386 0.5635 0.8659 0.9657 0.0103 0.0000 0.2889 0.0000 0.8659 0.3506 0.3386 179-DS 0.0000 0.4061 0.4893 0.5115 0.6774 0.4273 0.1973 0.1054 0.6774 0.4618 0.1051 0.0001 0.1329 0.3895 0.6000 0.4823 0.0673 180-DS 0.0000 0.1871 0.5111 0.7885 0.8092 0.4753 0.3313 0.6013 0.8092 0.6970 0.0527 0.0000 0.2825 0.0000 0.8092 0.4753 0.3313 181-DS 0.0000 0.4400 0.5351 0.6341 0.7500 0.5006 0.2331 0.1941 0.7500 0.4657 0.2156 0.0001 0.1683 0.4000 0.7500 0.5806 0.1237 182-DS 0.0000 0.3490 0.3857 0.6589 0.7085 0.4269 0.2244 0.3099 0.7085 0.5257 0.1932 0.0001 0.1819 0.0000 0.7085 0.4269 0.2244 183-DS 0.0000 0.0977 0.4868 0.8316 0.9091 0.4662 0.3596 0.7339 0.9091 0.7713 0.0906 0.0001 0.3183 0.0000 0.9091 0.4662 0.3596 184-DS 0.0810 0.1434 0.3849 0.7241 0.8302 0.4163 0.2785 0.5808 0.7492 0.6691 0.3152 0.2254 0.2404 0.0810 0.8302 0.4163 0.2785 185-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0000 0.0228 0.0284 0.0089 0.0125 0.0228 0.0284 1.4021 0.0002 0.0000 0.0114 0.0000 0.0284 0.0089 0.0125 187-DS 0.0582 0.0643 0.1115 0.1242 0.1552 0.1009 0.0361 0.0599 0.0969 0.3576 0.0947 0.0887 0.0319 0.0582 0.1552 0.1009 0.0361 188-DS 0.1869 0.5714 0.6018 0.6911 0.7613 0.5894 0.1473 0.1196 0.5744 0.2499 0.5634 0.5222 0.1012 0.4319 0.7613 0.6204 0.0946 189-DS 0.0000 0.0000 0.0520 0.1062 0.2979 0.0768 0.0814 0.1062 0.2979 1.0597 0.0066 0.0000 0.0602 0.0000 0.1543 0.0598 0.0528 190-DS 0.0000 0.5947 0.7991 0.8656 0.9249 0.6752 0.3040 0.2709 0.9249 0.4502 0.1560 0.0001 0.2204 0.5632 0.9249 0.7877 0.1117 191-DS 0.0000 0.0297 0.0487 0.0629 0.1759 0.0549 0.0452 0.0332 0.1759 0.8231 0.0161 0.0001 0.0301 0.0000 0.1098 0.0456 0.0300 192-DS 0.0000 0.0980 0.1331 0.5604 0.6327 0.2540 0.2366 0.4624 0.6327 0.9312 0.0526 0.0001 0.2061 0.0000 0.6327 0.2540 0.2366 193-DS 0.0000 0.0000 0.0650 0.2474 0.8777 0.2093 0.3044 0.2474 0.8777 1.4544 0.0018 0.0000 0.2263 0.0000 0.4577 0.1022 0.1478 194-DS 0.0000 0.0000 0.0717 0.2385 0.3795 0.1349 0.1336 0.2385 0.3795 0.9903 0.0097 0.0000 0.1154 0.0000 0.3795 0.1349 0.1336 195-DS 0.0000 0.3268 0.4215 0.4938 0.6000 0.3570 0.2080 0.1670 0.6000 0.5825 0.0450 0.0000 0.1617 0.3268 0.6000 0.4544 0.0869 196-DS 0.0000 0.1181 0.3826 0.4455 0.6081 0.3034 0.2094 0.3274 0.6081 0.6902 0.0674 0.0001 0.1845 0.0000 0.6081 0.3034 0.2094 197-DS 0.1706 0.3529 0.4762 0.6497 0.8487 0.4955 0.2185 0.2967 0.6781 0.4409 0.4450 0.3900 0.1767 0.1706 0.8487 0.4955 0.2185 198-DS 0.0000 0.4107 0.4835 0.5112 0.6441 0.4269 0.1956 0.1005 0.6441 0.4581 0.1052 0.0001 0.1308 0.3813 0.6441 0.4981 0.0809 199-DS 0.0000 0.0000 0.4454 0.5833 0.6338 0.3363 0.2678 0.5833 0.6338 0.7961 0.0201 0.0000 0.2464 0.0000 0.6338 0.3363 0.2678 200-DS 0.0000 0.0000 0.0000 0.0456 0.1786 0.0257 0.0511 0.0456 0.1786 1.9888 0.0001 0.0000 0.0367 0.0000 0.0708 0.0139 0.0270 127 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2DE-CLEF2007 Statistics for Precision at the 60% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.2547 0.8462 0.8852 0.3976 0.4100 0.8462 0.8852 1.0312 0.0055 0.0000 0.3816 0.0000 0.8852 0.3976 0.4100 177-DS 0.0000 0.0599 0.1227 0.1395 0.1803 0.1031 0.0564 0.0797 0.1803 0.5468 0.0298 0.0001 0.0448 0.0000 0.1803 0.1031 0.0564 178-DS 0.0000 0.0000 0.2308 0.5087 0.8317 0.3119 0.3230 0.5087 0.8317 1.0356 0.0092 0.0000 0.2708 0.0000 0.8317 0.3119 0.3230 179-DS 0.0000 0.3667 0.4464 0.4873 0.6333 0.3955 0.1851 0.1207 0.6333 0.4681 0.0982 0.0001 0.1287 0.3598 0.6333 0.4614 0.0856 180-DS 0.0000 0.1646 0.4723 0.6948 0.7387 0.4196 0.2952 0.5302 0.7387 0.7034 0.0474 0.0000 0.2534 0.0000 0.7387 0.4196 0.2952 181-DS 0.0000 0.2700 0.4984 0.6327 0.6585 0.4308 0.2213 0.3627 0.6585 0.5137 0.1827 0.0001 0.1788 0.0000 0.6585 0.4308 0.2213 182-DS 0.0000 0.3023 0.3617 0.6014 0.6602 0.3682 0.2361 0.2991 0.6602 0.6413 0.0452 0.0000 0.1848 0.0000 0.6602 0.3682 0.2361 183-DS 0.0000 0.0000 0.3970 0.7308 0.8482 0.3951 0.3471 0.7308 0.8482 0.8786 0.0211 0.0000 0.3080 0.0000 0.8482 0.3951 0.3471 184-DS 0.0725 0.0783 0.2894 0.6857 0.7424 0.3559 0.2642 0.6074 0.6699 0.7424 0.2542 0.1732 0.2256 0.0725 0.7424 0.3559 0.2642 185-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0000 0.0000 0.0262 0.0051 0.0101 0.0000 0.0262 1.9954 0.0001 0.0000 0.0080 0.0000 0.0000 0.0000 0.0000 187-DS 0.0501 0.0526 0.0936 0.1200 0.1269 0.0857 0.0323 0.0674 0.0768 0.3769 0.0798 0.0741 0.0290 0.0501 0.1269 0.0857 0.0323 188-DS 0.0000 0.4653 0.5072 0.6091 0.6401 0.4919 0.1642 0.1438 0.6401 0.3338 0.2406 0.0001 0.1073 0.3628 0.6401 0.5298 0.0866 189-DS 0.0000 0.0000 0.0471 0.1032 0.2286 0.0594 0.0693 0.1032 0.2286 1.1654 0.0018 0.0000 0.0545 0.0000 0.2286 0.0594 0.0693 190-DS 0.0000 0.4476 0.7252 0.8246 0.9082 0.6183 0.2992 0.3769 0.9082 0.4840 0.1426 0.0001 0.2319 0.0000 0.9082 0.6183 0.2992 191-DS 0.0000 0.0237 0.0366 0.0437 0.0767 0.0362 0.0210 0.0200 0.0767 0.5803 0.0122 0.0001 0.0142 0.0000 0.0657 0.0331 0.0182 192-DS 0.0000 0.0851 0.1063 0.4651 0.6327 0.2209 0.2253 0.3800 0.6327 1.0198 0.0246 0.0000 0.1921 0.0000 0.6327 0.2209 0.2253 193-DS 0.0000 0.0000 0.0000 0.1713 0.8150 0.1668 0.2677 0.1713 0.8150 1.6053 0.0008 0.0000 0.1932 0.0000 0.3679 0.0712 0.1182 194-DS 0.0000 0.0000 0.0000 0.1818 0.3540 0.0901 0.1173 0.1818 0.3540 1.3022 0.0007 0.0000 0.1029 0.0000 0.3540 0.0901 0.1173 195-DS 0.0000 0.2855 0.3345 0.4107 0.5359 0.2989 0.1770 0.1252 0.5359 0.5923 0.0391 0.0000 0.1319 0.2855 0.5359 0.3804 0.0814 196-DS 0.0000 0.0824 0.3069 0.3803 0.5045 0.2494 0.1833 0.2978 0.5045 0.7350 0.0309 0.0000 0.1608 0.0000 0.5045 0.2494 0.1833 197-DS 0.0000 0.2602 0.3568 0.4731 0.7563 0.3739 0.2327 0.2129 0.7563 0.6222 0.0888 0.0001 0.1741 0.0000 0.7563 0.3739 0.2327 198-DS 0.0000 0.2890 0.3851 0.4363 0.5847 0.3474 0.1679 0.1473 0.5847 0.4833 0.0874 0.0001 0.1181 0.2880 0.5847 0.4053 0.0878 199-DS 0.0000 0.0000 0.3504 0.5667 0.5882 0.3119 0.2588 0.5667 0.5882 0.8300 0.0186 0.0000 0.2329 0.0000 0.5882 0.3119 0.2588 200-DS 0.0000 0.0000 0.0000 0.0000 0.1445 0.0103 0.0386 0.0000 0.1445 3.7417 0.0000 0.0000 0.0192 0.0000 0.0000 0.0000 0.0000 128 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2DE-CLEF2007 Statistics for Precision at the 70% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.2085 0.8101 0.8228 0.3728 0.3913 0.8101 0.8228 1.0496 0.0052 0.0000 0.3665 0.0000 0.8228 0.3728 0.3913 177-DS 0.0000 0.0000 0.1021 0.1146 0.1393 0.0780 0.0551 0.1146 0.1393 0.7068 0.0075 0.0000 0.0470 0.0000 0.1393 0.0780 0.0551 178-DS 0.0000 0.0000 0.1728 0.3874 0.7576 0.2559 0.2977 0.3874 0.7576 1.1632 0.0041 0.0000 0.2431 0.0000 0.7576 0.2559 0.2977 179-DS 0.0000 0.3289 0.4139 0.4412 0.5112 0.3515 0.1612 0.1123 0.5112 0.4586 0.0890 0.0001 0.1133 0.3090 0.5112 0.4101 0.0671 180-DS 0.0000 0.0000 0.3502 0.5700 0.6042 0.3162 0.2631 0.5700 0.6042 0.8322 0.0102 0.0000 0.2278 0.0000 0.6042 0.3162 0.2631 181-DS 0.0000 0.2460 0.4667 0.5636 0.6327 0.3997 0.2098 0.3176 0.6327 0.5248 0.1692 0.0001 0.1718 0.0000 0.6327 0.3997 0.2098 182-DS 0.0000 0.2748 0.2978 0.5144 0.5881 0.3161 0.2032 0.2396 0.5881 0.6427 0.0401 0.0000 0.1563 0.0000 0.5881 0.3161 0.2032 183-DS 0.0000 0.0000 0.2582 0.6292 0.7534 0.3111 0.3131 0.6292 0.7534 1.0066 0.0049 0.0000 0.2817 0.0000 0.7534 0.3111 0.3131 184-DS 0.0000 0.0579 0.1943 0.5714 0.6154 0.2675 0.2288 0.5136 0.6154 0.8553 0.0558 0.0001 0.1916 0.0000 0.6154 0.2675 0.2288 185-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.0000 0.0701 0.1038 0.1189 0.0550 0.0513 0.1038 0.1189 0.9320 0.0019 0.0000 0.0472 0.0000 0.1189 0.0550 0.0513 188-DS 0.0000 0.3450 0.4198 0.5032 0.5402 0.4072 0.1397 0.1582 0.5402 0.3430 0.2014 0.0001 0.0938 0.3082 0.5402 0.4385 0.0791 189-DS 0.0000 0.0000 0.0201 0.0856 0.1721 0.0465 0.0573 0.0856 0.1721 1.2335 0.0009 0.0000 0.0473 0.0000 0.1721 0.0465 0.0573 190-DS 0.0000 0.3482 0.6712 0.7794 0.8295 0.5607 0.2881 0.4312 0.8295 0.5137 0.1290 0.0001 0.2304 0.0000 0.8295 0.5607 0.2881 191-DS 0.0000 0.0000 0.0291 0.0339 0.0564 0.0232 0.0194 0.0339 0.0564 0.8363 0.0019 0.0000 0.0166 0.0000 0.0564 0.0232 0.0194 192-DS 0.0000 0.0000 0.0924 0.3500 0.5426 0.1660 0.2007 0.3500 0.5426 1.2091 0.0031 0.0000 0.1674 0.0000 0.5426 0.1660 0.2007 193-DS 0.0000 0.0000 0.0000 0.0000 0.6600 0.1087 0.2275 0.0000 0.6600 2.0931 0.0001 0.0000 0.1708 0.0000 0.0000 0.0000 0.0000 194-DS 0.0000 0.0000 0.0000 0.1113 0.3096 0.0561 0.0917 0.1113 0.3096 1.6330 0.0003 0.0000 0.0722 0.0000 0.1391 0.0366 0.0578 195-DS 0.0000 0.0000 0.1457 0.3458 0.4648 0.1741 0.1858 0.3458 0.4648 1.0674 0.0019 0.0000 0.1741 0.0000 0.4648 0.1741 0.1858 196-DS 0.0000 0.0000 0.2467 0.3369 0.4444 0.1950 0.1574 0.3369 0.4444 0.8072 0.0136 0.0000 0.1382 0.0000 0.4444 0.1950 0.1574 197-DS 0.0000 0.1802 0.2761 0.3821 0.6558 0.2960 0.1980 0.2019 0.6558 0.6690 0.0713 0.0001 0.1468 0.0000 0.6558 0.2960 0.1980 198-DS 0.0000 0.2271 0.2812 0.3419 0.5063 0.2726 0.1401 0.1148 0.5063 0.5139 0.0704 0.0001 0.0979 0.2241 0.5063 0.3180 0.0862 199-DS 0.0000 0.0000 0.2859 0.5135 0.5614 0.2808 0.2416 0.5135 0.5614 0.8603 0.0168 0.0000 0.2133 0.0000 0.5614 0.2808 0.2416 200-DS 0.0000 0.0000 0.0000 0.0000 0.1026 0.0073 0.0274 0.0000 0.1026 3.7417 0.0000 0.0000 0.0136 0.0000 0.0000 0.0000 0.0000 129 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2DE-CLEF2007 Statistics for Precision at the 80% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.1579 0.7579 0.8000 0.3428 0.3688 0.7579 0.8000 1.0760 0.0049 0.0000 0.3466 0.0000 0.8000 0.3428 0.3688 177-DS 0.0000 0.0000 0.0926 0.1057 0.1218 0.0694 0.0487 0.1057 0.1218 0.7013 0.0069 0.0000 0.0413 0.0000 0.1218 0.0694 0.0487 178-DS 0.0000 0.0000 0.0000 0.2894 0.6890 0.1940 0.2724 0.2894 0.6890 1.4039 0.0009 0.0000 0.2218 0.0000 0.6890 0.1940 0.2724 179-DS 0.0000 0.3015 0.3633 0.4000 0.4591 0.3181 0.1441 0.0985 0.4591 0.4530 0.0818 0.0001 0.0967 0.2986 0.4591 0.3711 0.0554 180-DS 0.0000 0.0000 0.2364 0.4118 0.4404 0.2219 0.1876 0.4118 0.4404 0.8454 0.0081 0.0000 0.1591 0.0000 0.4404 0.2219 0.1876 181-DS 0.0000 0.1259 0.3103 0.4022 0.4615 0.2770 0.1614 0.2763 0.4615 0.5826 0.0674 0.0001 0.1285 0.0000 0.4615 0.2770 0.1614 182-DS 0.0000 0.2261 0.2609 0.4121 0.4809 0.2659 0.1694 0.1860 0.4809 0.6372 0.0351 0.0000 0.1284 0.0000 0.4809 0.2659 0.1694 183-DS 0.0000 0.0000 0.1425 0.4360 0.5676 0.2140 0.2287 0.4360 0.5676 1.0687 0.0038 0.0000 0.2038 0.0000 0.5676 0.2140 0.2287 184-DS 0.0000 0.0000 0.1443 0.3879 0.5246 0.1984 0.2029 0.3879 0.5246 1.0228 0.0127 0.0000 0.1671 0.0000 0.5246 0.1984 0.2029 185-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.0000 0.0298 0.0781 0.1080 0.0411 0.0442 0.0781 0.1080 1.0744 0.0009 0.0000 0.0411 0.0000 0.1080 0.0411 0.0442 188-DS 0.0000 0.2688 0.3377 0.4067 0.4760 0.3113 0.1474 0.1379 0.4760 0.4735 0.0798 0.0001 0.1066 0.2688 0.4760 0.3632 0.0716 189-DS 0.0000 0.0000 0.0000 0.0717 0.1273 0.0364 0.0482 0.0717 0.1273 1.3247 0.0005 0.0000 0.0416 0.0000 0.1273 0.0364 0.0482 190-DS 0.0000 0.2781 0.6396 0.7031 0.7716 0.4874 0.2955 0.4249 0.7716 0.6064 0.0567 0.0000 0.2480 0.0000 0.7716 0.4874 0.2955 191-DS 0.0000 0.0000 0.0000 0.0000 0.0363 0.0069 0.0138 0.0000 0.0363 1.9973 0.0001 0.0000 0.0109 0.0000 0.0000 0.0000 0.0000 192-DS 0.0000 0.0000 0.0000 0.2963 0.4000 0.1115 0.1513 0.2963 0.4000 1.3571 0.0007 0.0000 0.1274 0.0000 0.4000 0.1115 0.1513 193-DS 0.0000 0.0000 0.0000 0.0000 0.5465 0.0870 0.1837 0.0000 0.5465 2.1121 0.0001 0.0000 0.1367 0.0000 0.0000 0.0000 0.0000 194-DS 0.0000 0.0000 0.0000 0.0000 0.2526 0.0343 0.0751 0.0000 0.2526 2.1887 0.0001 0.0000 0.0539 0.0000 0.0000 0.0000 0.0000 195-DS 0.0000 0.0000 0.0000 0.0000 0.3679 0.0505 0.1284 0.0000 0.3679 2.5445 0.0000 0.0000 0.0865 0.0000 0.0000 0.0000 0.0000 196-DS 0.0000 0.0000 0.1784 0.2432 0.3682 0.1486 0.1317 0.2432 0.3682 0.8866 0.0061 0.0000 0.1159 0.0000 0.3682 0.1486 0.1317 197-DS 0.0000 0.0000 0.2010 0.2368 0.4387 0.1936 0.1553 0.2368 0.4387 0.8020 0.0140 0.0000 0.1154 0.0000 0.4387 0.1936 0.1553 198-DS 0.0000 0.0000 0.2132 0.2411 0.3758 0.1619 0.1328 0.2411 0.3758 0.8208 0.0067 0.0000 0.1156 0.0000 0.3758 0.1619 0.1328 199-DS 0.0000 0.0000 0.1633 0.4643 0.5328 0.2337 0.2299 0.4643 0.5328 0.9839 0.0076 0.0000 0.2109 0.0000 0.5328 0.2337 0.2299 200-DS 0.0000 0.0000 0.0000 0.0000 0.0703 0.0050 0.0188 0.0000 0.0703 3.7417 0.0000 0.0000 0.0093 0.0000 0.0000 0.0000 0.0000 130 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2DE-CLEF2007 Statistics for Precision at the 90% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.6279 0.7105 0.2730 0.3298 0.6279 0.7105 1.2080 0.0011 0.0000 0.3120 0.0000 0.7105 0.2730 0.3298 177-DS 0.0000 0.0000 0.0000 0.0660 0.0913 0.0327 0.0399 0.0660 0.0913 1.2214 0.0005 0.0000 0.0373 0.0000 0.0913 0.0327 0.0399 178-DS 0.0000 0.0000 0.0000 0.1921 0.5228 0.1296 0.2062 0.1921 0.5228 1.5909 0.0004 0.0000 0.1667 0.0000 0.4549 0.0660 0.1390 179-DS 0.0000 0.2298 0.2862 0.3220 0.3654 0.2496 0.1141 0.0922 0.3654 0.4572 0.0664 0.0001 0.0803 0.2080 0.3654 0.2912 0.0466 180-DS 0.0000 0.0000 0.0000 0.2831 0.3165 0.1023 0.1433 0.2831 0.3165 1.4012 0.0004 0.0000 0.1315 0.0000 0.3165 0.1023 0.1433 181-DS 0.0000 0.0567 0.1455 0.3670 0.4255 0.1931 0.1587 0.3102 0.4255 0.8219 0.0433 0.0001 0.1381 0.0000 0.4255 0.1931 0.1587 182-DS 0.0000 0.0000 0.0000 0.2959 0.3410 0.1128 0.1577 0.2959 0.3410 1.3980 0.0004 0.0000 0.1450 0.0000 0.3410 0.1128 0.1577 183-DS 0.0000 0.0000 0.0000 0.2085 0.2880 0.1002 0.1244 0.2085 0.2880 1.2417 0.0007 0.0000 0.1145 0.0000 0.2880 0.1002 0.1244 184-DS 0.0000 0.0000 0.0000 0.3200 0.3789 0.1167 0.1618 0.3200 0.3789 1.3862 0.0007 0.0000 0.1368 0.0000 0.3789 0.1167 0.1618 185-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.0000 0.0000 0.0000 0.0762 0.0104 0.0264 0.0000 0.0762 2.5456 0.0000 0.0000 0.0178 0.0000 0.0000 0.0000 0.0000 188-DS 0.0000 0.0000 0.0000 0.0000 0.3272 0.0682 0.1356 0.0000 0.3272 1.9879 0.0001 0.0000 0.1072 0.0000 0.0000 0.0000 0.0000 189-DS 0.0000 0.0000 0.0000 0.0619 0.1205 0.0255 0.0440 0.0619 0.1205 1.7294 0.0001 0.0000 0.0364 0.0000 0.1205 0.0255 0.0440 190-DS 0.0000 0.0000 0.5520 0.5945 0.6787 0.4005 0.2786 0.5945 0.6787 0.6957 0.0243 0.0000 0.2435 0.0000 0.6787 0.4005 0.2786 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0000 0.0000 0.0000 0.1741 0.2406 0.0554 0.0921 0.1741 0.2406 1.6636 0.0002 0.0000 0.0791 0.0000 0.2406 0.0554 0.0921 193-DS 0.0000 0.0000 0.0000 0.0000 0.3323 0.0443 0.1130 0.0000 0.3323 2.5495 0.0000 0.0000 0.0760 0.0000 0.0000 0.0000 0.0000 194-DS 0.0000 0.0000 0.0000 0.0000 0.1546 0.0110 0.0413 0.0000 0.1546 3.7417 0.0000 0.0000 0.0205 0.0000 0.0000 0.0000 0.0000 195-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 196-DS 0.0000 0.0000 0.0491 0.1573 0.3227 0.0858 0.1049 0.1573 0.3227 1.2227 0.0013 0.0000 0.0858 0.0000 0.3227 0.0858 0.1049 197-DS 0.0000 0.0000 0.0000 0.0000 0.3364 0.0639 0.1279 0.0000 0.3364 2.0013 0.0001 0.0000 0.1004 0.0000 0.0000 0.0000 0.0000 198-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 199-DS 0.0000 0.0000 0.0000 0.3510 0.4066 0.1590 0.1916 0.3510 0.4066 1.2049 0.0009 0.0000 0.1817 0.0000 0.4066 0.1590 0.1916 200-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 131 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2DE-CLEF2007 Statistics for Precision at the 100% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 177-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 180-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 181-DS 0.0000 0.0000 0.0000 0.1011 0.2933 0.0481 0.0897 0.1011 0.2933 1.8634 0.0002 0.0000 0.0687 0.0000 0.1686 0.0293 0.0576 182-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 183-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 184-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 185-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 188-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 189-DS 0.0000 0.0000 0.0000 0.0000 0.0592 0.0042 0.0158 0.0000 0.0592 3.7417 0.0000 0.0000 0.0078 0.0000 0.0000 0.0000 0.0000 190-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 193-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 194-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 195-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 196-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 197-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 198-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 199-DS 0.0000 0.0000 0.0000 0.2288 0.2755 0.0930 0.1163 0.2288 0.2755 1.2508 0.0007 0.0000 0.1063 0.0000 0.2755 0.0930 0.1163 200-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 132 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2DE-CLEF2007 Statistics for P@5 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 1.0000 1.0000 1.0000 0.6429 0.4718 1.0000 1.0000 0.7340 0.0327 0.0000 0.4306 0.0000 1.0000 0.6429 0.4718 177-DS 0.0000 0.0000 0.2000 0.4000 0.4000 0.1857 0.1657 0.4000 0.4000 0.8925 0.0071 0.0000 0.1327 0.0000 0.4000 0.1857 0.1657 178-DS 0.0000 0.0000 0.7000 1.0000 1.0000 0.5571 0.4519 1.0000 1.0000 0.8110 0.0147 0.0000 0.3980 0.0000 1.0000 0.5571 0.4519 179-DS 0.0000 0.6000 0.8000 0.8000 1.0000 0.6714 0.3197 0.2000 1.0000 0.4761 0.1541 0.0001 0.2327 0.6000 1.0000 0.7833 0.1586 180-DS 0.0000 0.4000 1.0000 1.0000 1.0000 0.7143 0.4204 0.6000 1.0000 0.5885 0.0770 0.0000 0.3510 0.0000 1.0000 0.7143 0.4204 181-DS 0.2000 0.8000 1.0000 1.0000 1.0000 0.8429 0.2954 0.2000 0.8000 0.3505 0.7540 0.6109 0.2245 0.6000 1.0000 0.9500 0.1243 182-DS 0.2000 0.6000 1.0000 1.0000 1.0000 0.8143 0.2656 0.4000 0.8000 0.3262 0.7518 0.6563 0.2122 0.2000 1.0000 0.8143 0.2656 183-DS 0.2000 0.2000 0.9000 1.0000 1.0000 0.6714 0.3730 0.8000 0.8000 0.5555 0.5452 0.4211 0.3469 0.2000 1.0000 0.6714 0.3730 184-DS 0.0000 0.4000 1.0000 1.0000 1.0000 0.7714 0.3911 0.6000 1.0000 0.5070 0.1694 0.0001 0.3265 0.0000 1.0000 0.7714 0.3911 185-DS 0.0000 0.0000 0.0000 0.2000 0.6000 0.1286 0.1858 0.2000 0.6000 1.4448 0.0008 0.0000 0.1469 0.0000 0.4000 0.0923 0.1320 186-DS 0.0000 0.0000 0.0000 0.0000 0.2000 0.0286 0.0726 0.0000 0.2000 2.5420 0.0000 0.0000 0.0490 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.2000 0.2000 0.2000 0.6000 0.2143 0.1657 0.0000 0.6000 0.7735 0.0286 0.0000 0.1082 0.2000 0.2000 0.2000 0.0000 188-DS 0.2000 0.8000 1.0000 1.0000 1.0000 0.9000 0.2184 0.2000 0.8000 0.2427 0.8498 0.7467 0.1429 0.8000 1.0000 0.9538 0.0877 189-DS 0.0000 0.0000 0.0000 0.2000 0.6000 0.1286 0.1858 0.2000 0.6000 1.4448 0.0008 0.0000 0.1469 0.0000 0.4000 0.0923 0.1320 190-DS 0.6000 0.8000 1.0000 1.0000 1.0000 0.9143 0.1292 0.2000 0.4000 0.1414 0.9046 0.8936 0.1102 0.6000 1.0000 0.9143 0.1292 191-DS 0.0000 0.0000 0.2000 0.4000 0.6000 0.2286 0.2054 0.4000 0.6000 0.8987 0.0081 0.0000 0.1755 0.0000 0.6000 0.2286 0.2054 192-DS 0.0000 0.6000 0.8000 1.0000 1.0000 0.7000 0.3573 0.4000 1.0000 0.5105 0.1570 0.0001 0.2857 0.4000 1.0000 0.8167 0.2167 193-DS 0.4000 0.6000 0.8000 0.8000 1.0000 0.7429 0.1828 0.2000 0.6000 0.2460 0.7207 0.6971 0.1510 0.4000 1.0000 0.7429 0.1828 194-DS 0.0000 0.0000 0.1000 0.6000 0.8000 0.2714 0.3099 0.6000 0.8000 1.1418 0.0022 0.0000 0.2816 0.0000 0.8000 0.2714 0.3099 195-DS 0.0000 0.6000 0.8000 1.0000 1.0000 0.7286 0.3384 0.4000 1.0000 0.4645 0.1657 0.0001 0.2449 0.6000 1.0000 0.8500 0.1508 196-DS 0.0000 0.2000 0.4000 0.8000 1.0000 0.4714 0.3292 0.6000 1.0000 0.6982 0.1033 0.0001 0.2633 0.0000 1.0000 0.4714 0.3292 197-DS 0.4000 0.6000 1.0000 1.0000 1.0000 0.8429 0.2102 0.4000 0.6000 0.2494 0.8132 0.7778 0.1796 0.4000 1.0000 0.8429 0.2102 198-DS 0.2000 0.8000 1.0000 1.0000 1.0000 0.8286 0.2920 0.2000 0.8000 0.3524 0.7421 0.6043 0.2204 0.6000 1.0000 0.9333 0.1303 199-DS 0.0000 0.0000 0.8000 0.8000 1.0000 0.5857 0.4036 0.8000 1.0000 0.6890 0.0320 0.0000 0.3347 0.0000 1.0000 0.5857 0.4036 200-DS 0.0000 0.0000 0.0000 0.2000 0.8000 0.1143 0.2179 0.2000 0.8000 1.9065 0.0004 0.0000 0.1469 0.0000 0.2000 0.0615 0.0961 133 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2DE-CLEF2007 Statistics for P@10 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.2000 0.9000 1.0000 1.0000 0.6429 0.4183 0.8000 1.0000 0.6506 0.1277 0.0001 0.3735 0.0000 1.0000 0.6429 0.4183 177-DS 0.0000 0.1000 0.2000 0.3000 0.5000 0.2214 0.1578 0.2000 0.5000 0.7125 0.0543 0.0001 0.1163 0.0000 0.5000 0.2214 0.1578 178-DS 0.0000 0.0000 0.6500 0.9000 1.0000 0.5214 0.4282 0.9000 1.0000 0.8212 0.0141 0.0000 0.3786 0.0000 1.0000 0.5214 0.4282 179-DS 0.0000 0.6000 0.7000 0.8000 0.8000 0.6143 0.2713 0.2000 0.8000 0.4417 0.1443 0.0001 0.1816 0.6000 0.8000 0.7167 0.0835 180-DS 0.0000 0.4000 1.0000 1.0000 1.0000 0.7143 0.4111 0.6000 1.0000 0.5756 0.1468 0.0001 0.3531 0.0000 1.0000 0.7143 0.4111 181-DS 0.2000 0.8000 0.9000 0.9000 0.9000 0.7714 0.2301 0.1000 0.7000 0.2983 0.7157 0.6250 0.1592 0.7000 0.9000 0.8583 0.0669 182-DS 0.1000 0.6000 0.7500 0.9000 1.0000 0.7000 0.2828 0.3000 0.9000 0.4041 0.6067 0.4529 0.2143 0.2000 1.0000 0.7462 0.2332 183-DS 0.2000 0.5000 0.9000 1.0000 1.0000 0.7143 0.3134 0.5000 0.8000 0.4388 0.6272 0.5217 0.2837 0.2000 1.0000 0.7143 0.3134 184-DS 0.0000 0.5000 0.9000 1.0000 1.0000 0.7143 0.3613 0.5000 1.0000 0.5058 0.1601 0.0001 0.2980 0.0000 1.0000 0.7143 0.3613 185-DS 0.0000 0.0000 0.0500 0.2000 0.3000 0.0929 0.1141 0.2000 0.3000 1.2289 0.0013 0.0000 0.0929 0.0000 0.3000 0.0929 0.1141 186-DS 0.0000 0.0000 0.0000 0.0000 0.1000 0.0214 0.0426 0.0000 0.1000 1.9871 0.0001 0.0000 0.0337 0.0000 0.0000 0.0000 0.0000 187-DS 0.1000 0.1000 0.1500 0.3000 0.4000 0.2000 0.1177 0.2000 0.3000 0.5883 0.1703 0.1474 0.1000 0.1000 0.4000 0.2000 0.1177 188-DS 0.2000 0.8000 0.9500 1.0000 1.0000 0.8714 0.2164 0.2000 0.8000 0.2483 0.8229 0.7268 0.1408 0.7000 1.0000 0.9231 0.1013 189-DS 0.0000 0.1000 0.1000 0.2000 0.5000 0.1500 0.1401 0.1000 0.5000 0.9337 0.0201 0.0000 0.1071 0.0000 0.3000 0.1231 0.1013 190-DS 0.5000 0.8000 0.9000 1.0000 1.0000 0.8643 0.1692 0.2000 0.5000 0.1958 0.8449 0.8208 0.1224 0.8000 1.0000 0.9250 0.0754 191-DS 0.0000 0.1000 0.2000 0.2000 0.6000 0.2214 0.1888 0.1000 0.6000 0.8528 0.0281 0.0000 0.1337 0.0000 0.2000 0.1364 0.0924 192-DS 0.0000 0.4000 0.7000 1.0000 1.0000 0.6357 0.3586 0.6000 1.0000 0.5642 0.1413 0.0001 0.3020 0.0000 1.0000 0.6357 0.3586 193-DS 0.5000 0.6000 0.7000 0.8000 1.0000 0.7071 0.1730 0.2000 0.5000 0.2447 0.6881 0.6700 0.1378 0.5000 1.0000 0.7071 0.1730 194-DS 0.0000 0.0000 0.2000 0.6000 0.6000 0.2643 0.2818 0.6000 0.6000 1.0662 0.0023 0.0000 0.2643 0.0000 0.6000 0.2643 0.2818 195-DS 0.0000 0.6000 0.8500 0.9000 1.0000 0.7143 0.3325 0.3000 1.0000 0.4655 0.1629 0.0001 0.2408 0.6000 1.0000 0.8333 0.1497 196-DS 0.0000 0.3000 0.3000 0.7000 1.0000 0.4500 0.3156 0.4000 1.0000 0.7014 0.1005 0.0001 0.2571 0.0000 1.0000 0.4500 0.3156 197-DS 0.5000 0.5000 0.7000 1.0000 1.0000 0.7714 0.2199 0.5000 0.5000 0.2850 0.7409 0.7101 0.1959 0.5000 1.0000 0.7714 0.2199 198-DS 0.4000 0.8000 0.9000 1.0000 1.0000 0.8286 0.2016 0.2000 0.6000 0.2434 0.7978 0.7574 0.1490 0.7000 1.0000 0.9000 0.0953 199-DS 0.0000 0.0000 0.8500 0.9000 1.0000 0.5929 0.4178 0.9000 1.0000 0.7047 0.0320 0.0000 0.3653 0.0000 1.0000 0.5929 0.4178 200-DS 0.0000 0.0000 0.0500 0.1000 0.4000 0.0857 0.1167 0.1000 0.4000 1.3619 0.0012 0.0000 0.0857 0.0000 0.2000 0.0615 0.0768 134 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2DE-CLEF2007 Statistics for P@15 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.1333 0.8667 0.9333 1.0000 0.6048 0.4147 0.8000 1.0000 0.6857 0.1185 0.0001 0.3755 0.0000 1.0000 0.6048 0.4147 177-DS 0.0000 0.1333 0.2000 0.3333 0.4000 0.2238 0.1374 0.2000 0.4000 0.6139 0.0568 0.0001 0.1129 0.0000 0.4000 0.2238 0.1374 178-DS 0.0000 0.0667 0.7000 0.8667 0.9333 0.5286 0.4012 0.8000 0.9333 0.7591 0.0498 0.0000 0.3585 0.0000 0.9333 0.5286 0.4012 179-DS 0.0667 0.6000 0.6667 0.7333 0.8000 0.6000 0.2353 0.1333 0.7333 0.3922 0.4912 0.2941 0.1619 0.5333 0.8000 0.6889 0.0715 180-DS 0.0667 0.4000 0.9000 1.0000 1.0000 0.7000 0.3796 0.6000 0.9333 0.5423 0.5106 0.2726 0.3286 0.0667 1.0000 0.7000 0.3796 181-DS 0.3333 0.6667 0.8000 0.8667 0.9333 0.7429 0.1901 0.2000 0.6000 0.2559 0.7111 0.6681 0.1401 0.6667 0.9333 0.8111 0.0845 182-DS 0.0667 0.6000 0.7333 0.9333 1.0000 0.7000 0.2625 0.3333 0.9333 0.3750 0.6095 0.4152 0.2143 0.4000 1.0000 0.7487 0.1966 183-DS 0.1333 0.3333 0.9333 1.0000 1.0000 0.6905 0.3475 0.6667 0.8667 0.5033 0.5690 0.4204 0.3156 0.1333 1.0000 0.6905 0.3475 184-DS 0.1333 0.4667 0.8000 0.9333 1.0000 0.6667 0.3116 0.4667 0.8667 0.4674 0.5638 0.4270 0.2762 0.1333 1.0000 0.6667 0.3116 185-DS 0.0000 0.0000 0.0333 0.1333 0.2000 0.0667 0.0784 0.1333 0.2000 1.1767 0.0011 0.0000 0.0667 0.0000 0.2000 0.0667 0.0784 186-DS 0.0000 0.0000 0.0333 0.0667 0.1333 0.0381 0.0431 0.0667 0.1333 1.1309 0.0009 0.0000 0.0381 0.0000 0.1333 0.0381 0.0431 187-DS 0.0667 0.1333 0.1667 0.2667 0.3333 0.1762 0.0852 0.1333 0.2667 0.4834 0.1553 0.1343 0.0714 0.0667 0.3333 0.1762 0.0852 188-DS 0.2667 0.8000 0.9333 1.0000 1.0000 0.8524 0.1960 0.2000 0.7333 0.2299 0.8178 0.7592 0.1327 0.6667 1.0000 0.8974 0.1040 189-DS 0.0000 0.0667 0.0667 0.2000 0.5333 0.1286 0.1395 0.1333 0.5333 1.0851 0.0298 0.0001 0.0986 0.0000 0.2667 0.0974 0.0799 190-DS 0.3333 0.8667 0.9000 0.9333 1.0000 0.8333 0.2055 0.0667 0.6667 0.2466 0.7982 0.7478 0.1381 0.8000 1.0000 0.9111 0.0592 191-DS 0.0000 0.0667 0.1333 0.2667 0.4667 0.1714 0.1401 0.2000 0.4667 0.8174 0.0230 0.0000 0.1102 0.0000 0.4667 0.1714 0.1401 192-DS 0.0000 0.4000 0.6667 0.8667 1.0000 0.5762 0.3385 0.4667 1.0000 0.5875 0.1284 0.0001 0.2844 0.0000 1.0000 0.5762 0.3385 193-DS 0.3333 0.5333 0.6667 0.8000 1.0000 0.6619 0.2132 0.2667 0.6667 0.3221 0.6294 0.5969 0.1673 0.3333 1.0000 0.6619 0.2132 194-DS 0.0000 0.0000 0.1667 0.5333 0.6000 0.2429 0.2543 0.5333 0.6000 1.0473 0.0040 0.0000 0.2333 0.0000 0.6000 0.2429 0.2543 195-DS 0.0000 0.5333 0.8000 0.9333 1.0000 0.6905 0.3395 0.4000 1.0000 0.4917 0.1565 0.0001 0.2585 0.0000 1.0000 0.6905 0.3395 196-DS 0.0000 0.2667 0.4000 0.5333 0.9333 0.4333 0.2909 0.2667 0.9333 0.6713 0.0991 0.0001 0.2143 0.0000 0.9333 0.4333 0.2909 197-DS 0.4667 0.5333 0.7333 1.0000 1.0000 0.7667 0.2246 0.4667 0.5333 0.2929 0.7346 0.7025 0.2000 0.4667 1.0000 0.7667 0.2246 198-DS 0.2667 0.7333 0.8667 0.9333 1.0000 0.7762 0.2391 0.2000 0.7333 0.3080 0.7230 0.6454 0.1769 0.6000 1.0000 0.8611 0.1118 199-DS 0.0000 0.0000 0.8667 0.8667 0.9333 0.5476 0.4069 0.8667 0.9333 0.7431 0.0295 0.0000 0.3741 0.0000 0.9333 0.5476 0.4069 200-DS 0.0000 0.0000 0.0667 0.1333 0.2667 0.0762 0.0821 0.1333 0.2667 1.0775 0.0038 0.0000 0.0612 0.0000 0.2667 0.0762 0.0821 135 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2DE-CLEF2007 Statistics for P@20 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.1000 0.8750 0.9500 1.0000 0.6000 0.4297 0.8500 1.0000 0.7161 0.1116 0.0001 0.3929 0.0000 1.0000 0.6000 0.4297 177-DS 0.0000 0.1500 0.2250 0.3000 0.4500 0.2179 0.1219 0.1500 0.4500 0.5593 0.1013 0.0001 0.0964 0.0000 0.4500 0.2179 0.1219 178-DS 0.0000 0.0500 0.6500 0.9000 0.9000 0.5179 0.3964 0.8500 0.9000 0.7655 0.0474 0.0000 0.3556 0.0000 0.9000 0.5179 0.3964 179-DS 0.0500 0.6000 0.6250 0.7500 0.8000 0.5786 0.2392 0.1500 0.7500 0.4134 0.4570 0.2400 0.1622 0.5000 0.8000 0.6667 0.0913 180-DS 0.0500 0.4500 0.8250 1.0000 1.0000 0.6929 0.3652 0.5500 0.9500 0.5272 0.5017 0.2382 0.3092 0.0500 1.0000 0.6929 0.3652 181-DS 0.2500 0.6000 0.7000 0.7500 0.8000 0.6464 0.1834 0.1500 0.5500 0.2837 0.6102 0.5587 0.1337 0.5500 0.8000 0.7125 0.0801 182-DS 0.1000 0.5500 0.6750 0.8500 0.9500 0.6750 0.2310 0.3000 0.8500 0.3422 0.6096 0.4815 0.1821 0.1000 0.9500 0.6750 0.2310 183-DS 0.1000 0.3000 0.8750 0.9500 1.0000 0.6607 0.3515 0.6500 0.9000 0.5320 0.5236 0.3540 0.3163 0.1000 1.0000 0.6607 0.3515 184-DS 0.1500 0.3500 0.7250 0.9000 0.9500 0.6393 0.2995 0.5500 0.8000 0.4684 0.5469 0.4326 0.2622 0.1500 0.9500 0.6393 0.2995 185-DS 0.0000 0.0000 0.0500 0.1500 0.2000 0.0679 0.0750 0.1500 0.2000 1.1046 0.0020 0.0000 0.0658 0.0000 0.2000 0.0679 0.0750 186-DS 0.0000 0.0000 0.0250 0.0500 0.1000 0.0286 0.0323 0.0500 0.1000 1.1309 0.0007 0.0000 0.0286 0.0000 0.1000 0.0286 0.0323 187-DS 0.1000 0.1000 0.1500 0.2500 0.3500 0.1786 0.0802 0.1500 0.2500 0.4490 0.1638 0.1513 0.0653 0.1000 0.3500 0.1786 0.0802 188-DS 0.3000 0.8000 0.9000 0.9500 1.0000 0.8464 0.1770 0.1500 0.7000 0.2091 0.8188 0.7735 0.1122 0.7000 1.0000 0.8885 0.0845 189-DS 0.0000 0.0500 0.0500 0.1500 0.4500 0.1250 0.1355 0.1000 0.4500 1.0842 0.0275 0.0001 0.1036 0.0000 0.2500 0.0792 0.0722 190-DS 0.3500 0.8500 0.9000 0.9000 1.0000 0.8179 0.2034 0.0500 0.6500 0.2487 0.7823 0.7312 0.1362 0.8000 0.9500 0.8864 0.0393 191-DS 0.0000 0.0500 0.1500 0.2500 0.4000 0.1571 0.1107 0.2000 0.4000 0.7044 0.0702 0.0001 0.0816 0.0000 0.4000 0.1571 0.1107 192-DS 0.0000 0.3000 0.5500 0.7500 0.9000 0.5071 0.3050 0.4500 0.9000 0.6014 0.1140 0.0001 0.2490 0.0000 0.9000 0.5071 0.3050 193-DS 0.3000 0.5000 0.6500 0.8500 1.0000 0.6607 0.2141 0.3500 0.7000 0.3240 0.6271 0.5923 0.1694 0.3000 1.0000 0.6607 0.2141 194-DS 0.0000 0.0000 0.1750 0.5500 0.6000 0.2536 0.2523 0.5500 0.6000 0.9949 0.0135 0.0000 0.2321 0.0000 0.6000 0.2536 0.2523 195-DS 0.0000 0.5500 0.8000 0.9500 1.0000 0.6964 0.3388 0.4000 1.0000 0.4865 0.1581 0.0001 0.2546 0.0000 1.0000 0.6964 0.3388 196-DS 0.0000 0.3000 0.4750 0.6000 0.9500 0.4536 0.2749 0.3000 0.9500 0.6061 0.1049 0.0001 0.2036 0.0000 0.9500 0.4536 0.2749 197-DS 0.5000 0.5500 0.7250 1.0000 1.0000 0.7679 0.2118 0.4500 0.5000 0.2758 0.7402 0.7133 0.1918 0.5000 1.0000 0.7679 0.2118 198-DS 0.2000 0.7000 0.8500 0.9000 1.0000 0.7464 0.2500 0.2000 0.8000 0.3349 0.6783 0.5704 0.1832 0.6500 1.0000 0.8375 0.1025 199-DS 0.0000 0.0000 0.7750 0.8000 0.9000 0.5071 0.3912 0.8000 0.9000 0.7713 0.0274 0.0000 0.3633 0.0000 0.9000 0.5071 0.3912 200-DS 0.0000 0.0000 0.0500 0.1000 0.3000 0.0857 0.0929 0.1000 0.3000 1.0836 0.0070 0.0000 0.0694 0.0000 0.2500 0.0692 0.0723 136 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2DE-CLEF2007 Statistics for P@30 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0667 0.8333 0.9000 0.9667 0.5619 0.4198 0.8333 0.9667 0.7471 0.0986 0.0001 0.3864 0.0000 0.9667 0.5619 0.4198 177-DS 0.0667 0.1333 0.2500 0.2667 0.3667 0.2167 0.0913 0.1333 0.3000 0.4213 0.1925 0.1630 0.0738 0.0667 0.3667 0.2167 0.0913 178-DS 0.0000 0.0333 0.5333 0.8333 0.9333 0.4690 0.3731 0.8000 0.9333 0.7955 0.0740 0.0001 0.3207 0.0000 0.9333 0.4690 0.3731 179-DS 0.0333 0.4667 0.5333 0.6667 0.8000 0.5167 0.2271 0.2000 0.7667 0.4396 0.3906 0.1735 0.1548 0.4667 0.8000 0.5972 0.1068 180-DS 0.0333 0.4667 0.8167 0.9667 1.0000 0.6690 0.3575 0.5000 0.9667 0.5343 0.4616 0.1768 0.3017 0.0333 1.0000 0.6690 0.3575 181-DS 0.2000 0.5333 0.6000 0.6667 0.7333 0.5643 0.1707 0.1333 0.5333 0.3025 0.5278 0.4748 0.1177 0.5000 0.7333 0.6250 0.0793 182-DS 0.0667 0.6000 0.6667 0.8333 0.9667 0.6690 0.2270 0.2333 0.9000 0.3393 0.5915 0.4114 0.1643 0.4333 0.9667 0.7154 0.1525 183-DS 0.0667 0.2000 0.8667 0.9333 1.0000 0.6429 0.3713 0.7333 0.9333 0.5776 0.4687 0.2656 0.3272 0.0667 1.0000 0.6429 0.3713 184-DS 0.1333 0.3000 0.6000 0.8333 0.8667 0.5619 0.2717 0.5333 0.7333 0.4835 0.4786 0.3790 0.2340 0.1333 0.8667 0.5619 0.2717 185-DS 0.0000 0.0000 0.0333 0.1000 0.1333 0.0524 0.0550 0.1000 0.1333 1.0505 0.0017 0.0000 0.0503 0.0000 0.1333 0.0524 0.0550 186-DS 0.0000 0.0000 0.0333 0.0333 0.1000 0.0238 0.0275 0.0333 0.1000 1.1556 0.0011 0.0000 0.0204 0.0000 0.0333 0.0179 0.0173 187-DS 0.0667 0.1000 0.1667 0.2000 0.2667 0.1571 0.0633 0.1000 0.2000 0.4027 0.1445 0.1315 0.0490 0.0667 0.2667 0.1571 0.0633 188-DS 0.4333 0.8667 0.9000 0.9333 1.0000 0.8667 0.1432 0.0667 0.5667 0.1653 0.8516 0.8307 0.0857 0.8667 1.0000 0.9167 0.0438 189-DS 0.0000 0.0333 0.1000 0.2000 0.3667 0.1310 0.1237 0.1667 0.3667 0.9444 0.0300 0.0001 0.0969 0.0000 0.3667 0.1310 0.1237 190-DS 0.2333 0.8333 0.8667 0.9333 0.9667 0.7976 0.2434 0.1000 0.7333 0.3051 0.7354 0.6344 0.1612 0.8000 0.9667 0.8917 0.0495 191-DS 0.0333 0.0667 0.1333 0.1667 0.3333 0.1405 0.0879 0.1000 0.3000 0.6256 0.1119 0.0837 0.0653 0.0333 0.2667 0.1256 0.0709 192-DS 0.0000 0.3000 0.4333 0.7667 0.9000 0.4643 0.2988 0.4667 0.9000 0.6437 0.1045 0.0001 0.2401 0.0000 0.9000 0.4643 0.2988 193-DS 0.3000 0.4667 0.5667 0.7667 1.0000 0.6143 0.2131 0.3000 0.7000 0.3469 0.5809 0.5492 0.1735 0.3000 1.0000 0.6143 0.2131 194-DS 0.0000 0.0333 0.1667 0.4667 0.6000 0.2310 0.2240 0.4333 0.6000 0.9698 0.0230 0.0000 0.2024 0.0000 0.6000 0.2310 0.2240 195-DS 0.0000 0.5667 0.8000 0.9000 0.9667 0.6690 0.3220 0.3333 0.9667 0.4812 0.1531 0.0001 0.2449 0.5000 0.9667 0.7806 0.1660 196-DS 0.0000 0.3333 0.4667 0.5333 0.8333 0.4381 0.2396 0.2000 0.8333 0.5469 0.1045 0.0001 0.1707 0.3000 0.8333 0.5111 0.1647 197-DS 0.5333 0.5667 0.7667 1.0000 1.0000 0.7762 0.2040 0.4333 0.4667 0.2628 0.7507 0.7257 0.1823 0.5333 1.0000 0.7762 0.2040 198-DS 0.2667 0.6667 0.8167 0.8333 0.9333 0.7262 0.2080 0.1667 0.6667 0.2865 0.6852 0.6274 0.1568 0.6000 0.9333 0.8000 0.0974 199-DS 0.0000 0.0000 0.6333 0.7000 0.8333 0.4333 0.3402 0.7000 0.8333 0.7850 0.0243 0.0000 0.3143 0.0000 0.8333 0.4333 0.3402 200-DS 0.0000 0.0333 0.0667 0.1333 0.3333 0.0952 0.0942 0.1000 0.3333 0.9886 0.0231 0.0001 0.0701 0.0000 0.2333 0.0769 0.0672 137 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2DE-CLEF2007 Statistics for P@100 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0200 0.4700 0.7300 0.7500 0.4043 0.3300 0.7100 0.7500 0.8163 0.0640 0.0001 0.2980 0.0000 0.7500 0.4043 0.3300 177-DS 0.0500 0.1300 0.1800 0.2000 0.2600 0.1650 0.0642 0.0700 0.2100 0.3890 0.1490 0.1280 0.0514 0.0500 0.2600 0.1650 0.0642 178-DS 0.0100 0.0200 0.3900 0.6500 0.8300 0.3871 0.3230 0.6300 0.8200 0.8342 0.1571 0.0362 0.2676 0.0100 0.8300 0.3871 0.3230 179-DS 0.0300 0.4100 0.5200 0.5600 0.6600 0.4457 0.1913 0.1500 0.6300 0.4292 0.3397 0.1547 0.1335 0.4100 0.6600 0.5150 0.0812 180-DS 0.0300 0.4400 0.7350 0.8300 0.8500 0.5914 0.3132 0.3900 0.8200 0.5295 0.4048 0.1555 0.2596 0.0300 0.8500 0.5914 0.3132 181-DS 0.0600 0.2700 0.3400 0.3800 0.4000 0.3086 0.1059 0.1100 0.3400 0.3432 0.2778 0.2261 0.0778 0.2600 0.4000 0.3467 0.0458 182-DS 0.0200 0.4500 0.5300 0.7900 0.8600 0.5836 0.2281 0.3400 0.8400 0.3908 0.4753 0.1940 0.1812 0.0200 0.8600 0.5836 0.2281 183-DS 0.1400 0.2000 0.6050 0.8100 0.8900 0.5429 0.2909 0.6100 0.7500 0.5359 0.4491 0.3524 0.2582 0.1400 0.8900 0.5429 0.2909 184-DS 0.0600 0.2800 0.3850 0.5600 0.5700 0.3714 0.1741 0.2800 0.5100 0.4687 0.3092 0.2183 0.1398 0.0600 0.5700 0.3714 0.1741 185-DS 0.0000 0.0000 0.0200 0.0500 0.1000 0.0279 0.0302 0.0500 0.1000 1.0832 0.0030 0.0000 0.0236 0.0000 0.1000 0.0279 0.0302 186-DS 0.0000 0.0100 0.0300 0.0400 0.0700 0.0279 0.0181 0.0300 0.0700 0.6480 0.0146 0.0001 0.0139 0.0000 0.0700 0.0279 0.0181 187-DS 0.0900 0.0900 0.1200 0.1900 0.2300 0.1386 0.0499 0.1000 0.1400 0.3601 0.1309 0.1242 0.0424 0.0900 0.2300 0.1386 0.0499 188-DS 0.5700 0.8100 0.8300 0.8900 0.9800 0.8286 0.0981 0.0800 0.4100 0.1184 0.8225 0.8157 0.0671 0.7300 0.9800 0.8485 0.0666 189-DS 0.0000 0.0100 0.1000 0.1600 0.2900 0.0993 0.0834 0.1500 0.2900 0.8403 0.0225 0.0001 0.0637 0.0000 0.2900 0.0993 0.0834 190-DS 0.1600 0.7800 0.8950 0.9300 0.9500 0.7829 0.2659 0.1500 0.7900 0.3396 0.6976 0.5505 0.1788 0.7600 0.9500 0.8850 0.0620 191-DS 0.0300 0.0600 0.0950 0.1000 0.1600 0.0843 0.0365 0.0400 0.1300 0.4333 0.0763 0.0680 0.0294 0.0300 0.1600 0.0843 0.0365 192-DS 0.0000 0.1800 0.2550 0.5200 0.6200 0.3036 0.2050 0.3400 0.6200 0.6754 0.0720 0.0001 0.1703 0.0000 0.6200 0.3036 0.2050 193-DS 0.1400 0.3600 0.3900 0.5600 0.9500 0.4857 0.2227 0.2000 0.8100 0.4586 0.4402 0.3927 0.1673 0.1400 0.6300 0.4117 0.1292 194-DS 0.0200 0.0200 0.1300 0.4200 0.4700 0.1971 0.1821 0.4000 0.4500 0.9237 0.1072 0.0530 0.1567 0.0200 0.4700 0.1971 0.1821 195-DS 0.0100 0.5200 0.6700 0.8700 0.9300 0.6093 0.3047 0.3500 0.9200 0.5000 0.3738 0.0641 0.2295 0.0100 0.9300 0.6093 0.3047 196-DS 0.0000 0.2800 0.3800 0.4400 0.5100 0.3329 0.1646 0.1600 0.5100 0.4944 0.0838 0.0001 0.1253 0.2400 0.5100 0.3883 0.0922 197-DS 0.4700 0.5200 0.6450 0.8100 0.8900 0.6700 0.1600 0.2900 0.4200 0.2389 0.6521 0.6344 0.1414 0.4700 0.8900 0.6700 0.1600 198-DS 0.2200 0.6100 0.6650 0.6700 0.7900 0.6129 0.1720 0.0600 0.5700 0.2806 0.5773 0.5242 0.1131 0.6000 0.7000 0.6570 0.0298 199-DS 0.0000 0.0000 0.4250 0.5400 0.5600 0.3171 0.2438 0.5400 0.5600 0.7688 0.0197 0.0000 0.2233 0.0000 0.5600 0.3171 0.2438 200-DS 0.0100 0.0300 0.0600 0.1200 0.2700 0.0850 0.0736 0.0900 0.2600 0.8654 0.0563 0.0342 0.0586 0.0100 0.1600 0.0708 0.0528 138 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2DE-CLEF2007 Statistics for P@200 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0050 0.0100 0.2550 0.4150 0.4250 0.2304 0.1866 0.4050 0.4200 0.8102 0.0959 0.0215 0.1674 0.0050 0.4250 0.2304 0.1866 177-DS 0.0450 0.1000 0.1400 0.1700 0.1800 0.1300 0.0432 0.0700 0.1350 0.3322 0.1208 0.1086 0.0343 0.0450 0.1800 0.1300 0.0432 178-DS 0.0050 0.0350 0.3150 0.4500 0.6100 0.2875 0.2326 0.4150 0.6050 0.8090 0.1270 0.0267 0.1971 0.0050 0.6100 0.2875 0.2326 179-DS 0.0400 0.3700 0.4125 0.4400 0.4850 0.3654 0.1433 0.0700 0.4450 0.3923 0.2987 0.1775 0.0930 0.3650 0.4850 0.4196 0.0428 180-DS 0.0300 0.3550 0.5350 0.7150 0.7350 0.4832 0.2622 0.3600 0.7050 0.5427 0.3426 0.1552 0.2130 0.0300 0.7350 0.4832 0.2622 181-DS 0.0400 0.1700 0.1925 0.2150 0.2200 0.1768 0.0542 0.0450 0.1800 0.3065 0.1629 0.1392 0.0367 0.1700 0.2200 0.1971 0.0168 182-DS 0.0200 0.4150 0.4475 0.6700 0.7050 0.4882 0.1923 0.2550 0.6850 0.3938 0.4018 0.1827 0.1508 0.3400 0.7050 0.5242 0.1427 183-DS 0.1300 0.1750 0.4275 0.5650 0.6100 0.3943 0.1858 0.3900 0.4800 0.4712 0.3441 0.2911 0.1637 0.1300 0.6100 0.3943 0.1858 184-DS 0.0850 0.1700 0.2450 0.3350 0.3650 0.2421 0.0950 0.1650 0.2800 0.3922 0.2207 0.1954 0.0764 0.0850 0.3650 0.2421 0.0950 185-DS 0.0000 0.0000 0.0225 0.0400 0.0700 0.0236 0.0209 0.0400 0.0700 0.8861 0.0030 0.0000 0.0164 0.0000 0.0700 0.0236 0.0209 186-DS 0.0050 0.0200 0.0225 0.0300 0.0400 0.0243 0.0090 0.0100 0.0350 0.3688 0.0221 0.0188 0.0071 0.0150 0.0400 0.0258 0.0073 187-DS 0.0750 0.0950 0.1125 0.1450 0.1650 0.1164 0.0287 0.0500 0.0900 0.2461 0.1131 0.1099 0.0257 0.0750 0.1650 0.1164 0.0287 188-DS 0.4000 0.6450 0.6900 0.7550 0.7900 0.6800 0.1019 0.1100 0.3900 0.1498 0.6714 0.6609 0.0700 0.5700 0.7900 0.7015 0.0649 189-DS 0.0000 0.0250 0.0750 0.1100 0.1800 0.0779 0.0530 0.0850 0.1800 0.6809 0.0218 0.0001 0.0404 0.0000 0.1800 0.0779 0.0530 190-DS 0.1450 0.6450 0.7975 0.8450 0.9150 0.6993 0.2467 0.2000 0.7700 0.3529 0.6194 0.4843 0.1753 0.6300 0.9150 0.7913 0.0858 191-DS 0.0250 0.0350 0.0600 0.0700 0.1000 0.0575 0.0240 0.0350 0.0750 0.4174 0.0523 0.0469 0.0182 0.0250 0.1000 0.0575 0.0240 192-DS 0.0050 0.1250 0.1825 0.3500 0.4000 0.2089 0.1308 0.2250 0.3950 0.6260 0.1289 0.0305 0.1058 0.0050 0.4000 0.2089 0.1308 193-DS 0.1050 0.2500 0.2650 0.3700 0.7550 0.3450 0.1822 0.1200 0.6500 0.5282 0.3064 0.2718 0.1343 0.1050 0.4950 0.2833 0.0996 194-DS 0.0200 0.0450 0.1200 0.2900 0.3650 0.1575 0.1243 0.2450 0.3450 0.7892 0.1049 0.0639 0.1086 0.0200 0.3650 0.1575 0.1243 195-DS 0.0050 0.5150 0.5425 0.6550 0.7350 0.4925 0.2347 0.1400 0.7300 0.4766 0.2851 0.0332 0.1696 0.5150 0.7350 0.6005 0.0822 196-DS 0.0000 0.1800 0.2900 0.3200 0.3650 0.2361 0.1160 0.1400 0.3650 0.4913 0.0624 0.0001 0.0909 0.0000 0.3650 0.2361 0.1160 197-DS 0.3300 0.4150 0.4875 0.5550 0.6800 0.4946 0.1143 0.1400 0.3500 0.2311 0.4823 0.4702 0.0918 0.3300 0.6800 0.4946 0.1143 198-DS 0.1750 0.4950 0.5175 0.5350 0.6100 0.4793 0.1308 0.0400 0.4350 0.2729 0.4535 0.4156 0.0876 0.4550 0.5450 0.5130 0.0257 199-DS 0.0000 0.0050 0.2775 0.3600 0.3700 0.2175 0.1592 0.3550 0.3700 0.7318 0.0373 0.0001 0.1421 0.0000 0.3700 0.2175 0.1592 200-DS 0.0050 0.0300 0.0425 0.1200 0.1850 0.0671 0.0546 0.0900 0.1800 0.8130 0.0436 0.0237 0.0467 0.0050 0.1850 0.0671 0.0546 139 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2DE-CLEF2007 Statistics for P@500 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0060 0.0120 0.1440 0.1700 0.1700 0.1024 0.0754 0.1580 0.1640 0.7357 0.0551 0.0204 0.0698 0.0060 0.1700 0.1024 0.0754 177-DS 0.0340 0.0680 0.0980 0.1040 0.1100 0.0859 0.0259 0.0360 0.0760 0.3017 0.0809 0.0743 0.0205 0.0340 0.1100 0.0859 0.0259 178-DS 0.0100 0.0300 0.1840 0.2380 0.2740 0.1524 0.1054 0.2080 0.2640 0.6916 0.0936 0.0415 0.0920 0.0100 0.2740 0.1524 0.1054 179-DS 0.0260 0.2280 0.2350 0.2440 0.2440 0.2069 0.0769 0.0160 0.2180 0.3715 0.1728 0.1097 0.0517 0.2260 0.2440 0.2370 0.0065 180-DS 0.0160 0.2260 0.3390 0.4000 0.4080 0.2824 0.1455 0.1740 0.3920 0.5152 0.2003 0.0852 0.1194 0.0160 0.4080 0.2824 0.1455 181-DS 0.0260 0.0760 0.0810 0.0880 0.0880 0.0753 0.0187 0.0120 0.0620 0.2478 0.0719 0.0668 0.0123 0.0740 0.0880 0.0823 0.0048 182-DS 0.0100 0.3100 0.3480 0.4400 0.4600 0.3360 0.1234 0.1300 0.4500 0.3672 0.2724 0.1013 0.0874 0.2120 0.4600 0.3611 0.0834 183-DS 0.0860 0.1160 0.2280 0.2740 0.2840 0.2031 0.0765 0.1580 0.1980 0.3767 0.1871 0.1695 0.0678 0.0860 0.2840 0.2031 0.0765 184-DS 0.0780 0.0920 0.1310 0.1520 0.1540 0.1224 0.0275 0.0600 0.0760 0.2247 0.1193 0.1158 0.0227 0.0780 0.1540 0.1224 0.0275 185-DS 0.0000 0.0100 0.0150 0.0220 0.0480 0.0174 0.0142 0.0120 0.0480 0.8145 0.0056 0.0001 0.0109 0.0000 0.0400 0.0151 0.0116 186-DS 0.0100 0.0120 0.0160 0.0220 0.0320 0.0180 0.0071 0.0100 0.0220 0.3970 0.0168 0.0158 0.0057 0.0100 0.0320 0.0180 0.0071 187-DS 0.0620 0.0640 0.0840 0.1000 0.1100 0.0827 0.0180 0.0360 0.0480 0.2172 0.0809 0.0791 0.0155 0.0620 0.1100 0.0827 0.0180 188-DS 0.2580 0.4300 0.4450 0.4820 0.5040 0.4407 0.0631 0.0520 0.2460 0.1433 0.4355 0.4289 0.0418 0.3800 0.5040 0.4548 0.0364 189-DS 0.0000 0.0140 0.0500 0.0760 0.1000 0.0510 0.0334 0.0620 0.1000 0.6549 0.0219 0.0001 0.0266 0.0000 0.1000 0.0510 0.0334 190-DS 0.1160 0.3960 0.5540 0.5760 0.5960 0.4721 0.1629 0.1800 0.4800 0.3450 0.4263 0.3541 0.1238 0.1280 0.5960 0.4995 0.1318 191-DS 0.0200 0.0280 0.0400 0.0420 0.0520 0.0367 0.0102 0.0140 0.0320 0.2774 0.0352 0.0336 0.0082 0.0200 0.0520 0.0367 0.0102 192-DS 0.0040 0.0980 0.1170 0.1760 0.1880 0.1187 0.0587 0.0780 0.1840 0.4946 0.0809 0.0236 0.0431 0.0040 0.1880 0.1187 0.0587 193-DS 0.0720 0.1440 0.1750 0.2400 0.4080 0.2074 0.1010 0.0960 0.3360 0.4871 0.1869 0.1687 0.0793 0.0720 0.3180 0.1752 0.0641 194-DS 0.0140 0.0560 0.0890 0.1540 0.2060 0.1021 0.0607 0.0980 0.1920 0.5938 0.0790 0.0519 0.0524 0.0140 0.2060 0.1021 0.0607 195-DS 0.0080 0.3300 0.4100 0.4400 0.5060 0.3473 0.1608 0.1100 0.4980 0.4630 0.2265 0.0498 0.1203 0.2180 0.5060 0.4038 0.0784 196-DS 0.0020 0.0960 0.1490 0.1600 0.1740 0.1204 0.0578 0.0640 0.1720 0.4801 0.0747 0.0128 0.0457 0.0020 0.1740 0.1204 0.0578 197-DS 0.1900 0.2500 0.2790 0.2960 0.3600 0.2759 0.0520 0.0460 0.1700 0.1886 0.2711 0.2662 0.0396 0.1900 0.3600 0.2759 0.0520 198-DS 0.1340 0.2860 0.3120 0.3260 0.3660 0.2904 0.0689 0.0400 0.2320 0.2371 0.2798 0.2655 0.0466 0.2780 0.3660 0.3158 0.0259 199-DS 0.0000 0.0060 0.1310 0.1620 0.1620 0.1039 0.0692 0.1560 0.1620 0.6663 0.0231 0.0001 0.0588 0.0000 0.1620 0.1039 0.0692 200-DS 0.0120 0.0260 0.0340 0.0680 0.1100 0.0457 0.0291 0.0420 0.0980 0.6367 0.0373 0.0302 0.0245 0.0120 0.1100 0.0457 0.0291 140 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2DE-CLEF2007 Statistics for P@1000 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0040 0.0060 0.0780 0.0850 0.0860 0.0535 0.0372 0.0790 0.0820 0.6962 0.0322 0.0146 0.0344 0.0040 0.0860 0.0535 0.0372 177-DS 0.0250 0.0440 0.0575 0.0610 0.0630 0.0519 0.0129 0.0170 0.0380 0.2492 0.0499 0.0473 0.0101 0.0250 0.0630 0.0519 0.0129 178-DS 0.0060 0.0290 0.1110 0.1310 0.1390 0.0867 0.0527 0.1020 0.1330 0.6078 0.0593 0.0278 0.0467 0.0060 0.1390 0.0867 0.0527 179-DS 0.0150 0.1210 0.1235 0.1250 0.1250 0.1079 0.0394 0.0040 0.1100 0.3650 0.0913 0.0607 0.0266 0.1210 0.1250 0.1234 0.0016 180-DS 0.0130 0.1520 0.2030 0.2310 0.2330 0.1684 0.0804 0.0790 0.2200 0.4775 0.1278 0.0663 0.0640 0.0580 0.2330 0.1940 0.0512 181-DS 0.0140 0.0410 0.0410 0.0440 0.0440 0.0393 0.0080 0.0030 0.0300 0.2030 0.0380 0.0360 0.0048 0.0400 0.0440 0.0421 0.0015 182-DS 0.0070 0.2250 0.2340 0.2600 0.2700 0.2142 0.0714 0.0350 0.2630 0.3333 0.1764 0.0694 0.0495 0.2250 0.2700 0.2457 0.0164 183-DS 0.0730 0.0900 0.1280 0.1470 0.1490 0.1189 0.0294 0.0570 0.0760 0.2471 0.1152 0.1113 0.0264 0.0730 0.1490 0.1189 0.0294 184-DS 0.0550 0.0560 0.0695 0.0770 0.0780 0.0680 0.0091 0.0210 0.0230 0.1334 0.0674 0.0668 0.0076 0.0550 0.0780 0.0680 0.0091 185-DS 0.0000 0.0080 0.0135 0.0230 0.0380 0.0149 0.0111 0.0150 0.0380 0.7494 0.0052 0.0001 0.0090 0.0000 0.0380 0.0149 0.0111 186-DS 0.0070 0.0100 0.0135 0.0190 0.0240 0.0149 0.0053 0.0090 0.0170 0.3550 0.0140 0.0131 0.0046 0.0070 0.0240 0.0149 0.0053 187-DS 0.0440 0.0450 0.0560 0.0590 0.0640 0.0535 0.0076 0.0140 0.0200 0.1425 0.0530 0.0525 0.0069 0.0440 0.0640 0.0535 0.0076 188-DS 0.1750 0.2680 0.2850 0.2980 0.3060 0.2779 0.0329 0.0300 0.1310 0.1184 0.2756 0.2728 0.0208 0.2640 0.3060 0.2858 0.0149 189-DS 0.0040 0.0130 0.0360 0.0490 0.0520 0.0324 0.0172 0.0360 0.0480 0.5308 0.0254 0.0164 0.0142 0.0040 0.0520 0.0324 0.0172 190-DS 0.0890 0.2570 0.3060 0.3100 0.3110 0.2667 0.0776 0.0530 0.2220 0.2908 0.2495 0.2232 0.0557 0.2370 0.3110 0.2959 0.0244 191-DS 0.0170 0.0220 0.0260 0.0280 0.0300 0.0251 0.0042 0.0060 0.0130 0.1665 0.0248 0.0244 0.0032 0.0170 0.0300 0.0251 0.0042 192-DS 0.0030 0.0640 0.0730 0.0970 0.0970 0.0689 0.0313 0.0330 0.0940 0.4545 0.0492 0.0170 0.0222 0.0540 0.0970 0.0799 0.0154 193-DS 0.0540 0.0980 0.1225 0.1490 0.2210 0.1343 0.0490 0.0510 0.1670 0.3646 0.1260 0.1175 0.0388 0.0540 0.2210 0.1343 0.0490 194-DS 0.0160 0.0440 0.0665 0.0890 0.1130 0.0676 0.0309 0.0450 0.0970 0.4571 0.0584 0.0466 0.0243 0.0160 0.1130 0.0676 0.0309 195-DS 0.0050 0.2620 0.2780 0.3030 0.3310 0.2423 0.1059 0.0410 0.3260 0.4372 0.1573 0.0316 0.0751 0.2620 0.3310 0.2901 0.0234 196-DS 0.0010 0.0620 0.0810 0.0830 0.0880 0.0654 0.0296 0.0210 0.0870 0.4528 0.0405 0.0065 0.0219 0.0470 0.0880 0.0762 0.0125 197-DS 0.1200 0.1480 0.1710 0.1790 0.1930 0.1646 0.0234 0.0310 0.0730 0.1425 0.1629 0.1610 0.0181 0.1200 0.1930 0.1646 0.0234 198-DS 0.0970 0.1770 0.1885 0.1970 0.2040 0.1764 0.0342 0.0200 0.1070 0.1938 0.1723 0.1670 0.0228 0.1730 0.2040 0.1894 0.0097 199-DS 0.0040 0.0050 0.0695 0.0810 0.0810 0.0547 0.0337 0.0760 0.0770 0.6168 0.0333 0.0135 0.0287 0.0040 0.0810 0.0547 0.0337 200-DS 0.0080 0.0180 0.0220 0.0430 0.0680 0.0298 0.0175 0.0250 0.0600 0.5888 0.0250 0.0207 0.0150 0.0080 0.0680 0.0298 0.0175 141 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2EN-CLEF2007 Domain−Specific Bilingual English Task Top 5 Participants − Standard Recall Levels vs Mean Interpolated Precision 100% xerox [Experiment XRCED2EHCGEPRFLE; MAP 33.41%; Pooled] chemnitz [Experiment CUT_DS_BILI_RU2EN_MERGED; MAP 26.46%; Pooled] 90% cheshire [Experiment BERKBRUENCCP15; MAP 17.57%; Pooled] moscow [Experiment CIRDSBILIRU2EN2; MAP 13.26%; Pooled] 80% 70% 60% Precision 50% 40% 30% 20% 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Bilingual English Task Top 5 Participants − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) 1 xerox [Experiment XRCED2EHCGEPRFLE; MAP 33.41%; Pooled] chemnitz [Experiment CUT_DS_BILI_RU2EN_MERGED; MAP 26.46%; Pooled] cheshire [Experiment BERKBRUENCCP15; MAP 17.57%; Pooled] moscow [Experiment CIRDSBILIRU2EN2; MAP 13.26%; Pooled] 0.8 0.6 0.4 0.2 Difference 0 −0.2 −0.4 −0.6 −0.8 −1 176−DS177−DS178−DS179−DS180−DS181−DS182−DS183−DS184−DS185−DS186−DS187−DS188−DS189−DS190−DS191−DS192−DS193−DS194−DS195−DS196−DS197−DS198−DS199−DS200−DS Topic Identifier 142 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2EN-CLEF2007 Domain−Specific Bilingual English Task − Box Plot of the Topics xerox [Experiment XRCED2EHCGEPRFLE; MAP 33.41%; Pooled] xerox [Experiment XRCED2EHECGPRFLE; MAP 29.23%; Pooled] xerox [Experiment XRCED2EMATRAXPRFLE; MAP 28.73%; Pooled] xerox [Experiment XRCED2EMATRAXLE; MAP 27.57%; Pooled] chemnitz [Experiment CUT_DS_BILI_RU2EN_MERGED; MAP 26.46%; Pooled] xerox [Experiment XRCED2EMATRAX; MAP 24.68%; Pooled] xerox [Experiment XRCED2EHECGLE; MAP 23.38%; Pooled] Experiments chemnitz [Experiment CUT_DS_BILI_DE2EN_MERGED_THES; MAP 20.37%; Pooled] chemnitz [Experiment CUT_DS_BILI_DE2EN_MERGED; MAP 19.88%; Pooled] cheshire [Experiment BERKBRUENCCP15; MAP 17.57%; Pooled] cheshire [Experiment BERKBRUENTHP7; MAP 17.01%; Pooled] moscow [Experiment CIRDSBILIRU2EN2; MAP 13.26%; Pooled] moscow [Experiment CIRDSBILIRU2EN; MAP 12.94%; Pooled] cheshire [Experiment BERKBDEENCCP15; MAP 10.96%; Pooled] cheshire [Experiment BERKBDEENTHP7; MAP 10.43%; Pooled] 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Average Precision 143 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2EN-CLEF2007 10.2455/TUKEY_T_TEST.AC3853F940774165F1A4D732C89A0203 Domain−Specific Bilingual English Task − Tukey T test with "top group" highlighted XRCED2EHCGEPRFLE XRCED2EHECGPRFLE XRCED2EMATRAXPRFLE XRCED2EMATRAXLE CUT_DS_BILI_RU2EN_MERGED XRCED2EMATRAX XRCED2EHECGLE Experiments CUT_DS_BILI_DE2EN_MERGED_THES CUT_DS_BILI_DE2EN_MERGED BERKBRUENCCP15 BERKBRUENTHP7 CIRDSBILIRU2EN2 CIRDSBILIRU2EN BERKBDEENCCP15 BERKBDEENTHP7 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 arcsin(sqrt(Average Precsion)) 144 145 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2EN-CLEF2007 Domain−Specific Bilingual English Task Top 5 Participants − Retrieved documents vs Mean Precision 100% xerox [Experiment XRCED2EHCGEPRFLE; R−Prec 37.45%; Pooled] chemnitz [Experiment CUT_DS_BILI_RU2EN_MERGED; R−Prec 31.46%; Pooled] 90% cheshire [Experiment BERKBRUENCCP15; R−Prec 23.20%; Pooled] moscow [Experiment CIRDSBILIRU2EN2; R−Prec 19.70%; Pooled] 80% 70% 60% Precision 50% 40% 30% 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Bilingual English Task Top 5 Participants − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) 1 xerox [Experiment XRCED2EHCGEPRFLE; R−Prec 37.45%; Pooled] chemnitz [Experiment CUT_DS_BILI_RU2EN_MERGED; R−Prec 31.46%; Pooled] cheshire [Experiment BERKBRUENCCP15; R−Prec 23.20%; Pooled] moscow [Experiment CIRDSBILIRU2EN2; R−Prec 19.70%; Pooled] 0.8 0.6 0.4 0.2 Difference 0 −0.2 −0.4 −0.6 −0.8 −1 176−DS177−DS178−DS179−DS180−DS181−DS182−DS183−DS184−DS185−DS186−DS187−DS188−DS189−DS190−DS191−DS192−DS193−DS194−DS195−DS196−DS197−DS198−DS199−DS200−DS Topic Identifier 146 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2EN-CLEF2007 Domain−Specific Bilingual English Task − Box Plot of the Topics xerox [Experiment XRCED2EHCGEPRFLE; R−Prec 37.45%; Pooled] xerox [Experiment XRCED2EMATRAXPRFLE; R−Prec 33.37%; Pooled] xerox [Experiment XRCED2EHECGPRFLE; R−Prec 32.87%; Pooled] xerox [Experiment XRCED2EMATRAXLE; R−Prec 32.72%; Pooled] chemnitz [Experiment CUT_DS_BILI_RU2EN_MERGED; R−Prec 31.46%; Pooled] xerox [Experiment XRCED2EMATRAX; R−Prec 30.20%; Pooled] xerox [Experiment XRCED2EHECGLE; R−Prec 29.72%; Pooled] Experiments chemnitz [Experiment CUT_DS_BILI_DE2EN_MERGED_THES; R−Prec 27.44%; Pooled] chemnitz [Experiment CUT_DS_BILI_DE2EN_MERGED; R−Prec 27.18%; Pooled] cheshire [Experiment BERKBRUENCCP15; R−Prec 23.20%; Pooled] cheshire [Experiment BERKBRUENTHP7; R−Prec 22.62%; Pooled] moscow [Experiment CIRDSBILIRU2EN; R−Prec 20.02%; Pooled] moscow [Experiment CIRDSBILIRU2EN2; R−Prec 19.70%; Pooled] cheshire [Experiment BERKBDEENCCP15; R−Prec 15.39%; Pooled] cheshire [Experiment BERKBDEENTHP7; R−Prec 15.34%; Pooled] 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% R−Precision 147 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2EN-CLEF2007 Domain−Specific Bilingual English Task − Tukey T test with "top group" highlighted XRCED2EHCGEPRFLE XRCED2EMATRAXPRFLE XRCED2EMATRAXLE XRCED2EHECGPRFLE CUT_DS_BILI_RU2EN_MERGED XRCED2EHECGLE XRCED2EMATRAX Experiments CUT_DS_BILI_DE2EN_MERGED_THES CUT_DS_BILI_DE2EN_MERGED BERKBRUENCCP15 BERKBRUENTHP7 CIRDSBILIRU2EN CIRDSBILIRU2EN2 BERKBDEENTHP7 BERKBDEENCCP15 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 arcsin(sqrt(R−Precision)) 148 149 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2EN-CLEF2007 Statistics for Number of relevant retrieved documents Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 16.00 25.50 77.00 86.75 89.00 61.87 29.94 61.25 73.00 0.48 52.13 41.11 26.58 16.00 89.00 61.87 29.94 177-DS 14.00 19.25 31.00 37.00 41.00 29.33 9.63 17.75 27.00 0.33 27.56 25.58 8.04 14.00 41.00 29.33 9.63 178-DS 29.00 51.25 87.00 93.00 107.00 71.20 26.96 41.75 78.00 0.38 65.57 59.40 24.59 29.00 107.00 71.20 26.96 179-DS 17.00 89.25 99.00 103.00 106.00 88.00 28.15 13.75 89.00 0.32 79.98 65.87 20.13 87.00 106.00 100.50 5.20 180-DS 198.00 210.75 283.00 307.00 322.00 263.93 48.90 96.25 124.00 0.19 259.51 254.98 44.61 198.00 322.00 263.93 48.90 181-DS 0.00 16.00 17.00 17.75 18.00 14.73 6.03 1.75 18.00 0.41 2.51 0.00 3.93 16.00 18.00 17.00 0.82 182-DS 2.00 28.25 44.00 50.50 54.00 36.47 16.95 22.25 52.00 0.46 27.07 11.24 13.44 2.00 54.00 36.47 16.95 183-DS 30.00 73.50 104.00 124.25 141.00 95.13 34.60 50.75 111.00 0.36 87.47 77.74 27.84 30.00 141.00 95.13 34.60 184-DS 53.00 72.25 169.00 229.50 249.00 153.93 74.96 157.25 196.00 0.49 133.45 112.33 65.27 53.00 249.00 153.93 74.96 185-DS 11.00 39.50 60.00 73.75 83.00 52.87 24.80 34.25 72.00 0.47 44.48 33.58 19.74 11.00 83.00 52.87 24.80 186-DS 16.00 25.00 27.00 37.50 42.00 29.93 8.37 12.50 26.00 0.28 28.73 27.43 7.13 16.00 42.00 29.93 8.37 187-DS 11.00 226.75 326.00 360.50 389.00 279.27 120.98 133.75 378.00 0.43 208.25 80.70 89.61 206.00 389.00 319.92 60.35 188-DS 127.00 214.75 247.00 256.50 291.00 232.40 44.74 41.75 164.00 0.19 227.53 221.63 33.47 153.00 291.00 239.93 35.21 189-DS 2.00 9.00 24.00 25.75 36.00 19.67 10.61 16.75 34.00 0.54 14.94 8.67 9.11 2.00 36.00 19.67 10.61 190-DS 0.00 79.75 100.00 105.75 106.00 84.67 36.36 26.00 106.00 0.43 11.33 0.00 26.49 66.00 106.00 97.69 12.79 191-DS 22.00 30.00 46.00 53.25 58.00 42.53 13.09 23.25 36.00 0.31 40.31 37.84 10.83 22.00 58.00 42.53 13.09 192-DS 0.00 27.00 45.00 75.00 79.00 44.73 29.40 48.00 79.00 0.66 11.39 0.00 24.42 0.00 79.00 44.73 29.40 193-DS 74.00 125.75 253.00 331.25 361.00 235.60 106.49 205.50 287.00 0.45 206.50 173.87 91.36 74.00 361.00 235.60 106.49 194-DS 49.00 63.50 107.00 179.50 201.00 115.33 58.05 116.00 152.00 0.50 101.70 89.67 48.98 49.00 201.00 115.33 58.05 195-DS 120.00 166.50 293.00 341.25 355.00 259.87 89.62 174.75 235.00 0.34 242.82 224.17 80.29 120.00 355.00 259.87 89.62 196-DS 0.00 19.00 44.00 44.75 45.00 33.73 17.65 25.75 45.00 0.52 4.80 0.00 14.79 0.00 45.00 33.73 17.65 197-DS 53.00 103.00 114.00 122.50 146.00 109.20 25.46 19.50 93.00 0.23 105.54 100.74 17.31 100.00 146.00 117.77 12.64 198-DS 64.00 159.75 180.00 194.00 201.00 167.33 43.12 34.25 137.00 0.26 159.54 148.26 30.98 146.00 201.00 182.54 16.94 199-DS 5.00 12.25 51.00 60.50 67.00 38.93 24.86 48.25 62.00 0.64 28.14 17.88 22.88 5.00 67.00 38.93 24.86 200-DS 41.00 56.50 65.00 77.75 104.00 67.40 16.81 21.25 63.00 0.25 65.42 63.39 12.69 41.00 104.00 67.40 16.81 150 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2EN-CLEF2007 Statistics for Average Precsion Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0193 0.1346 0.3096 0.5619 0.6596 0.3265 0.2166 0.4273 0.6402 0.6633 0.2208 0.0989 0.1767 0.0193 0.6596 0.3265 0.2166 177-DS 0.0127 0.0263 0.1081 0.1495 0.1837 0.0922 0.0638 0.1233 0.1710 0.6916 0.0642 0.0394 0.0568 0.0127 0.1837 0.0922 0.0638 178-DS 0.0114 0.0576 0.1423 0.2129 0.3268 0.1381 0.1086 0.1553 0.3154 0.7864 0.0874 0.0446 0.0916 0.0114 0.3268 0.1381 0.1086 179-DS 0.0057 0.2242 0.2780 0.4554 0.4953 0.2941 0.1556 0.2312 0.4896 0.5290 0.1973 0.0499 0.1220 0.0057 0.4953 0.2941 0.1556 180-DS 0.3155 0.3506 0.4834 0.5653 0.6043 0.4649 0.1100 0.2146 0.2887 0.2367 0.4522 0.4394 0.0982 0.3155 0.6043 0.4649 0.1100 181-DS 0.0000 0.1555 0.2981 0.3046 0.5300 0.2406 0.1383 0.1491 0.5300 0.5749 0.0669 0.0001 0.1096 0.0000 0.3520 0.2199 0.1171 182-DS 0.0001 0.0313 0.0530 0.0643 0.1025 0.0491 0.0272 0.0330 0.1023 0.5538 0.0246 0.0012 0.0201 0.0001 0.1025 0.0491 0.0272 183-DS 0.0119 0.1012 0.1787 0.4080 0.6275 0.2440 0.1954 0.3068 0.6156 0.8008 0.1564 0.0709 0.1591 0.0119 0.6275 0.2440 0.1954 184-DS 0.0095 0.0828 0.1607 0.2796 0.3950 0.1862 0.1235 0.1968 0.3855 0.6631 0.1264 0.0550 0.1024 0.0095 0.3950 0.1862 0.1235 185-DS 0.0034 0.0392 0.0948 0.1348 0.2482 0.0913 0.0702 0.0956 0.2448 0.7688 0.0520 0.0167 0.0541 0.0034 0.2482 0.0913 0.0702 186-DS 0.0167 0.0267 0.0506 0.0759 0.2755 0.0681 0.0643 0.0491 0.2588 0.9433 0.0509 0.0399 0.0402 0.0167 0.1072 0.0533 0.0300 187-DS 0.0003 0.1864 0.3483 0.4848 0.5030 0.3207 0.1742 0.2984 0.5026 0.5432 0.1459 0.0036 0.1392 0.0003 0.5030 0.3207 0.1742 188-DS 0.1352 0.3336 0.4024 0.5023 0.6061 0.4011 0.1353 0.1688 0.4708 0.3372 0.3745 0.3411 0.1047 0.1352 0.6061 0.4011 0.1353 189-DS 0.0002 0.0031 0.0343 0.0482 0.1189 0.0360 0.0342 0.0451 0.1187 0.9520 0.0147 0.0021 0.0253 0.0002 0.0780 0.0300 0.0264 190-DS 0.0000 0.1397 0.1929 0.2097 0.5867 0.1878 0.1333 0.0700 0.5867 0.7097 0.0530 0.0001 0.0784 0.1105 0.2500 0.1859 0.0417 191-DS 0.0217 0.0406 0.0869 0.1667 0.2160 0.1058 0.0664 0.1261 0.1944 0.6276 0.0817 0.0589 0.0588 0.0217 0.2160 0.1058 0.0664 192-DS 0.0000 0.0147 0.0551 0.1571 0.1645 0.0760 0.0671 0.1424 0.1645 0.8839 0.0140 0.0001 0.0596 0.0000 0.1645 0.0760 0.0671 193-DS 0.0416 0.0929 0.2900 0.4412 0.5782 0.2939 0.1880 0.3482 0.5366 0.6396 0.2127 0.1320 0.1603 0.0416 0.5782 0.2939 0.1880 194-DS 0.0140 0.0334 0.1168 0.3340 0.4463 0.1778 0.1639 0.3006 0.4323 0.9222 0.0997 0.0498 0.1400 0.0140 0.4463 0.1778 0.1639 195-DS 0.0720 0.1909 0.3850 0.5481 0.5751 0.3609 0.1900 0.3572 0.5031 0.5264 0.2979 0.2266 0.1674 0.0720 0.5751 0.3609 0.1900 196-DS 0.0000 0.0932 0.2466 0.3544 0.3724 0.2306 0.1392 0.2612 0.3724 0.6037 0.0592 0.0001 0.1108 0.0000 0.3724 0.2306 0.1392 197-DS 0.0701 0.1661 0.2203 0.3495 0.5222 0.2570 0.1430 0.1834 0.4521 0.5564 0.2187 0.1812 0.1127 0.0701 0.5222 0.2570 0.1430 198-DS 0.0955 0.2658 0.4107 0.4653 0.5586 0.3655 0.1476 0.1995 0.4631 0.4037 0.3246 0.2697 0.1137 0.0955 0.5586 0.3655 0.1476 199-DS 0.0009 0.0038 0.2179 0.2434 0.3313 0.1542 0.1330 0.2396 0.3304 0.8623 0.0398 0.0048 0.1210 0.0009 0.3313 0.1542 0.1330 200-DS 0.0597 0.0675 0.1045 0.1187 0.2212 0.1023 0.0411 0.0512 0.1614 0.4015 0.0959 0.0906 0.0288 0.0597 0.1266 0.0938 0.0255 151 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2EN-CLEF2007 Statistics for R-Precision Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0333 0.2028 0.3444 0.5639 0.6333 0.3526 0.1967 0.3611 0.6000 0.5578 0.2733 0.1651 0.1554 0.0333 0.6333 0.3526 0.1967 177-DS 0.0526 0.0877 0.1754 0.1930 0.2105 0.1497 0.0581 0.1053 0.1579 0.3883 0.1368 0.1223 0.0519 0.0526 0.2105 0.1497 0.0581 178-DS 0.0671 0.1265 0.2073 0.3079 0.3963 0.2114 0.1116 0.1814 0.3293 0.5282 0.1808 0.1509 0.0959 0.0671 0.3963 0.2114 0.1116 179-DS 0.0459 0.2752 0.3303 0.4885 0.5413 0.3468 0.1534 0.2133 0.4954 0.4422 0.2925 0.2061 0.1155 0.0459 0.5413 0.3468 0.1534 180-DS 0.3503 0.4124 0.5241 0.5615 0.6043 0.4945 0.0860 0.1491 0.2540 0.1739 0.4872 0.4796 0.0761 0.3503 0.6043 0.4945 0.0860 181-DS 0.0000 0.1667 0.2778 0.3889 0.4444 0.2704 0.1512 0.2222 0.4444 0.5593 0.0738 0.0001 0.1274 0.0000 0.4444 0.2704 0.1512 182-DS 0.0000 0.0691 0.1053 0.1612 0.2105 0.1044 0.0630 0.0921 0.2105 0.6035 0.0320 0.0001 0.0501 0.0000 0.2105 0.1044 0.0630 183-DS 0.0596 0.1871 0.2914 0.4421 0.5762 0.3033 0.1561 0.2550 0.5166 0.5147 0.2584 0.2067 0.1238 0.0596 0.5762 0.3033 0.1561 184-DS 0.0669 0.1253 0.2591 0.3607 0.4568 0.2589 0.1327 0.2354 0.3900 0.5125 0.2193 0.1769 0.1101 0.0669 0.4568 0.2589 0.1327 185-DS 0.0236 0.0965 0.1969 0.2598 0.3701 0.1790 0.1065 0.1634 0.3465 0.5952 0.1341 0.0829 0.0883 0.0236 0.3701 0.1790 0.1065 186-DS 0.0189 0.0660 0.1132 0.1274 0.3019 0.1094 0.0735 0.0613 0.2830 0.6716 0.0835 0.0564 0.0493 0.0189 0.1887 0.0957 0.0526 187-DS 0.0141 0.3239 0.4467 0.5151 0.5513 0.3933 0.1720 0.1911 0.5372 0.4375 0.2881 0.1026 0.1267 0.3119 0.5513 0.4510 0.0864 188-DS 0.2515 0.3867 0.4211 0.5146 0.5965 0.4349 0.0954 0.1279 0.3450 0.2195 0.4244 0.4131 0.0756 0.2515 0.5965 0.4349 0.0954 189-DS 0.0000 0.0227 0.0682 0.0909 0.1818 0.0667 0.0526 0.0682 0.1818 0.7887 0.0121 0.0000 0.0412 0.0000 0.1818 0.0667 0.0526 190-DS 0.0000 0.1958 0.2358 0.2453 0.5849 0.2245 0.1312 0.0495 0.5849 0.5844 0.0642 0.0001 0.0737 0.1792 0.2830 0.2319 0.0297 191-DS 0.0781 0.0898 0.1406 0.2188 0.2656 0.1646 0.0723 0.1289 0.1875 0.4393 0.1487 0.1334 0.0651 0.0781 0.2656 0.1646 0.0723 192-DS 0.0000 0.0584 0.1402 0.2266 0.2991 0.1439 0.1030 0.1682 0.2991 0.7159 0.0231 0.0000 0.0837 0.0000 0.2991 0.1439 0.1030 193-DS 0.1128 0.1920 0.4100 0.4881 0.5835 0.3640 0.1639 0.2961 0.4707 0.4504 0.3195 0.2697 0.1408 0.1128 0.5835 0.3640 0.1639 194-DS 0.0617 0.0859 0.2423 0.4449 0.5286 0.2605 0.1740 0.3590 0.4670 0.6678 0.1996 0.1474 0.1464 0.0617 0.5286 0.2605 0.1740 195-DS 0.1596 0.2854 0.4719 0.5854 0.5910 0.4274 0.1621 0.3000 0.4315 0.3792 0.3917 0.3506 0.1430 0.1596 0.5910 0.4274 0.1621 196-DS 0.0000 0.1611 0.2889 0.3556 0.4222 0.2578 0.1330 0.1944 0.4222 0.5160 0.0719 0.0001 0.1055 0.0000 0.4222 0.2578 0.1330 197-DS 0.1744 0.2558 0.3023 0.4070 0.5407 0.3256 0.1174 0.1512 0.3663 0.3606 0.3064 0.2884 0.0938 0.1744 0.5407 0.3256 0.1174 198-DS 0.1841 0.3337 0.4561 0.5126 0.5649 0.4218 0.1240 0.1789 0.3808 0.2939 0.3996 0.3718 0.0965 0.1841 0.5649 0.4218 0.1240 199-DS 0.0141 0.0176 0.2254 0.2817 0.3662 0.1784 0.1426 0.2641 0.3521 0.7994 0.0946 0.0398 0.1258 0.0141 0.3662 0.1784 0.1426 200-DS 0.1364 0.1610 0.1970 0.2311 0.3561 0.2010 0.0542 0.0701 0.2197 0.2695 0.1952 0.1901 0.0372 0.1364 0.2348 0.1899 0.0343 152 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2EN-CLEF2007 Statistics for Binary Preference Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0249 0.1778 0.2804 0.5881 0.6610 0.3365 0.2180 0.4103 0.6360 0.6478 0.2421 0.1265 0.1827 0.0249 0.6610 0.3365 0.2180 177-DS 0.0228 0.0542 0.0997 0.1642 0.1810 0.1105 0.0552 0.1100 0.1582 0.4994 0.0946 0.0768 0.0497 0.0228 0.1810 0.1105 0.0552 178-DS 0.0493 0.1139 0.1616 0.3099 0.3969 0.1935 0.1202 0.1960 0.3476 0.6210 0.1557 0.1216 0.1059 0.0493 0.3969 0.1935 0.1202 179-DS 0.0253 0.2350 0.2596 0.4401 0.4904 0.2919 0.1466 0.2052 0.4652 0.5022 0.2301 0.1326 0.1125 0.0253 0.4904 0.2919 0.1466 180-DS 0.4123 0.4536 0.5395 0.6348 0.6501 0.5473 0.0904 0.1812 0.2378 0.1651 0.5401 0.5327 0.0801 0.4123 0.6501 0.5473 0.0904 181-DS 0.0000 0.1111 0.1883 0.2762 0.4352 0.1928 0.1207 0.1651 0.4352 0.6261 0.0538 0.0001 0.0982 0.0000 0.4352 0.1928 0.1207 182-DS 0.0000 0.0420 0.0551 0.0963 0.1122 0.0604 0.0364 0.0543 0.1122 0.6015 0.0199 0.0001 0.0295 0.0000 0.1122 0.0604 0.0364 183-DS 0.0640 0.1396 0.2388 0.4427 0.6324 0.2835 0.1830 0.3031 0.5684 0.6455 0.2287 0.1799 0.1457 0.0640 0.6324 0.2835 0.1830 184-DS 0.0899 0.1586 0.3624 0.4843 0.5873 0.3357 0.1717 0.3257 0.4974 0.5115 0.2840 0.2288 0.1454 0.0899 0.5873 0.3357 0.1717 185-DS 0.0199 0.0721 0.1419 0.2051 0.3621 0.1460 0.0962 0.1330 0.3422 0.6586 0.1071 0.0663 0.0753 0.0199 0.3621 0.1460 0.0962 186-DS 0.0050 0.0429 0.0716 0.0924 0.2691 0.0805 0.0645 0.0495 0.2642 0.8011 0.0572 0.0320 0.0426 0.0050 0.1346 0.0670 0.0393 187-DS 0.0147 0.3736 0.5477 0.6512 0.6743 0.4823 0.2164 0.2776 0.6596 0.4488 0.3461 0.1128 0.1638 0.0147 0.6743 0.4823 0.2164 188-DS 0.2245 0.3740 0.4619 0.6634 0.7312 0.4954 0.1639 0.2893 0.5067 0.3307 0.4686 0.4406 0.1334 0.2245 0.7312 0.4954 0.1639 189-DS 0.0000 0.0090 0.0320 0.0473 0.1265 0.0397 0.0362 0.0382 0.1265 0.9121 0.0075 0.0000 0.0270 0.0000 0.0883 0.0335 0.0281 190-DS 0.0000 0.1124 0.1457 0.1639 0.5740 0.1575 0.1295 0.0515 0.5740 0.8219 0.0446 0.0001 0.0685 0.1082 0.2130 0.1491 0.0312 191-DS 0.0459 0.0618 0.1169 0.1740 0.1958 0.1190 0.0559 0.1122 0.1499 0.4702 0.1050 0.0912 0.0492 0.0459 0.1958 0.1190 0.0559 192-DS 0.0000 0.0407 0.1137 0.1611 0.2226 0.1024 0.0743 0.1204 0.2226 0.7260 0.0175 0.0000 0.0625 0.0000 0.2226 0.1024 0.0743 193-DS 0.1230 0.2103 0.4374 0.6273 0.7029 0.4290 0.2133 0.4170 0.5800 0.4972 0.3664 0.2993 0.1835 0.1230 0.7029 0.4290 0.2133 194-DS 0.0906 0.1099 0.2533 0.5109 0.6532 0.3048 0.2090 0.4010 0.5626 0.6857 0.2386 0.1858 0.1778 0.0906 0.6532 0.3048 0.2090 195-DS 0.2004 0.3197 0.5668 0.6935 0.7138 0.5095 0.1944 0.3738 0.5134 0.3815 0.4677 0.4211 0.1725 0.2004 0.7138 0.5095 0.1944 196-DS 0.0000 0.1089 0.1837 0.2915 0.3269 0.1947 0.1124 0.1826 0.3269 0.5774 0.0550 0.0001 0.0935 0.0000 0.3269 0.1947 0.1124 197-DS 0.1740 0.2544 0.3106 0.4348 0.5567 0.3354 0.1239 0.1804 0.3827 0.3695 0.3145 0.2946 0.1001 0.1740 0.5567 0.3354 0.1239 198-DS 0.2091 0.4303 0.5403 0.5823 0.6817 0.5030 0.1392 0.1520 0.4726 0.2768 0.4791 0.4479 0.1056 0.2091 0.6817 0.5030 0.1392 199-DS 0.0083 0.0122 0.1803 0.2267 0.2989 0.1422 0.1171 0.2145 0.2906 0.8232 0.0692 0.0263 0.1036 0.0083 0.2989 0.1422 0.1171 200-DS 0.1045 0.1090 0.1406 0.1678 0.2691 0.1460 0.0431 0.0588 0.1645 0.2953 0.1410 0.1368 0.0312 0.1045 0.1774 0.1372 0.0274 153 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2EN-CLEF2007 Statistics for Precision at the 0% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.7143 1.0000 1.0000 1.0000 1.0000 0.9810 0.0738 0.0000 0.2857 0.0752 0.9778 0.9740 0.0356 1.0000 1.0000 1.0000 0.0000 177-DS 0.0690 0.1839 0.4545 1.0000 1.0000 0.5743 0.3888 0.8161 0.9310 0.6770 0.4162 0.2701 0.3529 0.0690 1.0000 0.5743 0.3888 178-DS 0.1282 0.5000 1.0000 1.0000 1.0000 0.7307 0.3599 0.5000 0.8718 0.4926 0.5971 0.4290 0.3232 0.1282 1.0000 0.7307 0.3599 179-DS 0.0800 0.5000 0.6667 1.0000 1.0000 0.6894 0.3227 0.5000 0.9200 0.4681 0.5663 0.3768 0.2677 0.0800 1.0000 0.6894 0.3227 180-DS 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 0.0000 0.0000 0.0000 0.0000 1.0000 1.0000 0.0000 1.0000 1.0000 1.0000 0.0000 181-DS 0.0000 0.2795 0.3750 0.5000 1.0000 0.4185 0.2831 0.2205 1.0000 0.6764 0.1057 0.0001 0.1937 0.0000 0.5000 0.3290 0.1687 182-DS 0.0061 0.1135 0.2273 0.5000 0.5000 0.2652 0.1882 0.3865 0.4939 0.7095 0.1597 0.0429 0.1585 0.0061 0.5000 0.2652 0.1882 183-DS 0.0870 0.2946 1.0000 1.0000 1.0000 0.6707 0.3781 0.7054 0.9130 0.5637 0.5259 0.3603 0.3513 0.0870 1.0000 0.6707 0.3781 184-DS 0.0732 0.8864 1.0000 1.0000 1.0000 0.8413 0.3171 0.1136 0.9268 0.3769 0.6851 0.3836 0.2145 0.7568 1.0000 0.9586 0.0746 185-DS 0.0667 0.3345 0.5000 0.5000 1.0000 0.4972 0.2939 0.1655 0.9333 0.5911 0.4080 0.3035 0.2034 0.1818 0.5000 0.3992 0.1264 186-DS 0.0500 0.2292 0.4000 0.6250 1.0000 0.4612 0.3182 0.3958 0.9500 0.6900 0.3574 0.2507 0.2533 0.0500 1.0000 0.4612 0.3182 187-DS 0.0286 0.7958 1.0000 1.0000 1.0000 0.8303 0.3354 0.2042 0.9714 0.4040 0.6061 0.2005 0.2341 0.7333 1.0000 0.9528 0.0957 188-DS 0.9000 1.0000 1.0000 1.0000 1.0000 0.9867 0.0352 0.0000 0.1000 0.0357 0.9861 0.9854 0.0231 1.0000 1.0000 1.0000 0.0000 189-DS 0.0048 0.0429 0.1111 0.1857 1.0000 0.2671 0.3830 0.1429 0.9952 1.4337 0.0967 0.0309 0.2932 0.0048 0.2000 0.0839 0.0597 190-DS 0.0000 0.3926 0.5000 1.0000 1.0000 0.5824 0.3477 0.6074 1.0000 0.5969 0.1427 0.0001 0.2784 0.0000 1.0000 0.5824 0.3477 191-DS 0.3333 0.5000 0.5000 0.6667 1.0000 0.5798 0.2068 0.1667 0.6667 0.3568 0.5490 0.5217 0.1579 0.3333 0.7500 0.5151 0.1263 192-DS 0.0000 0.2500 0.4286 0.4917 1.0000 0.3980 0.3038 0.2417 1.0000 0.7634 0.1117 0.0001 0.2175 0.0000 0.5000 0.3053 0.1949 193-DS 0.4615 1.0000 1.0000 1.0000 1.0000 0.9295 0.1860 0.0000 0.5385 0.2001 0.9046 0.8699 0.1221 1.0000 1.0000 1.0000 0.0000 194-DS 0.0968 0.3977 0.6667 0.9643 1.0000 0.6299 0.3120 0.5666 0.9032 0.4954 0.5174 0.3616 0.2493 0.0968 1.0000 0.6299 0.3120 195-DS 0.8421 1.0000 1.0000 1.0000 1.0000 0.9767 0.0501 0.0000 0.1579 0.0513 0.9755 0.9741 0.0372 1.0000 1.0000 1.0000 0.0000 196-DS 0.0000 0.5625 1.0000 1.0000 1.0000 0.7652 0.3637 0.4375 1.0000 0.4753 0.1879 0.0001 0.2863 0.0000 1.0000 0.7652 0.3637 197-DS 0.4107 0.7083 1.0000 1.0000 1.0000 0.8565 0.2126 0.2917 0.5893 0.2482 0.8246 0.7845 0.1721 0.4107 1.0000 0.8565 0.2126 198-DS 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 0.0000 0.0000 0.0000 0.0000 1.0000 1.0000 0.0000 1.0000 1.0000 1.0000 0.0000 199-DS 0.0333 0.0526 1.0000 1.0000 1.0000 0.6199 0.4820 0.9474 0.9667 0.7775 0.2972 0.1091 0.4561 0.0333 1.0000 0.6199 0.4820 200-DS 0.4000 0.4659 0.6000 1.0000 1.0000 0.7099 0.2600 0.5341 0.6000 0.3663 0.6646 0.6220 0.2374 0.4000 1.0000 0.7099 0.2600 154 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2EN-CLEF2007 Statistics for Precision at the 10% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0437 0.6087 0.6923 0.7816 0.9143 0.6266 0.2577 0.1729 0.8705 0.4112 0.4900 0.2371 0.1732 0.5556 0.9143 0.7161 0.1112 177-DS 0.0594 0.1087 0.2209 0.5422 1.0000 0.3510 0.3051 0.4335 0.9406 0.8693 0.2389 0.1632 0.2443 0.0594 1.0000 0.3510 0.3051 178-DS 0.0436 0.1428 0.2727 0.5359 0.8333 0.3677 0.2827 0.3931 0.7897 0.7689 0.2539 0.1564 0.2362 0.0436 0.8333 0.3677 0.2827 179-DS 0.0268 0.3754 0.5500 0.6721 0.8667 0.4974 0.2421 0.2968 0.8398 0.4866 0.3764 0.1738 0.1901 0.0268 0.8667 0.4974 0.2421 180-DS 0.7944 0.8330 0.8800 0.9094 0.9524 0.8739 0.0517 0.0764 0.1580 0.0592 0.8725 0.8710 0.0421 0.7944 0.9524 0.8739 0.0517 181-DS 0.0000 0.2795 0.3750 0.4861 1.0000 0.3907 0.2431 0.2066 1.0000 0.6221 0.1016 0.0001 0.1640 0.0000 0.6667 0.3472 0.1817 182-DS 0.0000 0.0814 0.1207 0.1955 0.2273 0.1243 0.0719 0.1141 0.2273 0.5789 0.0376 0.0001 0.0563 0.0000 0.2273 0.1243 0.0719 183-DS 0.0733 0.2356 0.5667 0.8534 0.9474 0.5269 0.3102 0.6178 0.8741 0.5886 0.4078 0.2749 0.2585 0.0733 0.9474 0.5269 0.3102 184-DS 0.0662 0.2687 0.5714 0.6799 0.8615 0.4982 0.2626 0.4112 0.7954 0.5270 0.3944 0.2589 0.2155 0.0662 0.8615 0.4982 0.2626 185-DS 0.0000 0.0991 0.3061 0.3709 0.6087 0.2610 0.1799 0.2717 0.6087 0.6891 0.0618 0.0001 0.1472 0.0000 0.6087 0.2610 0.1799 186-DS 0.0500 0.0719 0.1159 0.1516 0.7500 0.1859 0.1938 0.0797 0.7000 1.0424 0.1312 0.1035 0.1361 0.0500 0.1522 0.1009 0.0382 187-DS 0.0000 0.5415 0.7260 0.8197 0.9219 0.6432 0.2896 0.2781 0.9219 0.4503 0.1640 0.0001 0.2123 0.5091 0.9219 0.7422 0.1353 188-DS 0.4343 0.7953 0.8750 0.9091 0.9535 0.8215 0.1493 0.1138 0.5191 0.1818 0.8053 0.7849 0.1113 0.6604 0.9535 0.8703 0.0763 189-DS 0.0000 0.0138 0.0893 0.1111 0.2917 0.0824 0.0766 0.0973 0.2917 0.9306 0.0204 0.0001 0.0549 0.0000 0.1579 0.0674 0.0521 190-DS 0.0000 0.2153 0.2558 0.2893 1.0000 0.2912 0.2336 0.0740 1.0000 0.8022 0.0758 0.0001 0.1343 0.2000 0.3333 0.2566 0.0377 191-DS 0.0429 0.1055 0.3600 0.4187 0.5000 0.2779 0.1672 0.3133 0.4571 0.6018 0.2099 0.1388 0.1512 0.0429 0.5000 0.2779 0.1672 192-DS 0.0000 0.0446 0.2973 0.3552 0.4000 0.2139 0.1615 0.3105 0.4000 0.7552 0.0293 0.0000 0.1478 0.0000 0.4000 0.2139 0.1615 193-DS 0.1627 0.3862 0.7467 0.8499 0.9800 0.6559 0.2854 0.4637 0.8173 0.4351 0.5670 0.4531 0.2316 0.1627 0.9800 0.6559 0.2854 194-DS 0.0656 0.0971 0.3519 0.5787 0.7632 0.3681 0.2563 0.4816 0.6976 0.6962 0.2633 0.1746 0.2286 0.0656 0.7632 0.3681 0.2563 195-DS 0.2706 0.6024 0.8000 0.9234 0.9677 0.7389 0.2251 0.3210 0.6972 0.3046 0.6942 0.6338 0.1784 0.2706 0.9677 0.7389 0.2251 196-DS 0.0000 0.2065 0.4348 0.6250 1.0000 0.4317 0.2823 0.4185 1.0000 0.6539 0.1056 0.0001 0.2328 0.0000 1.0000 0.4317 0.2823 197-DS 0.2126 0.4095 0.7273 0.8101 1.0000 0.6018 0.2616 0.4006 0.7874 0.4347 0.5411 0.4785 0.2389 0.2126 1.0000 0.6018 0.2616 198-DS 0.4528 0.5863 0.7500 0.9206 0.9643 0.7442 0.1896 0.3342 0.5115 0.2547 0.7191 0.6921 0.1589 0.4528 0.9643 0.7442 0.1896 199-DS 0.0000 0.0146 0.4286 0.7185 0.8889 0.4002 0.3556 0.7039 0.8889 0.8886 0.0534 0.0001 0.3123 0.0000 0.8889 0.4002 0.3556 200-DS 0.1705 0.2007 0.2609 0.3149 0.4118 0.2698 0.0782 0.1142 0.2413 0.2899 0.2597 0.2502 0.0643 0.1705 0.4118 0.2698 0.0782 155 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2EN-CLEF2007 Statistics for Precision at the 20% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.2326 0.4390 0.6076 0.9143 0.4246 0.2509 0.3750 0.9143 0.5909 0.1080 0.0001 0.1980 0.0000 0.9143 0.4246 0.2509 177-DS 0.0223 0.0402 0.1846 0.2132 0.2500 0.1397 0.0857 0.1730 0.2277 0.6136 0.1040 0.0689 0.0773 0.0223 0.2500 0.1397 0.0857 178-DS 0.0000 0.0737 0.2213 0.4710 0.8333 0.3091 0.3064 0.3973 0.8333 0.9915 0.0607 0.0001 0.2600 0.0000 0.8333 0.3091 0.3064 179-DS 0.0000 0.3519 0.4262 0.6190 0.6818 0.4410 0.2146 0.2671 0.6818 0.4867 0.1992 0.0001 0.1641 0.0000 0.6818 0.4410 0.2146 180-DS 0.7282 0.7946 0.8444 0.8824 0.8977 0.8370 0.0530 0.0877 0.1696 0.0633 0.8354 0.8337 0.0460 0.7282 0.8977 0.8370 0.0530 181-DS 0.0000 0.2174 0.3750 0.4427 1.0000 0.3501 0.2376 0.2253 1.0000 0.6785 0.0905 0.0001 0.1646 0.0000 0.4667 0.3037 0.1612 182-DS 0.0000 0.0469 0.1204 0.1346 0.2273 0.1000 0.0626 0.0877 0.2273 0.6265 0.0302 0.0001 0.0500 0.0000 0.2273 0.1000 0.0626 183-DS 0.0000 0.1922 0.3483 0.7020 0.9394 0.4140 0.3025 0.5098 0.9394 0.7308 0.1707 0.0001 0.2444 0.0000 0.9394 0.4140 0.3025 184-DS 0.0000 0.0379 0.3482 0.6393 0.7849 0.3489 0.2895 0.6014 0.7849 0.8296 0.0247 0.0000 0.2319 0.0000 0.7849 0.3489 0.2895 185-DS 0.0000 0.0606 0.1623 0.3291 0.6087 0.1943 0.1734 0.2685 0.6087 0.8926 0.0268 0.0000 0.1398 0.0000 0.6087 0.1943 0.1734 186-DS 0.0359 0.0393 0.0660 0.0888 0.6667 0.1146 0.1605 0.0495 0.6307 1.4014 0.0744 0.0598 0.0931 0.0359 0.0902 0.0564 0.0202 187-DS 0.0000 0.4626 0.6456 0.7634 0.8917 0.5865 0.2774 0.3008 0.8917 0.4730 0.1502 0.0001 0.2065 0.4464 0.8917 0.6767 0.1537 188-DS 0.3305 0.5537 0.8313 0.8965 0.9082 0.7312 0.1940 0.3428 0.5777 0.2653 0.7018 0.6667 0.1633 0.3305 0.9082 0.7312 0.1940 189-DS 0.0000 0.0093 0.0675 0.0931 0.1746 0.0627 0.0511 0.0838 0.1746 0.8152 0.0106 0.0000 0.0402 0.0000 0.1746 0.0627 0.0511 190-DS 0.0000 0.2153 0.2476 0.2727 0.8462 0.2573 0.1876 0.0575 0.8462 0.7290 0.0701 0.0001 0.0948 0.1944 0.3243 0.2511 0.0343 191-DS 0.0361 0.0482 0.0941 0.2688 0.3333 0.1620 0.1175 0.2206 0.2972 0.7250 0.1181 0.0847 0.1091 0.0361 0.3333 0.1620 0.1175 192-DS 0.0000 0.0273 0.0753 0.2363 0.3239 0.1244 0.1213 0.2090 0.3239 0.9743 0.0168 0.0000 0.1098 0.0000 0.3239 0.1244 0.1213 193-DS 0.0000 0.2067 0.6714 0.8265 0.9524 0.5598 0.3418 0.6198 0.9524 0.6107 0.1279 0.0001 0.2867 0.0000 0.9524 0.5598 0.3418 194-DS 0.0569 0.0875 0.3108 0.5245 0.7297 0.3312 0.2494 0.4370 0.6728 0.7529 0.2294 0.1500 0.2165 0.0569 0.7297 0.3312 0.2494 195-DS 0.1473 0.4804 0.7355 0.8772 0.9375 0.6593 0.2654 0.3969 0.7902 0.4025 0.5818 0.4714 0.2198 0.1473 0.9375 0.6593 0.2654 196-DS 0.0000 0.1270 0.3231 0.5801 0.6923 0.3587 0.2451 0.4530 0.6923 0.6831 0.0799 0.0001 0.2063 0.0000 0.6923 0.3587 0.2451 197-DS 0.1362 0.3290 0.3933 0.7101 0.9787 0.4808 0.2596 0.3811 0.8425 0.5400 0.4100 0.3394 0.2122 0.1362 0.9787 0.4808 0.2596 198-DS 0.1143 0.4839 0.6579 0.7827 0.8387 0.6055 0.2293 0.2988 0.7244 0.3787 0.5326 0.4145 0.1748 0.1143 0.8387 0.6055 0.2293 199-DS 0.0000 0.0000 0.2344 0.3857 0.5667 0.2167 0.2025 0.3857 0.5667 0.9342 0.0053 0.0000 0.1747 0.0000 0.5667 0.2167 0.2025 200-DS 0.0993 0.1759 0.1849 0.2576 0.4111 0.2072 0.0768 0.0817 0.3118 0.3708 0.1950 0.1833 0.0557 0.0993 0.2755 0.1926 0.0542 156 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2EN-CLEF2007 Statistics for Precision at the 30% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0145 0.3542 0.6076 0.9143 0.3550 0.2914 0.5931 0.9143 0.8210 0.0242 0.0000 0.2340 0.0000 0.9143 0.3550 0.2914 177-DS 0.0000 0.0123 0.0995 0.1443 0.2209 0.0899 0.0732 0.1321 0.2209 0.8143 0.0093 0.0000 0.0597 0.0000 0.2209 0.0899 0.0732 178-DS 0.0000 0.0524 0.2213 0.3219 0.6250 0.2112 0.1997 0.2694 0.6250 0.9453 0.0268 0.0000 0.1641 0.0000 0.6250 0.2112 0.1997 179-DS 0.0000 0.2809 0.3627 0.5893 0.6600 0.3829 0.2075 0.3084 0.6600 0.5418 0.1015 0.0001 0.1573 0.0000 0.6600 0.3829 0.2075 180-DS 0.5207 0.6111 0.7152 0.8294 0.8779 0.7165 0.1161 0.2182 0.3571 0.1620 0.7075 0.6984 0.0993 0.5207 0.8779 0.7165 0.1161 181-DS 0.0000 0.1970 0.3750 0.4427 0.7500 0.3262 0.1967 0.2457 0.7500 0.6028 0.0859 0.0001 0.1540 0.0000 0.7500 0.3262 0.1967 182-DS 0.0000 0.0352 0.0729 0.1092 0.1966 0.0738 0.0514 0.0741 0.1966 0.6970 0.0227 0.0001 0.0378 0.0000 0.1966 0.0738 0.0514 183-DS 0.0000 0.1607 0.2893 0.5750 0.8519 0.3430 0.2745 0.4143 0.8519 0.8003 0.0816 0.0001 0.2210 0.0000 0.8519 0.3430 0.2745 184-DS 0.0000 0.0000 0.2126 0.4237 0.6207 0.2482 0.2208 0.4237 0.6207 0.8896 0.0105 0.0000 0.1895 0.0000 0.6207 0.2482 0.2208 185-DS 0.0000 0.0129 0.1289 0.2412 0.5057 0.1489 0.1449 0.2282 0.5057 0.9732 0.0123 0.0000 0.1169 0.0000 0.5057 0.1489 0.1449 186-DS 0.0172 0.0306 0.0563 0.0744 0.3810 0.0744 0.0886 0.0438 0.3637 1.1915 0.0531 0.0428 0.0473 0.0172 0.1070 0.0525 0.0266 187-DS 0.0000 0.3547 0.5535 0.7241 0.8297 0.5009 0.2557 0.3695 0.8297 0.5105 0.1291 0.0001 0.2019 0.0000 0.8297 0.5009 0.2557 188-DS 0.1923 0.4823 0.6168 0.8313 0.9037 0.6314 0.2244 0.3490 0.7114 0.3555 0.5819 0.5176 0.1772 0.1923 0.9037 0.6314 0.2244 189-DS 0.0000 0.0000 0.0553 0.0749 0.1111 0.0451 0.0369 0.0749 0.1111 0.8192 0.0035 0.0000 0.0313 0.0000 0.1111 0.0451 0.0369 190-DS 0.0000 0.1975 0.2195 0.2397 0.7805 0.2332 0.1727 0.0422 0.7805 0.7404 0.0643 0.0001 0.0858 0.1944 0.2909 0.2265 0.0281 191-DS 0.0309 0.0441 0.0787 0.2314 0.2561 0.1262 0.0891 0.1873 0.2252 0.7059 0.0961 0.0724 0.0769 0.0309 0.2561 0.1262 0.0891 192-DS 0.0000 0.0000 0.0585 0.2175 0.3028 0.1029 0.1119 0.2175 0.3028 1.0875 0.0031 0.0000 0.0994 0.0000 0.3028 0.1029 0.1119 193-DS 0.0000 0.0672 0.4982 0.6703 0.8373 0.4313 0.3122 0.6031 0.8373 0.7238 0.0301 0.0000 0.2701 0.0000 0.8373 0.4313 0.3122 194-DS 0.0000 0.0000 0.1811 0.5245 0.7059 0.2552 0.2781 0.5245 0.7059 1.0900 0.0054 0.0000 0.2387 0.0000 0.7059 0.2552 0.2781 195-DS 0.0000 0.2604 0.6570 0.7993 0.8654 0.5297 0.3153 0.5389 0.8654 0.5952 0.1280 0.0001 0.2795 0.0000 0.8654 0.5297 0.3153 196-DS 0.0000 0.0514 0.3231 0.4041 0.5185 0.2702 0.1842 0.3527 0.5185 0.6815 0.0219 0.0000 0.1528 0.0000 0.5185 0.2702 0.1842 197-DS 0.0624 0.2242 0.3041 0.6053 0.9286 0.3891 0.2550 0.3811 0.8661 0.6553 0.3055 0.2214 0.2083 0.0624 0.9286 0.3891 0.2550 198-DS 0.0000 0.3667 0.5615 0.7106 0.8105 0.5182 0.2458 0.3438 0.8105 0.4744 0.2390 0.0001 0.1863 0.0000 0.8105 0.5182 0.2458 199-DS 0.0000 0.0000 0.1913 0.2272 0.4423 0.1662 0.1640 0.2272 0.4423 0.9868 0.0044 0.0000 0.1330 0.0000 0.4423 0.1662 0.1640 200-DS 0.0527 0.0931 0.1258 0.1776 0.3738 0.1491 0.0834 0.0845 0.3211 0.5591 0.1304 0.1142 0.0611 0.0527 0.2442 0.1331 0.0577 157 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2EN-CLEF2007 Statistics for Precision at the 40% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.3429 0.6046 0.8182 0.3278 0.2811 0.6046 0.8182 0.8575 0.0129 0.0000 0.2257 0.0000 0.8182 0.3278 0.2811 177-DS 0.0000 0.0101 0.0881 0.1119 0.1933 0.0719 0.0585 0.1017 0.1933 0.8137 0.0078 0.0000 0.0495 0.0000 0.1933 0.0719 0.0585 178-DS 0.0000 0.0000 0.1851 0.2626 0.3708 0.1354 0.1381 0.2626 0.3708 1.0195 0.0022 0.0000 0.1264 0.0000 0.3708 0.1354 0.1381 179-DS 0.0000 0.2569 0.3052 0.5482 0.5946 0.3466 0.1938 0.2912 0.5946 0.5592 0.0925 0.0001 0.1511 0.0000 0.5946 0.3466 0.1938 180-DS 0.2549 0.4574 0.6224 0.7501 0.7865 0.5857 0.1734 0.2927 0.5316 0.2960 0.5579 0.5264 0.1476 0.2549 0.7865 0.5857 0.1734 181-DS 0.0000 0.1832 0.3750 0.3820 0.5000 0.2872 0.1543 0.1988 0.5000 0.5371 0.0785 0.0001 0.1308 0.0000 0.5000 0.2872 0.1543 182-DS 0.0000 0.0086 0.0555 0.0840 0.1632 0.0543 0.0464 0.0754 0.1632 0.8555 0.0063 0.0000 0.0363 0.0000 0.1632 0.0543 0.0464 183-DS 0.0000 0.1126 0.2440 0.5117 0.7949 0.2961 0.2521 0.3990 0.7949 0.8515 0.0684 0.0001 0.2038 0.0000 0.7949 0.2961 0.2521 184-DS 0.0000 0.0000 0.1834 0.3425 0.5333 0.1809 0.1970 0.3425 0.5333 1.0889 0.0025 0.0000 0.1689 0.0000 0.5333 0.1809 0.1970 185-DS 0.0000 0.0000 0.0853 0.1527 0.2781 0.0943 0.0972 0.1527 0.2781 1.0307 0.0031 0.0000 0.0806 0.0000 0.2781 0.0943 0.0972 186-DS 0.0000 0.0267 0.0454 0.0586 0.2396 0.0543 0.0568 0.0319 0.2396 1.0460 0.0162 0.0001 0.0332 0.0000 0.0888 0.0411 0.0255 187-DS 0.0000 0.2935 0.4620 0.6489 0.6623 0.4335 0.2232 0.3554 0.6623 0.5147 0.1135 0.0001 0.1749 0.0000 0.6623 0.4335 0.2232 188-DS 0.0000 0.3820 0.4299 0.7173 0.8235 0.4923 0.2365 0.3353 0.8235 0.4803 0.2376 0.0001 0.1883 0.0000 0.8235 0.4923 0.2365 189-DS 0.0000 0.0000 0.0374 0.0457 0.1111 0.0353 0.0328 0.0457 0.1111 0.9301 0.0029 0.0000 0.0248 0.0000 0.1111 0.0353 0.0328 190-DS 0.0000 0.1877 0.2167 0.2298 0.6935 0.2183 0.1531 0.0421 0.6935 0.7013 0.0612 0.0001 0.0751 0.1660 0.2605 0.2151 0.0251 191-DS 0.0000 0.0402 0.0787 0.1733 0.2185 0.0976 0.0740 0.1331 0.2185 0.7587 0.0167 0.0000 0.0620 0.0000 0.2185 0.0976 0.0740 192-DS 0.0000 0.0000 0.0527 0.1615 0.2273 0.0769 0.0867 0.1615 0.2273 1.1268 0.0016 0.0000 0.0774 0.0000 0.2273 0.0769 0.0867 193-DS 0.0000 0.0000 0.4186 0.5568 0.7664 0.3452 0.2852 0.5568 0.7664 0.8262 0.0134 0.0000 0.2484 0.0000 0.7664 0.3452 0.2852 194-DS 0.0000 0.0000 0.1212 0.4894 0.6200 0.2184 0.2509 0.4894 0.6200 1.1489 0.0048 0.0000 0.2208 0.0000 0.6200 0.2184 0.2509 195-DS 0.0000 0.0631 0.5422 0.7191 0.8287 0.4425 0.3221 0.6560 0.8287 0.7280 0.0305 0.0000 0.2863 0.0000 0.8287 0.4425 0.3221 196-DS 0.0000 0.0456 0.3000 0.3355 0.4222 0.2312 0.1548 0.2899 0.4222 0.6695 0.0196 0.0000 0.1298 0.0000 0.4222 0.2312 0.1548 197-DS 0.0000 0.1976 0.2323 0.4432 0.7841 0.3056 0.2291 0.2457 0.7841 0.7495 0.0774 0.0001 0.1780 0.0000 0.7841 0.3056 0.2291 198-DS 0.0000 0.2881 0.4795 0.6075 0.7680 0.4388 0.2326 0.3195 0.7680 0.5299 0.1134 0.0001 0.1761 0.0000 0.7680 0.4388 0.2326 199-DS 0.0000 0.0000 0.1623 0.2255 0.3053 0.1323 0.1200 0.2255 0.3053 0.9076 0.0040 0.0000 0.1058 0.0000 0.3053 0.1323 0.1200 200-DS 0.0000 0.0649 0.0969 0.1316 0.2598 0.1008 0.0646 0.0667 0.2598 0.6413 0.0310 0.0001 0.0469 0.0000 0.1661 0.0894 0.0491 158 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2EN-CLEF2007 Statistics for Precision at the 50% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.2368 0.5931 0.7759 0.2943 0.2778 0.5931 0.7759 0.9439 0.0115 0.0000 0.2323 0.0000 0.7759 0.2943 0.2778 177-DS 0.0000 0.0000 0.0407 0.0810 0.1230 0.0446 0.0441 0.0810 0.1230 0.9881 0.0020 0.0000 0.0381 0.0000 0.1230 0.0446 0.0441 178-DS 0.0000 0.0000 0.0935 0.1513 0.2253 0.0858 0.0878 0.1513 0.2253 1.0226 0.0017 0.0000 0.0801 0.0000 0.2253 0.0858 0.0878 179-DS 0.0000 0.2019 0.2607 0.4849 0.5895 0.3073 0.1857 0.2830 0.5895 0.6044 0.0817 0.0001 0.1478 0.0000 0.5895 0.3073 0.1857 180-DS 0.2544 0.2845 0.5599 0.6563 0.7121 0.4891 0.1807 0.3718 0.4577 0.3693 0.4545 0.4196 0.1628 0.2544 0.7121 0.4891 0.1807 181-DS 0.0000 0.1832 0.3333 0.3805 0.4500 0.2777 0.1464 0.1973 0.4500 0.5271 0.0766 0.0001 0.1231 0.0000 0.4500 0.2777 0.1464 182-DS 0.0000 0.0000 0.0461 0.0736 0.1418 0.0406 0.0447 0.0736 0.1418 1.1001 0.0011 0.0000 0.0379 0.0000 0.1418 0.0406 0.0447 183-DS 0.0000 0.0000 0.1886 0.3781 0.6909 0.2159 0.2266 0.3781 0.6909 1.0493 0.0090 0.0000 0.1777 0.0000 0.6909 0.2159 0.2266 184-DS 0.0000 0.0000 0.0000 0.2905 0.4072 0.1421 0.1667 0.2905 0.4072 1.1727 0.0012 0.0000 0.1516 0.0000 0.4072 0.1421 0.1667 185-DS 0.0000 0.0000 0.0000 0.1144 0.1707 0.0467 0.0712 0.1144 0.1707 1.5268 0.0002 0.0000 0.0622 0.0000 0.1707 0.0467 0.0712 186-DS 0.0000 0.0000 0.0282 0.0492 0.1508 0.0344 0.0405 0.0492 0.1508 1.1763 0.0017 0.0000 0.0292 0.0000 0.0699 0.0261 0.0255 187-DS 0.0000 0.0756 0.3934 0.5267 0.5878 0.3445 0.2311 0.4511 0.5878 0.6707 0.0262 0.0000 0.1894 0.0000 0.5878 0.3445 0.2311 188-DS 0.0000 0.2818 0.3550 0.5206 0.7208 0.3804 0.2070 0.2387 0.7208 0.5442 0.1009 0.0001 0.1584 0.0000 0.7208 0.3804 0.2070 189-DS 0.0000 0.0000 0.0350 0.0406 0.0917 0.0305 0.0269 0.0406 0.0917 0.8817 0.0027 0.0000 0.0204 0.0000 0.0917 0.0305 0.0269 190-DS 0.0000 0.1383 0.2022 0.2270 0.6588 0.1984 0.1500 0.0887 0.6588 0.7560 0.0548 0.0001 0.0846 0.0966 0.2605 0.1932 0.0468 191-DS 0.0000 0.0116 0.0787 0.1461 0.1780 0.0827 0.0662 0.1345 0.1780 0.8009 0.0087 0.0000 0.0539 0.0000 0.1780 0.0827 0.0662 192-DS 0.0000 0.0000 0.0000 0.1283 0.1538 0.0523 0.0678 0.1283 0.1538 1.2952 0.0004 0.0000 0.0628 0.0000 0.1538 0.0523 0.0678 193-DS 0.0000 0.0000 0.3134 0.4802 0.6453 0.2766 0.2536 0.4802 0.6453 0.9169 0.0061 0.0000 0.2272 0.0000 0.6453 0.2766 0.2536 194-DS 0.0000 0.0000 0.0000 0.4113 0.5374 0.1616 0.2247 0.4113 0.5374 1.3902 0.0007 0.0000 0.2002 0.0000 0.5374 0.1616 0.2247 195-DS 0.0000 0.0000 0.4469 0.6288 0.7035 0.3521 0.3084 0.6288 0.7035 0.8759 0.0072 0.0000 0.2816 0.0000 0.7035 0.3521 0.3084 196-DS 0.0000 0.0456 0.2500 0.2903 0.3239 0.1958 0.1282 0.2447 0.3239 0.6550 0.0174 0.0000 0.1062 0.0000 0.3239 0.1958 0.1282 197-DS 0.0000 0.1629 0.1995 0.3156 0.5724 0.2471 0.1692 0.1527 0.5724 0.6849 0.0662 0.0001 0.1264 0.0000 0.4479 0.1986 0.1197 198-DS 0.0000 0.2722 0.4276 0.5202 0.6486 0.3865 0.1972 0.2480 0.6486 0.5103 0.1026 0.0001 0.1517 0.0000 0.6486 0.3865 0.1972 199-DS 0.0000 0.0000 0.1237 0.2105 0.2449 0.1101 0.1019 0.2105 0.2449 0.9263 0.0035 0.0000 0.0908 0.0000 0.2449 0.1101 0.1019 200-DS 0.0000 0.0000 0.0000 0.1023 0.1994 0.0539 0.0661 0.1023 0.1994 1.2267 0.0008 0.0000 0.0575 0.0000 0.1994 0.0539 0.0661 159 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2EN-CLEF2007 Statistics for Precision at the 60% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.1697 0.5836 0.6923 0.2679 0.2687 0.5836 0.6923 1.0029 0.0104 0.0000 0.2345 0.0000 0.6923 0.2679 0.2687 177-DS 0.0000 0.0000 0.0000 0.0587 0.0740 0.0268 0.0305 0.0587 0.0740 1.1412 0.0006 0.0000 0.0285 0.0000 0.0740 0.0268 0.0305 178-DS 0.0000 0.0000 0.0000 0.0000 0.1306 0.0087 0.0337 0.0000 0.1306 3.8730 0.0000 0.0000 0.0163 0.0000 0.0000 0.0000 0.0000 179-DS 0.0000 0.1899 0.2374 0.3911 0.5546 0.2623 0.1645 0.2012 0.5546 0.6271 0.0695 0.0001 0.1255 0.0000 0.5546 0.2623 0.1645 180-DS 0.0000 0.0000 0.4737 0.5313 0.6164 0.3186 0.2730 0.5313 0.6164 0.8569 0.0068 0.0000 0.2549 0.0000 0.6164 0.3186 0.2730 181-DS 0.0000 0.1689 0.3235 0.3637 0.3824 0.2559 0.1305 0.1948 0.3824 0.5098 0.0718 0.0001 0.1094 0.0000 0.3824 0.2559 0.1305 182-DS 0.0000 0.0000 0.0000 0.0596 0.0839 0.0292 0.0335 0.0596 0.0839 1.1482 0.0006 0.0000 0.0311 0.0000 0.0839 0.0292 0.0335 183-DS 0.0000 0.0000 0.1358 0.2860 0.5636 0.1648 0.1886 0.2860 0.5636 1.1447 0.0042 0.0000 0.1466 0.0000 0.5636 0.1648 0.1886 184-DS 0.0000 0.0000 0.0000 0.2077 0.3354 0.0804 0.1385 0.2077 0.3354 1.7224 0.0002 0.0000 0.1180 0.0000 0.3354 0.0804 0.1385 185-DS 0.0000 0.0000 0.0000 0.0000 0.1080 0.0196 0.0408 0.0000 0.1080 2.0803 0.0001 0.0000 0.0314 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0000 0.0427 0.1328 0.0273 0.0377 0.0427 0.1328 1.3783 0.0005 0.0000 0.0291 0.0000 0.0660 0.0198 0.0247 187-DS 0.0000 0.0000 0.3624 0.4588 0.5034 0.2576 0.2239 0.4588 0.5034 0.8691 0.0060 0.0000 0.2061 0.0000 0.5034 0.2576 0.2239 188-DS 0.0000 0.2230 0.3060 0.3851 0.5886 0.2892 0.1805 0.1621 0.5886 0.6242 0.0428 0.0000 0.1339 0.0000 0.5886 0.2892 0.1805 189-DS 0.0000 0.0000 0.0000 0.0000 0.0672 0.0088 0.0197 0.0000 0.0672 2.2449 0.0001 0.0000 0.0140 0.0000 0.0000 0.0000 0.0000 190-DS 0.0000 0.1123 0.1768 0.2242 0.4961 0.1764 0.1184 0.1119 0.4961 0.6713 0.0499 0.0001 0.0773 0.0000 0.2529 0.1535 0.0817 191-DS 0.0000 0.0116 0.0615 0.1105 0.1773 0.0701 0.0578 0.0989 0.1773 0.8254 0.0077 0.0000 0.0457 0.0000 0.1773 0.0701 0.0578 192-DS 0.0000 0.0000 0.0000 0.1042 0.1175 0.0364 0.0535 0.1042 0.1175 1.4689 0.0002 0.0000 0.0486 0.0000 0.1175 0.0364 0.0535 193-DS 0.0000 0.0000 0.0000 0.4270 0.5673 0.2076 0.2359 0.4270 0.5673 1.1365 0.0015 0.0000 0.2214 0.0000 0.5673 0.2076 0.2359 194-DS 0.0000 0.0000 0.0000 0.3309 0.4680 0.1315 0.1958 0.3309 0.4680 1.4888 0.0003 0.0000 0.1753 0.0000 0.4680 0.1315 0.1958 195-DS 0.0000 0.0000 0.3317 0.5505 0.5864 0.2911 0.2596 0.5505 0.5864 0.8918 0.0064 0.0000 0.2329 0.0000 0.5864 0.2911 0.2596 196-DS 0.0000 0.0456 0.2409 0.2875 0.2903 0.1873 0.1214 0.2419 0.2903 0.6480 0.0169 0.0000 0.1005 0.0000 0.2903 0.1873 0.1214 197-DS 0.0000 0.0314 0.1446 0.2480 0.4078 0.1590 0.1261 0.2166 0.4078 0.7933 0.0143 0.0000 0.0979 0.0000 0.4078 0.1590 0.1261 198-DS 0.0000 0.2107 0.3428 0.4116 0.5292 0.3074 0.1579 0.2009 0.5292 0.5138 0.0842 0.0001 0.1180 0.0000 0.5292 0.3074 0.1579 199-DS 0.0000 0.0000 0.0956 0.1827 0.2172 0.0915 0.0879 0.1827 0.2172 0.9604 0.0031 0.0000 0.0742 0.0000 0.2172 0.0915 0.0879 200-DS 0.0000 0.0000 0.0000 0.0000 0.1629 0.0237 0.0513 0.0000 0.1629 2.1606 0.0001 0.0000 0.0380 0.0000 0.0000 0.0000 0.0000 160 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2EN-CLEF2007 Statistics for Precision at the 70% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.1403 0.5814 0.6216 0.2524 0.2623 0.5814 0.6216 1.0390 0.0097 0.0000 0.2322 0.0000 0.6216 0.2524 0.2623 177-DS 0.0000 0.0000 0.0000 0.0000 0.0417 0.0028 0.0108 0.0000 0.0417 3.8730 0.0000 0.0000 0.0052 0.0000 0.0000 0.0000 0.0000 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0000 0.1576 0.2355 0.3465 0.3665 0.2167 0.1326 0.1889 0.3665 0.6119 0.0340 0.0000 0.1024 0.0000 0.3665 0.2167 0.1326 180-DS 0.0000 0.0000 0.3609 0.4517 0.5647 0.2630 0.2296 0.4517 0.5647 0.8730 0.0060 0.0000 0.2104 0.0000 0.5647 0.2630 0.2296 181-DS 0.0000 0.1650 0.2500 0.3333 0.3824 0.2323 0.1197 0.1683 0.3824 0.5153 0.0662 0.0001 0.0926 0.0000 0.3824 0.2323 0.1197 182-DS 0.0000 0.0000 0.0000 0.0000 0.0558 0.0037 0.0144 0.0000 0.0558 3.8730 0.0000 0.0000 0.0069 0.0000 0.0000 0.0000 0.0000 183-DS 0.0000 0.0000 0.0000 0.1945 0.5024 0.1166 0.1654 0.1945 0.5024 1.4193 0.0010 0.0000 0.1282 0.0000 0.3955 0.0890 0.1312 184-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 185-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0000 0.0293 0.0819 0.0142 0.0260 0.0293 0.0819 1.8297 0.0001 0.0000 0.0208 0.0000 0.0473 0.0094 0.0187 187-DS 0.0000 0.0000 0.0000 0.3806 0.4537 0.1612 0.2058 0.3806 0.4537 1.2768 0.0007 0.0000 0.1934 0.0000 0.4537 0.1612 0.2058 188-DS 0.0000 0.0000 0.2606 0.2820 0.4511 0.1875 0.1689 0.2820 0.4511 0.9011 0.0049 0.0000 0.1500 0.0000 0.4511 0.1875 0.1689 189-DS 0.0000 0.0000 0.0000 0.0000 0.0433 0.0029 0.0112 0.0000 0.0433 3.8730 0.0000 0.0000 0.0054 0.0000 0.0000 0.0000 0.0000 190-DS 0.0000 0.0281 0.1748 0.1789 0.3205 0.1368 0.0982 0.1508 0.3205 0.7181 0.0131 0.0000 0.0795 0.0000 0.3205 0.1368 0.0982 191-DS 0.0000 0.0000 0.0466 0.0794 0.1368 0.0446 0.0489 0.0794 0.1368 1.0966 0.0012 0.0000 0.0416 0.0000 0.1368 0.0446 0.0489 192-DS 0.0000 0.0000 0.0000 0.0789 0.0924 0.0284 0.0417 0.0789 0.0924 1.4699 0.0002 0.0000 0.0378 0.0000 0.0924 0.0284 0.0417 193-DS 0.0000 0.0000 0.0000 0.3475 0.4807 0.1305 0.1940 0.3475 0.4807 1.4864 0.0003 0.0000 0.1741 0.0000 0.4807 0.1305 0.1940 194-DS 0.0000 0.0000 0.0000 0.2688 0.3945 0.1087 0.1620 0.2688 0.3945 1.4905 0.0003 0.0000 0.1449 0.0000 0.3945 0.1087 0.1620 195-DS 0.0000 0.0000 0.0000 0.4332 0.4914 0.1813 0.2307 0.4332 0.4914 1.2722 0.0007 0.0000 0.2176 0.0000 0.4914 0.1813 0.2307 196-DS 0.0000 0.0428 0.2177 0.2213 0.2500 0.1595 0.1014 0.1785 0.2500 0.6355 0.0151 0.0000 0.0851 0.0000 0.2500 0.1595 0.1014 197-DS 0.0000 0.0000 0.0000 0.1017 0.3210 0.0550 0.1018 0.1017 0.3210 1.8528 0.0001 0.0000 0.0806 0.0000 0.2108 0.0360 0.0731 198-DS 0.0000 0.0553 0.2456 0.3126 0.3889 0.2100 0.1396 0.2573 0.3889 0.6647 0.0183 0.0000 0.1120 0.0000 0.3889 0.2100 0.1396 199-DS 0.0000 0.0000 0.0617 0.1454 0.2049 0.0701 0.0806 0.1454 0.2049 1.1501 0.0015 0.0000 0.0665 0.0000 0.2049 0.0701 0.0806 200-DS 0.0000 0.0000 0.0000 0.0000 0.1420 0.0095 0.0367 0.0000 0.1420 3.8730 0.0000 0.0000 0.0177 0.0000 0.0000 0.0000 0.0000 161 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2EN-CLEF2007 Statistics for Precision at the 80% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0898 0.5193 0.5581 0.2103 0.2477 0.5193 0.5581 1.1782 0.0026 0.0000 0.2237 0.0000 0.5581 0.2103 0.2477 177-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0000 0.0364 0.2217 0.3188 0.3346 0.1864 0.1307 0.2824 0.3346 0.7013 0.0165 0.0000 0.1073 0.0000 0.3346 0.1864 0.1307 180-DS 0.0000 0.0000 0.0000 0.3456 0.3945 0.1230 0.1805 0.3456 0.3945 1.4670 0.0003 0.0000 0.1640 0.0000 0.3945 0.1230 0.1805 181-DS 0.0000 0.0996 0.1389 0.3122 0.3750 0.1880 0.1302 0.2126 0.3750 0.6929 0.0504 0.0001 0.1149 0.0000 0.3750 0.1880 0.1302 182-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 183-DS 0.0000 0.0000 0.0000 0.1243 0.3836 0.0688 0.1256 0.1243 0.3836 1.8248 0.0001 0.0000 0.1010 0.0000 0.2591 0.0464 0.0939 184-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 185-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 188-DS 0.0000 0.0000 0.0000 0.0000 0.3350 0.0432 0.1140 0.0000 0.3350 2.6408 0.0000 0.0000 0.0748 0.0000 0.0000 0.0000 0.0000 189-DS 0.0000 0.0000 0.0000 0.0000 0.0396 0.0026 0.0102 0.0000 0.0396 3.8730 0.0000 0.0000 0.0049 0.0000 0.0000 0.0000 0.0000 190-DS 0.0000 0.0255 0.1352 0.1713 0.2931 0.1178 0.0874 0.1458 0.2931 0.7424 0.0117 0.0000 0.0672 0.0000 0.2931 0.1178 0.0874 191-DS 0.0000 0.0000 0.0000 0.0447 0.0967 0.0202 0.0354 0.0447 0.0967 1.7531 0.0001 0.0000 0.0296 0.0000 0.0967 0.0202 0.0354 192-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 193-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 194-DS 0.0000 0.0000 0.0000 0.0000 0.2942 0.0578 0.1196 0.0000 0.2942 2.0704 0.0001 0.0000 0.0924 0.0000 0.0000 0.0000 0.0000 195-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 196-DS 0.0000 0.0309 0.1809 0.2028 0.2118 0.1354 0.0876 0.1719 0.2118 0.6468 0.0133 0.0000 0.0738 0.0000 0.2118 0.1354 0.0876 197-DS 0.0000 0.0000 0.0000 0.0000 0.2096 0.0140 0.0541 0.0000 0.2096 3.8730 0.0000 0.0000 0.0261 0.0000 0.0000 0.0000 0.0000 198-DS 0.0000 0.0000 0.0000 0.1609 0.2370 0.0604 0.1038 0.1609 0.2370 1.7184 0.0001 0.0000 0.0886 0.0000 0.2370 0.0604 0.1038 199-DS 0.0000 0.0000 0.0000 0.0946 0.1597 0.0395 0.0681 0.0946 0.1597 1.7260 0.0001 0.0000 0.0579 0.0000 0.1597 0.0395 0.0681 200-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 162 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2EN-CLEF2007 Statistics for Precision at the 90% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.3502 0.4355 0.1364 0.1876 0.3502 0.4355 1.3748 0.0006 0.0000 0.1637 0.0000 0.4355 0.1364 0.1876 177-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0000 0.0000 0.1135 0.2528 0.2789 0.1328 0.1127 0.2528 0.2789 0.8488 0.0070 0.0000 0.0994 0.0000 0.2789 0.1328 0.1127 180-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 181-DS 0.0000 0.0000 0.0487 0.1222 0.2048 0.0696 0.0780 0.1222 0.2048 1.1202 0.0025 0.0000 0.0646 0.0000 0.2048 0.0696 0.0780 182-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 183-DS 0.0000 0.0000 0.0000 0.0000 0.2437 0.0258 0.0707 0.0000 0.2437 2.7392 0.0000 0.0000 0.0447 0.0000 0.0000 0.0000 0.0000 184-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 185-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 188-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 189-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 190-DS 0.0000 0.0244 0.1211 0.1534 0.1739 0.1008 0.0673 0.1290 0.1739 0.6679 0.0107 0.0000 0.0542 0.0000 0.1739 0.1008 0.0673 191-DS 0.0000 0.0000 0.0000 0.0000 0.0609 0.0041 0.0157 0.0000 0.0609 3.8730 0.0000 0.0000 0.0076 0.0000 0.0000 0.0000 0.0000 192-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 193-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 194-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 195-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 196-DS 0.0000 0.0000 0.1475 0.1574 0.1889 0.1010 0.0767 0.1574 0.1889 0.7596 0.0061 0.0000 0.0674 0.0000 0.1889 0.1010 0.0767 197-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 198-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 199-DS 0.0000 0.0000 0.0000 0.0000 0.0825 0.0158 0.0328 0.0000 0.0825 2.0724 0.0001 0.0000 0.0253 0.0000 0.0000 0.0000 0.0000 200-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 163 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2EN-CLEF2007 Statistics for Precision at the 100% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 177-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 180-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 181-DS 0.0000 0.0000 0.0000 0.0139 0.0367 0.0066 0.0120 0.0139 0.0367 1.8071 0.0001 0.0000 0.0097 0.0000 0.0231 0.0045 0.0090 182-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 183-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 184-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 185-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 188-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 189-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 190-DS 0.0000 0.0000 0.0000 0.0868 0.1415 0.0342 0.0589 0.0868 0.1415 1.7231 0.0001 0.0000 0.0501 0.0000 0.1415 0.0342 0.0589 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 193-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 194-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 195-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 196-DS 0.0000 0.0000 0.0000 0.0420 0.0659 0.0162 0.0279 0.0420 0.0659 1.7219 0.0001 0.0000 0.0237 0.0000 0.0659 0.0162 0.0279 197-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 198-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 199-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 200-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 164 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2EN-CLEF2007 Statistics for P@5 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.2000 0.8000 0.8000 1.0000 1.0000 0.8000 0.2726 0.2000 0.8000 0.3407 0.7240 0.6020 0.1867 0.6000 1.0000 0.8923 0.1320 177-DS 0.0000 0.0000 0.2000 0.5500 1.0000 0.3333 0.3352 0.5500 1.0000 1.0057 0.0122 0.0000 0.2756 0.0000 1.0000 0.3333 0.3352 178-DS 0.0000 0.2500 0.4000 0.6000 0.8000 0.4400 0.2849 0.3500 0.8000 0.6474 0.0587 0.0000 0.2293 0.0000 0.8000 0.4400 0.2849 179-DS 0.0000 0.2500 0.4000 0.7500 1.0000 0.4533 0.2973 0.5000 1.0000 0.6558 0.1114 0.0001 0.2311 0.0000 1.0000 0.4533 0.2973 180-DS 0.8000 0.8000 1.0000 1.0000 1.0000 0.9200 0.1014 0.2000 0.2000 0.1102 0.9146 0.9091 0.0960 0.8000 1.0000 0.9200 0.1014 181-DS 0.0000 0.0000 0.2000 0.3500 1.0000 0.2000 0.2726 0.3500 1.0000 1.3628 0.0025 0.0000 0.1867 0.0000 0.4000 0.1429 0.1651 182-DS 0.0000 0.0000 0.0000 0.4000 0.4000 0.1467 0.1922 0.4000 0.4000 1.3107 0.0007 0.0000 0.1760 0.0000 0.4000 0.1467 0.1922 183-DS 0.0000 0.2000 0.8000 1.0000 1.0000 0.5467 0.4307 0.8000 1.0000 0.7879 0.0623 0.0000 0.4036 0.0000 1.0000 0.5467 0.4307 184-DS 0.0000 0.6000 0.8000 0.8000 1.0000 0.6533 0.2973 0.2000 1.0000 0.4550 0.1656 0.0001 0.2222 0.4000 1.0000 0.7538 0.1450 185-DS 0.0000 0.2000 0.2000 0.4000 0.4000 0.2533 0.1407 0.2000 0.4000 0.5556 0.0705 0.0001 0.1173 0.0000 0.4000 0.2533 0.1407 186-DS 0.0000 0.2000 0.2000 0.4000 0.8000 0.2800 0.1971 0.2000 0.8000 0.7040 0.0738 0.0001 0.1493 0.0000 0.4000 0.2429 0.1399 187-DS 0.0000 0.2500 0.8000 0.8000 0.8000 0.5733 0.3195 0.5500 0.8000 0.5573 0.1383 0.0001 0.2756 0.0000 0.8000 0.5733 0.3195 188-DS 0.8000 0.8500 1.0000 1.0000 1.0000 0.9467 0.0915 0.1500 0.2000 0.0967 0.9422 0.9375 0.0782 0.8000 1.0000 0.9467 0.0915 189-DS 0.0000 0.0000 0.0000 0.1500 0.4000 0.0800 0.1474 0.1500 0.4000 1.8420 0.0002 0.0000 0.1173 0.0000 0.2000 0.0308 0.0751 190-DS 0.0000 0.2000 0.4000 0.4000 1.0000 0.3467 0.2560 0.2000 1.0000 0.7384 0.0867 0.0001 0.1902 0.0000 0.6000 0.3000 0.1881 191-DS 0.0000 0.2000 0.2000 0.4000 0.6000 0.3067 0.1668 0.2000 0.6000 0.5438 0.1507 0.0001 0.1404 0.0000 0.6000 0.3067 0.1668 192-DS 0.0000 0.0500 0.2000 0.3500 0.4000 0.2000 0.1512 0.3000 0.4000 0.7559 0.0172 0.0000 0.1067 0.0000 0.4000 0.2000 0.1512 193-DS 0.2000 0.6000 0.8000 1.0000 1.0000 0.7600 0.2530 0.4000 0.8000 0.3329 0.7052 0.6272 0.2080 0.2000 1.0000 0.7600 0.2530 194-DS 0.0000 0.2000 0.2000 0.5500 1.0000 0.3467 0.3067 0.3500 1.0000 0.8849 0.0806 0.0001 0.2489 0.0000 1.0000 0.3467 0.3067 195-DS 0.6000 0.8000 0.8000 1.0000 1.0000 0.8267 0.1486 0.2000 0.4000 0.1798 0.8136 0.8000 0.1156 0.6000 1.0000 0.8267 0.1486 196-DS 0.0000 0.2000 0.6000 0.6000 1.0000 0.4667 0.2992 0.4000 1.0000 0.6412 0.1131 0.0001 0.2489 0.0000 1.0000 0.4667 0.2992 197-DS 0.2000 0.4000 0.8000 0.8000 1.0000 0.6533 0.2669 0.4000 0.8000 0.4085 0.5851 0.5014 0.2293 0.2000 1.0000 0.6533 0.2669 198-DS 0.4000 0.8000 0.8000 1.0000 1.0000 0.8267 0.1831 0.2000 0.6000 0.2215 0.8038 0.7759 0.1387 0.6000 1.0000 0.8571 0.1453 199-DS 0.0000 0.0000 0.6000 0.8000 1.0000 0.4667 0.4186 0.8000 1.0000 0.8970 0.0085 0.0000 0.3733 0.0000 1.0000 0.4667 0.4186 200-DS 0.4000 0.4000 0.4000 0.6000 0.6000 0.4800 0.1014 0.2000 0.2000 0.2113 0.4704 0.4615 0.0960 0.4000 0.6000 0.4800 0.1014 165 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2EN-CLEF2007 Statistics for P@10 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.1000 0.6250 0.7000 0.7750 0.9000 0.6467 0.2167 0.1500 0.8000 0.3351 0.5787 0.4519 0.1449 0.6000 0.9000 0.7231 0.0832 177-DS 0.0000 0.1000 0.2000 0.4750 0.8000 0.2933 0.2576 0.3750 0.8000 0.8783 0.0379 0.0000 0.2062 0.0000 0.8000 0.2933 0.2576 178-DS 0.0000 0.2000 0.4000 0.6000 0.7000 0.3800 0.2426 0.4000 0.7000 0.6384 0.0522 0.0000 0.2000 0.0000 0.7000 0.3800 0.2426 179-DS 0.0000 0.3000 0.4000 0.6000 0.9000 0.4533 0.2560 0.3000 0.9000 0.5647 0.2090 0.0001 0.2169 0.0000 0.9000 0.4533 0.2560 180-DS 0.8000 0.9000 1.0000 1.0000 1.0000 0.9333 0.0816 0.1000 0.2000 0.0875 0.9299 0.9262 0.0711 0.8000 1.0000 0.9333 0.0816 181-DS 0.0000 0.2000 0.3000 0.3000 0.6000 0.2667 0.1496 0.1000 0.6000 0.5610 0.0741 0.0001 0.1067 0.2000 0.4000 0.2833 0.0718 182-DS 0.0000 0.0000 0.1000 0.2000 0.3000 0.1000 0.1000 0.2000 0.3000 1.0000 0.0033 0.0000 0.0800 0.0000 0.3000 0.1000 0.1000 183-DS 0.0000 0.1000 0.6000 0.8750 0.9000 0.4933 0.3731 0.7750 0.9000 0.7564 0.1023 0.0001 0.3404 0.0000 0.9000 0.4933 0.3731 184-DS 0.0000 0.5500 0.7000 0.9000 0.9000 0.6533 0.3044 0.3500 0.9000 0.4659 0.1649 0.0001 0.2284 0.4000 0.9000 0.7538 0.1613 185-DS 0.0000 0.2250 0.3000 0.3750 0.4000 0.2733 0.1223 0.1500 0.4000 0.4474 0.1370 0.0001 0.0924 0.1000 0.4000 0.2929 0.0997 186-DS 0.0000 0.1000 0.2000 0.3750 0.6000 0.2333 0.1633 0.2750 0.6000 0.6999 0.1070 0.0001 0.1333 0.0000 0.6000 0.2333 0.1633 187-DS 0.0000 0.4500 0.8000 0.9000 0.9000 0.6600 0.3180 0.4500 0.9000 0.4819 0.1650 0.0001 0.2533 0.0000 0.9000 0.6600 0.3180 188-DS 0.8000 0.8250 0.9000 1.0000 1.0000 0.9067 0.0799 0.1750 0.2000 0.0881 0.9033 0.9000 0.0622 0.8000 1.0000 0.9067 0.0799 189-DS 0.0000 0.0000 0.0000 0.1000 0.2000 0.0667 0.0816 0.1000 0.2000 1.2247 0.0008 0.0000 0.0711 0.0000 0.2000 0.0667 0.0816 190-DS 0.0000 0.2000 0.3000 0.3000 1.0000 0.3000 0.2268 0.1000 1.0000 0.7559 0.0788 0.0001 0.1200 0.2000 0.4000 0.2917 0.0669 191-DS 0.1000 0.2000 0.3000 0.4000 0.6000 0.3067 0.1580 0.2000 0.5000 0.5151 0.2637 0.2200 0.1280 0.1000 0.6000 0.3067 0.1580 192-DS 0.0000 0.1000 0.3000 0.4000 0.5000 0.2533 0.1885 0.3000 0.5000 0.7440 0.0351 0.0000 0.1698 0.0000 0.5000 0.2533 0.1885 193-DS 0.4000 0.4500 0.8000 0.9000 1.0000 0.7267 0.2344 0.4500 0.6000 0.3226 0.6857 0.6413 0.2080 0.4000 1.0000 0.7267 0.2344 194-DS 0.0000 0.1000 0.3000 0.3000 0.7000 0.2733 0.2154 0.2000 0.7000 0.7879 0.0670 0.0001 0.1618 0.0000 0.6000 0.2429 0.1869 195-DS 0.4000 0.7250 0.9000 1.0000 1.0000 0.8333 0.1877 0.2750 0.6000 0.2253 0.8084 0.7771 0.1467 0.4000 1.0000 0.8333 0.1877 196-DS 0.0000 0.1000 0.3000 0.5750 0.7000 0.3467 0.2416 0.4750 0.7000 0.6970 0.0820 0.0001 0.2098 0.0000 0.7000 0.3467 0.2416 197-DS 0.3000 0.4000 0.7000 0.8750 1.0000 0.6533 0.2386 0.4750 0.7000 0.3653 0.6065 0.5565 0.2027 0.3000 1.0000 0.6533 0.2386 198-DS 0.4000 0.7000 0.8000 0.9000 1.0000 0.7867 0.1727 0.2000 0.6000 0.2195 0.7663 0.7425 0.1360 0.6000 1.0000 0.8143 0.1406 199-DS 0.0000 0.0000 0.5000 0.7000 0.8000 0.3933 0.3432 0.7000 0.8000 0.8726 0.0077 0.0000 0.3147 0.0000 0.8000 0.3933 0.3432 200-DS 0.2000 0.3000 0.4000 0.4000 0.6000 0.3667 0.0976 0.1000 0.4000 0.2662 0.3550 0.3435 0.0756 0.2000 0.5000 0.3500 0.0760 166 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2EN-CLEF2007 Statistics for P@15 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.1333 0.5333 0.6667 0.7167 0.8000 0.5867 0.2096 0.1833 0.6667 0.3573 0.5248 0.4245 0.1511 0.4667 0.8000 0.6564 0.1083 177-DS 0.0000 0.0833 0.2000 0.4500 0.5333 0.2444 0.1930 0.3667 0.5333 0.7895 0.0588 0.0001 0.1689 0.0000 0.5333 0.2444 0.1930 178-DS 0.0000 0.2167 0.4667 0.5833 0.7333 0.3911 0.2480 0.3667 0.7333 0.6341 0.0946 0.0001 0.2139 0.0000 0.7333 0.3911 0.2480 179-DS 0.0000 0.2833 0.4667 0.5833 0.8667 0.4356 0.2362 0.3000 0.8667 0.5423 0.2002 0.0001 0.1843 0.0000 0.8667 0.4356 0.2362 180-DS 0.7333 0.8667 0.9333 0.9833 1.0000 0.9156 0.0733 0.1167 0.2667 0.0801 0.9127 0.9096 0.0569 0.7333 1.0000 0.9156 0.0733 181-DS 0.0000 0.2000 0.2667 0.4000 0.4667 0.2800 0.1516 0.2000 0.4667 0.5414 0.0772 0.0001 0.1209 0.0000 0.4667 0.2800 0.1516 182-DS 0.0000 0.0167 0.1333 0.1333 0.2000 0.0889 0.0651 0.1167 0.2000 0.7319 0.0095 0.0000 0.0563 0.0000 0.2000 0.0889 0.0651 183-DS 0.0000 0.2167 0.6000 0.8500 0.9333 0.5067 0.3481 0.6333 0.9333 0.6870 0.1126 0.0001 0.3129 0.0000 0.9333 0.5067 0.3481 184-DS 0.0000 0.6167 0.7333 0.8000 0.9333 0.6622 0.2900 0.1833 0.9333 0.4379 0.1689 0.0001 0.2021 0.5333 0.9333 0.7641 0.1174 185-DS 0.0667 0.2000 0.2667 0.3833 0.4667 0.2756 0.1205 0.1833 0.4000 0.4373 0.2463 0.2112 0.0919 0.0667 0.4667 0.2756 0.1205 186-DS 0.0000 0.1333 0.1333 0.3167 0.6000 0.2133 0.1617 0.1833 0.6000 0.7581 0.0963 0.0001 0.1316 0.0000 0.4000 0.1857 0.1259 187-DS 0.0000 0.4167 0.7333 0.8500 0.9333 0.6400 0.3185 0.4333 0.9333 0.4977 0.1590 0.0001 0.2524 0.0000 0.9333 0.6400 0.3185 188-DS 0.6667 0.8167 0.8667 1.0000 1.0000 0.8800 0.1104 0.1833 0.3333 0.1255 0.8732 0.8662 0.0871 0.6667 1.0000 0.8800 0.1104 189-DS 0.0000 0.0167 0.0667 0.0667 0.2667 0.0756 0.0750 0.0500 0.2667 0.9931 0.0079 0.0000 0.0498 0.0000 0.1333 0.0513 0.0399 190-DS 0.0000 0.2000 0.2000 0.3333 1.0000 0.2756 0.2402 0.1333 1.0000 0.8717 0.0697 0.0001 0.1541 0.0000 0.3333 0.2000 0.1089 191-DS 0.0667 0.1500 0.3333 0.4000 0.4667 0.2844 0.1413 0.2500 0.4000 0.4969 0.2405 0.1898 0.1233 0.0667 0.4667 0.2844 0.1413 192-DS 0.0000 0.0667 0.3333 0.4000 0.4667 0.2489 0.1790 0.3333 0.4667 0.7192 0.0344 0.0000 0.1612 0.0000 0.4667 0.2489 0.1790 193-DS 0.2667 0.4667 0.8000 0.8667 1.0000 0.7111 0.2426 0.4000 0.7333 0.3411 0.6610 0.6005 0.1985 0.2667 1.0000 0.7111 0.2426 194-DS 0.0000 0.1500 0.2667 0.5000 0.6667 0.3022 0.2060 0.3500 0.6667 0.6818 0.0754 0.0001 0.1671 0.0000 0.6667 0.3022 0.2060 195-DS 0.5333 0.7500 0.8000 0.9167 1.0000 0.8000 0.1357 0.1667 0.4667 0.1696 0.7882 0.7754 0.0978 0.5333 1.0000 0.8000 0.1357 196-DS 0.0000 0.1333 0.2667 0.5333 0.6000 0.3156 0.2274 0.4000 0.6000 0.7207 0.0754 0.0001 0.2033 0.0000 0.6000 0.3156 0.2274 197-DS 0.3333 0.3500 0.6667 0.8667 1.0000 0.6489 0.2475 0.5167 0.6667 0.3814 0.5993 0.5484 0.2080 0.3333 1.0000 0.6489 0.2475 198-DS 0.3333 0.6667 0.7333 0.9167 1.0000 0.7511 0.1976 0.2500 0.6667 0.2630 0.7230 0.6899 0.1612 0.3333 1.0000 0.7511 0.1976 199-DS 0.0000 0.0000 0.4667 0.6500 0.7333 0.3511 0.3070 0.6500 0.7333 0.8744 0.0072 0.0000 0.2809 0.0000 0.7333 0.3511 0.3070 200-DS 0.2000 0.2667 0.2667 0.3333 0.4000 0.2933 0.0704 0.0667 0.2000 0.2399 0.2855 0.2778 0.0587 0.2000 0.4000 0.2933 0.0704 167 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2EN-CLEF2007 Statistics for P@20 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.1000 0.5500 0.6000 0.6500 0.8500 0.5533 0.2013 0.1000 0.7500 0.3638 0.4846 0.3640 0.1293 0.5000 0.7000 0.6042 0.0582 177-DS 0.0500 0.1125 0.2000 0.3875 0.4500 0.2367 0.1356 0.2750 0.4000 0.5729 0.1967 0.1580 0.1191 0.0500 0.4500 0.2367 0.1356 178-DS 0.0500 0.2750 0.4500 0.5250 0.7500 0.4167 0.2233 0.2500 0.7000 0.5360 0.3384 0.2359 0.1689 0.0500 0.7500 0.4167 0.2233 179-DS 0.0500 0.3000 0.5000 0.5875 0.7000 0.4333 0.2059 0.2875 0.6500 0.4751 0.3491 0.2174 0.1711 0.0500 0.7000 0.4333 0.2059 180-DS 0.7500 0.9000 0.9000 0.9500 0.9500 0.9067 0.0530 0.0500 0.2000 0.0585 0.9051 0.9034 0.0347 0.8500 0.9500 0.9179 0.0317 181-DS 0.0000 0.1500 0.3000 0.3500 0.4500 0.2500 0.1414 0.2000 0.4500 0.5657 0.0687 0.0001 0.1200 0.0000 0.4500 0.2500 0.1414 182-DS 0.0000 0.0125 0.1000 0.1500 0.2000 0.0933 0.0704 0.1375 0.2000 0.7540 0.0096 0.0000 0.0613 0.0000 0.2000 0.0933 0.0704 183-DS 0.0000 0.2625 0.6000 0.8375 0.9000 0.5100 0.3175 0.5750 0.9000 0.6225 0.2097 0.0001 0.2760 0.0000 0.9000 0.5100 0.3175 184-DS 0.0000 0.6500 0.7000 0.8000 0.8500 0.6433 0.2718 0.1500 0.8500 0.4225 0.1656 0.0001 0.1773 0.6000 0.8500 0.7423 0.0813 185-DS 0.0500 0.1500 0.2500 0.3000 0.6000 0.2533 0.1494 0.1500 0.5500 0.5896 0.2122 0.1707 0.1107 0.0500 0.5000 0.2286 0.1188 186-DS 0.0000 0.1000 0.1500 0.2500 0.6000 0.1867 0.1529 0.1500 0.6000 0.8192 0.0825 0.0001 0.1173 0.0000 0.3500 0.1571 0.1054 187-DS 0.0000 0.4000 0.7500 0.8500 0.9000 0.6300 0.3161 0.4500 0.9000 0.5018 0.1565 0.0001 0.2600 0.0000 0.9000 0.6300 0.3161 188-DS 0.5500 0.7750 0.9000 0.9500 1.0000 0.8567 0.1425 0.1750 0.4500 0.1664 0.8440 0.8295 0.1111 0.5500 1.0000 0.8567 0.1425 189-DS 0.0000 0.0125 0.0500 0.1000 0.2500 0.0800 0.0797 0.0875 0.2500 0.9966 0.0079 0.0000 0.0627 0.0000 0.2000 0.0679 0.0668 190-DS 0.0000 0.1500 0.2500 0.2875 0.9000 0.2600 0.2165 0.1375 0.9000 0.8326 0.0671 0.0001 0.1347 0.0000 0.3500 0.1923 0.1038 191-DS 0.1000 0.1125 0.3000 0.3500 0.4000 0.2567 0.1193 0.2375 0.3000 0.4649 0.2248 0.1916 0.1062 0.1000 0.4000 0.2567 0.1193 192-DS 0.0000 0.1500 0.3000 0.3875 0.4000 0.2400 0.1526 0.2375 0.4000 0.6358 0.0363 0.0000 0.1307 0.0000 0.4000 0.2400 0.1526 193-DS 0.2000 0.4750 0.7000 0.8875 1.0000 0.6933 0.2449 0.4125 0.8000 0.3532 0.6385 0.5671 0.1898 0.2000 1.0000 0.6933 0.2449 194-DS 0.0000 0.1625 0.3000 0.5375 0.6000 0.3200 0.2042 0.3750 0.6000 0.6383 0.0825 0.0001 0.1680 0.0000 0.6000 0.3200 0.2042 195-DS 0.5500 0.6625 0.8000 0.9250 1.0000 0.7800 0.1486 0.2625 0.4500 0.1905 0.7662 0.7520 0.1213 0.5500 1.0000 0.7800 0.1486 196-DS 0.0000 0.1500 0.3500 0.5000 0.6000 0.3200 0.2086 0.3500 0.6000 0.6518 0.0811 0.0001 0.1853 0.0000 0.6000 0.3200 0.2086 197-DS 0.3000 0.3500 0.6500 0.8000 1.0000 0.6167 0.2410 0.4500 0.7000 0.3909 0.5683 0.5194 0.2089 0.3000 1.0000 0.6167 0.2410 198-DS 0.3500 0.6125 0.7500 0.9375 0.9500 0.7467 0.1894 0.3250 0.6000 0.2537 0.7204 0.6898 0.1569 0.3500 0.9500 0.7467 0.1894 199-DS 0.0000 0.0125 0.4000 0.5375 0.6000 0.3100 0.2551 0.5250 0.6000 0.8229 0.0205 0.0000 0.2347 0.0000 0.6000 0.3100 0.2551 200-DS 0.2000 0.2500 0.3000 0.3500 0.4000 0.2900 0.0632 0.1000 0.2000 0.2181 0.2833 0.2764 0.0520 0.2000 0.4000 0.2900 0.0632 168 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2EN-CLEF2007 Statistics for P@30 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0667 0.5000 0.5333 0.5333 0.9000 0.4844 0.2011 0.0333 0.8333 0.4152 0.4080 0.2753 0.1271 0.5000 0.5667 0.5333 0.0211 177-DS 0.0667 0.1083 0.1667 0.3250 0.3667 0.2133 0.1118 0.2167 0.3000 0.5242 0.1841 0.1573 0.1031 0.0667 0.3667 0.2133 0.1118 178-DS 0.1000 0.3083 0.3667 0.5333 0.8000 0.4267 0.2327 0.2250 0.7000 0.5454 0.3585 0.2840 0.1787 0.1000 0.8000 0.4267 0.2327 179-DS 0.0667 0.3333 0.4667 0.6250 0.6667 0.4378 0.1976 0.2917 0.6000 0.4513 0.3658 0.2560 0.1597 0.0667 0.6667 0.4378 0.1976 180-DS 0.8000 0.8750 0.9000 0.9333 0.9333 0.8956 0.0396 0.0583 0.1333 0.0442 0.8947 0.8938 0.0287 0.8000 0.9333 0.8956 0.0396 181-DS 0.0000 0.1667 0.3000 0.3250 0.3667 0.2378 0.1188 0.1583 0.3667 0.4995 0.0679 0.0001 0.0969 0.0000 0.3667 0.2378 0.1188 182-DS 0.0000 0.0417 0.1000 0.1667 0.2333 0.1089 0.0750 0.1250 0.2333 0.6891 0.0309 0.0001 0.0628 0.0000 0.2333 0.1089 0.0750 183-DS 0.0667 0.2500 0.5667 0.7250 0.9333 0.4911 0.2833 0.4750 0.8667 0.5768 0.3831 0.2529 0.2361 0.0667 0.9333 0.4911 0.2833 184-DS 0.0000 0.6417 0.7000 0.7667 0.8667 0.6267 0.2682 0.1250 0.8667 0.4280 0.1615 0.0001 0.1840 0.5000 0.8667 0.7231 0.0917 185-DS 0.0333 0.1500 0.2667 0.3250 0.6000 0.2511 0.1452 0.1750 0.5667 0.5783 0.2015 0.1423 0.1055 0.0333 0.4000 0.2262 0.1126 186-DS 0.0000 0.0667 0.1333 0.1667 0.4667 0.1467 0.1132 0.1000 0.4667 0.7722 0.0667 0.0001 0.0764 0.0000 0.2333 0.1238 0.0733 187-DS 0.0000 0.3917 0.7333 0.8917 0.9000 0.6244 0.3118 0.5000 0.9000 0.4993 0.2652 0.0001 0.2519 0.0000 0.9000 0.6244 0.3118 188-DS 0.5667 0.7750 0.9000 0.9333 0.9667 0.8333 0.1345 0.1583 0.4000 0.1614 0.8217 0.8086 0.1067 0.5667 0.9667 0.8333 0.1345 189-DS 0.0000 0.0083 0.0667 0.1000 0.2333 0.0733 0.0645 0.0917 0.2333 0.8794 0.0079 0.0000 0.0480 0.0000 0.2333 0.0733 0.0645 190-DS 0.0000 0.1667 0.2000 0.2583 0.8333 0.2378 0.1943 0.0917 0.8333 0.8172 0.0632 0.0001 0.1132 0.1667 0.2667 0.2091 0.0368 191-DS 0.1000 0.1167 0.2333 0.3250 0.3667 0.2244 0.0963 0.2083 0.2667 0.4292 0.2025 0.1799 0.0806 0.1000 0.3667 0.2244 0.0963 192-DS 0.0000 0.1333 0.2667 0.3333 0.4000 0.2178 0.1447 0.2000 0.4000 0.6643 0.0331 0.0000 0.1277 0.0000 0.4000 0.2178 0.1447 193-DS 0.2667 0.5083 0.7000 0.8167 1.0000 0.6778 0.2148 0.3083 0.7333 0.3169 0.6395 0.5942 0.1689 0.2667 1.0000 0.6778 0.2148 194-DS 0.0667 0.1750 0.3333 0.5833 0.7333 0.3533 0.2137 0.4083 0.6667 0.6049 0.2825 0.2091 0.1769 0.0667 0.7333 0.3533 0.2137 195-DS 0.4667 0.6417 0.8000 0.9167 0.9667 0.7600 0.1634 0.2750 0.5000 0.2150 0.7422 0.7230 0.1360 0.4667 0.9667 0.7600 0.1634 196-DS 0.0000 0.1833 0.2333 0.4250 0.4667 0.2778 0.1577 0.2417 0.4667 0.5677 0.0754 0.0001 0.1319 0.0000 0.4667 0.2778 0.1577 197-DS 0.2667 0.2750 0.6000 0.7333 1.0000 0.5578 0.2448 0.4583 0.7333 0.4388 0.5030 0.4495 0.2139 0.2667 1.0000 0.5578 0.2448 198-DS 0.4000 0.5417 0.7000 0.8667 0.9333 0.7200 0.1842 0.3250 0.5333 0.2559 0.6955 0.6690 0.1547 0.4000 0.9333 0.7200 0.1842 199-DS 0.0333 0.0333 0.4000 0.4250 0.5667 0.2756 0.2053 0.3917 0.5333 0.7449 0.1619 0.0806 0.1893 0.0333 0.5667 0.2756 0.2053 200-DS 0.1667 0.2000 0.3000 0.3000 0.3667 0.2667 0.0701 0.1000 0.2000 0.2631 0.2580 0.2494 0.0622 0.1667 0.3667 0.2667 0.0701 169 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2EN-CLEF2007 Statistics for P@100 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0400 0.1825 0.3500 0.5600 0.5900 0.3453 0.1956 0.3775 0.5500 0.5664 0.2674 0.1665 0.1556 0.0400 0.5900 0.3453 0.1956 177-DS 0.0500 0.0725 0.1300 0.1550 0.1900 0.1173 0.0461 0.0825 0.1400 0.3925 0.1080 0.0983 0.0392 0.0500 0.1900 0.1173 0.0461 178-DS 0.0700 0.1525 0.2100 0.4275 0.5700 0.2720 0.1678 0.2750 0.5000 0.6169 0.2215 0.1769 0.1491 0.0700 0.5700 0.2720 0.1678 179-DS 0.0400 0.2850 0.3500 0.5025 0.5700 0.3573 0.1604 0.2175 0.5300 0.4488 0.2967 0.1974 0.1198 0.0400 0.5700 0.3573 0.1604 180-DS 0.7200 0.7800 0.8300 0.8600 0.8800 0.8200 0.0511 0.0800 0.1600 0.0624 0.8185 0.8169 0.0440 0.7200 0.8800 0.8200 0.0511 181-DS 0.0000 0.1400 0.1400 0.1600 0.1700 0.1327 0.0552 0.0200 0.1700 0.4162 0.0422 0.0001 0.0354 0.1400 0.1700 0.1531 0.0132 182-DS 0.0000 0.0725 0.1000 0.1400 0.2100 0.1007 0.0561 0.0675 0.2100 0.5575 0.0317 0.0001 0.0434 0.0000 0.2100 0.1007 0.0561 183-DS 0.0700 0.2125 0.3200 0.5325 0.7200 0.3540 0.2002 0.3200 0.6500 0.5657 0.2949 0.2324 0.1560 0.0700 0.7200 0.3540 0.2002 184-DS 0.0500 0.3375 0.4700 0.6425 0.7700 0.4513 0.2215 0.3050 0.7200 0.4907 0.3673 0.2403 0.1719 0.0500 0.7700 0.4513 0.2215 185-DS 0.0300 0.1125 0.2000 0.2900 0.4600 0.2033 0.1244 0.1775 0.4300 0.6116 0.1526 0.0957 0.0969 0.0300 0.4600 0.2033 0.1244 186-DS 0.0300 0.0475 0.0800 0.0900 0.2300 0.0860 0.0512 0.0425 0.2000 0.5958 0.0740 0.0638 0.0339 0.0300 0.1400 0.0757 0.0334 187-DS 0.0100 0.5325 0.6800 0.7650 0.9000 0.6173 0.2731 0.2325 0.8900 0.4425 0.3972 0.0685 0.1969 0.5000 0.9000 0.7108 0.1269 188-DS 0.4300 0.6100 0.7800 0.8775 0.8900 0.7340 0.1492 0.2675 0.4600 0.2033 0.7182 0.7006 0.1245 0.4300 0.8900 0.7340 0.1492 189-DS 0.0000 0.0200 0.0500 0.0875 0.1200 0.0553 0.0398 0.0675 0.1200 0.7192 0.0106 0.0000 0.0337 0.0000 0.1200 0.0553 0.0398 190-DS 0.0000 0.1925 0.2300 0.2550 0.6100 0.2260 0.1361 0.0625 0.6100 0.6023 0.0643 0.0001 0.0741 0.1900 0.2800 0.2317 0.0292 191-DS 0.0500 0.0850 0.1100 0.2075 0.2300 0.1367 0.0678 0.1225 0.1800 0.4960 0.1193 0.1023 0.0591 0.0500 0.2300 0.1367 0.0678 192-DS 0.0000 0.0600 0.1500 0.2200 0.3100 0.1460 0.1038 0.1600 0.3100 0.7108 0.0234 0.0000 0.0843 0.0000 0.3100 0.1460 0.1038 193-DS 0.3200 0.4425 0.6800 0.8400 0.9500 0.6653 0.2184 0.3975 0.6300 0.3283 0.6255 0.5810 0.1749 0.3200 0.9500 0.6653 0.2184 194-DS 0.0800 0.1125 0.3400 0.4750 0.7000 0.3393 0.2223 0.3625 0.6200 0.6552 0.2597 0.1884 0.1874 0.0800 0.7000 0.3393 0.2223 195-DS 0.3300 0.5675 0.8000 0.8775 0.9300 0.7247 0.1965 0.3100 0.6000 0.2712 0.6934 0.6551 0.1618 0.3300 0.9300 0.7247 0.1965 196-DS 0.0000 0.0950 0.2400 0.2700 0.2800 0.1913 0.1047 0.1750 0.2800 0.5474 0.0536 0.0001 0.0876 0.0000 0.2800 0.1913 0.1047 197-DS 0.1900 0.3150 0.3700 0.5850 0.7500 0.4340 0.1707 0.2700 0.5600 0.3932 0.4036 0.3750 0.1400 0.1900 0.7500 0.4340 0.1707 198-DS 0.3600 0.4800 0.6200 0.7050 0.8000 0.5960 0.1375 0.2250 0.4400 0.2306 0.5796 0.5615 0.1080 0.3600 0.8000 0.5960 0.1375 199-DS 0.0100 0.0300 0.1700 0.2250 0.2900 0.1447 0.1085 0.1950 0.2800 0.7499 0.0853 0.0392 0.0971 0.0100 0.2900 0.1447 0.1085 200-DS 0.1600 0.1650 0.2200 0.2500 0.3800 0.2207 0.0590 0.0850 0.2200 0.2673 0.2142 0.2083 0.0435 0.1600 0.2700 0.2093 0.0407 170 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2EN-CLEF2007 Statistics for P@200 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0300 0.1000 0.2250 0.3875 0.4100 0.2353 0.1392 0.2875 0.3800 0.5917 0.1812 0.1193 0.1144 0.0300 0.4100 0.2353 0.1392 177-DS 0.0350 0.0513 0.0900 0.1037 0.1400 0.0820 0.0321 0.0525 0.1050 0.3917 0.0752 0.0678 0.0263 0.0350 0.1400 0.0820 0.0321 178-DS 0.0600 0.1262 0.2150 0.2975 0.3500 0.1980 0.1001 0.1713 0.2900 0.5054 0.1705 0.1426 0.0881 0.0600 0.3500 0.1980 0.1001 179-DS 0.0350 0.2325 0.2650 0.3688 0.3750 0.2663 0.1074 0.1363 0.3400 0.4033 0.2273 0.1604 0.0754 0.0350 0.3750 0.2663 0.1074 180-DS 0.5550 0.5887 0.6450 0.7475 0.7750 0.6610 0.0811 0.1588 0.2200 0.1227 0.6564 0.6519 0.0719 0.5550 0.7750 0.6610 0.0811 181-DS 0.0000 0.0750 0.0800 0.0850 0.0850 0.0700 0.0287 0.0100 0.0850 0.4094 0.0243 0.0001 0.0187 0.0750 0.0850 0.0808 0.0040 182-DS 0.0050 0.0562 0.0850 0.1087 0.1550 0.0810 0.0404 0.0525 0.1500 0.4989 0.0605 0.0271 0.0308 0.0050 0.1550 0.0810 0.0404 183-DS 0.0650 0.1800 0.2550 0.3875 0.5100 0.2690 0.1338 0.2075 0.4450 0.4973 0.2335 0.1942 0.1075 0.0650 0.5100 0.2690 0.1338 184-DS 0.0450 0.1950 0.3550 0.4875 0.6000 0.3347 0.1710 0.2925 0.5550 0.5111 0.2763 0.1985 0.1364 0.0450 0.6000 0.3347 0.1710 185-DS 0.0150 0.0737 0.1550 0.2150 0.2650 0.1437 0.0871 0.1413 0.2500 0.6060 0.1045 0.0604 0.0734 0.0150 0.2650 0.1437 0.0871 186-DS 0.0400 0.0450 0.0550 0.0650 0.1350 0.0627 0.0259 0.0200 0.0950 0.4133 0.0588 0.0559 0.0179 0.0400 0.0800 0.0542 0.0124 187-DS 0.0100 0.4350 0.6100 0.7250 0.7950 0.5383 0.2450 0.2900 0.7850 0.4551 0.3508 0.0676 0.1829 0.0100 0.7950 0.5383 0.2450 188-DS 0.3200 0.4887 0.5650 0.7037 0.7700 0.5783 0.1319 0.2150 0.4500 0.2281 0.5630 0.5463 0.1042 0.3200 0.7700 0.5783 0.1319 189-DS 0.0000 0.0112 0.0550 0.0725 0.1000 0.0470 0.0313 0.0613 0.1000 0.6653 0.0216 0.0001 0.0260 0.0000 0.1000 0.0470 0.0313 190-DS 0.0000 0.1863 0.2000 0.2050 0.3550 0.1857 0.0865 0.0187 0.3550 0.4658 0.0559 0.0001 0.0510 0.1750 0.2150 0.1982 0.0110 191-DS 0.0350 0.0550 0.0800 0.1437 0.1700 0.0970 0.0499 0.0887 0.1350 0.5143 0.0844 0.0729 0.0441 0.0350 0.1700 0.0970 0.0499 192-DS 0.0000 0.0500 0.0950 0.1900 0.2250 0.1080 0.0792 0.1400 0.2250 0.7332 0.0276 0.0001 0.0669 0.0000 0.2250 0.1080 0.0792 193-DS 0.2150 0.3137 0.5800 0.6788 0.7950 0.5270 0.2027 0.3650 0.5800 0.3846 0.4812 0.4292 0.1703 0.2150 0.7950 0.5270 0.2027 194-DS 0.0600 0.0938 0.2550 0.4700 0.5500 0.2727 0.1858 0.3762 0.4900 0.6814 0.2066 0.1507 0.1575 0.0600 0.5500 0.2727 0.1858 195-DS 0.2500 0.4388 0.6600 0.7725 0.8250 0.5930 0.2039 0.3338 0.5750 0.3438 0.5526 0.5058 0.1757 0.2500 0.8250 0.5930 0.2039 196-DS 0.0000 0.0825 0.1800 0.1800 0.1950 0.1380 0.0729 0.0975 0.1950 0.5280 0.0406 0.0001 0.0609 0.0000 0.1950 0.1380 0.0729 197-DS 0.1650 0.2325 0.2750 0.3700 0.4900 0.2977 0.1049 0.1375 0.3250 0.3523 0.2811 0.2656 0.0842 0.1650 0.4900 0.2977 0.1049 198-DS 0.2100 0.3500 0.4750 0.5375 0.6300 0.4467 0.1288 0.1875 0.4200 0.2883 0.4257 0.4008 0.1009 0.2100 0.6300 0.4467 0.1288 199-DS 0.0050 0.0200 0.1450 0.1875 0.2150 0.1130 0.0846 0.1675 0.2100 0.7488 0.0618 0.0230 0.0777 0.0050 0.2150 0.1130 0.0846 200-DS 0.1100 0.1450 0.1600 0.1750 0.2600 0.1653 0.0404 0.0300 0.1500 0.2442 0.1611 0.1571 0.0291 0.1100 0.2100 0.1535 0.0266 171 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2EN-CLEF2007 Statistics for P@500 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0280 0.0470 0.1300 0.1695 0.1720 0.1148 0.0578 0.1225 0.1440 0.5038 0.0958 0.0748 0.0499 0.0280 0.1720 0.1148 0.0578 177-DS 0.0220 0.0305 0.0520 0.0600 0.0700 0.0479 0.0172 0.0295 0.0480 0.3585 0.0444 0.0406 0.0146 0.0220 0.0700 0.0479 0.0172 178-DS 0.0380 0.0625 0.1520 0.1600 0.1800 0.1141 0.0546 0.0975 0.1420 0.4787 0.0997 0.0854 0.0513 0.0380 0.1800 0.1141 0.0546 179-DS 0.0240 0.1530 0.1920 0.2040 0.2080 0.1633 0.0596 0.0510 0.1840 0.3650 0.1425 0.1057 0.0436 0.1180 0.2080 0.1838 0.0269 180-DS 0.2900 0.3395 0.4600 0.4835 0.5460 0.4228 0.0849 0.1440 0.2560 0.2009 0.4144 0.4057 0.0756 0.2900 0.5460 0.4228 0.0849 181-DS 0.0000 0.0320 0.0340 0.0340 0.0360 0.0291 0.0119 0.0020 0.0360 0.4078 0.0114 0.0001 0.0078 0.0320 0.0360 0.0335 0.0012 182-DS 0.0040 0.0400 0.0560 0.0725 0.0900 0.0541 0.0255 0.0325 0.0860 0.4703 0.0417 0.0207 0.0193 0.0040 0.0900 0.0541 0.0255 183-DS 0.0460 0.1160 0.1600 0.2095 0.2680 0.1568 0.0664 0.0935 0.2220 0.4236 0.1408 0.1216 0.0517 0.0460 0.2680 0.1568 0.0664 184-DS 0.0560 0.1050 0.2140 0.3205 0.3800 0.2179 0.1139 0.2155 0.3240 0.5227 0.1832 0.1466 0.0961 0.0560 0.3800 0.2179 0.1139 185-DS 0.0100 0.0540 0.1000 0.1215 0.1380 0.0829 0.0457 0.0675 0.1280 0.5507 0.0632 0.0386 0.0390 0.0100 0.1380 0.0829 0.0457 186-DS 0.0240 0.0305 0.0440 0.0495 0.0760 0.0429 0.0147 0.0190 0.0520 0.3418 0.0407 0.0387 0.0115 0.0240 0.0760 0.0429 0.0147 187-DS 0.0140 0.3250 0.4500 0.5130 0.5500 0.3928 0.1717 0.1880 0.5360 0.4370 0.2876 0.1021 0.1261 0.3100 0.5500 0.4505 0.0858 188-DS 0.2000 0.3145 0.3520 0.3995 0.4700 0.3535 0.0758 0.0850 0.2700 0.2145 0.3450 0.3355 0.0573 0.2000 0.4700 0.3535 0.0758 189-DS 0.0040 0.0090 0.0360 0.0420 0.0540 0.0293 0.0173 0.0330 0.0500 0.5903 0.0218 0.0138 0.0148 0.0040 0.0540 0.0293 0.0173 190-DS 0.0000 0.1100 0.1540 0.1670 0.1880 0.1307 0.0593 0.0570 0.1880 0.4538 0.0411 0.0001 0.0447 0.0980 0.1880 0.1508 0.0286 191-DS 0.0320 0.0390 0.0760 0.0870 0.1000 0.0675 0.0254 0.0480 0.0680 0.3771 0.0622 0.0565 0.0217 0.0320 0.1000 0.0675 0.0254 192-DS 0.0000 0.0305 0.0600 0.1155 0.1220 0.0645 0.0471 0.0850 0.1220 0.7294 0.0172 0.0001 0.0408 0.0000 0.1220 0.0645 0.0471 193-DS 0.1100 0.1805 0.3920 0.4745 0.5620 0.3501 0.1590 0.2940 0.4520 0.4540 0.3068 0.2586 0.1366 0.1100 0.5620 0.3501 0.1590 194-DS 0.0620 0.0845 0.1560 0.2990 0.3460 0.1796 0.1092 0.2145 0.2840 0.6079 0.1494 0.1248 0.0944 0.0620 0.3460 0.1796 0.1092 195-DS 0.1500 0.2655 0.4460 0.5410 0.5600 0.4005 0.1500 0.2755 0.4100 0.3745 0.3681 0.3311 0.1327 0.1500 0.5600 0.4005 0.1500 196-DS 0.0000 0.0360 0.0860 0.0860 0.0860 0.0652 0.0344 0.0500 0.0860 0.5276 0.0212 0.0001 0.0289 0.0000 0.0860 0.0652 0.0344 197-DS 0.0840 0.1685 0.1840 0.2155 0.2580 0.1813 0.0471 0.0470 0.1740 0.2600 0.1742 0.1652 0.0336 0.1440 0.2580 0.1958 0.0297 198-DS 0.0960 0.2535 0.3080 0.3265 0.3460 0.2755 0.0822 0.0730 0.2500 0.2985 0.2579 0.2324 0.0632 0.1960 0.3460 0.3029 0.0420 199-DS 0.0040 0.0140 0.0860 0.1120 0.1220 0.0659 0.0481 0.0980 0.1180 0.7308 0.0398 0.0189 0.0439 0.0040 0.1220 0.0659 0.0481 200-DS 0.0700 0.0835 0.1020 0.1165 0.1600 0.1024 0.0248 0.0330 0.0900 0.2419 0.0998 0.0973 0.0191 0.0700 0.1600 0.1024 0.0248 172 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2EN-CLEF2007 Statistics for P@1000 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0160 0.0255 0.0770 0.0867 0.0890 0.0619 0.0299 0.0612 0.0730 0.4839 0.0521 0.0411 0.0266 0.0160 0.0890 0.0619 0.0299 177-DS 0.0140 0.0193 0.0310 0.0370 0.0410 0.0293 0.0096 0.0177 0.0270 0.3282 0.0276 0.0256 0.0080 0.0140 0.0410 0.0293 0.0096 178-DS 0.0290 0.0512 0.0870 0.0930 0.1070 0.0712 0.0270 0.0418 0.0780 0.3786 0.0656 0.0594 0.0246 0.0290 0.1070 0.0712 0.0270 179-DS 0.0170 0.0892 0.0990 0.1030 0.1060 0.0880 0.0282 0.0138 0.0890 0.3199 0.0800 0.0659 0.0201 0.0870 0.1060 0.1005 0.0052 180-DS 0.1980 0.2108 0.2830 0.3070 0.3220 0.2639 0.0489 0.0963 0.1240 0.1853 0.2595 0.2550 0.0446 0.1980 0.3220 0.2639 0.0489 181-DS 0.0000 0.0160 0.0170 0.0177 0.0180 0.0147 0.0060 0.0017 0.0180 0.4092 0.0063 0.0001 0.0039 0.0160 0.0180 0.0170 0.0008 182-DS 0.0020 0.0283 0.0440 0.0505 0.0540 0.0365 0.0170 0.0222 0.0520 0.4649 0.0271 0.0112 0.0134 0.0020 0.0540 0.0365 0.0170 183-DS 0.0300 0.0735 0.1040 0.1242 0.1410 0.0951 0.0346 0.0507 0.1110 0.3637 0.0875 0.0777 0.0278 0.0300 0.1410 0.0951 0.0346 184-DS 0.0530 0.0723 0.1690 0.2295 0.2490 0.1539 0.0750 0.1573 0.1960 0.4869 0.1334 0.1123 0.0653 0.0530 0.2490 0.1539 0.0750 185-DS 0.0110 0.0395 0.0600 0.0737 0.0830 0.0529 0.0248 0.0342 0.0720 0.4690 0.0445 0.0336 0.0197 0.0110 0.0830 0.0529 0.0248 186-DS 0.0160 0.0250 0.0270 0.0375 0.0420 0.0299 0.0084 0.0125 0.0260 0.2796 0.0287 0.0274 0.0071 0.0160 0.0420 0.0299 0.0084 187-DS 0.0110 0.2268 0.3260 0.3605 0.3890 0.2793 0.1210 0.1337 0.3780 0.4332 0.2083 0.0807 0.0896 0.2060 0.3890 0.3199 0.0604 188-DS 0.1270 0.2147 0.2470 0.2565 0.2910 0.2324 0.0447 0.0417 0.1640 0.1925 0.2275 0.2216 0.0335 0.1530 0.2910 0.2399 0.0352 189-DS 0.0020 0.0090 0.0240 0.0258 0.0360 0.0197 0.0106 0.0168 0.0340 0.5397 0.0149 0.0087 0.0091 0.0020 0.0360 0.0197 0.0106 190-DS 0.0000 0.0798 0.1000 0.1057 0.1060 0.0847 0.0364 0.0260 0.1060 0.4294 0.0285 0.0001 0.0265 0.0660 0.1060 0.0977 0.0128 191-DS 0.0220 0.0300 0.0460 0.0533 0.0580 0.0425 0.0131 0.0233 0.0360 0.3077 0.0403 0.0378 0.0108 0.0220 0.0580 0.0425 0.0131 192-DS 0.0000 0.0270 0.0450 0.0750 0.0790 0.0447 0.0294 0.0480 0.0790 0.6572 0.0180 0.0001 0.0244 0.0000 0.0790 0.0447 0.0294 193-DS 0.0740 0.1257 0.2530 0.3312 0.3610 0.2356 0.1065 0.2055 0.2870 0.4520 0.2065 0.1739 0.0914 0.0740 0.3610 0.2356 0.1065 194-DS 0.0490 0.0635 0.1070 0.1795 0.2010 0.1153 0.0581 0.1160 0.1520 0.5034 0.1017 0.0897 0.0490 0.0490 0.2010 0.1153 0.0581 195-DS 0.1200 0.1665 0.2930 0.3413 0.3550 0.2599 0.0896 0.1747 0.2350 0.3449 0.2428 0.2242 0.0803 0.1200 0.3550 0.2599 0.0896 196-DS 0.0000 0.0190 0.0440 0.0448 0.0450 0.0337 0.0176 0.0258 0.0450 0.5232 0.0120 0.0001 0.0148 0.0000 0.0450 0.0337 0.0176 197-DS 0.0530 0.1030 0.1140 0.1225 0.1460 0.1092 0.0255 0.0195 0.0930 0.2332 0.1055 0.1007 0.0173 0.1000 0.1460 0.1178 0.0126 198-DS 0.0640 0.1597 0.1800 0.1940 0.2010 0.1673 0.0431 0.0342 0.1370 0.2577 0.1595 0.1483 0.0310 0.1460 0.2010 0.1825 0.0169 199-DS 0.0050 0.0123 0.0510 0.0605 0.0670 0.0389 0.0249 0.0482 0.0620 0.6385 0.0281 0.0179 0.0229 0.0050 0.0670 0.0389 0.0249 200-DS 0.0410 0.0565 0.0650 0.0778 0.1040 0.0674 0.0168 0.0213 0.0630 0.2495 0.0654 0.0634 0.0127 0.0410 0.1040 0.0674 0.0168 173 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2RU-CLEF2007 Domain−Specific Bilingual Russian Task Top 5 Participants − Standard Recall Levels vs Mean Interpolated Precision 100% cheshire [Experiment BERKBENRUCCP15; MAP 13.48%; Pooled] chemnitz [Experiment CUT_DS_BILI_EN2RU_MERGED; MAP 11.41%; Pooled] 90% moscow [Experiment CIRDSBILIEN2RU; MAP 7.15%; Pooled] 80% 70% 60% Precision 50% 40% 30% 20% 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Bilingual Russian Task Top 5 Participants − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) 1 cheshire [Experiment BERKBENRUCCP15; MAP 13.48%; Pooled] chemnitz [Experiment CUT_DS_BILI_EN2RU_MERGED; MAP 11.41%; Pooled] moscow [Experiment CIRDSBILIEN2RU; MAP 7.15%; Pooled] 0.8 0.6 0.4 0.2 Difference 0 −0.2 −0.4 −0.6 −0.8 −1 176−DS177−DS178−DS179−DS180−DS181−DS182−DS183−DS184−DS185−DS186−DS187−DS188−DS189−DS190−DS191−DS192−DS193−DS194−DS195−DS196−DS197−DS198−DS199−DS200−DS Topic Identifier 174 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2RU-CLEF2007 Domain−Specific Bilingual Russian Task − Box Plot of the Topics cheshire [Experiment BERKBENRUCCP15; MAP 13.48%; Pooled] cheshire [Experiment BERKBENRUTHP7; MAP 13.41%; Pooled] chemnitz [Experiment CUT_DS_BILI_EN2RU_MERGED; MAP 11.41%; Pooled] chemnitz [Experiment CUT_DS_BILI_DE2RU_MERGED; MAP 9.38%; Pooled] Experiments chemnitz [Experiment CUT_DS_BILI_DE2RU_MERGED_THES; MAP 9.35%; Pooled] moscow [Experiment CIRDSBILIEN2RU; MAP 7.15%; Pooled] moscow [Experiment CIRDSBILIEN2RU2; MAP 6.82%; Pooled] cheshire [Experiment BERKBDERUTHP7; MAP 2.85%; Pooled] cheshire [Experiment BERKBDERUCCP15; MAP 2.69%; Pooled] 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Average Precision 175 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2RU-CLEF2007 10.2455/TUKEY_T_TEST.1600B16AD4BC96FD493DC4B1D8C52454 Domain−Specific Bilingual Russian Task − Tukey T test with "top group" highlighted BERKBENRUTHP7 BERKBENRUCCP15 CUT_DS_BILI_EN2RU_MERGED CUT_DS_BILI_DE2RU_MERGED Experiments CUT_DS_BILI_DE2RU_MERGED_THES CIRDSBILIEN2RU CIRDSBILIEN2RU2 BERKBDERUCCP15 BERKBDERUTHP7 0 0.05 0.1 0.15 0.2 0.25 0.3 0.35 0.4 arcsin(sqrt(Average Precsion)) 176 177 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2RU-CLEF2007 Domain−Specific Bilingual Russian Task Top 5 Participants − Retrieved documents vs Mean Precision 100% cheshire [Experiment BERKBENRUCCP15; R−Prec 15.28%; Pooled] chemnitz [Experiment CUT_DS_BILI_EN2RU_MERGED; R−Prec 13.27%; Pooled] 90% moscow [Experiment CIRDSBILIEN2RU; R−Prec 10.38%; Pooled] 80% 70% 60% Precision 50% 40% 30% 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Bilingual Russian Task Top 5 Participants − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) 1 cheshire [Experiment BERKBENRUCCP15; R−Prec 15.28%; Pooled] chemnitz [Experiment CUT_DS_BILI_EN2RU_MERGED; R−Prec 13.27%; Pooled] moscow [Experiment CIRDSBILIEN2RU; R−Prec 10.38%; Pooled] 0.8 0.6 0.4 0.2 Difference 0 −0.2 −0.4 −0.6 −0.8 −1 176−DS177−DS178−DS179−DS180−DS181−DS182−DS183−DS184−DS185−DS186−DS187−DS188−DS189−DS190−DS191−DS192−DS193−DS194−DS195−DS196−DS197−DS198−DS199−DS200−DS Topic Identifier 178 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2RU-CLEF2007 Domain−Specific Bilingual Russian Task − Box Plot of the Topics cheshire [Experiment BERKBENRUTHP7; R−Prec 15.51%; Pooled] cheshire [Experiment BERKBENRUCCP15; R−Prec 15.28%; Pooled] chemnitz [Experiment CUT_DS_BILI_EN2RU_MERGED; R−Prec 13.27%; Pooled] chemnitz [Experiment CUT_DS_BILI_DE2RU_MERGED; R−Prec 11.39%; Pooled] Experiments chemnitz [Experiment CUT_DS_BILI_DE2RU_MERGED_THES; R−Prec 11.39%; Pooled] moscow [Experiment CIRDSBILIEN2RU; R−Prec 10.38%; Pooled] moscow [Experiment CIRDSBILIEN2RU2; R−Prec 9.76%; Pooled] cheshire [Experiment BERKBDERUTHP7; R−Prec 4.07%; Pooled] cheshire [Experiment BERKBDERUCCP15; R−Prec 3.86%; Pooled] 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% R−Precision 179 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2RU-CLEF2007 Domain−Specific Bilingual Russian Task − Tukey T test with "top group" highlighted BERKBENRUTHP7 CUT_DS_BILI_EN2RU_MERGED BERKBENRUCCP15 CUT_DS_BILI_DE2RU_MERGED_THES Experiments CUT_DS_BILI_DE2RU_MERGED CIRDSBILIEN2RU CIRDSBILIEN2RU2 BERKBDERUTHP7 BERKBDERUCCP15 0 0.05 0.1 0.15 0.2 0.25 0.3 0.35 0.4 arcsin(sqrt(R−Precision)) 180 181 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2RU-CLEF2007 Statistics for Number of relevant retrieved documents Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.00 0.00 0.00 1.00 2.00 0.44 0.73 1.00 2.00 1.63 0.00 0.00 0.59 0.00 2.00 0.44 0.73 177-DS 6.00 6.75 8.00 10.00 10.00 8.22 1.64 3.25 4.00 0.20 8.07 7.91 1.36 6.00 10.00 8.22 1.64 178-DS 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 N/D 0.00 0.00 0.00 0.00 0.00 0.00 0.00 179-DS 25.00 49.00 79.00 93.25 94.00 67.11 27.78 44.25 69.00 0.41 60.30 52.24 23.21 25.00 94.00 67.11 27.78 180-DS 0.00 3.00 18.00 18.75 21.00 11.56 9.25 15.75 21.00 0.80 0.54 0.00 8.49 0.00 21.00 11.56 9.25 181-DS 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 N/D 0.00 0.00 0.00 0.00 0.00 0.00 0.00 182-DS 0.00 20.25 36.00 39.25 40.00 27.44 16.36 19.00 40.00 0.60 1.23 0.00 12.40 0.00 40.00 27.44 16.36 183-DS 44.00 45.50 51.00 53.00 53.00 49.44 3.97 7.50 9.00 0.08 49.30 49.15 3.51 44.00 53.00 49.44 3.97 184-DS 0.00 6.00 24.00 33.75 48.00 21.00 18.57 27.75 48.00 0.88 0.86 0.00 15.11 0.00 48.00 21.00 18.57 185-DS 0.00 0.00 5.00 8.00 8.00 4.11 4.01 8.00 8.00 0.98 0.02 0.00 3.65 0.00 8.00 4.11 4.01 186-DS 3.00 3.00 3.00 5.00 11.00 4.78 3.53 2.00 8.00 0.74 4.00 3.58 2.77 3.00 3.00 3.00 0.00 187-DS 2.00 5.25 217.00 292.00 310.00 157.22 147.62 286.75 308.00 0.94 41.36 7.60 135.98 2.00 310.00 157.22 147.62 188-DS 0.00 9.75 14.00 37.00 51.00 20.78 17.52 27.25 51.00 0.84 0.90 0.00 13.98 0.00 51.00 20.78 17.52 189-DS 2.00 3.00 4.00 6.50 11.00 5.22 3.42 3.50 9.00 0.65 4.43 3.86 2.57 2.00 11.00 5.22 3.42 190-DS 2.00 2.00 120.00 125.00 126.00 69.33 63.91 123.00 124.00 0.92 19.73 4.41 59.85 2.00 126.00 69.33 63.91 191-DS 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 N/D 0.00 0.00 0.00 0.00 0.00 0.00 0.00 192-DS 1.00 1.00 1.00 1.00 1.00 1.00 0.00 0.00 0.00 0.00 1.00 1.00 0.00 1.00 1.00 1.00 0.00 193-DS 0.00 6.75 17.00 18.00 21.00 12.56 7.62 11.25 21.00 0.61 2.65 0.00 6.72 0.00 21.00 12.56 7.62 194-DS 17.00 23.25 83.00 92.25 111.00 62.11 40.25 69.00 94.00 0.65 48.17 36.27 36.32 17.00 111.00 62.11 40.25 195-DS 15.00 20.50 66.00 83.50 85.00 51.67 31.94 63.00 70.00 0.62 40.99 31.59 29.26 15.00 85.00 51.67 31.94 196-DS 1.00 3.25 6.00 8.00 8.00 5.22 2.86 4.75 7.00 0.55 4.12 2.83 2.42 1.00 8.00 5.22 2.86 197-DS 0.00 2.25 5.00 23.75 26.00 10.11 11.34 21.50 26.00 1.12 0.41 0.00 9.93 0.00 26.00 10.11 11.34 198-DS 57.00 71.50 76.00 90.25 103.00 79.22 16.02 18.75 46.00 0.20 77.80 76.40 12.07 57.00 103.00 79.22 16.02 199-DS 1.00 2.75 4.00 4.00 4.00 3.22 1.09 1.25 3.00 0.34 2.98 2.63 0.86 1.00 4.00 3.22 1.09 200-DS 57.00 65.50 70.00 75.25 80.00 70.22 7.26 9.75 23.00 0.10 69.88 69.52 5.36 57.00 80.00 70.22 7.26 182 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2RU-CLEF2007 Statistics for Average Precsion Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0005 0.1720 0.0192 0.0573 0.0005 0.1720 2.9801 0.0001 0.0000 0.0340 0.0000 0.0005 0.0001 0.0002 177-DS 0.0066 0.0147 0.0382 0.0525 0.0539 0.0338 0.0199 0.0378 0.0472 0.5889 0.0271 0.0203 0.0179 0.0066 0.0539 0.0338 0.0199 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0119 0.0531 0.1370 0.2725 0.3383 0.1494 0.1208 0.2194 0.3264 0.8090 0.0903 0.0410 0.0982 0.0119 0.3383 0.1494 0.1208 180-DS 0.0000 0.0001 0.0052 0.0165 0.0235 0.0079 0.0091 0.0163 0.0235 1.1431 0.0010 0.0000 0.0076 0.0000 0.0235 0.0079 0.0091 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.0000 0.0959 0.1400 0.1875 0.2538 0.1359 0.0907 0.0916 0.2538 0.6674 0.0193 0.0000 0.0622 0.0000 0.2538 0.1359 0.0907 183-DS 0.1197 0.1570 0.2154 0.2759 0.3101 0.2148 0.0696 0.1189 0.1904 0.3241 0.2046 0.1946 0.0567 0.1197 0.3101 0.2148 0.0696 184-DS 0.0000 0.0217 0.0530 0.1598 0.4129 0.1182 0.1678 0.1381 0.4129 1.4204 0.0113 0.0000 0.1301 0.0000 0.0768 0.0345 0.0287 185-DS 0.0000 0.0000 0.0027 0.0099 0.0147 0.0049 0.0056 0.0099 0.0147 1.1515 0.0004 0.0000 0.0048 0.0000 0.0147 0.0049 0.0056 186-DS 0.0019 0.0037 0.0041 0.0297 0.1042 0.0261 0.0443 0.0260 0.1022 1.6983 0.0077 0.0044 0.0347 0.0019 0.0048 0.0038 0.0009 187-DS 0.0000 0.0001 0.3505 0.5713 0.6647 0.3046 0.3031 0.5712 0.6646 0.9949 0.0101 0.0001 0.2707 0.0000 0.6647 0.3046 0.3031 188-DS 0.0000 0.0032 0.0181 0.0190 0.0335 0.0134 0.0112 0.0157 0.0335 0.8358 0.0029 0.0000 0.0093 0.0000 0.0335 0.0134 0.0112 189-DS 0.0003 0.0016 0.0025 0.0091 0.0129 0.0054 0.0050 0.0076 0.0127 0.9296 0.0031 0.0013 0.0043 0.0003 0.0129 0.0054 0.0050 190-DS 0.0000 0.0000 0.5186 0.7111 0.7413 0.3648 0.3529 0.7111 0.7412 0.9675 0.0087 0.0001 0.3242 0.0000 0.7413 0.3648 0.3529 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0023 0.0045 0.0200 0.0303 0.0370 0.0172 0.0136 0.0258 0.0348 0.7923 0.0110 0.0065 0.0118 0.0023 0.0370 0.0172 0.0136 193-DS 0.0000 0.0621 0.0872 0.1000 0.1284 0.0769 0.0464 0.0378 0.1284 0.6040 0.0210 0.0001 0.0340 0.0825 0.1284 0.0987 0.0193 194-DS 0.0068 0.0235 0.0387 0.2536 0.6712 0.1786 0.2807 0.2300 0.6644 1.5717 0.0530 0.0214 0.2187 0.0068 0.1147 0.0380 0.0364 195-DS 0.0023 0.0106 0.0695 0.1304 0.1659 0.0671 0.0631 0.1197 0.1635 0.9402 0.0293 0.0086 0.0524 0.0023 0.1659 0.0671 0.0631 196-DS 0.0002 0.0030 0.0097 0.0270 0.0660 0.0195 0.0247 0.0240 0.0658 1.2658 0.0061 0.0010 0.0187 0.0002 0.0573 0.0137 0.0188 197-DS 0.0000 0.0051 0.0143 0.0387 0.0855 0.0254 0.0319 0.0336 0.0855 1.2579 0.0038 0.0000 0.0244 0.0000 0.0855 0.0254 0.0319 198-DS 0.0484 0.0737 0.1433 0.2481 0.3763 0.1696 0.1275 0.1744 0.3280 0.7518 0.1320 0.1046 0.0999 0.0484 0.3763 0.1696 0.1275 199-DS 0.0005 0.0021 0.0031 0.0207 0.0335 0.0116 0.0121 0.0186 0.0330 1.0476 0.0053 0.0021 0.0106 0.0005 0.0335 0.0116 0.0121 200-DS 0.0812 0.1245 0.1413 0.1999 0.2513 0.1623 0.0535 0.0754 0.1700 0.3297 0.1541 0.1458 0.0452 0.0812 0.2513 0.1623 0.0535 183 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2RU-CLEF2007 Statistics for R-Precision Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 177-DS 0.0000 0.0000 0.0000 0.1250 0.2000 0.0556 0.0882 0.1250 0.2000 1.5875 0.0003 0.0000 0.0741 0.0000 0.2000 0.0556 0.0882 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0417 0.0885 0.2188 0.3385 0.4062 0.2106 0.1340 0.2500 0.3646 0.6361 0.1612 0.1116 0.1062 0.0417 0.4062 0.2106 0.1340 180-DS 0.0000 0.0000 0.0000 0.0735 0.0882 0.0294 0.0382 0.0735 0.0882 1.2990 0.0005 0.0000 0.0327 0.0000 0.0882 0.0294 0.0382 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.0000 0.1071 0.1633 0.2449 0.2653 0.1633 0.1025 0.1378 0.2653 0.6281 0.0225 0.0000 0.0771 0.0000 0.2653 0.1633 0.1025 183-DS 0.1132 0.1887 0.2264 0.2877 0.3019 0.2306 0.0617 0.0991 0.1887 0.2676 0.2220 0.2118 0.0466 0.1132 0.3019 0.2306 0.0617 184-DS 0.0000 0.0409 0.1273 0.2682 0.4909 0.1697 0.1883 0.2273 0.4909 1.1096 0.0182 0.0000 0.1455 0.0000 0.4909 0.1697 0.1883 185-DS 0.0000 0.0000 0.0000 0.0139 0.0556 0.0123 0.0245 0.0139 0.0556 1.9843 0.0001 0.0000 0.0192 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0000 0.0227 0.0909 0.0202 0.0401 0.0227 0.0909 1.9843 0.0001 0.0000 0.0314 0.0000 0.0000 0.0000 0.0000 187-DS 0.0030 0.0030 0.3701 0.5246 0.6030 0.2866 0.2769 0.5216 0.6000 0.9662 0.0558 0.0076 0.2514 0.0030 0.6030 0.2866 0.2769 188-DS 0.0000 0.0000 0.0349 0.0581 0.0814 0.0323 0.0295 0.0581 0.0814 0.9139 0.0027 0.0000 0.0235 0.0000 0.0814 0.0323 0.0295 189-DS 0.0000 0.0000 0.0000 0.0125 0.0500 0.0111 0.0220 0.0125 0.0500 1.9843 0.0001 0.0000 0.0173 0.0000 0.0000 0.0000 0.0000 190-DS 0.0000 0.0000 0.5794 0.7480 0.7857 0.3871 0.3729 0.7480 0.7857 0.9633 0.0049 0.0000 0.3441 0.0000 0.7857 0.3871 0.3729 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 193-DS 0.0000 0.0600 0.1200 0.1700 0.2400 0.1200 0.0825 0.1100 0.2400 0.6872 0.0173 0.0000 0.0622 0.0000 0.2400 0.1200 0.0825 194-DS 0.0394 0.0571 0.1339 0.3012 0.7402 0.2353 0.2876 0.2441 0.7008 1.2220 0.1299 0.0851 0.2226 0.0394 0.1575 0.0922 0.0526 195-DS 0.0146 0.0748 0.1533 0.2336 0.2701 0.1419 0.0941 0.1588 0.2555 0.6632 0.0965 0.0492 0.0775 0.0146 0.2701 0.1419 0.0941 196-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 197-DS 0.0000 0.0242 0.0323 0.0968 0.0968 0.0502 0.0399 0.0726 0.0968 0.7946 0.0083 0.0000 0.0342 0.0000 0.0968 0.0502 0.0399 198-DS 0.1280 0.1540 0.2720 0.3340 0.4480 0.2604 0.1237 0.1800 0.3200 0.4749 0.2354 0.2133 0.0982 0.1280 0.4480 0.2604 0.1237 199-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 200-DS 0.1220 0.1768 0.1951 0.2927 0.3049 0.2195 0.0651 0.1159 0.1829 0.2966 0.2106 0.2016 0.0542 0.1220 0.3049 0.2195 0.0651 184 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2RU-CLEF2007 Statistics for Binary Preference Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 177-DS 0.0000 0.0000 0.0000 0.0425 0.0800 0.0211 0.0348 0.0425 0.0800 1.6485 0.0002 0.0000 0.0281 0.0000 0.0800 0.0211 0.0348 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0290 0.0728 0.1221 0.2364 0.3380 0.1486 0.1040 0.1635 0.3090 0.6996 0.1120 0.0777 0.0824 0.0290 0.3380 0.1486 0.1040 180-DS 0.0000 0.0000 0.0000 0.0258 0.0538 0.0130 0.0190 0.0258 0.0538 1.4640 0.0003 0.0000 0.0150 0.0000 0.0538 0.0130 0.0190 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.0000 0.0809 0.1270 0.2098 0.2370 0.1358 0.0914 0.1289 0.2370 0.6730 0.0192 0.0000 0.0733 0.0000 0.2370 0.1358 0.0914 183-DS 0.0965 0.1362 0.1638 0.2262 0.2460 0.1739 0.0530 0.0901 0.1495 0.3048 0.1666 0.1593 0.0425 0.0965 0.2460 0.1739 0.0530 184-DS 0.0000 0.0369 0.0939 0.1882 0.4139 0.1363 0.1615 0.1512 0.4139 1.1848 0.0152 0.0000 0.1226 0.0000 0.4139 0.1363 0.1615 185-DS 0.0000 0.0000 0.0000 0.0046 0.0185 0.0041 0.0082 0.0046 0.0185 1.9843 0.0001 0.0000 0.0064 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0000 0.0041 0.0165 0.0037 0.0073 0.0041 0.0165 1.9843 0.0001 0.0000 0.0057 0.0000 0.0000 0.0000 0.0000 187-DS 0.0040 0.0103 0.6037 0.8112 0.8675 0.4373 0.4141 0.8009 0.8635 0.9468 0.0990 0.0152 0.3813 0.0040 0.8675 0.4373 0.4141 188-DS 0.0000 0.0000 0.0288 0.0298 0.0462 0.0191 0.0174 0.0298 0.0462 0.9090 0.0019 0.0000 0.0154 0.0000 0.0462 0.0191 0.0174 189-DS 0.0000 0.0000 0.0000 0.0075 0.0300 0.0067 0.0132 0.0075 0.0300 1.9843 0.0001 0.0000 0.0104 0.0000 0.0000 0.0000 0.0000 190-DS 0.0000 0.0005 0.5845 0.8151 0.8279 0.4161 0.4016 0.8145 0.8279 0.9653 0.0132 0.0000 0.3695 0.0000 0.8279 0.4161 0.4016 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 193-DS 0.0000 0.0348 0.0672 0.0992 0.1664 0.0732 0.0593 0.0644 0.1664 0.8103 0.0114 0.0000 0.0426 0.0000 0.1664 0.0732 0.0593 194-DS 0.0268 0.0331 0.0719 0.2717 0.7918 0.2164 0.3245 0.2386 0.7650 1.4992 0.0878 0.0528 0.2536 0.0268 0.1016 0.0534 0.0296 195-DS 0.0102 0.0398 0.1165 0.1862 0.2592 0.1109 0.0866 0.1464 0.2490 0.7808 0.0702 0.0349 0.0697 0.0102 0.2592 0.1109 0.0866 196-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 197-DS 0.0000 0.0086 0.0271 0.0458 0.0458 0.0274 0.0195 0.0372 0.0458 0.7109 0.0053 0.0000 0.0159 0.0000 0.0458 0.0274 0.0195 198-DS 0.1032 0.1143 0.2060 0.3134 0.4644 0.2329 0.1443 0.1991 0.3613 0.6197 0.1979 0.1713 0.1125 0.1032 0.4644 0.2329 0.1443 199-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 200-DS 0.0895 0.1208 0.1303 0.2241 0.2430 0.1605 0.0570 0.1033 0.1535 0.3550 0.1518 0.1437 0.0492 0.0895 0.2430 0.1605 0.0570 185 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2RU-CLEF2007 Statistics for Precision at the 0% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0010 0.3333 0.0373 0.1110 0.0010 0.3333 2.9795 0.0001 0.0000 0.0658 0.0000 0.0010 0.0003 0.0005 177-DS 0.0122 0.0500 0.0909 0.1438 0.2000 0.0970 0.0670 0.0937 0.1878 0.6901 0.0738 0.0494 0.0520 0.0122 0.2000 0.0970 0.0670 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0909 0.2933 0.5000 1.0000 1.0000 0.5603 0.3660 0.7067 0.9091 0.6531 0.4160 0.2665 0.2931 0.0909 1.0000 0.5603 0.3660 180-DS 0.0000 0.0034 0.0372 0.1120 0.1724 0.0535 0.0635 0.1086 0.1724 1.1854 0.0057 0.0000 0.0528 0.0000 0.1724 0.0535 0.0635 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.0000 0.3750 0.8889 1.0000 1.0000 0.6420 0.4140 0.6250 1.0000 0.6449 0.0647 0.0000 0.3484 0.0000 1.0000 0.6420 0.4140 183-DS 0.5000 0.8750 1.0000 1.0000 1.0000 0.8889 0.2205 0.1250 0.5000 0.2480 0.8572 0.8182 0.1728 1.0000 1.0000 1.0000 0.0000 184-DS 0.0000 0.6000 1.0000 1.0000 1.0000 0.7333 0.4243 0.4000 1.0000 0.5785 0.0737 0.0000 0.3259 0.8000 1.0000 0.9429 0.0976 185-DS 0.0000 0.0000 0.0116 0.0628 0.0769 0.0275 0.0338 0.0628 0.0769 1.2251 0.0010 0.0000 0.0287 0.0000 0.0769 0.0275 0.0338 186-DS 0.0096 0.0174 0.0185 0.0759 0.2353 0.0662 0.0959 0.0584 0.2257 1.4494 0.0310 0.0211 0.0752 0.0096 0.0227 0.0179 0.0041 187-DS 0.0057 0.0089 0.9014 1.0000 1.0000 0.5481 0.5134 0.9911 0.9943 0.9366 0.1139 0.0168 0.4802 0.0057 1.0000 0.5481 0.5134 188-DS 0.0000 0.0304 0.0943 0.3405 1.0000 0.2660 0.4182 0.3102 1.0000 1.5720 0.0179 0.0000 0.3262 0.0000 0.1207 0.0563 0.0479 189-DS 0.0032 0.0137 0.0196 0.0566 0.1111 0.0406 0.0416 0.0429 0.1079 1.0262 0.0246 0.0139 0.0314 0.0032 0.1111 0.0406 0.0416 190-DS 0.0022 0.0031 0.8667 1.0000 1.0000 0.5297 0.5020 0.9969 0.9978 0.9477 0.0718 0.0062 0.4682 0.0022 1.0000 0.5297 0.5020 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0023 0.0045 0.0200 0.0303 0.0370 0.0172 0.0136 0.0258 0.0348 0.7923 0.0110 0.0065 0.0118 0.0023 0.0370 0.0172 0.0136 193-DS 0.0000 0.1379 0.1875 0.6250 1.0000 0.3959 0.3861 0.4871 1.0000 0.9753 0.0775 0.0001 0.3148 0.0000 1.0000 0.3959 0.3861 194-DS 0.0909 0.1477 0.9143 1.0000 1.0000 0.5968 0.4425 0.8523 0.9091 0.7414 0.3907 0.2327 0.4127 0.0909 1.0000 0.5968 0.4425 195-DS 0.0278 0.0831 0.5000 1.0000 1.0000 0.4741 0.4331 0.9169 0.9722 0.9135 0.2346 0.0919 0.3621 0.0278 1.0000 0.4741 0.4331 196-DS 0.0018 0.0091 0.0158 0.0375 0.1111 0.0307 0.0360 0.0284 0.1094 1.1713 0.0153 0.0065 0.0259 0.0018 0.0667 0.0207 0.0210 197-DS 0.0000 0.0430 0.1250 0.2083 0.3333 0.1453 0.1237 0.1653 0.3333 0.8516 0.0187 0.0000 0.0931 0.0000 0.3333 0.1453 0.1237 198-DS 0.2857 0.2985 0.4286 1.0000 1.0000 0.5777 0.3239 0.7015 0.7143 0.5606 0.5046 0.4477 0.2815 0.2857 1.0000 0.5777 0.3239 199-DS 0.0030 0.0051 0.0085 0.0556 0.1250 0.0340 0.0410 0.0504 0.1220 1.2058 0.0154 0.0078 0.0319 0.0030 0.1250 0.0340 0.0410 200-DS 0.2500 0.3043 1.0000 1.0000 1.0000 0.7343 0.3460 0.6957 0.7500 0.4711 0.6374 0.5324 0.2987 0.2500 1.0000 0.7343 0.3460 186 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2RU-CLEF2007 Statistics for Precision at the 10% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0010 0.3333 0.0373 0.1110 0.0010 0.3333 2.9795 0.0001 0.0000 0.0658 0.0000 0.0010 0.0003 0.0005 177-DS 0.0122 0.0500 0.0909 0.1438 0.2000 0.0970 0.0670 0.0937 0.1878 0.6901 0.0738 0.0494 0.0520 0.0122 0.2000 0.0970 0.0670 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0494 0.1006 0.2245 0.3604 0.4375 0.2262 0.1394 0.2598 0.3881 0.6164 0.1774 0.1277 0.1079 0.0494 0.4375 0.2262 0.1394 180-DS 0.0000 0.0000 0.0190 0.0771 0.1146 0.0380 0.0463 0.0771 0.1146 1.2179 0.0012 0.0000 0.0382 0.0000 0.1146 0.0380 0.0463 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.0000 0.1974 0.3846 0.5631 0.8889 0.4017 0.3217 0.3658 0.8889 0.8009 0.0428 0.0000 0.2330 0.0000 0.8889 0.4017 0.3217 183-DS 0.2400 0.2664 0.4000 0.4737 0.4737 0.3735 0.1030 0.2073 0.2337 0.2758 0.3600 0.3463 0.0922 0.2400 0.4737 0.3735 0.1030 184-DS 0.0000 0.0122 0.2069 0.4045 0.8000 0.2603 0.3242 0.3923 0.8000 1.2455 0.0182 0.0000 0.2426 0.0000 0.8000 0.2603 0.3242 185-DS 0.0000 0.0000 0.0116 0.0225 0.0581 0.0153 0.0192 0.0225 0.0581 1.2550 0.0008 0.0000 0.0144 0.0000 0.0244 0.0100 0.0113 186-DS 0.0096 0.0174 0.0185 0.0759 0.2353 0.0662 0.0959 0.0584 0.2257 1.4494 0.0310 0.0211 0.0752 0.0096 0.0227 0.0179 0.0041 187-DS 0.0000 0.0000 0.9014 0.9584 0.9730 0.5283 0.5016 0.9584 0.9730 0.9495 0.0058 0.0000 0.4696 0.0000 0.9730 0.5283 0.5016 188-DS 0.0000 0.0150 0.0405 0.0466 0.0582 0.0307 0.0213 0.0316 0.0582 0.6937 0.0059 0.0000 0.0183 0.0000 0.0582 0.0307 0.0213 189-DS 0.0032 0.0085 0.0168 0.0296 0.0385 0.0196 0.0131 0.0211 0.0353 0.6688 0.0152 0.0108 0.0110 0.0032 0.0385 0.0196 0.0131 190-DS 0.0000 0.0000 0.6818 0.8273 0.8667 0.4364 0.4187 0.8273 0.8667 0.9596 0.0052 0.0000 0.3879 0.0000 0.8667 0.4364 0.4187 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0023 0.0045 0.0200 0.0303 0.0370 0.0172 0.0136 0.0258 0.0348 0.7923 0.0110 0.0065 0.0118 0.0023 0.0370 0.0172 0.0136 193-DS 0.0000 0.1045 0.1667 0.2656 0.5000 0.2026 0.1826 0.1611 0.5000 0.9010 0.0494 0.0001 0.1322 0.0000 0.5000 0.2026 0.1826 194-DS 0.0224 0.0682 0.1429 0.3672 0.9268 0.2837 0.3657 0.2989 0.9044 1.2892 0.1336 0.0676 0.2831 0.0224 0.1848 0.1017 0.0668 195-DS 0.0228 0.0814 0.1979 0.3019 0.5600 0.2067 0.1707 0.2205 0.5372 0.8258 0.1344 0.0732 0.1294 0.0228 0.5600 0.2067 0.1707 196-DS 0.0018 0.0091 0.0158 0.0375 0.1111 0.0307 0.0360 0.0284 0.1094 1.1713 0.0153 0.0065 0.0259 0.0018 0.0667 0.0207 0.0210 197-DS 0.0000 0.0000 0.0573 0.0977 0.1489 0.0573 0.0618 0.0977 0.1489 1.0792 0.0016 0.0000 0.0509 0.0000 0.1489 0.0573 0.0618 198-DS 0.1505 0.1775 0.3836 0.5487 0.7222 0.3808 0.2279 0.3712 0.5717 0.5985 0.3220 0.2737 0.1825 0.1505 0.7222 0.3808 0.2279 199-DS 0.0030 0.0051 0.0085 0.0556 0.1250 0.0340 0.0410 0.0504 0.1220 1.2058 0.0154 0.0078 0.0319 0.0030 0.1250 0.0340 0.0410 200-DS 0.1765 0.2131 0.2571 0.4966 0.5909 0.3518 0.1617 0.2835 0.4144 0.4597 0.3200 0.2923 0.1427 0.1765 0.5909 0.3518 0.1617 187 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2RU-CLEF2007 Statistics for Precision at the 20% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0010 0.3333 0.0373 0.1110 0.0010 0.3333 2.9795 0.0001 0.0000 0.0658 0.0000 0.0010 0.0003 0.0005 177-DS 0.0122 0.0500 0.0800 0.1203 0.2000 0.0920 0.0663 0.0703 0.1878 0.7203 0.0702 0.0482 0.0484 0.0122 0.2000 0.0920 0.0663 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0292 0.0520 0.2245 0.3604 0.4375 0.2052 0.1557 0.3084 0.4083 0.7588 0.1373 0.0814 0.1301 0.0292 0.4375 0.2052 0.1557 180-DS 0.0000 0.0000 0.0184 0.0370 0.0805 0.0224 0.0271 0.0370 0.0805 1.2074 0.0009 0.0000 0.0208 0.0000 0.0805 0.0224 0.0271 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.0000 0.1425 0.2055 0.5332 0.7692 0.3346 0.2915 0.3907 0.7692 0.8711 0.0355 0.0000 0.2395 0.0000 0.7692 0.3346 0.2915 183-DS 0.1687 0.1973 0.2619 0.3868 0.4000 0.2812 0.0912 0.1895 0.2313 0.3244 0.2682 0.2560 0.0753 0.1687 0.4000 0.2812 0.0912 184-DS 0.0000 0.0000 0.0246 0.3247 0.7333 0.1864 0.3043 0.3247 0.7333 1.6321 0.0021 0.0000 0.2367 0.0000 0.7333 0.1864 0.3043 185-DS 0.0000 0.0000 0.0107 0.0219 0.0581 0.0141 0.0189 0.0219 0.0581 1.3432 0.0007 0.0000 0.0133 0.0000 0.0219 0.0086 0.0099 186-DS 0.0047 0.0083 0.0129 0.0726 0.2353 0.0612 0.0988 0.0643 0.2305 1.6128 0.0209 0.0120 0.0774 0.0047 0.0184 0.0115 0.0051 187-DS 0.0000 0.0000 0.8933 0.9251 0.9310 0.5080 0.4821 0.9251 0.9310 0.9491 0.0057 0.0000 0.4515 0.0000 0.9310 0.5080 0.4821 188-DS 0.0000 0.0000 0.0000 0.0466 0.0582 0.0195 0.0247 0.0466 0.0582 1.2684 0.0004 0.0000 0.0217 0.0000 0.0582 0.0195 0.0247 189-DS 0.0000 0.0000 0.0053 0.0137 0.0385 0.0104 0.0161 0.0137 0.0385 1.5576 0.0005 0.0000 0.0125 0.0000 0.0055 0.0023 0.0029 190-DS 0.0000 0.0000 0.6753 0.8066 0.8529 0.4259 0.4081 0.8066 0.8529 0.9581 0.0052 0.0000 0.3786 0.0000 0.8529 0.4259 0.4081 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0023 0.0045 0.0200 0.0303 0.0370 0.0172 0.0136 0.0258 0.0348 0.7923 0.0110 0.0065 0.0118 0.0023 0.0370 0.0172 0.0136 193-DS 0.0000 0.1045 0.1556 0.1850 0.2500 0.1401 0.0875 0.0805 0.2500 0.6246 0.0407 0.0001 0.0619 0.0000 0.2500 0.1401 0.0875 194-DS 0.0000 0.0000 0.0834 0.3339 0.9268 0.2387 0.3898 0.3339 0.9268 1.6330 0.0027 0.0000 0.3030 0.0000 0.1405 0.0439 0.0580 195-DS 0.0000 0.0000 0.1125 0.2459 0.3889 0.1246 0.1421 0.2459 0.3889 1.1402 0.0025 0.0000 0.1135 0.0000 0.3889 0.1246 0.1421 196-DS 0.0000 0.0086 0.0158 0.0375 0.0851 0.0274 0.0295 0.0289 0.0851 1.0774 0.0046 0.0000 0.0216 0.0000 0.0667 0.0202 0.0215 197-DS 0.0000 0.0000 0.0000 0.0795 0.1489 0.0391 0.0642 0.0795 0.1489 1.6407 0.0002 0.0000 0.0522 0.0000 0.1489 0.0391 0.0642 198-DS 0.0890 0.1281 0.3176 0.5092 0.5641 0.3150 0.1950 0.3812 0.4751 0.6190 0.2543 0.2004 0.1657 0.0890 0.5641 0.3150 0.1950 199-DS 0.0000 0.0042 0.0053 0.0389 0.0435 0.0198 0.0195 0.0347 0.0435 0.9834 0.0059 0.0001 0.0181 0.0000 0.0435 0.0198 0.0195 200-DS 0.1344 0.1586 0.1981 0.3488 0.4222 0.2489 0.1081 0.1902 0.2878 0.4342 0.2297 0.2132 0.0898 0.1344 0.4222 0.2489 0.1081 188 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2RU-CLEF2007 Statistics for Precision at the 30% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0010 0.3333 0.0373 0.1110 0.0010 0.3333 2.9795 0.0001 0.0000 0.0658 0.0000 0.0010 0.0003 0.0005 177-DS 0.0122 0.0500 0.0667 0.0819 0.0938 0.0623 0.0254 0.0319 0.0816 0.4083 0.0549 0.0435 0.0190 0.0122 0.0938 0.0623 0.0254 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0000 0.0447 0.1930 0.3604 0.4375 0.1855 0.1675 0.3157 0.4375 0.9033 0.0210 0.0000 0.1375 0.0000 0.4375 0.1855 0.1675 180-DS 0.0000 0.0000 0.0000 0.0055 0.0328 0.0061 0.0124 0.0055 0.0328 2.0336 0.0001 0.0000 0.0095 0.0000 0.0000 0.0000 0.0000 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.0000 0.0567 0.1613 0.2085 0.2174 0.1271 0.0902 0.1517 0.2174 0.7099 0.0177 0.0000 0.0792 0.0000 0.2174 0.1271 0.0902 183-DS 0.1036 0.1477 0.2521 0.2951 0.3231 0.2255 0.0847 0.1474 0.2195 0.3756 0.2092 0.1918 0.0729 0.1036 0.3231 0.2255 0.0847 184-DS 0.0000 0.0000 0.0246 0.1652 0.6000 0.1345 0.2402 0.1652 0.6000 1.7862 0.0017 0.0000 0.1870 0.0000 0.0500 0.0143 0.0197 185-DS 0.0000 0.0000 0.0000 0.0120 0.0387 0.0082 0.0128 0.0120 0.0387 1.5541 0.0003 0.0000 0.0091 0.0000 0.0120 0.0044 0.0061 186-DS 0.0000 0.0000 0.0000 0.0588 0.2353 0.0523 0.1038 0.0588 0.2353 1.9843 0.0001 0.0000 0.0813 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.0000 0.4769 0.9009 0.9138 0.4427 0.4403 0.9009 0.9138 0.9946 0.0052 0.0000 0.3935 0.0000 0.9138 0.4427 0.4403 188-DS 0.0000 0.0000 0.0000 0.0466 0.0582 0.0168 0.0255 0.0466 0.0582 1.5132 0.0002 0.0000 0.0224 0.0000 0.0582 0.0168 0.0255 189-DS 0.0000 0.0000 0.0000 0.0066 0.0263 0.0058 0.0116 0.0066 0.0263 1.9843 0.0001 0.0000 0.0091 0.0000 0.0000 0.0000 0.0000 190-DS 0.0000 0.0000 0.6753 0.8049 0.8151 0.4210 0.4025 0.8049 0.8151 0.9560 0.0051 0.0000 0.3742 0.0000 0.8151 0.4210 0.4025 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0023 0.0045 0.0200 0.0303 0.0370 0.0172 0.0136 0.0258 0.0348 0.7923 0.0110 0.0065 0.0118 0.0023 0.0370 0.0172 0.0136 193-DS 0.0000 0.0000 0.1154 0.1334 0.1383 0.0709 0.0678 0.1334 0.1383 0.9555 0.0019 0.0000 0.0631 0.0000 0.1383 0.0709 0.0678 194-DS 0.0000 0.0000 0.0834 0.3276 0.9091 0.2339 0.3804 0.3276 0.9091 1.6263 0.0027 0.0000 0.2956 0.0000 0.1405 0.0439 0.0580 195-DS 0.0000 0.0000 0.1000 0.1826 0.2100 0.0862 0.0895 0.1826 0.2100 1.0378 0.0021 0.0000 0.0766 0.0000 0.2100 0.0862 0.0895 196-DS 0.0000 0.0086 0.0158 0.0375 0.0851 0.0274 0.0295 0.0289 0.0851 1.0774 0.0046 0.0000 0.0216 0.0000 0.0667 0.0202 0.0215 197-DS 0.0000 0.0000 0.0000 0.0516 0.1290 0.0279 0.0472 0.0516 0.1290 1.6913 0.0002 0.0000 0.0372 0.0000 0.0802 0.0153 0.0301 198-DS 0.0686 0.1105 0.2077 0.3705 0.5641 0.2554 0.1923 0.2600 0.4955 0.7529 0.1965 0.1525 0.1495 0.0686 0.5641 0.2554 0.1923 199-DS 0.0000 0.0042 0.0053 0.0389 0.0435 0.0198 0.0195 0.0347 0.0435 0.9834 0.0059 0.0001 0.0181 0.0000 0.0435 0.0198 0.0195 200-DS 0.1344 0.1449 0.1593 0.2891 0.3140 0.2054 0.0752 0.1442 0.1795 0.3662 0.1942 0.1845 0.0642 0.1344 0.3140 0.2054 0.0752 189 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2RU-CLEF2007 Statistics for Precision at the 40% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0010 0.3333 0.0373 0.1110 0.0010 0.3333 2.9795 0.0001 0.0000 0.0658 0.0000 0.0010 0.0003 0.0005 177-DS 0.0117 0.0181 0.0370 0.0511 0.0909 0.0412 0.0273 0.0330 0.0792 0.6621 0.0332 0.0263 0.0195 0.0117 0.0909 0.0412 0.0273 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0000 0.0447 0.1634 0.3579 0.4180 0.1767 0.1635 0.3132 0.4180 0.9250 0.0202 0.0000 0.1345 0.0000 0.4180 0.1767 0.1635 180-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.0000 0.0545 0.1418 0.1695 0.1789 0.1077 0.0725 0.1150 0.1789 0.6732 0.0159 0.0000 0.0626 0.0000 0.1789 0.1077 0.0725 183-DS 0.1036 0.1294 0.2340 0.2676 0.3143 0.2118 0.0805 0.1383 0.2107 0.3801 0.1968 0.1815 0.0679 0.1036 0.3143 0.2118 0.0805 184-DS 0.0000 0.0000 0.0246 0.1462 0.5106 0.1196 0.2140 0.1462 0.5106 1.7892 0.0016 0.0000 0.1673 0.0000 0.0344 0.0120 0.0153 185-DS 0.0000 0.0000 0.0000 0.0090 0.0116 0.0043 0.0052 0.0090 0.0116 1.1992 0.0002 0.0000 0.0048 0.0000 0.0116 0.0043 0.0052 186-DS 0.0000 0.0000 0.0000 0.0302 0.1207 0.0268 0.0532 0.0302 0.1207 1.9843 0.0001 0.0000 0.0417 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.0000 0.3238 0.6994 0.7976 0.3518 0.3614 0.6994 0.7976 1.0273 0.0045 0.0000 0.3189 0.0000 0.7976 0.3518 0.3614 188-DS 0.0000 0.0000 0.0000 0.0446 0.0582 0.0164 0.0249 0.0446 0.0582 1.5190 0.0002 0.0000 0.0219 0.0000 0.0582 0.0164 0.0249 189-DS 0.0000 0.0000 0.0000 0.0036 0.0146 0.0032 0.0064 0.0036 0.0146 1.9843 0.0001 0.0000 0.0050 0.0000 0.0000 0.0000 0.0000 190-DS 0.0000 0.0000 0.6753 0.7855 0.8151 0.4178 0.3991 0.7855 0.8151 0.9553 0.0051 0.0000 0.3713 0.0000 0.8151 0.4178 0.3991 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0023 0.0045 0.0200 0.0303 0.0370 0.0172 0.0136 0.0258 0.0348 0.7923 0.0110 0.0065 0.0118 0.0023 0.0370 0.0172 0.0136 193-DS 0.0000 0.0000 0.1146 0.1334 0.1383 0.0708 0.0676 0.1334 0.1383 0.9561 0.0019 0.0000 0.0629 0.0000 0.1383 0.0708 0.0676 194-DS 0.0000 0.0000 0.0834 0.3276 0.9000 0.2329 0.3784 0.3276 0.9000 1.6247 0.0027 0.0000 0.2940 0.0000 0.1405 0.0439 0.0580 195-DS 0.0000 0.0000 0.0784 0.1235 0.1763 0.0689 0.0739 0.1235 0.1763 1.0734 0.0018 0.0000 0.0612 0.0000 0.1763 0.0689 0.0739 196-DS 0.0000 0.0044 0.0158 0.0369 0.0851 0.0262 0.0297 0.0325 0.0851 1.1331 0.0042 0.0000 0.0220 0.0000 0.0851 0.0262 0.0297 197-DS 0.0000 0.0000 0.0000 0.0426 0.1074 0.0242 0.0413 0.0426 0.1074 1.7054 0.0002 0.0000 0.0323 0.0000 0.0802 0.0138 0.0288 198-DS 0.0608 0.0966 0.1147 0.2783 0.4857 0.1954 0.1699 0.1818 0.4249 0.8693 0.1471 0.1188 0.1321 0.0608 0.4857 0.1954 0.1699 199-DS 0.0000 0.0033 0.0053 0.0146 0.0370 0.0109 0.0121 0.0113 0.0370 1.1133 0.0022 0.0000 0.0088 0.0000 0.0229 0.0076 0.0076 200-DS 0.1003 0.1421 0.1447 0.1700 0.2500 0.1584 0.0408 0.0279 0.1497 0.2576 0.1542 0.1503 0.0273 0.1416 0.1823 0.1537 0.0153 190 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2RU-CLEF2007 Statistics for Precision at the 50% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0010 0.3333 0.0373 0.1110 0.0010 0.3333 2.9795 0.0001 0.0000 0.0658 0.0000 0.0010 0.0003 0.0005 177-DS 0.0092 0.0094 0.0117 0.0247 0.0546 0.0206 0.0179 0.0153 0.0455 0.8681 0.0159 0.0134 0.0138 0.0092 0.0167 0.0117 0.0032 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0000 0.0447 0.1577 0.3579 0.4180 0.1752 0.1636 0.3132 0.4180 0.9336 0.0200 0.0000 0.1355 0.0000 0.4180 0.1752 0.1636 180-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.0000 0.0545 0.1298 0.1416 0.1724 0.0974 0.0644 0.0872 0.1724 0.6608 0.0148 0.0000 0.0535 0.0000 0.1724 0.0974 0.0644 183-DS 0.0922 0.1124 0.2308 0.2595 0.2816 0.1945 0.0785 0.1471 0.1894 0.4038 0.1787 0.1629 0.0710 0.0922 0.2816 0.1945 0.0785 184-DS 0.0000 0.0000 0.0000 0.1397 0.5000 0.1108 0.2116 0.1397 0.5000 1.9093 0.0003 0.0000 0.1656 0.0000 0.0307 0.0044 0.0116 185-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0000 0.0302 0.1207 0.0268 0.0532 0.0302 0.1207 1.9843 0.0001 0.0000 0.0417 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.0000 0.2877 0.5424 0.6829 0.2915 0.3003 0.5424 0.6829 1.0302 0.0041 0.0000 0.2600 0.0000 0.6829 0.2915 0.3003 188-DS 0.0000 0.0000 0.0000 0.0000 0.0578 0.0064 0.0193 0.0000 0.0578 3.0000 0.0000 0.0000 0.0114 0.0000 0.0000 0.0000 0.0000 189-DS 0.0000 0.0000 0.0000 0.0030 0.0122 0.0027 0.0054 0.0030 0.0122 1.9843 0.0000 0.0000 0.0042 0.0000 0.0000 0.0000 0.0000 190-DS 0.0000 0.0000 0.6471 0.7740 0.8151 0.4129 0.3952 0.7740 0.8151 0.9571 0.0051 0.0000 0.3670 0.0000 0.8151 0.4129 0.3952 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0023 0.0045 0.0200 0.0303 0.0370 0.0172 0.0136 0.0258 0.0348 0.7923 0.0110 0.0065 0.0118 0.0023 0.0370 0.0172 0.0136 193-DS 0.0000 0.0000 0.1140 0.1334 0.1383 0.0706 0.0676 0.1334 0.1383 0.9565 0.0019 0.0000 0.0628 0.0000 0.1383 0.0706 0.0676 194-DS 0.0000 0.0000 0.0834 0.3080 0.8723 0.2253 0.3681 0.3080 0.8723 1.6339 0.0026 0.0000 0.2863 0.0000 0.1218 0.0412 0.0530 195-DS 0.0000 0.0000 0.0000 0.1024 0.1182 0.0453 0.0552 0.1024 0.1182 1.2201 0.0006 0.0000 0.0503 0.0000 0.1182 0.0453 0.0552 196-DS 0.0000 0.0044 0.0158 0.0369 0.0851 0.0262 0.0297 0.0325 0.0851 1.1331 0.0042 0.0000 0.0220 0.0000 0.0851 0.0262 0.0297 197-DS 0.0000 0.0000 0.0000 0.0370 0.0773 0.0190 0.0315 0.0370 0.0773 1.6541 0.0002 0.0000 0.0254 0.0000 0.0773 0.0190 0.0315 198-DS 0.0000 0.0580 0.0887 0.2317 0.4267 0.1513 0.1640 0.1736 0.4267 1.0839 0.0176 0.0000 0.1258 0.0000 0.4267 0.1513 0.1640 199-DS 0.0000 0.0033 0.0053 0.0146 0.0370 0.0109 0.0121 0.0113 0.0370 1.1133 0.0022 0.0000 0.0088 0.0000 0.0229 0.0076 0.0076 200-DS 0.0817 0.0931 0.1199 0.1373 0.2193 0.1262 0.0436 0.0442 0.1376 0.3455 0.1205 0.1156 0.0304 0.0817 0.1687 0.1146 0.0280 191 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2RU-CLEF2007 Statistics for Precision at the 60% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0000 0.0107 0.0012 0.0036 0.0000 0.0107 3.0000 0.0000 0.0000 0.0021 0.0000 0.0000 0.0000 0.0000 177-DS 0.0070 0.0083 0.0091 0.0202 0.0546 0.0184 0.0189 0.0118 0.0476 1.0274 0.0131 0.0107 0.0148 0.0070 0.0107 0.0089 0.0013 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0000 0.0000 0.1326 0.3223 0.3681 0.1436 0.1574 0.3223 0.3681 1.0958 0.0027 0.0000 0.1301 0.0000 0.3681 0.1436 0.1574 180-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.0000 0.0000 0.1006 0.1167 0.1277 0.0644 0.0615 0.1167 0.1277 0.9549 0.0018 0.0000 0.0572 0.0000 0.1277 0.0644 0.0615 183-DS 0.0846 0.0922 0.2051 0.2541 0.2721 0.1765 0.0812 0.1619 0.1874 0.4603 0.1583 0.1410 0.0726 0.0846 0.2721 0.1765 0.0812 184-DS 0.0000 0.0000 0.0000 0.0971 0.4239 0.0903 0.1793 0.0971 0.4239 1.9868 0.0001 0.0000 0.1404 0.0000 0.0000 0.0000 0.0000 185-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0000 0.0302 0.1207 0.0268 0.0532 0.0302 0.1207 1.9843 0.0001 0.0000 0.0417 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.0000 0.2463 0.4635 0.6185 0.2495 0.2641 0.4635 0.6185 1.0583 0.0037 0.0000 0.2225 0.0000 0.6185 0.2495 0.2641 188-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 189-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 190-DS 0.0000 0.0000 0.5571 0.7740 0.8151 0.4021 0.3889 0.7740 0.8151 0.9673 0.0050 0.0000 0.3574 0.0000 0.8151 0.4021 0.3889 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0023 0.0045 0.0200 0.0303 0.0370 0.0172 0.0136 0.0258 0.0348 0.7923 0.0110 0.0065 0.0118 0.0023 0.0370 0.0172 0.0136 193-DS 0.0000 0.0000 0.1079 0.1235 0.1293 0.0661 0.0632 0.1235 0.1293 0.9554 0.0018 0.0000 0.0588 0.0000 0.1293 0.0661 0.0632 194-DS 0.0000 0.0000 0.0834 0.2870 0.8723 0.2210 0.3656 0.2870 0.8723 1.6541 0.0026 0.0000 0.2847 0.0000 0.0990 0.0380 0.0476 195-DS 0.0000 0.0000 0.0000 0.0854 0.0889 0.0291 0.0437 0.0854 0.0889 1.5007 0.0002 0.0000 0.0388 0.0000 0.0889 0.0291 0.0437 196-DS 0.0000 0.0000 0.0157 0.0333 0.0641 0.0195 0.0243 0.0333 0.0641 1.2465 0.0008 0.0000 0.0190 0.0000 0.0641 0.0195 0.0243 197-DS 0.0000 0.0000 0.0000 0.0342 0.0769 0.0184 0.0310 0.0342 0.0769 1.6799 0.0002 0.0000 0.0246 0.0000 0.0769 0.0184 0.0310 198-DS 0.0000 0.0565 0.0777 0.1814 0.3378 0.1236 0.1280 0.1249 0.3378 1.0356 0.0155 0.0000 0.0965 0.0000 0.3378 0.1236 0.1280 199-DS 0.0000 0.0000 0.0053 0.0122 0.0199 0.0069 0.0075 0.0122 0.0199 1.0899 0.0005 0.0000 0.0065 0.0000 0.0199 0.0069 0.0075 200-DS 0.0733 0.0836 0.1032 0.1231 0.2032 0.1105 0.0411 0.0395 0.1299 0.3717 0.1050 0.1006 0.0294 0.0733 0.1449 0.0989 0.0234 192 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2RU-CLEF2007 Statistics for Precision at the 70% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0000 0.0107 0.0012 0.0036 0.0000 0.0107 3.0000 0.0000 0.0000 0.0021 0.0000 0.0000 0.0000 0.0000 177-DS 0.0000 0.0055 0.0091 0.0197 0.0546 0.0165 0.0203 0.0142 0.0546 1.2276 0.0029 0.0000 0.0156 0.0000 0.0101 0.0065 0.0046 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0000 0.0000 0.0984 0.2776 0.3417 0.1235 0.1403 0.2776 0.3417 1.1361 0.0024 0.0000 0.1175 0.0000 0.3417 0.1235 0.1403 180-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.0000 0.0000 0.0742 0.0782 0.0862 0.0439 0.0418 0.0782 0.0862 0.9513 0.0015 0.0000 0.0390 0.0000 0.0862 0.0439 0.0418 183-DS 0.0713 0.0827 0.1275 0.2124 0.2649 0.1458 0.0779 0.1297 0.1936 0.5341 0.1290 0.1156 0.0639 0.0713 0.2649 0.1458 0.0779 184-DS 0.0000 0.0000 0.0000 0.0971 0.4239 0.0903 0.1793 0.0971 0.4239 1.9868 0.0001 0.0000 0.1404 0.0000 0.0000 0.0000 0.0000 185-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0000 0.0206 0.0825 0.0183 0.0364 0.0206 0.0825 1.9843 0.0001 0.0000 0.0285 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.0000 0.0000 0.3791 0.5176 0.1887 0.2332 0.3791 0.5176 1.2362 0.0011 0.0000 0.2096 0.0000 0.5176 0.1887 0.2332 188-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 189-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 190-DS 0.0000 0.0000 0.4341 0.7592 0.8151 0.3723 0.3707 0.7592 0.8151 0.9958 0.0047 0.0000 0.3309 0.0000 0.8151 0.3723 0.3707 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0023 0.0045 0.0200 0.0303 0.0370 0.0172 0.0136 0.0258 0.0348 0.7923 0.0110 0.0065 0.0118 0.0023 0.0370 0.0172 0.0136 193-DS 0.0000 0.0000 0.0000 0.0111 0.0444 0.0099 0.0196 0.0111 0.0444 1.9843 0.0001 0.0000 0.0154 0.0000 0.0000 0.0000 0.0000 194-DS 0.0000 0.0000 0.0000 0.1886 0.7946 0.1721 0.3416 0.1886 0.7946 1.9852 0.0001 0.0000 0.2677 0.0000 0.0000 0.0000 0.0000 195-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 196-DS 0.0000 0.0000 0.0104 0.0314 0.0545 0.0174 0.0223 0.0314 0.0545 1.2788 0.0008 0.0000 0.0177 0.0000 0.0545 0.0174 0.0223 197-DS 0.0000 0.0000 0.0000 0.0321 0.0618 0.0158 0.0259 0.0321 0.0618 1.6354 0.0002 0.0000 0.0211 0.0000 0.0618 0.0158 0.0259 198-DS 0.0000 0.0000 0.0000 0.0585 0.2340 0.0520 0.1032 0.0585 0.2340 1.9843 0.0001 0.0000 0.0809 0.0000 0.0000 0.0000 0.0000 199-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 200-DS 0.0000 0.0801 0.0891 0.1028 0.1721 0.0903 0.0450 0.0227 0.1721 0.4979 0.0353 0.0001 0.0266 0.0778 0.1221 0.0915 0.0148 193 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2RU-CLEF2007 Statistics for Precision at the 80% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0000 0.0107 0.0012 0.0036 0.0000 0.0107 3.0000 0.0000 0.0000 0.0021 0.0000 0.0000 0.0000 0.0000 177-DS 0.0000 0.0000 0.0091 0.0197 0.0546 0.0157 0.0209 0.0197 0.0546 1.3264 0.0014 0.0000 0.0159 0.0000 0.0485 0.0109 0.0160 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0000 0.0000 0.0800 0.2112 0.3020 0.1018 0.1195 0.2112 0.3020 1.1736 0.0022 0.0000 0.0992 0.0000 0.3020 0.1018 0.1195 180-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.0000 0.0000 0.0000 0.0125 0.0502 0.0112 0.0221 0.0125 0.0502 1.9843 0.0001 0.0000 0.0173 0.0000 0.0000 0.0000 0.0000 183-DS 0.0494 0.0574 0.0874 0.1996 0.2416 0.1194 0.0805 0.1422 0.1922 0.6746 0.0985 0.0837 0.0690 0.0494 0.2416 0.1194 0.0805 184-DS 0.0000 0.0000 0.0000 0.0491 0.2066 0.0448 0.0889 0.0491 0.2066 1.9851 0.0001 0.0000 0.0697 0.0000 0.0000 0.0000 0.0000 185-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0000 0.0036 0.0146 0.0032 0.0064 0.0036 0.0146 1.9843 0.0001 0.0000 0.0050 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.0000 0.0000 0.3509 0.4323 0.1629 0.1990 0.3509 0.4323 1.2217 0.0011 0.0000 0.1810 0.0000 0.4323 0.1629 0.1990 188-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 189-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 190-DS 0.0000 0.0000 0.3976 0.7546 0.7594 0.3595 0.3597 0.7546 0.7594 1.0006 0.0046 0.0000 0.3196 0.0000 0.7594 0.3595 0.3597 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0023 0.0045 0.0200 0.0303 0.0370 0.0172 0.0136 0.0258 0.0348 0.7923 0.0110 0.0065 0.0118 0.0023 0.0370 0.0172 0.0136 193-DS 0.0000 0.0000 0.0000 0.0070 0.0281 0.0062 0.0124 0.0070 0.0281 1.9843 0.0001 0.0000 0.0097 0.0000 0.0000 0.0000 0.0000 194-DS 0.0000 0.0000 0.0000 0.0804 0.4113 0.0815 0.1632 0.0804 0.4113 2.0032 0.0001 0.0000 0.1267 0.0000 0.0000 0.0000 0.0000 195-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 196-DS 0.0000 0.0000 0.0000 0.0218 0.0461 0.0131 0.0193 0.0218 0.0461 1.4736 0.0003 0.0000 0.0147 0.0000 0.0461 0.0131 0.0193 197-DS 0.0000 0.0000 0.0000 0.0070 0.0591 0.0097 0.0207 0.0070 0.0591 2.1421 0.0001 0.0000 0.0150 0.0000 0.0000 0.0000 0.0000 198-DS 0.0000 0.0000 0.0000 0.0326 0.1305 0.0290 0.0576 0.0326 0.1305 1.9843 0.0001 0.0000 0.0451 0.0000 0.0000 0.0000 0.0000 199-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 200-DS 0.0000 0.0501 0.0733 0.0857 0.1298 0.0676 0.0435 0.0356 0.1298 0.6433 0.0113 0.0000 0.0302 0.0000 0.1298 0.0676 0.0435 194 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2RU-CLEF2007 Statistics for Precision at the 90% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0000 0.0107 0.0012 0.0036 0.0000 0.0107 3.0000 0.0000 0.0000 0.0021 0.0000 0.0000 0.0000 0.0000 177-DS 0.0000 0.0000 0.0000 0.0197 0.0546 0.0137 0.0220 0.0197 0.0546 1.6018 0.0003 0.0000 0.0168 0.0000 0.0485 0.0086 0.0168 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0000 0.0000 0.0000 0.1577 0.2574 0.0671 0.1046 0.1577 0.2574 1.5602 0.0003 0.0000 0.0894 0.0000 0.2574 0.0671 0.1046 180-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 183-DS 0.0000 0.0000 0.0638 0.1311 0.1495 0.0680 0.0620 0.1311 0.1495 0.9109 0.0044 0.0000 0.0499 0.0000 0.1495 0.0680 0.0620 184-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 185-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0000 0.0031 0.0123 0.0027 0.0054 0.0031 0.0123 1.9843 0.0000 0.0000 0.0043 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.0000 0.0000 0.0877 0.3507 0.0779 0.1546 0.0877 0.3507 1.9843 0.0001 0.0000 0.1212 0.0000 0.0000 0.0000 0.0000 188-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 189-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 190-DS 0.0000 0.0000 0.2690 0.6540 0.7233 0.3099 0.3235 0.6540 0.7233 1.0438 0.0042 0.0000 0.2845 0.0000 0.7233 0.3099 0.3235 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0023 0.0045 0.0200 0.0303 0.0370 0.0172 0.0136 0.0258 0.0348 0.7923 0.0110 0.0065 0.0118 0.0023 0.0370 0.0172 0.0136 193-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 194-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 195-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 196-DS 0.0000 0.0000 0.0000 0.0192 0.0440 0.0103 0.0173 0.0192 0.0440 1.6765 0.0001 0.0000 0.0138 0.0000 0.0440 0.0103 0.0173 197-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 198-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 199-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 200-DS 0.0000 0.0000 0.0000 0.0786 0.1024 0.0297 0.0451 0.0786 0.1024 1.5180 0.0002 0.0000 0.0396 0.0000 0.1024 0.0297 0.0451 195 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2RU-CLEF2007 Statistics for Precision at the 100% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0000 0.0107 0.0012 0.0036 0.0000 0.0107 3.0000 0.0000 0.0000 0.0021 0.0000 0.0000 0.0000 0.0000 177-DS 0.0000 0.0000 0.0000 0.0197 0.0546 0.0126 0.0224 0.0197 0.0546 1.7807 0.0001 0.0000 0.0173 0.0000 0.0485 0.0073 0.0170 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 180-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 183-DS 0.0000 0.0000 0.0000 0.0797 0.1075 0.0382 0.0479 0.0797 0.1075 1.2543 0.0006 0.0000 0.0424 0.0000 0.1075 0.0382 0.0479 184-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 185-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0000 0.0031 0.0123 0.0027 0.0054 0.0031 0.0123 1.9843 0.0000 0.0000 0.0043 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 188-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 189-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 190-DS 0.0000 0.0000 0.0000 0.0000 0.2062 0.0229 0.0687 0.0000 0.2062 3.0000 0.0000 0.0000 0.0407 0.0000 0.0000 0.0000 0.0000 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0023 0.0045 0.0200 0.0303 0.0370 0.0172 0.0136 0.0258 0.0348 0.7923 0.0110 0.0065 0.0118 0.0023 0.0370 0.0172 0.0136 193-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 194-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 195-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 196-DS 0.0000 0.0000 0.0000 0.0192 0.0440 0.0103 0.0173 0.0192 0.0440 1.6765 0.0001 0.0000 0.0138 0.0000 0.0440 0.0103 0.0173 197-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 198-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 199-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 200-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 196 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2RU-CLEF2007 Statistics for P@5 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0000 0.2000 0.0222 0.0667 0.0000 0.2000 3.0000 0.0000 0.0000 0.0395 0.0000 0.0000 0.0000 0.0000 177-DS 0.0000 0.0000 0.0000 0.0500 0.2000 0.0444 0.0882 0.0500 0.2000 1.9843 0.0001 0.0000 0.0691 0.0000 0.0000 0.0000 0.0000 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0000 0.1500 0.2000 0.2500 0.4000 0.2000 0.1414 0.1000 0.4000 0.7071 0.0258 0.0000 0.0889 0.2000 0.2000 0.2000 0.0000 180-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.0000 0.1500 0.4000 0.6500 0.8000 0.3778 0.3073 0.5000 0.8000 0.8135 0.0397 0.0000 0.2469 0.0000 0.8000 0.3778 0.3073 183-DS 0.2000 0.3500 0.4000 0.6000 0.6000 0.4444 0.1667 0.2500 0.4000 0.3750 0.4106 0.3724 0.1383 0.2000 0.6000 0.4444 0.1667 184-DS 0.0000 0.1500 0.4000 0.4500 0.6000 0.3111 0.2261 0.3000 0.6000 0.7267 0.0356 0.0000 0.1877 0.0000 0.6000 0.3111 0.2261 185-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.0000 0.6000 1.0000 1.0000 0.5111 0.5011 1.0000 1.0000 0.9804 0.0057 0.0000 0.4543 0.0000 1.0000 0.5111 0.5011 188-DS 0.0000 0.0000 0.0000 0.0500 0.2000 0.0444 0.0882 0.0500 0.2000 1.9843 0.0001 0.0000 0.0691 0.0000 0.0000 0.0000 0.0000 189-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 190-DS 0.0000 0.0000 0.4000 0.4500 0.8000 0.2889 0.3018 0.4500 0.8000 1.0449 0.0041 0.0000 0.2568 0.0000 0.8000 0.2889 0.3018 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 193-DS 0.0000 0.0000 0.0000 0.2500 0.4000 0.1333 0.1732 0.2500 0.4000 1.2990 0.0010 0.0000 0.1481 0.0000 0.4000 0.1333 0.1732 194-DS 0.0000 0.0000 0.2000 0.6000 0.6000 0.2444 0.2789 0.6000 0.6000 1.1409 0.0035 0.0000 0.2370 0.0000 0.6000 0.2444 0.2789 195-DS 0.0000 0.0000 0.2000 0.4000 0.6000 0.2000 0.2236 0.4000 0.6000 1.1180 0.0032 0.0000 0.1778 0.0000 0.6000 0.2000 0.2236 196-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 197-DS 0.0000 0.0000 0.0000 0.0500 0.2000 0.0444 0.0882 0.0500 0.2000 1.9843 0.0001 0.0000 0.0691 0.0000 0.0000 0.0000 0.0000 198-DS 0.2000 0.2000 0.2000 0.8000 0.8000 0.4222 0.2906 0.6000 0.6000 0.6882 0.3429 0.2880 0.2519 0.2000 0.8000 0.4222 0.2906 199-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 200-DS 0.0000 0.1500 0.4000 0.6000 0.6000 0.3556 0.2404 0.4500 0.6000 0.6760 0.0402 0.0000 0.1926 0.0000 0.6000 0.3556 0.2404 197 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2RU-CLEF2007 Statistics for P@10 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0000 0.1000 0.0111 0.0333 0.0000 0.1000 3.0000 0.0000 0.0000 0.0198 0.0000 0.0000 0.0000 0.0000 177-DS 0.0000 0.0000 0.0000 0.1250 0.2000 0.0556 0.0882 0.1250 0.2000 1.5875 0.0003 0.0000 0.0741 0.0000 0.2000 0.0556 0.0882 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0000 0.0750 0.2000 0.3250 0.4000 0.2000 0.1500 0.2500 0.4000 0.7500 0.0250 0.0000 0.1111 0.0000 0.4000 0.2000 0.1500 180-DS 0.0000 0.0000 0.0000 0.0000 0.1000 0.0111 0.0333 0.0000 0.1000 3.0000 0.0000 0.0000 0.0198 0.0000 0.0000 0.0000 0.0000 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.0000 0.2250 0.3000 0.5000 0.8000 0.3556 0.2877 0.2750 0.8000 0.8092 0.0390 0.0000 0.2074 0.0000 0.8000 0.3556 0.2877 183-DS 0.3000 0.3750 0.4000 0.5000 0.5000 0.4111 0.0782 0.1250 0.2000 0.1902 0.4042 0.3971 0.0593 0.3000 0.5000 0.4111 0.0782 184-DS 0.0000 0.1500 0.2000 0.3500 0.8000 0.2889 0.3018 0.2000 0.8000 1.0449 0.0301 0.0000 0.2272 0.0000 0.2000 0.1429 0.0976 185-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0000 0.0250 0.1000 0.0222 0.0441 0.0250 0.1000 1.9843 0.0001 0.0000 0.0346 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.0000 0.7000 1.0000 1.0000 0.5222 0.5044 1.0000 1.0000 0.9659 0.0058 0.0000 0.4642 0.0000 1.0000 0.5222 0.5044 188-DS 0.0000 0.0000 0.0000 0.1250 0.2000 0.0556 0.0882 0.1250 0.2000 1.5875 0.0003 0.0000 0.0741 0.0000 0.2000 0.0556 0.0882 189-DS 0.0000 0.0000 0.0000 0.0250 0.1000 0.0222 0.0441 0.0250 0.1000 1.9843 0.0001 0.0000 0.0346 0.0000 0.0000 0.0000 0.0000 190-DS 0.0000 0.0000 0.4000 0.7250 0.8000 0.3556 0.3609 0.7250 0.8000 1.0151 0.0046 0.0000 0.3160 0.0000 0.8000 0.3556 0.3609 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 193-DS 0.0000 0.0750 0.1000 0.1500 0.4000 0.1333 0.1323 0.0750 0.4000 0.9922 0.0170 0.0000 0.0963 0.0000 0.1000 0.0714 0.0488 194-DS 0.0000 0.0750 0.2000 0.5500 0.8000 0.2889 0.3018 0.4750 0.8000 1.0449 0.0282 0.0000 0.2519 0.0000 0.8000 0.2889 0.3018 195-DS 0.0000 0.0000 0.3000 0.4000 0.5000 0.2111 0.2088 0.4000 0.5000 0.9892 0.0035 0.0000 0.1877 0.0000 0.5000 0.2111 0.2088 196-DS 0.0000 0.0000 0.0000 0.0000 0.1000 0.0111 0.0333 0.0000 0.1000 3.0000 0.0000 0.0000 0.0198 0.0000 0.0000 0.0000 0.0000 197-DS 0.0000 0.0000 0.1000 0.1000 0.1000 0.0667 0.0500 0.1000 0.1000 0.7500 0.0046 0.0000 0.0444 0.0000 0.1000 0.0667 0.0500 198-DS 0.1000 0.1750 0.3000 0.8000 0.8000 0.4000 0.3082 0.6250 0.7000 0.7706 0.2978 0.2227 0.2667 0.1000 0.8000 0.4000 0.3082 199-DS 0.0000 0.0000 0.0000 0.0000 0.1000 0.0111 0.0333 0.0000 0.1000 3.0000 0.0000 0.0000 0.0198 0.0000 0.0000 0.0000 0.0000 200-DS 0.2000 0.2000 0.3000 0.4000 0.4000 0.3111 0.0928 0.2000 0.2000 0.2983 0.2978 0.2842 0.0790 0.2000 0.4000 0.3111 0.0928 198 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2RU-CLEF2007 Statistics for P@15 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0000 0.0667 0.0074 0.0222 0.0000 0.0667 3.0000 0.0000 0.0000 0.0132 0.0000 0.0000 0.0000 0.0000 177-DS 0.0000 0.0000 0.0000 0.0833 0.1333 0.0370 0.0588 0.0833 0.1333 1.5875 0.0002 0.0000 0.0494 0.0000 0.1333 0.0370 0.0588 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0667 0.1167 0.1333 0.2500 0.4667 0.2000 0.1414 0.1333 0.4000 0.7071 0.1624 0.1340 0.1037 0.0667 0.4000 0.1667 0.1069 180-DS 0.0000 0.0000 0.0000 0.0167 0.0667 0.0148 0.0294 0.0167 0.0667 1.9843 0.0001 0.0000 0.0230 0.0000 0.0000 0.0000 0.0000 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.0000 0.1500 0.3333 0.4667 0.6667 0.3185 0.2422 0.3167 0.6667 0.7603 0.0361 0.0000 0.1794 0.0000 0.6667 0.3185 0.2422 183-DS 0.2667 0.2667 0.4000 0.4000 0.4000 0.3481 0.0648 0.1333 0.1333 0.1861 0.3424 0.3364 0.0576 0.2667 0.4000 0.3481 0.0648 184-DS 0.0000 0.1500 0.2000 0.3167 0.7333 0.2667 0.2603 0.1667 0.7333 0.9763 0.0292 0.0000 0.1926 0.0000 0.2000 0.1429 0.0976 185-DS 0.0000 0.0000 0.0000 0.0167 0.0667 0.0148 0.0294 0.0167 0.0667 1.9843 0.0001 0.0000 0.0230 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0000 0.0333 0.1333 0.0296 0.0588 0.0333 0.1333 1.9843 0.0001 0.0000 0.0461 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.0000 0.6667 1.0000 1.0000 0.5185 0.5031 1.0000 1.0000 0.9702 0.0057 0.0000 0.4609 0.0000 1.0000 0.5185 0.5031 188-DS 0.0000 0.0000 0.0000 0.0833 0.1333 0.0370 0.0588 0.0833 0.1333 1.5875 0.0002 0.0000 0.0494 0.0000 0.1333 0.0370 0.0588 189-DS 0.0000 0.0000 0.0000 0.0167 0.0667 0.0148 0.0294 0.0167 0.0667 1.9843 0.0001 0.0000 0.0230 0.0000 0.0000 0.0000 0.0000 190-DS 0.0000 0.0000 0.6000 0.8000 0.8667 0.4074 0.3964 0.8000 0.8667 0.9731 0.0050 0.0000 0.3621 0.0000 0.8667 0.4074 0.3964 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 193-DS 0.0000 0.0500 0.1333 0.1500 0.2667 0.1111 0.0882 0.1000 0.2667 0.7937 0.0156 0.0000 0.0691 0.0000 0.2667 0.1111 0.0882 194-DS 0.0667 0.1167 0.1333 0.4500 0.8000 0.2889 0.3000 0.3333 0.7333 1.0385 0.1884 0.1374 0.2370 0.0667 0.8000 0.2889 0.3000 195-DS 0.0000 0.0000 0.2000 0.4000 0.5333 0.2000 0.2108 0.4000 0.5333 1.0541 0.0033 0.0000 0.1778 0.0000 0.5333 0.2000 0.2108 196-DS 0.0000 0.0000 0.0000 0.0000 0.0667 0.0074 0.0222 0.0000 0.0667 3.0000 0.0000 0.0000 0.0132 0.0000 0.0000 0.0000 0.0000 197-DS 0.0000 0.0000 0.0667 0.0667 0.0667 0.0444 0.0333 0.0667 0.0667 0.7500 0.0035 0.0000 0.0296 0.0000 0.0667 0.0444 0.0333 198-DS 0.1333 0.2500 0.3333 0.6667 0.6667 0.4000 0.2134 0.4167 0.5333 0.5336 0.3480 0.3000 0.1778 0.1333 0.6667 0.4000 0.2134 199-DS 0.0000 0.0000 0.0000 0.0000 0.0667 0.0074 0.0222 0.0000 0.0667 3.0000 0.0000 0.0000 0.0132 0.0000 0.0000 0.0000 0.0000 200-DS 0.2000 0.2000 0.3333 0.4333 0.5333 0.3407 0.1352 0.2333 0.3333 0.3967 0.3170 0.2951 0.1119 0.2000 0.5333 0.3407 0.1352 199 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2RU-CLEF2007 Statistics for P@20 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0000 0.0500 0.0056 0.0167 0.0000 0.0500 3.0000 0.0000 0.0000 0.0099 0.0000 0.0000 0.0000 0.0000 177-DS 0.0000 0.0000 0.0000 0.0625 0.1000 0.0278 0.0441 0.0625 0.1000 1.5875 0.0002 0.0000 0.0370 0.0000 0.1000 0.0278 0.0441 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0500 0.0875 0.1500 0.2750 0.3500 0.1833 0.1146 0.1875 0.3000 0.6249 0.1482 0.1153 0.0926 0.0500 0.3500 0.1833 0.1146 180-DS 0.0000 0.0000 0.0000 0.0125 0.1000 0.0167 0.0354 0.0125 0.1000 2.1213 0.0001 0.0000 0.0259 0.0000 0.0000 0.0000 0.0000 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.0000 0.1875 0.2500 0.4375 0.5500 0.2889 0.2012 0.2500 0.5500 0.6965 0.0343 0.0000 0.1543 0.0000 0.5500 0.2889 0.2012 183-DS 0.2000 0.2000 0.3000 0.4500 0.4500 0.3167 0.1090 0.2500 0.2500 0.3441 0.3000 0.2842 0.0889 0.2000 0.4500 0.3167 0.1090 184-DS 0.0000 0.1125 0.1500 0.3000 0.6500 0.2333 0.2345 0.1875 0.6500 1.0051 0.0259 0.0000 0.1741 0.0000 0.2000 0.1214 0.0859 185-DS 0.0000 0.0000 0.0000 0.0125 0.0500 0.0111 0.0220 0.0125 0.0500 1.9843 0.0001 0.0000 0.0173 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0000 0.0500 0.2000 0.0444 0.0882 0.0500 0.2000 1.9843 0.0001 0.0000 0.0691 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.0000 0.7500 1.0000 1.0000 0.5278 0.5069 1.0000 1.0000 0.9604 0.0058 0.0000 0.4691 0.0000 1.0000 0.5278 0.5069 188-DS 0.0000 0.0000 0.0000 0.0625 0.1000 0.0278 0.0441 0.0625 0.1000 1.5875 0.0002 0.0000 0.0370 0.0000 0.1000 0.0278 0.0441 189-DS 0.0000 0.0000 0.0000 0.0125 0.0500 0.0111 0.0220 0.0125 0.0500 1.9843 0.0001 0.0000 0.0173 0.0000 0.0000 0.0000 0.0000 190-DS 0.0000 0.0000 0.6500 0.7500 0.8500 0.4111 0.3935 0.7500 0.8500 0.9572 0.0051 0.0000 0.3654 0.0000 0.8500 0.4111 0.3935 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 193-DS 0.0000 0.0375 0.1500 0.1625 0.2500 0.1167 0.0866 0.1250 0.2500 0.7423 0.0164 0.0000 0.0704 0.0000 0.2500 0.1167 0.0866 194-DS 0.0500 0.0875 0.1000 0.4000 0.8500 0.2722 0.3327 0.3125 0.8000 1.2222 0.1527 0.1042 0.2568 0.0500 0.8500 0.2722 0.3327 195-DS 0.0000 0.0000 0.2500 0.3000 0.6000 0.1889 0.2073 0.3000 0.6000 1.0976 0.0032 0.0000 0.1679 0.0000 0.6000 0.1889 0.2073 196-DS 0.0000 0.0000 0.0000 0.0125 0.0500 0.0111 0.0220 0.0125 0.0500 1.9843 0.0001 0.0000 0.0173 0.0000 0.0000 0.0000 0.0000 197-DS 0.0000 0.0000 0.0500 0.0625 0.1000 0.0444 0.0391 0.0625 0.1000 0.8795 0.0034 0.0000 0.0296 0.0000 0.1000 0.0444 0.0391 198-DS 0.1500 0.2000 0.4000 0.5500 0.7000 0.3944 0.2113 0.3500 0.5500 0.5357 0.3433 0.2976 0.1728 0.1500 0.7000 0.3944 0.2113 199-DS 0.0000 0.0000 0.0000 0.0500 0.0500 0.0167 0.0250 0.0500 0.0500 1.5000 0.0002 0.0000 0.0222 0.0000 0.0500 0.0167 0.0250 200-DS 0.2000 0.3000 0.3000 0.4625 0.5500 0.3667 0.1146 0.1625 0.3500 0.3124 0.3507 0.3349 0.0963 0.2000 0.5500 0.3667 0.1146 200 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2RU-CLEF2007 Statistics for P@30 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0000 0.0333 0.0037 0.0111 0.0000 0.0333 3.0000 0.0000 0.0000 0.0066 0.0000 0.0000 0.0000 0.0000 177-DS 0.0000 0.0000 0.0000 0.0667 0.0667 0.0259 0.0324 0.0667 0.0667 1.2495 0.0005 0.0000 0.0288 0.0000 0.0667 0.0259 0.0324 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0667 0.0917 0.1667 0.2667 0.2667 0.1704 0.0841 0.1750 0.2000 0.4935 0.1496 0.1290 0.0708 0.0667 0.2667 0.1704 0.0841 180-DS 0.0000 0.0000 0.0000 0.0333 0.1667 0.0259 0.0547 0.0333 0.1667 2.1105 0.0002 0.0000 0.0346 0.0000 0.0333 0.0083 0.0154 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.0000 0.1250 0.2333 0.3750 0.4000 0.2333 0.1616 0.2500 0.4000 0.6925 0.0289 0.0000 0.1333 0.0000 0.4000 0.2333 0.1616 183-DS 0.1667 0.2000 0.2667 0.3417 0.3667 0.2741 0.0778 0.1417 0.2000 0.2838 0.2638 0.2536 0.0675 0.1667 0.3667 0.2741 0.0778 184-DS 0.0000 0.0750 0.2000 0.2667 0.6000 0.2074 0.2033 0.1917 0.6000 0.9802 0.0236 0.0000 0.1449 0.0000 0.4667 0.1583 0.1499 185-DS 0.0000 0.0000 0.0000 0.0083 0.0333 0.0074 0.0147 0.0083 0.0333 1.9843 0.0001 0.0000 0.0115 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0000 0.0333 0.1333 0.0296 0.0588 0.0333 0.1333 1.9843 0.0001 0.0000 0.0461 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.0000 0.8333 0.9667 1.0000 0.5259 0.5010 0.9667 1.0000 0.9527 0.0058 0.0000 0.4675 0.0000 1.0000 0.5259 0.5010 188-DS 0.0000 0.0000 0.0000 0.0417 0.1000 0.0222 0.0373 0.0417 0.1000 1.6771 0.0002 0.0000 0.0296 0.0000 0.1000 0.0222 0.0373 189-DS 0.0000 0.0000 0.0000 0.0333 0.0333 0.0148 0.0176 0.0333 0.0333 1.1859 0.0004 0.0000 0.0165 0.0000 0.0333 0.0148 0.0176 190-DS 0.0000 0.0000 0.6000 0.6667 0.8333 0.3741 0.3612 0.6667 0.8333 0.9657 0.0048 0.0000 0.3325 0.0000 0.8333 0.3741 0.3612 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0000 0.0000 0.0000 0.0000 0.0333 0.0037 0.0111 0.0000 0.0333 3.0000 0.0000 0.0000 0.0066 0.0000 0.0000 0.0000 0.0000 193-DS 0.0000 0.0500 0.1000 0.1750 0.2333 0.1148 0.0835 0.1250 0.2333 0.7274 0.0164 0.0000 0.0683 0.0000 0.2333 0.1148 0.0835 194-DS 0.0333 0.0583 0.1000 0.3750 0.9000 0.2667 0.3625 0.3167 0.8667 1.3593 0.1260 0.0768 0.2815 0.0333 0.2000 0.0857 0.0573 195-DS 0.0000 0.0250 0.2000 0.3333 0.5000 0.1926 0.1786 0.3083 0.5000 0.9271 0.0206 0.0000 0.1490 0.0000 0.5000 0.1926 0.1786 196-DS 0.0000 0.0000 0.0000 0.0083 0.0667 0.0111 0.0236 0.0083 0.0667 2.1213 0.0001 0.0000 0.0173 0.0000 0.0000 0.0000 0.0000 197-DS 0.0000 0.0250 0.0333 0.0667 0.1000 0.0444 0.0333 0.0417 0.1000 0.7500 0.0078 0.0000 0.0272 0.0000 0.1000 0.0444 0.0333 198-DS 0.1667 0.2583 0.3000 0.4417 0.5667 0.3556 0.1404 0.1833 0.4000 0.3950 0.3312 0.3079 0.1136 0.1667 0.5667 0.3556 0.1404 199-DS 0.0000 0.0000 0.0000 0.0333 0.0333 0.0148 0.0176 0.0333 0.0333 1.1859 0.0004 0.0000 0.0165 0.0000 0.0333 0.0148 0.0176 200-DS 0.2000 0.2333 0.2667 0.4083 0.5000 0.3222 0.1054 0.1750 0.3000 0.3271 0.3075 0.2941 0.0914 0.2000 0.5000 0.3222 0.1054 201 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2RU-CLEF2007 Statistics for P@100 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0000 0.0100 0.0011 0.0033 0.0000 0.0100 3.0000 0.0000 0.0000 0.0020 0.0000 0.0000 0.0000 0.0000 177-DS 0.0000 0.0300 0.0300 0.0400 0.0400 0.0311 0.0127 0.0100 0.0400 0.4080 0.0140 0.0001 0.0079 0.0300 0.0400 0.0350 0.0053 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0400 0.0850 0.2200 0.3425 0.3900 0.2089 0.1322 0.2575 0.3500 0.6330 0.1589 0.1084 0.1057 0.0400 0.3900 0.2089 0.1322 180-DS 0.0000 0.0000 0.0000 0.0625 0.1100 0.0322 0.0449 0.0625 0.1100 1.3946 0.0005 0.0000 0.0363 0.0000 0.1100 0.0322 0.0449 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.0000 0.0975 0.1500 0.1575 0.1900 0.1211 0.0711 0.0600 0.1900 0.5874 0.0181 0.0000 0.0538 0.1300 0.1900 0.1557 0.0215 183-DS 0.1400 0.1475 0.2200 0.2550 0.2700 0.2056 0.0541 0.1075 0.1300 0.2632 0.1989 0.1923 0.0472 0.1400 0.2700 0.2056 0.0541 184-DS 0.0000 0.0300 0.0700 0.1850 0.4000 0.1244 0.1551 0.1550 0.4000 1.2463 0.0134 0.0000 0.1180 0.0000 0.4000 0.1244 0.1551 185-DS 0.0000 0.0000 0.0000 0.0125 0.0500 0.0100 0.0166 0.0125 0.0500 1.6583 0.0003 0.0000 0.0111 0.0000 0.0200 0.0050 0.0076 186-DS 0.0000 0.0075 0.0100 0.0350 0.0800 0.0256 0.0317 0.0275 0.0800 1.2391 0.0040 0.0000 0.0242 0.0000 0.0200 0.0100 0.0082 187-DS 0.0000 0.0000 0.8600 0.9200 0.9200 0.4989 0.4738 0.9200 0.9200 0.9497 0.0056 0.0000 0.4435 0.0000 0.9200 0.4989 0.4738 188-DS 0.0000 0.0150 0.0300 0.0500 0.0700 0.0322 0.0233 0.0350 0.0700 0.7241 0.0062 0.0000 0.0180 0.0000 0.0700 0.0322 0.0233 189-DS 0.0000 0.0075 0.0100 0.0225 0.0300 0.0144 0.0113 0.0150 0.0300 0.7826 0.0032 0.0000 0.0094 0.0000 0.0300 0.0144 0.0113 190-DS 0.0000 0.0000 0.6400 0.7700 0.8000 0.4089 0.3913 0.7700 0.8000 0.9570 0.0050 0.0000 0.3635 0.0000 0.8000 0.4089 0.3913 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0000 0.0000 0.0100 0.0100 0.0100 0.0056 0.0053 0.0100 0.0100 0.9487 0.0005 0.0000 0.0049 0.0000 0.0100 0.0056 0.0053 193-DS 0.0000 0.0525 0.1100 0.1225 0.1300 0.0822 0.0517 0.0700 0.1300 0.6284 0.0132 0.0000 0.0420 0.0000 0.1300 0.0822 0.0517 194-DS 0.0500 0.0575 0.1300 0.3375 0.8400 0.2633 0.3305 0.2800 0.7900 1.2552 0.1423 0.0946 0.2563 0.0500 0.1700 0.0986 0.0561 195-DS 0.0200 0.0500 0.1900 0.2300 0.3200 0.1522 0.1051 0.1800 0.3000 0.6904 0.1055 0.0608 0.0886 0.0200 0.3200 0.1522 0.1051 196-DS 0.0000 0.0000 0.0000 0.0200 0.0500 0.0133 0.0212 0.0200 0.0500 1.5910 0.0003 0.0000 0.0163 0.0000 0.0100 0.0029 0.0049 197-DS 0.0000 0.0150 0.0400 0.0600 0.1200 0.0422 0.0402 0.0450 0.1200 0.9531 0.0069 0.0000 0.0296 0.0000 0.1200 0.0422 0.0402 198-DS 0.1400 0.1550 0.3000 0.3775 0.4900 0.2844 0.1402 0.2225 0.3500 0.4928 0.2541 0.2274 0.1151 0.1400 0.4900 0.2844 0.1402 199-DS 0.0000 0.0000 0.0000 0.0200 0.0300 0.0100 0.0122 0.0200 0.0300 1.2247 0.0003 0.0000 0.0111 0.0000 0.0300 0.0100 0.0122 200-DS 0.1100 0.1575 0.1700 0.2700 0.2900 0.1989 0.0631 0.1125 0.1800 0.3174 0.1900 0.1813 0.0521 0.1100 0.2900 0.1989 0.0631 202 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2RU-CLEF2007 Statistics for P@200 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0000 0.0100 0.0011 0.0033 0.0000 0.0100 3.0000 0.0000 0.0000 0.0020 0.0000 0.0000 0.0000 0.0000 177-DS 0.0100 0.0187 0.0200 0.0263 0.0500 0.0244 0.0136 0.0075 0.0400 0.5550 0.0217 0.0196 0.0102 0.0100 0.0200 0.0179 0.0039 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0400 0.0587 0.1650 0.3063 0.3400 0.1717 0.1200 0.2475 0.3000 0.6989 0.1296 0.0939 0.0978 0.0400 0.3400 0.1717 0.1200 180-DS 0.0000 0.0000 0.0150 0.0500 0.0700 0.0239 0.0271 0.0500 0.0700 1.1357 0.0010 0.0000 0.0232 0.0000 0.0700 0.0239 0.0271 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.0000 0.0525 0.1250 0.1300 0.1400 0.0878 0.0560 0.0775 0.1400 0.6382 0.0138 0.0000 0.0469 0.0000 0.1400 0.0878 0.0560 183-DS 0.0950 0.1212 0.1750 0.2000 0.2300 0.1633 0.0497 0.0787 0.1350 0.3046 0.1563 0.1494 0.0419 0.0950 0.2300 0.1633 0.0497 184-DS 0.0000 0.0188 0.0350 0.1050 0.2150 0.0683 0.0843 0.0862 0.2150 1.2342 0.0085 0.0000 0.0644 0.0000 0.2150 0.0683 0.0843 185-DS 0.0000 0.0000 0.0100 0.0200 0.0300 0.0106 0.0113 0.0200 0.0300 1.0709 0.0006 0.0000 0.0095 0.0000 0.0300 0.0106 0.0113 186-DS 0.0050 0.0100 0.0100 0.0212 0.0400 0.0172 0.0133 0.0112 0.0350 0.7696 0.0138 0.0115 0.0101 0.0050 0.0150 0.0107 0.0035 187-DS 0.0050 0.0050 0.4950 0.6888 0.7600 0.3706 0.3553 0.6838 0.7550 0.9589 0.0750 0.0111 0.3249 0.0050 0.7600 0.3706 0.3553 188-DS 0.0000 0.0188 0.0350 0.0400 0.0500 0.0283 0.0175 0.0212 0.0500 0.6176 0.0058 0.0000 0.0133 0.0000 0.0500 0.0283 0.0175 189-DS 0.0000 0.0050 0.0100 0.0137 0.0250 0.0111 0.0086 0.0088 0.0250 0.7722 0.0049 0.0001 0.0062 0.0000 0.0250 0.0111 0.0086 190-DS 0.0000 0.0000 0.4350 0.5837 0.6100 0.3044 0.2933 0.5837 0.6100 0.9632 0.0043 0.0000 0.2706 0.0000 0.6100 0.3044 0.2933 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0000 0.0037 0.0050 0.0050 0.0050 0.0039 0.0022 0.0012 0.0050 0.5669 0.0013 0.0000 0.0017 0.0050 0.0050 0.0050 0.0000 193-DS 0.0000 0.0263 0.0750 0.0763 0.0800 0.0506 0.0338 0.0500 0.0800 0.6679 0.0088 0.0000 0.0294 0.0000 0.0800 0.0506 0.0338 194-DS 0.0250 0.0400 0.1050 0.2188 0.5000 0.1633 0.1905 0.1787 0.4750 1.1666 0.0918 0.0581 0.1463 0.0250 0.4850 0.1213 0.1526 195-DS 0.0150 0.0725 0.1200 0.1850 0.2100 0.1156 0.0700 0.1125 0.1950 0.6059 0.0862 0.0527 0.0549 0.0150 0.2100 0.1156 0.0700 196-DS 0.0000 0.0037 0.0100 0.0275 0.0400 0.0161 0.0147 0.0238 0.0400 0.9151 0.0032 0.0000 0.0123 0.0000 0.0400 0.0161 0.0147 197-DS 0.0000 0.0112 0.0200 0.0500 0.0750 0.0283 0.0272 0.0388 0.0750 0.9585 0.0050 0.0000 0.0222 0.0000 0.0750 0.0283 0.0272 198-DS 0.0950 0.1188 0.1950 0.2575 0.3550 0.2006 0.1000 0.1387 0.2600 0.4985 0.1797 0.1616 0.0784 0.0950 0.3550 0.2006 0.1000 199-DS 0.0000 0.0037 0.0050 0.0112 0.0150 0.0072 0.0057 0.0075 0.0150 0.7826 0.0019 0.0000 0.0047 0.0000 0.0150 0.0072 0.0057 200-DS 0.1250 0.1400 0.1550 0.1663 0.2150 0.1572 0.0256 0.0263 0.0900 0.1630 0.1555 0.1540 0.0174 0.1250 0.1700 0.1500 0.0146 203 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2RU-CLEF2007 Statistics for P@500 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0000 0.0040 0.0004 0.0013 0.0000 0.0040 3.0000 0.0000 0.0000 0.0008 0.0000 0.0000 0.0000 0.0000 177-DS 0.0080 0.0080 0.0100 0.0125 0.0200 0.0113 0.0050 0.0045 0.0120 0.4412 0.0106 0.0100 0.0039 0.0080 0.0100 0.0089 0.0011 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0360 0.0420 0.1240 0.1695 0.1800 0.1047 0.0630 0.1275 0.1440 0.6018 0.0855 0.0688 0.0557 0.0360 0.1800 0.1047 0.0630 180-DS 0.0000 0.0000 0.0120 0.0340 0.0400 0.0162 0.0172 0.0340 0.0400 1.0596 0.0008 0.0000 0.0154 0.0000 0.0400 0.0162 0.0172 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.0000 0.0390 0.0700 0.0700 0.0700 0.0507 0.0296 0.0310 0.0700 0.5845 0.0092 0.0000 0.0225 0.0000 0.0700 0.0507 0.0296 183-DS 0.0680 0.0760 0.0860 0.1030 0.1060 0.0873 0.0141 0.0270 0.0380 0.1619 0.0863 0.0853 0.0116 0.0680 0.1060 0.0873 0.0141 184-DS 0.0000 0.0105 0.0140 0.0500 0.0920 0.0316 0.0359 0.0395 0.0920 1.1390 0.0050 0.0000 0.0279 0.0000 0.0920 0.0316 0.0359 185-DS 0.0000 0.0000 0.0080 0.0100 0.0140 0.0058 0.0057 0.0100 0.0140 0.9858 0.0005 0.0000 0.0051 0.0000 0.0140 0.0058 0.0057 186-DS 0.0040 0.0060 0.0060 0.0085 0.0160 0.0080 0.0046 0.0025 0.0120 0.5728 0.0071 0.0065 0.0036 0.0040 0.0060 0.0057 0.0008 187-DS 0.0040 0.0055 0.3080 0.4295 0.4940 0.2344 0.2247 0.4240 0.4900 0.9583 0.0575 0.0106 0.2040 0.0040 0.4940 0.2344 0.2247 188-DS 0.0000 0.0120 0.0240 0.0400 0.0500 0.0240 0.0174 0.0280 0.0500 0.7253 0.0049 0.0000 0.0133 0.0000 0.0500 0.0240 0.0174 189-DS 0.0000 0.0055 0.0060 0.0080 0.0140 0.0069 0.0045 0.0025 0.0140 0.6510 0.0034 0.0001 0.0032 0.0040 0.0060 0.0057 0.0008 190-DS 0.0000 0.0015 0.2400 0.2420 0.2500 0.1358 0.1279 0.2405 0.2500 0.9421 0.0089 0.0000 0.1198 0.0000 0.2500 0.1358 0.1279 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0020 0.0020 0.0020 0.0020 0.0020 0.0020 0.0000 0.0000 0.0000 0.0000 0.0020 0.0020 0.0000 0.0020 0.0020 0.0020 0.0000 193-DS 0.0000 0.0105 0.0300 0.0345 0.0360 0.0218 0.0150 0.0240 0.0360 0.6879 0.0045 0.0000 0.0131 0.0000 0.0360 0.0218 0.0150 194-DS 0.0240 0.0255 0.0480 0.1445 0.2160 0.0831 0.0803 0.1190 0.1920 0.9666 0.0558 0.0412 0.0668 0.0240 0.2160 0.0831 0.0803 195-DS 0.0220 0.0385 0.0900 0.1115 0.1280 0.0753 0.0429 0.0730 0.1060 0.5691 0.0621 0.0491 0.0376 0.0220 0.1280 0.0753 0.0429 196-DS 0.0000 0.0050 0.0100 0.0130 0.0160 0.0091 0.0057 0.0080 0.0160 0.6220 0.0041 0.0001 0.0045 0.0000 0.0160 0.0091 0.0057 197-DS 0.0000 0.0045 0.0100 0.0325 0.0500 0.0173 0.0193 0.0280 0.0500 1.1112 0.0031 0.0000 0.0160 0.0000 0.0500 0.0173 0.0193 198-DS 0.0660 0.0955 0.1040 0.1550 0.1820 0.1187 0.0422 0.0595 0.1160 0.3556 0.1123 0.1063 0.0342 0.0660 0.1820 0.1187 0.0422 199-DS 0.0020 0.0020 0.0040 0.0080 0.0080 0.0051 0.0028 0.0060 0.0060 0.5572 0.0043 0.0036 0.0026 0.0020 0.0080 0.0051 0.0028 200-DS 0.0760 0.0850 0.1020 0.1075 0.1260 0.0978 0.0174 0.0225 0.0500 0.1779 0.0964 0.0951 0.0140 0.0760 0.1260 0.0978 0.0174 204 DS-BILI-CLEF2007 Track Overview Results and Graphs DS-BILI-X2RU-CLEF2007 Statistics for P@1000 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0010 0.0020 0.0004 0.0007 0.0010 0.0020 1.6346 0.0001 0.0000 0.0006 0.0000 0.0020 0.0004 0.0007 177-DS 0.0060 0.0068 0.0080 0.0100 0.0100 0.0082 0.0016 0.0032 0.0040 0.1996 0.0081 0.0079 0.0014 0.0060 0.0100 0.0082 0.0016 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0250 0.0490 0.0790 0.0933 0.0940 0.0671 0.0278 0.0443 0.0690 0.4140 0.0603 0.0522 0.0232 0.0250 0.0940 0.0671 0.0278 180-DS 0.0000 0.0030 0.0180 0.0187 0.0210 0.0116 0.0092 0.0157 0.0210 0.8003 0.0025 0.0000 0.0085 0.0000 0.0210 0.0116 0.0092 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.0000 0.0203 0.0360 0.0393 0.0400 0.0274 0.0164 0.0190 0.0400 0.5960 0.0057 0.0000 0.0124 0.0000 0.0400 0.0274 0.0164 183-DS 0.0440 0.0455 0.0510 0.0530 0.0530 0.0494 0.0040 0.0075 0.0090 0.0803 0.0493 0.0492 0.0035 0.0440 0.0530 0.0494 0.0040 184-DS 0.0000 0.0060 0.0240 0.0337 0.0480 0.0210 0.0186 0.0277 0.0480 0.8845 0.0040 0.0000 0.0151 0.0000 0.0480 0.0210 0.0186 185-DS 0.0000 0.0000 0.0050 0.0080 0.0080 0.0041 0.0040 0.0080 0.0080 0.9763 0.0004 0.0000 0.0037 0.0000 0.0080 0.0041 0.0040 186-DS 0.0030 0.0030 0.0030 0.0050 0.0110 0.0048 0.0035 0.0020 0.0080 0.7383 0.0040 0.0036 0.0028 0.0030 0.0030 0.0030 0.0000 187-DS 0.0020 0.0053 0.2170 0.2920 0.3100 0.1572 0.1476 0.2868 0.3080 0.9389 0.0414 0.0076 0.1360 0.0020 0.3100 0.1572 0.1476 188-DS 0.0000 0.0098 0.0140 0.0370 0.0510 0.0208 0.0175 0.0273 0.0510 0.8432 0.0042 0.0000 0.0140 0.0000 0.0510 0.0208 0.0175 189-DS 0.0020 0.0030 0.0040 0.0065 0.0110 0.0052 0.0034 0.0035 0.0090 0.6548 0.0044 0.0039 0.0026 0.0020 0.0110 0.0052 0.0034 190-DS 0.0020 0.0020 0.1200 0.1250 0.1260 0.0693 0.0639 0.1230 0.1240 0.9218 0.0197 0.0044 0.0599 0.0020 0.1260 0.0693 0.0639 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0010 0.0010 0.0010 0.0010 0.0010 0.0010 0.0000 0.0000 0.0000 0.0000 0.0010 0.0010 0.0000 0.0010 0.0010 0.0010 0.0000 193-DS 0.0000 0.0068 0.0170 0.0180 0.0210 0.0126 0.0076 0.0113 0.0210 0.6067 0.0057 0.0001 0.0067 0.0000 0.0210 0.0126 0.0076 194-DS 0.0170 0.0233 0.0830 0.0923 0.1110 0.0621 0.0402 0.0690 0.0940 0.6480 0.0482 0.0363 0.0363 0.0170 0.1110 0.0621 0.0402 195-DS 0.0150 0.0205 0.0660 0.0835 0.0850 0.0517 0.0319 0.0630 0.0700 0.6181 0.0410 0.0316 0.0293 0.0150 0.0850 0.0517 0.0319 196-DS 0.0010 0.0033 0.0060 0.0080 0.0080 0.0052 0.0029 0.0048 0.0070 0.5482 0.0041 0.0028 0.0024 0.0010 0.0080 0.0052 0.0029 197-DS 0.0000 0.0023 0.0050 0.0238 0.0260 0.0101 0.0113 0.0215 0.0260 1.1216 0.0019 0.0000 0.0099 0.0000 0.0260 0.0101 0.0113 198-DS 0.0570 0.0715 0.0760 0.0903 0.1030 0.0792 0.0160 0.0187 0.0460 0.2022 0.0778 0.0764 0.0121 0.0570 0.1030 0.0792 0.0160 199-DS 0.0010 0.0028 0.0040 0.0040 0.0040 0.0032 0.0011 0.0013 0.0030 0.3392 0.0030 0.0026 0.0009 0.0010 0.0040 0.0032 0.0011 200-DS 0.0570 0.0655 0.0700 0.0753 0.0800 0.0702 0.0073 0.0098 0.0230 0.1034 0.0699 0.0695 0.0054 0.0570 0.0800 0.0702 0.0073 205 DS-MULTI-CLEF2007 Track Overview Results and Graphs DS-MULTI-CLEF2007 Domain−Specific Multilingual Task Top 5 Participants − Standard Recall Levels vs Mean Interpolated Precision 100% cheshire [Experiment BERKMUENP15; MAP 8.84%; Not Pooled] chemnitz [Experiment CUT_DS_MULTI_DE2X_MERGED; MAP 8.42%; Not Pooled] 90% 80% 70% 60% Precision 50% 40% 30% 20% 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Multilingual Task Top 5 Participants − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) 1 cheshire [Experiment BERKMUENP15; MAP 8.84%; Not Pooled] chemnitz [Experiment CUT_DS_MULTI_DE2X_MERGED; MAP 8.42%; Not Pooled] 0.8 0.6 0.4 0.2 Difference 0 −0.2 −0.4 −0.6 −0.8 −1 176−DS177−DS178−DS179−DS180−DS181−DS182−DS183−DS184−DS185−DS186−DS187−DS188−DS189−DS190−DS191−DS192−DS193−DS194−DS195−DS196−DS197−DS198−DS199−DS200−DS Topic Identifier 206 DS-MULTI-CLEF2007 Track Overview Results and Graphs DS-MULTI-CLEF2007 Domain−Specific Multilingual Task − Box Plot of the Topics cheshire [Experiment BERKMUENP15; MAP 8.84%; Not Pooled] chemnitz [Experiment CUT_DS_MULTI_DE2X_MERGED; MAP 8.42%; Not Pooled] cheshire [Experiment BERKMUENTHP7; MAP 8.39%; Not Pooled] chemnitz [Experiment CUT_DS_MULTI_EN2X_MERGED; MAP 8.33%; Not Pooled] Experiments chemnitz [Experiment CUT_DS_MULTI_RU2X_MERGED; MAP 5.08%; Not Pooled] cheshire [Experiment BERKMUDETHP7; MAP 4.86%; Not Pooled] cheshire [Experiment BERKMUDEP15; MAP 4.68%; Not Pooled] cheshire [Experiment BERKMURUP15; MAP 4.14%; Not Pooled] cheshire [Experiment BERKMURUTHP7; MAP 4.00%; Not Pooled] 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Average Precision 207 DS-MULTI-CLEF2007 Track Overview Results and Graphs DS-MULTI-CLEF2007 10.2455/TUKEY_T_TEST.80060D07E297A6E9364FBE6FE768E648 Domain−Specific Multilingual Task − Tukey T test with "top group" highlighted BERKMUENP15 CUT_DS_MULTI_DE2X_MERGED BERKMUENTHP7 CUT_DS_MULTI_EN2X_MERGED Experiments CUT_DS_MULTI_RU2X_MERGED BERKMURUP15 BERKMURUTHP7 BERKMUDETHP7 BERKMUDEP15 0.1 0.15 0.2 0.25 0.3 0.35 arcsin(sqrt(Average Precsion)) 208 209 DS-MULTI-CLEF2007 Track Overview Results and Graphs DS-MULTI-CLEF2007 Domain−Specific Multilingual Task Top 5 Participants − Retrieved documents vs Mean Precision 100% cheshire [Experiment BERKMUENP15; R−Prec 18.52%; Not Pooled] chemnitz [Experiment CUT_DS_MULTI_DE2X_MERGED; R−Prec 18.33%; Not Pooled] 90% 80% 70% 60% Precision 50% 40% 30% 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Multilingual Task Top 5 Participants − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) 1 cheshire [Experiment BERKMUENP15; R−Prec 18.52%; Not Pooled] chemnitz [Experiment CUT_DS_MULTI_DE2X_MERGED; R−Prec 18.33%; Not Pooled] 0.8 0.6 0.4 0.2 Difference 0 −0.2 −0.4 −0.6 −0.8 −1 176−DS177−DS178−DS179−DS180−DS181−DS182−DS183−DS184−DS185−DS186−DS187−DS188−DS189−DS190−DS191−DS192−DS193−DS194−DS195−DS196−DS197−DS198−DS199−DS200−DS Topic Identifier 210 DS-MULTI-CLEF2007 Track Overview Results and Graphs DS-MULTI-CLEF2007 Domain−Specific Multilingual Task − Box Plot of the Topics cheshire [Experiment BERKMUENP15; R−Prec 18.52%; Not Pooled] chemnitz [Experiment CUT_DS_MULTI_DE2X_MERGED; R−Prec 18.33%; Not Pooled] cheshire [Experiment BERKMUENTHP7; R−Prec 17.84%; Not Pooled] chemnitz [Experiment CUT_DS_MULTI_EN2X_MERGED; R−Prec 17.70%; Not Pooled] Experiments cheshire [Experiment BERKMURUP15; R−Prec 12.38%; Not Pooled] chemnitz [Experiment CUT_DS_MULTI_RU2X_MERGED; R−Prec 12.25%; Not Pooled] cheshire [Experiment BERKMURUTHP7; R−Prec 11.92%; Not Pooled] cheshire [Experiment BERKMUDETHP7; R−Prec 11.61%; Not Pooled] cheshire [Experiment BERKMUDEP15; R−Prec 11.28%; Not Pooled] 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% R−Precision 211 DS-MULTI-CLEF2007 Track Overview Results and Graphs DS-MULTI-CLEF2007 Domain−Specific Multilingual Task − Tukey T test with "top group" highlighted CUT_DS_MULTI_DE2X_MERGED CUT_DS_MULTI_EN2X_MERGED BERKMUENP15 BERKMUENTHP7 Experiments BERKMURUP15 BERKMURUTHP7 CUT_DS_MULTI_RU2X_MERGED BERKMUDETHP7 BERKMUDEP15 0.2 0.25 0.3 0.35 0.4 0.45 0.5 arcsin(sqrt(R−Precision)) 212 213 DS-MULTI-CLEF2007 Track Overview Results and Graphs DS-MULTI-CLEF2007 Statistics for Number of relevant retrieved documents Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 10.00 23.25 35.00 76.50 126.00 53.00 42.45 53.25 116.00 0.80 38.59 27.31 32.67 10.00 126.00 53.00 42.45 177-DS 9.00 19.75 30.00 45.25 56.00 31.44 15.91 25.50 47.00 0.51 27.26 22.78 12.49 9.00 56.00 31.44 15.91 178-DS 9.00 45.75 67.00 98.75 133.00 67.89 40.33 53.00 124.00 0.59 52.10 33.44 29.41 9.00 133.00 67.89 40.33 179-DS 6.00 167.00 224.00 233.50 241.00 186.89 77.85 66.50 235.00 0.42 138.50 43.53 56.15 119.00 241.00 209.50 40.84 180-DS 127.00 192.50 207.00 279.00 316.00 230.56 61.59 86.50 189.00 0.27 222.66 214.21 51.95 127.00 316.00 230.56 61.59 181-DS 16.00 16.75 17.00 35.00 41.00 23.89 11.08 18.25 25.00 0.46 21.96 20.48 9.63 16.00 41.00 23.89 11.08 182-DS 2.00 30.50 44.00 121.50 250.00 83.00 92.21 91.00 248.00 1.11 34.88 8.10 70.00 2.00 250.00 83.00 92.21 183-DS 11.00 40.00 60.00 82.50 111.00 58.56 32.35 42.50 100.00 0.55 47.55 34.64 24.49 11.00 111.00 58.56 32.35 184-DS 21.00 38.50 50.00 98.25 221.00 82.22 78.33 59.75 200.00 0.95 59.05 46.10 60.57 21.00 59.00 43.29 14.82 185-DS 1.00 19.00 32.00 53.50 60.00 32.44 20.51 34.50 59.00 0.63 22.03 7.05 16.27 1.00 60.00 32.44 20.51 186-DS 10.00 11.75 16.00 35.25 37.00 22.89 12.13 23.50 27.00 0.53 19.96 17.44 11.21 10.00 37.00 22.89 12.13 187-DS 31.00 37.00 169.00 250.00 295.00 150.78 113.55 213.00 264.00 0.75 103.64 68.57 100.91 31.00 295.00 150.78 113.55 188-DS 161.00 193.00 211.00 251.00 268.00 216.33 36.43 58.00 107.00 0.17 213.53 210.66 29.26 161.00 268.00 216.33 36.43 189-DS 6.00 7.75 25.00 29.50 36.00 21.33 11.42 21.75 30.00 0.54 17.66 13.84 9.56 6.00 36.00 21.33 11.42 190-DS 0.00 95.50 188.00 223.75 304.00 166.33 109.65 128.25 304.00 0.66 17.51 0.00 82.44 0.00 304.00 166.33 109.65 191-DS 9.00 22.50 30.00 51.50 57.00 35.44 17.76 29.00 48.00 0.50 30.47 24.89 15.38 9.00 57.00 35.44 17.76 192-DS 3.00 13.25 43.00 55.25 63.00 37.44 22.42 42.00 60.00 0.60 27.13 14.63 18.74 3.00 63.00 37.44 22.42 193-DS 57.00 69.00 95.00 174.75 324.00 140.89 101.17 105.75 267.00 0.72 116.37 100.33 76.72 57.00 324.00 140.89 101.17 194-DS 27.00 50.50 61.00 129.00 147.00 85.00 47.23 78.50 120.00 0.56 71.98 59.70 42.44 27.00 147.00 85.00 47.23 195-DS 152.00 187.25 290.00 358.25 374.00 273.22 91.08 171.00 222.00 0.33 258.69 244.04 81.31 152.00 374.00 273.22 91.08 196-DS 1.00 10.00 21.00 47.00 83.00 30.67 28.26 37.00 82.00 0.92 14.84 3.97 22.30 1.00 83.00 30.67 28.26 197-DS 20.00 55.50 74.00 108.75 149.00 79.33 41.81 53.25 129.00 0.53 67.31 53.91 31.48 20.00 149.00 79.33 41.81 198-DS 99.00 131.75 165.00 209.75 241.00 172.33 50.71 78.00 142.00 0.29 165.33 158.15 40.81 99.00 241.00 172.33 50.71 199-DS 1.00 6.75 12.00 40.00 79.00 26.44 27.14 33.25 78.00 1.03 14.28 5.70 21.16 1.00 79.00 26.44 27.14 200-DS 7.00 38.00 56.00 69.50 87.00 52.89 26.66 31.50 80.00 0.50 43.14 29.23 19.48 7.00 87.00 52.89 26.66 214 DS-MULTI-CLEF2007 Track Overview Results and Graphs DS-MULTI-CLEF2007 Statistics for Average Precsion Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0005 0.0212 0.0326 0.1166 0.1941 0.0699 0.0709 0.0954 0.1937 1.0145 0.0239 0.0025 0.0567 0.0005 0.1941 0.0699 0.0709 177-DS 0.0103 0.0120 0.0139 0.0506 0.0619 0.0273 0.0222 0.0386 0.0516 0.8127 0.0207 0.0168 0.0193 0.0103 0.0619 0.0273 0.0222 178-DS 0.0039 0.0483 0.0642 0.0719 0.2138 0.0700 0.0608 0.0236 0.2099 0.8685 0.0416 0.0159 0.0346 0.0629 0.0820 0.0680 0.0071 179-DS 0.0001 0.1772 0.2200 0.2423 0.2560 0.1930 0.0823 0.0650 0.2560 0.4267 0.0894 0.0008 0.0574 0.1277 0.2560 0.2171 0.0421 180-DS 0.0513 0.1041 0.1366 0.1722 0.2515 0.1443 0.0620 0.0681 0.2002 0.4293 0.1316 0.1180 0.0452 0.0513 0.2515 0.1443 0.0620 181-DS 0.0080 0.0228 0.0452 0.0958 0.2978 0.0840 0.1065 0.0729 0.2898 1.2686 0.0437 0.0255 0.0819 0.0080 0.0481 0.0313 0.0168 182-DS 0.0002 0.0030 0.0062 0.0868 0.2851 0.0645 0.1124 0.0838 0.2849 1.7428 0.0075 0.0008 0.0872 0.0002 0.0370 0.0085 0.0129 183-DS 0.0004 0.0060 0.0227 0.0519 0.1044 0.0333 0.0372 0.0459 0.1040 1.1167 0.0130 0.0025 0.0288 0.0004 0.1044 0.0333 0.0372 184-DS 0.0047 0.0094 0.0129 0.0415 0.1274 0.0351 0.0482 0.0322 0.1227 1.3722 0.0175 0.0115 0.0376 0.0047 0.0181 0.0110 0.0045 185-DS 0.0000 0.0039 0.0148 0.0426 0.0436 0.0194 0.0187 0.0387 0.0436 0.9639 0.0061 0.0001 0.0158 0.0000 0.0436 0.0194 0.0187 186-DS 0.0034 0.0054 0.0150 0.0252 0.0307 0.0165 0.0106 0.0198 0.0273 0.6393 0.0126 0.0089 0.0089 0.0034 0.0307 0.0165 0.0106 187-DS 0.0015 0.0022 0.0384 0.0954 0.1440 0.0543 0.0580 0.0932 0.1425 1.0687 0.0171 0.0045 0.0496 0.0015 0.1440 0.0543 0.0580 188-DS 0.0559 0.0823 0.1105 0.1351 0.1597 0.1077 0.0336 0.0528 0.1039 0.3122 0.1027 0.0975 0.0275 0.0559 0.1597 0.1077 0.0336 189-DS 0.0003 0.0006 0.0102 0.0122 0.0380 0.0103 0.0117 0.0116 0.0377 1.1397 0.0041 0.0011 0.0075 0.0003 0.0149 0.0068 0.0058 190-DS 0.0000 0.0460 0.0774 0.1522 0.3149 0.1142 0.1185 0.1062 0.3149 1.0380 0.0128 0.0000 0.0886 0.0000 0.0989 0.0572 0.0414 191-DS 0.0037 0.0142 0.0477 0.0597 0.0790 0.0386 0.0285 0.0454 0.0753 0.7379 0.0248 0.0125 0.0244 0.0037 0.0790 0.0386 0.0285 192-DS 0.0001 0.0019 0.0172 0.0252 0.0440 0.0171 0.0152 0.0232 0.0438 0.8873 0.0073 0.0010 0.0114 0.0001 0.0440 0.0171 0.0152 193-DS 0.0079 0.0210 0.0252 0.0780 0.2329 0.0684 0.0924 0.0570 0.2251 1.3500 0.0352 0.0233 0.0723 0.0079 0.0276 0.0220 0.0068 194-DS 0.0027 0.0075 0.0103 0.0603 0.0780 0.0321 0.0306 0.0528 0.0753 0.9532 0.0171 0.0087 0.0280 0.0027 0.0780 0.0321 0.0306 195-DS 0.0326 0.0580 0.1175 0.1680 0.2045 0.1174 0.0636 0.1100 0.1719 0.5414 0.0990 0.0802 0.0520 0.0326 0.2045 0.1174 0.0636 196-DS 0.0000 0.0010 0.0037 0.0528 0.1174 0.0279 0.0411 0.0518 0.1174 1.4736 0.0029 0.0001 0.0328 0.0000 0.1174 0.0279 0.0411 197-DS 0.0024 0.0088 0.0170 0.0598 0.2068 0.0465 0.0665 0.0510 0.2044 1.4299 0.0200 0.0094 0.0464 0.0024 0.0929 0.0265 0.0305 198-DS 0.0298 0.0639 0.1056 0.1697 0.2175 0.1201 0.0697 0.1058 0.1877 0.5804 0.0982 0.0757 0.0568 0.0298 0.2175 0.1201 0.0697 199-DS 0.0000 0.0004 0.0015 0.0565 0.1650 0.0393 0.0610 0.0561 0.1650 1.5534 0.0036 0.0001 0.0458 0.0000 0.1194 0.0236 0.0414 200-DS 0.0003 0.0144 0.0229 0.0343 0.0544 0.0250 0.0188 0.0199 0.0541 0.7533 0.0130 0.0019 0.0134 0.0003 0.0544 0.0250 0.0188 215 DS-MULTI-CLEF2007 Track Overview Results and Graphs DS-MULTI-CLEF2007 Statistics for R-Precision Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0055 0.0594 0.1160 0.2251 0.3094 0.1338 0.1084 0.1657 0.3039 0.8100 0.0720 0.0217 0.0864 0.0055 0.3094 0.1338 0.1084 177-DS 0.0226 0.0564 0.0752 0.1617 0.1805 0.0936 0.0613 0.1053 0.1579 0.6554 0.0738 0.0554 0.0512 0.0226 0.1805 0.0936 0.0613 178-DS 0.0164 0.1044 0.1480 0.1834 0.3618 0.1513 0.1029 0.0789 0.3454 0.6798 0.1086 0.0618 0.0665 0.0164 0.2204 0.1250 0.0705 179-DS 0.0000 0.2976 0.3353 0.3520 0.4048 0.2998 0.1180 0.0544 0.4048 0.3936 0.1054 0.0001 0.0683 0.2931 0.4048 0.3372 0.0383 180-DS 0.1706 0.2467 0.2726 0.3189 0.3950 0.2839 0.0656 0.0722 0.2245 0.2310 0.2769 0.2695 0.0495 0.1706 0.3950 0.2839 0.0656 181-DS 0.0000 0.0927 0.1452 0.2621 0.4839 0.1918 0.1558 0.1694 0.4839 0.8127 0.0569 0.0001 0.1199 0.0000 0.4839 0.1918 0.1558 182-DS 0.0025 0.0228 0.0468 0.2106 0.4335 0.1294 0.1702 0.1878 0.4310 1.3145 0.0429 0.0098 0.1326 0.0025 0.4335 0.1294 0.1702 183-DS 0.0111 0.0381 0.1025 0.1697 0.2327 0.1046 0.0754 0.1316 0.2216 0.7201 0.0746 0.0452 0.0590 0.0111 0.2327 0.1046 0.0754 184-DS 0.0324 0.0496 0.0668 0.1326 0.2874 0.1084 0.1011 0.0830 0.2551 0.9330 0.0794 0.0634 0.0782 0.0324 0.0830 0.0581 0.0190 185-DS 0.0000 0.0302 0.0862 0.1336 0.1509 0.0781 0.0565 0.1034 0.1509 0.7238 0.0269 0.0001 0.0483 0.0000 0.1509 0.0781 0.0565 186-DS 0.0303 0.0303 0.0707 0.1010 0.1010 0.0673 0.0311 0.0707 0.0707 0.4623 0.0599 0.0524 0.0262 0.0303 0.1010 0.0673 0.0311 187-DS 0.0322 0.0366 0.1743 0.2628 0.3052 0.1572 0.1191 0.2261 0.2730 0.7572 0.1077 0.0710 0.1055 0.0322 0.3052 0.1572 0.1191 188-DS 0.1953 0.2189 0.2425 0.2795 0.3198 0.2468 0.0410 0.0606 0.1245 0.1662 0.2438 0.2409 0.0316 0.1953 0.3198 0.2468 0.0410 189-DS 0.0000 0.0065 0.0259 0.0517 0.1207 0.0354 0.0401 0.0453 0.1207 1.1308 0.0054 0.0000 0.0300 0.0000 0.0776 0.0248 0.0258 190-DS 0.0000 0.1448 0.2114 0.3318 0.4761 0.2322 0.1658 0.1870 0.4761 0.7139 0.0288 0.0000 0.1249 0.0000 0.4761 0.2322 0.1658 191-DS 0.0100 0.0650 0.1000 0.1400 0.1800 0.1000 0.0550 0.0750 0.1700 0.5500 0.0792 0.0486 0.0422 0.0100 0.1800 0.1000 0.0550 192-DS 0.0048 0.0302 0.0725 0.0918 0.1111 0.0644 0.0373 0.0616 0.1063 0.5797 0.0475 0.0250 0.0301 0.0048 0.1111 0.0644 0.0373 193-DS 0.0707 0.0877 0.1110 0.2035 0.3911 0.1689 0.1256 0.1158 0.3204 0.7433 0.1389 0.1205 0.0966 0.0707 0.1442 0.1068 0.0276 194-DS 0.0398 0.0519 0.0713 0.1751 0.2180 0.1130 0.0698 0.1232 0.1782 0.6178 0.0934 0.0774 0.0631 0.0398 0.2180 0.1130 0.0698 195-DS 0.1494 0.1878 0.2958 0.3626 0.3756 0.2752 0.0927 0.1748 0.2262 0.3367 0.2602 0.2449 0.0829 0.1494 0.3756 0.2752 0.0927 196-DS 0.0000 0.0000 0.0352 0.1479 0.2254 0.0712 0.0928 0.1479 0.2254 1.3031 0.0016 0.0000 0.0777 0.0000 0.2254 0.0712 0.0928 197-DS 0.0272 0.0446 0.0866 0.1850 0.3094 0.1191 0.0976 0.1405 0.2822 0.8195 0.0878 0.0663 0.0779 0.0272 0.3094 0.1191 0.0976 198-DS 0.1216 0.1744 0.2399 0.2943 0.3581 0.2406 0.0840 0.1199 0.2365 0.3489 0.2262 0.2110 0.0646 0.1216 0.3581 0.2406 0.0840 199-DS 0.0000 0.0063 0.0316 0.1361 0.2785 0.0858 0.1053 0.1297 0.2785 1.2273 0.0174 0.0001 0.0813 0.0000 0.2785 0.0858 0.1053 200-DS 0.0067 0.0811 0.1171 0.1472 0.1773 0.1100 0.0581 0.0661 0.1706 0.5278 0.0817 0.0386 0.0429 0.0067 0.1773 0.1100 0.0581 216 DS-MULTI-CLEF2007 Track Overview Results and Graphs DS-MULTI-CLEF2007 Statistics for Binary Preference Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0056 0.0698 0.1516 0.3225 0.3845 0.1824 0.1456 0.2527 0.3789 0.7981 0.0983 0.0291 0.1214 0.0056 0.3845 0.1824 0.1456 177-DS 0.0230 0.0444 0.0556 0.1243 0.1386 0.0729 0.0449 0.0799 0.1156 0.6165 0.0604 0.0494 0.0381 0.0230 0.1386 0.0729 0.0449 178-DS 0.0149 0.1149 0.1591 0.2615 0.3885 0.1762 0.1194 0.1465 0.3736 0.6773 0.1195 0.0589 0.0876 0.0149 0.3885 0.1762 0.1194 179-DS 0.0156 0.2727 0.3095 0.3318 0.3616 0.2792 0.1034 0.0591 0.3461 0.3704 0.2227 0.0998 0.0617 0.2713 0.3616 0.3121 0.0324 180-DS 0.1709 0.2574 0.2889 0.3262 0.4119 0.2944 0.0690 0.0688 0.2410 0.2345 0.2868 0.2785 0.0502 0.1709 0.4119 0.2944 0.0690 181-DS 0.1051 0.1288 0.1444 0.2516 0.4888 0.2175 0.1545 0.1227 0.3837 0.7104 0.1831 0.1624 0.1199 0.1051 0.1735 0.1404 0.0254 182-DS 0.0042 0.0539 0.0768 0.2652 0.5174 0.1678 0.1986 0.2113 0.5132 1.1835 0.0676 0.0172 0.1546 0.0042 0.5174 0.1678 0.1986 183-DS 0.0248 0.0839 0.1193 0.1849 0.2277 0.1221 0.0682 0.1010 0.2029 0.5587 0.0996 0.0742 0.0515 0.0248 0.2277 0.1221 0.0682 184-DS 0.0345 0.0608 0.0902 0.1533 0.3413 0.1301 0.1206 0.0925 0.3068 0.9270 0.0948 0.0744 0.0931 0.0345 0.0918 0.0703 0.0244 185-DS 0.0027 0.0362 0.0866 0.1296 0.1729 0.0835 0.0606 0.0934 0.1702 0.7260 0.0537 0.0181 0.0490 0.0027 0.1729 0.0835 0.0606 186-DS 0.0270 0.0393 0.0534 0.0667 0.0824 0.0540 0.0185 0.0274 0.0554 0.3428 0.0511 0.0482 0.0139 0.0270 0.0824 0.0540 0.0185 187-DS 0.0268 0.0341 0.1548 0.2660 0.3060 0.1537 0.1218 0.2319 0.2792 0.7921 0.1000 0.0621 0.1069 0.0268 0.3060 0.1537 0.1218 188-DS 0.1818 0.2293 0.2542 0.2805 0.3033 0.2513 0.0383 0.0513 0.1215 0.1525 0.2485 0.2455 0.0293 0.1818 0.3033 0.2513 0.0383 189-DS 0.0033 0.0148 0.0386 0.0469 0.0875 0.0365 0.0257 0.0321 0.0841 0.7051 0.0252 0.0136 0.0184 0.0033 0.0875 0.0365 0.0257 190-DS 0.0000 0.1614 0.2403 0.3187 0.5386 0.2504 0.1903 0.1573 0.5386 0.7598 0.0530 0.0001 0.1270 0.0000 0.5386 0.2504 0.1903 191-DS 0.0195 0.0478 0.1126 0.1527 0.1978 0.1051 0.0666 0.1050 0.1783 0.6335 0.0820 0.0594 0.0561 0.0195 0.1978 0.1051 0.0666 192-DS 0.0111 0.0271 0.0753 0.1044 0.1320 0.0709 0.0433 0.0773 0.1209 0.6099 0.0547 0.0374 0.0339 0.0111 0.1320 0.0709 0.0433 193-DS 0.0717 0.0884 0.1156 0.2239 0.4001 0.1772 0.1265 0.1355 0.3284 0.7142 0.1465 0.1263 0.0957 0.0717 0.4001 0.1772 0.1265 194-DS 0.0501 0.0760 0.0925 0.1883 0.2201 0.1269 0.0663 0.1123 0.1700 0.5224 0.1106 0.0957 0.0597 0.0501 0.2201 0.1269 0.0663 195-DS 0.1497 0.1850 0.2778 0.3523 0.3690 0.2680 0.0896 0.1673 0.2192 0.3346 0.2537 0.2395 0.0795 0.1497 0.3690 0.2680 0.0896 196-DS 0.0000 0.0032 0.0291 0.2043 0.2769 0.0900 0.1174 0.2011 0.2769 1.3044 0.0073 0.0000 0.1012 0.0000 0.2769 0.0900 0.1174 197-DS 0.0329 0.0937 0.1333 0.2306 0.3389 0.1593 0.1003 0.1369 0.3060 0.6296 0.1273 0.0952 0.0780 0.0329 0.3389 0.1593 0.1003 198-DS 0.1433 0.2037 0.2535 0.3145 0.3527 0.2588 0.0753 0.1108 0.2095 0.2910 0.2480 0.2365 0.0596 0.1433 0.3527 0.2588 0.0753 199-DS 0.0044 0.0090 0.0161 0.1437 0.3082 0.0905 0.1136 0.1346 0.3038 1.2552 0.0347 0.0149 0.0885 0.0044 0.3082 0.0905 0.1136 200-DS 0.0150 0.0739 0.1155 0.1384 0.1694 0.1057 0.0526 0.0645 0.1544 0.4978 0.0863 0.0594 0.0399 0.0150 0.1694 0.1057 0.0526 217 DS-MULTI-CLEF2007 Track Overview Results and Graphs DS-MULTI-CLEF2007 Statistics for Precision at the 0% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0120 0.3303 0.5000 0.6250 1.0000 0.4912 0.3498 0.2947 0.9880 0.7121 0.2540 0.0549 0.2320 0.0120 1.0000 0.4912 0.3498 177-DS 0.0761 0.1806 0.3750 0.5500 1.0000 0.4193 0.3499 0.3694 0.9239 0.8344 0.3043 0.2196 0.2581 0.0761 1.0000 0.4193 0.3499 178-DS 0.5000 0.5000 0.6667 0.7500 1.0000 0.6667 0.1614 0.2500 0.5000 0.2421 0.6504 0.6353 0.1111 0.5000 1.0000 0.6667 0.1614 179-DS 0.0062 0.4366 0.4615 0.8750 1.0000 0.5689 0.3213 0.4384 0.9938 0.5648 0.3597 0.0512 0.2504 0.0062 1.0000 0.5689 0.3213 180-DS 0.3763 0.4542 0.6667 0.7148 0.7857 0.6078 0.1507 0.2606 0.4094 0.2480 0.5889 0.5682 0.1280 0.3763 0.7857 0.6078 0.1507 181-DS 0.0385 0.1187 0.2295 0.3810 0.6667 0.2799 0.2350 0.2623 0.6282 0.8394 0.1937 0.1240 0.1732 0.0385 0.6667 0.2799 0.2350 182-DS 0.0714 0.2708 0.3333 0.4263 0.6140 0.3342 0.1746 0.1555 0.5426 0.5225 0.2754 0.2040 0.1149 0.0714 0.6140 0.3342 0.1746 183-DS 0.0213 0.0902 0.3333 0.5758 1.0000 0.3636 0.3235 0.4855 0.9787 0.8896 0.2131 0.0963 0.2492 0.0213 1.0000 0.3636 0.3235 184-DS 0.1633 0.2375 0.3333 0.5458 1.0000 0.4151 0.2599 0.3083 0.8367 0.6262 0.3576 0.3140 0.1937 0.1633 1.0000 0.4151 0.2599 185-DS 0.0019 0.2708 0.2857 0.5000 0.5000 0.3223 0.1612 0.2292 0.4981 0.5000 0.1947 0.0163 0.1184 0.0019 0.5000 0.3223 0.1612 186-DS 0.0531 0.0623 0.1087 0.2981 1.0000 0.2540 0.3132 0.2358 0.9469 1.2330 0.1511 0.1061 0.2204 0.0531 0.5000 0.1608 0.1507 187-DS 0.0909 0.1500 1.0000 1.0000 1.0000 0.6231 0.4493 0.8500 0.9091 0.7210 0.4167 0.2500 0.4188 0.0909 1.0000 0.6231 0.4493 188-DS 0.3750 0.5321 0.6118 0.6844 0.7500 0.5970 0.1242 0.1523 0.3750 0.2080 0.5839 0.5692 0.0935 0.3750 0.7500 0.5970 0.1242 189-DS 0.0072 0.0148 0.1000 0.3750 0.5000 0.1925 0.2018 0.3602 0.4928 1.0482 0.0806 0.0258 0.1680 0.0072 0.5000 0.1925 0.2018 190-DS 0.0000 0.5240 0.7614 1.0000 1.0000 0.6901 0.4097 0.4760 1.0000 0.5937 0.1237 0.0001 0.3063 0.0000 1.0000 0.6901 0.4097 191-DS 0.0333 0.1519 0.3333 0.3333 0.6000 0.2677 0.1723 0.1814 0.5667 0.6436 0.2013 0.1272 0.1322 0.0333 0.6000 0.2677 0.1723 192-DS 0.0124 0.0661 0.3333 0.3750 0.5000 0.2752 0.1842 0.3089 0.4876 0.6694 0.1764 0.0710 0.1516 0.0124 0.5000 0.2752 0.1842 193-DS 0.2000 0.2279 0.3333 0.6454 0.6923 0.4259 0.2164 0.4175 0.4923 0.5081 0.3762 0.3331 0.1986 0.2000 0.6923 0.4259 0.2164 194-DS 0.0652 0.1257 0.2174 0.3977 1.0000 0.3243 0.2894 0.2721 0.9348 0.8925 0.2358 0.1740 0.2000 0.0652 0.5000 0.2398 0.1494 195-DS 0.2143 0.5330 0.6667 0.7164 0.7500 0.5856 0.2050 0.1834 0.5357 0.3500 0.5380 0.4750 0.1579 0.6286 0.7500 0.6872 0.0427 196-DS 0.0019 0.0134 0.1429 0.3333 1.0000 0.2316 0.3184 0.3199 0.9981 1.3746 0.0579 0.0081 0.2160 0.0019 0.3333 0.1356 0.1448 197-DS 0.1441 0.2279 0.3333 0.6250 1.0000 0.4506 0.3288 0.3971 0.8559 0.7297 0.3624 0.2988 0.2551 0.1441 1.0000 0.4506 0.3288 198-DS 0.4688 0.5771 0.6667 0.6911 0.8333 0.6479 0.1033 0.1141 0.3646 0.1595 0.6404 0.6327 0.0744 0.4688 0.8333 0.6479 0.1033 199-DS 0.0030 0.0218 0.0340 0.5536 1.0000 0.3131 0.3759 0.5318 0.9970 1.2005 0.0818 0.0170 0.3248 0.0030 1.0000 0.3131 0.3759 200-DS 0.0175 0.1676 0.2500 0.3393 0.5000 0.2570 0.1668 0.1717 0.4825 0.6488 0.1817 0.0902 0.1207 0.0175 0.5000 0.2570 0.1668 218 DS-MULTI-CLEF2007 Track Overview Results and Graphs DS-MULTI-CLEF2007 Statistics for Precision at the 10% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0528 0.1316 0.4303 0.4590 0.1971 0.1912 0.3775 0.4590 0.9701 0.0216 0.0000 0.1626 0.0000 0.4590 0.1971 0.1912 177-DS 0.0000 0.0272 0.0517 0.1933 0.2206 0.0898 0.0896 0.1661 0.2206 0.9985 0.0118 0.0000 0.0773 0.0000 0.2206 0.0898 0.0896 178-DS 0.0000 0.1500 0.2581 0.3232 0.6667 0.2556 0.1991 0.1732 0.6667 0.7789 0.0307 0.0000 0.1332 0.0000 0.3483 0.2042 0.1347 179-DS 0.0000 0.3978 0.4228 0.4466 0.5645 0.3911 0.1555 0.0488 0.5645 0.3976 0.1334 0.0001 0.0869 0.3967 0.4615 0.4222 0.0248 180-DS 0.3122 0.4530 0.4834 0.6446 0.6990 0.5162 0.1297 0.1916 0.3868 0.2513 0.5012 0.4860 0.1028 0.3122 0.6990 0.5162 0.1297 181-DS 0.0385 0.1187 0.1800 0.3063 0.5455 0.2272 0.1704 0.1876 0.5070 0.7500 0.1690 0.1173 0.1272 0.0385 0.5455 0.2272 0.1704 182-DS 0.0000 0.0000 0.0445 0.2630 0.6027 0.1595 0.2318 0.2630 0.6027 1.4534 0.0057 0.0000 0.1804 0.0000 0.6027 0.1595 0.2318 183-DS 0.0000 0.0397 0.1125 0.2742 0.4568 0.1631 0.1739 0.2345 0.4568 1.0666 0.0182 0.0000 0.1385 0.0000 0.4568 0.1631 0.1739 184-DS 0.0000 0.0000 0.0514 0.1298 0.3243 0.0897 0.1278 0.1298 0.3243 1.4249 0.0018 0.0000 0.0972 0.0000 0.3243 0.0897 0.1278 185-DS 0.0000 0.0000 0.0569 0.2352 0.2604 0.0965 0.1168 0.2352 0.2604 1.2107 0.0020 0.0000 0.1010 0.0000 0.2604 0.0965 0.1168 186-DS 0.0111 0.0139 0.0450 0.1045 0.1220 0.0589 0.0445 0.0906 0.1109 0.7563 0.0410 0.0269 0.0388 0.0111 0.1220 0.0589 0.0445 187-DS 0.0000 0.0000 0.1987 0.3658 0.5150 0.2055 0.2173 0.3658 0.5150 1.0574 0.0033 0.0000 0.1842 0.0000 0.5150 0.2055 0.2173 188-DS 0.3015 0.3691 0.4875 0.5132 0.5510 0.4502 0.0912 0.1441 0.2495 0.2026 0.4410 0.4310 0.0762 0.3015 0.5510 0.4502 0.0912 189-DS 0.0000 0.0000 0.0329 0.0580 0.1348 0.0427 0.0466 0.0580 0.1348 1.0916 0.0031 0.0000 0.0334 0.0000 0.1348 0.0427 0.0466 190-DS 0.0000 0.1540 0.2935 0.4151 0.7614 0.3117 0.2660 0.2612 0.7614 0.8531 0.0345 0.0000 0.1878 0.0000 0.7614 0.3117 0.2660 191-DS 0.0000 0.0576 0.1268 0.1815 0.2273 0.1145 0.0774 0.1239 0.2273 0.6760 0.0382 0.0001 0.0647 0.0000 0.2273 0.1145 0.0774 192-DS 0.0000 0.0000 0.0739 0.1048 0.1448 0.0656 0.0551 0.1048 0.1448 0.8408 0.0045 0.0000 0.0437 0.0000 0.1448 0.0656 0.0551 193-DS 0.0000 0.0000 0.1271 0.2881 0.6923 0.2127 0.2619 0.2881 0.6923 1.2312 0.0084 0.0000 0.1968 0.0000 0.6923 0.2127 0.2619 194-DS 0.0000 0.0461 0.0719 0.2342 0.3006 0.1331 0.1170 0.1881 0.3006 0.8790 0.0169 0.0000 0.1027 0.0000 0.3006 0.1331 0.1170 195-DS 0.2070 0.3472 0.4415 0.5919 0.6744 0.4498 0.1663 0.2447 0.4675 0.3697 0.4194 0.3870 0.1297 0.2070 0.6744 0.4498 0.1663 196-DS 0.0000 0.0000 0.0305 0.1523 0.2385 0.0761 0.0965 0.1523 0.2385 1.2685 0.0038 0.0000 0.0805 0.0000 0.2385 0.0761 0.0965 197-DS 0.0000 0.0496 0.0923 0.2704 0.8082 0.1993 0.2604 0.2208 0.8082 1.3066 0.0196 0.0000 0.1864 0.0000 0.4020 0.1232 0.1337 198-DS 0.1275 0.3258 0.5625 0.6139 0.6854 0.4671 0.2116 0.2881 0.5579 0.4529 0.4036 0.3243 0.1703 0.1275 0.6854 0.4671 0.2116 199-DS 0.0000 0.0000 0.0000 0.2224 0.5405 0.1330 0.2026 0.2224 0.5405 1.5226 0.0009 0.0000 0.1566 0.0000 0.5405 0.1330 0.2026 200-DS 0.0000 0.0724 0.1328 0.1785 0.2650 0.1300 0.0917 0.1061 0.2650 0.7052 0.0184 0.0000 0.0669 0.0000 0.2650 0.1300 0.0917 219 DS-MULTI-CLEF2007 Track Overview Results and Graphs DS-MULTI-CLEF2007 Statistics for Precision at the 20% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.3048 0.3604 0.1189 0.1589 0.3048 0.3604 1.3366 0.0009 0.0000 0.1381 0.0000 0.3604 0.1189 0.1589 177-DS 0.0000 0.0000 0.0328 0.1265 0.1697 0.0588 0.0650 0.1265 0.1697 1.1056 0.0036 0.0000 0.0551 0.0000 0.1697 0.0588 0.0650 178-DS 0.0000 0.0000 0.0912 0.1832 0.5789 0.1367 0.1833 0.1832 0.5789 1.3412 0.0062 0.0000 0.1252 0.0000 0.2258 0.0814 0.0836 179-DS 0.0000 0.3502 0.3883 0.4078 0.4148 0.3442 0.1315 0.0576 0.4148 0.3819 0.1195 0.0001 0.0768 0.3429 0.4148 0.3872 0.0266 180-DS 0.0000 0.3418 0.3983 0.4487 0.6205 0.3808 0.1757 0.1069 0.6205 0.4615 0.1279 0.0001 0.1104 0.3013 0.5703 0.4009 0.0834 181-DS 0.0335 0.0612 0.1077 0.3063 0.5455 0.2049 0.1838 0.2451 0.5120 0.8972 0.1382 0.0940 0.1471 0.0335 0.5455 0.2049 0.1838 182-DS 0.0000 0.0000 0.0000 0.1968 0.5250 0.1237 0.2200 0.1968 0.5250 1.7781 0.0003 0.0000 0.1705 0.0000 0.4896 0.0736 0.1716 183-DS 0.0000 0.0000 0.0000 0.1365 0.2776 0.0614 0.1006 0.1365 0.2776 1.6382 0.0003 0.0000 0.0819 0.0000 0.2776 0.0614 0.1006 184-DS 0.0000 0.0000 0.0000 0.0731 0.3127 0.0673 0.1335 0.0731 0.3127 1.9857 0.0001 0.0000 0.1046 0.0000 0.0000 0.0000 0.0000 185-DS 0.0000 0.0000 0.0000 0.0765 0.0959 0.0291 0.0442 0.0765 0.0959 1.5216 0.0002 0.0000 0.0388 0.0000 0.0959 0.0291 0.0442 186-DS 0.0000 0.0000 0.0000 0.0653 0.0712 0.0295 0.0350 0.0653 0.0712 1.1884 0.0005 0.0000 0.0327 0.0000 0.0712 0.0295 0.0350 187-DS 0.0000 0.0000 0.0000 0.2882 0.3922 0.1417 0.1750 0.2882 0.3922 1.2353 0.0010 0.0000 0.1574 0.0000 0.3922 0.1417 0.1750 188-DS 0.1837 0.2314 0.3018 0.3736 0.4622 0.2999 0.0919 0.1421 0.2786 0.3063 0.2875 0.2754 0.0717 0.1837 0.4622 0.2999 0.0919 189-DS 0.0000 0.0000 0.0260 0.0369 0.0767 0.0233 0.0262 0.0369 0.0767 1.1245 0.0010 0.0000 0.0207 0.0000 0.0767 0.0233 0.0262 190-DS 0.0000 0.1374 0.2208 0.4119 0.6981 0.2897 0.2538 0.2745 0.6981 0.8762 0.0322 0.0000 0.1864 0.0000 0.6981 0.2897 0.2538 191-DS 0.0000 0.0272 0.0454 0.1547 0.1825 0.0834 0.0747 0.1275 0.1825 0.8955 0.0115 0.0000 0.0664 0.0000 0.1825 0.0834 0.0747 192-DS 0.0000 0.0000 0.0431 0.0615 0.1035 0.0366 0.0382 0.0615 0.1035 1.0442 0.0013 0.0000 0.0325 0.0000 0.1035 0.0366 0.0382 193-DS 0.0000 0.0000 0.0000 0.1442 0.6134 0.1323 0.2626 0.1442 0.6134 1.9855 0.0001 0.0000 0.2057 0.0000 0.0000 0.0000 0.0000 194-DS 0.0000 0.0000 0.0000 0.1564 0.2240 0.0772 0.0942 0.1564 0.2240 1.2201 0.0008 0.0000 0.0858 0.0000 0.2240 0.0772 0.0942 195-DS 0.0000 0.0000 0.3708 0.4897 0.5568 0.2897 0.2380 0.4897 0.5568 0.8214 0.0120 0.0000 0.2074 0.0000 0.5568 0.2897 0.2380 196-DS 0.0000 0.0000 0.0000 0.1052 0.2385 0.0632 0.0970 0.1052 0.2385 1.5354 0.0006 0.0000 0.0745 0.0000 0.2385 0.0632 0.0970 197-DS 0.0000 0.0000 0.0000 0.1705 0.7664 0.1413 0.2536 0.1705 0.7664 1.7947 0.0009 0.0000 0.1711 0.0000 0.2862 0.0632 0.1035 198-DS 0.0000 0.1208 0.3754 0.4846 0.5780 0.3203 0.2226 0.3638 0.5780 0.6949 0.0367 0.0000 0.1836 0.0000 0.5780 0.3203 0.2226 199-DS 0.0000 0.0000 0.0000 0.0932 0.3000 0.0667 0.1231 0.0932 0.3000 1.8444 0.0002 0.0000 0.0958 0.0000 0.0361 0.0052 0.0136 200-DS 0.0000 0.0000 0.0000 0.0950 0.1542 0.0426 0.0677 0.0950 0.1542 1.5910 0.0002 0.0000 0.0567 0.0000 0.1542 0.0426 0.0677 220 DS-MULTI-CLEF2007 Track Overview Results and Graphs DS-MULTI-CLEF2007 Statistics for Precision at the 30% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.1525 0.3111 0.0766 0.1257 0.1525 0.3111 1.6403 0.0003 0.0000 0.1022 0.0000 0.3111 0.0766 0.1257 177-DS 0.0000 0.0000 0.0000 0.0597 0.0995 0.0262 0.0411 0.0597 0.0995 1.5722 0.0002 0.0000 0.0349 0.0000 0.0995 0.0262 0.0411 178-DS 0.0000 0.0000 0.0000 0.1121 0.5140 0.0836 0.1696 0.1121 0.5140 2.0286 0.0003 0.0000 0.1115 0.0000 0.1333 0.0298 0.0557 179-DS 0.0000 0.3000 0.3601 0.3678 0.4067 0.3118 0.1225 0.0678 0.4067 0.3927 0.1091 0.0001 0.0751 0.2964 0.4067 0.3508 0.0389 180-DS 0.0000 0.0000 0.2137 0.3440 0.5061 0.1975 0.2048 0.3440 0.5061 1.0373 0.0033 0.0000 0.1755 0.0000 0.5061 0.1975 0.2048 181-DS 0.0000 0.0000 0.0000 0.1431 0.5455 0.1111 0.2081 0.1431 0.5455 1.8729 0.0003 0.0000 0.1598 0.0000 0.0588 0.0084 0.0222 182-DS 0.0000 0.0000 0.0000 0.1187 0.5121 0.1097 0.2178 0.1187 0.5121 1.9861 0.0001 0.0000 0.1706 0.0000 0.0000 0.0000 0.0000 183-DS 0.0000 0.0000 0.0000 0.0000 0.1267 0.0141 0.0422 0.0000 0.1267 3.0000 0.0000 0.0000 0.0250 0.0000 0.0000 0.0000 0.0000 184-DS 0.0000 0.0000 0.0000 0.0666 0.2834 0.0611 0.1213 0.0666 0.2834 1.9855 0.0001 0.0000 0.0950 0.0000 0.0000 0.0000 0.0000 185-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0000 0.0508 0.0574 0.0233 0.0277 0.0508 0.0574 1.1889 0.0004 0.0000 0.0259 0.0000 0.0574 0.0233 0.0277 187-DS 0.0000 0.0000 0.0000 0.0761 0.3094 0.0682 0.1353 0.0761 0.3094 1.9844 0.0001 0.0000 0.1061 0.0000 0.0000 0.0000 0.0000 188-DS 0.0000 0.0000 0.0000 0.2666 0.3438 0.0983 0.1490 0.2666 0.3438 1.5159 0.0003 0.0000 0.1310 0.0000 0.3438 0.0983 0.1490 189-DS 0.0000 0.0000 0.0000 0.0000 0.0419 0.0047 0.0140 0.0000 0.0419 3.0000 0.0000 0.0000 0.0083 0.0000 0.0000 0.0000 0.0000 190-DS 0.0000 0.0000 0.2208 0.3606 0.6308 0.2435 0.2370 0.3606 0.6308 0.9734 0.0103 0.0000 0.1771 0.0000 0.6308 0.2435 0.2370 191-DS 0.0000 0.0000 0.0317 0.1366 0.1700 0.0637 0.0728 0.1366 0.1700 1.1419 0.0017 0.0000 0.0637 0.0000 0.1700 0.0637 0.0728 192-DS 0.0000 0.0000 0.0000 0.0000 0.0645 0.0072 0.0215 0.0000 0.0645 3.0000 0.0000 0.0000 0.0128 0.0000 0.0000 0.0000 0.0000 193-DS 0.0000 0.0000 0.0000 0.1192 0.4769 0.1060 0.2103 0.1192 0.4769 1.9843 0.0001 0.0000 0.1649 0.0000 0.0000 0.0000 0.0000 194-DS 0.0000 0.0000 0.0000 0.0000 0.1569 0.0174 0.0523 0.0000 0.1569 3.0000 0.0000 0.0000 0.0310 0.0000 0.0000 0.0000 0.0000 195-DS 0.0000 0.0000 0.0000 0.4040 0.4311 0.1802 0.2140 0.4040 0.4311 1.1879 0.0011 0.0000 0.2002 0.0000 0.4311 0.1802 0.2140 196-DS 0.0000 0.0000 0.0000 0.0306 0.2217 0.0382 0.0798 0.0306 0.2217 2.0880 0.0001 0.0000 0.0595 0.0000 0.0000 0.0000 0.0000 197-DS 0.0000 0.0000 0.0000 0.0324 0.3280 0.0509 0.1124 0.0324 0.3280 2.2107 0.0001 0.0000 0.0791 0.0000 0.0000 0.0000 0.0000 198-DS 0.0000 0.0000 0.0000 0.2876 0.4472 0.1506 0.1915 0.2876 0.4472 1.2721 0.0010 0.0000 0.1673 0.0000 0.4472 0.1506 0.1915 199-DS 0.0000 0.0000 0.0000 0.0379 0.2667 0.0465 0.0966 0.0379 0.2667 2.0784 0.0001 0.0000 0.0723 0.0000 0.0000 0.0000 0.0000 200-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 221 DS-MULTI-CLEF2007 Track Overview Results and Graphs DS-MULTI-CLEF2007 Statistics for Precision at the 40% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0625 0.2508 0.0556 0.1104 0.0625 0.2508 1.9843 0.0001 0.0000 0.0866 0.0000 0.0000 0.0000 0.0000 177-DS 0.0000 0.0000 0.0000 0.0000 0.0642 0.0071 0.0214 0.0000 0.0642 3.0000 0.0000 0.0000 0.0127 0.0000 0.0000 0.0000 0.0000 178-DS 0.0000 0.0000 0.0000 0.0000 0.2542 0.0282 0.0847 0.0000 0.2542 3.0000 0.0000 0.0000 0.0502 0.0000 0.0000 0.0000 0.0000 179-DS 0.0000 0.2082 0.2863 0.3496 0.4067 0.2561 0.1517 0.1414 0.4067 0.5922 0.0324 0.0000 0.1138 0.0000 0.4067 0.2561 0.1517 180-DS 0.0000 0.0000 0.0000 0.0809 0.3924 0.0795 0.1588 0.0809 0.3924 1.9961 0.0001 0.0000 0.1237 0.0000 0.0000 0.0000 0.0000 181-DS 0.0000 0.0000 0.0000 0.1347 0.5455 0.1098 0.2084 0.1347 0.5455 1.8973 0.0003 0.0000 0.1602 0.0000 0.0479 0.0068 0.0181 182-DS 0.0000 0.0000 0.0000 0.1034 0.4603 0.0971 0.1930 0.1034 0.4603 1.9879 0.0001 0.0000 0.1511 0.0000 0.0000 0.0000 0.0000 183-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 184-DS 0.0000 0.0000 0.0000 0.0620 0.2644 0.0569 0.1130 0.0620 0.2644 1.9856 0.0001 0.0000 0.0885 0.0000 0.0000 0.0000 0.0000 185-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 188-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 189-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 190-DS 0.0000 0.0000 0.0000 0.1244 0.5436 0.1157 0.2299 0.1244 0.5436 1.9868 0.0001 0.0000 0.1800 0.0000 0.0000 0.0000 0.0000 191-DS 0.0000 0.0000 0.0000 0.1169 0.1487 0.0525 0.0658 0.1169 0.1487 1.2538 0.0006 0.0000 0.0583 0.0000 0.1487 0.0525 0.0658 192-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 193-DS 0.0000 0.0000 0.0000 0.0842 0.3818 0.0798 0.1588 0.0842 0.3818 1.9893 0.0001 0.0000 0.1242 0.0000 0.0000 0.0000 0.0000 194-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 195-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 196-DS 0.0000 0.0000 0.0000 0.0229 0.2138 0.0339 0.0739 0.0229 0.2138 2.1795 0.0001 0.0000 0.0528 0.0000 0.0000 0.0000 0.0000 197-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 198-DS 0.0000 0.0000 0.0000 0.0620 0.2576 0.0562 0.1115 0.0620 0.2576 1.9848 0.0001 0.0000 0.0874 0.0000 0.0000 0.0000 0.0000 199-DS 0.0000 0.0000 0.0000 0.0000 0.2092 0.0232 0.0697 0.0000 0.2092 3.0000 0.0000 0.0000 0.0413 0.0000 0.0000 0.0000 0.0000 200-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 222 DS-MULTI-CLEF2007 Track Overview Results and Graphs DS-MULTI-CLEF2007 Statistics for Precision at the 50% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0512 0.2062 0.0457 0.0907 0.0512 0.2062 1.9843 0.0001 0.0000 0.0711 0.0000 0.0000 0.0000 0.0000 177-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0000 0.1627 0.2627 0.3082 0.3381 0.2200 0.1304 0.1454 0.3381 0.5929 0.0287 0.0000 0.0984 0.0000 0.3381 0.2200 0.1304 180-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 181-DS 0.0000 0.0000 0.0000 0.1275 0.4493 0.0981 0.1847 0.1275 0.4493 1.8830 0.0003 0.0000 0.1440 0.0000 0.0383 0.0055 0.0145 182-DS 0.0000 0.0000 0.0000 0.0839 0.3684 0.0782 0.1554 0.0839 0.3684 1.9871 0.0001 0.0000 0.1217 0.0000 0.0000 0.0000 0.0000 183-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 184-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 185-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 188-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 189-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 190-DS 0.0000 0.0000 0.0000 0.0908 0.4682 0.0924 0.1852 0.0908 0.4682 2.0046 0.0001 0.0000 0.1437 0.0000 0.0000 0.0000 0.0000 191-DS 0.0000 0.0000 0.0000 0.0622 0.1126 0.0331 0.0425 0.0622 0.1126 1.2838 0.0005 0.0000 0.0368 0.0000 0.1126 0.0331 0.0425 192-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 193-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 194-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 195-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 196-DS 0.0000 0.0000 0.0000 0.0000 0.1839 0.0204 0.0613 0.0000 0.1839 3.0000 0.0000 0.0000 0.0363 0.0000 0.0000 0.0000 0.0000 197-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 198-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 199-DS 0.0000 0.0000 0.0000 0.0000 0.0862 0.0096 0.0287 0.0000 0.0862 3.0000 0.0000 0.0000 0.0170 0.0000 0.0000 0.0000 0.0000 200-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 223 DS-MULTI-CLEF2007 Track Overview Results and Graphs DS-MULTI-CLEF2007 Statistics for Precision at the 60% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0403 0.1637 0.0361 0.0716 0.0403 0.1637 1.9844 0.0001 0.0000 0.0561 0.0000 0.0000 0.0000 0.0000 177-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0000 0.0000 0.2456 0.2760 0.3023 0.1779 0.1352 0.2760 0.3023 0.7603 0.0089 0.0000 0.1186 0.0000 0.3023 0.1779 0.1352 180-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 181-DS 0.0000 0.0000 0.0000 0.0337 0.3167 0.0502 0.1094 0.0337 0.3167 2.1817 0.0001 0.0000 0.0780 0.0000 0.0000 0.0000 0.0000 182-DS 0.0000 0.0000 0.0000 0.0000 0.2714 0.0302 0.0905 0.0000 0.2714 3.0000 0.0000 0.0000 0.0536 0.0000 0.0000 0.0000 0.0000 183-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 184-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 185-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 188-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 189-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 190-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 193-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 194-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 195-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 196-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 197-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 198-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 199-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 200-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 224 DS-MULTI-CLEF2007 Track Overview Results and Graphs DS-MULTI-CLEF2007 Statistics for Precision at the 70% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 177-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0000 0.0000 0.0000 0.2362 0.2505 0.0813 0.1220 0.2362 0.2505 1.5013 0.0003 0.0000 0.1084 0.0000 0.2505 0.0813 0.1220 180-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 183-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 184-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 185-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 188-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 189-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 190-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 193-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 194-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 195-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 196-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 197-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 198-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 199-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 200-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 225 DS-MULTI-CLEF2007 Track Overview Results and Graphs DS-MULTI-CLEF2007 Statistics for Precision at the 80% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 177-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 180-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 183-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 184-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 185-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 188-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 189-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 190-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 193-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 194-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 195-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 196-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 197-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 198-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 199-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 200-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 226 DS-MULTI-CLEF2007 Track Overview Results and Graphs DS-MULTI-CLEF2007 Statistics for Precision at the 90% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 177-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 180-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 183-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 184-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 185-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 188-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 189-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 190-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 193-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 194-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 195-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 196-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 197-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 198-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 199-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 200-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 227 DS-MULTI-CLEF2007 Track Overview Results and Graphs DS-MULTI-CLEF2007 Statistics for Precision at the 100% interpolated recall level Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 177-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 178-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 179-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 180-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 181-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 182-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 183-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 184-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 185-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 186-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 188-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 189-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 190-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 191-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 193-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 194-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 195-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 196-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 197-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 198-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 199-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 200-DS 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 228 DS-MULTI-CLEF2007 Track Overview Results and Graphs DS-MULTI-CLEF2007 Statistics for P@5 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0000 0.2000 0.4000 0.6000 0.2222 0.2333 0.4000 0.6000 1.0500 0.0035 0.0000 0.2025 0.0000 0.6000 0.2222 0.2333 177-DS 0.0000 0.0000 0.0000 0.2500 0.4000 0.1333 0.1732 0.2500 0.4000 1.2990 0.0010 0.0000 0.1481 0.0000 0.4000 0.1333 0.1732 178-DS 0.2000 0.4000 0.4000 0.6000 0.6000 0.4444 0.1333 0.2000 0.4000 0.3000 0.4239 0.4000 0.1037 0.2000 0.6000 0.4444 0.1333 179-DS 0.0000 0.0000 0.2000 0.4000 0.6000 0.2222 0.2108 0.4000 0.6000 0.9487 0.0097 0.0000 0.1630 0.0000 0.6000 0.2222 0.2108 180-DS 0.0000 0.2000 0.4000 0.4000 0.6000 0.3333 0.1732 0.2000 0.6000 0.5196 0.1105 0.0001 0.1333 0.0000 0.6000 0.3333 0.1732 181-DS 0.0000 0.0000 0.0000 0.2500 0.6000 0.1333 0.2236 0.2500 0.6000 1.6771 0.0003 0.0000 0.1778 0.0000 0.6000 0.1333 0.2236 182-DS 0.0000 0.1500 0.2000 0.2500 0.4000 0.2000 0.1414 0.1000 0.4000 0.7071 0.0258 0.0000 0.0889 0.2000 0.2000 0.2000 0.0000 183-DS 0.0000 0.0000 0.0000 0.2000 0.2000 0.0889 0.1054 0.2000 0.2000 1.1859 0.0008 0.0000 0.0988 0.0000 0.2000 0.0889 0.1054 184-DS 0.0000 0.2000 0.2000 0.4000 0.6000 0.2667 0.1732 0.2000 0.6000 0.6495 0.0877 0.0001 0.1333 0.0000 0.6000 0.2667 0.1732 185-DS 0.0000 0.0000 0.2000 0.2000 0.4000 0.1556 0.1333 0.2000 0.4000 0.8571 0.0080 0.0000 0.1037 0.0000 0.4000 0.1556 0.1333 186-DS 0.0000 0.0000 0.0000 0.0500 0.2000 0.0444 0.0882 0.0500 0.2000 1.9843 0.0001 0.0000 0.0691 0.0000 0.0000 0.0000 0.0000 187-DS 0.0000 0.0000 0.2000 0.6000 0.6000 0.2667 0.2828 0.6000 0.6000 1.0607 0.0038 0.0000 0.2519 0.0000 0.6000 0.2667 0.2828 188-DS 0.0000 0.2000 0.2000 0.4500 0.6000 0.3111 0.2028 0.2500 0.6000 0.6517 0.0991 0.0001 0.1679 0.0000 0.6000 0.3111 0.2028 189-DS 0.0000 0.0000 0.0000 0.2000 0.4000 0.0889 0.1453 0.2000 0.4000 1.6346 0.0003 0.0000 0.1185 0.0000 0.4000 0.0889 0.1453 190-DS 0.0000 0.0000 0.4000 0.6000 0.8000 0.3333 0.3000 0.6000 0.8000 0.9000 0.0128 0.0000 0.2519 0.0000 0.8000 0.3333 0.3000 191-DS 0.0000 0.0000 0.2000 0.2000 0.6000 0.1778 0.1856 0.2000 0.6000 1.0440 0.0083 0.0000 0.1185 0.0000 0.2000 0.1250 0.1035 192-DS 0.0000 0.0000 0.2000 0.2000 0.4000 0.1556 0.1333 0.2000 0.4000 0.8571 0.0080 0.0000 0.1037 0.0000 0.4000 0.1556 0.1333 193-DS 0.0000 0.1500 0.2000 0.4000 0.6000 0.2667 0.2000 0.2500 0.6000 0.7500 0.0315 0.0000 0.1630 0.0000 0.6000 0.2667 0.2000 194-DS 0.0000 0.0000 0.0000 0.2500 0.6000 0.1556 0.2186 0.2500 0.6000 1.4052 0.0010 0.0000 0.1728 0.0000 0.6000 0.1556 0.2186 195-DS 0.0000 0.1500 0.4000 0.6000 0.6000 0.3778 0.2539 0.4500 0.6000 0.6720 0.0421 0.0000 0.2074 0.0000 0.6000 0.3778 0.2539 196-DS 0.0000 0.0000 0.0000 0.2000 0.4000 0.0889 0.1453 0.2000 0.4000 1.6346 0.0003 0.0000 0.1185 0.0000 0.4000 0.0889 0.1453 197-DS 0.0000 0.1500 0.2000 0.2000 0.4000 0.1778 0.1202 0.0500 0.4000 0.6760 0.0239 0.0000 0.0790 0.2000 0.2000 0.2000 0.0000 198-DS 0.0000 0.3000 0.4000 0.6000 0.8000 0.4222 0.2728 0.3000 0.8000 0.6462 0.0469 0.0000 0.2025 0.0000 0.8000 0.4222 0.2728 199-DS 0.0000 0.0000 0.0000 0.2500 0.6000 0.1556 0.2186 0.2500 0.6000 1.4052 0.0010 0.0000 0.1728 0.0000 0.6000 0.1556 0.2186 200-DS 0.0000 0.0000 0.0000 0.2000 0.4000 0.0889 0.1453 0.2000 0.4000 1.6346 0.0003 0.0000 0.1185 0.0000 0.4000 0.0889 0.1453 229 DS-MULTI-CLEF2007 Track Overview Results and Graphs DS-MULTI-CLEF2007 Statistics for P@10 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0750 0.2000 0.3500 0.5000 0.2333 0.1871 0.2750 0.5000 0.8018 0.0275 0.0000 0.1481 0.0000 0.5000 0.2333 0.1871 177-DS 0.0000 0.0750 0.2000 0.3000 0.4000 0.1889 0.1364 0.2250 0.4000 0.7222 0.0242 0.0000 0.1037 0.0000 0.4000 0.1889 0.1364 178-DS 0.2000 0.2750 0.4000 0.5000 0.5000 0.3778 0.1302 0.2250 0.3000 0.3446 0.3552 0.3313 0.1136 0.2000 0.5000 0.3778 0.1302 179-DS 0.0000 0.1500 0.4000 0.5000 0.8000 0.3333 0.2598 0.3500 0.8000 0.7794 0.0369 0.0000 0.2074 0.0000 0.8000 0.3333 0.2598 180-DS 0.1000 0.2000 0.4000 0.6000 0.7000 0.4000 0.2062 0.4000 0.6000 0.5154 0.3423 0.2790 0.1556 0.1000 0.7000 0.4000 0.2062 181-DS 0.0000 0.0000 0.0000 0.2500 0.5000 0.1222 0.1986 0.2500 0.5000 1.6250 0.0003 0.0000 0.1630 0.0000 0.5000 0.1222 0.1986 182-DS 0.0000 0.0750 0.1000 0.2250 0.4000 0.1444 0.1333 0.1500 0.4000 0.9231 0.0184 0.0000 0.1037 0.0000 0.4000 0.1444 0.1333 183-DS 0.0000 0.0000 0.2000 0.4000 0.4000 0.2000 0.1732 0.4000 0.4000 0.8660 0.0093 0.0000 0.1333 0.0000 0.4000 0.2000 0.1732 184-DS 0.0000 0.1000 0.1000 0.4000 0.5000 0.2222 0.1787 0.3000 0.5000 0.8043 0.0661 0.0001 0.1580 0.0000 0.5000 0.2222 0.1787 185-DS 0.0000 0.1000 0.2000 0.2000 0.3000 0.1556 0.0882 0.1000 0.3000 0.5669 0.0553 0.0001 0.0716 0.0000 0.3000 0.1556 0.0882 186-DS 0.0000 0.0000 0.0000 0.1000 0.2000 0.0556 0.0726 0.1000 0.2000 1.3077 0.0006 0.0000 0.0617 0.0000 0.2000 0.0556 0.0726 187-DS 0.0000 0.1000 0.2000 0.4000 0.5000 0.2444 0.1810 0.3000 0.5000 0.7406 0.0737 0.0001 0.1605 0.0000 0.5000 0.2444 0.1810 188-DS 0.1000 0.1750 0.3000 0.4250 0.5000 0.3000 0.1581 0.2500 0.4000 0.5270 0.2565 0.2126 0.1333 0.1000 0.5000 0.3000 0.1581 189-DS 0.0000 0.0000 0.1000 0.1000 0.3000 0.0889 0.0928 0.1000 0.3000 1.0440 0.0052 0.0000 0.0593 0.0000 0.1000 0.0625 0.0518 190-DS 0.0000 0.1500 0.3000 0.5000 0.5000 0.2778 0.1986 0.3500 0.5000 0.7150 0.0329 0.0000 0.1580 0.0000 0.5000 0.2778 0.1986 191-DS 0.0000 0.0750 0.1000 0.1000 0.3000 0.1000 0.0866 0.0250 0.3000 0.8660 0.0146 0.0000 0.0444 0.1000 0.1000 0.1000 0.0000 192-DS 0.0000 0.0000 0.1000 0.1250 0.4000 0.1111 0.1269 0.1250 0.4000 1.1424 0.0058 0.0000 0.0840 0.0000 0.2000 0.0750 0.0707 193-DS 0.0000 0.0750 0.1000 0.4000 0.4000 0.2111 0.1833 0.3250 0.4000 0.8684 0.0239 0.0000 0.1679 0.0000 0.4000 0.2111 0.1833 194-DS 0.0000 0.0000 0.1000 0.3000 0.4000 0.1556 0.1509 0.3000 0.4000 0.9702 0.0075 0.0000 0.1284 0.0000 0.4000 0.1556 0.1509 195-DS 0.1000 0.2500 0.4000 0.4250 0.6000 0.3556 0.1667 0.1750 0.5000 0.4688 0.3053 0.2432 0.1259 0.1000 0.6000 0.3556 0.1667 196-DS 0.0000 0.0000 0.1000 0.1250 0.4000 0.1000 0.1323 0.1250 0.4000 1.3229 0.0021 0.0000 0.0889 0.0000 0.2000 0.0625 0.0744 197-DS 0.0000 0.0750 0.1000 0.2250 0.3000 0.1333 0.1118 0.1500 0.3000 0.8385 0.0178 0.0000 0.0889 0.0000 0.3000 0.1333 0.1118 198-DS 0.3000 0.4000 0.5000 0.5000 0.6000 0.4556 0.0882 0.1000 0.3000 0.1936 0.4475 0.4390 0.0716 0.3000 0.6000 0.4556 0.0882 199-DS 0.0000 0.0000 0.0000 0.3250 0.6000 0.1778 0.2279 0.3250 0.6000 1.2820 0.0011 0.0000 0.1975 0.0000 0.6000 0.1778 0.2279 200-DS 0.0000 0.0000 0.1000 0.2000 0.2000 0.0889 0.0928 0.2000 0.2000 1.0440 0.0021 0.0000 0.0790 0.0000 0.2000 0.0889 0.0928 230 DS-MULTI-CLEF2007 Track Overview Results and Graphs DS-MULTI-CLEF2007 Statistics for P@15 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.1500 0.3333 0.3500 0.6000 0.2667 0.1915 0.2000 0.6000 0.7181 0.0320 0.0000 0.1481 0.0000 0.6000 0.2667 0.1915 177-DS 0.0000 0.1000 0.1333 0.2000 0.2667 0.1333 0.0882 0.1000 0.2667 0.6614 0.0191 0.0000 0.0593 0.0000 0.2667 0.1333 0.0882 178-DS 0.1333 0.2833 0.4667 0.6000 0.6000 0.4148 0.1908 0.3167 0.4667 0.4601 0.3618 0.2998 0.1613 0.1333 0.6000 0.4148 0.1908 179-DS 0.0000 0.2667 0.4000 0.4667 0.6667 0.3481 0.2049 0.2000 0.6667 0.5885 0.1062 0.0001 0.1465 0.0000 0.6667 0.3481 0.2049 180-DS 0.2000 0.2500 0.5333 0.6000 0.7333 0.4593 0.1928 0.3500 0.5333 0.4197 0.4161 0.3698 0.1580 0.2000 0.7333 0.4593 0.1928 181-DS 0.0000 0.0000 0.0667 0.2500 0.4667 0.1333 0.1826 0.2500 0.4667 1.3693 0.0023 0.0000 0.1481 0.0000 0.4667 0.1333 0.1826 182-DS 0.0667 0.0667 0.0667 0.2333 0.4667 0.1556 0.1491 0.1667 0.4000 0.9583 0.1118 0.0899 0.1185 0.0667 0.4667 0.1556 0.1491 183-DS 0.0000 0.0500 0.1333 0.3000 0.6000 0.2000 0.1972 0.2500 0.6000 0.9860 0.0226 0.0000 0.1481 0.0000 0.6000 0.2000 0.1972 184-DS 0.0667 0.1167 0.2667 0.5333 0.5333 0.2815 0.2021 0.4167 0.4667 0.7182 0.2117 0.1548 0.1679 0.0667 0.5333 0.2815 0.2021 185-DS 0.0000 0.1333 0.1333 0.2167 0.3333 0.1704 0.0949 0.0833 0.3333 0.5572 0.0607 0.0001 0.0708 0.1333 0.3333 0.1917 0.0751 186-DS 0.0000 0.0000 0.0000 0.1333 0.2000 0.0593 0.0778 0.1333 0.2000 1.3125 0.0007 0.0000 0.0658 0.0000 0.2000 0.0593 0.0778 187-DS 0.0667 0.1167 0.1333 0.4167 0.4667 0.2519 0.1757 0.3000 0.4000 0.6976 0.1927 0.1457 0.1613 0.0667 0.4667 0.2519 0.1757 188-DS 0.1333 0.2500 0.4667 0.4833 0.6000 0.3926 0.1579 0.2333 0.4667 0.4022 0.3563 0.3134 0.1284 0.1333 0.6000 0.3926 0.1579 189-DS 0.0000 0.0000 0.0667 0.0667 0.2000 0.0593 0.0619 0.0667 0.2000 1.0440 0.0040 0.0000 0.0395 0.0000 0.0667 0.0417 0.0345 190-DS 0.0000 0.1500 0.2667 0.3333 0.3333 0.2222 0.1374 0.1833 0.3333 0.6185 0.0287 0.0000 0.1086 0.0000 0.3333 0.2222 0.1374 191-DS 0.0000 0.0500 0.0667 0.0667 0.3333 0.0815 0.0988 0.0167 0.3333 1.2120 0.0113 0.0000 0.0560 0.0667 0.0667 0.0667 0.0000 192-DS 0.0000 0.0000 0.0667 0.1000 0.3333 0.0889 0.1106 0.1000 0.3333 1.2437 0.0048 0.0000 0.0790 0.0000 0.2000 0.0583 0.0661 193-DS 0.0667 0.1167 0.2000 0.4000 0.6000 0.2667 0.2082 0.2833 0.5333 0.7806 0.1997 0.1498 0.1630 0.0667 0.6000 0.2667 0.2082 194-DS 0.0000 0.0500 0.1333 0.3167 0.4667 0.2000 0.1795 0.2667 0.4667 0.8975 0.0230 0.0000 0.1481 0.0000 0.4667 0.2000 0.1795 195-DS 0.0667 0.3167 0.4667 0.5333 0.5333 0.3926 0.1899 0.2167 0.4667 0.4836 0.3112 0.2020 0.1449 0.0667 0.5333 0.3926 0.1899 196-DS 0.0000 0.0000 0.0667 0.0833 0.4000 0.0815 0.1281 0.0833 0.4000 1.5726 0.0018 0.0000 0.0823 0.0000 0.1333 0.0417 0.0496 197-DS 0.0000 0.0500 0.0667 0.1833 0.4000 0.1333 0.1414 0.1333 0.4000 1.0607 0.0160 0.0000 0.1037 0.0000 0.3333 0.1000 0.1069 198-DS 0.3333 0.4000 0.4667 0.5500 0.6000 0.4815 0.0930 0.1500 0.2667 0.1931 0.4732 0.4647 0.0757 0.3333 0.6000 0.4815 0.0930 199-DS 0.0000 0.0000 0.0000 0.4000 0.6667 0.2074 0.2737 0.4000 0.6667 1.3199 0.0012 0.0000 0.2305 0.0000 0.6667 0.2074 0.2737 200-DS 0.0000 0.0500 0.0667 0.2167 0.2667 0.1185 0.1042 0.1667 0.2667 0.8795 0.0156 0.0000 0.0872 0.0000 0.2667 0.1185 0.1042 231 DS-MULTI-CLEF2007 Track Overview Results and Graphs DS-MULTI-CLEF2007 Statistics for P@20 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.1875 0.3000 0.3500 0.5000 0.2556 0.1629 0.1625 0.5000 0.6373 0.0319 0.0000 0.1160 0.0000 0.5000 0.2556 0.1629 177-DS 0.0000 0.0875 0.1500 0.2000 0.2000 0.1278 0.0712 0.1125 0.2000 0.5572 0.0459 0.0001 0.0580 0.0000 0.2000 0.1278 0.0712 178-DS 0.1000 0.2125 0.4500 0.5625 0.6500 0.3889 0.2162 0.3500 0.5500 0.5559 0.3179 0.2428 0.1901 0.1000 0.6500 0.3889 0.2162 179-DS 0.0000 0.3250 0.3500 0.4625 0.6500 0.3611 0.1781 0.1375 0.6500 0.4933 0.1208 0.0001 0.1148 0.2500 0.6500 0.4062 0.1237 180-DS 0.2000 0.2875 0.5000 0.5875 0.7000 0.4611 0.1816 0.3000 0.5000 0.3939 0.4253 0.3874 0.1432 0.2000 0.7000 0.4611 0.1816 181-DS 0.0000 0.0375 0.1000 0.2875 0.4000 0.1500 0.1601 0.2500 0.4000 1.0672 0.0167 0.0000 0.1333 0.0000 0.4000 0.1500 0.1601 182-DS 0.0500 0.0500 0.0500 0.1750 0.4500 0.1278 0.1394 0.1250 0.4000 1.0913 0.0862 0.0677 0.1037 0.0500 0.2500 0.0875 0.0744 183-DS 0.0000 0.0750 0.1500 0.3875 0.6500 0.2222 0.2279 0.3125 0.6500 1.0256 0.0239 0.0000 0.1852 0.0000 0.6500 0.2222 0.2279 184-DS 0.0500 0.0875 0.2000 0.4500 0.4500 0.2444 0.1722 0.3625 0.4000 0.7045 0.1807 0.1256 0.1494 0.0500 0.4500 0.2444 0.1722 185-DS 0.0000 0.1000 0.1000 0.2500 0.3000 0.1556 0.0982 0.1500 0.3000 0.6316 0.0538 0.0001 0.0840 0.0000 0.3000 0.1556 0.0982 186-DS 0.0000 0.0000 0.0500 0.1125 0.2000 0.0667 0.0707 0.1125 0.2000 1.0607 0.0042 0.0000 0.0556 0.0000 0.2000 0.0667 0.0707 187-DS 0.0500 0.0875 0.2000 0.4125 0.5000 0.2444 0.1810 0.3250 0.4500 0.7406 0.1754 0.1207 0.1605 0.0500 0.5000 0.2444 0.1810 188-DS 0.2000 0.2750 0.4000 0.4875 0.6500 0.3944 0.1570 0.2125 0.4500 0.3981 0.3660 0.3381 0.1173 0.2000 0.6500 0.3944 0.1570 189-DS 0.0000 0.0000 0.0500 0.0625 0.2000 0.0556 0.0635 0.0625 0.2000 1.1424 0.0037 0.0000 0.0420 0.0000 0.1000 0.0375 0.0354 190-DS 0.0000 0.1125 0.2500 0.2750 0.4000 0.2000 0.1392 0.1625 0.4000 0.6960 0.0257 0.0000 0.1111 0.0000 0.4000 0.2000 0.1392 191-DS 0.0000 0.0500 0.0500 0.1125 0.2500 0.0833 0.0750 0.0625 0.2500 0.9000 0.0283 0.0001 0.0556 0.0000 0.1500 0.0625 0.0443 192-DS 0.0000 0.0500 0.0500 0.0750 0.2500 0.0778 0.0755 0.0250 0.2500 0.9702 0.0262 0.0001 0.0543 0.0500 0.0500 0.0500 0.0000 193-DS 0.0500 0.1250 0.1500 0.3750 0.6000 0.2556 0.2113 0.2500 0.5500 0.8269 0.1828 0.1274 0.1630 0.0500 0.6000 0.2556 0.2113 194-DS 0.0000 0.0375 0.2000 0.3375 0.4500 0.2167 0.1750 0.3000 0.4500 0.8077 0.0249 0.0000 0.1407 0.0000 0.4500 0.2167 0.1750 195-DS 0.0500 0.2875 0.4500 0.5250 0.6000 0.3889 0.1965 0.2375 0.5500 0.5053 0.3088 0.1994 0.1481 0.0500 0.6000 0.3889 0.1965 196-DS 0.0000 0.0000 0.0500 0.0625 0.3500 0.0667 0.1118 0.0625 0.3500 1.6771 0.0015 0.0000 0.0704 0.0000 0.1000 0.0313 0.0372 197-DS 0.0000 0.0500 0.1500 0.1875 0.5500 0.1611 0.1710 0.1375 0.5500 1.0613 0.0446 0.0001 0.1173 0.0000 0.3000 0.1125 0.0954 198-DS 0.3000 0.3500 0.4000 0.6000 0.6000 0.4611 0.1244 0.2500 0.3000 0.2699 0.4460 0.4313 0.1123 0.3000 0.6000 0.4611 0.1244 199-DS 0.0000 0.0000 0.0000 0.3625 0.5500 0.1833 0.2385 0.3625 0.5500 1.3008 0.0011 0.0000 0.2037 0.0000 0.5500 0.1833 0.2385 200-DS 0.0000 0.0375 0.1500 0.1625 0.2000 0.1056 0.0808 0.1250 0.2000 0.7654 0.0148 0.0000 0.0716 0.0000 0.2000 0.1056 0.0808 232 DS-MULTI-CLEF2007 Track Overview Results and Graphs DS-MULTI-CLEF2007 Statistics for P@30 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.2000 0.3000 0.3583 0.5000 0.2667 0.1700 0.1583 0.5000 0.6374 0.0330 0.0000 0.1185 0.0000 0.5000 0.2667 0.1700 177-DS 0.0667 0.0667 0.1000 0.2000 0.2333 0.1296 0.0696 0.1333 0.1667 0.5370 0.1133 0.0997 0.0626 0.0667 0.2333 0.1296 0.0696 178-DS 0.0667 0.1667 0.4000 0.5167 0.5667 0.3519 0.1987 0.3500 0.5000 0.5647 0.2746 0.1868 0.1646 0.0667 0.5667 0.3519 0.1987 179-DS 0.0000 0.2667 0.3333 0.4750 0.5667 0.3370 0.1662 0.2083 0.5667 0.4931 0.1135 0.0001 0.1160 0.0000 0.5667 0.3370 0.1662 180-DS 0.2667 0.2917 0.4667 0.5500 0.6667 0.4481 0.1454 0.2583 0.4000 0.3245 0.4258 0.4031 0.1169 0.2667 0.6667 0.4481 0.1454 181-DS 0.0000 0.0750 0.1667 0.2417 0.4667 0.1741 0.1561 0.1667 0.4667 0.8970 0.0214 0.0000 0.1136 0.0000 0.4667 0.1741 0.1561 182-DS 0.0333 0.0333 0.0333 0.2500 0.5000 0.1370 0.1703 0.2167 0.4667 1.2429 0.0714 0.0475 0.1383 0.0333 0.5000 0.1370 0.1703 183-DS 0.0000 0.0583 0.1333 0.3500 0.5667 0.2037 0.2071 0.2917 0.5667 1.0168 0.0520 0.0001 0.1679 0.0000 0.5667 0.2037 0.2071 184-DS 0.0333 0.0833 0.1333 0.3333 0.3667 0.1926 0.1331 0.2500 0.3333 0.6911 0.1406 0.0923 0.1177 0.0333 0.3667 0.1926 0.1331 185-DS 0.0000 0.0667 0.1333 0.2000 0.2667 0.1333 0.0882 0.1333 0.2667 0.6614 0.0455 0.0001 0.0741 0.0000 0.2667 0.1333 0.0882 186-DS 0.0000 0.0333 0.0667 0.1083 0.1667 0.0704 0.0539 0.0750 0.1667 0.7654 0.0249 0.0001 0.0420 0.0000 0.1667 0.0704 0.0539 187-DS 0.0333 0.0583 0.1667 0.4167 0.5667 0.2407 0.2040 0.3583 0.5333 0.8473 0.1521 0.0896 0.1786 0.0333 0.5667 0.2407 0.2040 188-DS 0.2333 0.2667 0.4000 0.5667 0.6333 0.4296 0.1559 0.3000 0.4000 0.3628 0.4030 0.3768 0.1366 0.2333 0.6333 0.4296 0.1559 189-DS 0.0000 0.0000 0.0333 0.0417 0.1333 0.0370 0.0423 0.0417 0.1333 1.1424 0.0028 0.0000 0.0280 0.0000 0.0667 0.0250 0.0236 190-DS 0.0000 0.0750 0.1667 0.3250 0.6000 0.2074 0.1956 0.2500 0.6000 0.9432 0.0240 0.0000 0.1506 0.0000 0.6000 0.2074 0.1956 191-DS 0.0333 0.0333 0.0667 0.1000 0.2667 0.0815 0.0747 0.0667 0.2333 0.9173 0.0625 0.0518 0.0494 0.0333 0.1000 0.0583 0.0295 192-DS 0.0000 0.0333 0.0667 0.1083 0.2667 0.0889 0.0943 0.0750 0.2667 1.0607 0.0267 0.0001 0.0716 0.0000 0.0667 0.0429 0.0252 193-DS 0.0333 0.0833 0.2000 0.4000 0.6333 0.2519 0.2142 0.3167 0.6000 0.8503 0.1621 0.0951 0.1761 0.0333 0.6333 0.2519 0.2142 194-DS 0.0000 0.0583 0.1667 0.3083 0.4333 0.2000 0.1590 0.2500 0.4333 0.7949 0.0578 0.0001 0.1259 0.0000 0.4333 0.2000 0.1590 195-DS 0.1000 0.2750 0.4000 0.5250 0.6667 0.3926 0.1970 0.2500 0.5667 0.5019 0.3294 0.2533 0.1490 0.1000 0.6667 0.3926 0.1970 196-DS 0.0000 0.0000 0.0333 0.0833 0.2333 0.0556 0.0799 0.0833 0.2333 1.4387 0.0014 0.0000 0.0593 0.0000 0.1333 0.0333 0.0471 197-DS 0.0333 0.0583 0.1000 0.1417 0.6000 0.1519 0.1819 0.0833 0.5667 1.1979 0.0974 0.0718 0.1251 0.0333 0.1000 0.0714 0.0300 198-DS 0.3333 0.3667 0.4000 0.6000 0.7000 0.4741 0.1352 0.2333 0.3667 0.2851 0.4578 0.4429 0.1193 0.3333 0.7000 0.4741 0.1352 199-DS 0.0000 0.0000 0.0000 0.3167 0.5000 0.1630 0.2105 0.3167 0.5000 1.2914 0.0010 0.0000 0.1811 0.0000 0.5000 0.1630 0.2105 200-DS 0.0000 0.0250 0.1000 0.1500 0.2000 0.0926 0.0795 0.1250 0.2000 0.8591 0.0126 0.0000 0.0675 0.0000 0.2000 0.0926 0.0795 233 DS-MULTI-CLEF2007 Track Overview Results and Graphs DS-MULTI-CLEF2007 Statistics for P@100 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0000 0.0750 0.1400 0.3225 0.3500 0.1700 0.1354 0.2475 0.3500 0.7963 0.0217 0.0000 0.1089 0.0000 0.3500 0.1700 0.1354 177-DS 0.0300 0.0600 0.0800 0.1650 0.1800 0.0989 0.0597 0.1050 0.1500 0.6035 0.0818 0.0661 0.0496 0.0300 0.1800 0.0989 0.0597 178-DS 0.0300 0.2050 0.2700 0.3075 0.5600 0.2589 0.1574 0.1025 0.5300 0.6081 0.1911 0.1105 0.0995 0.2600 0.3300 0.2833 0.0273 179-DS 0.0000 0.3775 0.3900 0.4325 0.5000 0.3689 0.1439 0.0550 0.5000 0.3901 0.1268 0.0001 0.0820 0.3700 0.5000 0.4150 0.0424 180-DS 0.3200 0.4000 0.5000 0.6400 0.6900 0.5089 0.1322 0.2400 0.3700 0.2599 0.4932 0.4775 0.1054 0.3200 0.6900 0.5089 0.1322 181-DS 0.0200 0.0600 0.1100 0.1925 0.3500 0.1444 0.1175 0.1325 0.3300 0.8134 0.1017 0.0662 0.0872 0.0200 0.3500 0.1444 0.1175 182-DS 0.0100 0.0100 0.0100 0.2875 0.5500 0.1467 0.2230 0.2775 0.5400 1.5208 0.0339 0.0148 0.1822 0.0100 0.5500 0.1467 0.2230 183-DS 0.0200 0.0475 0.1600 0.2400 0.4300 0.1711 0.1558 0.1925 0.4100 0.9103 0.1106 0.0683 0.1148 0.0200 0.4300 0.1711 0.1558 184-DS 0.0100 0.0975 0.1200 0.1725 0.3100 0.1311 0.0875 0.0750 0.3000 0.6676 0.0943 0.0496 0.0593 0.0100 0.1800 0.1087 0.0601 185-DS 0.0000 0.0200 0.1100 0.2350 0.2500 0.1122 0.1060 0.2150 0.2500 0.9449 0.0289 0.0001 0.0874 0.0000 0.2500 0.1122 0.1060 186-DS 0.0300 0.0300 0.0700 0.1000 0.1000 0.0667 0.0308 0.0700 0.0700 0.4623 0.0593 0.0519 0.0259 0.0300 0.1000 0.0667 0.0308 187-DS 0.0400 0.0625 0.2100 0.4325 0.5700 0.2578 0.2166 0.3700 0.5300 0.8403 0.1653 0.1010 0.1864 0.0400 0.5700 0.2578 0.2166 188-DS 0.3200 0.4375 0.5400 0.5700 0.5800 0.4967 0.0950 0.1325 0.2600 0.1913 0.4874 0.4769 0.0756 0.3200 0.5800 0.4967 0.0950 189-DS 0.0000 0.0000 0.0200 0.0425 0.1200 0.0300 0.0381 0.0425 0.1200 1.2693 0.0023 0.0000 0.0267 0.0000 0.0500 0.0187 0.0189 190-DS 0.0000 0.1200 0.1900 0.3375 0.7500 0.2667 0.2641 0.2175 0.7500 0.9904 0.0290 0.0000 0.1948 0.0000 0.6600 0.2063 0.2054 191-DS 0.0100 0.0650 0.1000 0.1400 0.1800 0.1000 0.0550 0.0750 0.1700 0.5500 0.0792 0.0486 0.0422 0.0100 0.1800 0.1000 0.0550 192-DS 0.0000 0.0350 0.0800 0.1050 0.1900 0.0822 0.0650 0.0700 0.1900 0.7900 0.0278 0.0001 0.0457 0.0000 0.1900 0.0822 0.0650 193-DS 0.0900 0.1075 0.2000 0.4050 0.6500 0.2878 0.2160 0.2975 0.5600 0.7507 0.2249 0.1798 0.1664 0.0900 0.6500 0.2878 0.2160 194-DS 0.0400 0.0800 0.0900 0.2650 0.3500 0.1678 0.1154 0.1850 0.3100 0.6879 0.1315 0.1024 0.1042 0.0400 0.3500 0.1678 0.1154 195-DS 0.1400 0.3125 0.5200 0.6325 0.6900 0.4533 0.2088 0.3200 0.5500 0.4606 0.3937 0.3226 0.1741 0.1400 0.6900 0.4533 0.2088 196-DS 0.0000 0.0000 0.0300 0.1325 0.2100 0.0667 0.0863 0.1325 0.2100 1.2947 0.0016 0.0000 0.0711 0.0000 0.2100 0.0667 0.0863 197-DS 0.0300 0.0575 0.1100 0.2850 0.7600 0.2100 0.2362 0.2275 0.7300 1.1249 0.1283 0.0851 0.1711 0.0300 0.3900 0.1412 0.1231 198-DS 0.1800 0.3650 0.5500 0.5925 0.6700 0.4722 0.1815 0.2275 0.4900 0.3844 0.4311 0.3814 0.1464 0.1800 0.6700 0.4722 0.1815 199-DS 0.0000 0.0075 0.0200 0.1900 0.3100 0.1022 0.1243 0.1825 0.3100 1.2157 0.0089 0.0000 0.1047 0.0000 0.3100 0.1022 0.1243 200-DS 0.0100 0.1025 0.1400 0.1850 0.2500 0.1422 0.0769 0.0825 0.2400 0.5410 0.1077 0.0553 0.0558 0.0100 0.2500 0.1422 0.0769 234 DS-MULTI-CLEF2007 Track Overview Results and Graphs DS-MULTI-CLEF2007 Statistics for P@200 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0050 0.0625 0.1100 0.2187 0.3000 0.1300 0.1040 0.1562 0.2950 0.8003 0.0743 0.0254 0.0833 0.0050 0.3000 0.1300 0.1040 177-DS 0.0200 0.0475 0.0600 0.1262 0.1400 0.0750 0.0453 0.0787 0.1200 0.6037 0.0619 0.0497 0.0378 0.0200 0.1400 0.0750 0.0453 178-DS 0.0200 0.1413 0.1950 0.2238 0.4850 0.1961 0.1358 0.0825 0.4650 0.6926 0.1377 0.0740 0.0835 0.0200 0.2500 0.1600 0.0876 179-DS 0.0000 0.3475 0.3650 0.3825 0.3950 0.3283 0.1244 0.0350 0.3950 0.3788 0.1147 0.0001 0.0730 0.3400 0.3950 0.3694 0.0188 180-DS 0.3250 0.4175 0.4600 0.5400 0.6200 0.4689 0.0894 0.1225 0.2950 0.1907 0.4612 0.4535 0.0677 0.3250 0.6200 0.4689 0.0894 181-DS 0.0350 0.0525 0.0800 0.1050 0.1950 0.0911 0.0571 0.0525 0.1600 0.6268 0.0782 0.0685 0.0428 0.0350 0.1800 0.0781 0.0446 182-DS 0.0050 0.0050 0.0250 0.2638 0.5150 0.1422 0.2111 0.2588 0.5100 1.4843 0.0355 0.0123 0.1696 0.0050 0.5150 0.1422 0.2111 183-DS 0.0100 0.0450 0.1300 0.2313 0.3150 0.1400 0.1096 0.1863 0.3050 0.7829 0.0916 0.0471 0.0878 0.0100 0.3150 0.1400 0.1096 184-DS 0.0450 0.0612 0.0800 0.1562 0.3000 0.1172 0.0902 0.0950 0.2550 0.7693 0.0943 0.0800 0.0696 0.0450 0.2350 0.0944 0.0626 185-DS 0.0000 0.0238 0.0900 0.1475 0.1700 0.0833 0.0670 0.1238 0.1700 0.8044 0.0262 0.0001 0.0574 0.0000 0.1700 0.0833 0.0670 186-DS 0.0250 0.0325 0.0450 0.0675 0.0750 0.0506 0.0201 0.0350 0.0500 0.3970 0.0467 0.0428 0.0173 0.0250 0.0750 0.0506 0.0201 187-DS 0.0450 0.0488 0.2300 0.3837 0.5150 0.2400 0.1903 0.3350 0.4700 0.7928 0.1601 0.1016 0.1622 0.0450 0.5150 0.2400 0.1903 188-DS 0.3100 0.3687 0.4300 0.4625 0.5200 0.4200 0.0705 0.0938 0.2100 0.1679 0.4144 0.4085 0.0544 0.3100 0.5200 0.4200 0.0705 189-DS 0.0000 0.0075 0.0200 0.0475 0.0950 0.0322 0.0322 0.0400 0.0950 1.0000 0.0054 0.0000 0.0247 0.0000 0.0950 0.0322 0.0322 190-DS 0.0000 0.1275 0.2550 0.3825 0.6650 0.2772 0.2364 0.2550 0.6650 0.8527 0.0314 0.0000 0.1696 0.0000 0.6650 0.2772 0.2364 191-DS 0.0300 0.0525 0.0750 0.1325 0.1700 0.0911 0.0515 0.0800 0.1400 0.5649 0.0770 0.0636 0.0435 0.0300 0.1700 0.0911 0.0515 192-DS 0.0050 0.0312 0.0750 0.0900 0.1100 0.0644 0.0367 0.0587 0.1050 0.5694 0.0480 0.0257 0.0296 0.0050 0.1100 0.0644 0.0367 193-DS 0.0850 0.1513 0.1900 0.3225 0.6300 0.2700 0.1969 0.1712 0.5450 0.7291 0.2211 0.1874 0.1500 0.0850 0.2350 0.1736 0.0519 194-DS 0.0450 0.0600 0.0750 0.2350 0.2800 0.1456 0.0998 0.1750 0.2350 0.6856 0.1147 0.0914 0.0917 0.0450 0.2800 0.1456 0.0998 195-DS 0.1850 0.3362 0.4350 0.5500 0.6450 0.4289 0.1620 0.2137 0.4600 0.3776 0.3976 0.3633 0.1246 0.1850 0.6450 0.4289 0.1620 196-DS 0.0000 0.0037 0.0250 0.1187 0.2150 0.0628 0.0788 0.1150 0.2150 1.2550 0.0068 0.0000 0.0648 0.0000 0.2150 0.0628 0.0788 197-DS 0.0400 0.0400 0.1150 0.2400 0.4850 0.1600 0.1559 0.2000 0.4450 0.9745 0.1061 0.0752 0.1211 0.0400 0.4850 0.1600 0.1559 198-DS 0.1400 0.3075 0.4300 0.5300 0.5800 0.4039 0.1643 0.2225 0.4400 0.4068 0.3626 0.3116 0.1257 0.1400 0.5800 0.4039 0.1643 199-DS 0.0000 0.0100 0.0250 0.1213 0.2500 0.0783 0.0932 0.1113 0.2500 1.1894 0.0184 0.0001 0.0715 0.0000 0.2500 0.0783 0.0932 200-DS 0.0050 0.0875 0.1300 0.1613 0.2100 0.1228 0.0673 0.0738 0.2050 0.5483 0.0866 0.0325 0.0496 0.0050 0.2100 0.1228 0.0673 235 DS-MULTI-CLEF2007 Track Overview Results and Graphs DS-MULTI-CLEF2007 Statistics for P@500 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0060 0.0365 0.0580 0.1310 0.1900 0.0831 0.0687 0.0945 0.1840 0.8261 0.0511 0.0237 0.0541 0.0060 0.1900 0.0831 0.0687 177-DS 0.0160 0.0265 0.0380 0.0755 0.0840 0.0460 0.0267 0.0490 0.0680 0.5805 0.0389 0.0325 0.0222 0.0160 0.0840 0.0460 0.0267 178-DS 0.0120 0.0760 0.1080 0.1435 0.2440 0.1098 0.0707 0.0675 0.2320 0.6437 0.0792 0.0446 0.0478 0.0120 0.2440 0.1098 0.0707 179-DS 0.0040 0.2610 0.2740 0.3125 0.3320 0.2580 0.1005 0.0515 0.3280 0.3896 0.1790 0.0324 0.0631 0.2280 0.3320 0.2897 0.0344 180-DS 0.1980 0.3030 0.3220 0.3595 0.4560 0.3313 0.0744 0.0565 0.2580 0.2246 0.3235 0.3152 0.0498 0.2940 0.4240 0.3326 0.0428 181-DS 0.0280 0.0320 0.0320 0.0555 0.0820 0.0442 0.0211 0.0235 0.0540 0.4762 0.0407 0.0381 0.0167 0.0280 0.0820 0.0442 0.0211 182-DS 0.0020 0.0295 0.0560 0.1905 0.3920 0.1213 0.1525 0.1610 0.3900 1.2570 0.0449 0.0106 0.1178 0.0020 0.3920 0.1213 0.1525 183-DS 0.0100 0.0330 0.0800 0.1410 0.1880 0.0867 0.0605 0.1080 0.1780 0.6980 0.0631 0.0396 0.0483 0.0100 0.1880 0.0867 0.0605 184-DS 0.0320 0.0490 0.0660 0.1315 0.2860 0.1076 0.1008 0.0825 0.2540 0.9372 0.0785 0.0627 0.0780 0.0320 0.0820 0.0574 0.0188 185-DS 0.0000 0.0215 0.0520 0.0860 0.0940 0.0491 0.0347 0.0645 0.0940 0.7060 0.0183 0.0001 0.0285 0.0000 0.0940 0.0491 0.0347 186-DS 0.0140 0.0175 0.0280 0.0525 0.0560 0.0347 0.0176 0.0350 0.0420 0.5079 0.0304 0.0265 0.0159 0.0140 0.0560 0.0347 0.0176 187-DS 0.0380 0.0440 0.1960 0.3075 0.3840 0.1904 0.1459 0.2635 0.3460 0.7659 0.1308 0.0866 0.1262 0.0380 0.3840 0.1904 0.1459 188-DS 0.2220 0.2555 0.3040 0.3345 0.3840 0.2956 0.0526 0.0790 0.1620 0.1779 0.2914 0.2872 0.0423 0.2220 0.3840 0.2956 0.0526 189-DS 0.0040 0.0075 0.0300 0.0390 0.0560 0.0278 0.0182 0.0315 0.0520 0.6544 0.0202 0.0128 0.0145 0.0040 0.0560 0.0278 0.0182 190-DS 0.0000 0.1470 0.2080 0.3420 0.4860 0.2380 0.1705 0.1950 0.4860 0.7165 0.0294 0.0000 0.1289 0.0000 0.4860 0.2380 0.1705 191-DS 0.0180 0.0330 0.0420 0.0865 0.1000 0.0564 0.0312 0.0535 0.0820 0.5534 0.0482 0.0406 0.0276 0.0180 0.1000 0.0564 0.0312 192-DS 0.0060 0.0170 0.0620 0.0645 0.0940 0.0487 0.0294 0.0475 0.0880 0.6043 0.0367 0.0233 0.0240 0.0060 0.0940 0.0487 0.0294 193-DS 0.0780 0.1120 0.1420 0.2335 0.4560 0.2004 0.1466 0.1215 0.3780 0.7313 0.1660 0.1444 0.1131 0.0780 0.1600 0.1277 0.0296 194-DS 0.0380 0.0515 0.0680 0.1695 0.2160 0.1098 0.0684 0.1180 0.1780 0.6229 0.0907 0.0752 0.0615 0.0380 0.2160 0.1098 0.0684 195-DS 0.2020 0.2285 0.3620 0.4590 0.4760 0.3478 0.1147 0.2305 0.2740 0.3299 0.3298 0.3118 0.1007 0.2020 0.4760 0.3478 0.1147 196-DS 0.0000 0.0125 0.0300 0.0715 0.1500 0.0460 0.0511 0.0590 0.1500 1.1102 0.0120 0.0001 0.0396 0.0000 0.1500 0.0460 0.0511 197-DS 0.0260 0.0495 0.0860 0.1630 0.2540 0.1087 0.0787 0.1135 0.2280 0.7242 0.0848 0.0661 0.0630 0.0260 0.2540 0.1087 0.0787 198-DS 0.1240 0.1825 0.2660 0.3295 0.3900 0.2638 0.0963 0.1470 0.2660 0.3652 0.2459 0.2265 0.0749 0.1240 0.3900 0.2638 0.0963 199-DS 0.0020 0.0060 0.0160 0.0630 0.1380 0.0431 0.0490 0.0570 0.1360 1.1357 0.0205 0.0089 0.0377 0.0020 0.1380 0.0431 0.0490 200-DS 0.0080 0.0675 0.0880 0.1060 0.1380 0.0831 0.0410 0.0385 0.1300 0.4930 0.0665 0.0399 0.0290 0.0360 0.1380 0.0925 0.0318 236 DS-MULTI-CLEF2007 Track Overview Results and Graphs DS-MULTI-CLEF2007 Statistics for P@1000 Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 176-DS 0.0100 0.0233 0.0350 0.0765 0.1260 0.0530 0.0424 0.0532 0.1160 0.8009 0.0386 0.0273 0.0327 0.0100 0.1260 0.0530 0.0424 177-DS 0.0090 0.0197 0.0300 0.0452 0.0560 0.0314 0.0159 0.0255 0.0470 0.5061 0.0273 0.0228 0.0125 0.0090 0.0560 0.0314 0.0159 178-DS 0.0090 0.0458 0.0670 0.0988 0.1330 0.0679 0.0403 0.0530 0.1240 0.5941 0.0521 0.0334 0.0294 0.0090 0.1330 0.0679 0.0403 179-DS 0.0060 0.1670 0.2240 0.2335 0.2410 0.1869 0.0778 0.0665 0.2350 0.4166 0.1385 0.0435 0.0561 0.1190 0.2410 0.2095 0.0408 180-DS 0.1270 0.1925 0.2070 0.2790 0.3160 0.2306 0.0616 0.0865 0.1890 0.2671 0.2227 0.2142 0.0520 0.1270 0.3160 0.2306 0.0616 181-DS 0.0160 0.0168 0.0170 0.0350 0.0410 0.0239 0.0111 0.0182 0.0250 0.4640 0.0220 0.0205 0.0096 0.0160 0.0410 0.0239 0.0111 182-DS 0.0020 0.0305 0.0440 0.1215 0.2500 0.0830 0.0922 0.0910 0.2480 1.1110 0.0349 0.0081 0.0700 0.0020 0.2500 0.0830 0.0922 183-DS 0.0110 0.0400 0.0600 0.0825 0.1110 0.0586 0.0323 0.0425 0.1000 0.5524 0.0476 0.0346 0.0245 0.0110 0.1110 0.0586 0.0323 184-DS 0.0210 0.0385 0.0500 0.0983 0.2210 0.0822 0.0783 0.0598 0.2000 0.9527 0.0590 0.0461 0.0606 0.0210 0.0590 0.0433 0.0148 185-DS 0.0010 0.0190 0.0320 0.0535 0.0600 0.0324 0.0205 0.0345 0.0590 0.6321 0.0220 0.0070 0.0163 0.0010 0.0600 0.0324 0.0205 186-DS 0.0100 0.0118 0.0160 0.0352 0.0370 0.0229 0.0121 0.0235 0.0270 0.5299 0.0200 0.0174 0.0112 0.0100 0.0370 0.0229 0.0121 187-DS 0.0310 0.0370 0.1690 0.2500 0.2950 0.1508 0.1136 0.2130 0.2640 0.7531 0.1036 0.0686 0.1009 0.0310 0.2950 0.1508 0.1136 188-DS 0.1610 0.1930 0.2110 0.2510 0.2680 0.2163 0.0364 0.0580 0.1070 0.1684 0.2135 0.2107 0.0293 0.1610 0.2680 0.2163 0.0364 189-DS 0.0060 0.0078 0.0250 0.0295 0.0360 0.0213 0.0114 0.0217 0.0300 0.5355 0.0177 0.0138 0.0096 0.0060 0.0360 0.0213 0.0114 190-DS 0.0000 0.0955 0.1880 0.2237 0.3040 0.1663 0.1097 0.1282 0.3040 0.6592 0.0377 0.0001 0.0824 0.0000 0.3040 0.1663 0.1097 191-DS 0.0090 0.0225 0.0300 0.0515 0.0570 0.0354 0.0178 0.0290 0.0480 0.5012 0.0305 0.0249 0.0154 0.0090 0.0570 0.0354 0.0178 192-DS 0.0030 0.0133 0.0430 0.0553 0.0630 0.0374 0.0224 0.0420 0.0600 0.5988 0.0271 0.0146 0.0187 0.0030 0.0630 0.0374 0.0224 193-DS 0.0570 0.0690 0.0950 0.1748 0.3240 0.1409 0.1012 0.1058 0.2670 0.7181 0.1164 0.1003 0.0767 0.0570 0.3240 0.1409 0.1012 194-DS 0.0270 0.0505 0.0610 0.1290 0.1470 0.0850 0.0472 0.0785 0.1200 0.5557 0.0720 0.0597 0.0424 0.0270 0.1470 0.0850 0.0472 195-DS 0.1520 0.1872 0.2900 0.3583 0.3740 0.2732 0.0911 0.1710 0.2220 0.3334 0.2587 0.2440 0.0813 0.1520 0.3740 0.2732 0.0911 196-DS 0.0010 0.0100 0.0210 0.0470 0.0830 0.0307 0.0283 0.0370 0.0820 0.9214 0.0148 0.0040 0.0223 0.0010 0.0830 0.0307 0.0283 197-DS 0.0200 0.0555 0.0740 0.1088 0.1490 0.0793 0.0418 0.0533 0.1290 0.5270 0.0673 0.0539 0.0315 0.0200 0.1490 0.0793 0.0418 198-DS 0.0990 0.1317 0.1650 0.2098 0.2410 0.1723 0.0507 0.0780 0.1420 0.2942 0.1653 0.1582 0.0408 0.0990 0.2410 0.1723 0.0507 199-DS 0.0010 0.0068 0.0120 0.0400 0.0790 0.0264 0.0271 0.0332 0.0780 1.0263 0.0143 0.0057 0.0212 0.0010 0.0790 0.0264 0.0271 200-DS 0.0070 0.0380 0.0560 0.0695 0.0870 0.0529 0.0267 0.0315 0.0800 0.5041 0.0431 0.0292 0.0195 0.0070 0.0870 0.0529 0.0267 237 Individual Experiment Results and Graphs 238 239 chemnitz 10.2415/DS-MONO-DE-CLEF2007.CHEMNITZ.CUT_DS_MONO_DE_MERGED DS-MONO-DE-CLEF2007 Overall statistics for 25 queries : Priority 3 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 24,999 Source Language German Relevant 3,689 Topic Fields title, description Relevant retrieved 2,623 Pooled true Geometric Mean Average Precision 0.2189 Merged monolingual DE on structured and Binary Preference (BPREF) 0.3424 unstructured indizes Interploated Recall (%) Precision Averages (%) Domain−Specific Monolingual German Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 82.78 CUT_DS_MONO_DE_MERGED 10 60.78 90% 20 48.72 80% 30 40.92 40 34.38 70% 50 27.84 60% 60 22.94 Precision 70 16.47 50% 80 10.24 40% 90 5.37 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 29.91 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Monolingual German Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.7122 Minimum 0.0432 First Quartile 0.1103 Second Quartile 0.2403 Third Quartile 0.4559 Interquartile range 0.3456 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.2991 Domain−Specific Monolingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.2148 4 Number of Topics of the Experiment 3.5 Lower Outlier Threshold 0.0432 3 Upper Outlier Threshold 0.7122 2.5 Mean With No Outliers 0.2991 2 1.5 Std With No Outliers 0.2148 1 0.5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Monolingual German Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries CUT_DS_MONO_DE_MERGED 176-DS 36.98 189-DS 13.43 0.8 177-DS 17.88 190-DS 24.03 178-DS 71.22 191-DS 22.81 0.6 179-DS 45.32 192-DS 18.46 180-DS 66.57 193-DS 11.82 181-DS 67.85 194-DS 4.32 0.4 182-DS 59.32 195-DS 32.37 183-DS 7.26 196-DS 24.51 0.2 184-DS 20.22 197-DS 55.60 Difference 185-DS 6.14 198-DS 46.40 0 186-DS 4.33 199-DS 33.32 187-DS 8.66 200-DS 8.65 −0.2 188-DS 40.33 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 240 chemnitz 10.2415/DS-MONO-DE-CLEF2007.CHEMNITZ.CUT_DS_MONO_DE_MERGED DS-MONO-DE-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Monolingual German Task − Retrieved documents vs Mean Precision 100% 5 docs 63.20 CUT_DS_MONO_DE_MERGED 10 docs 60.00 90% 15 docs 55.47 80% 20 docs 52.20 30 docs 50.93 70% 100 docs 39.32 60% 200 docs 29.46 Precision 500 docs 17.12 50% 1000 docs 10.49 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 33.84 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Monolingual German Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.7000 Minimum 0.0857 First Quartile 0.1797 Second Quartile 0.3114 Third Quartile 0.5077 Interquartile range 0.3280 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.3384 Domain−Specific Monolingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.1954 4 Number of Topics of the Experiment 3.5 Lower Outlier Threshold 0.0857 3 Upper Outlier Threshold 0.7000 2.5 Mean With No Outliers 0.3384 2 1.5 Std With No Outliers 0.1954 1 0.5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Monolingual German Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries CUT_DS_MONO_DE_MERGED 176-DS 37.08 189-DS 15.38 0.8 177-DS 25.76 190-DS 34.29 178-DS 70.00 191-DS 25.00 0.6 179-DS 50.00 192-DS 24.24 180-DS 65.98 193-DS 21.28 181-DS 65.91 194-DS 10.57 0.4 182-DS 64.41 195-DS 31.14 183-DS 18.47 196-DS 35.96 0.2 184-DS 18.75 197-DS 53.23 Difference 185-DS 12.64 198-DS 53.07 0 186-DS 8.57 199-DS 38.27 187-DS 8.70 200-DS 16.47 −0.2 188-DS 40.90 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 241 chemnitz 10.2415/DS-MONO-DE-CLEF2007.CHEMNITZ.CUT_DS_MONO_DE_STRUCT DS-MONO-DE-CLEF2007 Overall statistics for 25 queries : Priority 2 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language German Relevant 3,689 Topic Fields title, description Relevant retrieved 2,502 Pooled true Geometric Mean Average Precision 0.1687 Monolingual DE on index with structure Binary Preference (BPREF) 0.3208 Interploated Recall (%) Precision Averages (%) Domain−Specific Monolingual German Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 81.02 CUT_DS_MONO_DE_STRUCT 10 54.54 90% 20 46.74 80% 30 37.20 40 31.49 70% 50 25.95 60% 60 18.15 Precision 70 11.68 50% 80 7.01 40% 90 2.54 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 26.31 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Monolingual German Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.6343 Minimum 0.0112 First Quartile 0.1046 Second Quartile 0.2057 Third Quartile 0.4152 Interquartile range 0.3107 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.2631 Domain−Specific Monolingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.1997 4 Number of Topics of the Experiment 3.5 Lower Outlier Threshold 0.0112 3 Upper Outlier Threshold 0.6343 2.5 Mean With No Outliers 0.2631 2 1.5 Std With No Outliers 0.1997 1 0.5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Monolingual German Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries CUT_DS_MONO_DE_STRUCT 176-DS 32.44 189-DS 11.51 0.8 177-DS 17.41 190-DS 23.48 178-DS 60.20 191-DS 17.11 0.6 179-DS 40.87 192-DS 18.28 180-DS 63.43 193-DS 11.50 181-DS 54.98 194-DS 3.36 0.4 182-DS 56.55 195-DS 28.46 183-DS 3.31 196-DS 19.24 0.2 184-DS 20.57 197-DS 53.73 Difference 185-DS 1.12 198-DS 39.49 0 186-DS 1.24 199-DS 21.59 187-DS 7.32 200-DS 6.97 −0.2 188-DS 43.49 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 242 chemnitz 10.2415/DS-MONO-DE-CLEF2007.CHEMNITZ.CUT_DS_MONO_DE_STRUCT DS-MONO-DE-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Monolingual German Task − Retrieved documents vs Mean Precision 100% 5 docs 57.60 CUT_DS_MONO_DE_STRUCT 10 docs 52.80 90% 15 docs 51.73 80% 20 docs 50.80 30 docs 47.20 70% 100 docs 36.28 60% 200 docs 26.92 Precision 500 docs 16.08 50% 1000 docs 10.01 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 30.37 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Monolingual German Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.6121 Minimum 0.0286 First Quartile 0.1477 Second Quartile 0.2727 Third Quartile 0.4588 Interquartile range 0.3111 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.3037 Domain−Specific Monolingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.1797 4 Number of Topics of the Experiment 3.5 Lower Outlier Threshold 0.0286 3 Upper Outlier Threshold 0.6121 2.5 Mean With No Outliers 0.3037 2 1.5 Std With No Outliers 0.1797 1 0.5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Monolingual German Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries CUT_DS_MONO_DE_STRUCT 176-DS 33.71 189-DS 15.38 0.8 177-DS 25.76 190-DS 31.73 178-DS 57.86 191-DS 22.22 0.6 179-DS 45.24 192-DS 27.27 180-DS 59.43 193-DS 19.57 181-DS 54.55 194-DS 9.76 0.4 182-DS 61.21 195-DS 31.14 183-DS 12.74 196-DS 31.46 0.2 184-DS 25.00 197-DS 51.74 Difference 185-DS 4.60 198-DS 47.81 0 186-DS 2.86 199-DS 25.93 187-DS 7.25 200-DS 12.94 −0.2 188-DS 42.09 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 243 chemnitz 10.2415/DS-MONO-DE-CLEF2007.CHEMNITZ.CUT_DS_MONO_DE_UNSTRUCT DS-MONO-DE-CLEF2007 Overall statistics for 25 queries : Priority 1 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language German Relevant 3,689 Topic Fields title, description Relevant retrieved 2,584 Pooled true Geometric Mean Average Precision 0.2192 Monolingual DE on index without structure Binary Preference (BPREF) 0.3381 Interploated Recall (%) Precision Averages (%) Domain−Specific Monolingual German Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 87.14 CUT_DS_MONO_DE_UNSTRUCT 10 59.42 90% 20 48.07 80% 30 38.49 40 31.57 70% 50 26.73 60% 60 20.94 Precision 70 15.11 50% 80 9.81 40% 90 5.16 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 28.87 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Monolingual German Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.6927 Minimum 0.0495 First Quartile 0.1094 Second Quartile 0.2066 Third Quartile 0.4441 Interquartile range 0.3347 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.2887 Domain−Specific Monolingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.2029 5 Number of Topics of the Experiment Lower Outlier Threshold 0.0495 4 Upper Outlier Threshold 0.6927 3 Mean With No Outliers 0.2887 2 Std With No Outliers 0.2029 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Monolingual German Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries CUT_DS_MONO_DE_UNSTRUCT 176-DS 37.02 189-DS 13.24 0.8 177-DS 17.82 190-DS 20.66 178-DS 69.27 191-DS 22.56 0.6 179-DS 46.86 192-DS 14.33 180-DS 64.23 193-DS 8.22 181-DS 62.97 194-DS 4.95 0.4 182-DS 52.89 195-DS 33.98 183-DS 7.97 196-DS 18.58 0.2 184-DS 18.85 197-DS 53.82 Difference 185-DS 11.28 198-DS 43.59 0 186-DS 7.38 199-DS 35.74 187-DS 8.21 200-DS 9.91 −0.2 188-DS 37.40 −0.4 −0.6 −0.8 −1 176−DS177−DS178−DS 179−DS180−DS181−DS 182−DS183−DS184−DS 185−DS186−DS187−DS 188−DS189−DS190−DS191−DS 192−DS193−DS194−DS 195−DS196−DS197−DS 198−DS199−DS200−DS Topic Identifier 244 chemnitz 10.2415/DS-MONO-DE-CLEF2007.CHEMNITZ.CUT_DS_MONO_DE_UNSTRUCT DS-MONO-DE-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Monolingual German Task − Retrieved documents vs Mean Precision 100% 5 docs 68.00 CUT_DS_MONO_DE_UNSTRUCT 10 docs 60.00 90% 15 docs 55.73 80% 20 docs 53.20 30 docs 49.20 70% 100 docs 38.44 60% 200 docs 28.26 Precision 500 docs 16.51 50% 1000 docs 10.34 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 32.97 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Monolingual German Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.6818 Minimum 0.0857 First Quartile 0.1754 Second Quartile 0.2921 Third Quartile 0.4984 Interquartile range 0.3230 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.3297 Domain−Specific Monolingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.1888 4 Number of Topics of the Experiment 3.5 Lower Outlier Threshold 0.0857 3 Upper Outlier Threshold 0.6818 2.5 Mean With No Outliers 0.3297 2 1.5 Std With No Outliers 0.1888 1 0.5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Monolingual German Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries CUT_DS_MONO_DE_UNSTRUCT 176-DS 35.96 189-DS 19.23 0.8 177-DS 22.73 190-DS 32.05 178-DS 67.14 191-DS 25.00 0.6 179-DS 49.21 192-DS 21.21 180-DS 65.16 193-DS 17.87 181-DS 68.18 194-DS 8.94 0.4 182-DS 56.23 195-DS 32.41 183-DS 16.56 196-DS 29.21 0.2 184-DS 16.25 197-DS 53.23 Difference 185-DS 22.99 198-DS 51.75 0 186-DS 8.57 199-DS 40.74 187-DS 10.14 200-DS 14.12 −0.2 188-DS 39.40 −0.4 −0.6 −0.8 −1 176−DS177−DS178−DS 179−DS180−DS181−DS 182−DS183−DS184−DS 185−DS186−DS187−DS 188−DS189−DS190−DS191−DS 192−DS193−DS194−DS 195−DS196−DS197−DS 198−DS199−DS200−DS Topic Identifier 245 cheshire 10.2415/DS-MONO-DE-CLEF2007.CHESHIRE.BERKMDECCP15 DS-MONO-DE-CLEF2007 Overall statistics for 25 queries : Priority 1 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language German Relevant 3,689 Topic Fields title, description Relevant retrieved 2,857 Pooled true Geometric Mean Average Precision 0.2511 DE monolingual using Class Cluster Lookup merged Binary Preference (BPREF) 0.3674 with T2FB Interploated Recall (%) Precision Averages (%) Domain−Specific Monolingual German Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 89.52 BERKMDECCP15 10 61.51 90% 20 49.51 80% 30 42.53 40 37.08 70% 50 31.55 60% 60 25.21 Precision 70 18.90 50% 80 10.63 40% 90 3.67 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 31.50 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Monolingual German Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.6389 Minimum 0.0665 First Quartile 0.1166 Second Quartile 0.2838 Third Quartile 0.4798 Interquartile range 0.3632 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.3150 Domain−Specific Monolingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.1930 5 Number of Topics of the Experiment Lower Outlier Threshold 0.0665 4 Upper Outlier Threshold 0.6389 3 Mean With No Outliers 0.3150 2 Std With No Outliers 0.1930 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Monolingual German Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries BERKMDECCP15 176-DS 41.95 189-DS 18.14 0.8 177-DS 18.29 190-DS 47.25 178-DS 45.97 191-DS 10.60 0.6 179-DS 53.41 192-DS 21.36 180-DS 58.06 193-DS 12.01 181-DS 61.50 194-DS 10.39 0.4 182-DS 47.53 195-DS 49.32 183-DS 9.64 196-DS 43.41 0.2 184-DS 26.19 197-DS 51.73 Difference 185-DS 28.49 198-DS 28.38 0 186-DS 6.65 199-DS 13.46 187-DS 9.43 200-DS 10.52 −0.2 188-DS 63.89 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 246 cheshire 10.2415/DS-MONO-DE-CLEF2007.CHESHIRE.BERKMDECCP15 DS-MONO-DE-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Monolingual German Task − Retrieved documents vs Mean Precision 100% 5 docs 70.40 BERKMDECCP15 10 docs 66.00 90% 15 docs 59.47 80% 20 docs 56.80 30 docs 52.80 70% 100 docs 40.12 60% 200 docs 30.26 Precision 500 docs 18.56 50% 1000 docs 11.43 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 34.91 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Monolingual German Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.5910 Minimum 0.0833 First Quartile 0.1840 Second Quartile 0.3377 Third Quartile 0.5200 Interquartile range 0.3360 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.3491 Domain−Specific Monolingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.1714 5 Number of Topics of the Experiment Lower Outlier Threshold 0.0833 4 Upper Outlier Threshold 0.5910 3 Mean With No Outliers 0.3491 2 Std With No Outliers 0.1714 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Monolingual German Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries BERKMDECCP15 176-DS 42.70 189-DS 21.15 0.8 177-DS 21.21 190-DS 51.92 178-DS 45.00 191-DS 8.33 0.6 179-DS 52.38 192-DS 27.27 180-DS 57.79 193-DS 20.43 181-DS 56.82 194-DS 17.07 0.4 182-DS 53.02 195-DS 51.39 183-DS 14.65 196-DS 48.31 0.2 184-DS 32.50 197-DS 52.24 Difference 185-DS 42.53 198-DS 33.77 0 186-DS 14.29 199-DS 13.58 187-DS 18.84 200-DS 16.47 −0.2 188-DS 59.10 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 247 cheshire 10.2415/DS-MONO-DE-CLEF2007.CHESHIRE.BERKMDETHP7 DS-MONO-DE-CLEF2007 Overall statistics for 25 queries : Priority 2 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language German Relevant 3,689 Topic Fields title, description Relevant retrieved 2,854 Pooled true Geometric Mean Average Precision 0.2532 DE monolingual using Thesaurus Lookup merged with Binary Preference (BPREF) 0.3740 T2FB Interploated Recall (%) Precision Averages (%) Domain−Specific Monolingual German Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 92.09 BERKMDETHP7 10 60.17 90% 20 50.33 80% 30 43.80 40 37.68 70% 50 32.36 60% 60 26.02 Precision 70 20.47 50% 80 10.92 40% 90 3.90 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 31.99 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Monolingual German Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.6312 Minimum 0.0539 First Quartile 0.1198 Second Quartile 0.2716 Third Quartile 0.4924 Interquartile range 0.3725 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.3199 Domain−Specific Monolingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.1965 5 Number of Topics of the Experiment Lower Outlier Threshold 0.0539 4 Upper Outlier Threshold 0.6312 3 Mean With No Outliers 0.3199 2 Std With No Outliers 0.1965 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Monolingual German Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries BERKMDETHP7 176-DS 41.66 189-DS 22.10 0.8 177-DS 17.17 190-DS 48.15 178-DS 55.35 191-DS 11.22 0.6 179-DS 51.38 192-DS 22.80 180-DS 56.58 193-DS 12.24 181-DS 63.12 194-DS 11.13 0.4 182-DS 45.88 195-DS 48.52 183-DS 9.48 196-DS 44.90 0.2 184-DS 24.34 197-DS 58.26 Difference 185-DS 27.16 198-DS 28.91 0 186-DS 5.39 199-DS 14.01 187-DS 8.95 200-DS 10.57 −0.2 188-DS 60.49 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 248 cheshire 10.2415/DS-MONO-DE-CLEF2007.CHESHIRE.BERKMDETHP7 DS-MONO-DE-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Monolingual German Task − Retrieved documents vs Mean Precision 100% 5 docs 70.40 BERKMDETHP7 10 docs 67.20 90% 15 docs 59.20 80% 20 docs 55.40 30 docs 52.93 70% 100 docs 41.16 60% 200 docs 30.72 Precision 500 docs 18.44 50% 1000 docs 11.42 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 35.75 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Monolingual German Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.5909 Minimum 0.0833 First Quartile 0.1776 Second Quartile 0.3553 Third Quartile 0.5238 Interquartile range 0.3461 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.3575 Domain−Specific Monolingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.1785 6 Number of Topics of the Experiment Lower Outlier Threshold 0.0833 5 Upper Outlier Threshold 0.5909 4 Mean With No Outliers 0.3575 3 Std With No Outliers 0.1785 2 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Monolingual German Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries BERKMDETHP7 176-DS 46.07 189-DS 23.08 0.8 177-DS 22.73 190-DS 52.56 178-DS 54.29 191-DS 8.33 0.6 179-DS 51.59 192-DS 31.31 180-DS 57.38 193-DS 20.00 181-DS 59.09 194-DS 17.89 0.4 182-DS 52.31 195-DS 51.14 183-DS 15.92 196-DS 51.69 0.2 184-DS 28.75 197-DS 58.21 Difference 185-DS 42.53 198-DS 35.53 0 186-DS 11.43 199-DS 14.81 187-DS 17.39 200-DS 14.12 −0.2 188-DS 55.52 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 249 unine 10.2415/DS-MONO-DE-CLEF2007.UNINE.UNINEDE1 DS-MONO-DE-CLEF2007 Overall statistics for 25 queries : Priority 1 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language German Relevant 3,689 Topic Fields title, description Relevant retrieved 2,868 Pooled true Geometric Mean Average Precision 0.2512 PL2 & PB2 & InB2 Binary Preference (BPREF) 0.3893 Interploated Recall (%) Precision Averages (%) Domain−Specific Monolingual German Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 86.02 UNINEDE1 10 61.73 90% 20 50.27 80% 30 43.97 40 38.62 70% 50 33.30 60% 60 27.91 Precision 70 23.79 50% 80 17.38 40% 90 11.84 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 34.03 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Monolingual German Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.8522 Minimum 0.0319 First Quartile 0.1377 Second Quartile 0.2341 Third Quartile 0.5220 Interquartile range 0.3843 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.3403 Domain−Specific Monolingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.2364 4 Number of Topics of the Experiment 3.5 Lower Outlier Threshold 0.0319 3 Upper Outlier Threshold 0.8522 2.5 Mean With No Outliers 0.3403 2 1.5 Std With No Outliers 0.2364 1 0.5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Monolingual German Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries UNINEDE1 176-DS 85.22 189-DS 22.24 0.8 177-DS 17.64 190-DS 50.22 178-DS 73.52 191-DS 22.48 0.6 179-DS 51.31 192-DS 14.54 180-DS 66.04 193-DS 23.41 181-DS 22.74 194-DS 6.22 0.4 182-DS 57.39 195-DS 58.95 183-DS 8.35 196-DS 49.73 0.2 184-DS 38.44 197-DS 54.87 Difference 185-DS 11.47 198-DS 30.57 0 186-DS 3.19 199-DS 47.43 187-DS 10.90 200-DS 8.29 −0.2 188-DS 15.60 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 250 unine 10.2415/DS-MONO-DE-CLEF2007.UNINE.UNINEDE1 DS-MONO-DE-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Monolingual German Task − Retrieved documents vs Mean Precision 100% 5 docs 64.00 UNINEDE1 10 docs 57.60 90% 15 docs 54.67 80% 20 docs 53.20 30 docs 53.47 70% 100 docs 42.44 60% 200 docs 31.98 Precision 500 docs 18.73 50% 1000 docs 11.47 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 37.31 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Monolingual German Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.7978 Minimum 0.0571 First Quartile 0.1797 Second Quartile 0.3404 Third Quartile 0.5238 Interquartile range 0.3441 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.3731 Domain−Specific Monolingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.2069 5 Number of Topics of the Experiment Lower Outlier Threshold 0.0571 4 Upper Outlier Threshold 0.7978 3 Mean With No Outliers 0.3731 2 Std With No Outliers 0.2069 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Monolingual German Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries UNINEDE1 176-DS 79.78 189-DS 28.85 0.8 177-DS 24.24 190-DS 49.36 178-DS 70.71 191-DS 25.00 0.6 179-DS 51.59 192-DS 15.15 180-DS 67.62 193-DS 34.04 181-DS 29.55 194-DS 8.13 0.4 182-DS 59.43 195-DS 56.46 183-DS 18.47 196-DS 52.81 0.2 184-DS 41.25 197-DS 52.24 Difference 185-DS 16.09 198-DS 37.72 0 186-DS 5.71 199-DS 49.38 187-DS 15.94 200-DS 16.47 −0.2 188-DS 26.87 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 251 unine 10.2415/DS-MONO-DE-CLEF2007.UNINE.UNINEDE2 DS-MONO-DE-CLEF2007 Overall statistics for 25 queries : Priority 4 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language German Relevant 3,689 Topic Fields title, description Relevant retrieved 2,903 Pooled true Geometric Mean Average Precision 0.2692 LM & PB2 & InL2 Binary Preference (BPREF) 0.3949 Interploated Recall (%) Precision Averages (%) Domain−Specific Monolingual German Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 84.55 UNINEDE2 10 61.98 90% 20 51.67 80% 30 46.30 40 41.64 70% 50 35.91 60% 60 30.01 Precision 70 24.63 50% 80 18.79 40% 90 12.14 30% 100 0.40 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 35.31 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Monolingual German Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.8565 Minimum 0.0488 First Quartile 0.1383 Second Quartile 0.3319 Third Quartile 0.5424 Interquartile range 0.4041 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.3531 Domain−Specific Monolingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.2327 5 Number of Topics of the Experiment Lower Outlier Threshold 0.0488 4 Upper Outlier Threshold 0.8565 3 Mean With No Outliers 0.3531 2 Std With No Outliers 0.2327 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Monolingual German Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries UNINEDE2 176-DS 85.65 189-DS 22.50 0.8 177-DS 15.93 190-DS 54.47 178-DS 69.10 191-DS 26.65 0.6 179-DS 52.33 192-DS 14.39 180-DS 69.65 193-DS 24.46 181-DS 39.88 194-DS 6.61 0.4 182-DS 56.02 195-DS 60.56 183-DS 10.68 196-DS 47.08 0.2 184-DS 37.70 197-DS 54.17 Difference 185-DS 14.77 198-DS 33.19 0 186-DS 4.88 199-DS 48.78 187-DS 11.83 200-DS 9.31 −0.2 188-DS 12.15 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 252 unine 10.2415/DS-MONO-DE-CLEF2007.UNINE.UNINEDE2 DS-MONO-DE-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Monolingual German Task − Retrieved documents vs Mean Precision 100% 5 docs 63.20 UNINEDE2 10 docs 56.80 90% 15 docs 54.67 80% 20 docs 52.80 30 docs 52.93 70% 100 docs 42.76 60% 200 docs 33.36 Precision 500 docs 19.37 50% 1000 docs 11.61 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 38.18 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Monolingual German Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.8090 Minimum 0.0571 First Quartile 0.1941 Second Quartile 0.4125 Third Quartile 0.5283 Interquartile range 0.3342 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.3818 Domain−Specific Monolingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.2098 4 Number of Topics of the Experiment 3.5 Lower Outlier Threshold 0.0571 3 Upper Outlier Threshold 0.8090 2.5 Mean With No Outliers 0.3818 2 1.5 Std With No Outliers 0.2098 1 0.5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Monolingual German Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries UNINEDE2 176-DS 80.90 189-DS 25.00 0.8 177-DS 21.21 190-DS 52.88 178-DS 67.14 191-DS 27.78 0.6 179-DS 52.38 192-DS 15.15 180-DS 70.08 193-DS 34.47 181-DS 45.45 194-DS 8.94 0.4 182-DS 58.36 195-DS 59.75 183-DS 19.75 196-DS 52.81 0.2 184-DS 41.25 197-DS 51.24 Difference 185-DS 18.39 198-DS 41.67 0 186-DS 5.71 199-DS 49.38 187-DS 14.49 200-DS 15.29 −0.2 188-DS 25.07 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 253 unine 10.2415/DS-MONO-DE-CLEF2007.UNINE.UNINEDE3 DS-MONO-DE-CLEF2007 Overall statistics for 25 queries : Priority 3 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language German Relevant 3,689 Topic Fields title, description Relevant retrieved 2,897 Pooled true Geometric Mean Average Precision 0.2635 PL2 & InB2 (+thesaurus) Binary Preference (BPREF) 0.4009 Interploated Recall (%) Precision Averages (%) Domain−Specific Monolingual German Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 87.00 UNINEDE3 10 63.46 90% 20 52.65 80% 30 45.71 40 40.42 70% 50 34.79 60% 60 29.12 Precision 70 24.56 50% 80 18.13 40% 90 12.32 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 35.35 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Monolingual German Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.8511 Minimum 0.0281 First Quartile 0.1454 Second Quartile 0.3110 Third Quartile 0.5491 Interquartile range 0.4037 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.3535 Domain−Specific Monolingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.2341 4 Number of Topics of the Experiment 3.5 Lower Outlier Threshold 0.0281 3 Upper Outlier Threshold 0.8511 2.5 Mean With No Outliers 0.3535 2 1.5 Std With No Outliers 0.2341 1 0.5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Monolingual German Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries UNINEDE3 176-DS 85.11 189-DS 28.11 0.8 177-DS 17.62 190-DS 51.98 178-DS 72.00 191-DS 22.88 0.6 179-DS 51.28 192-DS 15.24 180-DS 68.22 193-DS 24.14 181-DS 31.10 194-DS 5.86 0.4 182-DS 55.27 195-DS 58.08 183-DS 7.93 196-DS 54.82 0.2 184-DS 40.20 197-DS 55.17 Difference 185-DS 11.44 198-DS 33.13 0 186-DS 2.81 199-DS 50.81 187-DS 11.16 200-DS 12.44 −0.2 188-DS 16.84 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 254 unine 10.2415/DS-MONO-DE-CLEF2007.UNINE.UNINEDE3 DS-MONO-DE-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Monolingual German Task − Retrieved documents vs Mean Precision 100% 5 docs 64.80 UNINEDE3 10 docs 60.80 90% 15 docs 56.53 80% 20 docs 55.20 30 docs 54.27 70% 100 docs 43.40 60% 200 docs 32.70 Precision 500 docs 18.89 50% 1000 docs 11.59 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 38.45 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Monolingual German Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.7978 Minimum 0.0571 First Quartile 0.1951 Second Quartile 0.3864 Third Quartile 0.5398 Interquartile range 0.3446 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.3845 Domain−Specific Monolingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.2083 4 Number of Topics of the Experiment 3.5 Lower Outlier Threshold 0.0571 3 Upper Outlier Threshold 0.7978 2.5 Mean With No Outliers 0.3845 2 1.5 Std With No Outliers 0.2083 1 0.5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Monolingual German Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries UNINEDE3 176-DS 79.78 189-DS 28.85 0.8 177-DS 24.24 190-DS 51.28 178-DS 67.86 191-DS 25.00 0.6 179-DS 51.59 192-DS 16.16 180-DS 69.26 193-DS 35.32 181-DS 38.64 194-DS 8.94 0.4 182-DS 59.79 195-DS 56.20 183-DS 19.75 196-DS 59.55 0.2 184-DS 42.50 197-DS 53.23 Difference 185-DS 16.09 198-DS 39.91 0 186-DS 5.71 199-DS 51.85 187-DS 13.04 200-DS 18.82 −0.2 188-DS 27.76 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 255 unine 10.2415/DS-MONO-DE-CLEF2007.UNINE.UNINEDE4 DS-MONO-DE-CLEF2007 Overall statistics for 25 queries : Priority 2 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language German Relevant 3,689 Topic Fields title, description, narrative Relevant retrieved 2,797 Pooled true Geometric Mean Average Precision 0.2916 PL2 & PB2 & InB2 Binary Preference (BPREF) 0.4119 Interploated Recall (%) Precision Averages (%) Domain−Specific Monolingual German Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 87.98 UNINEDE4 10 68.70 90% 20 56.22 80% 30 48.63 40 40.87 70% 50 35.12 60% 60 28.86 Precision 70 23.75 50% 80 14.47 40% 90 9.51 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 36.04 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Monolingual German Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.8473 Minimum 0.0370 First Quartile 0.2294 Second Quartile 0.3268 Third Quartile 0.4980 Interquartile range 0.2686 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.3604 Domain−Specific Monolingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.2021 5 Number of Topics of the Experiment Lower Outlier Threshold 0.0370 4 Upper Outlier Threshold 0.8473 3 Mean With No Outliers 0.3604 2 Std With No Outliers 0.2021 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Monolingual German Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries UNINEDE4 176-DS 84.73 189-DS 31.39 0.8 177-DS 15.77 190-DS 35.65 178-DS 67.02 191-DS 31.92 0.6 179-DS 55.06 192-DS 24.41 180-DS 69.77 193-DS 18.54 181-DS 34.38 194-DS 10.13 0.4 182-DS 50.23 195-DS 49.66 183-DS 4.85 196-DS 32.26 0.2 184-DS 44.54 197-DS 52.81 Difference 185-DS 3.70 198-DS 32.68 0 186-DS 25.41 199-DS 43.43 187-DS 16.54 200-DS 38.58 −0.2 188-DS 27.63 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 256 unine 10.2415/DS-MONO-DE-CLEF2007.UNINE.UNINEDE4 DS-MONO-DE-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Monolingual German Task − Retrieved documents vs Mean Precision 100% 5 docs 70.40 UNINEDE4 10 docs 66.80 90% 15 docs 64.27 80% 20 docs 60.60 30 docs 57.33 70% 100 docs 44.20 60% 200 docs 32.46 Precision 500 docs 18.66 50% 1000 docs 11.19 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 39.61 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Monolingual German Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.8090 Minimum 0.1138 First Quartile 0.2867 Second Quartile 0.3860 Third Quartile 0.5097 Interquartile range 0.2230 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.3961 Domain−Specific Monolingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.1730 4 Number of Topics of the Experiment 3.5 Lower Outlier Threshold 0.1138 3 Upper Outlier Threshold 0.8090 2.5 Mean With No Outliers 0.3961 2 1.5 Std With No Outliers 0.1730 1 0.5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Monolingual German Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries UNINEDE4 176-DS 80.90 189-DS 36.54 0.8 177-DS 21.21 190-DS 41.67 178-DS 65.00 191-DS 33.33 0.6 179-DS 58.73 192-DS 29.29 180-DS 66.39 193-DS 26.81 181-DS 36.36 194-DS 11.38 0.4 182-DS 51.96 195-DS 51.65 183-DS 14.01 196-DS 40.45 0.2 184-DS 46.25 197-DS 50.75 Difference 185-DS 12.64 198-DS 38.60 0 186-DS 31.43 199-DS 45.68 187-DS 21.74 200-DS 41.18 −0.2 188-DS 36.42 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 257 xerox 10.2415/DS-MONO-DE-CLEF2007.XEROX.XRCELEDE DS-MONO-DE-CLEF2007 Overall statistics for 25 queries : Priority 4 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language German Relevant 3,689 Topic Fields title, description Relevant retrieved 3,011 Pooled true Geometric Mean Average Precision 0.3034 LexicalEntailment Binary Preference (BPREF) 0.4060 Interploated Recall (%) Precision Averages (%) Domain−Specific Monolingual German Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 88.80 XRCELEDE 10 63.11 90% 20 54.87 80% 30 46.46 40 40.21 70% 50 35.33 60% 60 29.65 Precision 70 22.59 50% 80 14.67 40% 90 5.61 30% 100 1.05 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 34.75 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Monolingual German Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.6106 Minimum 0.1086 First Quartile 0.1758 Second Quartile 0.3195 Third Quartile 0.5010 Interquartile range 0.3252 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.3475 Domain−Specific Monolingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.1715 5 Number of Topics of the Experiment Lower Outlier Threshold 0.1086 4 Upper Outlier Threshold 0.6106 3 Mean With No Outliers 0.3475 2 Std With No Outliers 0.1715 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Monolingual German Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries XRCELEDE 176-DS 28.87 189-DS 16.01 0.8 177-DS 17.57 190-DS 37.91 178-DS 61.06 191-DS 20.35 0.6 179-DS 51.85 192-DS 24.43 180-DS 60.79 193-DS 55.00 181-DS 58.38 194-DS 14.62 0.4 182-DS 30.27 195-DS 46.63 183-DS 17.59 196-DS 47.18 0.2 184-DS 41.89 197-DS 49.52 Difference 185-DS 10.86 198-DS 39.84 0 186-DS 17.07 199-DS 57.19 187-DS 13.28 200-DS 18.63 −0.2 188-DS 31.95 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 258 xerox 10.2415/DS-MONO-DE-CLEF2007.XEROX.XRCELEDE DS-MONO-DE-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Monolingual German Task − Retrieved documents vs Mean Precision 100% 5 docs 66.40 XRCELEDE 10 docs 61.60 90% 15 docs 61.33 80% 20 docs 58.60 30 docs 55.73 70% 100 docs 43.44 60% 200 docs 32.10 Precision 500 docs 19.37 50% 1000 docs 12.04 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 38.04 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Monolingual German Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.6270 Minimum 0.0690 First Quartile 0.2469 Second Quartile 0.3910 Third Quartile 0.5102 Interquartile range 0.2633 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.3804 Domain−Specific Monolingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.1522 5 Number of Topics of the Experiment Lower Outlier Threshold 0.0690 4 Upper Outlier Threshold 0.6270 3 Mean With No Outliers 0.3804 2 Std With No Outliers 0.1522 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Monolingual German Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries XRCELEDE 176-DS 35.96 189-DS 21.15 0.8 177-DS 21.21 190-DS 39.10 178-DS 62.14 191-DS 25.00 0.6 179-DS 52.38 192-DS 30.30 180-DS 62.70 193-DS 54.47 181-DS 52.27 194-DS 15.45 0.4 182-DS 37.01 195-DS 48.35 183-DS 21.66 196-DS 49.44 0.2 184-DS 48.75 197-DS 50.75 Difference 185-DS 6.90 198-DS 43.86 0 186-DS 31.43 199-DS 51.85 187-DS 24.64 200-DS 24.71 −0.2 188-DS 39.40 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 259 xerox 10.2415/DS-MONO-DE-CLEF2007.XEROX.XRCEPRFDE DS-MONO-DE-CLEF2007 Overall statistics for 25 queries : Priority 1 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language German Relevant 3,689 Topic Fields title, description Relevant retrieved 3,234 Pooled true Geometric Mean Average Precision 0.3603 Language Model and PRF Binary Preference (BPREF) 0.4853 Interploated Recall (%) Precision Averages (%) Domain−Specific Monolingual German Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 87.54 XRCEPRFDE 10 73.26 90% 20 66.28 80% 30 60.27 40 53.19 70% 50 46.17 60% 60 39.60 Precision 70 33.49 50% 80 26.28 40% 90 14.83 30% 100 0.49 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 44.65 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Monolingual German Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.8335 Minimum 0.0302 First Quartile 0.1977 Second Quartile 0.5358 Third Quartile 0.5953 Interquartile range 0.3977 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.4465 Domain−Specific Monolingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.2236 5 Number of Topics of the Experiment Lower Outlier Threshold 0.0302 4 Upper Outlier Threshold 0.8335 3 Mean With No Outliers 0.4465 2 Std With No Outliers 0.2236 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Monolingual German Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries XRCEPRFDE 176-DS 83.35 189-DS 17.58 0.8 177-DS 20.95 190-DS 56.02 178-DS 71.81 191-DS 20.21 0.6 179-DS 50.27 192-DS 48.09 180-DS 66.04 193-DS 54.50 181-DS 65.14 194-DS 8.81 0.4 182-DS 65.47 195-DS 55.84 183-DS 53.58 196-DS 47.89 0.2 184-DS 54.99 197-DS 54.00 Difference 185-DS 14.90 198-DS 49.78 0 186-DS 3.02 199-DS 59.39 187-DS 16.19 200-DS 18.43 −0.2 188-DS 59.97 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 260 xerox 10.2415/DS-MONO-DE-CLEF2007.XEROX.XRCEPRFDE DS-MONO-DE-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Monolingual German Task − Retrieved documents vs Mean Precision 100% 5 docs 72.80 XRCEPRFDE 10 docs 70.40 90% 15 docs 69.07 80% 20 docs 67.40 30 docs 64.53 70% 100 docs 51.80 60% 200 docs 38.70 Precision 500 docs 21.86 50% 1000 docs 12.94 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 44.90 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Monolingual German Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.7753 Minimum 0.0571 First Quartile 0.2773 Second Quartile 0.5185 Third Quartile 0.5597 Interquartile range 0.2824 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.4490 Domain−Specific Monolingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.1880 6 Number of Topics of the Experiment Lower Outlier Threshold 0.0571 5 Upper Outlier Threshold 0.7753 4 Mean With No Outliers 0.4490 3 Std With No Outliers 0.1880 2 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Monolingual German Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries XRCEPRFDE 176-DS 77.53 189-DS 21.15 0.8 177-DS 21.21 190-DS 51.92 178-DS 68.57 191-DS 27.78 0.6 179-DS 48.41 192-DS 45.45 180-DS 65.16 193-DS 55.32 181-DS 56.82 194-DS 9.76 0.4 182-DS 61.92 195-DS 55.95 183-DS 56.05 196-DS 50.56 0.2 184-DS 52.50 197-DS 51.74 Difference 185-DS 27.59 198-DS 52.19 0 186-DS 5.71 199-DS 51.85 187-DS 23.19 200-DS 28.24 −0.2 188-DS 55.82 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 261 xerox 10.2415/DS-MONO-DE-CLEF2007.XEROX.XRCEPRFDELE DS-MONO-DE-CLEF2007 Overall statistics for 25 queries : Priority 3 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language German Relevant 3,689 Topic Fields title, description Relevant retrieved 3,389 Pooled true Geometric Mean Average Precision 0.4206 Language Models + PRF + LexEnt Binary Preference (BPREF) 0.5240 Interploated Recall (%) Precision Averages (%) Domain−Specific Monolingual German Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 93.11 XRCEPRFDELE 10 74.70 90% 20 69.39 80% 30 65.22 40 59.41 70% 50 53.67 60% 60 47.29 Precision 70 40.29 50% 80 32.54 40% 90 20.23 30% 100 2.24 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 50.14 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Monolingual German Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.8519 Minimum 0.0430 First Quartile 0.2411 Second Quartile 0.5989 Third Quartile 0.6689 Interquartile range 0.4277 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.5014 Domain−Specific Monolingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.2305 6 Number of Topics of the Experiment Lower Outlier Threshold 0.0430 5 Upper Outlier Threshold 0.8519 4 Mean With No Outliers 0.5014 3 Std With No Outliers 0.2305 2 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Monolingual German Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries XRCEPRFDELE 176-DS 85.19 189-DS 24.24 0.8 177-DS 23.71 190-DS 69.77 178-DS 75.96 191-DS 24.21 0.6 179-DS 50.57 192-DS 63.66 180-DS 68.68 193-DS 67.02 181-DS 63.73 194-DS 16.48 0.4 182-DS 66.84 195-DS 57.77 183-DS 59.89 196-DS 61.60 0.2 184-DS 68.41 197-DS 62.07 Difference 185-DS 14.36 198-DS 56.54 0 186-DS 4.30 199-DS 65.70 187-DS 21.09 200-DS 23.81 −0.2 188-DS 57.84 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 262 xerox 10.2415/DS-MONO-DE-CLEF2007.XEROX.XRCEPRFDELE DS-MONO-DE-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Monolingual German Task − Retrieved documents vs Mean Precision 100% 5 docs 77.60 XRCEPRFDELE 10 docs 70.80 90% 15 docs 71.20 80% 20 docs 69.40 30 docs 65.20 70% 100 docs 55.44 60% 200 docs 41.38 Precision 500 docs 23.88 50% 1000 docs 13.56 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 48.85 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Monolingual German Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.7528 Minimum 0.0857 First Quartile 0.2747 Second Quartile 0.5821 Third Quartile 0.6256 Interquartile range 0.3509 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.4885 Domain−Specific Monolingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.1970 8 Number of Topics of the Experiment 7 Lower Outlier Threshold 0.0857 6 Upper Outlier Threshold 0.7528 5 Mean With No Outliers 0.4885 4 3 Std With No Outliers 0.1970 2 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Monolingual German Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries XRCEPRFDELE 176-DS 75.28 189-DS 25.00 0.8 177-DS 27.27 190-DS 64.10 178-DS 70.71 191-DS 22.22 0.6 179-DS 50.00 192-DS 61.62 180-DS 65.98 193-DS 62.98 181-DS 56.82 194-DS 10.57 0.4 182-DS 60.85 195-DS 58.23 183-DS 62.42 196-DS 60.67 0.2 184-DS 65.00 197-DS 58.21 Difference 185-DS 25.29 198-DS 55.70 0 186-DS 8.57 199-DS 59.26 187-DS 27.54 200-DS 32.94 −0.2 188-DS 54.03 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 263 xerox 10.2415/DS-MONO-DE-CLEF2007.XEROX.XRCEPRFLEDE DS-MONO-DE-CLEF2007 Overall statistics for 25 queries : Priority 2 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language German Relevant 3,689 Topic Fields title, description Relevant retrieved 3,376 Pooled true Geometric Mean Average Precision 0.4230 LexicalEntailment model with PRF Binary Preference (BPREF) 0.5391 Interploated Recall (%) Precision Averages (%) Domain−Specific Monolingual German Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 90.38 XRCEPRFLEDE 10 77.39 90% 20 71.58 80% 30 65.60 40 58.97 70% 50 53.53 60% 60 47.49 Precision 70 39.35 50% 80 30.61 40% 90 20.45 30% 100 1.98 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 50.51 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Monolingual German Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.7707 Minimum 0.0325 First Quartile 0.3966 Second Quartile 0.5676 Third Quartile 0.6674 Interquartile range 0.2707 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.5051 Domain−Specific Monolingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.2149 4 Number of Topics of the Experiment 3.5 Lower Outlier Threshold 0.0325 3 Upper Outlier Threshold 0.7707 2.5 Mean With No Outliers 0.5051 2 1.5 Std With No Outliers 0.2149 1 0.5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Monolingual German Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries XRCEPRFLEDE 176-DS 53.95 189-DS 28.69 0.8 177-DS 20.91 190-DS 73.09 178-DS 77.07 191-DS 11.85 0.6 179-DS 50.37 192-DS 66.54 180-DS 68.86 193-DS 71.43 181-DS 59.32 194-DS 52.13 0.4 182-DS 67.32 195-DS 45.73 183-DS 61.04 196-DS 74.19 0.2 184-DS 55.50 197-DS 65.43 Difference 185-DS 11.31 198-DS 58.14 0 186-DS 3.25 199-DS 61.38 187-DS 25.28 200-DS 43.32 −0.2 188-DS 56.76 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 264 xerox 10.2415/DS-MONO-DE-CLEF2007.XEROX.XRCEPRFLEDE DS-MONO-DE-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Monolingual German Task − Retrieved documents vs Mean Precision 100% 5 docs 76.80 XRCEPRFLEDE 10 docs 74.80 90% 15 docs 72.53 80% 20 docs 71.40 30 docs 68.27 70% 100 docs 56.84 60% 200 docs 42.08 Precision 500 docs 23.82 50% 1000 docs 13.50 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 50.08 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Monolingual German Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.6929 Minimum 0.0571 First Quartile 0.4290 Second Quartile 0.5614 Third Quartile 0.6381 Interquartile range 0.2091 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.5008 Domain−Specific Monolingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.1726 6 Number of Topics of the Experiment Lower Outlier Threshold 0.2222 5 Upper Outlier Threshold 0.6929 4 Mean With No Outliers 0.5193 3 Std With No Outliers 0.1489 2 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Monolingual German Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries XRCEPRFLEDE 176-DS 50.56 189-DS 26.92 0.8 177-DS 28.79 190-DS 69.23 178-DS 69.29 191-DS 22.22 0.6 179-DS 49.21 192-DS 63.64 180-DS 65.16 193-DS 65.53 181-DS 47.73 194-DS 57.72 0.4 182-DS 61.21 195-DS 50.89 183-DS 64.33 196-DS 68.54 0.2 184-DS 56.25 197-DS 59.20 Difference 185-DS 24.14 198-DS 56.14 0 186-DS 5.71 199-DS 56.79 187-DS 30.43 200-DS 47.06 −0.2 188-DS 55.22 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 265 chemnitz 10.2415/DS-MONO-EN-CLEF2007.CHEMNITZ.CUT_DS_MONO_EN_MERGED DS-MONO-EN-CLEF2007 Overall statistics for 25 queries : Priority 3 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 24,999 Source Language English Relevant 4,530 Topic Fields title, description Relevant retrieved 3,381 Pooled true Geometric Mean Average Precision 0.2218 Merged monolingual EN on structured and Binary Preference (BPREF) 0.3292 unstructured indizes Interploated Recall (%) Precision Averages (%) Domain−Specific Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 79.30 CUT_DS_MONO_EN_MERGED 10 52.19 90% 20 45.61 80% 30 41.83 40 36.81 70% 50 32.14 60% 60 27.03 Precision 70 19.75 50% 80 10.32 40% 90 3.73 30% 100 0.59 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 29.85 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Monolingual English Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.6620 Minimum 0.0245 First Quartile 0.1334 Second Quartile 0.2641 Third Quartile 0.4468 Interquartile range 0.3135 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.2985 Domain−Specific Monolingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1907 4 Number of Topics of the Experiment 3.5 Lower Outlier Threshold 0.0245 3 Upper Outlier Threshold 0.6620 2.5 Mean With No Outliers 0.2985 2 1.5 Std With No Outliers 0.1907 1 0.5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries CUT_DS_MONO_EN_MERGED 176-DS 66.20 189-DS 11.40 0.8 177-DS 5.27 190-DS 26.41 178-DS 13.98 191-DS 14.05 0.6 179-DS 38.34 192-DS 26.17 180-DS 64.59 193-DS 49.90 181-DS 32.82 194-DS 21.81 0.4 182-DS 5.29 195-DS 46.96 183-DS 20.69 196-DS 24.99 0.2 184-DS 46.07 197-DS 44.22 Difference 185-DS 2.45 198-DS 38.69 0 186-DS 5.24 199-DS 33.96 187-DS 41.98 200-DS 9.03 −0.2 188-DS 55.83 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 266 chemnitz 10.2415/DS-MONO-EN-CLEF2007.CHEMNITZ.CUT_DS_MONO_EN_MERGED DS-MONO-EN-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Monolingual English Task − Retrieved documents vs Mean Precision 100% 5 docs 56.00 CUT_DS_MONO_EN_MERGED 10 docs 53.60 90% 15 docs 53.87 80% 20 docs 51.20 30 docs 48.53 70% 100 docs 40.92 60% 200 docs 33.38 Precision 500 docs 21.58 50% 1000 docs 13.52 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 34.55 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Monolingual English Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.6497 Minimum 0.0709 First Quartile 0.1842 Second Quartile 0.3380 Third Quartile 0.4936 Interquartile range 0.3094 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.3455 Domain−Specific Monolingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1806 4 Number of Topics of the Experiment 3.5 Lower Outlier Threshold 0.0709 3 Upper Outlier Threshold 0.6497 2.5 Mean With No Outliers 0.3455 2 1.5 Std With No Outliers 0.1806 1 0.5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries CUT_DS_MONO_EN_MERGED 176-DS 62.22 189-DS 11.36 0.8 177-DS 14.04 190-DS 31.13 178-DS 22.56 191-DS 18.75 0.6 179-DS 49.54 192-DS 29.91 180-DS 64.97 193-DS 57.92 181-DS 38.89 194-DS 35.68 0.4 182-DS 10.53 195-DS 51.46 183-DS 31.79 196-DS 24.44 0.2 184-DS 49.03 197-DS 47.67 Difference 185-DS 7.09 198-DS 37.66 0 186-DS 7.55 199-DS 33.80 187-DS 49.30 200-DS 17.42 −0.2 188-DS 59.06 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 267 chemnitz 10.2415/DS-MONO-EN-CLEF2007.CHEMNITZ.CUT_DS_MONO_EN_MERGED_STRUCT DS-MONO-EN-CLEF2007 Overall statistics for 25 queries : Priority 2 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 24,999 Source Language English Relevant 4,530 Topic Fields title, description Relevant retrieved 2,190 Pooled true Geometric Mean Average Precision 0.1124 Merged Monolingual EN on indizes with structure Binary Preference (BPREF) 0.2504 Interploated Recall (%) Precision Averages (%) Domain−Specific Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 75.81 CUT_DS_MONO_EN_MERGED_STRUCT 10 43.14 90% 20 33.90 80% 30 25.61 40 19.95 70% 50 13.41 60% 60 9.69 Precision 70 6.26 50% 80 2.65 40% 90 0.88 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 18.50 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Monolingual English Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.6125 Minimum 0.0123 First Quartile 0.0407 Second Quartile 0.1769 Third Quartile 0.2634 Interquartile range 0.2226 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.1850 Domain−Specific Monolingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1673 8 Number of Topics of the Experiment 7 Lower Outlier Threshold 0.0123 6 Upper Outlier Threshold 0.5632 5 Mean With No Outliers 0.1672 4 3 Std With No Outliers 0.1446 2 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries CUT_DS_MONO_EN_MERGED_STRUCT 176-DS 61.25 189-DS 4.57 0.8 177-DS 1.78 190-DS 25.05 178-DS 3.85 191-DS 8.72 0.6 179-DS 36.61 192-DS 4.14 180-DS 56.32 193-DS 20.90 181-DS 20.64 194-DS 6.49 0.4 182-DS 2.78 195-DS 7.76 183-DS 8.32 196-DS 20.55 0.2 184-DS 30.21 197-DS 23.34 Difference 185-DS 1.23 198-DS 33.12 0 186-DS 3.44 199-DS 24.52 187-DS 35.90 200-DS 3.25 −0.2 188-DS 17.69 −0.4 −0.6 −0.8 −1 176−DS177−DS178−DS179−DS180−DS181−DS182−DS183−DS184−DS185−DS186−DS187−DS188−DS189−DS190−DS191−DS192−DS193−DS194−DS195−DS196−DS197−DS198−DS199−DS200−DS Topic Identifier 268 chemnitz 10.2415/DS-MONO-EN-CLEF2007.CHEMNITZ.CUT_DS_MONO_EN_MERGED_STRUCT DS-MONO-EN-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Monolingual English Task − Retrieved documents vs Mean Precision 100% 5 docs 53.60 CUT_DS_MONO_EN_MERGED_STRUCT 10 docs 50.80 90% 15 docs 48.27 80% 20 docs 46.40 30 docs 42.53 70% 100 docs 34.24 60% 200 docs 23.78 Precision 500 docs 14.08 50% 1000 docs 8.76 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 25.65 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Monolingual English Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.6333 Minimum 0.0472 First Quartile 0.1262 Second Quartile 0.2778 Third Quartile 0.3293 Interquartile range 0.2031 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.2565 Domain−Specific Monolingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1574 4 Number of Topics of the Experiment 3.5 Lower Outlier Threshold 0.0472 3 Upper Outlier Threshold 0.6333 2.5 Mean With No Outliers 0.2565 2 1.5 Std With No Outliers 0.1574 1 0.5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries CUT_DS_MONO_EN_MERGED_STRUCT 176-DS 63.33 189-DS 9.09 0.8 177-DS 8.77 190-DS 29.25 178-DS 7.32 191-DS 17.19 0.6 179-DS 45.87 192-DS 13.08 180-DS 59.09 193-DS 30.15 181-DS 27.78 194-DS 18.06 0.4 182-DS 11.84 195-DS 16.85 183-DS 17.88 196-DS 28.89 0.2 184-DS 34.54 197-DS 30.81 Difference 185-DS 4.72 198-DS 39.33 0 186-DS 11.32 199-DS 32.39 187-DS 42.66 200-DS 12.88 −0.2 188-DS 28.07 −0.4 −0.6 −0.8 −1 176−DS177−DS178−DS179−DS180−DS181−DS182−DS183−DS184−DS185−DS186−DS187−DS188−DS189−DS190−DS191−DS192−DS193−DS194−DS195−DS196−DS197−DS198−DS199−DS200−DS Topic Identifier 269 chemnitz 10.2415/DS-MONO-EN-CLEF2007.CHEMNITZ.CUT_DS_MONO_EN_MERGED_UNSTRUCT DS-MONO-EN-CLEF2007 Overall statistics for 25 queries : Priority 1 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 24,999 Source Language English Relevant 4,530 Topic Fields title, description Relevant retrieved 3,426 Pooled true Geometric Mean Average Precision 0.2208 Monolingual EN on index without structure Binary Preference (BPREF) 0.3351 Interploated Recall (%) Precision Averages (%) Domain−Specific Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 76.98 CUT_DS_MONO_EN_MERGED_UNSTRUCT 10 51.25 90% 20 45.43 80% 30 41.15 40 35.95 70% 50 32.11 60% 60 27.82 Precision 70 20.18 50% 80 10.99 40% 90 3.68 30% 100 0.57 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 29.52 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Monolingual English Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.6313 Minimum 0.0218 First Quartile 0.1307 Second Quartile 0.3028 Third Quartile 0.4049 Interquartile range 0.2742 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.2952 Domain−Specific Monolingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1846 5 Number of Topics of the Experiment Lower Outlier Threshold 0.0218 4 Upper Outlier Threshold 0.6313 3 Mean With No Outliers 0.2952 2 Std With No Outliers 0.1846 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries CUT_DS_MONO_EN_MERGED_UNSTRUCT 176-DS 63.13 189-DS 11.55 0.8 177-DS 7.00 190-DS 24.25 178-DS 14.23 191-DS 13.57 0.6 179-DS 37.67 192-DS 30.28 180-DS 62.80 193-DS 50.07 181-DS 35.82 194-DS 26.48 0.4 182-DS 5.37 195-DS 50.09 183-DS 19.96 196-DS 22.34 0.2 184-DS 39.99 197-DS 41.98 Difference 185-DS 2.18 198-DS 37.60 0 186-DS 4.46 199-DS 32.30 187-DS 39.95 200-DS 9.30 −0.2 188-DS 55.55 −0.4 −0.6 −0.8 −1 176−DS177−DS178−DS179−DS180−DS181−DS182−DS183−DS184−DS185−DS186−DS187−DS188−DS189−DS190−DS191−DS192−DS193−DS194−DS195−DS196−DS197−DS198−DS199−DS200−DS Topic Identifier 270 chemnitz 10.2415/DS-MONO-EN-CLEF2007.CHEMNITZ.CUT_DS_MONO_EN_MERGED_UNSTRUCT DS-MONO-EN-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Monolingual English Task − Retrieved documents vs Mean Precision 100% 5 docs 58.40 CUT_DS_MONO_EN_MERGED_UNSTRUCT 10 docs 52.40 90% 15 docs 52.27 80% 20 docs 50.80 30 docs 47.60 70% 100 docs 40.32 60% 200 docs 33.24 Precision 500 docs 21.72 50% 1000 docs 13.70 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 35.09 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Monolingual English Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.6556 Minimum 0.0566 First Quartile 0.2184 Second Quartile 0.3458 Third Quartile 0.4810 Interquartile range 0.2626 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.3509 Domain−Specific Monolingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1756 4 Number of Topics of the Experiment 3.5 Lower Outlier Threshold 0.0566 3 Upper Outlier Threshold 0.6556 2.5 Mean With No Outliers 0.3509 2 1.5 Std With No Outliers 0.1756 1 0.5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries CUT_DS_MONO_EN_MERGED_UNSTRUCT 176-DS 65.56 189-DS 13.64 0.8 177-DS 12.28 190-DS 29.25 178-DS 22.56 191-DS 23.44 0.6 179-DS 46.79 192-DS 34.58 180-DS 61.76 193-DS 55.31 181-DS 44.44 194-DS 39.21 0.4 182-DS 13.16 195-DS 54.16 183-DS 27.81 196-DS 26.67 0.2 184-DS 48.75 197-DS 46.51 Difference 185-DS 8.66 198-DS 37.24 0 186-DS 5.66 199-DS 33.80 187-DS 47.89 200-DS 19.70 −0.2 188-DS 58.48 −0.4 −0.6 −0.8 −1 176−DS177−DS178−DS179−DS180−DS181−DS182−DS183−DS184−DS185−DS186−DS187−DS188−DS189−DS190−DS191−DS192−DS193−DS194−DS195−DS196−DS197−DS198−DS199−DS200−DS Topic Identifier 271 cheshire 10.2415/DS-MONO-EN-CLEF2007.CHESHIRE.BERKMENCCP15 DS-MONO-EN-CLEF2007 Overall statistics for 25 queries : Priority 1 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language English Relevant 4,530 Topic Fields title, description Relevant retrieved 3,319 Pooled true Geometric Mean Average Precision 0.2163 EN monolingual using Class Cluster Lookup merged Binary Preference (BPREF) 0.3250 with T2FB Interploated Recall (%) Precision Averages (%) Domain−Specific Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 74.16 BERKMENCCP15 10 56.74 90% 20 47.83 80% 30 39.83 40 34.31 70% 50 28.27 60% 60 22.58 Precision 70 15.97 50% 80 8.09 40% 90 2.08 30% 100 0.45 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 28.14 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Monolingual English Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.5751 Minimum 0.0226 First Quartile 0.1636 Second Quartile 0.2035 Third Quartile 0.4510 Interquartile range 0.2874 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.2814 Domain−Specific Monolingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1750 10 Number of Topics of the Experiment Lower Outlier Threshold 0.0226 8 Upper Outlier Threshold 0.5751 6 Mean With No Outliers 0.2814 4 Std With No Outliers 0.1750 2 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries BERKMENCCP15 176-DS 44.97 189-DS 4.52 0.8 177-DS 2.26 190-DS 19.20 178-DS 15.61 191-DS 17.09 0.6 179-DS 43.93 192-DS 17.16 180-DS 53.87 193-DS 51.88 181-DS 20.35 194-DS 18.38 0.4 182-DS 15.92 195-DS 57.51 183-DS 38.84 196-DS 18.69 0.2 184-DS 26.39 197-DS 16.35 Difference 185-DS 22.48 198-DS 54.19 0 186-DS 3.65 199-DS 25.55 187-DS 45.51 200-DS 16.37 −0.2 188-DS 52.87 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 272 cheshire 10.2415/DS-MONO-EN-CLEF2007.CHESHIRE.BERKMENCCP15 DS-MONO-EN-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Monolingual English Task − Retrieved documents vs Mean Precision 100% 5 docs 55.20 BERKMENCCP15 10 docs 54.40 90% 15 docs 52.53 80% 20 docs 51.40 30 docs 51.60 70% 100 docs 42.24 60% 200 docs 33.20 Precision 500 docs 21.02 50% 1000 docs 13.28 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 33.69 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Monolingual English Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.5978 Minimum 0.0175 First Quartile 0.2222 Second Quartile 0.3023 Third Quartile 0.4966 Interquartile range 0.2743 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.3369 Domain−Specific Monolingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1614 6 Number of Topics of the Experiment Lower Outlier Threshold 0.0175 5 Upper Outlier Threshold 0.5978 4 Mean With No Outliers 0.3369 3 Std With No Outliers 0.1614 2 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries BERKMENCCP15 176-DS 50.00 189-DS 9.09 0.8 177-DS 1.75 190-DS 21.70 178-DS 21.95 191-DS 23.44 0.6 179-DS 49.54 192-DS 24.30 180-DS 53.74 193-DS 54.23 181-DS 22.22 194-DS 28.19 0.4 182-DS 25.00 195-DS 59.78 183-DS 43.71 196-DS 22.22 0.2 184-DS 36.49 197-DS 30.23 Difference 185-DS 37.80 198-DS 53.97 0 186-DS 9.43 199-DS 32.39 187-DS 47.48 200-DS 29.55 −0.2 188-DS 54.09 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 273 cheshire 10.2415/DS-MONO-EN-CLEF2007.CHESHIRE.BERKMENTHP15 DS-MONO-EN-CLEF2007 Overall statistics for 25 queries : Priority 2 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language English Relevant 4,530 Topic Fields title, description Relevant retrieved 3,307 Pooled true Geometric Mean Average Precision 0.2151 EN monolingual using Thesaurus Lookup merged with Binary Preference (BPREF) 0.3151 T2FB Interploated Recall (%) Precision Averages (%) Domain−Specific Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 77.25 BERKMENTHP15 10 55.76 90% 20 46.77 80% 30 38.93 40 32.83 70% 50 27.32 60% 60 21.64 Precision 70 15.20 50% 80 5.53 40% 90 1.29 30% 100 0.46 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 27.33 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Monolingual English Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.5718 Minimum 0.0264 First Quartile 0.1645 Second Quartile 0.2156 Third Quartile 0.3992 Interquartile range 0.2348 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.2733 Domain−Specific Monolingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1651 8 Number of Topics of the Experiment 7 Lower Outlier Threshold 0.0264 6 Upper Outlier Threshold 0.5718 5 Mean With No Outliers 0.2733 4 3 Std With No Outliers 0.1651 2 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries BERKMENTHP15 176-DS 40.70 189-DS 4.75 0.8 177-DS 2.64 190-DS 17.81 178-DS 15.38 191-DS 13.46 0.6 179-DS 39.67 192-DS 16.80 180-DS 54.44 193-DS 52.42 181-DS 23.87 194-DS 19.91 0.4 182-DS 14.58 195-DS 57.18 183-DS 39.61 196-DS 19.34 0.2 184-DS 29.06 197-DS 18.25 Difference 185-DS 21.56 198-DS 52.24 0 186-DS 4.42 199-DS 24.00 187-DS 47.23 200-DS 17.39 −0.2 188-DS 36.44 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 274 cheshire 10.2415/DS-MONO-EN-CLEF2007.CHESHIRE.BERKMENTHP15 DS-MONO-EN-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Monolingual English Task − Retrieved documents vs Mean Precision 100% 5 docs 55.20 BERKMENTHP15 10 docs 53.60 90% 15 docs 51.47 80% 20 docs 51.20 30 docs 50.80 70% 100 docs 41.16 60% 200 docs 32.70 Precision 500 docs 20.67 50% 1000 docs 13.23 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 33.10 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Monolingual English Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.5888 Minimum 0.0351 First Quartile 0.2204 Second Quartile 0.3140 Third Quartile 0.4538 Interquartile range 0.2334 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.3310 Domain−Specific Monolingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1530 5 Number of Topics of the Experiment Lower Outlier Threshold 0.0351 4 Upper Outlier Threshold 0.5888 3 Mean With No Outliers 0.3310 2 Std With No Outliers 0.1530 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries BERKMENTHP15 176-DS 46.67 189-DS 13.64 0.8 177-DS 3.51 190-DS 17.92 178-DS 23.17 191-DS 20.31 0.6 179-DS 44.95 192-DS 21.50 180-DS 55.61 193-DS 53.80 181-DS 27.78 194-DS 32.16 0.4 182-DS 23.68 195-DS 58.88 183-DS 43.71 196-DS 22.22 0.2 184-DS 38.72 197-DS 31.40 Difference 185-DS 35.43 198-DS 53.56 0 186-DS 7.55 199-DS 30.99 187-DS 50.50 200-DS 30.30 −0.2 188-DS 39.47 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 275 moscow 10.2415/DS-MONO-EN-CLEF2007.MOSCOW.CIRDSMONOEN DS-MONO-EN-CLEF2007 Overall statistics for 25 queries : Priority 1 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language English Relevant 4,530 Topic Fields title, description Relevant retrieved 2,631 Pooled true Geometric Mean Average Precision 0.1501 word pairs in window=5 Binary Preference (BPREF) 0.2619 Interploated Recall (%) Precision Averages (%) Domain−Specific Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 79.80 CIRDSMONOEN 10 48.99 90% 20 35.95 80% 30 28.69 40 22.33 70% 50 17.22 60% 60 10.25 Precision 70 3.18 50% 80 0.32 40% 90 0.08 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 18.91 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Monolingual English Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.5583 Minimum 0.0490 First Quartile 0.0830 Second Quartile 0.1508 Third Quartile 0.2718 Interquartile range 0.1888 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.1891 Domain−Specific Monolingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1340 10 Number of Topics of the Experiment Lower Outlier Threshold 0.0490 8 Upper Outlier Threshold 0.4285 6 Mean With No Outliers 0.1738 4 Std With No Outliers 0.1121 2 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries CIRDSMONOEN 176-DS 30.60 189-DS 15.09 0.8 177-DS 13.30 190-DS 6.42 178-DS 9.43 191-DS 8.40 0.6 179-DS 27.53 192-DS 8.38 180-DS 42.85 193-DS 34.34 181-DS 7.44 194-DS 21.40 0.4 182-DS 8.06 195-DS 39.38 183-DS 17.89 196-DS 7.35 0.2 184-DS 27.07 197-DS 15.08 Difference 185-DS 4.90 198-DS 18.97 0 186-DS 5.21 199-DS 9.36 187-DS 23.97 200-DS 14.59 −0.2 188-DS 55.83 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 276 moscow 10.2415/DS-MONO-EN-CLEF2007.MOSCOW.CIRDSMONOEN DS-MONO-EN-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Monolingual English Task − Retrieved documents vs Mean Precision 100% 5 docs 50.40 CIRDSMONOEN 10 docs 49.20 90% 15 docs 48.00 80% 20 docs 45.80 30 docs 42.53 70% 100 docs 34.00 60% 200 docs 26.34 Precision 500 docs 16.82 50% 1000 docs 10.52 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 27.11 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Monolingual English Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.5643 Minimum 0.0755 First Quartile 0.1593 Second Quartile 0.2197 Third Quartile 0.3905 Interquartile range 0.2312 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.2711 Domain−Specific Monolingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1416 8 Number of Topics of the Experiment 7 Lower Outlier Threshold 0.0755 6 Upper Outlier Threshold 0.5643 5 Mean With No Outliers 0.2711 4 3 Std With No Outliers 0.1416 2 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries CIRDSMONOEN 176-DS 44.44 189-DS 20.45 0.8 177-DS 17.54 190-DS 16.04 178-DS 17.07 191-DS 15.62 0.6 179-DS 37.61 192-DS 19.63 180-DS 49.73 193-DS 41.21 181-DS 11.11 194-DS 39.21 0.4 182-DS 10.53 195-DS 49.21 183-DS 30.46 196-DS 15.56 0.2 184-DS 39.00 197-DS 25.00 Difference 185-DS 9.45 198-DS 29.29 0 186-DS 7.55 199-DS 19.72 187-DS 34.00 200-DS 21.97 −0.2 188-DS 56.43 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 277 moscow 10.2415/DS-MONO-EN-CLEF2007.MOSCOW.CIRDSMONOEN2 DS-MONO-EN-CLEF2007 Overall statistics for 25 queries : Priority 2 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language English Relevant 4,530 Topic Fields title, description Relevant retrieved 2,644 Pooled true Geometric Mean Average Precision 0.1539 tfidf+pairs Binary Preference (BPREF) 0.2671 Interploated Recall (%) Precision Averages (%) Domain−Specific Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 83.26 CIRDSMONOEN2 10 50.27 90% 20 36.16 80% 30 29.65 40 22.99 70% 50 18.53 60% 60 10.85 Precision 70 3.35 50% 80 1.49 40% 90 0.11 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 19.50 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Monolingual English Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.5615 Minimum 0.0438 First Quartile 0.0864 Second Quartile 0.1607 Third Quartile 0.2830 Interquartile range 0.1966 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.1950 Domain−Specific Monolingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1361 10 Number of Topics of the Experiment Lower Outlier Threshold 0.0438 8 Upper Outlier Threshold 0.5615 6 Mean With No Outliers 0.1950 4 Std With No Outliers 0.1361 2 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries CIRDSMONOEN2 176-DS 31.51 189-DS 16.07 0.8 177-DS 11.95 190-DS 6.87 178-DS 9.13 191-DS 8.91 0.6 179-DS 27.23 192-DS 8.87 180-DS 43.11 193-DS 32.28 181-DS 7.24 194-DS 22.42 0.4 182-DS 7.97 195-DS 39.49 183-DS 19.23 196-DS 7.34 0.2 184-DS 32.86 197-DS 17.51 Difference 185-DS 4.38 198-DS 23.59 0 186-DS 5.30 199-DS 9.50 187-DS 24.18 200-DS 14.36 −0.2 188-DS 56.15 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 278 moscow 10.2415/DS-MONO-EN-CLEF2007.MOSCOW.CIRDSMONOEN2 DS-MONO-EN-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Monolingual English Task − Retrieved documents vs Mean Precision 100% 5 docs 52.00 CIRDSMONOEN2 10 docs 50.40 90% 15 docs 47.47 80% 20 docs 46.40 30 docs 41.73 70% 100 docs 35.36 60% 200 docs 27.44 Precision 500 docs 17.34 50% 1000 docs 10.58 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 27.69 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Monolingual English Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.5585 Minimum 0.0755 First Quartile 0.1629 Second Quartile 0.2500 Third Quartile 0.3762 Interquartile range 0.2133 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.2769 Domain−Specific Monolingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1414 8 Number of Topics of the Experiment 7 Lower Outlier Threshold 0.0755 6 Upper Outlier Threshold 0.5585 5 Mean With No Outliers 0.2769 4 3 Std With No Outliers 0.1414 2 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries CIRDSMONOEN2 176-DS 48.89 189-DS 25.00 0.8 177-DS 15.79 190-DS 16.98 178-DS 16.46 191-DS 17.19 0.6 179-DS 36.70 192-DS 19.63 180-DS 50.80 193-DS 41.21 181-DS 11.11 194-DS 36.56 0.4 182-DS 13.16 195-DS 48.99 183-DS 30.46 196-DS 15.56 0.2 184-DS 40.39 197-DS 26.16 Difference 185-DS 10.24 198-DS 30.54 0 186-DS 7.55 199-DS 19.72 187-DS 34.61 200-DS 22.73 −0.2 188-DS 55.85 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 279 unine 10.2415/DS-MONO-EN-CLEF2007.UNINE.UNINEEN1 DS-MONO-EN-CLEF2007 Overall statistics for 25 queries : Priority 1 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language English Relevant 4,530 Topic Fields title, description Relevant retrieved 3,622 Pooled true Geometric Mean Average Precision 0.2774 GL2 & PB2 & InB2 Binary Preference (BPREF) 0.3801 Interploated Recall (%) Precision Averages (%) Domain−Specific Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 81.33 UNINEEN1 10 58.39 90% 20 51.48 80% 30 47.43 40 43.02 70% 50 38.48 60% 60 33.00 Precision 70 26.56 50% 80 16.10 40% 90 5.42 30% 100 0.68 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 34.72 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Monolingual English Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.6920 Minimum 0.0448 First Quartile 0.1686 Second Quartile 0.3137 Third Quartile 0.5526 Interquartile range 0.3839 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.3472 Domain−Specific Monolingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.2054 4 Number of Topics of the Experiment 3.5 Lower Outlier Threshold 0.0448 3 Upper Outlier Threshold 0.6920 2.5 Mean With No Outliers 0.3472 2 1.5 Std With No Outliers 0.2054 1 0.5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries UNINEEN1 176-DS 69.20 189-DS 19.53 0.8 177-DS 9.24 190-DS 20.42 178-DS 14.45 191-DS 29.41 0.6 179-DS 41.34 192-DS 18.93 180-DS 54.87 193-DS 58.79 181-DS 37.59 194-DS 42.19 0.4 182-DS 15.33 195-DS 63.56 183-DS 31.37 196-DS 17.37 0.2 184-DS 33.52 197-DS 56.41 Difference 185-DS 7.56 198-DS 53.51 0 186-DS 4.48 199-DS 31.37 187-DS 61.06 200-DS 12.30 −0.2 188-DS 64.11 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 280 unine 10.2415/DS-MONO-EN-CLEF2007.UNINE.UNINEEN1 DS-MONO-EN-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Monolingual English Task − Retrieved documents vs Mean Precision 100% 5 docs 61.60 UNINEEN1 10 docs 56.40 90% 15 docs 54.67 80% 20 docs 53.80 30 docs 51.33 70% 100 docs 45.00 60% 200 docs 37.46 Precision 500 docs 24.21 50% 1000 docs 14.49 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 39.14 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Monolingual English Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.6778 Minimum 0.0943 First Quartile 0.2481 Second Quartile 0.3333 Third Quartile 0.5780 Interquartile range 0.3298 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.3914 Domain−Specific Monolingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1860 5 Number of Topics of the Experiment Lower Outlier Threshold 0.0943 4 Upper Outlier Threshold 0.6778 3 Mean With No Outliers 0.3914 2 Std With No Outliers 0.1860 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries UNINEEN1 176-DS 67.78 189-DS 25.00 0.8 177-DS 21.05 190-DS 25.47 178-DS 28.05 191-DS 31.25 0.6 179-DS 47.71 192-DS 29.91 180-DS 57.49 193-DS 59.22 181-DS 33.33 194-DS 55.07 0.4 182-DS 18.42 195-DS 65.84 183-DS 35.76 196-DS 15.56 0.2 184-DS 46.52 197-DS 58.72 Difference 185-DS 11.81 198-DS 56.07 0 186-DS 9.43 199-DS 30.99 187-DS 63.58 200-DS 24.24 −0.2 188-DS 60.23 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 281 unine 10.2415/DS-MONO-EN-CLEF2007.UNINE.UNINEEN2 DS-MONO-EN-CLEF2007 Overall statistics for 25 queries : Priority 3 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language English Relevant 4,530 Topic Fields title, description Relevant retrieved 3,350 Pooled true Geometric Mean Average Precision 0.2351 LM & PB2 & PL2 Binary Preference (BPREF) 0.3518 Interploated Recall (%) Precision Averages (%) Domain−Specific Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 80.41 UNINEEN2 10 56.10 90% 20 46.66 80% 30 41.21 40 36.57 70% 50 32.15 60% 60 26.83 Precision 70 18.71 50% 80 11.48 40% 90 5.34 30% 100 0.70 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 30.38 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Monolingual English Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.5891 Minimum 0.0395 First Quartile 0.1557 Second Quartile 0.2566 Third Quartile 0.4655 Interquartile range 0.3099 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.3038 Domain−Specific Monolingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1856 4 Number of Topics of the Experiment 3.5 Lower Outlier Threshold 0.0395 3 Upper Outlier Threshold 0.5891 2.5 Mean With No Outliers 0.3038 2 1.5 Std With No Outliers 0.1856 1 0.5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries UNINEEN2 176-DS 58.91 189-DS 4.71 0.8 177-DS 9.27 190-DS 22.94 178-DS 15.19 191-DS 22.66 0.6 179-DS 46.29 192-DS 23.67 180-DS 57.62 193-DS 45.98 181-DS 45.62 194-DS 31.89 0.4 182-DS 8.34 195-DS 54.66 183-DS 29.76 196-DS 15.69 0.2 184-DS 20.11 197-DS 55.09 Difference 185-DS 3.95 198-DS 47.36 0 186-DS 5.89 199-DS 25.66 187-DS 35.56 200-DS 16.77 −0.2 188-DS 56.01 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 282 unine 10.2415/DS-MONO-EN-CLEF2007.UNINE.UNINEEN2 DS-MONO-EN-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Monolingual English Task − Retrieved documents vs Mean Precision 100% 5 docs 60.00 UNINEEN2 10 docs 56.40 90% 15 docs 55.47 80% 20 docs 54.00 30 docs 49.07 70% 100 docs 41.56 60% 200 docs 33.74 Precision 500 docs 21.45 50% 1000 docs 13.40 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 33.75 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Monolingual English Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.5615 Minimum 0.0455 First Quartile 0.1867 Second Quartile 0.3092 Third Quartile 0.5111 Interquartile range 0.3245 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.3375 Domain−Specific Monolingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1723 5 Number of Topics of the Experiment Lower Outlier Threshold 0.0455 4 Upper Outlier Threshold 0.5615 3 Mean With No Outliers 0.3375 2 Std With No Outliers 0.1723 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries UNINEEN2 176-DS 55.56 189-DS 4.55 0.8 177-DS 15.79 190-DS 22.64 178-DS 26.83 191-DS 18.75 0.6 179-DS 54.13 192-DS 27.10 180-DS 56.15 193-DS 50.11 181-DS 44.44 194-DS 40.97 0.4 182-DS 18.42 195-DS 54.83 183-DS 35.76 196-DS 17.78 0.2 184-DS 30.92 197-DS 54.65 Difference 185-DS 8.66 198-DS 48.95 0 186-DS 5.66 199-DS 23.94 187-DS 44.06 200-DS 28.79 −0.2 188-DS 54.39 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 283 unine 10.2415/DS-MONO-EN-CLEF2007.UNINE.UNINEEN3 DS-MONO-EN-CLEF2007 Overall statistics for 25 queries : Priority 4 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language English Relevant 4,530 Topic Fields title, description Relevant retrieved 3,587 Pooled true Geometric Mean Average Precision 0.2716 PL2 & InB2 Binary Preference (BPREF) 0.3741 Interploated Recall (%) Precision Averages (%) Domain−Specific Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 80.96 UNINEEN3 10 57.11 90% 20 49.72 80% 30 45.76 40 42.05 70% 50 37.99 60% 60 32.57 Precision 70 25.93 50% 80 16.43 40% 90 6.47 30% 100 1.07 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 33.99 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Monolingual English Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.6767 Minimum 0.0514 First Quartile 0.1637 Second Quartile 0.2919 Third Quartile 0.5542 Interquartile range 0.3904 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.3399 Domain−Specific Monolingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.2008 3 Number of Topics of the Experiment Lower Outlier Threshold 0.0514 2.5 Upper Outlier Threshold 0.6767 2 Mean With No Outliers 0.3399 1.5 Std With No Outliers 0.2008 1 0.5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries UNINEEN3 176-DS 67.67 189-DS 16.51 0.8 177-DS 9.34 190-DS 20.08 178-DS 15.96 191-DS 32.16 0.6 179-DS 41.71 192-DS 20.87 180-DS 58.57 193-DS 56.66 181-DS 38.68 194-DS 37.39 0.4 182-DS 14.47 195-DS 60.70 183-DS 27.94 196-DS 20.84 0.2 184-DS 26.82 197-DS 55.00 Difference 185-DS 5.16 198-DS 54.23 0 186-DS 5.14 199-DS 29.19 187-DS 58.94 200-DS 13.55 −0.2 188-DS 62.15 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 284 unine 10.2415/DS-MONO-EN-CLEF2007.UNINE.UNINEEN3 DS-MONO-EN-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Monolingual English Task − Retrieved documents vs Mean Precision 100% 5 docs 59.20 UNINEEN3 10 docs 55.60 90% 15 docs 54.13 80% 20 docs 54.00 30 docs 51.87 70% 100 docs 44.40 60% 200 docs 36.50 Precision 500 docs 23.56 50% 1000 docs 14.35 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 38.65 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Monolingual English Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.6556 Minimum 0.0945 First Quartile 0.2470 Second Quartile 0.3510 Third Quartile 0.5838 Interquartile range 0.3368 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.3865 Domain−Specific Monolingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1787 5 Number of Topics of the Experiment Lower Outlier Threshold 0.0945 4 Upper Outlier Threshold 0.6556 3 Mean With No Outliers 0.3865 2 Std With No Outliers 0.1787 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries UNINEEN3 176-DS 65.56 189-DS 18.18 0.8 177-DS 21.05 190-DS 25.47 178-DS 27.44 191-DS 37.50 0.6 179-DS 49.54 192-DS 28.04 180-DS 59.09 193-DS 59.44 181-DS 33.33 194-DS 47.58 0.4 182-DS 22.37 195-DS 62.70 183-DS 35.10 196-DS 22.22 0.2 184-DS 39.83 197-DS 58.14 Difference 185-DS 9.45 198-DS 56.07 0 186-DS 11.32 199-DS 28.17 187-DS 62.58 200-DS 25.76 −0.2 188-DS 60.23 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 285 unine 10.2415/DS-MONO-EN-CLEF2007.UNINE.UNINEEN4 DS-MONO-EN-CLEF2007 Overall statistics for 25 queries : Priority 2 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language English Relevant 4,530 Topic Fields title, description, narrative Relevant retrieved 3,576 Pooled true Geometric Mean Average Precision 0.2987 GL2 & PB2 & InB2 Binary Preference (BPREF) 0.4002 Interploated Recall (%) Precision Averages (%) Domain−Specific Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 86.47 UNINEEN4 10 61.07 90% 20 54.99 80% 30 48.63 40 43.36 70% 50 37.16 60% 60 31.48 Precision 70 24.67 50% 80 14.99 40% 90 4.95 30% 100 0.64 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 35.34 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Monolingual English Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.7119 Minimum 0.0636 First Quartile 0.2075 Second Quartile 0.3783 Third Quartile 0.5046 Interquartile range 0.2971 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.3534 Domain−Specific Monolingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1838 4 Number of Topics of the Experiment 3.5 Lower Outlier Threshold 0.0636 3 Upper Outlier Threshold 0.7119 2.5 Mean With No Outliers 0.3534 2 1.5 Std With No Outliers 0.1838 1 0.5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries UNINEEN4 176-DS 71.19 189-DS 22.17 0.8 177-DS 8.66 190-DS 22.13 178-DS 13.56 191-DS 38.12 0.6 179-DS 46.62 192-DS 21.31 180-DS 56.02 193-DS 54.62 181-DS 41.40 194-DS 46.09 0.4 182-DS 13.63 195-DS 52.49 183-DS 37.83 196-DS 19.05 0.2 184-DS 27.06 197-DS 49.78 Difference 185-DS 6.36 198-DS 58.04 0 186-DS 24.20 199-DS 27.04 187-DS 49.34 200-DS 16.85 −0.2 188-DS 59.89 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 286 unine 10.2415/DS-MONO-EN-CLEF2007.UNINE.UNINEEN4 DS-MONO-EN-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Monolingual English Task − Retrieved documents vs Mean Precision 100% 5 docs 61.60 UNINEEN4 10 docs 61.60 90% 15 docs 60.00 80% 20 docs 58.40 30 docs 54.80 70% 100 docs 46.72 60% 200 docs 36.18 Precision 500 docs 22.96 50% 1000 docs 14.30 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 39.54 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Monolingual English Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.7000 Minimum 0.1228 First Quartile 0.2534 Second Quartile 0.4371 Third Quartile 0.5412 Interquartile range 0.2878 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.3954 Domain−Specific Monolingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1662 5 Number of Topics of the Experiment Lower Outlier Threshold 0.1228 4 Upper Outlier Threshold 0.7000 3 Mean With No Outliers 0.3954 2 Std With No Outliers 0.1662 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries UNINEEN4 176-DS 70.00 189-DS 29.55 0.8 177-DS 12.28 190-DS 24.53 178-DS 25.61 191-DS 45.31 0.6 179-DS 51.38 192-DS 22.43 180-DS 54.28 193-DS 58.13 181-DS 44.44 194-DS 52.86 0.4 182-DS 22.37 195-DS 55.28 183-DS 43.71 196-DS 15.56 0.2 184-DS 41.78 197-DS 54.07 Difference 185-DS 13.39 198-DS 56.90 0 186-DS 26.42 199-DS 29.58 187-DS 52.52 200-DS 28.79 −0.2 188-DS 57.31 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 287 xerox 10.2415/DS-MONO-EN-CLEF2007.XEROX.XRCELEEN DS-MONO-EN-CLEF2007 Overall statistics for 25 queries : Priority 2 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language English Relevant 4,530 Topic Fields title, description Relevant retrieved 3,225 Pooled true Geometric Mean Average Precision 0.2115 LexicalEntailment Binary Preference (BPREF) 0.3164 Interploated Recall (%) Precision Averages (%) Domain−Specific Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 83.19 XRCELEEN 10 53.53 90% 20 42.83 80% 30 37.06 40 33.12 70% 50 28.97 60% 60 23.25 Precision 70 14.76 50% 80 7.05 40% 90 2.12 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 27.22 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Monolingual English Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.5694 Minimum 0.0468 First Quartile 0.0996 Second Quartile 0.2500 Third Quartile 0.4149 Interquartile range 0.3154 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.2722 Domain−Specific Monolingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1703 5 Number of Topics of the Experiment Lower Outlier Threshold 0.0468 4 Upper Outlier Threshold 0.5694 3 Mean With No Outliers 0.2722 2 Std With No Outliers 0.1703 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries XRCELEEN 176-DS 25.70 189-DS 10.16 0.8 177-DS 9.35 190-DS 16.56 178-DS 5.32 191-DS 8.90 0.6 179-DS 47.82 192-DS 21.48 180-DS 53.94 193-DS 42.69 181-DS 40.02 194-DS 43.25 0.4 182-DS 6.84 195-DS 54.17 183-DS 39.66 196-DS 22.52 0.2 184-DS 24.59 197-DS 27.21 Difference 185-DS 4.68 198-DS 41.09 0 186-DS 7.23 199-DS 25.00 187-DS 33.44 200-DS 11.84 −0.2 188-DS 56.94 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 288 xerox 10.2415/DS-MONO-EN-CLEF2007.XEROX.XRCELEEN DS-MONO-EN-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Monolingual English Task − Retrieved documents vs Mean Precision 100% 5 docs 52.00 XRCELEEN 10 docs 50.00 90% 15 docs 51.47 80% 20 docs 49.80 30 docs 48.80 70% 100 docs 38.80 60% 200 docs 31.90 Precision 500 docs 20.37 50% 1000 docs 12.90 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 32.28 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Monolingual English Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.5910 Minimum 0.0787 First Quartile 0.1706 Second Quartile 0.3099 Third Quartile 0.4803 Interquartile range 0.3097 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.3228 Domain−Specific Monolingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1679 4 Number of Topics of the Experiment 3.5 Lower Outlier Threshold 0.0787 3 Upper Outlier Threshold 0.5910 2.5 Mean With No Outliers 0.3228 2 1.5 Std With No Outliers 0.1679 1 0.5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries XRCELEEN 176-DS 27.78 189-DS 9.09 0.8 177-DS 17.54 190-DS 21.70 178-DS 14.63 191-DS 15.62 0.6 179-DS 51.38 192-DS 28.04 180-DS 54.28 193-DS 49.02 181-DS 38.89 194-DS 53.74 0.4 182-DS 9.21 195-DS 59.10 183-DS 43.71 196-DS 28.89 0.2 184-DS 32.03 197-DS 33.72 Difference 185-DS 7.87 198-DS 47.70 0 186-DS 9.43 199-DS 30.99 187-DS 44.06 200-DS 21.21 −0.2 188-DS 57.31 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 289 xerox 10.2415/DS-MONO-EN-CLEF2007.XEROX.XRCEPRFEN DS-MONO-EN-CLEF2007 Overall statistics for 25 queries : Priority 1 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language English Relevant 4,530 Topic Fields title, description Relevant retrieved 3,259 Pooled true Geometric Mean Average Precision 0.2140 Language Model and PRF Binary Preference (BPREF) 0.3311 Interploated Recall (%) Precision Averages (%) Domain−Specific Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 83.56 XRCEPRFEN 10 51.87 90% 20 46.30 80% 30 40.64 40 36.07 70% 50 31.34 60% 60 24.89 Precision 70 17.93 50% 80 10.65 40% 90 4.85 30% 100 0.62 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 29.34 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Monolingual English Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.6142 Minimum 0.0137 First Quartile 0.1139 Second Quartile 0.2811 Third Quartile 0.4462 Interquartile range 0.3323 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.2934 Domain−Specific Monolingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1883 5 Number of Topics of the Experiment Lower Outlier Threshold 0.0137 4 Upper Outlier Threshold 0.6142 3 Mean With No Outliers 0.2934 2 Std With No Outliers 0.1883 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries XRCEPRFEN 176-DS 52.78 189-DS 6.25 0.8 177-DS 1.37 190-DS 22.09 178-DS 8.62 191-DS 43.01 0.6 179-DS 39.18 192-DS 25.05 180-DS 59.56 193-DS 47.55 181-DS 36.27 194-DS 14.86 0.4 182-DS 5.75 195-DS 61.42 183-DS 30.87 196-DS 15.66 0.2 184-DS 28.11 197-DS 40.37 Difference 185-DS 6.48 198-DS 50.27 0 186-DS 8.74 199-DS 21.31 187-DS 52.03 200-DS 12.27 −0.2 188-DS 43.64 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 290 xerox 10.2415/DS-MONO-EN-CLEF2007.XEROX.XRCEPRFEN DS-MONO-EN-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Monolingual English Task − Retrieved documents vs Mean Precision 100% 5 docs 59.20 XRCEPRFEN 10 docs 55.20 90% 15 docs 52.80 80% 20 docs 51.00 30 docs 48.67 70% 100 docs 41.04 60% 200 docs 33.72 Precision 500 docs 21.36 50% 1000 docs 13.04 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 34.28 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Monolingual English Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.6067 Minimum 0.0351 First Quartile 0.1852 Second Quartile 0.3983 Third Quartile 0.4948 Interquartile range 0.3096 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.3428 Domain−Specific Monolingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1889 4 Number of Topics of the Experiment 3.5 Lower Outlier Threshold 0.0351 3 Upper Outlier Threshold 0.6067 2.5 Mean With No Outliers 0.3428 2 1.5 Std With No Outliers 0.1889 1 0.5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries XRCEPRFEN 176-DS 55.56 189-DS 4.55 0.8 177-DS 3.51 190-DS 26.42 178-DS 19.51 191-DS 48.44 0.6 179-DS 48.62 192-DS 29.91 180-DS 60.43 193-DS 52.06 181-DS 44.44 194-DS 28.19 0.4 182-DS 6.58 195-DS 60.67 183-DS 40.40 196-DS 15.56 0.2 184-DS 39.83 197-DS 47.09 Difference 185-DS 13.39 198-DS 53.56 0 186-DS 9.43 199-DS 22.54 187-DS 55.94 200-DS 21.97 −0.2 188-DS 48.54 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 291 xerox 10.2415/DS-MONO-EN-CLEF2007.XEROX.XRCEPRFENLE DS-MONO-EN-CLEF2007 Overall statistics for 25 queries : Priority 3 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language English Relevant 4,530 Topic Fields title, description Relevant retrieved 3,460 Pooled true Geometric Mean Average Precision 0.2390 PRF Lexical Entailment Binary Preference (BPREF) 0.3643 Interploated Recall (%) Precision Averages (%) Domain−Specific Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 84.59 XRCEPRFENLE 10 57.32 90% 20 50.70 80% 30 44.38 40 38.80 70% 50 33.96 60% 60 28.78 Precision 70 21.37 50% 80 13.63 40% 90 4.24 30% 100 1.09 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 32.37 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Monolingual English Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.5946 Minimum 0.0269 First Quartile 0.1223 Second Quartile 0.3895 Third Quartile 0.4762 Interquartile range 0.3539 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.3237 Domain−Specific Monolingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1890 4 Number of Topics of the Experiment 3.5 Lower Outlier Threshold 0.0269 3 Upper Outlier Threshold 0.5946 2.5 Mean With No Outliers 0.3237 2 1.5 Std With No Outliers 0.1890 1 0.5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries XRCEPRFENLE 176-DS 51.46 189-DS 3.23 0.8 177-DS 2.69 190-DS 22.53 178-DS 8.44 191-DS 38.95 0.6 179-DS 42.58 192-DS 33.06 180-DS 59.46 193-DS 45.55 181-DS 42.75 194-DS 36.26 0.4 182-DS 7.17 195-DS 57.41 183-DS 46.46 196-DS 20.58 0.2 184-DS 39.48 197-DS 44.56 Difference 185-DS 8.13 198-DS 52.68 0 186-DS 5.86 199-DS 24.16 187-DS 51.10 200-DS 13.49 −0.2 188-DS 51.09 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 292 xerox 10.2415/DS-MONO-EN-CLEF2007.XEROX.XRCEPRFENLE DS-MONO-EN-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Monolingual English Task − Retrieved documents vs Mean Precision 100% 5 docs 56.00 XRCEPRFENLE 10 docs 57.60 90% 15 docs 55.20 80% 20 docs 54.40 30 docs 51.20 70% 100 docs 44.00 60% 200 docs 35.44 Precision 500 docs 22.49 50% 1000 docs 13.84 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 36.03 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Monolingual English Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.6090 Minimum 0.0175 First Quartile 0.2234 Second Quartile 0.4401 Third Quartile 0.5034 Interquartile range 0.2800 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.3603 Domain−Specific Monolingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1827 4 Number of Topics of the Experiment 3.5 Lower Outlier Threshold 0.0175 3 Upper Outlier Threshold 0.6090 2.5 Mean With No Outliers 0.3603 2 1.5 Std With No Outliers 0.1827 1 0.5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries XRCEPRFENLE 176-DS 50.00 189-DS 6.82 0.8 177-DS 1.75 190-DS 25.47 178-DS 18.90 191-DS 40.62 0.6 179-DS 51.38 192-DS 39.25 180-DS 59.36 193-DS 47.07 181-DS 44.44 194-DS 46.70 0.4 182-DS 9.21 195-DS 60.90 183-DS 47.68 196-DS 24.44 0.2 184-DS 44.01 197-DS 49.42 Difference 185-DS 14.96 198-DS 55.65 0 186-DS 9.43 199-DS 23.94 187-DS 54.33 200-DS 23.48 −0.2 188-DS 51.46 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 293 xerox 10.2415/DS-MONO-EN-CLEF2007.XEROX.XRCEPRFLEEN DS-MONO-EN-CLEF2007 Overall statistics for 25 queries : Priority 4 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language English Relevant 4,530 Topic Fields title, description Relevant retrieved 3,360 Pooled true Geometric Mean Average Precision 0.2181 PRF Lexical Entailment Binary Preference (BPREF) 0.3519 Interploated Recall (%) Precision Averages (%) Domain−Specific Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 75.12 XRCEPRFLEEN 10 53.33 90% 20 47.42 80% 30 41.82 40 36.96 70% 50 32.74 60% 60 27.65 Precision 70 21.56 50% 80 11.48 40% 90 4.05 30% 100 0.66 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 30.51 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Monolingual English Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.5783 Minimum 0.0206 First Quartile 0.0797 Second Quartile 0.3591 Third Quartile 0.4722 Interquartile range 0.3926 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.3051 Domain−Specific Monolingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1951 6 Number of Topics of the Experiment Lower Outlier Threshold 0.0206 5 Upper Outlier Threshold 0.5783 4 Mean With No Outliers 0.3051 3 Std With No Outliers 0.1951 2 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries XRCEPRFLEEN 176-DS 53.16 189-DS 6.78 0.8 177-DS 6.55 190-DS 23.79 178-DS 7.99 191-DS 12.85 0.6 179-DS 53.49 192-DS 35.91 180-DS 57.83 193-DS 39.88 181-DS 26.65 194-DS 49.65 0.4 182-DS 5.10 195-DS 56.74 183-DS 45.97 196-DS 20.49 0.2 184-DS 39.06 197-DS 37.47 Difference 185-DS 5.24 198-DS 45.73 0 186-DS 2.06 199-DS 22.23 187-DS 46.42 200-DS 7.90 −0.2 188-DS 53.86 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 294 xerox 10.2415/DS-MONO-EN-CLEF2007.XEROX.XRCEPRFLEEN DS-MONO-EN-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Monolingual English Task − Retrieved documents vs Mean Precision 100% 5 docs 56.80 XRCEPRFLEEN 10 docs 54.80 90% 15 docs 54.67 80% 20 docs 52.60 30 docs 51.33 70% 100 docs 43.72 60% 200 docs 35.16 Precision 500 docs 21.91 50% 1000 docs 13.44 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 34.06 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Monolingual English Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.5910 Minimum 0.0566 First Quartile 0.1563 Second Quartile 0.4206 Third Quartile 0.5230 Interquartile range 0.3667 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.3406 Domain−Specific Monolingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1877 4 Number of Topics of the Experiment 3.5 Lower Outlier Threshold 0.0566 3 Upper Outlier Threshold 0.5910 2.5 Mean With No Outliers 0.3406 2 1.5 Std With No Outliers 0.1877 1 0.5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries XRCEPRFLEEN 176-DS 52.22 189-DS 9.09 0.8 177-DS 10.53 190-DS 28.30 178-DS 17.68 191-DS 12.50 0.6 179-DS 55.05 192-DS 42.06 180-DS 56.42 193-DS 43.38 181-DS 27.78 194-DS 57.71 0.4 182-DS 9.21 195-DS 59.10 183-DS 46.36 196-DS 26.67 0.2 184-DS 44.01 197-DS 43.02 Difference 185-DS 11.02 198-DS 50.63 0 186-DS 5.66 199-DS 19.72 187-DS 52.52 200-DS 16.67 −0.2 188-DS 54.09 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 295 chemnitz 10.2415/DS-MONO-RU-CLEF2007.CHEMNITZ.CUT_DS_MONO_RU_MERGED DS-MONO-RU-CLEF2007 Overall statistics for 25 queries : Priority 3 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 24,999 Source Language English Relevant 1,471 Topic Fields title, description Relevant retrieved 1,159 Pooled true Geometric Mean Average Precision 0.0119 Monolingual RU merged results from structured and Binary Preference (BPREF) 0.1338 unstructured indizes Interploated Recall (%) Precision Averages (%) Domain−Specific Monolingual Russian Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 39.19 CUT_DS_MONO_RU_MERGED 10 25.33 90% 20 21.42 80% 30 17.63 40 14.52 70% 50 13.07 60% 60 11.56 Precision 70 8.66 50% 80 6.26 40% 90 3.20 30% 100 0.89 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 13.12 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Monolingual Russian Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.5689 Minimum 0.0000 First Quartile 0.0015 Second Quartile 0.0677 Third Quartile 0.2079 Interquartile range 0.2064 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.1312 Domain−Specific Monolingual Russian Task − Distribution of the Topics of the Experiment Standard Deviation 0.1594 10 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 8 Upper Outlier Threshold 0.3082 6 Mean With No Outliers 0.0945 4 Std With No Outliers 0.1004 2 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Monolingual Russian Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries CUT_DS_MONO_RU_MERGED 176-DS 0.00 189-DS 0.11 0.8 177-DS 23.20 190-DS 53.76 178-DS 0.00 191-DS 0.00 0.6 179-DS 20.56 192-DS 0.00 180-DS 25.47 193-DS 5.86 181-DS 0.00 194-DS 10.60 0.4 182-DS 19.91 195-DS 16.95 183-DS 30.82 196-DS 3.99 0.2 184-DS 7.24 197-DS 6.33 Difference 185-DS 1.32 198-DS 21.46 0 186-DS 0.16 199-DS 0.31 187-DS 56.89 200-DS 16.32 −0.2 188-DS 6.77 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 296 chemnitz 10.2415/DS-MONO-RU-CLEF2007.CHEMNITZ.CUT_DS_MONO_RU_MERGED DS-MONO-RU-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Monolingual Russian Task − Retrieved documents vs Mean Precision 100% 5 docs 18.40 CUT_DS_MONO_RU_MERGED 10 docs 19.60 90% 15 docs 18.93 80% 20 docs 18.60 30 docs 18.13 70% 100 docs 15.44 60% 200 docs 13.20 Precision 500 docs 7.76 50% 1000 docs 4.64 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 16.52 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Monolingual Russian Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.6111 Minimum 0.0000 First Quartile 0.0000 Second Quartile 0.1290 Third Quartile 0.2826 Interquartile range 0.2826 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.1652 Domain−Specific Monolingual Russian Task − Distribution of the Topics of the Experiment Standard Deviation 0.1767 10 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 8 Upper Outlier Threshold 0.6111 6 Mean With No Outliers 0.1652 4 Std With No Outliers 0.1767 2 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Monolingual Russian Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries CUT_DS_MONO_RU_MERGED 176-DS 0.00 189-DS 0.00 0.8 177-DS 30.00 190-DS 61.11 178-DS 0.00 191-DS 0.00 0.6 179-DS 22.92 192-DS 0.00 180-DS 27.94 193-DS 12.00 181-DS 0.00 194-DS 15.75 0.4 182-DS 24.49 195-DS 29.20 183-DS 30.19 196-DS 0.00 0.2 184-DS 20.00 197-DS 12.90 Difference 185-DS 5.56 198-DS 29.60 0 186-DS 0.00 199-DS 0.00 187-DS 60.30 200-DS 19.51 −0.2 188-DS 11.63 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 297 chemnitz 10.2415/DS-MONO-RU-CLEF2007.CHEMNITZ.CUT_DS_MONO_RU_STRUCT DS-MONO-RU-CLEF2007 Overall statistics for 25 queries : Priority 2 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language Russian Relevant 1,471 Topic Fields title, description Relevant retrieved 957 Pooled true Geometric Mean Average Precision 0.0096 Monolingual RU on index with structure Binary Preference (BPREF) 0.1005 Interploated Recall (%) Precision Averages (%) Domain−Specific Monolingual Russian Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 33.80 CUT_DS_MONO_RU_STRUCT 10 15.50 90% 20 13.37 80% 30 11.45 40 10.69 70% 50 9.49 60% 60 8.06 Precision 70 5.56 50% 80 3.57 40% 90 1.76 30% 100 0.44 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 8.98 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Monolingual Russian Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.4414 Minimum 0.0000 First Quartile 0.0012 Second Quartile 0.0198 Third Quartile 0.1147 Interquartile range 0.1134 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.0898 Domain−Specific Monolingual Russian Task − Distribution of the Topics of the Experiment Standard Deviation 0.1347 15 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 Upper Outlier Threshold 0.2179 10 Mean With No Outliers 0.0467 Std With No Outliers 0.0661 5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Monolingual Russian Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries CUT_DS_MONO_RU_STRUCT 176-DS 0.07 189-DS 0.34 0.8 177-DS 1.21 190-DS 40.40 178-DS 0.00 191-DS 0.00 0.6 179-DS 37.31 192-DS 0.14 180-DS 21.79 193-DS 5.95 181-DS 0.00 194-DS 5.89 0.4 182-DS 13.02 195-DS 0.69 183-DS 20.40 196-DS 5.07 0.2 184-DS 2.70 197-DS 1.29 Difference 185-DS 1.98 198-DS 10.95 0 186-DS 0.08 199-DS 0.04 187-DS 44.14 200-DS 10.31 −0.2 188-DS 0.81 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 298 chemnitz 10.2415/DS-MONO-RU-CLEF2007.CHEMNITZ.CUT_DS_MONO_RU_STRUCT DS-MONO-RU-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Monolingual Russian Task − Retrieved documents vs Mean Precision 100% 5 docs 16.00 CUT_DS_MONO_RU_STRUCT 10 docs 15.20 90% 15 docs 13.60 80% 20 docs 13.40 30 docs 13.87 70% 100 docs 12.36 60% 200 docs 9.52 Precision 500 docs 5.91 50% 1000 docs 3.83 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 11.47 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Monolingual Russian Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.5208 Minimum 0.0000 First Quartile 0.0000 Second Quartile 0.0556 Third Quartile 0.1548 Interquartile range 0.1548 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.1147 Domain−Specific Monolingual Russian Task − Distribution of the Topics of the Experiment Standard Deviation 0.1624 15 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 Upper Outlier Threshold 0.2353 10 Mean With No Outliers 0.0623 Std With No Outliers 0.0779 5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Monolingual Russian Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries CUT_DS_MONO_RU_STRUCT 176-DS 0.00 189-DS 0.00 0.8 177-DS 0.00 190-DS 50.00 178-DS 0.00 191-DS 0.00 0.6 179-DS 52.08 192-DS 0.00 180-DS 23.53 193-DS 12.00 181-DS 0.00 194-DS 11.02 0.4 182-DS 16.33 195-DS 6.57 183-DS 22.64 196-DS 0.00 0.2 184-DS 7.27 197-DS 0.00 Difference 185-DS 5.56 198-DS 15.20 0 186-DS 0.00 199-DS 0.00 187-DS 47.76 200-DS 12.20 −0.2 188-DS 4.65 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 299 chemnitz 10.2415/DS-MONO-RU-CLEF2007.CHEMNITZ.CUT_DS_MONO_RU_UNSTRUCT DS-MONO-RU-CLEF2007 Overall statistics for 25 queries : Priority 1 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language Russian Relevant 1,471 Topic Fields title, description Relevant retrieved 1,090 Pooled true Geometric Mean Average Precision 0.0108 Monolingual RU on index without structure Binary Preference (BPREF) 0.1355 Interploated Recall (%) Precision Averages (%) Domain−Specific Monolingual Russian Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 46.48 CUT_DS_MONO_RU_UNSTRUCT 10 29.21 90% 20 22.75 80% 30 19.26 40 12.70 70% 50 10.67 60% 60 8.55 Precision 70 6.54 50% 80 3.79 40% 90 2.47 30% 100 0.27 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 12.83 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Monolingual Russian Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.5191 Minimum 0.0000 First Quartile 0.0019 Second Quartile 0.0845 Third Quartile 0.2210 Interquartile range 0.2190 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.1283 Domain−Specific Monolingual Russian Task − Distribution of the Topics of the Experiment Standard Deviation 0.1469 15 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 Upper Outlier Threshold 0.5191 10 Mean With No Outliers 0.1283 Std With No Outliers 0.1469 5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Monolingual Russian Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries CUT_DS_MONO_RU_UNSTRUCT 176-DS 0.00 189-DS 0.03 0.8 177-DS 34.87 190-DS 51.91 178-DS 0.00 191-DS 0.00 0.6 179-DS 2.09 192-DS 0.00 180-DS 22.70 193-DS 4.36 181-DS 0.00 194-DS 13.98 0.4 182-DS 21.02 195-DS 21.74 183-DS 27.15 196-DS 1.74 0.2 184-DS 8.45 197-DS 9.76 Difference 185-DS 0.68 198-DS 22.35 0 186-DS 0.25 199-DS 0.48 187-DS 40.25 200-DS 22.01 −0.2 188-DS 14.92 −0.4 −0.6 −0.8 −1 176−DS177−DS178−DS179−DS 180−DS181−DS182−DS 183−DS184−DS185−DS186−DS 187−DS188−DS189−DS 190−DS191−DS192−DS193−DS 194−DS195−DS196−DS 197−DS198−DS199−DS200−DS Topic Identifier 300 chemnitz 10.2415/DS-MONO-RU-CLEF2007.CHEMNITZ.CUT_DS_MONO_RU_UNSTRUCT DS-MONO-RU-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Monolingual Russian Task − Retrieved documents vs Mean Precision 100% 5 docs 28.00 CUT_DS_MONO_RU_UNSTRUCT 10 docs 24.80 90% 15 docs 23.20 80% 20 docs 22.00 30 docs 19.33 70% 100 docs 15.20 60% 200 docs 11.28 Precision 500 docs 6.94 50% 1000 docs 4.36 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 15.77 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Monolingual Russian Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.5317 Minimum 0.0000 First Quartile 0.0000 Second Quartile 0.1636 Third Quartile 0.2873 Interquartile range 0.2873 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.1577 Domain−Specific Monolingual Russian Task − Distribution of the Topics of the Experiment Standard Deviation 0.1676 15 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 Upper Outlier Threshold 0.5317 10 Mean With No Outliers 0.1577 Std With No Outliers 0.1676 5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Monolingual Russian Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries CUT_DS_MONO_RU_UNSTRUCT 176-DS 0.00 189-DS 0.00 0.8 177-DS 30.00 190-DS 53.17 178-DS 0.00 191-DS 0.00 0.6 179-DS 2.08 192-DS 0.00 180-DS 32.35 193-DS 8.00 181-DS 0.00 194-DS 18.11 0.4 182-DS 22.45 195-DS 32.12 183-DS 28.30 196-DS 0.00 0.2 184-DS 16.36 197-DS 19.35 Difference 185-DS 0.00 198-DS 32.80 0 186-DS 0.00 199-DS 0.00 187-DS 50.45 200-DS 24.39 −0.2 188-DS 24.42 −0.4 −0.6 −0.8 −1 176−DS177−DS178−DS179−DS 180−DS181−DS182−DS 183−DS184−DS185−DS186−DS 187−DS188−DS189−DS 190−DS191−DS192−DS193−DS 194−DS195−DS196−DS 197−DS198−DS199−DS200−DS Topic Identifier 301 cheshire 10.2415/DS-MONO-RU-CLEF2007.CHESHIRE.BERKMRUCCP15 DS-MONO-RU-CLEF2007 Overall statistics for 25 queries : Priority 1 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language Russian Relevant 1,471 Topic Fields title, description Relevant retrieved 1,174 Pooled true Geometric Mean Average Precision 0.0170 RU monolingual using Class Cluster Lookup merged Binary Preference (BPREF) 0.1420 with T2FB Interploated Recall (%) Precision Averages (%) Domain−Specific Monolingual Russian Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 46.13 BERKMRUCCP15 10 26.86 90% 20 22.61 80% 30 17.08 40 15.08 70% 50 14.01 60% 60 12.20 Precision 70 9.42 50% 80 7.03 40% 90 3.42 30% 100 0.85 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 13.90 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Monolingual Russian Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.5345 Minimum 0.0000 First Quartile 0.0042 Second Quartile 0.1070 Third Quartile 0.2277 Interquartile range 0.2236 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.1390 Domain−Specific Monolingual Russian Task − Distribution of the Topics of the Experiment Standard Deviation 0.1641 15 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 Upper Outlier Threshold 0.5345 10 Mean With No Outliers 0.1390 Std With No Outliers 0.1641 5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Monolingual Russian Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries BERKMRUCCP15 176-DS 0.00 189-DS 2.56 0.8 177-DS 22.42 190-DS 53.45 178-DS 0.00 191-DS 0.00 0.6 179-DS 10.70 192-DS 0.21 180-DS 28.63 193-DS 0.88 181-DS 0.00 194-DS 15.63 0.4 182-DS 12.14 195-DS 50.85 183-DS 25.35 196-DS 2.89 0.2 184-DS 7.60 197-DS 16.94 Difference 185-DS 1.39 198-DS 12.81 0 186-DS 0.44 199-DS 0.35 187-DS 46.21 200-DS 23.85 −0.2 188-DS 12.33 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 302 cheshire 10.2415/DS-MONO-RU-CLEF2007.CHESHIRE.BERKMRUCCP15 DS-MONO-RU-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Monolingual Russian Task − Retrieved documents vs Mean Precision 100% 5 docs 25.60 BERKMRUCCP15 10 docs 21.60 90% 15 docs 20.80 80% 20 docs 19.20 30 docs 18.80 70% 100 docs 16.24 60% 200 docs 12.66 Precision 500 docs 7.60 50% 1000 docs 4.70 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 15.70 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Monolingual Russian Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.6058 Minimum 0.0000 First Quartile 0.0000 Second Quartile 0.1224 Third Quartile 0.2349 Interquartile range 0.2349 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.1570 Domain−Specific Monolingual Russian Task − Distribution of the Topics of the Experiment Standard Deviation 0.1882 10 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 8 Upper Outlier Threshold 0.5015 6 Mean With No Outliers 0.1181 4 Std With No Outliers 0.1373 2 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Monolingual Russian Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries BERKMRUCCP15 176-DS 0.00 189-DS 0.00 0.8 177-DS 20.00 190-DS 60.32 178-DS 0.00 191-DS 0.00 0.6 179-DS 7.29 192-DS 0.00 180-DS 30.88 193-DS 4.00 181-DS 0.00 194-DS 21.26 0.4 182-DS 12.24 195-DS 60.58 183-DS 30.19 196-DS 0.00 0.2 184-DS 18.18 197-DS 12.90 Difference 185-DS 5.56 198-DS 14.40 0 186-DS 0.00 199-DS 0.00 187-DS 50.15 200-DS 31.71 −0.2 188-DS 12.79 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 303 cheshire 10.2415/DS-MONO-RU-CLEF2007.CHESHIRE.BERKMRUTHP7 DS-MONO-RU-CLEF2007 Overall statistics for 25 queries : Priority 2 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language Russian Relevant 1,471 Topic Fields title, description Relevant retrieved 1,195 Pooled true Geometric Mean Average Precision 0.0173 RU monolingual using Thesaurus Lookup merged with Binary Preference (BPREF) 0.1417 T2FB Interploated Recall (%) Precision Averages (%) Domain−Specific Monolingual Russian Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 49.09 BERKMRUTHP7 10 26.74 90% 20 22.77 80% 30 17.43 40 15.29 70% 50 13.33 60% 60 11.54 Precision 70 9.31 50% 80 6.84 40% 90 3.86 30% 100 0.29 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 14.01 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Monolingual Russian Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.4975 Minimum 0.0000 First Quartile 0.0041 Second Quartile 0.1179 Third Quartile 0.2335 Interquartile range 0.2294 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.1401 Domain−Specific Monolingual Russian Task − Distribution of the Topics of the Experiment Standard Deviation 0.1544 15 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 Upper Outlier Threshold 0.4975 10 Mean With No Outliers 0.1401 Std With No Outliers 0.1544 5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Monolingual Russian Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries BERKMRUTHP7 176-DS 0.00 189-DS 1.59 0.8 177-DS 22.49 190-DS 49.75 178-DS 0.00 191-DS 0.00 0.6 179-DS 19.38 192-DS 0.12 180-DS 25.93 193-DS 1.17 181-DS 0.00 194-DS 11.79 0.4 182-DS 13.15 195-DS 41.40 183-DS 25.93 196-DS 3.25 0.2 184-DS 8.17 197-DS 16.07 Difference 185-DS 1.71 198-DS 15.29 0 186-DS 0.41 199-DS 0.41 187-DS 47.90 200-DS 27.19 −0.2 188-DS 17.10 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 304 cheshire 10.2415/DS-MONO-RU-CLEF2007.CHESHIRE.BERKMRUTHP7 DS-MONO-RU-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Monolingual Russian Task − Retrieved documents vs Mean Precision 100% 5 docs 25.60 BERKMRUTHP7 10 docs 22.80 90% 15 docs 20.53 80% 20 docs 19.40 30 docs 18.67 70% 100 docs 16.36 60% 200 docs 13.12 Precision 500 docs 7.78 50% 1000 docs 4.78 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 15.84 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Monolingual Russian Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.5397 Minimum 0.0000 First Quartile 0.0000 Second Quartile 0.1613 Third Quartile 0.2255 Interquartile range 0.2255 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.1584 Domain−Specific Monolingual Russian Task − Distribution of the Topics of the Experiment Standard Deviation 0.1715 10 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 8 Upper Outlier Threshold 0.5397 6 Mean With No Outliers 0.1584 4 Std With No Outliers 0.1715 2 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Monolingual Russian Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries BERKMRUTHP7 176-DS 0.00 189-DS 0.00 0.8 177-DS 20.00 190-DS 53.97 178-DS 0.00 191-DS 0.00 0.6 179-DS 19.79 192-DS 0.00 180-DS 32.35 193-DS 4.00 181-DS 0.00 194-DS 17.32 0.4 182-DS 12.24 195-DS 48.91 183-DS 30.19 196-DS 0.00 0.2 184-DS 18.18 197-DS 16.13 Difference 185-DS 5.56 198-DS 16.80 0 186-DS 0.00 199-DS 0.00 187-DS 50.15 200-DS 32.93 −0.2 188-DS 17.44 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 305 moscow 10.2415/DS-MONO-RU-CLEF2007.MOSCOW.CIRDSMONORU DS-MONO-RU-CLEF2007 Overall statistics for 25 queries : Priority 1 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 18,137 Source Language Russian Relevant 1,471 Topic Fields title, description Relevant retrieved 841 Pooled true Geometric Mean Average Precision 0.0071 word pairs in window=5 Binary Preference (BPREF) 0.1140 Interploated Recall (%) Precision Averages (%) Domain−Specific Monolingual Russian Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 35.95 CIRDSMONORU 10 24.84 90% 20 17.67 80% 30 15.06 40 9.81 70% 50 8.22 60% 60 5.16 Precision 70 3.79 50% 80 3.45 40% 90 3.22 30% 100 0.30 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 9.77 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Monolingual Russian Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.5833 Minimum 0.0000 First Quartile 0.0020 Second Quartile 0.0418 Third Quartile 0.1540 Interquartile range 0.1520 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.0977 Domain−Specific Monolingual Russian Task − Distribution of the Topics of the Experiment Standard Deviation 0.1398 15 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 Upper Outlier Threshold 0.3430 10 Mean With No Outliers 0.0775 Std With No Outliers 0.0985 5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Monolingual Russian Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries CIRDSMONORU 176-DS 0.83 189-DS 2.03 0.8 177-DS 34.30 190-DS 58.33 178-DS 0.00 191-DS 0.00 0.6 179-DS 3.53 192-DS 0.00 180-DS 5.04 193-DS 4.18 181-DS 0.00 194-DS 8.35 0.4 182-DS 15.68 195-DS 12.16 183-DS 26.19 196-DS 0.27 0.2 184-DS 5.30 197-DS 0.00 Difference 185-DS 0.00 198-DS 18.09 0 186-DS 0.39 199-DS 0.64 187-DS 24.93 200-DS 15.30 −0.2 188-DS 8.74 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 306 moscow 10.2415/DS-MONO-RU-CLEF2007.MOSCOW.CIRDSMONORU DS-MONO-RU-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Monolingual Russian Task − Retrieved documents vs Mean Precision 100% 5 docs 21.60 CIRDSMONORU 10 docs 17.60 90% 15 docs 15.73 80% 20 docs 15.00 30 docs 13.60 70% 100 docs 11.92 60% 200 docs 9.66 Precision 500 docs 5.77 50% 1000 docs 3.36 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 13.01 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Monolingual Russian Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.5952 Minimum 0.0000 First Quartile 0.0000 Second Quartile 0.0814 Third Quartile 0.2398 Interquartile range 0.2398 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.1301 Domain−Specific Monolingual Russian Task − Distribution of the Topics of the Experiment Standard Deviation 0.1644 15 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 Upper Outlier Threshold 0.5952 10 Mean With No Outliers 0.1301 Std With No Outliers 0.1644 5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Monolingual Russian Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries CIRDSMONORU 176-DS 0.00 189-DS 0.00 0.8 177-DS 30.00 190-DS 59.52 178-DS 0.00 191-DS 0.00 0.6 179-DS 11.46 192-DS 0.00 180-DS 13.24 193-DS 0.00 181-DS 0.00 194-DS 18.90 0.4 182-DS 18.37 195-DS 27.74 183-DS 26.42 196-DS 0.00 0.2 184-DS 12.73 197-DS 0.00 Difference 185-DS 0.00 198-DS 28.00 0 186-DS 0.00 199-DS 0.00 187-DS 47.46 200-DS 23.17 −0.2 188-DS 8.14 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 307 moscow 10.2415/DS-MONO-RU-CLEF2007.MOSCOW.CIRDSMONORU2 DS-MONO-RU-CLEF2007 Overall statistics for 25 queries : Priority 2 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 18,137 Source Language Russian Relevant 1,471 Topic Fields title, description Relevant retrieved 837 Pooled true Geometric Mean Average Precision 0.0069 tfidf+pairs Binary Preference (BPREF) 0.1109 Interploated Recall (%) Precision Averages (%) Domain−Specific Monolingual Russian Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 41.34 CIRDSMONORU2 10 26.47 90% 20 17.37 80% 30 15.29 40 9.49 70% 50 8.48 60% 60 5.17 Precision 70 3.75 50% 80 3.40 40% 90 3.02 30% 100 0.11 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 9.86 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Monolingual Russian Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.6115 Minimum 0.0000 First Quartile 0.0008 Second Quartile 0.0456 Third Quartile 0.1477 Interquartile range 0.1469 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.0986 Domain−Specific Monolingual Russian Task − Distribution of the Topics of the Experiment Standard Deviation 0.1427 15 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 Upper Outlier Threshold 0.3281 10 Mean With No Outliers 0.0772 Std With No Outliers 0.0965 5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Monolingual Russian Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries CIRDSMONORU2 176-DS 0.11 189-DS 1.39 0.8 177-DS 32.81 190-DS 61.15 178-DS 0.00 191-DS 0.00 0.6 179-DS 2.95 192-DS 0.00 180-DS 6.46 193-DS 4.56 181-DS 0.00 194-DS 11.27 0.4 182-DS 14.88 195-DS 12.73 183-DS 26.30 196-DS 0.78 0.2 184-DS 5.38 197-DS 0.00 Difference 185-DS 0.00 198-DS 15.47 0 186-DS 0.50 199-DS 0.67 187-DS 25.73 200-DS 14.74 −0.2 188-DS 8.66 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 308 moscow 10.2415/DS-MONO-RU-CLEF2007.MOSCOW.CIRDSMONORU2 DS-MONO-RU-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Monolingual Russian Task − Retrieved documents vs Mean Precision 100% 5 docs 24.00 CIRDSMONORU2 10 docs 17.60 90% 15 docs 17.07 80% 20 docs 16.20 30 docs 14.80 70% 100 docs 11.36 60% 200 docs 9.56 Precision 500 docs 5.82 50% 1000 docs 3.35 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 12.66 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Monolingual Russian Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.6032 Minimum 0.0000 First Quartile 0.0000 Second Quartile 0.0698 Third Quartile 0.2139 Interquartile range 0.2139 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.1266 Domain−Specific Monolingual Russian Task − Distribution of the Topics of the Experiment Standard Deviation 0.1660 15 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 Upper Outlier Threshold 0.5015 10 Mean With No Outliers 0.1067 Std With No Outliers 0.1359 5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Monolingual Russian Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries CIRDSMONORU2 176-DS 0.00 189-DS 0.00 0.8 177-DS 30.00 190-DS 60.32 178-DS 0.00 191-DS 0.00 0.6 179-DS 9.38 192-DS 0.00 180-DS 13.24 193-DS 0.00 181-DS 0.00 194-DS 18.90 0.4 182-DS 16.33 195-DS 29.93 183-DS 24.53 196-DS 0.00 0.2 184-DS 12.73 197-DS 0.00 Difference 185-DS 0.00 198-DS 20.80 0 186-DS 0.00 199-DS 0.00 187-DS 50.15 200-DS 23.17 −0.2 188-DS 6.98 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 309 unine 10.2415/DS-MONO-RU-CLEF2007.UNINE.UNINERU1 DS-MONO-RU-CLEF2007 Overall statistics for 25 queries : Priority 1 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language Russian Relevant 1,471 Topic Fields title, description Relevant retrieved 1,046 Pooled true Geometric Mean Average Precision 0.0164 Okapi & GL2 & LM Binary Preference (BPREF) 0.1385 Interploated Recall (%) Precision Averages (%) Domain−Specific Monolingual Russian Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 40.54 UNINERU1 10 28.51 90% 20 20.86 80% 30 18.55 40 15.67 70% 50 12.69 60% 60 11.21 Precision 70 10.29 50% 80 8.59 40% 90 7.78 30% 100 0.96 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 13.73 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Monolingual Russian Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.8392 Minimum 0.0000 First Quartile 0.0031 Second Quartile 0.0769 Third Quartile 0.1940 Interquartile range 0.1909 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.1373 Domain−Specific Monolingual Russian Task − Distribution of the Topics of the Experiment Standard Deviation 0.1877 15 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 Upper Outlier Threshold 0.4203 10 Mean With No Outliers 0.1080 Std With No Outliers 0.1201 5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Monolingual Russian Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries UNINERU1 176-DS 0.00 189-DS 0.15 0.8 177-DS 28.27 190-DS 42.03 178-DS 0.00 191-DS 0.00 0.6 179-DS 9.73 192-DS 0.12 180-DS 18.79 193-DS 27.69 181-DS 0.00 194-DS 4.71 0.4 182-DS 9.52 195-DS 7.69 183-DS 14.18 196-DS 4.41 0.2 184-DS 9.18 197-DS 16.67 Difference 185-DS 1.11 198-DS 21.23 0 186-DS 0.37 199-DS 4.59 187-DS 6.00 200-DS 32.78 −0.2 188-DS 83.92 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 310 unine 10.2415/DS-MONO-RU-CLEF2007.UNINE.UNINERU1 DS-MONO-RU-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Monolingual Russian Task − Retrieved documents vs Mean Precision 100% 5 docs 18.40 UNINERU1 10 docs 16.80 90% 15 docs 17.33 80% 20 docs 16.60 30 docs 16.00 70% 100 docs 13.64 60% 200 docs 9.86 Precision 500 docs 6.06 50% 1000 docs 4.18 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 16.14 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Monolingual Russian Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.8140 Minimum 0.0000 First Quartile 0.0000 Second Quartile 0.0896 Third Quartile 0.2685 Interquartile range 0.2685 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.1614 Domain−Specific Monolingual Russian Task − Distribution of the Topics of the Experiment Standard Deviation 0.2019 10 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 8 Upper Outlier Threshold 0.4921 6 Mean With No Outliers 0.1342 4 Std With No Outliers 0.1524 2 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Monolingual Russian Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries UNINERU1 176-DS 0.00 189-DS 0.00 0.8 177-DS 30.00 190-DS 49.21 178-DS 0.00 191-DS 0.00 0.6 179-DS 2.08 192-DS 0.00 180-DS 30.88 193-DS 32.00 181-DS 0.00 194-DS 8.66 0.4 182-DS 12.24 195-DS 5.84 183-DS 13.21 196-DS 0.00 0.2 184-DS 18.18 197-DS 25.81 Difference 185-DS 0.00 198-DS 23.20 0 186-DS 0.00 199-DS 16.67 187-DS 8.96 200-DS 45.12 −0.2 188-DS 81.40 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 311 unine 10.2415/DS-MONO-RU-CLEF2007.UNINE.UNINERU2 DS-MONO-RU-CLEF2007 Overall statistics for 25 queries : Priority 3 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language Russian Relevant 1,471 Topic Fields title, description Relevant retrieved 911 Pooled true Geometric Mean Average Precision 0.0143 GL2 Binary Preference (BPREF) 0.1286 Interploated Recall (%) Precision Averages (%) Domain−Specific Monolingual Russian Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 39.08 UNINERU2 10 27.71 90% 20 21.29 80% 30 18.51 40 14.76 70% 50 13.03 60% 60 11.32 Precision 70 8.55 50% 80 7.43 40% 90 6.00 30% 100 1.08 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 13.38 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Monolingual Russian Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.7616 Minimum 0.0000 First Quartile 0.0043 Second Quartile 0.0452 Third Quartile 0.2600 Interquartile range 0.2557 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.1338 Domain−Specific Monolingual Russian Task − Distribution of the Topics of the Experiment Standard Deviation 0.1801 15 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 Upper Outlier Threshold 0.3634 10 Mean With No Outliers 0.1076 Std With No Outliers 0.1264 5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Monolingual Russian Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries UNINERU2 176-DS 0.00 189-DS 0.08 0.8 177-DS 33.09 190-DS 36.34 178-DS 0.00 191-DS 0.00 0.6 179-DS 26.48 192-DS 0.12 180-DS 4.47 193-DS 22.23 181-DS 0.00 194-DS 5.45 0.4 182-DS 10.39 195-DS 3.74 183-DS 16.80 196-DS 3.76 0.2 184-DS 4.93 197-DS 25.96 Difference 185-DS 1.31 198-DS 26.14 0 186-DS 0.54 199-DS 4.52 187-DS 0.76 200-DS 31.21 −0.2 188-DS 76.16 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 312 unine 10.2415/DS-MONO-RU-CLEF2007.UNINE.UNINERU2 DS-MONO-RU-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Monolingual Russian Task − Retrieved documents vs Mean Precision 100% 5 docs 22.40 UNINERU2 10 docs 18.80 90% 15 docs 18.13 80% 20 docs 16.00 30 docs 14.53 70% 100 docs 12.56 60% 200 docs 9.88 Precision 500 docs 5.84 50% 1000 docs 3.64 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 16.52 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Monolingual Russian Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.6628 Minimum 0.0000 First Quartile 0.0000 Second Quartile 0.1250 Third Quartile 0.2910 Interquartile range 0.2910 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.1652 Domain−Specific Monolingual Russian Task − Distribution of the Topics of the Experiment Standard Deviation 0.1764 8 Number of Topics of the Experiment 7 Lower Outlier Threshold 0.0000 6 Upper Outlier Threshold 0.6628 5 Mean With No Outliers 0.1652 4 3 Std With No Outliers 0.1764 2 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Monolingual Russian Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries UNINERU2 176-DS 0.00 189-DS 0.00 0.8 177-DS 30.00 190-DS 50.00 178-DS 0.00 191-DS 0.00 0.6 179-DS 30.21 192-DS 0.00 180-DS 8.82 193-DS 32.00 181-DS 0.00 194-DS 9.45 0.4 182-DS 16.33 195-DS 2.19 183-DS 16.98 196-DS 12.50 0.2 184-DS 14.55 197-DS 25.81 Difference 185-DS 5.56 198-DS 28.80 0 186-DS 0.00 199-DS 16.67 187-DS 6.57 200-DS 40.24 −0.2 188-DS 66.28 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 313 unine 10.2415/DS-MONO-RU-CLEF2007.UNINE.UNINERU3 DS-MONO-RU-CLEF2007 Overall statistics for 25 queries : Priority 4 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language Russian Relevant 1,471 Topic Fields title, description Relevant retrieved 991 Pooled true Geometric Mean Average Precision 0.0138 Okapi & Lm & GL2 Binary Preference (BPREF) 0.1418 Interploated Recall (%) Precision Averages (%) Domain−Specific Monolingual Russian Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 45.26 UNINERU3 10 27.50 90% 20 23.27 80% 30 20.57 40 15.73 70% 50 13.14 60% 60 11.87 Precision 70 9.20 50% 80 8.02 40% 90 6.84 30% 100 0.95 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 14.50 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Monolingual Russian Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.8073 Minimum 0.0000 First Quartile 0.0042 Second Quartile 0.0755 Third Quartile 0.2502 Interquartile range 0.2460 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.1450 Domain−Specific Monolingual Russian Task − Distribution of the Topics of the Experiment Standard Deviation 0.1883 15 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 Upper Outlier Threshold 0.3954 10 Mean With No Outliers 0.1174 Std With No Outliers 0.1310 5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Monolingual Russian Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries UNINERU3 176-DS 0.00 189-DS 0.47 0.8 177-DS 35.98 190-DS 39.54 178-DS 0.00 191-DS 0.00 0.6 179-DS 28.93 192-DS 0.00 180-DS 10.31 193-DS 28.41 181-DS 0.00 194-DS 7.55 0.4 182-DS 8.20 195-DS 6.38 183-DS 21.05 196-DS 3.41 0.2 184-DS 23.89 197-DS 12.76 Difference 185-DS 1.01 198-DS 18.02 0 186-DS 0.27 199-DS 2.94 187-DS 1.83 200-DS 30.91 −0.2 188-DS 80.73 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 314 unine 10.2415/DS-MONO-RU-CLEF2007.UNINE.UNINERU3 DS-MONO-RU-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Monolingual Russian Task − Retrieved documents vs Mean Precision 100% 5 docs 23.20 UNINERU3 10 docs 22.40 90% 15 docs 20.00 80% 20 docs 17.80 30 docs 16.53 70% 100 docs 13.28 60% 200 docs 9.94 Precision 500 docs 5.95 50% 1000 docs 3.96 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 16.02 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Monolingual Russian Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.7558 Minimum 0.0000 First Quartile 0.0000 Second Quartile 0.0866 Third Quartile 0.3068 Interquartile range 0.3068 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.1602 Domain−Specific Monolingual Russian Task − Distribution of the Topics of the Experiment Standard Deviation 0.1983 15 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 Upper Outlier Threshold 0.7558 10 Mean With No Outliers 0.1602 Std With No Outliers 0.1983 5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Monolingual Russian Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries UNINERU3 176-DS 0.00 189-DS 0.00 0.8 177-DS 30.00 190-DS 48.41 178-DS 0.00 191-DS 0.00 0.6 179-DS 35.42 192-DS 0.00 180-DS 11.76 193-DS 36.00 181-DS 0.00 194-DS 8.66 0.4 182-DS 14.29 195-DS 4.38 183-DS 24.53 196-DS 0.00 0.2 184-DS 32.73 197-DS 16.13 Difference 185-DS 0.00 198-DS 18.40 0 186-DS 0.00 199-DS 0.00 187-DS 3.88 200-DS 40.24 −0.2 188-DS 75.58 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 315 unine 10.2415/DS-MONO-RU-CLEF2007.UNINE.UNINERU4 DS-MONO-RU-CLEF2007 Overall statistics for 25 queries : Priority 2 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language Russian Relevant 1,471 Topic Fields title, description, narrative Relevant retrieved 1,037 Pooled true Geometric Mean Average Precision 0.0345 GL2 & LM Binary Preference (BPREF) 0.1958 Interploated Recall (%) Precision Averages (%) Domain−Specific Monolingual Russian Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 49.63 UNINERU4 10 38.23 90% 20 32.56 80% 30 29.12 40 21.99 70% 50 19.02 60% 60 15.81 Precision 70 12.19 50% 80 10.24 40% 90 7.66 30% 100 1.38 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 19.71 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Monolingual Russian Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.8145 Minimum 0.0000 First Quartile 0.0142 Second Quartile 0.1118 Third Quartile 0.3483 Interquartile range 0.3341 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.1971 Domain−Specific Monolingual Russian Task − Distribution of the Topics of the Experiment Standard Deviation 0.2148 10 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 8 Upper Outlier Threshold 0.8145 6 Mean With No Outliers 0.1971 4 Std With No Outliers 0.2148 2 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Bilingual English Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries XRCED2EMATRAXLE 176-DS 0.33 189-DS 3.39 0.8 177-DS 38.64 190-DS 37.48 178-DS 0.00 191-DS 0.00 0.6 179-DS 57.27 192-DS 0.38 180-DS 27.21 193-DS 40.32 181-DS 0.00 194-DS 11.18 0.4 182-DS 13.38 195-DS 1.55 183-DS 18.04 196-DS 4.87 0.2 184-DS 30.47 197-DS 23.80 Difference 185-DS 5.61 198-DS 46.09 0 186-DS 1.03 199-DS 8.89 187-DS 7.45 200-DS 33.94 −0.2 188-DS 81.45 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 316 unine 10.2415/DS-MONO-RU-CLEF2007.UNINE.UNINERU4 DS-MONO-RU-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Monolingual Russian Task − Retrieved documents vs Mean Precision 100% 5 docs 28.80 UNINERU4 10 docs 26.40 90% 15 docs 24.00 80% 20 docs 22.40 30 docs 20.53 70% 100 docs 18.84 60% 200 docs 13.60 Precision 500 docs 7.13 50% 1000 docs 4.15 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 21.72 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Monolingual Russian Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.7907 Minimum 0.0000 First Quartile 0.0000 Second Quartile 0.1940 Third Quartile 0.3537 Interquartile range 0.3537 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.2172 Domain−Specific Monolingual Russian Task − Distribution of the Topics of the Experiment Standard Deviation 0.2232 10 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 8 Upper Outlier Threshold 0.7907 6 Mean With No Outliers 0.2172 4 Std With No Outliers 0.2232 2 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Monolingual Russian Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries UNINERU4 176-DS 0.00 189-DS 0.00 0.8 177-DS 30.00 190-DS 47.62 178-DS 0.00 191-DS 0.00 0.6 179-DS 58.33 192-DS 0.00 180-DS 33.82 193-DS 40.00 181-DS 0.00 194-DS 11.81 0.4 182-DS 22.45 195-DS 0.73 183-DS 20.75 196-DS 12.50 0.2 184-DS 29.09 197-DS 22.58 Difference 185-DS 0.00 198-DS 56.80 0 186-DS 0.00 199-DS 16.67 187-DS 19.40 200-DS 41.46 −0.2 188-DS 79.07 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 317 chemnitz 10.2415/DS-BILI-X2DE-CLEF2007.CHEMNITZ.CUT_DS_BILI_EN2DE_MERGED DS-BILI-X2DE-CLEF2007 Overall statistics for 25 queries : Priority 3 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 24,999 Source Language English Relevant 3,689 Topic Fields title, description Relevant retrieved 2,259 Pooled true Geometric Mean Average Precision 0.0984 Bilingual EN2DE merged structured and unstructured Binary Preference (BPREF) 0.2620 indizes, translated with Google translate (beta) Interploated Recall (%) Precision Averages (%) Domain−Specific Bilingual German Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 68.39 CUT_DS_BILI_EN2DE_MERGED 10 38.24 90% 20 31.49 80% 30 27.17 40 23.70 70% 50 19.62 60% 60 15.32 Precision 70 11.78 50% 80 8.43 40% 90 3.13 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 20.11 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Bilingual German Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.6458 Minimum 0.0045 First Quartile 0.0401 Second Quartile 0.1121 Third Quartile 0.3793 Interquartile range 0.3393 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.2011 Domain−Specific Bilingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.2047 10 Number of Topics of the Experiment Lower Outlier Threshold 0.0045 8 Upper Outlier Threshold 0.6458 6 Mean With No Outliers 0.2011 4 Std With No Outliers 0.2047 2 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Bilingual German Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries CUT_DS_BILI_EN2DE_MERGED 176-DS 1.68 189-DS 4.46 0.8 177-DS 17.17 190-DS 64.58 178-DS 55.03 191-DS 1.84 0.6 179-DS 46.20 192-DS 10.04 180-DS 2.58 193-DS 4.04 181-DS 4.82 194-DS 9.42 0.4 182-DS 16.61 195-DS 13.87 183-DS 23.21 196-DS 21.10 0.2 184-DS 5.70 197-DS 35.18 Difference 185-DS 3.91 198-DS 50.30 0 186-DS 0.66 199-DS 47.53 187-DS 11.21 200-DS 0.45 −0.2 188-DS 51.30 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 318 chemnitz 10.2415/DS-BILI-X2DE-CLEF2007.CHEMNITZ.CUT_DS_BILI_EN2DE_MERGED DS-BILI-X2DE-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Bilingual German Task − Retrieved documents vs Mean Precision 100% 5 docs 46.40 CUT_DS_BILI_EN2DE_MERGED 10 docs 41.20 90% 15 docs 40.27 80% 20 docs 39.20 30 docs 36.93 70% 100 docs 29.52 60% 200 docs 23.32 Precision 500 docs 14.42 50% 1000 docs 9.04 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 24.93 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Bilingual German Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.6314 Minimum 0.0235 First Quartile 0.0764 Second Quartile 0.2114 Third Quartile 0.4444 Interquartile range 0.3679 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.2493 Domain−Specific Bilingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.1901 6 Number of Topics of the Experiment Lower Outlier Threshold 0.0235 5 Upper Outlier Threshold 0.6314 4 Mean With No Outliers 0.2493 3 Std With No Outliers 0.1901 2 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Bilingual German Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries CUT_DS_BILI_EN2DE_MERGED 176-DS 6.74 189-DS 7.69 0.8 177-DS 24.24 190-DS 63.14 178-DS 52.14 191-DS 5.56 0.6 179-DS 50.00 192-DS 16.16 180-DS 10.66 193-DS 9.36 181-DS 13.64 194-DS 21.14 0.4 182-DS 29.54 195-DS 23.80 183-DS 34.39 196-DS 28.09 0.2 184-DS 7.50 197-DS 42.79 Difference 185-DS 5.75 198-DS 50.00 0 186-DS 2.86 199-DS 49.38 187-DS 14.49 200-DS 2.35 −0.2 188-DS 51.94 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 319 chemnitz 10.2415/DS-BILI-X2DE-CLEF2007.CHEMNITZ.CUT_DS_BILI_EN2DE_MERGED_THES DS-BILI-X2DE-CLEF2007 Overall statistics for 25 queries : Priority 4 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 24,999 Source Language English Relevant 3,689 Topic Fields title, description Relevant retrieved 2,768 Pooled true Geometric Mean Average Precision 0.1601 (See overleaf for description) Binary Preference (BPREF) 0.3291 Interploated Recall (%) Precision Averages (%) Domain−Specific Bilingual German Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 75.26 CUT_DS_BILI_EN2DE_MERGED_THES 10 49.94 90% 20 41.19 80% 30 36.24 40 32.05 70% 50 27.51 60% 60 23.25 Precision 70 17.41 50% 80 11.39 40% 90 5.85 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 27.21 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Bilingual German Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.7572 Minimum 0.0081 First Quartile 0.0776 Second Quartile 0.1776 Third Quartile 0.4564 Interquartile range 0.3788 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.2721 Domain−Specific Bilingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.2175 5 Number of Topics of the Experiment Lower Outlier Threshold 0.0081 4 Upper Outlier Threshold 0.7572 3 Mean With No Outliers 0.2721 2 Std With No Outliers 0.2175 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Bilingual German Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries CUT_DS_BILI_EN2DE_MERGED_THES 176-DS 16.25 189-DS 4.46 0.8 177-DS 17.21 190-DS 75.72 178-DS 45.45 191-DS 2.42 0.6 179-DS 46.20 192-DS 12.20 180-DS 53.97 193-DS 17.13 181-DS 9.14 194-DS 29.29 0.4 182-DS 61.15 195-DS 37.84 183-DS 17.76 196-DS 37.91 0.2 184-DS 5.70 197-DS 33.32 Difference 185-DS 2.83 198-DS 48.03 0 186-DS 1.41 199-DS 44.37 187-DS 8.45 200-DS 0.81 −0.2 188-DS 51.30 −0.4 −0.6 −0.8 −1 176−DS177−DS178−DS179−DS180−DS181−DS182−DS183−DS184−DS185−DS186−DS187−DS188−DS189−DS190−DS191−DS192−DS193−DS194−DS195−DS196−DS197−DS198−DS199−DS200−DS Topic Identifier 320 chemnitz 10.2415/DS-BILI-X2DE-CLEF2007.CHEMNITZ.CUT_DS_BILI_EN2DE_MERGED_THES DS-BILI-X2DE-CLEF2007 Bilingual EN2DE merged structured and unstructured indizes, translated with Google translate (beta) and the provided thesaurus Docs Cutoff Levels Precision at DCL (%) Domain−Specific Bilingual German Task − Retrieved documents vs Mean Precision 100% 5 docs 56.80 CUT_DS_BILI_EN2DE_MERGED_THES 10 docs 52.80 90% 15 docs 51.47 80% 20 docs 46.60 30 docs 45.20 70% 100 docs 37.84 60% 200 docs 29.54 Precision 500 docs 18.49 50% 1000 docs 11.07 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 31.34 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Bilingual German Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.6827 Minimum 0.0286 First Quartile 0.1171 Second Quartile 0.3057 Third Quartile 0.4991 Interquartile range 0.3820 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.3134 Domain−Specific Bilingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.2044 4 Number of Topics of the Experiment 3.5 Lower Outlier Threshold 0.0286 3 Upper Outlier Threshold 0.6827 2.5 Mean With No Outliers 0.3134 2 1.5 Std With No Outliers 0.2044 1 0.5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Bilingual German Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries CUT_DS_BILI_EN2DE_MERGED_THES 176-DS 24.72 189-DS 7.69 0.8 177-DS 24.24 190-DS 68.27 178-DS 48.57 191-DS 5.56 0.6 179-DS 50.00 192-DS 18.18 180-DS 53.69 193-DS 22.13 181-DS 13.64 194-DS 43.09 0.4 182-DS 60.14 195-DS 49.87 183-DS 30.57 196-DS 42.70 0.2 184-DS 7.50 197-DS 42.29 Difference 185-DS 5.75 198-DS 50.44 0 186-DS 2.86 199-DS 43.21 187-DS 13.04 200-DS 3.53 −0.2 188-DS 51.94 −0.4 −0.6 −0.8 −1 176−DS177−DS178−DS179−DS180−DS181−DS182−DS183−DS184−DS185−DS186−DS187−DS188−DS189−DS190−DS191−DS192−DS193−DS194−DS195−DS196−DS197−DS198−DS199−DS200−DS Topic Identifier 321 chemnitz 10.2415/DS-BILI-X2DE-CLEF2007.CHEMNITZ.CUT_DS_BILI_RU2DE_MERGED DS-BILI-X2DE-CLEF2007 Overall statistics for 25 queries : Priority 1 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 24,999 Source Language Russian Relevant 3,689 Topic Fields title, description Relevant retrieved 1,970 Pooled true Geometric Mean Average Precision 0.0327 (See overleaf for description) Binary Preference (BPREF) 0.2468 Interploated Recall (%) Precision Averages (%) Domain−Specific Bilingual German Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 54.77 CUT_DS_BILI_RU2DE_MERGED 10 36.88 90% 20 33.22 80% 30 26.60 40 22.58 70% 50 18.93 60% 60 13.22 Precision 70 9.20 50% 80 6.55 40% 90 3.04 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 18.83 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Bilingual German Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.7689 Minimum 0.0000 First Quartile 0.0041 Second Quartile 0.1271 Third Quartile 0.2925 Interquartile range 0.2884 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.1883 Domain−Specific Bilingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.2176 10 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 8 Upper Outlier Threshold 0.6515 6 Mean With No Outliers 0.1641 4 Std With No Outliers 0.1848 2 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Bilingual German Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries CUT_DS_BILI_RU2DE_MERGED 176-DS 50.40 189-DS 0.78 0.8 177-DS 12.71 190-DS 76.89 178-DS 28.38 191-DS 1.42 0.6 179-DS 0.47 192-DS 0.02 180-DS 20.00 193-DS 21.97 181-DS 65.15 194-DS 0.23 0.4 182-DS 0.16 195-DS 31.84 183-DS 7.89 196-DS 34.15 0.2 184-DS 19.17 197-DS 22.23 Difference 185-DS 0.00 198-DS 46.34 0 186-DS 4.92 199-DS 0.04 187-DS 6.45 200-DS 0.12 −0.2 188-DS 19.09 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS197−DS 198−DS 199−DS 200−DS Topic Identifier 322 chemnitz 10.2415/DS-BILI-X2DE-CLEF2007.CHEMNITZ.CUT_DS_BILI_RU2DE_MERGED DS-BILI-X2DE-CLEF2007 Bilingual RU2DE merged structured and unstructured indizes, translated with PROMT translation service Docs Cutoff Levels Precision at DCL (%) Domain−Specific Bilingual German Task − Retrieved documents vs Mean Precision 100% 5 docs 36.80 CUT_DS_BILI_RU2DE_MERGED 10 docs 33.60 90% 15 docs 33.33 80% 20 docs 35.00 30 docs 33.73 70% 100 docs 27.12 60% 200 docs 20.54 Precision 500 docs 12.44 50% 1000 docs 7.88 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 22.77 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Bilingual German Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.7019 Minimum 0.0000 First Quartile 0.0189 Second Quartile 0.1818 Third Quartile 0.3446 Interquartile range 0.3257 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.2277 Domain−Specific Bilingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.2130 8 Number of Topics of the Experiment 7 Lower Outlier Threshold 0.0000 6 Upper Outlier Threshold 0.7019 5 Mean With No Outliers 0.2277 4 3 Std With No Outliers 0.2130 2 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Bilingual German Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries CUT_DS_BILI_RU2DE_MERGED 176-DS 52.81 189-DS 1.92 0.8 177-DS 18.18 190-DS 70.19 178-DS 35.71 191-DS 2.78 0.6 179-DS 5.56 192-DS 0.00 180-DS 31.56 193-DS 34.04 181-DS 61.36 194-DS 1.63 0.4 182-DS 1.78 195-DS 30.89 183-DS 16.56 196-DS 41.57 0.2 184-DS 31.25 197-DS 33.33 Difference 185-DS 0.00 198-DS 49.56 0 186-DS 8.57 199-DS 0.00 187-DS 8.70 200-DS 1.18 −0.2 188-DS 30.15 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS197−DS 198−DS 199−DS 200−DS Topic Identifier 323 chemnitz 10.2415/DS-BILI-X2DE-CLEF2007.CHEMNITZ.CUT_DS_BILI_RU2DE_MERGED_THES DS-BILI-X2DE-CLEF2007 Overall statistics for 25 queries : Priority 2 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 24,999 Source Language Russian Relevant 3,689 Topic Fields title, description Relevant retrieved 2,190 Pooled true Geometric Mean Average Precision 0.0388 (See overleaf for description) Binary Preference (BPREF) 0.2636 Interploated Recall (%) Precision Averages (%) Domain−Specific Bilingual German Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 57.73 CUT_DS_BILI_RU2DE_MERGED_THES 10 40.27 90% 20 35.62 80% 30 28.68 40 24.36 70% 50 20.45 60% 60 14.62 Precision 70 10.53 50% 80 6.60 40% 90 3.04 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 20.47 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Bilingual German Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.7689 Minimum 0.0000 First Quartile 0.0071 Second Quartile 0.1614 Third Quartile 0.3241 Interquartile range 0.3171 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.2047 Domain−Specific Bilingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.2202 10 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 8 Upper Outlier Threshold 0.7689 6 Mean With No Outliers 0.2047 4 Std With No Outliers 0.2202 2 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Bilingual German Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries CUT_DS_BILI_RU2DE_MERGED_THES 176-DS 50.40 189-DS 0.78 0.8 177-DS 16.14 190-DS 76.89 178-DS 28.38 191-DS 1.42 0.6 179-DS 0.47 192-DS 0.02 180-DS 24.65 193-DS 15.42 181-DS 65.15 194-DS 0.23 0.4 182-DS 20.28 195-DS 31.84 183-DS 7.89 196-DS 34.15 0.2 184-DS 19.17 197-DS 22.23 Difference 185-DS 0.00 198-DS 46.34 0 186-DS 0.86 199-DS 0.04 187-DS 6.45 200-DS 0.16 −0.2 188-DS 42.33 −0.4 −0.6 −0.8 −1 176−DS177−DS178−DS179−DS180−DS181−DS182−DS183−DS184−DS185−DS186−DS187−DS188−DS189−DS190−DS191−DS192−DS193−DS194−DS195−DS196−DS197−DS198−DS199−DS200−DS Topic Identifier 324 chemnitz 10.2415/DS-BILI-X2DE-CLEF2007.CHEMNITZ.CUT_DS_BILI_RU2DE_MERGED_THES DS-BILI-X2DE-CLEF2007 Bilingual RU2DE merged structured and unstructured indizes, translated with PROMT translation service and the provided thesaurus Docs Cutoff Levels Precision at DCL (%) Domain−Specific Bilingual German Task − Retrieved documents vs Mean Precision 100% 5 docs 43.20 CUT_DS_BILI_RU2DE_MERGED_THES 10 docs 38.40 90% 15 docs 37.87 80% 20 docs 39.20 30 docs 36.80 70% 100 docs 29.48 60% 200 docs 22.00 Precision 500 docs 13.66 50% 1000 docs 8.76 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 24.23 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Bilingual German Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.7019 Minimum 0.0000 First Quartile 0.0256 Second Quartile 0.2727 Third Quartile 0.3718 Interquartile range 0.3461 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.2423 Domain−Specific Bilingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.2141 8 Number of Topics of the Experiment 7 Lower Outlier Threshold 0.0000 6 Upper Outlier Threshold 0.7019 5 Mean With No Outliers 0.2423 4 3 Std With No Outliers 0.2141 2 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Bilingual German Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries CUT_DS_BILI_RU2DE_MERGED_THES 176-DS 52.81 189-DS 1.92 0.8 177-DS 27.27 190-DS 70.19 178-DS 35.71 191-DS 2.78 0.6 179-DS 5.56 192-DS 0.00 180-DS 34.84 193-DS 22.13 181-DS 61.36 194-DS 1.63 0.4 182-DS 28.47 195-DS 30.89 183-DS 16.56 196-DS 41.57 0.2 184-DS 31.25 197-DS 33.33 Difference 185-DS 0.00 198-DS 49.56 0 186-DS 2.86 199-DS 0.00 187-DS 8.70 200-DS 1.18 −0.2 188-DS 45.07 −0.4 −0.6 −0.8 −1 176−DS177−DS178−DS179−DS180−DS181−DS182−DS183−DS184−DS185−DS186−DS187−DS188−DS189−DS190−DS191−DS192−DS193−DS194−DS195−DS196−DS197−DS198−DS199−DS200−DS Topic Identifier 325 cheshire 10.2415/DS-BILI-X2DE-CLEF2007.CHESHIRE.BERKBENDECCP15 DS-BILI-X2DE-CLEF2007 Overall statistics for 25 queries : Priority 1 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language English Relevant 3,689 Topic Fields title, description Relevant retrieved 2,490 Pooled true Geometric Mean Average Precision 0.1297 EN->DE using powertrans retrieval using Class Binary Preference (BPREF) 0.2961 Clusters merged with T2FB Interploated Recall (%) Precision Averages (%) Domain−Specific Bilingual German Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 76.79 BERKBENDECCP15 10 46.65 90% 20 38.89 80% 30 33.85 40 28.29 70% 50 23.44 60% 60 18.80 Precision 70 12.76 50% 80 8.18 40% 90 1.78 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 24.12 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Bilingual German Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.6426 Minimum 0.0038 First Quartile 0.0635 Second Quartile 0.2316 Third Quartile 0.4263 Interquartile range 0.3629 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.2412 Domain−Specific Bilingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.1914 6 Number of Topics of the Experiment Lower Outlier Threshold 0.0038 5 Upper Outlier Threshold 0.6426 4 Mean With No Outliers 0.2412 3 Std With No Outliers 0.1914 2 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Bilingual German Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries BERKBENDECCP15 176-DS 0.38 189-DS 4.79 0.8 177-DS 8.41 190-DS 4.83 178-DS 23.16 191-DS 6.85 0.6 179-DS 37.97 192-DS 20.14 180-DS 45.39 193-DS 15.26 181-DS 48.71 194-DS 26.77 0.4 182-DS 33.46 195-DS 45.74 183-DS 48.47 196-DS 30.97 0.2 184-DS 24.38 197-DS 46.52 Difference 185-DS 1.03 198-DS 41.71 0 186-DS 1.64 199-DS 14.19 187-DS 7.28 200-DS 0.68 −0.2 188-DS 64.26 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 326 cheshire 10.2415/DS-BILI-X2DE-CLEF2007.CHESHIRE.BERKBENDECCP15 DS-BILI-X2DE-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Bilingual German Task − Retrieved documents vs Mean Precision 100% 5 docs 58.40 BERKBENDECCP15 10 docs 54.40 90% 15 docs 50.13 80% 20 docs 46.80 30 docs 42.80 70% 100 docs 33.60 60% 200 docs 26.30 Precision 500 docs 16.09 50% 1000 docs 9.96 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 28.17 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Bilingual German Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.6149 Minimum 0.0225 First Quartile 0.1275 Second Quartile 0.2626 Third Quartile 0.4577 Interquartile range 0.3302 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.2817 Domain−Specific Bilingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.1818 6 Number of Topics of the Experiment Lower Outlier Threshold 0.0225 5 Upper Outlier Threshold 0.6149 4 Mean With No Outliers 0.2817 3 Std With No Outliers 0.1818 2 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Bilingual German Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries BERKBENDECCP15 176-DS 2.25 189-DS 7.69 0.8 177-DS 18.18 190-DS 11.86 178-DS 26.43 191-DS 13.89 0.6 179-DS 41.27 192-DS 26.26 180-DS 47.54 193-DS 24.68 181-DS 47.73 194-DS 39.02 0.4 182-DS 40.21 195-DS 49.62 183-DS 49.04 196-DS 37.08 0.2 184-DS 25.00 197-DS 49.75 Difference 185-DS 3.45 198-DS 45.18 0 186-DS 2.86 199-DS 17.28 187-DS 13.04 200-DS 3.53 −0.2 188-DS 61.49 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 327 cheshire 10.2415/DS-BILI-X2DE-CLEF2007.CHESHIRE.BERKBENDETHP7 DS-BILI-X2DE-CLEF2007 Overall statistics for 25 queries : Priority 2 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language English Relevant 3,689 Topic Fields title, description Relevant retrieved 2,537 Pooled true Geometric Mean Average Precision 0.1337 EN->DE using powertrans retrieval using thesaurus Binary Preference (BPREF) 0.3093 lookup merged with T2FB Interploated Recall (%) Precision Averages (%) Domain−Specific Bilingual German Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 77.48 BERKBENDETHP7 10 47.58 90% 20 39.88 80% 30 35.61 40 29.72 70% 50 24.83 60% 60 20.31 Precision 70 14.75 50% 80 9.58 40% 90 1.63 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 25.14 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Bilingual German Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.6192 Minimum 0.0039 First Quartile 0.0684 Second Quartile 0.2364 Third Quartile 0.4501 Interquartile range 0.3817 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.2514 Domain−Specific Bilingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.1946 5 Number of Topics of the Experiment Lower Outlier Threshold 0.0039 4 Upper Outlier Threshold 0.6192 3 Mean With No Outliers 0.2514 2 Std With No Outliers 0.1946 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Bilingual German Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries BERKBENDETHP7 176-DS 0.39 189-DS 4.36 0.8 177-DS 7.46 190-DS 5.31 178-DS 46.16 191-DS 7.35 0.6 179-DS 40.11 192-DS 20.28 180-DS 44.72 193-DS 14.10 181-DS 47.84 194-DS 28.89 0.4 182-DS 32.92 195-DS 46.24 183-DS 47.61 196-DS 31.53 0.2 184-DS 23.64 197-DS 44.02 Difference 185-DS 1.01 198-DS 45.88 0 186-DS 1.56 199-DS 16.89 187-DS 7.77 200-DS 0.63 −0.2 188-DS 61.92 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 328 cheshire 10.2415/DS-BILI-X2DE-CLEF2007.CHESHIRE.BERKBENDETHP7 DS-BILI-X2DE-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Bilingual German Task − Retrieved documents vs Mean Precision 100% 5 docs 59.20 BERKBENDETHP7 10 docs 54.40 90% 15 docs 50.40 80% 20 docs 47.20 30 docs 43.07 70% 100 docs 34.56 60% 200 docs 26.48 Precision 500 docs 16.51 50% 1000 docs 10.15 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 29.19 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Bilingual German Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.6000 Minimum 0.0225 First Quartile 0.1336 Second Quartile 0.2750 Third Quartile 0.4728 Interquartile range 0.3392 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.2919 Domain−Specific Bilingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.1862 6 Number of Topics of the Experiment Lower Outlier Threshold 0.0225 5 Upper Outlier Threshold 0.6000 4 Mean With No Outliers 0.2919 3 Std With No Outliers 0.1862 2 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Bilingual German Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries BERKBENDETHP7 176-DS 2.25 189-DS 7.69 0.8 177-DS 16.67 190-DS 13.46 178-DS 52.14 191-DS 13.89 0.6 179-DS 41.27 192-DS 25.25 180-DS 47.13 193-DS 24.26 181-DS 47.73 194-DS 40.65 0.4 182-DS 37.01 195-DS 49.11 183-DS 48.41 196-DS 40.45 0.2 184-DS 27.50 197-DS 48.26 Difference 185-DS 3.45 198-DS 46.49 0 186-DS 2.86 199-DS 17.28 187-DS 13.04 200-DS 3.53 −0.2 188-DS 60.00 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 329 cheshire 10.2415/DS-BILI-X2DE-CLEF2007.CHESHIRE.BERKBRUDECCP15 DS-BILI-X2DE-CLEF2007 Overall statistics for 25 queries : Priority 3 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language Russian Relevant 3,689 Topic Fields title, description Relevant retrieved 1,771 Pooled true Geometric Mean Average Precision 0.0207 RU->DE using powertrans translation with Class Binary Preference (BPREF) 0.1996 Cluster lookup merged with T2FB Interploated Recall (%) Precision Averages (%) Domain−Specific Bilingual German Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 50.23 BERKBRUDECCP15 10 29.62 90% 20 24.58 80% 30 20.49 40 17.90 70% 50 14.90 60% 60 12.22 Precision 70 9.02 50% 80 5.84 40% 90 1.43 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 15.20 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Bilingual German Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.5820 Minimum 0.0000 First Quartile 0.0015 Second Quartile 0.0582 Third Quartile 0.3227 Interquartile range 0.3212 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.1520 Domain−Specific Bilingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.1937 15 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 Upper Outlier Threshold 0.5820 10 Mean With No Outliers 0.1520 Std With No Outliers 0.1937 5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Bilingual German Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries BERKBRUDECCP15 176-DS 0.06 189-DS 0.03 0.8 177-DS 1.52 190-DS 47.62 178-DS 0.10 191-DS 7.27 0.6 179-DS 38.31 192-DS 15.24 180-DS 0.17 193-DS 24.23 181-DS 54.43 194-DS 1.82 0.4 182-DS 32.16 195-DS 0.02 183-DS 7.10 196-DS 0.00 0.2 184-DS 39.55 197-DS 32.61 Difference 185-DS 1.54 198-DS 7.46 0 186-DS 2.24 199-DS 0.02 187-DS 5.82 200-DS 2.50 −0.2 188-DS 58.20 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 330 cheshire 10.2415/DS-BILI-X2DE-CLEF2007.CHESHIRE.BERKBRUDECCP15 DS-BILI-X2DE-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Bilingual German Task − Retrieved documents vs Mean Precision 100% 5 docs 32.00 BERKBRUDECCP15 10 docs 31.60 90% 15 docs 28.27 80% 20 docs 26.60 30 docs 26.13 70% 100 docs 22.00 60% 200 docs 16.96 Precision 500 docs 10.86 50% 1000 docs 7.08 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 18.58 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Bilingual German Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.5731 Minimum 0.0000 First Quartile 0.0094 Second Quartile 0.1111 Third Quartile 0.3941 Interquartile range 0.3847 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.1858 Domain−Specific Bilingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.2017 10 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 8 Upper Outlier Threshold 0.5731 6 Mean With No Outliers 0.1858 4 Std With No Outliers 0.2017 2 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Bilingual German Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries BERKBRUDECCP15 176-DS 0.00 189-DS 0.00 0.8 177-DS 4.55 190-DS 52.24 178-DS 0.71 191-DS 11.11 0.6 179-DS 41.27 192-DS 22.22 180-DS 2.87 193-DS 33.62 181-DS 56.82 194-DS 7.32 0.4 182-DS 38.79 195-DS 1.01 183-DS 15.29 196-DS 0.00 0.2 184-DS 41.25 197-DS 41.29 Difference 185-DS 1.15 198-DS 17.11 0 186-DS 0.00 199-DS 0.00 187-DS 11.59 200-DS 7.06 −0.2 188-DS 57.31 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 331 cheshire 10.2415/DS-BILI-X2DE-CLEF2007.CHESHIRE.BERKBRUDETHP7 DS-BILI-X2DE-CLEF2007 Overall statistics for 25 queries : Priority 4 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language Russian Relevant 3,689 Topic Fields title, description Relevant retrieved 1,789 Pooled true Geometric Mean Average Precision 0.0216 RU->DE using powertrans translation with Thesaurus Binary Preference (BPREF) 0.1965 lookup merged with T2FB Interploated Recall (%) Precision Averages (%) Domain−Specific Bilingual German Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 49.82 BERKBRUDETHP7 10 28.81 90% 20 24.86 80% 30 20.35 40 17.27 70% 50 14.60 60% 60 11.81 Precision 70 8.87 50% 80 6.75 40% 90 1.64 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 15.01 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Bilingual German Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.5200 Minimum 0.0000 First Quartile 0.0016 Second Quartile 0.0618 Third Quartile 0.3167 Interquartile range 0.3151 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.1501 Domain−Specific Bilingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.1878 15 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 Upper Outlier Threshold 0.5200 10 Mean With No Outliers 0.1501 Std With No Outliers 0.1878 5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Bilingual German Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries BERKBRUDETHP7 176-DS 0.07 189-DS 0.05 0.8 177-DS 1.73 190-DS 51.31 178-DS 0.09 191-DS 7.74 0.6 179-DS 39.41 192-DS 14.69 180-DS 0.18 193-DS 24.58 181-DS 48.19 194-DS 2.35 0.4 182-DS 32.99 195-DS 0.02 183-DS 6.70 196-DS 0.00 0.2 184-DS 42.17 197-DS 31.23 Difference 185-DS 1.55 198-DS 7.96 0 186-DS 1.50 199-DS 0.02 187-DS 6.18 200-DS 2.53 −0.2 188-DS 52.00 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 332 cheshire 10.2415/DS-BILI-X2DE-CLEF2007.CHESHIRE.BERKBRUDETHP7 DS-BILI-X2DE-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Bilingual German Task − Retrieved documents vs Mean Precision 100% 5 docs 32.00 BERKBRUDETHP7 10 docs 32.00 90% 15 docs 29.07 80% 20 docs 27.40 30 docs 25.60 70% 100 docs 21.24 60% 200 docs 16.82 Precision 500 docs 11.08 50% 1000 docs 7.16 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 18.59 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Bilingual German Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.5481 Minimum 0.0000 First Quartile 0.0094 Second Quartile 0.1304 Third Quartile 0.4009 Interquartile range 0.3915 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.1859 Domain−Specific Bilingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.1960 10 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 8 Upper Outlier Threshold 0.5481 6 Mean With No Outliers 0.1859 4 Std With No Outliers 0.1960 2 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Bilingual German Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries BERKBRUDETHP7 176-DS 0.00 189-DS 0.00 0.8 177-DS 4.55 190-DS 54.81 178-DS 0.71 191-DS 13.89 0.6 179-DS 42.06 192-DS 20.20 180-DS 2.87 193-DS 35.32 181-DS 47.73 194-DS 8.13 0.4 182-DS 39.86 195-DS 1.01 183-DS 15.29 196-DS 0.00 0.2 184-DS 43.75 197-DS 40.80 Difference 185-DS 1.15 198-DS 18.86 0 186-DS 0.00 199-DS 0.00 187-DS 13.04 200-DS 7.06 −0.2 188-DS 53.73 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 333 xerox 10.2415/DS-BILI-X2DE-CLEF2007.XEROX.XRCEE2DHCGELE DS-BILI-X2DE-CLEF2007 Overall statistics for 25 queries : Priority 1 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language English Relevant 3,689 Topic Fields title, description Relevant retrieved 3,048 Pooled true Geometric Mean Average Precision 0.2417 Dict Adapt Lexical Entailment Binary Preference (BPREF) 0.4349 Interploated Recall (%) Precision Averages (%) Domain−Specific Bilingual German Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 84.63 XRCEE2DHCGELE 10 65.26 90% 20 56.81 80% 30 51.11 40 46.04 70% 50 40.32 60% 60 34.80 Precision 70 29.31 50% 80 23.24 40% 90 10.51 30% 100 1.59 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 39.05 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Bilingual German Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.8061 Minimum 0.0053 First Quartile 0.1853 Second Quartile 0.4487 Third Quartile 0.5798 Interquartile range 0.3944 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.3905 Domain−Specific Bilingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.2432 4 Number of Topics of the Experiment 3.5 Lower Outlier Threshold 0.0053 3 Upper Outlier Threshold 0.8061 2.5 Mean With No Outliers 0.3905 2 1.5 Std With No Outliers 0.2432 1 0.5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Bilingual German Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries XRCEE2DHCGELE 176-DS 80.61 189-DS 11.69 0.8 177-DS 20.30 190-DS 74.56 178-DS 0.58 191-DS 23.55 0.6 179-DS 53.63 192-DS 26.16 180-DS 59.59 193-DS 43.06 181-DS 58.90 194-DS 21.86 0.4 182-DS 39.12 195-DS 55.45 183-DS 64.45 196-DS 49.34 0.2 184-DS 54.01 197-DS 57.67 Difference 185-DS 0.53 198-DS 44.87 0 186-DS 4.71 199-DS 62.42 187-DS 13.23 200-DS 4.15 −0.2 188-DS 51.76 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 334 xerox 10.2415/DS-BILI-X2DE-CLEF2007.XEROX.XRCEE2DHCGELE DS-BILI-X2DE-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Bilingual German Task − Retrieved documents vs Mean Precision 100% 5 docs 64.80 XRCEE2DHCGELE 10 docs 64.40 90% 15 docs 62.40 80% 20 docs 61.20 30 docs 57.33 70% 100 docs 45.52 60% 200 docs 34.44 Precision 500 docs 20.34 50% 1000 docs 12.19 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 39.75 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Bilingual German Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.7303 Minimum 0.0115 First Quartile 0.2411 Second Quartile 0.4737 Third Quartile 0.5556 Interquartile range 0.3145 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.3975 Domain−Specific Bilingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.2202 4 Number of Topics of the Experiment 3.5 Lower Outlier Threshold 0.0115 3 Upper Outlier Threshold 0.7303 2.5 Mean With No Outliers 0.3975 2 1.5 Std With No Outliers 0.2202 1 0.5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Bilingual German Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries XRCEE2DHCGELE 176-DS 73.03 189-DS 15.38 0.8 177-DS 28.79 190-DS 67.31 178-DS 2.14 191-DS 27.78 0.6 179-DS 55.56 192-DS 27.27 180-DS 63.11 193-DS 46.81 181-DS 59.09 194-DS 26.83 0.4 182-DS 41.28 195-DS 53.16 183-DS 63.06 196-DS 51.69 0.2 184-DS 53.75 197-DS 54.73 Difference 185-DS 1.15 198-DS 47.37 0 186-DS 2.86 199-DS 55.56 187-DS 15.94 200-DS 10.59 −0.2 188-DS 49.55 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 335 xerox 10.2415/DS-BILI-X2DE-CLEF2007.XEROX.XRCEE2DHCGEPRFLE DS-BILI-X2DE-CLEF2007 Overall statistics for 25 queries : Priority 2 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language English Relevant 3,689 Topic Fields title, description Relevant retrieved 3,162 Pooled true Geometric Mean Average Precision 0.2715 Dico Adapt PRF Lexical Entailment Binary Preference (BPREF) 0.4814 Interploated Recall (%) Precision Averages (%) Domain−Specific Bilingual German Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 75.86 XRCEE2DHCGEPRFLE 10 69.81 90% 20 63.23 80% 30 57.08 40 51.23 70% 50 46.38 60% 60 41.53 Precision 70 36.00 50% 80 28.12 40% 90 18.38 30% 100 1.54 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 44.47 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Bilingual German Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.8494 Minimum 0.0102 First Quartile 0.1594 Second Quartile 0.5435 Third Quartile 0.6558 Interquartile range 0.4964 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.4447 Domain−Specific Bilingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.2753 4 Number of Topics of the Experiment 3.5 Lower Outlier Threshold 0.0102 3 Upper Outlier Threshold 0.8494 2.5 Mean With No Outliers 0.4447 2 1.5 Std With No Outliers 0.2753 1 0.5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Bilingual German Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries XRCEE2DHCGEPRFLE 176-DS 84.94 189-DS 9.00 0.8 177-DS 20.36 190-DS 70.74 178-DS 1.17 191-DS 17.79 0.6 179-DS 51.38 192-DS 56.62 180-DS 68.68 193-DS 75.85 181-DS 64.55 194-DS 38.40 0.4 182-DS 48.45 195-DS 45.32 183-DS 77.50 196-DS 54.35 0.2 184-DS 70.30 197-DS 60.04 Difference 185-DS 1.93 198-DS 56.12 0 186-DS 1.02 199-DS 58.57 187-DS 10.39 200-DS 4.92 −0.2 188-DS 63.36 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 336 xerox 10.2415/DS-BILI-X2DE-CLEF2007.XEROX.XRCEE2DHCGEPRFLE DS-BILI-X2DE-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Bilingual German Task − Retrieved documents vs Mean Precision 100% 5 docs 67.20 XRCEE2DHCGEPRFLE 10 docs 68.00 90% 15 docs 67.20 80% 20 docs 64.80 30 docs 61.47 70% 100 docs 50.72 60% 200 docs 37.40 Precision 500 docs 21.74 50% 1000 docs 12.65 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 43.86 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Bilingual German Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.7978 Minimum 0.0000 First Quartile 0.2287 Second Quartile 0.5169 Third Quartile 0.6183 Interquartile range 0.3897 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.4386 Domain−Specific Bilingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.2370 3 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 2.5 Upper Outlier Threshold 0.7978 2 Mean With No Outliers 0.4386 1.5 Std With No Outliers 0.2370 1 0.5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Bilingual German Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries XRCEE2DHCGEPRFLE 176-DS 79.78 189-DS 9.62 0.8 177-DS 25.76 190-DS 66.67 178-DS 4.29 191-DS 25.00 0.6 179-DS 49.21 192-DS 52.53 180-DS 64.75 193-DS 68.09 181-DS 56.82 194-DS 43.09 0.4 182-DS 49.82 195-DS 47.09 183-DS 72.61 196-DS 51.69 0.2 184-DS 63.75 197-DS 55.22 Difference 185-DS 5.75 198-DS 57.02 0 186-DS 0.00 199-DS 54.32 187-DS 15.94 200-DS 16.47 −0.2 188-DS 61.19 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 337 xerox 10.2415/DS-BILI-X2DE-CLEF2007.XEROX.XRCEE2DHECGPRFLE DS-BILI-X2DE-CLEF2007 Overall statistics for 25 queries : Priority 3 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language English Relevant 3,689 Topic Fields title, description Relevant retrieved 3,208 Pooled true Geometric Mean Average Precision 0.2885 Dico Adapt PRF Lexical Entailment Binary Preference (BPREF) 0.4908 Interploated Recall (%) Precision Averages (%) Domain−Specific Bilingual German Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 83.26 XRCEE2DHECGPRFLE 10 70.63 90% 20 63.81 80% 30 58.48 40 52.95 70% 50 47.69 60% 60 41.93 Precision 70 36.80 50% 80 30.54 40% 90 17.97 30% 100 1.33 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 45.68 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Bilingual German Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.8509 Minimum 0.0059 First Quartile 0.1695 Second Quartile 0.5945 Third Quartile 0.6339 Interquartile range 0.4644 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.4568 Domain−Specific Bilingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.2738 6 Number of Topics of the Experiment Lower Outlier Threshold 0.0059 5 Upper Outlier Threshold 0.8509 4 Mean With No Outliers 0.4568 3 Std With No Outliers 0.2738 2 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Bilingual German Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries XRCEE2DHECGPRFLE 176-DS 85.09 189-DS 15.44 0.8 177-DS 18.26 190-DS 80.40 178-DS 0.59 191-DS 12.36 0.6 179-DS 61.21 192-DS 59.45 180-DS 70.74 193-DS 69.40 181-DS 60.46 194-DS 15.78 0.4 182-DS 61.15 195-DS 57.87 183-DS 68.51 196-DS 61.68 0.2 184-DS 71.84 197-DS 54.37 Difference 185-DS 3.22 198-DS 60.55 0 186-DS 0.99 199-DS 61.38 187-DS 17.34 200-DS 20.59 −0.2 188-DS 53.40 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 338 xerox 10.2415/DS-BILI-X2DE-CLEF2007.XEROX.XRCEE2DHECGPRFLE DS-BILI-X2DE-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Bilingual German Task − Retrieved documents vs Mean Precision 100% 5 docs 71.20 XRCEE2DHECGPRFLE 10 docs 69.20 90% 15 docs 67.20 80% 20 docs 65.40 30 docs 62.80 70% 100 docs 51.40 60% 200 docs 38.56 Precision 500 docs 21.99 50% 1000 docs 12.83 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 45.18 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Bilingual German Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.7865 Minimum 0.0286 First Quartile 0.2443 Second Quartile 0.5570 Third Quartile 0.6228 Interquartile range 0.3785 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.4518 Domain−Specific Bilingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.2265 6 Number of Topics of the Experiment Lower Outlier Threshold 0.0286 5 Upper Outlier Threshold 0.7865 4 Mean With No Outliers 0.4518 3 Std With No Outliers 0.2265 2 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Bilingual German Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries XRCEE2DHECGPRFLE 176-DS 78.65 189-DS 25.00 0.8 177-DS 22.73 190-DS 75.00 178-DS 2.86 191-DS 19.44 0.6 179-DS 61.90 192-DS 57.58 180-DS 65.57 193-DS 63.40 181-DS 47.73 194-DS 18.70 0.4 182-DS 58.36 195-DS 55.70 183-DS 64.33 196-DS 57.30 0.2 184-DS 63.75 197-DS 51.24 Difference 185-DS 11.49 198-DS 58.33 0 186-DS 2.86 199-DS 56.79 187-DS 27.54 200-DS 29.41 −0.2 188-DS 53.73 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 339 xerox 10.2415/DS-BILI-X2DE-CLEF2007.XEROX.XRCEE2DMATRAX DS-BILI-X2DE-CLEF2007 Overall statistics for 25 queries : Priority 4 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language English Relevant 3,689 Topic Fields title, description Relevant retrieved 2,976 Pooled true Geometric Mean Average Precision 0.2104 Matrax language Models Binary Preference (BPREF) 0.4444 Interploated Recall (%) Precision Averages (%) Domain−Specific Bilingual German Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 78.23 XRCEE2DMATRAX 10 62.99 90% 20 58.37 80% 30 52.55 40 47.64 70% 50 41.39 60% 60 36.89 Precision 70 30.63 50% 80 23.81 40% 90 16.11 30% 100 0.46 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 40.01 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Bilingual German Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.8364 Minimum 0.0010 First Quartile 0.1072 Second Quartile 0.3879 Third Quartile 0.6647 Interquartile range 0.5575 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.4001 Domain−Specific Bilingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.2866 4 Number of Topics of the Experiment 3.5 Lower Outlier Threshold 0.0010 3 Upper Outlier Threshold 0.8364 2.5 Mean With No Outliers 0.4001 2 1.5 Std With No Outliers 0.2866 1 0.5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Bilingual German Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries XRCEE2DMATRAX 176-DS 79.21 189-DS 10.17 0.8 177-DS 12.73 190-DS 83.64 178-DS 75.67 191-DS 6.38 0.6 179-DS 50.58 192-DS 38.59 180-DS 66.74 193-DS 10.90 181-DS 64.95 194-DS 4.21 0.4 182-DS 63.77 195-DS 37.98 183-DS 66.38 196-DS 19.93 0.2 184-DS 52.98 197-DS 68.32 Difference 185-DS 0.10 198-DS 38.79 0 186-DS 0.40 199-DS 59.57 187-DS 14.29 200-DS 7.00 −0.2 188-DS 66.85 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 340 xerox 10.2415/DS-BILI-X2DE-CLEF2007.XEROX.XRCEE2DMATRAX DS-BILI-X2DE-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Bilingual German Task − Retrieved documents vs Mean Precision 100% 5 docs 66.40 XRCEE2DMATRAX 10 docs 64.00 90% 15 docs 60.80 80% 20 docs 59.00 30 docs 56.00 70% 100 docs 46.80 60% 200 docs 35.62 Precision 500 docs 20.50 50% 1000 docs 11.90 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 41.05 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Bilingual German Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.7821 Minimum 0.0000 First Quartile 0.1484 Second Quartile 0.4649 Third Quartile 0.6317 Interquartile range 0.4833 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.4105 Domain−Specific Bilingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.2548 4 Number of Topics of the Experiment 3.5 Lower Outlier Threshold 0.0000 3 Upper Outlier Threshold 0.7821 2.5 Mean With No Outliers 0.4105 2 1.5 Std With No Outliers 0.2548 1 0.5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Bilingual German Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries XRCEE2DMATRAX 176-DS 77.53 189-DS 13.46 0.8 177-DS 10.61 190-DS 78.21 178-DS 71.43 191-DS 11.11 0.6 179-DS 49.21 192-DS 43.43 180-DS 63.93 193-DS 18.30 181-DS 59.09 194-DS 7.32 0.4 182-DS 62.99 195-DS 45.82 183-DS 63.69 196-DS 33.71 0.2 184-DS 52.50 197-DS 65.17 Difference 185-DS 0.00 198-DS 46.49 0 186-DS 0.00 199-DS 54.32 187-DS 21.74 200-DS 15.29 −0.2 188-DS 60.90 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 341 xerox 10.2415/DS-BILI-X2DE-CLEF2007.XEROX.XRCEE2DMATRAXLE DS-BILI-X2DE-CLEF2007 Overall statistics for 25 queries : Priority 5 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language English Relevant 3,689 Topic Fields title, description Relevant retrieved 3,110 Pooled true Geometric Mean Average Precision 0.2326 matrax lexical entailment Binary Preference (BPREF) 0.4738 Interploated Recall (%) Precision Averages (%) Domain−Specific Bilingual German Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 75.54 XRCEE2DMATRAXLE 10 63.84 90% 20 59.16 80% 30 55.44 40 50.79 70% 50 46.29 60% 60 41.09 Precision 70 36.23 50% 80 28.52 40% 90 20.74 30% 100 2.05 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 43.36 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Bilingual German Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.8564 Minimum 0.0015 First Quartile 0.1450 Second Quartile 0.5124 Third Quartile 0.6913 Interquartile range 0.5463 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.4336 Domain−Specific Bilingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.2996 4 Number of Topics of the Experiment 3.5 Lower Outlier Threshold 0.0015 3 Upper Outlier Threshold 0.8564 2.5 Mean With No Outliers 0.4336 2 1.5 Std With No Outliers 0.2996 1 0.5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Bilingual German Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries XRCEE2DMATRAXLE 176-DS 80.74 189-DS 17.31 0.8 177-DS 14.38 190-DS 85.64 178-DS 78.23 191-DS 6.30 0.6 179-DS 51.24 192-DS 55.55 180-DS 68.69 193-DS 14.54 181-DS 70.46 194-DS 3.34 0.4 182-DS 65.18 195-DS 34.90 183-DS 74.37 196-DS 22.98 0.2 184-DS 67.46 197-DS 74.10 Difference 185-DS 0.15 198-DS 46.32 0 186-DS 0.46 199-DS 65.19 187-DS 15.49 200-DS 6.50 −0.2 188-DS 64.55 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 342 xerox 10.2415/DS-BILI-X2DE-CLEF2007.XEROX.XRCEE2DMATRAXLE DS-BILI-X2DE-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Bilingual German Task − Retrieved documents vs Mean Precision 100% 5 docs 62.40 XRCEE2DMATRAXLE 10 docs 65.20 90% 15 docs 60.27 80% 20 docs 60.20 30 docs 58.13 70% 100 docs 48.60 60% 200 docs 37.28 Precision 500 docs 21.49 50% 1000 docs 12.44 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 43.47 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Bilingual German Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.7788 Minimum 0.0000 First Quartile 0.2085 Second Quartile 0.5132 Third Quartile 0.6410 Interquartile range 0.4325 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.4347 Domain−Specific Bilingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.2607 4 Number of Topics of the Experiment 3.5 Lower Outlier Threshold 0.0000 3 Upper Outlier Threshold 0.7788 2.5 Mean With No Outliers 0.4347 2 1.5 Std With No Outliers 0.2607 1 0.5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Bilingual German Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries XRCEE2DMATRAXLE 176-DS 77.53 189-DS 25.00 0.8 177-DS 18.18 190-DS 77.88 178-DS 72.86 191-DS 11.11 0.6 179-DS 50.00 192-DS 54.55 180-DS 65.16 193-DS 22.55 181-DS 63.64 194-DS 2.44 0.4 182-DS 61.21 195-DS 45.57 183-DS 70.70 196-DS 30.34 0.2 184-DS 63.75 197-DS 67.66 Difference 185-DS 1.15 198-DS 51.32 0 186-DS 0.00 199-DS 59.26 187-DS 21.74 200-DS 12.94 −0.2 188-DS 60.30 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 343 xerox 10.2415/DS-BILI-X2DE-CLEF2007.XEROX.XRCEE2DMATRAXPRFLE DS-BILI-X2DE-CLEF2007 Overall statistics for 25 queries : Priority 6 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language English Relevant 3,689 Topic Fields title, description Relevant retrieved 3,097 Pooled true Geometric Mean Average Precision 0.2202 matrax prf lexical entailment Binary Preference (BPREF) 0.4692 Interploated Recall (%) Precision Averages (%) Domain−Specific Bilingual German Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 81.33 XRCEE2DMATRAXPRFLE 10 64.92 90% 20 59.78 80% 30 54.01 40 50.45 70% 50 45.02 60% 60 40.65 Precision 70 34.53 50% 80 27.04 40% 90 19.85 30% 100 1.16 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 42.98 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Bilingual German Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.8484 Minimum 0.0002 First Quartile 0.1606 Second Quartile 0.5479 Third Quartile 0.6881 Interquartile range 0.5276 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.4298 Domain−Specific Bilingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.2888 4 Number of Topics of the Experiment 3.5 Lower Outlier Threshold 0.0002 3 Upper Outlier Threshold 0.8484 2.5 Mean With No Outliers 0.4298 2 1.5 Std With No Outliers 0.2888 1 0.5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Bilingual German Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries XRCEE2DMATRAXPRFLE 176-DS 78.20 189-DS 32.12 0.8 177-DS 13.77 190-DS 84.84 178-DS 78.00 191-DS 7.53 0.6 179-DS 57.99 192-DS 64.63 180-DS 68.56 193-DS 17.73 181-DS 54.79 194-DS 3.37 0.4 182-DS 63.16 195-DS 33.19 183-DS 71.42 196-DS 20.38 0.2 184-DS 69.57 197-DS 72.04 Difference 185-DS 0.02 198-DS 36.83 0 186-DS 0.79 199-DS 61.38 187-DS 16.82 200-DS 5.01 −0.2 188-DS 62.37 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 344 xerox 10.2415/DS-BILI-X2DE-CLEF2007.XEROX.XRCEE2DMATRAXPRFLE DS-BILI-X2DE-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Bilingual German Task − Retrieved documents vs Mean Precision 100% 5 docs 70.40 XRCEE2DMATRAXPRFLE 10 docs 63.60 90% 15 docs 61.07 80% 20 docs 60.60 30 docs 57.33 70% 100 docs 48.16 60% 200 docs 36.56 Precision 500 docs 21.04 50% 1000 docs 12.39 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 42.69 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Bilingual German Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.7885 Minimum 0.0000 First Quartile 0.1901 Second Quartile 0.4561 Third Quartile 0.6306 Interquartile range 0.4405 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.4269 Domain−Specific Bilingual German Task − Distribution of the Topics of the Experiment Standard Deviation 0.2512 4 Number of Topics of the Experiment 3.5 Lower Outlier Threshold 0.0000 3 Upper Outlier Threshold 0.7885 2.5 Mean With No Outliers 0.4269 2 1.5 Std With No Outliers 0.2512 1 0.5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Bilingual German Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries XRCEE2DMATRAXPRFLE 176-DS 71.91 189-DS 36.54 0.8 177-DS 15.15 190-DS 78.85 178-DS 72.86 191-DS 13.89 0.6 179-DS 55.56 192-DS 62.63 180-DS 64.34 193-DS 24.26 181-DS 45.45 194-DS 3.25 0.4 182-DS 61.57 195-DS 43.04 183-DS 67.52 196-DS 25.84 0.2 184-DS 62.50 197-DS 65.17 Difference 185-DS 0.00 198-DS 45.61 0 186-DS 2.86 199-DS 56.79 187-DS 20.29 200-DS 11.76 −0.2 188-DS 59.70 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 345 chemnitz 10.2415/DS-BILI-X2EN-CLEF2007.CHEMNITZ.CUT_DS_BILI_DE2EN_MERGED DS-BILI-X2EN-CLEF2007 Overall statistics for 25 queries : Priority 2 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 24,999 Source Language German Relevant 4,530 Topic Fields title, description Relevant retrieved 2,703 Pooled true Geometric Mean Average Precision 0.1453 Bilingual DE2EN merged structured and unstructured Binary Preference (BPREF) 0.2545 indizes, translated with Google Translate (beta) Interploated Recall (%) Precision Averages (%) Domain−Specific Bilingual English Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 71.18 CUT_DS_BILI_DE2EN_MERGED 10 44.41 90% 20 35.48 80% 30 28.46 40 22.02 70% 50 17.99 60% 60 12.48 Precision 70 8.78 50% 80 1.88 40% 90 1.53 30% 100 0.57 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 19.88 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Bilingual English Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.5030 Minimum 0.0140 First Quartile 0.0936 Second Quartile 0.1787 Third Quartile 0.2829 Interquartile range 0.1893 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.1988 Domain−Specific Bilingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1305 4 Number of Topics of the Experiment 3.5 Lower Outlier Threshold 0.0140 3 Upper Outlier Threshold 0.5030 2.5 Mean With No Outliers 0.1988 2 1.5 Std With No Outliers 0.1305 1 0.5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Bilingual English Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries CUT_DS_BILI_DE2EN_MERGED 176-DS 28.05 189-DS 3.65 0.8 177-DS 4.13 190-DS 23.92 178-DS 14.23 191-DS 2.17 0.6 179-DS 22.43 192-DS 16.24 180-DS 44.37 193-DS 29.00 181-DS 29.81 194-DS 1.40 0.4 182-DS 5.58 195-DS 17.85 183-DS 17.87 196-DS 24.66 0.2 184-DS 26.91 197-DS 24.85 Difference 185-DS 10.99 198-DS 36.64 0 186-DS 7.59 199-DS 30.81 187-DS 50.30 200-DS 9.95 −0.2 188-DS 13.52 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 346 chemnitz 10.2415/DS-BILI-X2EN-CLEF2007.CHEMNITZ.CUT_DS_BILI_DE2EN_MERGED DS-BILI-X2EN-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Bilingual English Task − Retrieved documents vs Mean Precision 100% 5 docs 47.20 CUT_DS_BILI_DE2EN_MERGED 10 docs 48.40 90% 15 docs 45.07 80% 20 docs 43.80 30 docs 42.13 70% 100 docs 32.76 60% 200 docs 25.30 Precision 500 docs 16.82 50% 1000 docs 10.81 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 27.18 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Bilingual English Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.5513 Minimum 0.0617 First Quartile 0.1681 Second Quartile 0.2830 Third Quartile 0.3499 Interquartile range 0.1818 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.2718 Domain−Specific Bilingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1334 8 Number of Topics of the Experiment 7 Lower Outlier Threshold 0.0617 6 Upper Outlier Threshold 0.5513 5 Mean With No Outliers 0.2718 4 3 Std With No Outliers 0.1334 2 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Bilingual English Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries CUT_DS_BILI_DE2EN_MERGED 176-DS 34.44 189-DS 9.09 0.8 177-DS 7.02 190-DS 28.30 178-DS 20.73 191-DS 7.81 0.6 179-DS 27.52 192-DS 28.04 180-DS 50.53 193-DS 41.00 181-DS 38.89 194-DS 6.17 0.4 182-DS 17.11 195-DS 28.54 183-DS 29.14 196-DS 28.89 0.2 184-DS 33.15 197-DS 31.40 Difference 185-DS 25.98 198-DS 43.51 0 186-DS 9.43 199-DS 36.62 187-DS 55.13 200-DS 15.91 −0.2 188-DS 25.15 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 347 chemnitz 10.2415/DS-BILI-X2EN-CLEF2007.CHEMNITZ.CUT_DS_BILI_DE2EN_MERGED_THES DS-BILI-X2EN-CLEF2007 Overall statistics for 25 queries : Priority 3 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 24,999 Source Language German Relevant 4,530 Topic Fields title, description Relevant retrieved 2,696 Pooled true Geometric Mean Average Precision 0.1504 (See overleaf for description) Binary Preference (BPREF) 0.2547 Interploated Recall (%) Precision Averages (%) Domain−Specific Bilingual English Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 77.66 CUT_DS_BILI_DE2EN_MERGED_THES 10 45.14 90% 20 35.62 80% 30 29.12 40 23.38 70% 50 18.79 60% 60 13.00 Precision 70 8.28 50% 80 1.79 40% 90 1.42 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 20.37 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Bilingual English Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.5030 Minimum 0.0140 First Quartile 0.1014 Second Quartile 0.1853 Third Quartile 0.2849 Interquartile range 0.1835 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.2037 Domain−Specific Bilingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1350 5 Number of Topics of the Experiment Lower Outlier Threshold 0.0140 4 Upper Outlier Threshold 0.5030 3 Mean With No Outliers 0.2037 2 Std With No Outliers 0.1350 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Bilingual English Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries CUT_DS_BILI_DE2EN_MERGED_THES 176-DS 28.05 189-DS 3.65 0.8 177-DS 7.08 190-DS 25.00 178-DS 14.23 191-DS 2.17 0.6 179-DS 21.04 192-DS 16.31 180-DS 48.34 193-DS 38.48 181-DS 29.81 194-DS 1.40 0.4 182-DS 5.58 195-DS 19.03 183-DS 17.87 196-DS 24.66 0.2 184-DS 15.32 197-DS 24.85 Difference 185-DS 10.99 198-DS 36.64 0 186-DS 7.59 199-DS 30.81 187-DS 50.30 200-DS 11.56 −0.2 188-DS 18.53 −0.4 −0.6 −0.8 −1 176−DS177−DS178−DS179−DS180−DS181−DS182−DS183−DS184−DS185−DS186−DS187−DS188−DS189−DS190−DS191−DS192−DS193−DS194−DS195−DS196−DS197−DS198−DS199−DS200−DS Topic Identifier 348 chemnitz 10.2415/DS-BILI-X2EN-CLEF2007.CHEMNITZ.CUT_DS_BILI_DE2EN_MERGED_THES DS-BILI-X2EN-CLEF2007 Bilingual DE2EN merged structured and unstructured indizes, translated with Google Translate (beta) and the provided thesaurus Docs Cutoff Levels Precision at DCL (%) Domain−Specific Bilingual English Task − Retrieved documents vs Mean Precision 100% 5 docs 53.60 CUT_DS_BILI_DE2EN_MERGED_THES 10 docs 49.60 90% 15 docs 45.33 80% 20 docs 44.40 30 docs 42.67 70% 100 docs 34.08 60% 200 docs 25.78 Precision 500 docs 16.57 50% 1000 docs 10.78 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 27.44 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Bilingual English Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.5513 Minimum 0.0617 First Quartile 0.1700 Second Quartile 0.2642 Third Quartile 0.3499 Interquartile range 0.1799 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.2744 Domain−Specific Bilingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1343 8 Number of Topics of the Experiment 7 Lower Outlier Threshold 0.0617 6 Upper Outlier Threshold 0.5513 5 Mean With No Outliers 0.2744 4 3 Std With No Outliers 0.1343 2 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Bilingual English Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries CUT_DS_BILI_DE2EN_MERGED_THES 176-DS 34.44 189-DS 9.09 0.8 177-DS 15.79 190-DS 26.42 178-DS 20.73 191-DS 7.81 0.6 179-DS 31.19 192-DS 26.17 180-DS 54.01 193-DS 45.77 181-DS 38.89 194-DS 6.17 0.4 182-DS 17.11 195-DS 26.07 183-DS 29.14 196-DS 28.89 0.2 184-DS 20.33 197-DS 31.40 Difference 185-DS 25.98 198-DS 43.51 0 186-DS 9.43 199-DS 36.62 187-DS 55.13 200-DS 16.67 −0.2 188-DS 29.24 −0.4 −0.6 −0.8 −1 176−DS177−DS178−DS179−DS180−DS181−DS182−DS183−DS184−DS185−DS186−DS187−DS188−DS189−DS190−DS191−DS192−DS193−DS194−DS195−DS196−DS197−DS198−DS199−DS200−DS Topic Identifier 349 chemnitz 10.2415/DS-BILI-X2EN-CLEF2007.CHEMNITZ.CUT_DS_BILI_RU2EN_MERGED DS-BILI-X2EN-CLEF2007 Overall statistics for 25 queries : Priority 1 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 24,999 Source Language Russian Relevant 4,530 Topic Fields title, description Relevant retrieved 2,851 Pooled true Geometric Mean Average Precision 0.1502 Bilingual RU2EN merged structured and unstructured Binary Preference (BPREF) 0.3088 indizes, translated with Google Translate (beta) Interploated Recall (%) Precision Averages (%) Domain−Specific Bilingual English Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 72.47 CUT_DS_BILI_RU2EN_MERGED 10 51.62 90% 20 45.44 80% 30 38.11 40 31.81 70% 50 26.18 60% 60 18.40 Precision 70 11.70 50% 80 8.38 40% 90 4.47 30% 100 0.54 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 26.46 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Bilingual English Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.6596 Minimum 0.0034 First Quartile 0.0785 Second Quartile 0.2662 Third Quartile 0.4334 Interquartile range 0.3549 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.2646 Domain−Specific Bilingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.2034 5 Number of Topics of the Experiment Lower Outlier Threshold 0.0034 4 Upper Outlier Threshold 0.6596 3 Mean With No Outliers 0.2646 2 Std With No Outliers 0.2034 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Bilingual English Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries CUT_DS_BILI_RU2EN_MERGED 176-DS 65.96 189-DS 0.62 0.8 177-DS 4.46 190-DS 58.67 178-DS 1.78 191-DS 17.86 0.6 179-DS 43.02 192-DS 4.95 180-DS 56.59 193-DS 26.62 181-DS 53.00 194-DS 9.23 0.4 182-DS 8.04 195-DS 44.29 183-DS 44.72 196-DS 24.44 0.2 184-DS 28.31 197-DS 12.15 Difference 185-DS 0.34 198-DS 41.19 0 186-DS 7.27 199-DS 33.13 187-DS 35.49 200-DS 10.77 −0.2 188-DS 28.62 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS197−DS 198−DS 199−DS 200−DS Topic Identifier 350 chemnitz 10.2415/DS-BILI-X2EN-CLEF2007.CHEMNITZ.CUT_DS_BILI_RU2EN_MERGED DS-BILI-X2EN-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Bilingual English Task − Retrieved documents vs Mean Precision 100% 5 docs 53.60 CUT_DS_BILI_RU2EN_MERGED 10 docs 50.40 90% 15 docs 48.80 80% 20 docs 47.80 30 docs 47.60 70% 100 docs 38.56 60% 200 docs 29.18 Precision 500 docs 18.02 50% 1000 docs 11.40 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 31.46 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Bilingual English Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.6333 Minimum 0.0236 First Quartile 0.1635 Second Quartile 0.3662 Third Quartile 0.4526 Interquartile range 0.2890 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.3146 Domain−Specific Bilingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1820 4 Number of Topics of the Experiment 3.5 Lower Outlier Threshold 0.0236 3 Upper Outlier Threshold 0.6333 2.5 Mean With No Outliers 0.3146 2 1.5 Std With No Outliers 0.1820 1 0.5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Bilingual English Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries CUT_DS_BILI_RU2EN_MERGED 176-DS 63.33 189-DS 4.55 0.8 177-DS 12.28 190-DS 58.49 178-DS 7.93 191-DS 21.88 0.6 179-DS 49.54 192-DS 13.08 180-DS 58.56 193-DS 37.96 181-DS 44.44 194-DS 19.82 0.4 182-DS 18.42 195-DS 49.89 183-DS 47.02 196-DS 24.44 0.2 184-DS 38.72 197-DS 17.44 Difference 185-DS 2.36 198-DS 41.84 0 186-DS 11.32 199-DS 36.62 187-DS 44.67 200-DS 23.48 −0.2 188-DS 38.30 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS197−DS 198−DS 199−DS 200−DS Topic Identifier 351 cheshire 10.2415/DS-BILI-X2EN-CLEF2007.CHESHIRE.BERKBDEENCCP15 DS-BILI-X2EN-CLEF2007 Overall statistics for 25 queries : Priority 1 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language German Relevant 4,530 Topic Fields title, description Relevant retrieved 1,608 Pooled true Geometric Mean Average Precision 0.0195 DE->EN using powertrans retrieval using Class Binary Preference (BPREF) 0.1519 Clusters merged with T2FB Interploated Recall (%) Precision Averages (%) Domain−Specific Bilingual English Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 43.98 BERKBDEENCCP15 10 26.70 90% 20 19.27 80% 30 14.46 40 11.42 70% 50 8.61 60% 60 5.75 Precision 70 4.74 50% 80 2.42 40% 90 0.00 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10.96 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Bilingual English Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.5586 Minimum 0.0000 First Quartile 0.0119 Second Quartile 0.0527 Third Quartile 0.1158 Interquartile range 0.1040 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.1096 Domain−Specific Bilingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1551 15 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 Upper Outlier Threshold 0.2286 10 Mean With No Outliers 0.0492 Std With No Outliers 0.0574 5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Bilingual English Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries BERKBDEENCCP15 176-DS 32.43 189-DS 4.68 0.8 177-DS 1.45 190-DS 0.00 178-DS 5.91 191-DS 3.15 0.6 179-DS 22.86 192-DS 1.45 180-DS 36.00 193-DS 5.95 181-DS 15.51 194-DS 2.65 0.4 182-DS 0.02 195-DS 7.83 183-DS 1.19 196-DS 0.00 0.2 184-DS 1.18 197-DS 7.24 Difference 185-DS 5.27 198-DS 55.86 0 186-DS 10.27 199-DS 0.34 187-DS 0.03 200-DS 6.42 −0.2 188-DS 46.25 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 352 cheshire 10.2415/DS-BILI-X2EN-CLEF2007.CHESHIRE.BERKBDEENCCP15 DS-BILI-X2EN-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Bilingual English Task − Retrieved documents vs Mean Precision 100% 5 docs 30.40 BERKBDEENCCP15 10 docs 30.00 90% 15 docs 29.33 80% 20 docs 27.80 30 docs 27.47 70% 100 docs 21.68 60% 200 docs 15.66 Precision 500 docs 9.62 50% 1000 docs 6.43 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 15.39 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Bilingual English Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.5649 Minimum 0.0000 First Quartile 0.0587 Second Quartile 0.1220 Third Quartile 0.1753 Interquartile range 0.1166 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.1539 Domain−Specific Bilingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1508 8 Number of Topics of the Experiment 7 Lower Outlier Threshold 0.0000 6 Upper Outlier Threshold 0.2752 5 Mean With No Outliers 0.0980 4 3 Std With No Outliers 0.0738 2 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Bilingual English Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries BERKBDEENCCP15 176-DS 35.56 189-DS 9.09 0.8 177-DS 8.77 190-DS 0.00 178-DS 12.20 191-DS 7.81 0.6 179-DS 27.52 192-DS 5.61 180-DS 39.30 193-DS 15.40 181-DS 16.67 194-DS 7.05 0.4 182-DS 0.00 195-DS 16.40 183-DS 5.96 196-DS 0.00 0.2 184-DS 7.24 197-DS 19.19 Difference 185-DS 13.39 198-DS 56.49 0 186-DS 16.98 199-DS 1.41 187-DS 1.41 200-DS 13.64 −0.2 188-DS 47.66 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 353 cheshire 10.2415/DS-BILI-X2EN-CLEF2007.CHESHIRE.BERKBDEENTHP7 DS-BILI-X2EN-CLEF2007 Overall statistics for 25 queries : Priority 2 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language German Relevant 4,530 Topic Fields title, description Relevant retrieved 1,561 Pooled true Geometric Mean Average Precision 0.0197 DE->EN using powertrans translation and retrieval Binary Preference (BPREF) 0.1449 using Thesaurus lookup merged with T2FB Interploated Recall (%) Precision Averages (%) Domain−Specific Bilingual English Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 43.91 BERKBDEENTHP7 10 25.73 90% 20 18.56 80% 30 13.78 40 10.15 70% 50 8.10 60% 60 4.77 Precision 70 3.93 50% 80 2.52 40% 90 0.41 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10.43 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Bilingual English Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.5441 Minimum 0.0000 First Quartile 0.0133 Second Quartile 0.0487 Third Quartile 0.1228 Interquartile range 0.1096 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.1043 Domain−Specific Bilingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1443 15 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 Upper Outlier Threshold 0.2241 10 Mean With No Outliers 0.0492 Std With No Outliers 0.0582 5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Bilingual English Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries BERKBDEENTHP7 176-DS 30.96 189-DS 4.87 0.8 177-DS 1.45 190-DS 0.00 178-DS 6.37 191-DS 2.86 0.6 179-DS 22.41 192-DS 1.51 180-DS 38.97 193-DS 6.16 181-DS 16.97 194-DS 2.55 0.4 182-DS 0.01 195-DS 7.20 183-DS 1.81 196-DS 0.00 0.2 184-DS 0.95 197-DS 7.01 Difference 185-DS 3.53 198-DS 54.41 0 186-DS 10.72 199-DS 0.37 187-DS 0.08 200-DS 6.56 −0.2 188-DS 33.12 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 354 cheshire 10.2415/DS-BILI-X2EN-CLEF2007.CHESHIRE.BERKBDEENTHP7 DS-BILI-X2EN-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Bilingual English Task − Retrieved documents vs Mean Precision 100% 5 docs 30.40 BERKBDEENTHP7 10 docs 28.80 90% 15 docs 28.80 80% 20 docs 28.60 30 docs 26.40 70% 100 docs 20.44 60% 200 docs 15.40 Precision 500 docs 9.54 50% 1000 docs 6.24 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 15.34 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Bilingual English Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.5565 Minimum 0.0000 First Quartile 0.0665 Second Quartile 0.0927 Third Quartile 0.1823 Interquartile range 0.1158 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.1534 Domain−Specific Bilingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1449 8 Number of Topics of the Experiment 7 Lower Outlier Threshold 0.0000 6 Upper Outlier Threshold 0.3556 5 Mean With No Outliers 0.1116 4 3 Std With No Outliers 0.0899 2 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Bilingual English Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries BERKBDEENTHP7 176-DS 35.56 189-DS 9.09 0.8 177-DS 8.77 190-DS 0.00 178-DS 14.02 191-DS 7.81 0.6 179-DS 27.52 192-DS 6.54 180-DS 42.25 193-DS 16.05 181-DS 16.67 194-DS 7.93 0.4 182-DS 0.00 195-DS 15.96 183-DS 9.27 196-DS 0.00 0.2 184-DS 6.69 197-DS 18.02 Difference 185-DS 8.66 198-DS 55.65 0 186-DS 18.87 199-DS 1.41 187-DS 2.21 200-DS 14.39 −0.2 188-DS 40.06 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 355 cheshire 10.2415/DS-BILI-X2EN-CLEF2007.CHESHIRE.BERKBRUENCCP15 DS-BILI-X2EN-CLEF2007 Overall statistics for 25 queries : Priority 3 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language Russian Relevant 4,530 Topic Fields title, description Relevant retrieved 2,391 Pooled true Geometric Mean Average Precision 0.0873 RU->EN using powertrans translation with Class Binary Preference (BPREF) 0.2199 Cluster lookup merged with T2FB Interploated Recall (%) Precision Averages (%) Domain−Specific Bilingual English Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 72.05 BERKBRUENCCP15 10 42.39 90% 20 31.16 80% 30 23.85 40 18.80 70% 50 13.60 60% 60 10.23 Precision 70 5.96 50% 80 3.47 40% 90 2.08 30% 100 0.75 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 17.57 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Bilingual English Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.4953 Minimum 0.0009 First Quartile 0.0282 Second Quartile 0.1580 Third Quartile 0.2966 Interquartile range 0.2683 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.1757 Domain−Specific Bilingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1434 8 Number of Topics of the Experiment 7 Lower Outlier Threshold 0.0009 6 Upper Outlier Threshold 0.4953 5 Mean With No Outliers 0.1757 4 3 Std With No Outliers 0.1434 2 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Bilingual English Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries BERKBRUENCCP15 176-DS 1.96 189-DS 0.18 0.8 177-DS 2.12 190-DS 20.14 178-DS 1.16 191-DS 16.96 0.6 179-DS 49.53 192-DS 16.34 180-DS 32.93 193-DS 20.12 181-DS 15.67 194-DS 15.80 0.4 182-DS 3.06 195-DS 38.50 183-DS 29.03 196-DS 35.74 0.2 184-DS 14.70 197-DS 19.86 Difference 185-DS 8.22 198-DS 9.81 0 186-DS 2.09 199-DS 0.09 187-DS 31.53 200-DS 12.36 −0.2 188-DS 41.37 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 356 cheshire 10.2415/DS-BILI-X2EN-CLEF2007.CHESHIRE.BERKBRUENCCP15 DS-BILI-X2EN-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Bilingual English Task − Retrieved documents vs Mean Precision 100% 5 docs 50.40 BERKBRUENCCP15 10 docs 48.80 90% 15 docs 46.13 80% 20 docs 43.40 30 docs 40.27 70% 100 docs 31.04 60% 200 docs 24.16 Precision 500 docs 14.88 50% 1000 docs 9.56 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 23.20 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Bilingual English Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.5138 Minimum 0.0000 First Quartile 0.0826 Second Quartile 0.2348 Third Quartile 0.3561 Interquartile range 0.2735 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.2320 Domain−Specific Bilingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1524 4 Number of Topics of the Experiment 3.5 Lower Outlier Threshold 0.0000 3 Upper Outlier Threshold 0.5138 2.5 Mean With No Outliers 0.2320 2 1.5 Std With No Outliers 0.1524 1 0.5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Bilingual English Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries BERKBRUENCCP15 176-DS 3.33 189-DS 0.00 0.8 177-DS 8.77 190-DS 21.70 178-DS 6.71 191-DS 26.56 0.6 179-DS 51.38 192-DS 23.36 180-DS 40.91 193-DS 29.07 181-DS 16.67 194-DS 24.23 0.4 182-DS 6.58 195-DS 47.19 183-DS 35.76 196-DS 35.56 0.2 184-DS 25.35 197-DS 30.23 Difference 185-DS 16.54 198-DS 18.41 0 186-DS 1.89 199-DS 1.41 187-DS 41.45 200-DS 23.48 −0.2 188-DS 43.57 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 357 cheshire 10.2415/DS-BILI-X2EN-CLEF2007.CHESHIRE.BERKBRUENTHP7 DS-BILI-X2EN-CLEF2007 Overall statistics for 25 queries : Priority 4 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language Russian Relevant 4,530 Topic Fields title, description Relevant retrieved 2,365 Pooled true Geometric Mean Average Precision 0.0838 RU->EN using powertrans translation with Thesaurus Binary Preference (BPREF) 0.2165 lookup merged with T2FB Interploated Recall (%) Precision Averages (%) Domain−Specific Bilingual English Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 70.30 BERKBRUENTHP7 10 41.59 90% 20 30.50 80% 30 23.57 40 16.99 70% 50 13.49 60% 60 9.95 Precision 70 4.48 50% 80 2.87 40% 90 1.64 30% 100 0.53 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 17.01 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Bilingual English Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.4662 Minimum 0.0011 First Quartile 0.0301 Second Quartile 0.1582 Third Quartile 0.2792 Interquartile range 0.2492 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.1701 Domain−Specific Bilingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1395 8 Number of Topics of the Experiment 7 Lower Outlier Threshold 0.0011 6 Upper Outlier Threshold 0.4662 5 Mean With No Outliers 0.1701 4 3 Std With No Outliers 0.1395 2 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Bilingual English Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries BERKBRUENTHP7 176-DS 1.93 189-DS 0.21 0.8 177-DS 1.27 190-DS 21.06 178-DS 1.14 191-DS 15.82 0.6 179-DS 46.62 192-DS 14.12 180-DS 34.75 193-DS 18.70 181-DS 14.03 194-DS 17.19 0.4 182-DS 3.36 195-DS 37.94 183-DS 25.97 196-DS 37.07 0.2 184-DS 16.07 197-DS 20.18 Difference 185-DS 5.12 198-DS 9.55 0 186-DS 1.95 199-DS 0.11 187-DS 33.80 200-DS 12.66 −0.2 188-DS 34.51 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 358 cheshire 10.2415/DS-BILI-X2EN-CLEF2007.CHESHIRE.BERKBRUENTHP7 DS-BILI-X2EN-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Bilingual English Task − Retrieved documents vs Mean Precision 100% 5 docs 51.20 BERKBRUENTHP7 10 docs 45.60 90% 15 docs 44.00 80% 20 docs 41.60 30 docs 38.27 70% 100 docs 31.12 60% 200 docs 23.94 Precision 500 docs 14.51 50% 1000 docs 9.46 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 22.62 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Bilingual English Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.4679 Minimum 0.0000 First Quartile 0.0760 Second Quartile 0.2348 Third Quartile 0.3478 Interquartile range 0.2718 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.2262 Domain−Specific Bilingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1483 4 Number of Topics of the Experiment 3.5 Lower Outlier Threshold 0.0000 3 Upper Outlier Threshold 0.4679 2.5 Mean With No Outliers 0.2262 2 1.5 Std With No Outliers 0.1483 1 0.5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Bilingual English Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries BERKBRUENTHP7 176-DS 4.44 189-DS 0.00 0.8 177-DS 5.26 190-DS 21.70 178-DS 6.71 191-DS 25.00 0.6 179-DS 46.79 192-DS 20.56 180-DS 42.25 193-DS 28.63 181-DS 16.67 194-DS 28.19 0.4 182-DS 7.89 195-DS 46.74 183-DS 33.77 196-DS 37.78 0.2 184-DS 25.91 197-DS 30.23 Difference 185-DS 12.60 198-DS 18.41 0 186-DS 1.89 199-DS 1.41 187-DS 39.44 200-DS 23.48 −0.2 188-DS 39.77 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 359 moscow 10.2415/DS-BILI-X2EN-CLEF2007.MOSCOW.CIRDSBILIRU2EN DS-BILI-X2EN-CLEF2007 Overall statistics for 25 queries : Priority 1 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 24,000 Source Language Russian Relevant 4,530 Topic Fields title, description Relevant retrieved 1,955 Pooled true Geometric Mean Average Precision 0.0578 Prompt, word pairs in window=5 Binary Preference (BPREF) 0.1964 Interploated Recall (%) Precision Averages (%) Domain−Specific Bilingual English Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 65.44 CIRDSBILIRU2EN 10 35.31 90% 20 22.97 80% 30 15.55 40 12.34 70% 50 8.59 60% 60 6.29 Precision 70 2.98 50% 80 1.72 40% 90 1.46 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 12.94 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Bilingual English Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.5028 Minimum 0.0000 First Quartile 0.0513 Second Quartile 0.0748 Third Quartile 0.1666 Interquartile range 0.1153 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.1294 Domain−Specific Bilingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1302 8 Number of Topics of the Experiment 7 Lower Outlier Threshold 0.0000 6 Upper Outlier Threshold 0.3155 5 Mean With No Outliers 0.0986 4 3 Std With No Outliers 0.0780 2 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Bilingual English Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries CIRDSBILIRU2EN 176-DS 13.80 189-DS 7.80 0.8 177-DS 18.37 190-DS 14.28 178-DS 5.89 191-DS 7.32 0.6 179-DS 46.38 192-DS 5.51 180-DS 31.55 193-DS 4.21 181-DS 0.00 194-DS 5.41 0.4 182-DS 5.30 195-DS 19.26 183-DS 15.32 196-DS 4.62 0.2 184-DS 7.48 197-DS 16.09 Difference 185-DS 0.43 198-DS 18.97 0 186-DS 2.79 199-DS 0.50 187-DS 15.65 200-DS 6.35 −0.2 188-DS 50.28 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 360 moscow 10.2415/DS-BILI-X2EN-CLEF2007.MOSCOW.CIRDSBILIRU2EN DS-BILI-X2EN-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Bilingual English Task − Retrieved documents vs Mean Precision 100% 5 docs 44.80 CIRDSBILIRU2EN 10 docs 43.20 90% 15 docs 38.40 80% 20 docs 36.80 30 docs 36.00 70% 100 docs 27.36 60% 200 docs 19.32 Precision 500 docs 11.71 50% 1000 docs 7.82 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 20.02 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Bilingual English Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.5413 Minimum 0.0000 First Quartile 0.1247 Second Quartile 0.1674 Third Quartile 0.2700 Interquartile range 0.1454 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.2002 Domain−Specific Bilingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1320 10 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 8 Upper Outlier Threshold 0.3503 6 Mean With No Outliers 0.1716 4 Std With No Outliers 0.0910 2 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Bilingual English Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries CIRDSBILIRU2EN 176-DS 20.00 189-DS 13.64 0.8 177-DS 19.30 190-DS 18.87 178-DS 14.63 191-DS 12.50 0.6 179-DS 54.13 192-DS 14.95 180-DS 35.03 193-DS 12.36 181-DS 0.00 194-DS 16.74 0.4 182-DS 11.84 195-DS 28.54 183-DS 26.49 196-DS 13.33 0.2 184-DS 10.86 197-DS 25.58 Difference 185-DS 2.36 198-DS 29.29 0 186-DS 13.21 199-DS 4.23 187-DS 31.19 200-DS 19.70 −0.2 188-DS 51.75 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 361 moscow 10.2415/DS-BILI-X2EN-CLEF2007.MOSCOW.CIRDSBILIRU2EN2 DS-BILI-X2EN-CLEF2007 Overall statistics for 25 queries : Priority 2 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 24,000 Source Language Russian Relevant 4,530 Topic Fields title, description Relevant retrieved 1,965 Pooled true Geometric Mean Average Precision 0.0580 tfidf+pairs Binary Preference (BPREF) 0.1962 Interploated Recall (%) Precision Averages (%) Domain−Specific Bilingual English Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 66.95 CIRDSBILIRU2EN2 10 35.40 90% 20 23.60 80% 30 16.85 40 12.89 70% 50 8.91 60% 60 6.14 Precision 70 2.93 50% 80 1.72 40% 90 1.46 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 13.26 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Bilingual English Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.5009 Minimum 0.0000 First Quartile 0.0523 Second Quartile 0.0735 Third Quartile 0.1725 Interquartile range 0.1202 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.1326 Domain−Specific Bilingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1340 8 Number of Topics of the Experiment 7 Lower Outlier Threshold 0.0000 6 Upper Outlier Threshold 0.3319 5 Mean With No Outliers 0.1016 4 3 Std With No Outliers 0.0837 2 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Bilingual English Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries CIRDSBILIRU2EN2 176-DS 13.35 189-DS 7.60 0.8 177-DS 15.77 190-DS 13.87 178-DS 5.71 191-DS 7.35 0.6 179-DS 47.75 192-DS 5.85 180-DS 33.19 193-DS 4.16 181-DS 0.00 194-DS 5.46 0.4 182-DS 6.27 195-DS 19.84 183-DS 15.94 196-DS 4.53 0.2 184-DS 6.58 197-DS 18.18 Difference 185-DS 0.45 198-DS 23.59 0 186-DS 2.64 199-DS 0.41 187-DS 16.95 200-DS 5.97 −0.2 188-DS 50.09 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 362 moscow 10.2415/DS-BILI-X2EN-CLEF2007.MOSCOW.CIRDSBILIRU2EN2 DS-BILI-X2EN-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Bilingual English Task − Retrieved documents vs Mean Precision 100% 5 docs 48.00 CIRDSBILIRU2EN2 10 docs 43.20 90% 15 docs 40.00 80% 20 docs 39.40 30 docs 36.93 70% 100 docs 26.84 60% 200 docs 19.44 Precision 500 docs 12.08 50% 1000 docs 7.86 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 19.70 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Bilingual English Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.5413 Minimum 0.0000 First Quartile 0.1058 Second Quartile 0.1463 Third Quartile 0.2682 Interquartile range 0.1624 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.1970 Domain−Specific Bilingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1394 8 Number of Topics of the Experiment 7 Lower Outlier Threshold 0.0000 6 Upper Outlier Threshold 0.5058 5 Mean With No Outliers 0.1827 4 3 Std With No Outliers 0.1221 2 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Bilingual English Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries CIRDSBILIRU2EN2 176-DS 20.00 189-DS 9.09 0.8 177-DS 21.05 190-DS 17.92 178-DS 14.63 191-DS 12.50 0.6 179-DS 54.13 192-DS 13.08 180-DS 39.84 193-DS 11.28 181-DS 0.00 194-DS 10.57 0.4 182-DS 13.16 195-DS 33.71 183-DS 24.50 196-DS 13.33 0.2 184-DS 10.58 197-DS 25.58 Difference 185-DS 3.15 198-DS 30.54 0 186-DS 9.43 199-DS 2.82 187-DS 31.39 200-DS 19.70 −0.2 188-DS 50.58 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 363 xerox 10.2415/DS-BILI-X2EN-CLEF2007.XEROX.XRCED2EHCGEPRFLE DS-BILI-X2EN-CLEF2007 Overall statistics for 25 queries : Priority 1 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language German Relevant 4,530 Topic Fields title, description Relevant retrieved 3,420 Pooled true Geometric Mean Average Precision 0.2749 Dico Adapt PRF Lexical Entailment Binary Preference (BPREF) 0.3948 Interploated Recall (%) Precision Averages (%) Domain−Specific Bilingual English Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 89.48 XRCED2EHCGEPRFLE 10 62.61 90% 20 55.83 80% 30 47.93 40 40.54 70% 50 32.50 60% 60 25.90 Precision 70 20.38 50% 80 9.99 40% 90 4.77 30% 100 0.31 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 33.41 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Bilingual English Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.5826 Minimum 0.0303 First Quartile 0.1993 Second Quartile 0.3469 Third Quartile 0.5203 Interquartile range 0.3210 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.3341 Domain−Specific Bilingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1749 5 Number of Topics of the Experiment Lower Outlier Threshold 0.0303 4 Upper Outlier Threshold 0.5826 3 Mean With No Outliers 0.3341 2 Std With No Outliers 0.1749 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Bilingual English Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries XRCED2EHCGEPRFLE 176-DS 57.74 189-DS 11.89 0.8 177-DS 12.83 190-DS 20.27 178-DS 18.93 191-DS 6.80 0.6 179-DS 34.69 192-DS 16.45 180-DS 51.97 193-DS 57.82 181-DS 35.20 194-DS 40.76 0.4 182-DS 3.03 195-DS 56.25 183-DS 54.16 196-DS 37.24 0.2 184-DS 39.50 197-DS 52.22 Difference 185-DS 24.82 198-DS 46.61 0 186-DS 27.55 199-DS 24.39 187-DS 23.74 200-DS 22.12 −0.2 188-DS 58.26 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 364 xerox 10.2415/DS-BILI-X2EN-CLEF2007.XEROX.XRCED2EHCGEPRFLE DS-BILI-X2EN-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Bilingual English Task − Retrieved documents vs Mean Precision 100% 5 docs 65.60 XRCED2EHCGEPRFLE 10 docs 58.80 90% 15 docs 59.47 80% 20 docs 57.20 30 docs 56.80 70% 100 docs 46.68 60% 200 docs 35.18 Precision 500 docs 22.05 50% 1000 docs 13.68 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 37.45 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Bilingual English Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.5910 Minimum 0.0789 First Quartile 0.2830 Second Quartile 0.3561 Third Quartile 0.5189 Interquartile range 0.2358 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.3745 Domain−Specific Bilingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1483 5 Number of Topics of the Experiment Lower Outlier Threshold 0.0789 4 Upper Outlier Threshold 0.5910 3 Mean With No Outliers 0.3745 2 Std With No Outliers 0.1483 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Bilingual English Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries XRCED2EHCGEPRFLE 176-DS 55.56 189-DS 18.18 0.8 177-DS 19.30 190-DS 23.58 178-DS 29.88 191-DS 12.50 0.6 179-DS 34.86 192-DS 29.91 180-DS 52.41 193-DS 58.35 181-DS 38.89 194-DS 44.49 0.4 182-DS 7.89 195-DS 59.10 183-DS 52.32 196-DS 35.56 0.2 184-DS 45.68 197-DS 51.74 Difference 185-DS 37.01 198-DS 49.37 0 186-DS 30.19 199-DS 22.54 187-DS 35.41 200-DS 35.61 −0.2 188-DS 55.85 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 365 xerox 10.2415/DS-BILI-X2EN-CLEF2007.XEROX.XRCED2EHECGLE DS-BILI-X2EN-CLEF2007 Overall statistics for 25 queries : Priority 2 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language German Relevant 4,530 Topic Fields title, description Relevant retrieved 2,983 Pooled true Geometric Mean Average Precision 0.1432 Dict Adapt Lexical Entailment Binary Preference (BPREF) 0.2902 Interploated Recall (%) Precision Averages (%) Domain−Specific Bilingual English Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 68.67 XRCED2EHECGLE 10 50.14 90% 20 40.58 80% 30 32.31 40 26.94 70% 50 22.51 60% 60 18.76 Precision 70 11.53 50% 80 4.59 40% 90 0.82 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 23.38 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Bilingual English Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.5338 Minimum 0.0015 First Quartile 0.1056 Second Quartile 0.1906 Third Quartile 0.3673 Interquartile range 0.2617 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.2338 Domain−Specific Bilingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1661 5 Number of Topics of the Experiment Lower Outlier Threshold 0.0015 4 Upper Outlier Threshold 0.5338 3 Mean With No Outliers 0.2338 2 Std With No Outliers 0.1661 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Bilingual English Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries XRCED2EHECGLE 176-DS 10.76 189-DS 0.15 0.8 177-DS 13.08 190-DS 11.05 178-DS 19.06 191-DS 17.86 0.6 179-DS 0.57 192-DS 4.37 180-DS 53.38 193-DS 41.56 181-DS 32.56 194-DS 34.23 0.4 182-DS 10.25 195-DS 50.82 183-DS 49.12 196-DS 34.94 0.2 184-DS 10.66 197-DS 22.03 Difference 185-DS 15.72 198-DS 35.55 0 186-DS 5.06 199-DS 22.72 187-DS 41.52 200-DS 7.34 −0.2 188-DS 40.24 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 366 xerox 10.2415/DS-BILI-X2EN-CLEF2007.XEROX.XRCED2EHECGLE DS-BILI-X2EN-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Bilingual English Task − Retrieved documents vs Mean Precision 100% 5 docs 53.60 XRCED2EHECGLE 10 docs 50.00 90% 15 docs 48.80 80% 20 docs 47.20 30 docs 42.13 70% 100 docs 36.56 60% 200 docs 28.32 Precision 500 docs 18.65 50% 1000 docs 11.93 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 29.72 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Bilingual English Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.5910 Minimum 0.0227 First Quartile 0.1886 Second Quartile 0.2677 Third Quartile 0.4520 Interquartile range 0.2634 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.2972 Domain−Specific Bilingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1588 4 Number of Topics of the Experiment 3.5 Lower Outlier Threshold 0.0227 3 Upper Outlier Threshold 0.5910 2.5 Mean With No Outliers 0.2972 2 1.5 Std With No Outliers 0.1588 1 0.5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Bilingual English Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries XRCED2EHECGLE 176-DS 21.11 189-DS 2.27 0.8 177-DS 19.30 190-DS 21.70 178-DS 29.27 191-DS 20.31 0.6 179-DS 4.59 192-DS 14.02 180-DS 54.28 193-DS 45.99 181-DS 38.89 194-DS 44.93 0.4 182-DS 21.05 195-DS 59.10 183-DS 48.34 196-DS 33.33 0.2 184-DS 17.55 197-DS 26.16 Difference 185-DS 26.77 198-DS 46.44 0 186-DS 11.32 199-DS 28.17 187-DS 50.91 200-DS 15.15 −0.2 188-DS 42.11 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 367 xerox 10.2415/DS-BILI-X2EN-CLEF2007.XEROX.XRCED2EHECGPRFLE DS-BILI-X2EN-CLEF2007 Overall statistics for 25 queries : Priority 3 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language German Relevant 4,530 Topic Fields title, description Relevant retrieved 3,255 Pooled true Geometric Mean Average Precision 0.1640 Dico Adapt PRF Lexical Entailment Binary Preference (BPREF) 0.3379 Interploated Recall (%) Precision Averages (%) Domain−Specific Bilingual English Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 74.42 XRCED2EHECGPRFLE 10 57.72 90% 20 48.85 80% 30 40.34 40 34.66 70% 50 28.34 60% 60 23.00 Precision 70 18.78 50% 80 8.91 40% 90 3.81 30% 100 0.22 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 29.23 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Bilingual English Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.6275 Minimum 0.0002 First Quartile 0.1602 Second Quartile 0.2634 Third Quartile 0.4556 Interquartile range 0.2954 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.2923 Domain−Specific Bilingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1918 4 Number of Topics of the Experiment 3.5 Lower Outlier Threshold 0.0002 3 Upper Outlier Threshold 0.6275 2.5 Mean With No Outliers 0.2923 2 1.5 Std With No Outliers 0.1918 1 0.5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Bilingual English Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries XRCED2EHECGPRFLE 176-DS 35.82 189-DS 0.02 0.8 177-DS 18.03 190-DS 20.70 178-DS 22.03 191-DS 21.60 0.6 179-DS 1.21 192-DS 10.83 180-DS 56.33 193-DS 55.45 181-DS 30.18 194-DS 44.63 0.4 182-DS 5.14 195-DS 51.73 183-DS 62.75 196-DS 32.67 0.2 184-DS 26.34 197-DS 42.47 Difference 185-DS 17.74 198-DS 41.07 0 186-DS 1.67 199-DS 24.18 187-DS 48.35 200-DS 7.42 −0.2 188-DS 52.32 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 368 xerox 10.2415/DS-BILI-X2EN-CLEF2007.XEROX.XRCED2EHECGPRFLE DS-BILI-X2EN-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Bilingual English Task − Retrieved documents vs Mean Precision 100% 5 docs 56.00 XRCED2EHECGPRFLE 10 docs 55.20 90% 15 docs 53.87 80% 20 docs 52.00 30 docs 51.20 70% 100 docs 42.60 60% 200 docs 33.50 Precision 500 docs 20.77 50% 1000 docs 13.02 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 32.87 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Bilingual English Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.5762 Minimum 0.0000 First Quartile 0.2093 Second Quartile 0.3110 Third Quartile 0.5095 Interquartile range 0.3002 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.3287 Domain−Specific Bilingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1800 4 Number of Topics of the Experiment 3.5 Lower Outlier Threshold 0.0000 3 Upper Outlier Threshold 0.5762 2.5 Mean With No Outliers 0.3287 2 1.5 Std With No Outliers 0.1800 1 0.5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Bilingual English Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries XRCED2EHECGPRFLE 176-DS 27.78 189-DS 0.00 0.8 177-DS 21.05 190-DS 24.53 178-DS 31.10 191-DS 26.56 0.6 179-DS 6.42 192-DS 20.56 180-DS 55.35 193-DS 56.62 181-DS 44.44 194-DS 51.10 0.4 182-DS 7.89 195-DS 54.38 183-DS 57.62 196-DS 35.56 0.2 184-DS 32.03 197-DS 47.09 Difference 185-DS 29.13 198-DS 45.61 0 186-DS 1.89 199-DS 23.94 187-DS 50.91 200-DS 18.18 −0.2 188-DS 52.05 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 369 xerox 10.2415/DS-BILI-X2EN-CLEF2007.XEROX.XRCED2EMATRAX DS-BILI-X2EN-CLEF2007 Overall statistics for 25 queries : Priority 4 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language German Relevant 4,530 Topic Fields title, description Relevant retrieved 3,032 Pooled true Geometric Mean Average Precision 0.1294 Matrax language Models Binary Preference (BPREF) 0.2973 Interploated Recall (%) Precision Averages (%) Domain−Specific Bilingual English Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 72.57 XRCED2EMATRAX 10 49.28 90% 20 41.34 80% 30 35.73 40 29.96 70% 50 24.68 60% 60 19.41 Precision 70 14.54 50% 80 6.31 40% 90 3.34 30% 100 0.15 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 24.68 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Bilingual English Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.6029 Minimum 0.0000 First Quartile 0.1021 Second Quartile 0.1890 Third Quartile 0.3623 Interquartile range 0.2602 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.2468 Domain−Specific Bilingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1835 4 Number of Topics of the Experiment 3.5 Lower Outlier Threshold 0.0000 3 Upper Outlier Threshold 0.6029 2.5 Mean With No Outliers 0.2468 2 1.5 Std With No Outliers 0.1835 1 0.5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Bilingual English Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries XRCED2EMATRAX 176-DS 56.32 189-DS 3.43 0.8 177-DS 10.81 190-DS 16.08 178-DS 32.68 191-DS 15.09 0.6 179-DS 26.02 192-DS 0.00 180-DS 60.29 193-DS 42.74 181-DS 27.79 194-DS 11.68 0.4 182-DS 5.07 195-DS 55.84 183-DS 6.81 196-DS 23.42 0.2 184-DS 17.86 197-DS 31.29 Difference 185-DS 9.51 198-DS 46.30 0 186-DS 4.64 199-DS 18.90 187-DS 49.90 200-DS 10.45 −0.2 188-DS 34.06 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 370 xerox 10.2415/DS-BILI-X2EN-CLEF2007.XEROX.XRCED2EMATRAX DS-BILI-X2EN-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Bilingual English Task − Retrieved documents vs Mean Precision 100% 5 docs 52.00 XRCED2EMATRAX 10 docs 47.60 90% 15 docs 45.07 80% 20 docs 45.20 30 docs 43.73 70% 100 docs 37.76 60% 200 docs 30.36 Precision 500 docs 19.43 50% 1000 docs 12.13 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 30.20 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Bilingual English Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.6043 Minimum 0.0000 First Quartile 0.1916 Second Quartile 0.2599 Third Quartile 0.4198 Interquartile range 0.2282 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.3020 Domain−Specific Bilingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1747 5 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 4 Upper Outlier Threshold 0.6043 3 Mean With No Outliers 0.3020 2 Std With No Outliers 0.1747 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Bilingual English Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries XRCED2EMATRAX 176-DS 58.89 189-DS 6.82 0.8 177-DS 17.54 190-DS 24.53 178-DS 39.63 191-DS 21.88 0.6 179-DS 33.03 192-DS 0.00 180-DS 60.43 193-DS 49.02 181-DS 27.78 194-DS 25.99 0.4 182-DS 5.26 195-DS 58.20 183-DS 15.23 196-DS 24.44 0.2 184-DS 31.75 197-DS 38.95 Difference 185-DS 20.47 198-DS 51.88 0 186-DS 11.32 199-DS 22.54 187-DS 52.92 200-DS 19.70 −0.2 188-DS 36.84 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 371 xerox 10.2415/DS-BILI-X2EN-CLEF2007.XEROX.XRCED2EMATRAXLE DS-BILI-X2EN-CLEF2007 Overall statistics for 25 queries : Priority 5 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language German Relevant 4,530 Topic Fields title, description Relevant retrieved 3,303 Pooled true Geometric Mean Average Precision 0.1503 matrax lexical entailment Binary Preference (BPREF) 0.3229 Interploated Recall (%) Precision Averages (%) Domain−Specific Bilingual English Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 75.56 XRCED2EMATRAXLE 10 52.18 90% 20 46.50 80% 30 39.45 40 32.78 70% 50 28.15 60% 60 23.07 Precision 70 18.45 50% 80 8.33 40% 90 4.08 30% 100 0.36 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 27.57 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Bilingual English Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.6043 Minimum 0.0000 First Quartile 0.1196 Second Quartile 0.2889 Third Quartile 0.4126 Interquartile range 0.2930 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.2757 Domain−Specific Bilingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1825 4 Number of Topics of the Experiment 3.5 Lower Outlier Threshold 0.0000 3 Upper Outlier Threshold 0.6043 2.5 Mean With No Outliers 0.2757 2 1.5 Std With No Outliers 0.1825 1 0.5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Bilingual English Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries XRCED2EMATRAXLE 176-DS 55.79 189-DS 2.46 0.8 177-DS 11.92 190-DS 17.44 178-DS 28.80 191-DS 12.93 0.6 179-DS 28.89 192-DS 0.00 180-DS 60.43 193-DS 45.31 181-DS 29.84 194-DS 30.92 0.4 182-DS 6.49 195-DS 57.42 183-DS 8.52 196-DS 35.61 0.2 184-DS 29.36 197-DS 36.17 Difference 185-DS 14.31 198-DS 48.89 0 186-DS 5.46 199-DS 21.79 187-DS 48.53 200-DS 11.98 −0.2 188-DS 39.91 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 372 xerox 10.2415/DS-BILI-X2EN-CLEF2007.XEROX.XRCED2EMATRAXLE DS-BILI-X2EN-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Bilingual English Task − Retrieved documents vs Mean Precision 100% 5 docs 50.40 XRCED2EMATRAXLE 10 docs 46.80 90% 15 docs 46.13 80% 20 docs 47.20 30 docs 45.60 70% 100 docs 40.28 60% 200 docs 31.88 Precision 500 docs 20.46 50% 1000 docs 13.21 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 32.72 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Bilingual English Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.6016 Minimum 0.0000 First Quartile 0.2167 Second Quartile 0.3476 Third Quartile 0.4541 Interquartile range 0.2374 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.3272 Domain−Specific Bilingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1730 5 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 4 Upper Outlier Threshold 0.6016 3 Mean With No Outliers 0.3272 2 Std With No Outliers 0.1730 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Bilingual English Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries XRCED2EMATRAXLE 176-DS 57.78 189-DS 2.27 0.8 177-DS 21.05 190-DS 24.53 178-DS 34.76 191-DS 21.88 0.6 179-DS 38.53 192-DS 0.00 180-DS 60.16 193-DS 48.16 181-DS 27.78 194-DS 44.49 0.4 182-DS 10.53 195-DS 58.65 183-DS 17.22 196-DS 42.22 0.2 184-DS 37.05 197-DS 41.28 Difference 185-DS 24.41 198-DS 52.30 0 186-DS 11.32 199-DS 28.17 187-DS 51.71 200-DS 21.97 −0.2 188-DS 39.77 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 373 xerox 10.2415/DS-BILI-X2EN-CLEF2007.XEROX.XRCED2EMATRAXPRFLE DS-BILI-X2EN-CLEF2007 Overall statistics for 25 queries : Priority 6 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language English Relevant 4,530 Topic Fields title, description Relevant retrieved 3,333 Pooled true Geometric Mean Average Precision 0.1640 matrax prf lexical entailment Binary Preference (BPREF) 0.3369 Interploated Recall (%) Precision Averages (%) Domain−Specific Bilingual English Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 71.03 XRCED2EMATRAXPRFLE 10 54.43 90% 20 45.29 80% 30 39.61 40 35.52 70% 50 30.62 60% 60 24.80 Precision 70 17.79 50% 80 11.14 40% 90 3.89 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 28.73 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Bilingual English Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.6061 Minimum 0.0001 First Quartile 0.1100 Second Quartile 0.2780 Third Quartile 0.4366 Interquartile range 0.3266 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.2873 Domain−Specific Bilingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1928 3 Number of Topics of the Experiment Lower Outlier Threshold 0.0001 2.5 Upper Outlier Threshold 0.6061 2 Mean With No Outliers 0.2873 1.5 Std With No Outliers 0.1928 1 0.5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Bilingual English Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries XRCED2EMATRAXPRFLE 176-DS 56.83 189-DS 2.74 0.8 177-DS 15.58 190-DS 19.29 178-DS 29.19 191-DS 8.69 0.6 179-DS 27.80 192-DS 0.01 180-DS 58.21 193-DS 44.57 181-DS 30.56 194-DS 43.36 0.4 182-DS 6.52 195-DS 57.51 183-DS 14.91 196-DS 26.29 0.2 184-DS 38.06 197-DS 50.89 Difference 185-DS 9.48 198-DS 43.23 0 186-DS 4.90 199-DS 22.79 187-DS 34.83 200-DS 11.51 −0.2 188-DS 60.61 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 374 xerox 10.2415/DS-BILI-X2EN-CLEF2007.XEROX.XRCED2EMATRAXPRFLE DS-BILI-X2EN-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Bilingual English Task − Retrieved documents vs Mean Precision 100% 5 docs 51.20 XRCED2EMATRAXPRFLE 10 docs 49.60 90% 15 docs 51.47 80% 20 docs 50.60 30 docs 48.00 70% 100 docs 40.52 60% 200 docs 33.26 Precision 500 docs 21.20 50% 1000 docs 13.33 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 33.37 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Bilingual English Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.5965 Minimum 0.0000 First Quartile 0.1959 Second Quartile 0.3333 Third Quartile 0.5096 Interquartile range 0.3137 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.3337 Domain−Specific Bilingual English Task − Distribution of the Topics of the Experiment Standard Deviation 0.1875 4 Number of Topics of the Experiment 3.5 Lower Outlier Threshold 0.0000 3 Upper Outlier Threshold 0.5965 2.5 Mean With No Outliers 0.3337 2 1.5 Std With No Outliers 0.1875 1 0.5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Bilingual English Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries XRCED2EMATRAXPRFLE 176-DS 56.67 189-DS 6.82 0.8 177-DS 19.30 190-DS 24.53 178-DS 34.15 191-DS 14.06 0.6 179-DS 33.03 192-DS 0.00 180-DS 56.42 193-DS 50.33 181-DS 38.89 194-DS 52.86 0.4 182-DS 11.84 195-DS 58.65 183-DS 23.18 196-DS 33.33 0.2 184-DS 45.40 197-DS 54.07 Difference 185-DS 19.69 198-DS 49.37 0 186-DS 5.66 199-DS 19.72 187-DS 46.08 200-DS 20.45 −0.2 188-DS 59.65 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 375 chemnitz 10.2415/DS-BILI-X2RU-CLEF2007.CHEMNITZ.CUT_DS_BILI_DE2RU_MERGED DS-BILI-X2RU-CLEF2007 Overall statistics for 25 queries : Priority 2 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language German Relevant 1,471 Topic Fields title, description Relevant retrieved 897 Pooled true Geometric Mean Average Precision 0.0091 (See overleaf for description) Binary Preference (BPREF) 0.1002 Interploated Recall (%) Precision Averages (%) Domain−Specific Bilingual Russian Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 29.95 CUT_DS_BILI_DE2RU_MERGED 10 18.65 90% 20 16.20 80% 30 12.21 40 10.53 70% 50 8.91 60% 60 7.76 Precision 70 5.61 50% 80 4.22 40% 90 2.31 30% 100 0.74 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 9.38 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Bilingual Russian Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.6647 Minimum 0.0000 First Quartile 0.0020 Second Quartile 0.0290 Third Quartile 0.1092 Interquartile range 0.1073 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.0938 Domain−Specific Bilingual Russian Task − Distribution of the Topics of the Experiment Standard Deviation 0.1564 15 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 Upper Outlier Threshold 0.2538 10 Mean With No Outliers 0.0452 Std With No Outliers 0.0628 5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Bilingual Russian Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries CUT_DS_BILI_DE2RU_MERGED 176-DS 0.05 189-DS 1.29 0.8 177-DS 5.39 190-DS 0.00 178-DS 0.00 191-DS 0.00 0.6 179-DS 1.19 192-DS 3.03 180-DS 0.02 193-DS 9.17 181-DS 0.00 194-DS 3.87 0.4 182-DS 25.38 195-DS 13.04 183-DS 31.01 196-DS 6.60 0.2 184-DS 2.90 197-DS 1.43 Difference 185-DS 0.99 198-DS 37.63 0 186-DS 10.42 199-DS 0.25 187-DS 66.47 200-DS 12.45 −0.2 188-DS 1.87 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS197−DS 198−DS 199−DS 200−DS Topic Identifier 376 chemnitz 10.2415/DS-BILI-X2RU-CLEF2007.CHEMNITZ.CUT_DS_BILI_DE2RU_MERGED DS-BILI-X2RU-CLEF2007 Bilingual DE2RU merged structured and unstructured indizes, translated with PROMT translation service Docs Cutoff Levels Precision at DCL (%) Domain−Specific Bilingual Russian Task − Retrieved documents vs Mean Precision 100% 5 docs 14.40 CUT_DS_BILI_DE2RU_MERGED 10 docs 18.00 90% 15 docs 17.07 80% 20 docs 16.80 30 docs 14.67 70% 100 docs 11.12 60% 200 docs 8.78 Precision 500 docs 5.26 50% 1000 docs 3.59 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 11.39 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Bilingual Russian Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.6030 Minimum 0.0000 First Quartile 0.0000 Second Quartile 0.0556 Third Quartile 0.1963 Interquartile range 0.1963 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.1139 Domain−Specific Bilingual Russian Task − Distribution of the Topics of the Experiment Standard Deviation 0.1557 15 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 Upper Outlier Threshold 0.4480 10 Mean With No Outliers 0.0935 Std With No Outliers 0.1203 5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Bilingual Russian Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries CUT_DS_BILI_DE2RU_MERGED 176-DS 0.00 189-DS 0.00 0.8 177-DS 20.00 190-DS 0.00 178-DS 0.00 191-DS 0.00 0.6 179-DS 4.17 192-DS 0.00 180-DS 0.00 193-DS 16.00 181-DS 0.00 194-DS 6.30 0.4 182-DS 24.49 195-DS 23.36 183-DS 30.19 196-DS 0.00 0.2 184-DS 5.45 197-DS 9.68 Difference 185-DS 5.56 198-DS 44.80 0 186-DS 9.09 199-DS 0.00 187-DS 60.30 200-DS 19.51 −0.2 188-DS 5.81 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS197−DS 198−DS 199−DS 200−DS Topic Identifier 377 chemnitz 10.2415/DS-BILI-X2RU-CLEF2007.CHEMNITZ.CUT_DS_BILI_DE2RU_MERGED_THES DS-BILI-X2RU-CLEF2007 Overall statistics for 25 queries : Priority 3 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language German Relevant 1,471 Topic Fields title, description Relevant retrieved 897 Pooled true Geometric Mean Average Precision 0.0092 (See overleaf for description) Binary Preference (BPREF) 0.1002 Interploated Recall (%) Precision Averages (%) Domain−Specific Bilingual Russian Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 29.78 CUT_DS_BILI_DE2RU_MERGED_THES 10 18.48 90% 20 16.13 80% 30 12.14 40 10.45 70% 50 8.82 60% 60 7.81 Precision 70 5.62 50% 80 4.22 40% 90 2.35 30% 100 0.78 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 9.35 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Bilingual Russian Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.6647 Minimum 0.0000 First Quartile 0.0024 Second Quartile 0.0290 Third Quartile 0.1092 Interquartile range 0.1068 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.0935 Domain−Specific Bilingual Russian Task − Distribution of the Topics of the Experiment Standard Deviation 0.1565 15 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 Upper Outlier Threshold 0.2538 10 Mean With No Outliers 0.0448 Std With No Outliers 0.0627 5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Bilingual Russian Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries CUT_DS_BILI_DE2RU_MERGED_THES 176-DS 0.05 189-DS 1.29 0.8 177-DS 5.39 190-DS 0.00 178-DS 0.00 191-DS 0.00 0.6 179-DS 1.19 192-DS 3.03 180-DS 0.02 193-DS 9.17 181-DS 0.00 194-DS 3.87 0.4 182-DS 25.38 195-DS 13.04 183-DS 31.01 196-DS 5.73 0.2 184-DS 2.90 197-DS 1.43 Difference 185-DS 0.99 198-DS 37.63 0 186-DS 10.42 199-DS 0.31 187-DS 66.47 200-DS 12.45 −0.2 188-DS 1.87 −0.4 −0.6 −0.8 −1 176−DS177−DS178−DS179−DS180−DS181−DS182−DS183−DS184−DS185−DS186−DS187−DS188−DS189−DS190−DS191−DS192−DS193−DS194−DS195−DS196−DS197−DS198−DS199−DS200−DS Topic Identifier 378 chemnitz 10.2415/DS-BILI-X2RU-CLEF2007.CHEMNITZ.CUT_DS_BILI_DE2RU_MERGED_THES DS-BILI-X2RU-CLEF2007 Bilingual DE2RU merged structured and unstructured indizes, translated with PROMT translation service with utilisation of the provided thesaurus Docs Cutoff Levels Precision at DCL (%) Domain−Specific Bilingual Russian Task − Retrieved documents vs Mean Precision 100% 5 docs 14.40 CUT_DS_BILI_DE2RU_MERGED_THES 10 docs 17.60 90% 15 docs 16.80 80% 20 docs 16.80 30 docs 14.53 70% 100 docs 11.12 60% 200 docs 8.80 Precision 500 docs 5.26 50% 1000 docs 3.59 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 11.39 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Bilingual Russian Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.6030 Minimum 0.0000 First Quartile 0.0000 Second Quartile 0.0556 Third Quartile 0.1963 Interquartile range 0.1963 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.1139 Domain−Specific Bilingual Russian Task − Distribution of the Topics of the Experiment Standard Deviation 0.1557 15 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 Upper Outlier Threshold 0.4480 10 Mean With No Outliers 0.0935 Std With No Outliers 0.1203 5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Bilingual Russian Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries CUT_DS_BILI_DE2RU_MERGED_THES 176-DS 0.00 189-DS 0.00 0.8 177-DS 20.00 190-DS 0.00 178-DS 0.00 191-DS 0.00 0.6 179-DS 4.17 192-DS 0.00 180-DS 0.00 193-DS 16.00 181-DS 0.00 194-DS 6.30 0.4 182-DS 24.49 195-DS 23.36 183-DS 30.19 196-DS 0.00 0.2 184-DS 5.45 197-DS 9.68 Difference 185-DS 5.56 198-DS 44.80 0 186-DS 9.09 199-DS 0.00 187-DS 60.30 200-DS 19.51 −0.2 188-DS 5.81 −0.4 −0.6 −0.8 −1 176−DS177−DS178−DS179−DS180−DS181−DS182−DS183−DS184−DS185−DS186−DS187−DS188−DS189−DS190−DS191−DS192−DS193−DS194−DS195−DS196−DS197−DS198−DS199−DS200−DS Topic Identifier 379 chemnitz 10.2415/DS-BILI-X2RU-CLEF2007.CHEMNITZ.CUT_DS_BILI_EN2RU_MERGED DS-BILI-X2RU-CLEF2007 Overall statistics for 25 queries : Priority 1 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language English Relevant 1,471 Topic Fields title, description Relevant retrieved 1,017 Pooled true Geometric Mean Average Precision 0.0177 Bilingual EN2RU merged structured and unstructured Binary Preference (BPREF) 0.1177 indizes, translated with Google Translate (beta) Interploated Recall (%) Precision Averages (%) Domain−Specific Bilingual Russian Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 38.04 CUT_DS_BILI_EN2RU_MERGED 10 21.38 90% 20 18.82 80% 30 14.68 40 12.43 70% 50 11.70 60% 60 9.01 Precision 70 5.53 50% 80 4.79 40% 90 4.07 30% 100 0.51 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 11.41 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Bilingual Russian Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.7413 Minimum 0.0000 First Quartile 0.0047 Second Quartile 0.0382 Third Quartile 0.1674 Interquartile range 0.1627 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.1141 Domain−Specific Bilingual Russian Task − Distribution of the Topics of the Experiment Standard Deviation 0.1649 15 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 Upper Outlier Threshold 0.3505 10 Mean With No Outliers 0.0880 Std With No Outliers 0.1027 5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Bilingual Russian Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries CUT_DS_BILI_EN2RU_MERGED 176-DS 17.20 189-DS 0.25 0.8 177-DS 3.82 190-DS 74.13 178-DS 0.00 191-DS 0.00 0.6 179-DS 26.91 192-DS 2.13 180-DS 0.52 193-DS 8.25 181-DS 0.00 194-DS 11.47 0.4 182-DS 16.53 195-DS 16.59 183-DS 26.45 196-DS 1.68 0.2 184-DS 7.68 197-DS 2.71 Difference 185-DS 1.47 198-DS 20.54 0 186-DS 0.19 199-DS 0.31 187-DS 35.05 200-DS 8.12 −0.2 188-DS 3.35 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS197−DS 198−DS 199−DS 200−DS Topic Identifier 380 chemnitz 10.2415/DS-BILI-X2RU-CLEF2007.CHEMNITZ.CUT_DS_BILI_EN2RU_MERGED DS-BILI-X2RU-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Bilingual Russian Task − Retrieved documents vs Mean Precision 100% 5 docs 20.00 CUT_DS_BILI_EN2RU_MERGED 10 docs 20.00 90% 15 docs 18.40 80% 20 docs 18.40 30 docs 16.67 70% 100 docs 15.12 60% 200 docs 11.12 Precision 500 docs 6.26 50% 1000 docs 4.07 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 13.27 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Bilingual Russian Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.7460 Minimum 0.0000 First Quartile 0.0000 Second Quartile 0.0814 Third Quartile 0.2175 Interquartile range 0.2175 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.1327 Domain−Specific Bilingual Russian Task − Distribution of the Topics of the Experiment Standard Deviation 0.1775 15 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 Upper Outlier Threshold 0.3701 10 Mean With No Outliers 0.1071 Std With No Outliers 0.1259 5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Bilingual Russian Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries CUT_DS_BILI_EN2RU_MERGED 176-DS 0.00 189-DS 0.00 0.8 177-DS 10.00 190-DS 74.60 178-DS 0.00 191-DS 0.00 0.6 179-DS 35.42 192-DS 0.00 180-DS 2.94 193-DS 12.00 181-DS 0.00 194-DS 14.96 0.4 182-DS 16.33 195-DS 27.01 183-DS 28.30 196-DS 0.00 0.2 184-DS 20.00 197-DS 3.23 Difference 185-DS 0.00 198-DS 29.60 0 186-DS 0.00 199-DS 0.00 187-DS 37.01 200-DS 12.20 −0.2 188-DS 8.14 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS197−DS 198−DS 199−DS 200−DS Topic Identifier 381 cheshire 10.2415/DS-BILI-X2RU-CLEF2007.CHESHIRE.BERKBDERUCCP15 DS-BILI-X2RU-CLEF2007 Overall statistics for 25 queries : Priority 1 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language German Relevant 1,471 Topic Fields title, description Relevant retrieved 343 Pooled true Geometric Mean Average Precision 0.0005 DE->RU using powertrans retrieval using Class Binary Preference (BPREF) 0.0265 Clusters merged with T2FB Interploated Recall (%) Precision Averages (%) Domain−Specific Bilingual Russian Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 19.24 BERKBDERUCCP15 10 5.17 90% 20 3.58 80% 30 3.13 40 2.83 70% 50 2.37 60% 60 1.97 Precision 70 1.45 50% 80 1.13 40% 90 0.66 30% 100 0.24 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 2.69 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Bilingual Russian Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.2292 Minimum 0.0000 First Quartile 0.0000 Second Quartile 0.0010 Third Quartile 0.0095 Interquartile range 0.0095 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.0269 Domain−Specific Bilingual Russian Task − Distribution of the Topics of the Experiment Standard Deviation 0.0629 25 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 20 Upper Outlier Threshold 0.0197 15 Mean With No Outliers 0.0029 10 Std With No Outliers 0.0053 5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Bilingual Russian Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries BERKBDERUCCP15 176-DS 0.00 189-DS 0.79 0.8 177-DS 1.45 190-DS 0.01 178-DS 0.00 191-DS 0.00 0.6 179-DS 13.70 192-DS 0.27 180-DS 0.00 193-DS 0.10 181-DS 0.00 194-DS 0.69 0.4 182-DS 0.00 195-DS 0.23 183-DS 22.92 196-DS 0.03 0.2 184-DS 0.00 197-DS 0.00 Difference 185-DS 0.00 198-DS 4.84 0 186-DS 0.48 199-DS 0.10 187-DS 0.00 200-DS 19.70 −0.2 188-DS 1.97 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 382 cheshire 10.2415/DS-BILI-X2RU-CLEF2007.CHESHIRE.BERKBDERUCCP15 DS-BILI-X2RU-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Bilingual Russian Task − Retrieved documents vs Mean Precision 100% 5 docs 7.20 BERKBDERUCCP15 10 docs 5.60 90% 15 docs 5.33 80% 20 docs 5.00 30 docs 4.27 70% 100 docs 4.00 60% 200 docs 2.96 Precision 500 docs 1.96 50% 1000 docs 1.37 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 3.86 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Bilingual Russian Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.2453 Minimum 0.0000 First Quartile 0.0000 Second Quartile 0.0000 Third Quartile 0.0360 Interquartile range 0.0360 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.0386 Domain−Specific Bilingual Russian Task − Distribution of the Topics of the Experiment Standard Deviation 0.0781 20 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 15 Upper Outlier Threshold 0.0500 Mean With No Outliers 0.0068 10 Std With No Outliers 0.0151 5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Bilingual Russian Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries BERKBDERUCCP15 176-DS 0.00 189-DS 5.00 0.8 177-DS 0.00 190-DS 0.00 178-DS 0.00 191-DS 0.00 0.6 179-DS 21.88 192-DS 0.00 180-DS 0.00 193-DS 0.00 181-DS 0.00 194-DS 3.94 0.4 182-DS 0.00 195-DS 1.46 183-DS 24.53 196-DS 0.00 0.2 184-DS 0.00 197-DS 0.00 Difference 185-DS 0.00 198-DS 12.80 0 186-DS 0.00 199-DS 0.00 187-DS 0.30 200-DS 23.17 −0.2 188-DS 3.49 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 383 cheshire 10.2415/DS-BILI-X2RU-CLEF2007.CHESHIRE.BERKBDERUTHP7 DS-BILI-X2RU-CLEF2007 Overall statistics for 25 queries : Priority 2 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language German Relevant 1,471 Topic Fields title, description Relevant retrieved 339 Pooled true Geometric Mean Average Precision 0.0004 DE->RU using powertrans translation and retrieval Binary Preference (BPREF) 0.0285 using Thesaurus lookup merged with T2FB Interploated Recall (%) Precision Averages (%) Domain−Specific Bilingual Russian Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 18.57 BERKBDERUTHP7 10 4.85 90% 20 4.01 80% 30 3.41 40 2.99 70% 50 2.58 60% 60 2.42 Precision 70 1.69 50% 80 1.21 40% 90 0.67 30% 100 0.01 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 2.85 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Bilingual Russian Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.2513 Minimum 0.0000 First Quartile 0.0000 Second Quartile 0.0002 Third Quartile 0.0069 Interquartile range 0.0069 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.0285 Domain−Specific Bilingual Russian Task − Distribution of the Topics of the Experiment Standard Deviation 0.0686 25 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 20 Upper Outlier Threshold 0.0072 15 Mean With No Outliers 0.0015 10 Std With No Outliers 0.0026 5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Bilingual Russian Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries BERKBDERUTHP7 176-DS 0.00 189-DS 0.72 0.8 177-DS 0.66 190-DS 0.01 178-DS 0.00 191-DS 0.00 0.6 179-DS 14.18 192-DS 0.23 180-DS 0.00 193-DS 0.00 181-DS 0.00 194-DS 0.68 0.4 182-DS 0.00 195-DS 0.23 183-DS 21.54 196-DS 0.02 0.2 184-DS 0.00 197-DS 0.00 Difference 185-DS 0.00 198-DS 5.63 0 186-DS 0.43 199-DS 0.05 187-DS 0.00 200-DS 25.13 −0.2 188-DS 1.81 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 384 cheshire 10.2415/DS-BILI-X2RU-CLEF2007.CHESHIRE.BERKBDERUTHP7 DS-BILI-X2RU-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Bilingual Russian Task − Retrieved documents vs Mean Precision 100% 5 docs 7.20 BERKBDERUTHP7 10 docs 6.00 90% 15 docs 5.87 80% 20 docs 4.80 30 docs 4.53 70% 100 docs 4.00 60% 200 docs 3.02 Precision 500 docs 2.03 50% 1000 docs 1.36 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 4.07 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Bilingual Russian Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.2927 Minimum 0.0000 First Quartile 0.0000 Second Quartile 0.0000 Third Quartile 0.0360 Interquartile range 0.0360 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.0407 Domain−Specific Bilingual Russian Task − Distribution of the Topics of the Experiment Standard Deviation 0.0835 20 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 15 Upper Outlier Threshold 0.0500 Mean With No Outliers 0.0069 10 Std With No Outliers 0.0150 5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Bilingual Russian Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries BERKBDERUTHP7 176-DS 0.00 189-DS 5.00 0.8 177-DS 0.00 190-DS 0.00 178-DS 0.00 191-DS 0.00 0.6 179-DS 21.88 192-DS 0.00 180-DS 0.00 193-DS 0.00 181-DS 0.00 194-DS 3.94 0.4 182-DS 0.00 195-DS 1.46 183-DS 22.64 196-DS 0.00 0.2 184-DS 0.00 197-DS 0.00 Difference 185-DS 0.00 198-DS 13.60 0 186-DS 0.00 199-DS 0.00 187-DS 0.60 200-DS 29.27 −0.2 188-DS 3.49 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 385 cheshire 10.2415/DS-BILI-X2RU-CLEF2007.CHESHIRE.BERKBENRUCCP15 DS-BILI-X2RU-CLEF2007 Overall statistics for 25 queries : Priority 3 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language English Relevant 1,471 Topic Fields title, description Relevant retrieved 1,053 Pooled true Geometric Mean Average Precision 0.0114 EN->RU using powertrans retrieval using Class Binary Preference (BPREF) 0.1476 Clusters merged with T2FB Interploated Recall (%) Precision Averages (%) Domain−Specific Bilingual Russian Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 32.75 BERKBENRUCCP15 10 24.28 90% 20 20.54 80% 30 19.29 40 16.63 70% 50 14.78 60% 60 12.89 Precision 70 10.49 50% 80 6.83 40% 90 2.33 30% 100 0.02 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 13.48 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Bilingual Russian Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.6700 Minimum 0.0000 First Quartile 0.0042 Second Quartile 0.0335 Third Quartile 0.1610 Interquartile range 0.1568 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.1348 Domain−Specific Bilingual Russian Task − Distribution of the Topics of the Experiment Standard Deviation 0.1987 15 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 Upper Outlier Threshold 0.3383 10 Mean With No Outliers 0.0585 Std With No Outliers 0.0864 5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Bilingual Russian Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries BERKBENRUCCP15 176-DS 0.00 189-DS 0.03 0.8 177-DS 1.48 190-DS 51.86 178-DS 0.00 191-DS 0.00 0.6 179-DS 33.83 192-DS 0.55 180-DS 0.86 193-DS 8.72 181-DS 0.00 194-DS 67.00 0.4 182-DS 13.61 195-DS 6.95 183-DS 14.95 196-DS 0.97 0.2 184-DS 41.29 197-DS 8.55 Difference 185-DS 0.65 198-DS 7.96 0 186-DS 0.39 199-DS 3.35 187-DS 54.01 200-DS 19.55 −0.2 188-DS 0.43 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 386 cheshire 10.2415/DS-BILI-X2RU-CLEF2007.CHESHIRE.BERKBENRUCCP15 DS-BILI-X2RU-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Bilingual Russian Task − Retrieved documents vs Mean Precision 100% 5 docs 18.40 BERKBENRUCCP15 10 docs 20.40 90% 15 docs 20.27 80% 20 docs 20.00 30 docs 19.87 70% 100 docs 18.12 60% 200 docs 12.40 Precision 500 docs 6.98 50% 1000 docs 4.21 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 15.28 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Bilingual Russian Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.7402 Minimum 0.0000 First Quartile 0.0000 Second Quartile 0.0000 Third Quartile 0.2147 Interquartile range 0.2147 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.1528 Domain−Specific Bilingual Russian Task − Distribution of the Topics of the Experiment Standard Deviation 0.2186 15 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 Upper Outlier Threshold 0.4985 10 Mean With No Outliers 0.1087 Std With No Outliers 0.1616 5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Bilingual Russian Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries BERKBENRUCCP15 176-DS 0.00 189-DS 0.00 0.8 177-DS 0.00 190-DS 57.94 178-DS 0.00 191-DS 0.00 0.6 179-DS 40.62 192-DS 0.00 180-DS 0.00 193-DS 12.00 181-DS 0.00 194-DS 74.02 0.4 182-DS 14.29 195-DS 15.33 183-DS 18.87 196-DS 0.00 0.2 184-DS 47.27 197-DS 6.45 Difference 185-DS 0.00 198-DS 16.00 0 186-DS 0.00 199-DS 0.00 187-DS 49.85 200-DS 29.27 −0.2 188-DS 0.00 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 387 cheshire 10.2415/DS-BILI-X2RU-CLEF2007.CHESHIRE.BERKBENRUTHP7 DS-BILI-X2RU-CLEF2007 Overall statistics for 25 queries : Priority 4 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language English Relevant 1,471 Topic Fields title, description Relevant retrieved 1,080 Pooled true Geometric Mean Average Precision 0.0127 EN->RU using powertrans retrieval using Thesaurus Binary Preference (BPREF) 0.1500 lookup merged with T2FB Interploated Recall (%) Precision Averages (%) Domain−Specific Bilingual Russian Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 34.74 BERKBENRUTHP7 10 23.63 90% 20 20.68 80% 30 17.84 40 15.82 70% 50 14.83 60% 60 13.25 Precision 70 10.89 50% 80 7.47 40% 90 2.72 30% 100 0.85 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 13.41 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Bilingual Russian Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.6712 Minimum 0.0000 First Quartile 0.0032 Second Quartile 0.0235 Third Quartile 0.1480 Interquartile range 0.1448 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.1341 Domain−Specific Bilingual Russian Task − Distribution of the Topics of the Experiment Standard Deviation 0.2008 15 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 Upper Outlier Threshold 0.2827 10 Mean With No Outliers 0.0554 Std With No Outliers 0.0767 5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Bilingual Russian Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries BERKBENRUTHP7 176-DS 0.00 189-DS 0.19 0.8 177-DS 1.88 190-DS 58.85 178-DS 0.00 191-DS 0.00 0.6 179-DS 28.27 192-DS 0.51 180-DS 2.35 193-DS 8.48 181-DS 0.00 194-DS 67.12 0.4 182-DS 12.79 195-DS 7.55 183-DS 11.97 196-DS 1.70 0.2 184-DS 40.89 197-DS 7.36 Difference 185-DS 0.27 198-DS 8.84 0 186-DS 0.34 199-DS 2.27 187-DS 52.13 200-DS 20.86 −0.2 188-DS 0.74 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 388 cheshire 10.2415/DS-BILI-X2RU-CLEF2007.CHESHIRE.BERKBENRUTHP7 DS-BILI-X2RU-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Bilingual Russian Task − Retrieved documents vs Mean Precision 100% 5 docs 18.40 BERKBENRUTHP7 10 docs 18.80 90% 15 docs 19.20 80% 20 docs 19.60 30 docs 18.80 70% 100 docs 18.04 60% 200 docs 12.74 Precision 500 docs 7.06 50% 1000 docs 4.32 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 15.51 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Bilingual Russian Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.7323 Minimum 0.0000 First Quartile 0.0000 Second Quartile 0.0800 Third Quartile 0.2082 Interquartile range 0.2082 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.1551 Domain−Specific Bilingual Russian Task − Distribution of the Topics of the Experiment Standard Deviation 0.2165 15 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 Upper Outlier Threshold 0.4909 10 Mean With No Outliers 0.1099 Std With No Outliers 0.1552 5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Bilingual Russian Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries BERKBENRUTHP7 176-DS 0.00 189-DS 0.00 0.8 177-DS 0.00 190-DS 61.90 178-DS 0.00 191-DS 0.00 0.6 179-DS 33.33 192-DS 0.00 180-DS 8.82 193-DS 8.00 181-DS 0.00 194-DS 73.23 0.4 182-DS 16.33 195-DS 16.79 183-DS 11.32 196-DS 0.00 0.2 184-DS 49.09 197-DS 9.68 Difference 185-DS 0.00 198-DS 17.60 0 186-DS 0.00 199-DS 0.00 187-DS 48.96 200-DS 30.49 −0.2 188-DS 2.33 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 389 moscow 10.2415/DS-BILI-X2RU-CLEF2007.MOSCOW.CIRDSBILIEN2RU DS-BILI-X2RU-CLEF2007 Overall statistics for 25 queries : Priority 1 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 16,623 Source Language English Relevant 1,471 Topic Fields title, description Relevant retrieved 527 Pooled true Geometric Mean Average Precision 0.0041 Prompt, word pairs in window=5 Binary Preference (BPREF) 0.0870 Interploated Recall (%) Precision Averages (%) Domain−Specific Bilingual Russian Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 33.00 CIRDSBILIEN2RU 10 15.24 90% 20 10.66 80% 30 6.98 40 6.02 70% 50 5.38 60% 60 4.67 Precision 70 4.25 50% 80 3.89 40% 90 3.56 30% 100 0.37 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 7.15 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Bilingual Russian Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.7298 Minimum 0.0000 First Quartile 0.0001 Second Quartile 0.0179 Third Quartile 0.0956 Interquartile range 0.0955 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.0715 Domain−Specific Bilingual Russian Task − Distribution of the Topics of the Experiment Standard Deviation 0.1485 20 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 15 Upper Outlier Threshold 0.1752 Mean With No Outliers 0.0441 10 Std With No Outliers 0.0583 5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Bilingual Russian Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries CIRDSBILIEN2RU 176-DS 0.00 189-DS 0.17 0.8 177-DS 5.15 190-DS 72.98 178-DS 0.00 191-DS 0.00 0.6 179-DS 8.47 192-DS 3.70 180-DS 1.79 193-DS 12.84 181-DS 0.00 194-DS 2.90 0.4 182-DS 14.61 195-DS 1.34 183-DS 17.52 196-DS 0.49 0.2 184-DS 5.30 197-DS 0.68 Difference 185-DS 0.00 198-DS 14.33 0 186-DS 0.38 199-DS 2.01 187-DS 0.01 200-DS 14.13 −0.2 188-DS 0.00 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 390 moscow 10.2415/DS-BILI-X2RU-CLEF2007.MOSCOW.CIRDSBILIEN2RU DS-BILI-X2RU-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Bilingual Russian Task − Retrieved documents vs Mean Precision 100% 5 docs 16.00 CIRDSBILIEN2RU 10 docs 14.40 90% 15 docs 14.13 80% 20 docs 12.40 30 docs 11.73 70% 100 docs 8.96 60% 200 docs 6.78 Precision 500 docs 3.28 50% 1000 docs 2.11 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 10.38 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Bilingual Russian Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.7857 Minimum 0.0000 First Quartile 0.0000 Second Quartile 0.0030 Third Quartile 0.1785 Interquartile range 0.1785 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.1038 Domain−Specific Bilingual Russian Task − Distribution of the Topics of the Experiment Standard Deviation 0.1714 15 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 Upper Outlier Threshold 0.2720 10 Mean With No Outliers 0.0753 Std With No Outliers 0.0980 5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Bilingual Russian Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries CIRDSBILIEN2RU 176-DS 0.00 189-DS 0.00 0.8 177-DS 0.00 190-DS 78.57 178-DS 0.00 191-DS 0.00 0.6 179-DS 17.71 192-DS 0.00 180-DS 7.35 193-DS 24.00 181-DS 0.00 194-DS 13.39 0.4 182-DS 24.49 195-DS 9.49 183-DS 22.64 196-DS 0.00 0.2 184-DS 12.73 197-DS 3.23 Difference 185-DS 0.00 198-DS 27.20 0 186-DS 0.00 199-DS 0.00 187-DS 0.30 200-DS 18.29 −0.2 188-DS 0.00 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 391 moscow 10.2415/DS-BILI-X2RU-CLEF2007.MOSCOW.CIRDSBILIEN2RU2 DS-BILI-X2RU-CLEF2007 Overall statistics for 25 queries : Priority 2 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 16,623 Source Language English Relevant 1,471 Topic Fields title, description Relevant retrieved 525 Pooled true Geometric Mean Average Precision 0.0038 tfidf+pairs Binary Preference (BPREF) 0.0837 Interploated Recall (%) Precision Averages (%) Domain−Specific Bilingual Russian Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 33.82 CIRDSBILIEN2RU2 10 15.76 90% 20 10.65 80% 30 6.41 40 5.80 70% 50 5.09 60% 60 4.49 Precision 70 3.96 50% 80 3.82 40% 90 2.84 30% 100 0.27 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 6.82 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Bilingual Russian Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.7049 Minimum 0.0000 First Quartile 0.0001 Second Quartile 0.0160 Third Quartile 0.0813 Interquartile range 0.0812 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.0682 Domain−Specific Bilingual Russian Task − Distribution of the Topics of the Experiment Standard Deviation 0.1436 20 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 15 Upper Outlier Threshold 0.1595 Mean With No Outliers 0.0417 10 Std With No Outliers 0.0563 5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Bilingual Russian Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries CIRDSBILIEN2RU2 176-DS 0.00 189-DS 0.12 0.8 177-DS 5.21 190-DS 70.49 178-DS 0.00 191-DS 0.00 0.6 179-DS 6.69 192-DS 2.00 180-DS 1.60 193-DS 12.48 181-DS 0.00 194-DS 3.14 0.4 182-DS 14.00 195-DS 1.45 183-DS 15.95 196-DS 0.39 0.2 184-DS 5.38 197-DS 0.68 Difference 185-DS 0.00 198-DS 15.19 0 186-DS 0.41 199-DS 1.77 187-DS 0.01 200-DS 13.65 −0.2 188-DS 0.00 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 392 moscow 10.2415/DS-BILI-X2RU-CLEF2007.MOSCOW.CIRDSBILIEN2RU2 DS-BILI-X2RU-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Bilingual Russian Task − Retrieved documents vs Mean Precision 100% 5 docs 15.20 CIRDSBILIEN2RU2 10 docs 14.00 90% 15 docs 13.07 80% 20 docs 12.80 30 docs 11.60 70% 100 docs 9.12 60% 200 docs 6.32 Precision 500 docs 3.21 50% 1000 docs 2.10 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 9.76 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Bilingual Russian Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.7540 Minimum 0.0000 First Quartile 0.0000 Second Quartile 0.0030 Third Quartile 0.1577 Interquartile range 0.1577 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.0976 Domain−Specific Bilingual Russian Task − Distribution of the Topics of the Experiment Standard Deviation 0.1642 15 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 Upper Outlier Threshold 0.2800 10 Mean With No Outliers 0.0702 Std With No Outliers 0.0929 5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Bilingual Russian Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries CIRDSBILIEN2RU2 176-DS 0.00 189-DS 0.00 0.8 177-DS 0.00 190-DS 75.40 178-DS 0.00 191-DS 0.00 0.6 179-DS 10.42 192-DS 0.00 180-DS 7.35 193-DS 20.00 181-DS 0.00 194-DS 15.75 0.4 182-DS 26.53 195-DS 9.49 183-DS 18.87 196-DS 0.00 0.2 184-DS 12.73 197-DS 3.23 Difference 185-DS 0.00 198-DS 28.00 0 186-DS 0.00 199-DS 0.00 187-DS 0.30 200-DS 15.85 −0.2 188-DS 0.00 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 393 chemnitz 10.2415/DS-MULTI-CLEF2007.CHEMNITZ.CUT_DS_MULTI_DE2X_MERGED DS-MULTI-CLEF2007 Overall statistics for 25 queries : Priority 1 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language German Relevant 9,690 Topic Fields title, description Relevant retrieved 2,234 Pooled false Geometric Mean Average Precision 0.0494 (See overleaf for description) Binary Preference (BPREF) 0.1957 Interploated Recall (%) Precision Averages (%) Domain−Specific Multilingual Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 58.51 CUT_DS_MULTI_DE2X_MERGED 10 29.06 90% 20 19.91 80% 30 10.62 40 4.85 70% 50 3.14 60% 60 1.27 Precision 70 0.00 50% 80 0.00 40% 90 0.00 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 8.42 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Multilingual Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.2978 Minimum 0.0045 First Quartile 0.0183 Second Quartile 0.0593 Third Quartile 0.1215 Interquartile range 0.1032 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.0842 Domain−Specific Multilingual Task − Distribution of the Topics of the Experiment Standard Deviation 0.0801 15 Number of Topics of the Experiment Lower Outlier Threshold 0.0045 Upper Outlier Threshold 0.2362 10 Mean With No Outliers 0.0753 Std With No Outliers 0.0680 5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Multilingual Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries CUT_DS_MULTI_DE2X_MERGED 176-DS 7.26 189-DS 3.80 0.8 177-DS 5.93 190-DS 6.13 178-DS 21.38 191-DS 4.77 0.6 179-DS 12.77 192-DS 3.51 180-DS 13.32 193-DS 0.79 181-DS 29.78 194-DS 0.89 0.4 182-DS 23.62 195-DS 9.78 183-DS 0.76 196-DS 4.87 0.2 184-DS 1.81 197-DS 20.68 Difference 185-DS 4.23 198-DS 10.21 0 186-DS 1.50 199-DS 11.94 187-DS 0.45 200-DS 1.84 −0.2 188-DS 8.42 −0.4 −0.6 −0.8 −1 176−DS177−DS 178−DS179−DS180−DS 181−DS182−DS 183−DS184−DS185−DS 186−DS187−DS 188−DS189−DS190−DS 191−DS192−DS 193−DS194−DS195−DS 196−DS197−DS 198−DS199−DS200−DS Topic Identifier 394 chemnitz 10.2415/DS-MULTI-CLEF2007.CHEMNITZ.CUT_DS_MULTI_DE2X_MERGED DS-MULTI-CLEF2007 Multilingual merged unstructured indizes translated with Google translate (Beta), PROMT and the provided thesaurus Docs Cutoff Levels Precision at DCL (%) Domain−Specific Multilingual Task − Retrieved documents vs Mean Precision 100% 5 docs 32.00 CUT_DS_MULTI_DE2X_MERGED 10 docs 32.40 90% 15 docs 33.07 80% 20 docs 30.20 30 docs 29.87 70% 100 docs 28.28 60% 200 docs 22.76 Precision 500 docs 13.94 50% 1000 docs 8.94 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 18.33 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Multilingual Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.4839 Minimum 0.0416 First Quartile 0.0904 Second Quartile 0.1300 Third Quartile 0.2485 Interquartile range 0.1581 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.1833 Domain−Specific Multilingual Task − Distribution of the Topics of the Experiment Standard Deviation 0.1190 6 Number of Topics of the Experiment Lower Outlier Threshold 0.0416 5 Upper Outlier Threshold 0.4839 4 Mean With No Outliers 0.1833 3 Std With No Outliers 0.1190 2 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Multilingual Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries CUT_DS_MULTI_DE2X_MERGED 176-DS 12.15 189-DS 12.07 0.8 177-DS 18.05 190-DS 19.30 178-DS 36.18 191-DS 13.00 0.6 179-DS 29.91 192-DS 11.11 180-DS 27.26 193-DS 7.07 181-DS 48.39 194-DS 5.45 0.4 182-DS 40.64 195-DS 21.19 183-DS 4.16 196-DS 12.68 0.2 184-DS 6.68 197-DS 30.94 Difference 185-DS 12.93 198-DS 23.99 0 186-DS 7.07 199-DS 24.05 187-DS 4.88 200-DS 9.70 −0.2 188-DS 19.53 −0.4 −0.6 −0.8 −1 176−DS177−DS 178−DS179−DS180−DS 181−DS182−DS 183−DS184−DS185−DS 186−DS187−DS 188−DS189−DS190−DS 191−DS192−DS 193−DS194−DS195−DS 196−DS197−DS 198−DS199−DS200−DS Topic Identifier 395 chemnitz 10.2415/DS-MULTI-CLEF2007.CHEMNITZ.CUT_DS_MULTI_EN2X_MERGED DS-MULTI-CLEF2007 Overall statistics for 25 queries : Priority 2 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language English Relevant 9,690 Topic Fields title, description Relevant retrieved 2,662 Pooled false Geometric Mean Average Precision 0.0399 (See overleaf for description) Binary Preference (BPREF) 0.1947 Interploated Recall (%) Precision Averages (%) Domain−Specific Multilingual Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 50.79 CUT_DS_MULTI_EN2X_MERGED 10 27.08 90% 20 18.06 80% 30 9.73 40 7.12 70% 50 5.03 60% 60 1.09 Precision 70 0.00 50% 80 0.00 40% 90 0.00 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 8.33 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Multilingual Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.3120 Minimum 0.0025 First Quartile 0.0141 Second Quartile 0.0481 Third Quartile 0.1174 Interquartile range 0.1033 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.0833 Domain−Specific Multilingual Task − Distribution of the Topics of the Experiment Standard Deviation 0.0864 15 Number of Topics of the Experiment Lower Outlier Threshold 0.0025 Upper Outlier Threshold 0.2200 10 Mean With No Outliers 0.0646 Std With No Outliers 0.0595 5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Multilingual Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries CUT_DS_MULTI_EN2X_MERGED 176-DS 3.26 189-DS 1.49 0.8 177-DS 6.19 190-DS 31.20 178-DS 8.20 191-DS 0.39 0.6 179-DS 22.00 192-DS 4.40 180-DS 13.66 193-DS 2.76 181-DS 4.81 194-DS 0.27 0.4 182-DS 28.51 195-DS 11.75 183-DS 4.11 196-DS 11.74 0.2 184-DS 1.14 197-DS 9.29 Difference 185-DS 0.38 198-DS 10.56 0 186-DS 0.60 199-DS 16.50 187-DS 3.84 200-DS 0.25 −0.2 188-DS 11.05 −0.4 −0.6 −0.8 −1 176−DS177−DS 178−DS179−DS180−DS 181−DS182−DS 183−DS184−DS185−DS 186−DS187−DS 188−DS189−DS190−DS 191−DS192−DS 193−DS194−DS195−DS 196−DS197−DS 198−DS199−DS200−DS Topic Identifier 396 chemnitz 10.2415/DS-MULTI-CLEF2007.CHEMNITZ.CUT_DS_MULTI_EN2X_MERGED DS-MULTI-CLEF2007 Multilingual merged unstructured indizes translated with Google translate (Beta) and the provided thesaurus Docs Cutoff Levels Precision at DCL (%) Domain−Specific Multilingual Task − Retrieved documents vs Mean Precision 100% 5 docs 21.60 CUT_DS_MULTI_EN2X_MERGED 10 docs 24.80 90% 15 docs 26.13 80% 20 docs 24.60 30 docs 25.60 70% 100 docs 27.28 60% 200 docs 23.04 Precision 500 docs 16.03 50% 1000 docs 10.65 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 17.70 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Multilingual Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.4393 Minimum 0.0303 First Quartile 0.0775 Second Quartile 0.1729 Third Quartile 0.2438 Interquartile range 0.1663 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.1770 Domain−Specific Multilingual Task − Distribution of the Topics of the Experiment Standard Deviation 0.1204 6 Number of Topics of the Experiment Lower Outlier Threshold 0.0303 5 Upper Outlier Threshold 0.4393 4 Mean With No Outliers 0.1770 3 Std With No Outliers 0.1204 2 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Multilingual Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries CUT_DS_MULTI_EN2X_MERGED 176-DS 7.73 189-DS 7.76 0.8 177-DS 17.29 190-DS 43.93 178-DS 22.04 191-DS 5.00 0.6 179-DS 33.84 192-DS 10.63 180-DS 24.78 193-DS 8.46 181-DS 11.29 194-DS 3.98 0.4 182-DS 43.35 195-DS 29.58 183-DS 16.62 196-DS 22.54 0.2 184-DS 8.30 197-DS 22.77 Difference 185-DS 3.45 198-DS 23.14 0 186-DS 3.03 199-DS 27.85 187-DS 17.43 200-DS 3.34 −0.2 188-DS 24.25 −0.4 −0.6 −0.8 −1 176−DS177−DS 178−DS179−DS180−DS 181−DS182−DS 183−DS184−DS185−DS 186−DS187−DS 188−DS189−DS190−DS 191−DS192−DS 193−DS194−DS195−DS 196−DS197−DS 198−DS199−DS200−DS Topic Identifier 397 chemnitz 10.2415/DS-MULTI-CLEF2007.CHEMNITZ.CUT_DS_MULTI_RU2X_MERGED DS-MULTI-CLEF2007 Overall statistics for 25 queries : Priority 3 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language Russian Relevant 9,690 Topic Fields title, description Relevant retrieved 1,725 Pooled false Geometric Mean Average Precision 0.0080 (See overleaf for description) Binary Preference (BPREF) 0.1493 Interploated Recall (%) Precision Averages (%) Domain−Specific Multilingual Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 34.96 CUT_DS_MULTI_RU2X_MERGED 10 17.11 90% 20 10.45 80% 30 5.68 40 4.12 70% 50 3.45 60% 60 0.54 Precision 70 0.00 50% 80 0.00 40% 90 0.00 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 5.08 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Multilingual Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.3149 Minimum 0.0000 First Quartile 0.0020 Second Quartile 0.0246 Third Quartile 0.0643 Interquartile range 0.0623 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.0508 Domain−Specific Multilingual Task − Distribution of the Topics of the Experiment Standard Deviation 0.0757 20 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 15 Upper Outlier Threshold 0.0993 Mean With No Outliers 0.0312 10 Std With No Outliers 0.0326 5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Multilingual Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries CUT_DS_MULTI_RU2X_MERGED 176-DS 9.93 189-DS 0.07 0.8 177-DS 4.77 190-DS 31.49 178-DS 6.40 191-DS 0.37 0.6 179-DS 0.01 192-DS 0.01 180-DS 5.13 193-DS 2.46 181-DS 23.88 194-DS 0.35 0.4 182-DS 3.70 195-DS 6.33 183-DS 1.24 196-DS 6.52 0.2 184-DS 1.34 197-DS 4.88 Difference 185-DS 0.00 198-DS 7.42 0 186-DS 1.43 199-DS 0.00 187-DS 0.24 200-DS 0.03 −0.2 188-DS 9.04 −0.4 −0.6 −0.8 −1 176−DS177−DS178−DS 179−DS180−DS181−DS 182−DS183−DS 184−DS185−DS186−DS 187−DS188−DS189−DS 190−DS191−DS192−DS 193−DS194−DS 195−DS196−DS197−DS 198−DS199−DS200−DS Topic Identifier 398 chemnitz 10.2415/DS-MULTI-CLEF2007.CHEMNITZ.CUT_DS_MULTI_RU2X_MERGED DS-MULTI-CLEF2007 Multilingual merged unstructured indizes translated with Google translate (Beta), PROMT and the provided thesaurus Docs Cutoff Levels Precision at DCL (%) Domain−Specific Multilingual Task − Retrieved documents vs Mean Precision 100% 5 docs 17.60 CUT_DS_MULTI_RU2X_MERGED 10 docs 19.20 90% 15 docs 17.33 80% 20 docs 15.00 30 docs 15.20 70% 100 docs 20.08 60% 200 docs 16.50 Precision 500 docs 10.26 50% 1000 docs 6.90 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 12.25 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Multilingual Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.4761 Minimum 0.0000 First Quartile 0.0097 Second Quartile 0.0888 Third Quartile 0.1756 Interquartile range 0.1659 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.1225 Domain−Specific Multilingual Task − Distribution of the Topics of the Experiment Standard Deviation 0.1207 10 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 8 Upper Outlier Threshold 0.3710 6 Mean With No Outliers 0.1078 4 Std With No Outliers 0.0976 2 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Multilingual Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries CUT_DS_MULTI_RU2X_MERGED 176-DS 20.99 189-DS 0.86 0.8 177-DS 15.79 190-DS 47.61 178-DS 17.11 191-DS 1.00 0.6 179-DS 0.00 192-DS 0.48 180-DS 17.06 193-DS 8.88 181-DS 37.10 194-DS 4.40 0.4 182-DS 14.53 195-DS 14.94 183-DS 7.48 196-DS 21.13 0.2 184-DS 7.29 197-DS 17.08 Difference 185-DS 0.00 198-DS 18.92 0 186-DS 6.06 199-DS 0.00 187-DS 3.66 200-DS 0.67 −0.2 188-DS 23.20 −0.4 −0.6 −0.8 −1 176−DS177−DS178−DS 179−DS180−DS181−DS 182−DS183−DS 184−DS185−DS186−DS 187−DS188−DS189−DS 190−DS191−DS192−DS 193−DS194−DS 195−DS196−DS197−DS 198−DS199−DS200−DS Topic Identifier 399 cheshire 10.2415/DS-MULTI-CLEF2007.CHESHIRE.BERKMUDEP15 DS-MULTI-CLEF2007 Overall statistics for 25 queries : Priority 1 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language German Relevant 9,690 Topic Fields title, description Relevant retrieved 1,892 Pooled false Geometric Mean Average Precision 0.0073 Multilingual from German using Powertrans and Class Binary Preference (BPREF) 0.1166 Cluster Lookup Interploated Recall (%) Precision Averages (%) Domain−Specific Multilingual Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 30.88 BERKMUDEP15 10 14.99 90% 20 10.04 80% 30 6.59 40 2.33 70% 50 2.01 60% 60 1.71 Precision 70 0.00 50% 80 0.00 40% 90 0.00 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 4.68 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Multilingual Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.2369 Minimum 0.0000 First Quartile 0.0016 Second Quartile 0.0124 Third Quartile 0.0579 Interquartile range 0.0563 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.0468 Domain−Specific Multilingual Task − Distribution of the Topics of the Experiment Standard Deviation 0.0700 20 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 15 Upper Outlier Threshold 0.0642 Mean With No Outliers 0.0144 10 Std With No Outliers 0.0183 5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Multilingual Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries BERKMUDEP15 176-DS 19.41 189-DS 1.13 0.8 177-DS 1.24 190-DS 0.00 178-DS 6.42 191-DS 1.77 0.6 179-DS 23.69 192-DS 0.14 180-DS 15.25 193-DS 2.02 181-DS 2.66 194-DS 1.03 0.4 182-DS 0.02 195-DS 14.49 183-DS 0.04 196-DS 0.00 0.2 184-DS 0.62 197-DS 0.24 Difference 185-DS 0.39 198-DS 15.47 0 186-DS 3.07 199-DS 0.15 187-DS 0.16 200-DS 2.11 −0.2 188-DS 5.59 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 400 cheshire 10.2415/DS-MULTI-CLEF2007.CHESHIRE.BERKMUDEP15 DS-MULTI-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Multilingual Task − Retrieved documents vs Mean Precision 100% 5 docs 14.40 BERKMUDEP15 10 docs 14.80 90% 15 docs 16.80 80% 20 docs 17.60 30 docs 16.53 70% 100 docs 15.08 60% 200 docs 13.50 Precision 500 docs 10.14 50% 1000 docs 7.57 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 11.28 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Multilingual Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.3521 Minimum 0.0000 First Quartile 0.0269 Second Quartile 0.0700 Third Quartile 0.1549 Interquartile range 0.1280 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.1128 Domain−Specific Multilingual Task − Distribution of the Topics of the Experiment Standard Deviation 0.1144 10 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 8 Upper Outlier Threshold 0.3353 6 Mean With No Outliers 0.1028 4 Std With No Outliers 0.1051 2 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Multilingual Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries BERKMUDEP15 176-DS 30.94 189-DS 2.59 0.8 177-DS 6.77 190-DS 0.00 178-DS 14.14 191-DS 7.00 0.6 179-DS 33.53 192-DS 1.93 180-DS 30.32 193-DS 11.10 181-DS 12.90 194-DS 7.13 0.4 182-DS 0.25 195-DS 35.21 183-DS 1.11 196-DS 0.00 0.2 184-DS 6.28 197-DS 2.72 Difference 185-DS 3.02 198-DS 27.20 0 186-DS 10.10 199-DS 3.16 187-DS 3.66 200-DS 11.37 −0.2 188-DS 19.53 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 401 cheshire 10.2415/DS-MULTI-CLEF2007.CHESHIRE.BERKMUDETHP7 DS-MULTI-CLEF2007 Overall statistics for 25 queries : Priority 4 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language German Relevant 9,690 Topic Fields title, description Relevant retrieved 1,966 Pooled false Geometric Mean Average Precision 0.0085 Multilingual from German using Powertrans and Binary Preference (BPREF) 0.1214 Thesaurus Lookup Interploated Recall (%) Precision Averages (%) Domain−Specific Multilingual Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 30.28 BERKMUDETHP7 10 15.46 90% 20 10.71 80% 30 6.67 40 2.36 70% 50 2.04 60% 60 1.81 Precision 70 1.00 50% 80 0.00 40% 90 0.00 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 4.86 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Multilingual Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.2560 Minimum 0.0000 First Quartile 0.0020 Second Quartile 0.0167 Third Quartile 0.0705 Interquartile range 0.0685 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.0486 Domain−Specific Multilingual Task − Distribution of the Topics of the Experiment Standard Deviation 0.0710 20 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 15 Upper Outlier Threshold 0.1685 Mean With No Outliers 0.0400 10 Std With No Outliers 0.0576 5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Multilingual Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries BERKMUDETHP7 176-DS 16.85 189-DS 1.02 0.8 177-DS 1.67 190-DS 0.00 178-DS 6.85 191-DS 1.94 0.6 179-DS 25.60 192-DS 0.21 180-DS 15.60 193-DS 2.13 181-DS 3.22 194-DS 0.91 0.4 182-DS 0.02 195-DS 15.89 183-DS 0.12 196-DS 0.00 0.2 184-DS 0.47 197-DS 0.45 Difference 185-DS 0.41 198-DS 14.91 0 186-DS 2.84 199-DS 0.14 187-DS 0.15 200-DS 2.44 −0.2 188-DS 7.65 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 402 cheshire 10.2415/DS-MULTI-CLEF2007.CHESHIRE.BERKMUDETHP7 DS-MULTI-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Multilingual Task − Retrieved documents vs Mean Precision 100% 5 docs 13.60 BERKMUDETHP7 10 docs 14.40 90% 15 docs 17.07 80% 20 docs 18.00 30 docs 16.67 70% 100 docs 16.00 60% 200 docs 13.84 Precision 500 docs 10.78 50% 1000 docs 7.86 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 11.61 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Multilingual Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.3623 Minimum 0.0000 First Quartile 0.0296 Second Quartile 0.0752 Third Quartile 0.1677 Interquartile range 0.1381 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.1161 Domain−Specific Multilingual Task − Distribution of the Topics of the Experiment Standard Deviation 0.1145 10 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 8 Upper Outlier Threshold 0.3623 6 Mean With No Outliers 0.1161 4 Std With No Outliers 0.1145 2 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Multilingual Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries BERKMUDETHP7 176-DS 27.07 189-DS 1.72 0.8 177-DS 7.52 190-DS 0.00 178-DS 14.80 191-DS 8.00 0.6 179-DS 34.44 192-DS 3.38 180-DS 30.76 193-DS 10.96 181-DS 14.52 194-DS 7.13 0.4 182-DS 0.25 195-DS 36.23 183-DS 2.77 196-DS 0.00 0.2 184-DS 5.47 197-DS 4.95 Difference 185-DS 3.02 198-DS 27.70 0 186-DS 10.10 199-DS 1.90 187-DS 3.22 200-DS 11.71 −0.2 188-DS 22.67 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 403 cheshire 10.2415/DS-MULTI-CLEF2007.CHESHIRE.BERKMUENP15 DS-MULTI-CLEF2007 Overall statistics for 25 queries : Priority 2 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language English Relevant 9,690 Topic Fields title, description Relevant retrieved 3,323 Pooled false Geometric Mean Average Precision 0.0484 Multilingual from English using Powertrans and Binary Preference (BPREF) 0.1947 Class Cluster Lookup Interploated Recall (%) Precision Averages (%) Domain−Specific Multilingual Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 44.23 BERKMUENP15 10 28.21 90% 20 21.43 80% 30 15.31 40 6.93 70% 50 1.80 60% 60 1.21 Precision 70 1.00 50% 80 0.00 40% 90 0.00 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 8.84 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Multilingual Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.2548 Minimum 0.0032 First Quartile 0.0172 Second Quartile 0.0666 Third Quartile 0.1410 Interquartile range 0.1239 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.0884 Domain−Specific Multilingual Task − Distribution of the Topics of the Experiment Standard Deviation 0.0823 15 Number of Topics of the Experiment Lower Outlier Threshold 0.0032 Upper Outlier Threshold 0.2548 10 Mean With No Outliers 0.0884 Std With No Outliers 0.0823 5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Multilingual Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries BERKMUENP15 176-DS 2.80 189-DS 1.08 0.8 177-DS 1.03 190-DS 7.74 178-DS 6.66 191-DS 7.90 0.6 179-DS 25.48 192-DS 1.87 180-DS 22.05 193-DS 23.29 181-DS 0.80 194-DS 7.80 0.4 182-DS 0.72 195-DS 20.45 183-DS 10.44 196-DS 0.32 0.2 184-DS 12.74 197-DS 1.25 Difference 185-DS 4.36 198-DS 21.50 0 186-DS 2.31 199-DS 3.55 187-DS 13.48 200-DS 5.29 −0.2 188-DS 15.97 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 404 cheshire 10.2415/DS-MULTI-CLEF2007.CHESHIRE.BERKMUENP15 DS-MULTI-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Multilingual Task − Retrieved documents vs Mean Precision 100% 5 docs 24.80 BERKMUENP15 10 docs 23.60 90% 15 docs 26.93 80% 20 docs 28.60 30 docs 27.87 70% 100 docs 27.80 60% 200 docs 24.58 Precision 500 docs 18.44 50% 1000 docs 13.29 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 18.52 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Multilingual Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.4048 Minimum 0.0000 First Quartile 0.0713 Second Quartile 0.1700 Third Quartile 0.3064 Interquartile range 0.2351 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.1852 Domain−Specific Multilingual Task − Distribution of the Topics of the Experiment Standard Deviation 0.1310 5 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 4 Upper Outlier Threshold 0.4048 3 Mean With No Outliers 0.1852 2 Std With No Outliers 0.1310 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Multilingual Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries BERKMUENP15 176-DS 8.84 189-DS 4.31 0.8 177-DS 6.77 190-DS 21.14 178-DS 14.80 191-DS 17.00 0.6 179-DS 40.48 192-DS 7.25 180-DS 35.28 193-DS 38.14 181-DS 0.00 194-DS 21.80 0.4 182-DS 4.68 195-DS 37.56 183-DS 23.27 196-DS 0.00 0.2 184-DS 28.74 197-DS 4.46 Difference 185-DS 14.66 198-DS 35.81 0 186-DS 8.08 199-DS 10.13 187-DS 30.19 200-DS 17.73 −0.2 188-DS 31.98 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 405 cheshire 10.2415/DS-MULTI-CLEF2007.CHESHIRE.BERKMUENTHP7 DS-MULTI-CLEF2007 Overall statistics for 25 queries : Priority 5 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language English Relevant 9,690 Topic Fields title, description Relevant retrieved 3,237 Pooled false Geometric Mean Average Precision 0.0435 Multilingual from English using Powertrans and Binary Preference (BPREF) 0.1916 Thesaurus Lookup Interploated Recall (%) Precision Averages (%) Domain−Specific Multilingual Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 45.26 BERKMUENTHP7 10 27.16 90% 20 19.50 80% 30 13.65 40 6.90 70% 50 1.50 60% 60 1.08 Precision 70 0.93 50% 80 0.00 40% 90 0.00 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 8.39 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Multilingual Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.2515 Minimum 0.0013 First Quartile 0.0199 Second Quartile 0.0544 Third Quartile 0.1362 Interquartile range 0.1163 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.0839 Domain−Specific Multilingual Task − Distribution of the Topics of the Experiment Standard Deviation 0.0824 15 Number of Topics of the Experiment Lower Outlier Threshold 0.0013 Upper Outlier Threshold 0.2515 10 Mean With No Outliers 0.0839 Std With No Outliers 0.0824 5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Multilingual Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries BERKMUENTHP7 176-DS 3.23 189-DS 0.60 0.8 177-DS 1.39 190-DS 6.80 178-DS 6.29 191-DS 4.77 0.6 179-DS 23.81 192-DS 2.18 180-DS 25.15 193-DS 22.93 181-DS 1.14 194-DS 6.08 0.4 182-DS 0.45 195-DS 19.53 183-DS 8.42 196-DS 0.13 0.2 184-DS 11.19 197-DS 1.03 Difference 185-DS 4.33 198-DS 21.75 0 186-DS 2.41 199-DS 2.99 187-DS 14.40 200-DS 5.44 −0.2 188-DS 13.35 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 406 cheshire 10.2415/DS-MULTI-CLEF2007.CHESHIRE.BERKMUENTHP7 DS-MULTI-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Multilingual Task − Retrieved documents vs Mean Precision 100% 5 docs 24.00 BERKMUENTHP7 10 docs 23.60 90% 15 docs 28.27 80% 20 docs 28.20 30 docs 27.47 70% 100 docs 26.64 60% 200 docs 23.62 Precision 500 docs 17.80 50% 1000 docs 12.95 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 17.84 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Multilingual Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.3950 Minimum 0.0000 First Quartile 0.0745 Second Quartile 0.1509 Third Quartile 0.2873 Interquartile range 0.2128 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.1784 Domain−Specific Multilingual Task − Distribution of the Topics of the Experiment Standard Deviation 0.1279 5 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 4 Upper Outlier Threshold 0.3950 3 Mean With No Outliers 0.1784 2 Std With No Outliers 0.1279 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Multilingual Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries BERKMUENTHP7 176-DS 11.60 189-DS 2.59 0.8 177-DS 7.52 190-DS 19.49 178-DS 13.16 191-DS 11.00 0.6 179-DS 37.46 192-DS 7.25 180-DS 39.50 193-DS 39.11 181-DS 3.23 194-DS 18.45 0.4 182-DS 3.69 195-DS 36.34 183-DS 18.01 196-DS 0.00 0.2 184-DS 28.14 197-DS 4.46 Difference 185-DS 15.09 198-DS 34.63 0 186-DS 10.10 199-DS 8.86 187-DS 30.52 200-DS 17.73 −0.2 188-DS 28.05 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 407 cheshire 10.2415/DS-MULTI-CLEF2007.CHESHIRE.BERKMURUP15 DS-MULTI-CLEF2007 Overall statistics for 25 queries : Priority 3 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language Russian Relevant 9,690 Topic Fields title, description Relevant retrieved 2,125 Pooled false Geometric Mean Average Precision 0.0167 Multilingual from Russian using Powertrans and Binary Preference (BPREF) 0.1259 Class Cluster Lookup Interploated Recall (%) Precision Averages (%) Domain−Specific Multilingual Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 44.26 BERKMURUP15 10 14.93 90% 20 9.43 80% 30 3.09 40 1.73 70% 50 1.34 60% 60 0.98 Precision 70 0.00 50% 80 0.00 40% 90 0.00 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 4.14 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Multilingual Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.2094 Minimum 0.0003 First Quartile 0.0097 Second Quartile 0.0229 Third Quartile 0.0633 Interquartile range 0.0536 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.0414 Domain−Specific Multilingual Task − Distribution of the Topics of the Experiment Standard Deviation 0.0497 20 Number of Topics of the Experiment Lower Outlier Threshold 0.0003 15 Upper Outlier Threshold 0.1190 Mean With No Outliers 0.0345 10 Std With No Outliers 0.0360 5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Multilingual Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries BERKMURUP15 176-DS 0.05 189-DS 0.03 0.8 177-DS 1.09 190-DS 9.51 178-DS 0.46 191-DS 7.28 0.6 179-DS 20.94 192-DS 1.72 180-DS 10.95 193-DS 2.52 181-DS 4.76 194-DS 6.02 0.4 182-DS 0.62 195-DS 3.26 183-DS 2.27 196-DS 1.18 0.2 184-DS 1.29 197-DS 2.37 Difference 185-DS 1.48 198-DS 2.98 0 186-DS 0.38 199-DS 0.04 187-DS 8.23 200-DS 2.29 −0.2 188-DS 11.90 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 408 cheshire 10.2415/DS-MULTI-CLEF2007.CHESHIRE.BERKMURUP15 DS-MULTI-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Multilingual Task − Retrieved documents vs Mean Precision 100% 5 docs 22.40 BERKMURUP15 10 docs 17.60 90% 15 docs 17.33 80% 20 docs 16.20 30 docs 15.60 70% 100 docs 15.44 60% 200 docs 14.44 Precision 500 docs 11.29 50% 1000 docs 8.50 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 12.38 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Multilingual Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.3082 Minimum 0.0000 First Quartile 0.0319 Second Quartile 0.1114 Third Quartile 0.1915 Interquartile range 0.1596 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.1238 Domain−Specific Multilingual Task − Distribution of the Topics of the Experiment Standard Deviation 0.0961 8 Number of Topics of the Experiment 7 Lower Outlier Threshold 0.0000 6 Upper Outlier Threshold 0.3082 5 Mean With No Outliers 0.1238 4 3 Std With No Outliers 0.0961 2 1 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Multilingual Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries BERKMURUP15 176-DS 0.55 189-DS 0.00 0.8 177-DS 2.26 190-DS 27.94 178-DS 2.30 191-DS 18.00 0.6 179-DS 30.82 192-DS 8.70 180-DS 26.24 193-DS 13.87 181-DS 22.58 194-DS 16.14 0.4 182-DS 6.16 195-DS 17.40 183-DS 10.53 196-DS 4.23 0.2 184-DS 3.24 197-DS 11.14 Difference 185-DS 8.62 198-DS 12.16 0 186-DS 3.03 199-DS 0.63 187-DS 24.97 200-DS 13.04 −0.2 188-DS 25.03 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 409 cheshire 10.2415/DS-MULTI-CLEF2007.CHESHIRE.BERKMURUTHP7 DS-MULTI-CLEF2007 Overall statistics for 25 queries : Priority 6 Total number of documents over all queries Query Construction AUTOMATIC Retrieved 25,000 Source Language Russian Relevant 9,690 Topic Fields title, description Relevant retrieved 2,087 Pooled false Geometric Mean Average Precision 0.0156 Multilingual from Russian using Powertrans and Binary Preference (BPREF) 0.1230 Thesaurus Lookup Interploated Recall (%) Precision Averages (%) Domain−Specific Multilingual Task − Standard Recall Levels vs Mean Interpolated Precision 100% 0 42.60 BERKMURUTHP7 10 14.49 90% 20 8.74 80% 30 3.90 40 1.54 70% 50 1.20 60% 60 0.91 Precision 70 0.00 50% 80 0.00 40% 90 0.00 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 4.00 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Recall Domain−Specific Multilingual Task − Box plot of the Topics of the Experiment AVERAGE_PRECISION Maximum 0.1938 Minimum 0.0003 First Quartile 0.0040 Second Quartile 0.0258 Third Quartile 0.0554 Interquartile range 0.0514 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Mean 0.0400 Domain−Specific Multilingual Task − Distribution of the Topics of the Experiment Standard Deviation 0.0480 20 Number of Topics of the Experiment Lower Outlier Threshold 0.0003 15 Upper Outlier Threshold 0.0989 Mean With No Outliers 0.0290 10 Std With No Outliers 0.0293 5 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Average Precision Precision averages (%) for individual 1 Domain−Specific Multilingual Task − Comparison to Median Average Precision by Topic (Topics 176−DS to 200−DS) queries BERKMURUTHP7 176-DS 0.08 189-DS 0.04 0.8 177-DS 1.24 190-DS 9.89 178-DS 0.39 191-DS 5.53 0.6 179-DS 19.38 192-DS 1.34 180-DS 8.80 193-DS 2.70 181-DS 4.52 194-DS 5.57 0.4 182-DS 0.40 195-DS 4.19 183-DS 2.58 196-DS 0.37 0.2 184-DS 1.04 197-DS 1.70 Difference 185-DS 1.87 198-DS 3.31 0 186-DS 0.34 199-DS 0.03 187-DS 7.89 200-DS 2.81 −0.2 188-DS 13.97 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 410 cheshire 10.2415/DS-MULTI-CLEF2007.CHESHIRE.BERKMURUTHP7 DS-MULTI-CLEF2007 Docs Cutoff Levels Precision at DCL (%) Domain−Specific Multilingual Task − Retrieved documents vs Mean Precision 100% 5 docs 20.80 BERKMURUTHP7 10 docs 18.00 90% 15 docs 18.67 80% 20 docs 18.00 30 docs 16.40 70% 100 docs 14.68 60% 200 docs 14.04 Precision 500 docs 11.24 50% 1000 docs 8.35 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 11.92 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Domain−Specific Multilingual Task − Box plot of the Topics of the Experiment R_PRECISION Maximum 0.2960 Minimum 0.0000 First Quartile 0.0301 Second Quartile 0.1000 Third Quartile 0.2008 Interquartile range 0.1707 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Mean 0.1192 Domain−Specific Multilingual Task − Distribution of the Topics of the Experiment Standard Deviation 0.0978 10 Number of Topics of the Experiment Lower Outlier Threshold 0.0000 8 Upper Outlier Threshold 0.2960 6 Mean With No Outliers 0.1192 4 Std With No Outliers 0.0978 2 0 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% R−Precision Precision averages (%) for individual 1 Domain−Specific Multilingual Task − Comparison to Median R−Precision by Topic (Topics 176−DS to 200−DS) queries BERKMURUTHP7 176-DS 0.55 189-DS 0.00 0.8 177-DS 2.26 190-DS 29.60 178-DS 1.64 191-DS 10.00 0.6 179-DS 29.31 192-DS 7.25 180-DS 24.34 193-DS 14.42 181-DS 22.58 194-DS 17.19 0.4 182-DS 2.96 195-DS 19.24 183-DS 10.25 196-DS 3.52 0.2 184-DS 3.44 197-DS 8.66 Difference 185-DS 9.48 198-DS 13.01 0 186-DS 3.03 199-DS 0.63 187-DS 22.97 200-DS 13.71 −0.2 188-DS 27.92 −0.4 −0.6 −0.8 −1 176−DS 177−DS 178−DS 179−DS 180−DS 181−DS 182−DS 183−DS 184−DS 185−DS 186−DS 187−DS 188−DS 189−DS 190−DS 191−DS 192−DS 193−DS 194−DS 195−DS 196−DS 197−DS 198−DS 199−DS 200−DS Topic Identifier 411