Appendix D
Results of the GeoCLEF Track
Prepared by:
Giorgio Maria Di Nunzio and Nicola Ferro
{dinunzio, ferro}@dei.unipd.it
Department of Information Engineering
University of Padua
Italy
1
2
Introduction
3
4
Results for CLEF 2007 GeoCLEF Track
The following pages contain the results and graphs for all the experiments that have been officially submitted to the CLEF 2007
campaign for the GeoCLEF track.
This document is divided in three main parts:
1. List of submitted experiments
2. Track overview results and graphs
3. Individual experiment results and graphs
1. List of Submitted Experiments
This section gives a listing of all experiments and their characteristics:
Participant: name of the participant who submitted the experiment.
Country: country of the participant.
Expeirment DOI: Digital Object Identifier (DOI) for each experiment.
Task: track/task to which the experiment belongs.
Lang.: language of the topics used to create the experiment (ISO identifiers for language).
Fields: identifies the parts of the topics used to create the experiment (T = title, D = Description, N = Narrative).
Constr.: identifies how the query has been constructed from topic fields (manual/automatic).
Pool: specifies if experiment was used for relevance assessment pooling.
2. Track Overview Results and Graphs
For each track/task graphs and tables are shown in order to compare the experiments.
The graphs and tables contain the following information:
- Best experiments of at most top five participants
- Interpolated recall vs precision averages plot
- Average precision comparison to median plot
- All experiments
- Average precision box plot
- Average precision Tukey t-test plot
- Best experiments of at most top five participants
- Document cutoff levels (DCL) vs precision at DCL plot
- R-Precision comparison to median plot
- All experiments
- R-Precision box plot
- R-Precision Tukey t-test plot
- A table with descriptive statistics of performance figures for each topic
- Min: The minimum of a set of observations
- 1st Q: The first quartile of a set of observations
- 2nd Q: The second quartile (median) of a set of observations
- 3rd Q: The third quartile of a set of observations
- Max: The maximum of a set of observations
- Mean: The arithmetic mean of a set of observations
- Std: The standard deviation of a set of observations
- IQR: Interquartile range, the difference between the 3rd and 1st quartiles
- Range: The difference between the maximum and the minimum of a set of observations
- C.Var: Coefficient of variation, the spread of a set of data as a proportion of its mean
- Geom.: The geometric mean of a set of observations
- Harm.: The harmonic mean of a set of observations
- MAO: The mean of absolute deviation of the values in a set of observations
- LOT: The lower threshold below which values of a set of observations are considered outliers
- UOT: The upper threshold below which values of a set of observations are considered outliers
- MNO: Mean without outliers, the arithmetic mean of a set of observations without outliers
- SNO: Std without outliers, the standard deviation a set of observations without outliers
5
3. Individual Experiment Results and Graphs
This section provides the individual results for each official experiment. For each experiment the following tables and graphs are
shown:
- Overall statistics and information
- Interpolated recall vs precision averages plot
- Average precision statistics and box plot
- Average precision comparison to median plot
- Document cutoff levels vs precision at DCL plot
- R-Precision statistics and box plot
- R-Precision comparison to median plot
Topics are identified with DOIs, as well as the experiments. The prefix for the DOI of a topic is 10.2452. The following example
shows how to build the DOI for a topic given its number: for topic 200-AH, the corresponding DOI is 10.2452/200-AH
6
List of Submitted Experiments
7
8
Participant Country Experiment DOI Task Lang. Fields Constr. Pool
cheshire United States 10.2415/GC-MONO-DE- GC-MONO-DE-CLEF2007 de TD AUTOMATIC yes
CLEF2007.CHESHIRE.BERKMODEBASE
csusm United States 10.2415/GC-MONO-DE- GC-MONO-DE-CLEF2007 de TD AUTOMATIC yes
CLEF2007.CSUSM.GEOMODE1
csusm United States 10.2415/GC-MONO-DE- GC-MONO-DE-CLEF2007 de TDN AUTOMATIC yes
CLEF2007.CSUSM.GEOMODE2
csusm United States 10.2415/GC-MONO-DE- GC-MONO-DE-CLEF2007 de TD AUTOMATIC yes
CLEF2007.CSUSM.GEOMODE3
csusm United States 10.2415/GC-MONO-DE- GC-MONO-DE-CLEF2007 de TD AUTOMATIC yes
CLEF2007.CSUSM.GEOMODE4
csusm United States 10.2415/GC-MONO-DE- GC-MONO-DE-CLEF2007 de TDN AUTOMATIC yes
CLEF2007.CSUSM.GEOMODE5
csusm United States 10.2415/GC-MONO-DE- GC-MONO-DE-CLEF2007 de TDN AUTOMATIC yes
CLEF2007.CSUSM.GEOMODE6
hagen Germany 10.2415/GC-MONO-DE- GC-MONO-DE-CLEF2007 de TD AUTOMATIC yes
CLEF2007.HAGEN.FUHTD2DE
hagen Germany 10.2415/GC-MONO-DE- GC-MONO-DE-CLEF2007 de TD AUTOMATIC yes
CLEF2007.HAGEN.FUHTD3DE
hagen Germany 10.2415/GC-MONO-DE- GC-MONO-DE-CLEF2007 de TD AUTOMATIC yes
CLEF2007.HAGEN.FUHTD6DE
hagen Germany 10.2415/GC-MONO-DE- GC-MONO-DE-CLEF2007 de TDN AUTOMATIC yes
CLEF2007.HAGEN.FUHTDN4DE
hagen Germany 10.2415/GC-MONO-DE- GC-MONO-DE-CLEF2007 de TDN AUTOMATIC yes
CLEF2007.HAGEN.FUHTDN5DE
hildesheim Germany 10.2415/GC-MONO-DE- GC-MONO-DE-CLEF2007 de TD AUTOMATIC yes
CLEF2007.HILDESHEIM.HIMODEBASE
hildesheim Germany 10.2415/GC-MONO-DE- GC-MONO-DE-CLEF2007 es TD AUTOMATIC yes
CLEF2007.HILDESHEIM.HIMODENE2
hildesheim Germany 10.2415/GC-MONO-DE- GC-MONO-DE-CLEF2007 es TDN AUTOMATIC yes
CLEF2007.HILDESHEIM.HIMODENE2NA
hildesheim Germany 10.2415/GC-MONO-DE- GC-MONO-DE-CLEF2007 es TD AUTOMATIC yes
CLEF2007.HILDESHEIM.HIMODENE3
catalunya Spain 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 en TD AUTOMATIC yes
CLEF2007.CATALUNYA.TALPGEOIRTD1
catalunya Spain 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 en TD AUTOMATIC no
CLEF2007.CATALUNYA.TALPGEOIRTD2
catalunya Spain 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 es TDN AUTOMATIC yes
CLEF2007.CATALUNYA.TALPGEOIRTDN1
catalunya Spain 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 en TDN AUTOMATIC no
CLEF2007.CATALUNYA.TALPGEOIRTDN2
catalunya Spain 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 en TDN AUTOMATIC no
CLEF2007.CATALUNYA.TALPGEOIRTDN3
cheshire United States 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 en TD AUTOMATIC yes
CLEF2007.CHESHIRE.BERKMOENBASE
csusm United States 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 en TD AUTOMATIC yes
CLEF2007.CSUSM.GEOMOEN1
csusm United States 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 en TDN AUTOMATIC yes
CLEF2007.CSUSM.GEOMOEN2
csusm United States 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 en TD AUTOMATIC no
CLEF2007.CSUSM.GEOMOEN3
csusm United States 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 en TD AUTOMATIC no
CLEF2007.CSUSM.GEOMOEN4
csusm United States 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 en TDN AUTOMATIC no
CLEF2007.CSUSM.GEOMOEN5
csusm United States 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 en TDN AUTOMATIC no
CLEF2007.CSUSM.GEOMOEN6
groningen Netherlands 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 en T MANUAL no
CLEF2007.GRONINGEN.CLCGGEOEET00
groningen Netherlands 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 en TD MANUAL no
CLEF2007.GRONINGEN.CLCGGEOEETD00
groningen Netherlands 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 en TDN MANUAL no
CLEF2007.GRONINGEN.CLCGGEOEETDN00
groningen Netherlands 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 en TDN MANUAL yes
CLEF2007.GRONINGEN.CLCGGEOEETDN01
groningen Netherlands 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 en TDN MANUAL yes
CLEF2007.GRONINGEN.CLCGGEOEETDN01B
hildesheim Germany 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 es TD AUTOMATIC yes
CLEF2007.HILDESHEIM.HIMOENBASE
hildesheim Germany 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 es TDN AUTOMATIC yes
CLEF2007.HILDESHEIM.HIMOENNANE
hildesheim Germany 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 en TD AUTOMATIC no
CLEF2007.HILDESHEIM.HIMOENNE
hildesheim Germany 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 en TD AUTOMATIC no
CLEF2007.HILDESHEIM.HIMOENNE2
icl United 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 en TDN MANUAL yes
Kingdom CLEF2007.ICL.IMPCOLCOMBINATION
icl United 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 en TDN MANUAL yes
Kingdom CLEF2007.ICL.IMPCOLGEOONLY
icl United 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 en TDN MANUAL no
Kingdom CLEF2007.ICL.IMPCOLNOGEO
9
Participant Country Experiment DOI Task Lang. Fields Constr. Pool
icl United 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 en TDN MANUAL no
Kingdom CLEF2007.ICL.IMPCOLTEXTONLY
linguit United 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 en T AUTOMATIC yes
Kingdom CLEF2007.LINGUIT.LTITLE2007
linguit United 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 en TD AUTOMATIC yes
Kingdom CLEF2007.LINGUIT.LTITLEDESC2007
linguit United 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 en T MANUAL no
Kingdom CLEF2007.LINGUIT.LTITLEEXPMANUAL2007
linguit United 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 en T MANUAL no
Kingdom CLEF2007.LINGUIT.LTITLEGEORERANK2007
moscow Russian 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 es TD AUTOMATIC yes
Federation CLEF2007.MOSCOW.CIRGEOEN07_RUN1
moscow Russian 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 en TN AUTOMATIC yes
Federation CLEF2007.MOSCOW.CIRGEOEN07_RUN2
msasia China 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 en TD AUTOMATIC no
CLEF2007.MSASIA.MSRAEXPANSION
msasia China 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 en TDN AUTOMATIC yes
CLEF2007.MSASIA.MSRALDA
msasia China 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 en TD AUTOMATIC no
CLEF2007.MSASIA.MSRALOCATION
msasia China 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 en TDN AUTOMATIC no
CLEF2007.MSASIA.MSRATEXT
msasia China 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 en TD AUTOMATIC yes
CLEF2007.MSASIA.MSRAWHITELIST
valencia Spain 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 en TD AUTOMATIC no
CLEF2007.VALENCIA.RFIAUPV01
valencia Spain 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 en TDN AUTOMATIC no
CLEF2007.VALENCIA.RFIAUPV02
valencia Spain 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 en TD AUTOMATIC yes
CLEF2007.VALENCIA.RFIAUPV03
valencia Spain 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 en TDN AUTOMATIC yes
CLEF2007.VALENCIA.RFIAUPV04
valencia Spain 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 en TD AUTOMATIC no
CLEF2007.VALENCIA.RFIAUPV05
valencia Spain 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 en TDN AUTOMATIC no
CLEF2007.VALENCIA.RFIAUPV06
valencia Spain 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 en TD AUTOMATIC no
CLEF2007.VALENCIA.RFIAUPV07
valencia Spain 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 en TD AUTOMATIC no
CLEF2007.VALENCIA.RFIAUPV08
valencia Spain 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 en TD AUTOMATIC no
CLEF2007.VALENCIA.RFIAUPV09
valencia Spain 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 en TD AUTOMATIC no
CLEF2007.VALENCIA.RFIAUPV10
valencia Spain 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 en TD AUTOMATIC no
CLEF2007.VALENCIA.RFIAUPV11
valencia Spain 10.2415/GC-MONO-EN- GC-MONO-EN-CLEF2007 en TD AUTOMATIC no
CLEF2007.VALENCIA.RFIAUPV12
xldb Portugal 10.2415/GC-MONO-EN-CLEF2007.XLDB.XLDBEN_1 GC-MONO-EN-CLEF2007 en TD AUTOMATIC yes
xldb Portugal 10.2415/GC-MONO-EN-CLEF2007.XLDB.XLDBEN_2 GC-MONO-EN-CLEF2007 en T AUTOMATIC yes
xldb Portugal 10.2415/GC-MONO-EN-CLEF2007.XLDB.XLDBEN_3 GC-MONO-EN-CLEF2007 en T AUTOMATIC no
xldb Portugal 10.2415/GC-MONO-EN-CLEF2007.XLDB.XLDBEN_4 GC-MONO-EN-CLEF2007 en T AUTOMATIC no
xldb Portugal 10.2415/GC-MONO-EN-CLEF2007.XLDB.XLDBEN_5 GC-MONO-EN-CLEF2007 en T AUTOMATIC no
cheshire United States 10.2415/GC-MONO-PT- GC-MONO-PT-CLEF2007 pt TD AUTOMATIC yes
CLEF2007.CHESHIRE.BERKMOPTBASE
csusm United States 10.2415/GC-MONO-PT- GC-MONO-PT-CLEF2007 es TD AUTOMATIC yes
CLEF2007.CSUSM.GEOBIESPT1
csusm United States 10.2415/GC-MONO-PT- GC-MONO-PT-CLEF2007 pt TD AUTOMATIC yes
CLEF2007.CSUSM.GEOMOPT1
csusm United States 10.2415/GC-MONO-PT- GC-MONO-PT-CLEF2007 pt TDN AUTOMATIC yes
CLEF2007.CSUSM.GEOMOPT2
csusm United States 10.2415/GC-MONO-PT- GC-MONO-PT-CLEF2007 pt TD AUTOMATIC yes
CLEF2007.CSUSM.GEOMOPT3
csusm United States 10.2415/GC-MONO-PT- GC-MONO-PT-CLEF2007 pt TDN AUTOMATIC yes
CLEF2007.CSUSM.GEOMOPT4
xldb Portugal 10.2415/GC-MONO-PT-CLEF2007.XLDB.XLDBPT_1 GC-MONO-PT-CLEF2007 pt TD AUTOMATIC yes
xldb Portugal 10.2415/GC-MONO-PT-CLEF2007.XLDB.XLDBPT_2 GC-MONO-PT-CLEF2007 pt T AUTOMATIC yes
xldb Portugal 10.2415/GC-MONO-PT-CLEF2007.XLDB.XLDBPT_3 GC-MONO-PT-CLEF2007 pt T AUTOMATIC yes
xldb Portugal 10.2415/GC-MONO-PT-CLEF2007.XLDB.XLDBPT_4 GC-MONO-PT-CLEF2007 pt T AUTOMATIC yes
xldb Portugal 10.2415/GC-MONO-PT-CLEF2007.XLDB.XLDBPT_5 GC-MONO-PT-CLEF2007 pt T AUTOMATIC yes
10
Participant Country Experiment DOI Task Lang. Fields Constr. Pool
cheshire United States 10.2415/GC-BILI-X2DE- GC-BILI-X2DE-CLEF2007 en TD AUTOMATIC yes
CLEF2007.CHESHIRE.BERKBIENDEBASE
cheshire United States 10.2415/GC-BILI-X2DE- GC-BILI-X2DE-CLEF2007 es TD AUTOMATIC yes
CLEF2007.CHESHIRE.BERKBIESDEBASE
cheshire United States 10.2415/GC-BILI-X2DE- GC-BILI-X2DE-CLEF2007 pt TD AUTOMATIC yes
CLEF2007.CHESHIRE.BERKBIPTDEBASE
hagen Germany 10.2415/GC-BILI-X2DE- GC-BILI-X2DE-CLEF2007 en TD AUTOMATIC yes
CLEF2007.HAGEN.FUHTD1EN
hagen Germany 10.2415/GC-BILI-X2DE- GC-BILI-X2DE-CLEF2007 en TD AUTOMATIC yes
CLEF2007.HAGEN.FUHTD2EN
hagen Germany 10.2415/GC-BILI-X2DE- GC-BILI-X2DE-CLEF2007 en TD AUTOMATIC yes
CLEF2007.HAGEN.FUHTD3EN
hagen Germany 10.2415/GC-BILI-X2DE- GC-BILI-X2DE-CLEF2007 en TDN AUTOMATIC yes
CLEF2007.HAGEN.FUHTDN4EN
hagen Germany 10.2415/GC-BILI-X2DE- GC-BILI-X2DE-CLEF2007 en TDN AUTOMATIC yes
CLEF2007.HAGEN.FUHTDN5EN
cheshire United States 10.2415/GC-BILI-X2EN- GC-BILI-X2EN-CLEF2007 de TD AUTOMATIC yes
CLEF2007.CHESHIRE.BERKBIDEENBASE
cheshire United States 10.2415/GC-BILI-X2EN- GC-BILI-X2EN-CLEF2007 es TD AUTOMATIC yes
CLEF2007.CHESHIRE.BERKBIESENBASE
cheshire United States 10.2415/GC-BILI-X2EN- GC-BILI-X2EN-CLEF2007 pt TD AUTOMATIC no
CLEF2007.CHESHIRE.BERKBIPTENBASE
csusm United States 10.2415/GC-BILI-X2EN- GC-BILI-X2EN-CLEF2007 es TDN MANUAL yes
CLEF2007.CSUSM.GEOBIESEN1
csusm United States 10.2415/GC-BILI-X2EN- GC-BILI-X2EN-CLEF2007 es TD MANUAL yes
CLEF2007.CSUSM.GEOBIESEN2
csusm United States 10.2415/GC-BILI-X2EN- GC-BILI-X2EN-CLEF2007 es TD MANUAL no
CLEF2007.CSUSM.GEOBIESEN3
csusm United States 10.2415/GC-BILI-X2EN- GC-BILI-X2EN-CLEF2007 es TD MANUAL no
CLEF2007.CSUSM.GEOBIESEN4
depok Indonesia 10.2415/GC-BILI-X2EN- GC-BILI-X2EN-CLEF2007 id TD AUTOMATIC yes
CLEF2007.DEPOK.UIBITDGP
depok Indonesia 10.2415/GC-BILI-X2EN- GC-BILI-X2EN-CLEF2007 id TD AUTOMATIC no
CLEF2007.DEPOK.UIBITDGPGEOFB
depok Indonesia 10.2415/GC-BILI-X2EN- GC-BILI-X2EN-CLEF2007 id TD AUTOMATIC yes
CLEF2007.DEPOK.UIBITDGPPF5
depok Indonesia 10.2415/GC-BILI-X2EN- GC-BILI-X2EN-CLEF2007 id T AUTOMATIC no
CLEF2007.DEPOK.UIBITGP
depok Indonesia 10.2415/GC-BILI-X2EN- GC-BILI-X2EN-CLEF2007 id T AUTOMATIC no
CLEF2007.DEPOK.UIBITGPGEOFB
depok Indonesia 10.2415/GC-BILI-X2EN- GC-BILI-X2EN-CLEF2007 id T AUTOMATIC no
CLEF2007.DEPOK.UIBITGPPF5
cheshire United States 10.2415/GC-BILI-X2PT- GC-BILI-X2PT-CLEF2007 de TD AUTOMATIC yes
CLEF2007.CHESHIRE.BERKBIDEPTBASE
cheshire United States 10.2415/GC-BILI-X2PT- GC-BILI-X2PT-CLEF2007 en TD AUTOMATIC yes
CLEF2007.CHESHIRE.BERKBIENPTBASE
cheshire United States 10.2415/GC-BILI-X2PT- GC-BILI-X2PT-CLEF2007 es TD AUTOMATIC yes
CLEF2007.CHESHIRE.BERKBIESPTBASE
csusm United States 10.2415/GC-BILI-X2PT- GC-BILI-X2PT-CLEF2007 es TD AUTOMATIC yes
CLEF2007.CSUSM.GEOBIESPT1
csusm United States 10.2415/GC-BILI-X2PT- GC-BILI-X2PT-CLEF2007 es TD AUTOMATIC yes
CLEF2007.CSUSM.GEOBIESPT2
csusm United States 10.2415/GC-BILI-X2PT- GC-BILI-X2PT-CLEF2007 es TDN AUTOMATIC yes
CLEF2007.CSUSM.GEOBIESPT3
csusm United States 10.2415/GC-BILI-X2PT- GC-BILI-X2PT-CLEF2007 es TDN AUTOMATIC yes
CLEF2007.CSUSM.GEOBIESPT4
11
Track Overview Results and Graphs
12
13
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-DE-CLEF2007
GeoCLEF Monolingual German Task Top 5 Participants − Standard Recall Levels vs Mean Interpolated Precision
100%
hagen [Experiment FUHTDN5DE; MAP 25.76%; Pooled]
csusm [Experiment GEOMODE5; MAP 21.41%; Pooled]
90% hildesheim [Experiment HIMODENE2NA; MAP 20.67%; Pooled]
cheshire [Experiment BERKMODEBASE; MAP 13.92%; Pooled]
80%
70%
60%
Precision
50%
40%
30%
20%
10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual German Task Top 5 Participants − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
1
hagen [Experiment FUHTDN5DE; MAP 25.76%; Pooled]
csusm [Experiment GEOMODE5; MAP 21.41%; Pooled]
hildesheim [Experiment HIMODENE2NA; MAP 20.67%; Pooled]
cheshire [Experiment BERKMODEBASE; MAP 13.92%; Pooled]
0.8
0.6
0.4
0.2
Difference
0
−0.2
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
14
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-DE-CLEF2007
GeoCLEF Monolingual German Task − Box Plot of the Topics
hagen [Experiment FUHTDN5DE; MAP 25.76%; Pooled]
hagen [Experiment FUHTDN4DE; MAP 23.58%; Pooled]
csusm [Experiment GEOMODE5; MAP 21.41%; Pooled]
csusm [Experiment GEOMODE4; MAP 21.41%; Pooled]
hildesheim [Experiment HIMODENE2NA; MAP 20.67%; Pooled]
csusm [Experiment GEOMODE6; MAP 20.38%; Pooled]
csusm [Experiment GEOMODE1; MAP 20.38%; Pooled]
hildesheim [Experiment HIMODEBASE; MAP 20.19%; Pooled]
Experiments
hagen [Experiment FUHTD6DE; MAP 19.57%; Pooled]
hildesheim [Experiment HIMODENE2; MAP 19.53%; Pooled]
hagen [Experiment FUHTD2DE; MAP 19.11%; Pooled]
hagen [Experiment FUHTD3DE; MAP 19.09%; Pooled]
hildesheim [Experiment HIMODENE3; MAP 17.95%; Pooled]
cheshire [Experiment BERKMODEBASE; MAP 13.92%; Pooled]
csusm [Experiment GEOMODE3; MAP 11.70%; Pooled]
csusm [Experiment GEOMODE2; MAP 11.70%; Pooled]
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Average Precision
15
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-DE-CLEF2007
10.2455/TUKEY_T_TEST.40A773D08F2E0F044438139E14B327C3
GeoCLEF Monolingual German Task − Tukey T test with "top group" highlighted
FUHTDN5DE
FUHTDN4DE
GEOMODE4
GEOMODE5
GEOMODE1
GEOMODE6
HIMODENE2NA
Experiments
FUHTD6DE
HIMODEBASE
FUHTD3DE
HIMODENE2
FUHTD2DE
HIMODENE3
BERKMODEBASE
GEOMODE2
GEOMODE3
0.2 0.25 0.3 0.35 0.4 0.45 0.5 0.55 0.6 0.65
arcsin(sqrt(Average Precsion))
16
17
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-DE-CLEF2007
GeoCLEF Monolingual German Task Top 5 Participants − Retrieved documents vs Mean Precision
100%
hagen [Experiment FUHTDN5DE; R−Prec 26.58%; Pooled]
csusm [Experiment GEOMODE5; R−Prec 22.99%; Pooled]
90% hildesheim [Experiment HIMODENE2NA; R−Prec 23.41%; Pooled]
cheshire [Experiment BERKMODEBASE; R−Prec 16.36%; Pooled]
80%
70%
60%
Precision
50%
40%
30%
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual German Task Top 5 Participants − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
1
hagen [Experiment FUHTDN5DE; R−Prec 26.58%; Pooled]
csusm [Experiment GEOMODE5; R−Prec 22.99%; Pooled]
hildesheim [Experiment HIMODENE2NA; R−Prec 23.41%; Pooled]
cheshire [Experiment BERKMODEBASE; R−Prec 16.36%; Pooled]
0.8
0.6
0.4
0.2
Difference
0
−0.2
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
18
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-DE-CLEF2007
GeoCLEF Monolingual German Task − Box Plot of the Topics
hagen [Experiment FUHTDN5DE; R−Prec 26.58%; Pooled]
hagen [Experiment FUHTDN4DE; R−Prec 23.67%; Pooled]
hildesheim [Experiment HIMODENE2NA; R−Prec 23.41%; Pooled]
csusm [Experiment GEOMODE5; R−Prec 22.99%; Pooled]
csusm [Experiment GEOMODE4; R−Prec 22.99%; Pooled]
hagen [Experiment FUHTD6DE; R−Prec 22.68%; Pooled]
csusm [Experiment GEOMODE6; R−Prec 22.10%; Pooled]
csusm [Experiment GEOMODE1; R−Prec 22.10%; Pooled]
Experiments
hagen [Experiment FUHTD2DE; R−Prec 21.66%; Pooled]
hagen [Experiment FUHTD3DE; R−Prec 21.58%; Pooled]
hildesheim [Experiment HIMODEBASE; R−Prec 19.93%; Pooled]
hildesheim [Experiment HIMODENE2; R−Prec 19.48%; Pooled]
hildesheim [Experiment HIMODENE3; R−Prec 18.60%; Pooled]
cheshire [Experiment BERKMODEBASE; R−Prec 16.36%; Pooled]
csusm [Experiment GEOMODE3; R−Prec 14.75%; Pooled]
csusm [Experiment GEOMODE2; R−Prec 14.75%; Pooled]
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
R−Precision
19
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-DE-CLEF2007
GeoCLEF Monolingual German Task − Tukey T test with "top group" highlighted
FUHTDN5DE
GEOMODE4
GEOMODE5
GEOMODE1
GEOMODE6
HIMODENE2NA
FUHTDN4DE
Experiments
FUHTD6DE
FUHTD3DE
FUHTD2DE
HIMODEBASE
HIMODENE2
HIMODENE3
GEOMODE2
GEOMODE3
BERKMODEBASE
0.2 0.25 0.3 0.35 0.4 0.45 0.5 0.55 0.6 0.65
arcsin(sqrt(R−Precision))
20
21
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-DE-CLEF2007
Statistics for Number of relevant retrieved documents
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 2.00 8.50 11.50 22.50 30.00 14.56 9.19 14.00 28.00 0.63 11.47 8.28 7.83 2.00 30.00 14.56 9.19
52-GC 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 N/D 0.00 0.00 0.00 0.00 0.00 0.00 0.00
53-GC 2.00 5.00 7.00 10.00 10.00 6.88 2.96 5.00 8.00 0.43 6.09 5.14 2.39 2.00 10.00 6.88 2.96
54-GC 1.00 3.50 4.00 4.00 4.00 3.62 0.81 0.50 3.00 0.22 3.48 3.20 0.56 3.00 4.00 3.80 0.41
55-GC 0.00 2.00 2.00 4.00 7.00 2.81 2.01 2.00 7.00 0.71 1.16 0.00 1.62 0.00 7.00 2.81 2.01
56-GC 2.00 2.00 3.50 5.00 5.00 3.50 1.26 3.00 3.00 0.36 3.27 3.05 1.12 2.00 5.00 3.50 1.26
57-GC 0.00 0.50 1.00 1.00 1.00 0.75 0.45 0.50 1.00 0.60 0.06 0.00 0.38 0.00 1.00 0.75 0.45
58-GC 4.00 17.00 19.00 19.00 19.00 17.38 3.74 2.00 15.00 0.22 16.58 14.89 2.11 16.00 19.00 18.27 1.16
59-GC 0.00 1.00 3.00 4.00 4.00 2.44 1.63 3.00 4.00 0.67 0.26 0.00 1.45 0.00 4.00 2.44 1.63
60-GC 0.00 7.50 33.00 43.00 49.00 26.00 17.75 35.50 49.00 0.68 3.82 0.00 15.50 0.00 49.00 26.00 17.75
61-GC 0.00 8.00 17.50 27.00 46.00 21.19 14.41 19.00 46.00 0.68 7.62 0.00 11.71 0.00 46.00 21.19 14.41
62-GC 13.00 22.50 29.00 32.00 32.00 26.56 6.82 9.50 19.00 0.26 25.53 24.29 5.53 13.00 32.00 26.56 6.82
63-GC 22.00 26.00 29.00 35.50 36.00 30.06 5.22 9.50 14.00 0.17 29.62 29.18 4.57 22.00 36.00 30.06 5.22
64-GC 1.00 1.00 3.00 4.50 7.00 3.19 2.07 3.50 6.00 0.65 2.52 1.96 1.81 1.00 7.00 3.19 2.07
65-GC 20.00 44.00 58.00 76.00 83.00 57.19 20.32 32.00 63.00 0.36 52.86 47.41 15.69 20.00 83.00 57.19 20.32
66-GC 1.00 1.00 1.00 2.00 2.00 1.38 0.50 1.00 1.00 0.36 1.30 1.23 0.47 1.00 2.00 1.38 0.50
67-GC 55.00 60.00 61.00 61.00 61.00 60.38 1.50 1.00 6.00 0.02 60.36 60.34 0.86 60.00 61.00 60.73 0.46
68-GC 97.00 185.00 212.00 223.00 228.00 196.19 42.12 38.00 131.00 0.21 190.37 182.55 30.12 176.00 228.00 210.36 17.80
69-GC 20.00 24.00 29.00 39.00 41.00 30.69 8.07 15.00 21.00 0.26 29.67 28.68 7.44 20.00 41.00 30.69 8.07
70-GC 5.00 7.00 7.00 13.50 18.00 9.69 4.45 6.50 13.00 0.46 8.88 8.25 3.82 5.00 18.00 9.69 4.45
71-GC 0.00 4.00 5.00 7.00 7.00 4.94 2.35 3.00 7.00 0.48 1.05 0.00 1.82 0.00 7.00 4.94 2.35
72-GC 3.00 3.00 3.50 7.50 8.00 4.75 2.21 4.50 5.00 0.46 4.33 3.99 1.94 3.00 8.00 4.75 2.21
73-GC 1.00 5.00 7.00 7.00 7.00 5.75 1.91 2.00 6.00 0.33 5.23 4.33 1.56 3.00 7.00 6.07 1.49
74-GC 0.00 5.00 6.50 7.00 8.00 5.69 2.50 2.00 8.00 0.44 1.20 0.00 1.80 4.00 8.00 6.50 1.22
75-GC 37.00 79.50 95.00 109.50 114.00 88.25 23.95 30.00 77.00 0.27 84.11 78.55 17.84 37.00 114.00 88.25 23.95
22
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-DE-CLEF2007
Statistics for Average Precsion
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0014 0.0072 0.0456 0.1681 0.2601 0.0866 0.0968 0.1609 0.2588 1.1176 0.0280 0.0061 0.0841 0.0014 0.2601 0.0866 0.0968
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0004 0.0068 0.0792 0.1243 0.1985 0.0778 0.0709 0.1174 0.1981 0.9115 0.0245 0.0024 0.0634 0.0004 0.1985 0.0778 0.0709
54-GC 0.0186 0.1554 0.3025 0.5114 0.7803 0.3164 0.2275 0.3560 0.7617 0.7190 0.1974 0.0799 0.1739 0.0186 0.7803 0.3164 0.2275
55-GC 0.0000 0.0010 0.0213 0.0729 0.1467 0.0426 0.0501 0.0719 0.1467 1.1755 0.0086 0.0001 0.0412 0.0000 0.1467 0.0426 0.0501
56-GC 0.0025 0.0399 0.0696 0.2323 0.2512 0.1218 0.1016 0.1924 0.2487 0.8340 0.0650 0.0175 0.0939 0.0025 0.2512 0.1218 0.1016
57-GC 0.0000 0.0015 0.0156 0.1114 0.5000 0.0792 0.1401 0.1099 0.5000 1.7687 0.0044 0.0000 0.1041 0.0000 0.2500 0.0512 0.0868
58-GC 0.0029 0.1623 0.2355 0.2779 0.3509 0.2058 0.0922 0.1156 0.3481 0.4477 0.1553 0.0369 0.0728 0.0029 0.3509 0.2058 0.0922
59-GC 0.0000 0.0224 0.3232 0.4452 0.5457 0.2626 0.2136 0.4228 0.5457 0.8133 0.0305 0.0001 0.1934 0.0000 0.5457 0.2626 0.2136
60-GC 0.0000 0.0245 0.1214 0.3918 0.5436 0.1882 0.1944 0.3673 0.5436 1.0329 0.0371 0.0001 0.1649 0.0000 0.5436 0.1882 0.1944
61-GC 0.0000 0.0324 0.1742 0.2271 0.5400 0.1883 0.1849 0.1948 0.5400 0.9820 0.0682 0.0002 0.1422 0.0000 0.4920 0.1388 0.1353
62-GC 0.0064 0.0180 0.0771 0.2767 0.3636 0.1402 0.1445 0.2587 0.3572 1.0307 0.0590 0.0234 0.1255 0.0064 0.3636 0.1402 0.1445
63-GC 0.1471 0.3013 0.3440 0.3915 0.4513 0.3406 0.0780 0.0902 0.3042 0.2291 0.3303 0.3172 0.0606 0.2649 0.4513 0.3535 0.0606
64-GC 0.0003 0.0012 0.0040 0.0149 0.0238 0.0085 0.0088 0.0137 0.0236 1.0282 0.0037 0.0015 0.0078 0.0003 0.0238 0.0085 0.0088
65-GC 0.0238 0.0483 0.1080 0.2959 0.3479 0.1578 0.1254 0.2477 0.3241 0.7948 0.1067 0.0691 0.1112 0.0238 0.3479 0.1578 0.1254
66-GC 0.0011 0.0050 0.0104 0.0213 0.0810 0.0198 0.0239 0.0163 0.0799 1.2087 0.0112 0.0063 0.0165 0.0011 0.0311 0.0116 0.0088
67-GC 0.7339 0.7690 0.7922 0.8126 0.8153 0.7854 0.0271 0.0436 0.0815 0.0345 0.7849 0.7845 0.0227 0.7339 0.8153 0.7854 0.0271
68-GC 0.0860 0.3219 0.4025 0.4859 0.5782 0.3843 0.1419 0.1641 0.4922 0.3691 0.3435 0.2788 0.1028 0.0860 0.5782 0.3843 0.1419
69-GC 0.1108 0.1237 0.2423 0.4974 0.6440 0.3215 0.2094 0.3736 0.5332 0.6514 0.2570 0.2070 0.1874 0.1108 0.6440 0.3215 0.2094
70-GC 0.0029 0.0066 0.0898 0.1084 0.1243 0.0639 0.0516 0.1018 0.1214 0.8072 0.0315 0.0117 0.0488 0.0029 0.1243 0.0639 0.0516
71-GC 0.0000 0.0226 0.0719 0.2292 0.3492 0.1251 0.1375 0.2066 0.3492 1.0989 0.0284 0.0001 0.1120 0.0000 0.3492 0.1251 0.1375
72-GC 0.0014 0.0042 0.0560 0.1115 0.2081 0.0672 0.0669 0.1072 0.2067 0.9952 0.0244 0.0063 0.0592 0.0014 0.2081 0.0672 0.0669
73-GC 0.0024 0.0295 0.0579 0.3452 0.4120 0.1616 0.1673 0.3157 0.4096 1.0356 0.0699 0.0199 0.1455 0.0024 0.4120 0.1616 0.1673
74-GC 0.0000 0.0219 0.0733 0.3079 0.4810 0.1643 0.1660 0.2860 0.4810 1.0108 0.0336 0.0001 0.1476 0.0000 0.4810 0.1643 0.1660
75-GC 0.0476 0.3963 0.4499 0.5877 0.8481 0.4773 0.2320 0.1914 0.8004 0.4860 0.3835 0.2283 0.1627 0.3963 0.8481 0.5387 0.1722
23
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-DE-CLEF2007
Statistics for R-Precision
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0167 0.0833 0.2333 0.3000 0.1208 0.1167 0.2167 0.3000 0.9655 0.0114 0.0000 0.1026 0.0000 0.3000 0.1208 0.1167
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0500 0.2000 0.3000 0.1000 0.1265 0.2000 0.3000 1.2649 0.0013 0.0000 0.1000 0.0000 0.3000 0.1000 0.1265
54-GC 0.0000 0.1250 0.5000 0.5000 0.7500 0.3438 0.2394 0.3750 0.7500 0.6963 0.0301 0.0000 0.2070 0.0000 0.7500 0.3438 0.2394
55-GC 0.0000 0.0000 0.0000 0.1429 0.1429 0.0536 0.0714 0.1429 0.1429 1.3333 0.0004 0.0000 0.0670 0.0000 0.1429 0.0536 0.0714
56-GC 0.0000 0.0000 0.0000 0.2000 0.2000 0.0875 0.1025 0.2000 0.2000 1.1711 0.0008 0.0000 0.0984 0.0000 0.2000 0.0875 0.1025
57-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
58-GC 0.0000 0.1579 0.2895 0.3947 0.5263 0.2730 0.1504 0.2368 0.5263 0.5507 0.1372 0.0002 0.1349 0.0000 0.5263 0.2730 0.1504
59-GC 0.0000 0.0000 0.2500 0.2500 0.5000 0.1719 0.1505 0.2500 0.5000 0.8758 0.0059 0.0000 0.1289 0.0000 0.5000 0.1719 0.1505
60-GC 0.0000 0.0385 0.2308 0.4423 0.5577 0.2452 0.2054 0.4038 0.5577 0.8377 0.0548 0.0001 0.1719 0.0000 0.5577 0.2452 0.2054
61-GC 0.0000 0.0435 0.2283 0.3261 0.6087 0.2310 0.2042 0.2826 0.6087 0.8842 0.0878 0.0002 0.1658 0.0000 0.6087 0.2310 0.2042
62-GC 0.0000 0.0000 0.0781 0.3281 0.4375 0.1621 0.1761 0.3281 0.4375 1.0864 0.0047 0.0000 0.1589 0.0000 0.4375 0.1621 0.1761
63-GC 0.3000 0.3500 0.3500 0.3750 0.5000 0.3719 0.0491 0.0250 0.2000 0.1319 0.3691 0.3665 0.0340 0.3250 0.3750 0.3562 0.0155
64-GC 0.0000 0.0000 0.0000 0.0769 0.0769 0.0288 0.0385 0.0769 0.0769 1.3333 0.0003 0.0000 0.0361 0.0000 0.0769 0.0288 0.0385
65-GC 0.0947 0.1158 0.2211 0.4211 0.4632 0.2546 0.1513 0.3053 0.3684 0.5944 0.2110 0.1754 0.1388 0.0947 0.4632 0.2546 0.1513
66-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
67-GC 0.7213 0.7377 0.7623 0.7951 0.8033 0.7643 0.0316 0.0574 0.0820 0.0413 0.7637 0.7631 0.0266 0.7213 0.8033 0.7643 0.0316
68-GC 0.1822 0.4219 0.4796 0.5204 0.5762 0.4487 0.1160 0.0985 0.3941 0.2587 0.4282 0.3990 0.0812 0.4052 0.5762 0.4867 0.0552
69-GC 0.2000 0.2444 0.3667 0.5556 0.7333 0.4153 0.1927 0.3111 0.5333 0.4639 0.3736 0.3358 0.1653 0.2000 0.7333 0.4153 0.1927
70-GC 0.0000 0.0000 0.1304 0.1739 0.2174 0.1005 0.0949 0.1739 0.2174 0.9437 0.0024 0.0000 0.0880 0.0000 0.2174 0.1005 0.0949
71-GC 0.0000 0.0000 0.0000 0.2857 0.4286 0.1339 0.1842 0.2857 0.4286 1.3753 0.0009 0.0000 0.1507 0.0000 0.4286 0.1339 0.1842
72-GC 0.0000 0.0000 0.1000 0.1000 0.3000 0.0750 0.0775 0.1000 0.3000 1.0328 0.0034 0.0000 0.0563 0.0000 0.1000 0.0600 0.0507
73-GC 0.0000 0.0000 0.1429 0.2857 0.2857 0.1250 0.1264 0.2857 0.2857 1.0115 0.0027 0.0000 0.1094 0.0000 0.2857 0.1250 0.1264
74-GC 0.0000 0.0000 0.2500 0.2500 0.3750 0.1719 0.1505 0.2500 0.3750 0.8758 0.0058 0.0000 0.1348 0.0000 0.3750 0.1719 0.1505
75-GC 0.1404 0.5175 0.5263 0.6316 0.7544 0.5340 0.1788 0.1140 0.6140 0.3348 0.4880 0.4152 0.1150 0.4649 0.7544 0.5902 0.0981
24
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-DE-CLEF2007
Statistics for Binary Preference
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0006 0.0433 0.1706 0.2700 0.0873 0.1006 0.1700 0.2700 1.1526 0.0054 0.0000 0.0873 0.0000 0.2700 0.0873 0.1006
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0350 0.1400 0.2300 0.0731 0.0939 0.1400 0.2300 1.2845 0.0011 0.0000 0.0747 0.0000 0.2300 0.0731 0.0939
54-GC 0.0000 0.0312 0.3750 0.5000 0.7500 0.3047 0.2359 0.4688 0.7500 0.7743 0.0259 0.0000 0.1963 0.0000 0.7500 0.3047 0.2359
55-GC 0.0000 0.0000 0.0000 0.1224 0.1429 0.0485 0.0649 0.1224 0.1429 1.3392 0.0003 0.0000 0.0606 0.0000 0.1429 0.0485 0.0649
56-GC 0.0000 0.0000 0.0000 0.2000 0.2000 0.0850 0.1000 0.2000 0.2000 1.1765 0.0008 0.0000 0.0956 0.0000 0.2000 0.0850 0.1000
57-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
58-GC 0.0000 0.0886 0.2078 0.3296 0.4044 0.2031 0.1281 0.2410 0.4044 0.6305 0.0980 0.0002 0.1169 0.0000 0.4044 0.2031 0.1281
59-GC 0.0000 0.0000 0.1875 0.2500 0.3750 0.1602 0.1443 0.2500 0.3750 0.9009 0.0055 0.0000 0.1289 0.0000 0.3750 0.1602 0.1443
60-GC 0.0000 0.0377 0.1561 0.4027 0.5503 0.2095 0.1939 0.3650 0.5503 0.9252 0.0471 0.0001 0.1655 0.0000 0.5503 0.2095 0.1939
61-GC 0.0000 0.0421 0.1994 0.2786 0.5515 0.2073 0.1885 0.2365 0.5515 0.9090 0.0796 0.0002 0.1499 0.0000 0.5515 0.2073 0.1885
62-GC 0.0000 0.0000 0.0576 0.2710 0.3545 0.1302 0.1473 0.2710 0.3545 1.1313 0.0034 0.0000 0.1318 0.0000 0.3545 0.1302 0.1473
63-GC 0.1906 0.3156 0.3341 0.3431 0.4337 0.3317 0.0567 0.0275 0.2431 0.1708 0.3267 0.3210 0.0365 0.2925 0.3713 0.3315 0.0200
64-GC 0.0000 0.0000 0.0000 0.0444 0.0592 0.0189 0.0256 0.0444 0.0592 1.3565 0.0002 0.0000 0.0236 0.0000 0.0592 0.0189 0.0256
65-GC 0.0500 0.0726 0.1453 0.3568 0.3839 0.1948 0.1399 0.2842 0.3340 0.7183 0.1447 0.1079 0.1274 0.0500 0.3839 0.1948 0.1399
66-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
67-GC 0.8038 0.8421 0.8503 0.8557 0.8624 0.8446 0.0177 0.0136 0.0586 0.0210 0.8444 0.8442 0.0132 0.8412 0.8624 0.8521 0.0075
68-GC 0.2929 0.5713 0.6674 0.7308 0.7563 0.6276 0.1460 0.1596 0.4635 0.2326 0.6057 0.5760 0.1070 0.5540 0.7563 0.6754 0.0699
69-GC 0.1654 0.1783 0.2706 0.5380 0.7042 0.3662 0.2087 0.3598 0.5388 0.5698 0.3128 0.2699 0.1860 0.1654 0.7042 0.3662 0.2087
70-GC 0.0000 0.0000 0.1115 0.1172 0.1456 0.0683 0.0627 0.1172 0.1456 0.9181 0.0020 0.0000 0.0598 0.0000 0.1456 0.0683 0.0627
71-GC 0.0000 0.0000 0.0000 0.2347 0.3878 0.1097 0.1679 0.2347 0.3878 1.5310 0.0007 0.0000 0.1390 0.0000 0.3878 0.1097 0.1679
72-GC 0.0000 0.0000 0.0550 0.1000 0.2800 0.0650 0.0728 0.1000 0.2800 1.1193 0.0030 0.0000 0.0531 0.0000 0.1000 0.0507 0.0464
73-GC 0.0000 0.0000 0.0408 0.2755 0.2857 0.1084 0.1273 0.2755 0.2857 1.1740 0.0022 0.0000 0.1118 0.0000 0.2857 0.1084 0.1273
74-GC 0.0000 0.0000 0.0625 0.2812 0.3750 0.1406 0.1478 0.2812 0.3750 1.0510 0.0046 0.0000 0.1367 0.0000 0.3750 0.1406 0.1478
75-GC 0.1424 0.5158 0.5665 0.6858 0.8827 0.5697 0.2098 0.1701 0.7403 0.3682 0.5146 0.4312 0.1421 0.5104 0.8827 0.6308 0.1366
25
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-DE-CLEF2007
Statistics for Precision at the 0% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0319 0.0380 0.1909 0.8636 1.0000 0.3975 0.4224 0.8256 0.9681 1.0624 0.1724 0.0778 0.3837 0.0319 1.0000 0.3975 0.4224
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0021 0.0173 0.2019 0.3250 0.5000 0.1987 0.1788 0.3077 0.4979 0.9001 0.0739 0.0117 0.1513 0.0021 0.5000 0.1987 0.1788
54-GC 0.0316 0.2667 0.6667 1.0000 1.0000 0.6445 0.3905 0.7333 0.9684 0.6059 0.4111 0.1558 0.3222 0.0316 1.0000 0.6445 0.3905
55-GC 0.0000 0.0052 0.0449 0.5000 1.0000 0.2632 0.3559 0.4948 1.0000 1.3521 0.0353 0.0002 0.3026 0.0000 1.0000 0.2632 0.3559
56-GC 0.0063 0.0851 0.1964 1.0000 1.0000 0.4613 0.4453 0.9149 0.9937 0.9652 0.2022 0.0480 0.4088 0.0063 1.0000 0.4613 0.4453
57-GC 0.0000 0.0015 0.0156 0.1114 0.5000 0.0792 0.1401 0.1099 0.5000 1.7687 0.0044 0.0000 0.1041 0.0000 0.2500 0.0512 0.0868
58-GC 0.0211 0.2969 0.5250 0.7778 1.0000 0.5255 0.2674 0.4809 0.9789 0.5090 0.4158 0.1993 0.2238 0.0211 1.0000 0.5255 0.2674
59-GC 0.0000 0.0897 0.6667 1.0000 1.0000 0.5633 0.4620 0.9103 1.0000 0.8201 0.0612 0.0001 0.4367 0.0000 1.0000 0.5633 0.4620
60-GC 0.0000 0.5833 1.0000 1.0000 1.0000 0.7604 0.3650 0.4167 1.0000 0.4800 0.2015 0.0001 0.2995 0.0000 1.0000 0.7604 0.3650
61-GC 0.0000 1.0000 1.0000 1.0000 1.0000 0.9236 0.2525 0.0000 1.0000 0.2733 0.4794 0.0002 0.1337 1.0000 1.0000 1.0000 0.0000
62-GC 0.0169 0.0302 0.1762 0.6458 1.0000 0.3721 0.3935 0.6156 0.9831 1.0574 0.1433 0.0539 0.3483 0.0169 1.0000 0.3721 0.3935
63-GC 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 0.0000 0.0000 0.0000 0.0000 1.0000 1.0000 0.0000 1.0000 1.0000 1.0000 0.0000
64-GC 0.0035 0.0053 0.0282 0.1548 0.2500 0.0808 0.0941 0.1495 0.2465 1.1646 0.0293 0.0114 0.0835 0.0035 0.2500 0.0808 0.0941
65-GC 0.1552 0.5032 1.0000 1.0000 1.0000 0.7524 0.3214 0.4968 0.8448 0.4271 0.6505 0.5073 0.2785 0.1552 1.0000 0.7524 0.3214
66-GC 0.0022 0.0099 0.0156 0.0359 0.1429 0.0339 0.0412 0.0260 0.1406 1.2169 0.0199 0.0120 0.0276 0.0022 0.0500 0.0196 0.0138
67-GC 0.8571 0.9062 0.9524 1.0000 1.0000 0.9429 0.0521 0.0938 0.1429 0.0552 0.9415 0.9401 0.0404 0.8571 1.0000 0.9429 0.0521
68-GC 0.5000 0.7896 0.9000 1.0000 1.0000 0.8692 0.1683 0.2104 0.5000 0.1937 0.8503 0.8271 0.1271 0.5000 1.0000 0.8692 0.1683
69-GC 0.7333 0.9155 1.0000 1.0000 1.0000 0.9519 0.0833 0.0845 0.2667 0.0875 0.9482 0.9440 0.0661 0.8333 1.0000 0.9665 0.0615
70-GC 0.0104 0.0312 1.0000 1.0000 1.0000 0.5748 0.4980 0.9688 0.9896 0.8663 0.2014 0.0508 0.4783 0.0104 1.0000 0.5748 0.4980
71-GC 0.0000 0.0435 0.1155 0.6250 1.0000 0.3227 0.4100 0.5815 1.0000 1.2704 0.0543 0.0001 0.3386 0.0000 1.0000 0.3227 0.4100
72-GC 0.0059 0.0233 0.1833 1.0000 1.0000 0.4524 0.4607 0.9767 0.9941 1.0183 0.1439 0.0298 0.4292 0.0059 1.0000 0.4524 0.4607
73-GC 0.0169 0.0533 0.1714 1.0000 1.0000 0.4196 0.4296 0.9467 0.9831 1.0240 0.1903 0.0799 0.3829 0.0169 1.0000 0.4196 0.4296
74-GC 0.0000 0.0399 0.2500 1.0000 1.0000 0.4589 0.4479 0.9601 1.0000 0.9760 0.0779 0.0001 0.4058 0.0000 1.0000 0.4589 0.4479
75-GC 0.8684 1.0000 1.0000 1.0000 1.0000 0.9918 0.0329 0.0000 0.1316 0.0332 0.9912 0.9906 0.0154 1.0000 1.0000 1.0000 0.0000
26
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-DE-CLEF2007
Statistics for Precision at the 10% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0354 0.1847 0.4286 0.7273 0.2446 0.2543 0.3931 0.7273 1.0395 0.0636 0.0002 0.2127 0.0000 0.7273 0.2446 0.2543
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0021 0.0173 0.2019 0.3250 0.5000 0.1987 0.1788 0.3077 0.4979 0.9001 0.0739 0.0117 0.1513 0.0021 0.5000 0.1987 0.1788
54-GC 0.0316 0.2667 0.6667 1.0000 1.0000 0.6445 0.3905 0.7333 0.9684 0.6059 0.4111 0.1558 0.3222 0.0316 1.0000 0.6445 0.3905
55-GC 0.0000 0.0052 0.0449 0.5000 1.0000 0.2632 0.3559 0.4948 1.0000 1.3521 0.0353 0.0002 0.3026 0.0000 1.0000 0.2632 0.3559
56-GC 0.0063 0.0851 0.1964 1.0000 1.0000 0.4613 0.4453 0.9149 0.9937 0.9652 0.2022 0.0480 0.4088 0.0063 1.0000 0.4613 0.4453
57-GC 0.0000 0.0015 0.0156 0.1114 0.5000 0.0792 0.1401 0.1099 0.5000 1.7687 0.0044 0.0000 0.1041 0.0000 0.2500 0.0512 0.0868
58-GC 0.0211 0.2770 0.4308 0.7222 0.7778 0.4663 0.2491 0.4452 0.7567 0.5341 0.3678 0.1880 0.2163 0.0211 0.7778 0.4663 0.2491
59-GC 0.0000 0.0897 0.6667 1.0000 1.0000 0.5633 0.4620 0.9103 1.0000 0.8201 0.0612 0.0001 0.4367 0.0000 1.0000 0.5633 0.4620
60-GC 0.0000 0.0088 0.5000 0.7143 0.8571 0.3945 0.3332 0.7055 0.8571 0.8447 0.0360 0.0001 0.2919 0.0000 0.8571 0.3945 0.3332
61-GC 0.0000 0.0127 0.5778 0.7778 1.0000 0.4366 0.3833 0.7651 1.0000 0.8779 0.1018 0.0002 0.3537 0.0000 1.0000 0.4366 0.3833
62-GC 0.0169 0.0302 0.1184 0.5192 0.6667 0.2581 0.2586 0.4890 0.6497 1.0019 0.1124 0.0494 0.2369 0.0169 0.6667 0.2581 0.2586
63-GC 0.3448 0.8258 1.0000 1.0000 1.0000 0.9051 0.1808 0.1742 0.6552 0.1997 0.8795 0.8401 0.1305 0.6667 1.0000 0.9424 0.1053
64-GC 0.0000 0.0000 0.0053 0.0160 0.0455 0.0118 0.0149 0.0160 0.0455 1.2709 0.0013 0.0000 0.0118 0.0000 0.0294 0.0072 0.0089
65-GC 0.1058 0.1273 0.2659 0.5625 0.7143 0.3486 0.2453 0.4352 0.6085 0.7036 0.2643 0.2024 0.2229 0.1058 0.7143 0.3486 0.2453
66-GC 0.0022 0.0099 0.0156 0.0359 0.1429 0.0339 0.0412 0.0260 0.1406 1.2169 0.0199 0.0120 0.0276 0.0022 0.0500 0.0196 0.0138
67-GC 0.7931 0.8661 0.9303 0.9524 0.9722 0.9042 0.0568 0.0863 0.1791 0.0628 0.9025 0.9007 0.0474 0.7931 0.9722 0.9042 0.0568
68-GC 0.4500 0.6709 0.7817 0.8799 0.9518 0.7550 0.1519 0.2090 0.5018 0.2012 0.7384 0.7193 0.1183 0.4500 0.9518 0.7550 0.1519
69-GC 0.3514 0.4167 0.5130 0.8333 0.9167 0.6153 0.2229 0.4167 0.5653 0.3622 0.5780 0.5439 0.2056 0.3514 0.9167 0.6153 0.2229
70-GC 0.0104 0.0276 0.2000 0.2381 0.2941 0.1411 0.1071 0.2105 0.2837 0.7589 0.0861 0.0450 0.1000 0.0104 0.2941 0.1411 0.1071
71-GC 0.0000 0.0435 0.1155 0.6250 1.0000 0.3227 0.4100 0.5815 1.0000 1.2704 0.0543 0.0001 0.3386 0.0000 1.0000 0.3227 0.4100
72-GC 0.0059 0.0233 0.1833 1.0000 1.0000 0.4524 0.4607 0.9767 0.9941 1.0183 0.1439 0.0298 0.4292 0.0059 1.0000 0.4524 0.4607
73-GC 0.0169 0.0533 0.1714 1.0000 1.0000 0.4196 0.4296 0.9467 0.9831 1.0240 0.1903 0.0799 0.3829 0.0169 1.0000 0.4196 0.4296
74-GC 0.0000 0.0399 0.2500 1.0000 1.0000 0.4589 0.4479 0.9601 1.0000 0.9760 0.0779 0.0001 0.4058 0.0000 1.0000 0.4589 0.4479
75-GC 0.1714 0.5618 0.8405 0.9349 1.0000 0.7323 0.2731 0.3731 0.8286 0.3729 0.6547 0.5368 0.2255 0.1714 1.0000 0.7323 0.2731
27
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-DE-CLEF2007
Statistics for Precision at the 20% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0271 0.1791 0.2765 0.7273 0.2043 0.2350 0.2494 0.7273 1.1503 0.0254 0.0001 0.1679 0.0000 0.3529 0.1296 0.1250
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0021 0.0156 0.1429 0.2769 0.5000 0.1701 0.1780 0.2613 0.4979 1.0467 0.0598 0.0100 0.1399 0.0021 0.5000 0.1701 0.1780
54-GC 0.0316 0.2667 0.6667 1.0000 1.0000 0.6445 0.3905 0.7333 0.9684 0.6059 0.4111 0.1558 0.3222 0.0316 1.0000 0.6445 0.3905
55-GC 0.0000 0.0022 0.0102 0.0267 0.0641 0.0179 0.0191 0.0245 0.0641 1.0704 0.0037 0.0001 0.0151 0.0000 0.0455 0.0148 0.0151
56-GC 0.0063 0.0851 0.1964 1.0000 1.0000 0.4613 0.4453 0.9149 0.9937 0.9652 0.2022 0.0480 0.4088 0.0063 1.0000 0.4613 0.4453
57-GC 0.0000 0.0015 0.0156 0.1114 0.5000 0.0792 0.1401 0.1099 0.5000 1.7687 0.0044 0.0000 0.1041 0.0000 0.2500 0.0512 0.0868
58-GC 0.0041 0.2770 0.3974 0.7222 0.7778 0.4484 0.2678 0.4452 0.7736 0.5973 0.3035 0.0556 0.2336 0.0041 0.7778 0.4484 0.2678
59-GC 0.0000 0.0897 0.6667 1.0000 1.0000 0.5633 0.4620 0.9103 1.0000 0.8201 0.0612 0.0001 0.4367 0.0000 1.0000 0.5633 0.4620
60-GC 0.0000 0.0000 0.2308 0.6821 0.7647 0.3099 0.3098 0.6821 0.7647 0.9998 0.0124 0.0000 0.2702 0.0000 0.7647 0.3099 0.3098
61-GC 0.0000 0.0000 0.3365 0.6333 0.8333 0.3334 0.3294 0.6333 0.8333 0.9881 0.0124 0.0000 0.2958 0.0000 0.8333 0.3334 0.3294
62-GC 0.0169 0.0302 0.0968 0.4211 0.5556 0.2121 0.2144 0.3908 0.5386 1.0107 0.0977 0.0464 0.1918 0.0169 0.5556 0.2121 0.2144
63-GC 0.3448 0.7101 0.8990 1.0000 1.0000 0.8225 0.1939 0.2899 0.6552 0.2358 0.7948 0.7588 0.1517 0.3448 1.0000 0.8225 0.1939
64-GC 0.0000 0.0000 0.0026 0.0085 0.0417 0.0067 0.0109 0.0085 0.0417 1.6406 0.0003 0.0000 0.0074 0.0000 0.0160 0.0043 0.0059
65-GC 0.0203 0.0997 0.2472 0.5466 0.6897 0.3177 0.2604 0.4469 0.6694 0.8195 0.1900 0.0915 0.2386 0.0203 0.6897 0.3177 0.2604
66-GC 0.0022 0.0099 0.0156 0.0359 0.1429 0.0339 0.0412 0.0260 0.1406 1.2169 0.0199 0.0120 0.0276 0.0022 0.0500 0.0196 0.0138
67-GC 0.7931 0.8372 0.9062 0.9524 0.9722 0.8915 0.0652 0.1152 0.1791 0.0731 0.8893 0.8869 0.0577 0.7931 0.9722 0.8915 0.0652
68-GC 0.1641 0.6066 0.7081 0.8143 0.9518 0.6692 0.2310 0.2077 0.7877 0.3451 0.6066 0.5063 0.1580 0.5610 0.9518 0.7413 0.1292
69-GC 0.3103 0.3165 0.4827 0.8333 0.9167 0.5722 0.2645 0.5169 0.6063 0.4622 0.5144 0.4637 0.2433 0.3103 0.9167 0.5722 0.2645
70-GC 0.0070 0.0250 0.0649 0.0943 0.2941 0.0898 0.0892 0.0693 0.2871 0.9928 0.0545 0.0310 0.0648 0.0070 0.0943 0.0513 0.0346
71-GC 0.0000 0.0426 0.1086 0.4500 0.7500 0.2439 0.3052 0.4074 0.7500 1.2513 0.0454 0.0001 0.2530 0.0000 0.7500 0.2439 0.3052
72-GC 0.0044 0.0233 0.0308 0.0839 0.6000 0.0796 0.1446 0.0607 0.5956 1.8172 0.0356 0.0187 0.0783 0.0044 0.1538 0.0449 0.0420
73-GC 0.0000 0.0455 0.0812 0.5000 0.6667 0.2208 0.2281 0.4545 0.6667 1.0333 0.0753 0.0002 0.1953 0.0000 0.6667 0.2208 0.2281
74-GC 0.0000 0.0399 0.2500 1.0000 1.0000 0.4589 0.4479 0.9601 1.0000 0.9760 0.0779 0.0001 0.4058 0.0000 1.0000 0.4589 0.4479
75-GC 0.1000 0.5618 0.8002 0.8787 1.0000 0.6978 0.2784 0.3169 0.9000 0.3990 0.5942 0.4135 0.2175 0.1000 1.0000 0.6978 0.2784
28
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-DE-CLEF2007
Statistics for Precision at the 30% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0052 0.0430 0.2228 0.3462 0.1095 0.1294 0.2177 0.3462 1.1815 0.0085 0.0000 0.1141 0.0000 0.3462 0.1095 0.1294
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0156 0.1109 0.2589 0.5000 0.1541 0.1618 0.2433 0.5000 1.0500 0.0285 0.0001 0.1261 0.0000 0.5000 0.1541 0.1618
54-GC 0.0000 0.0400 0.6333 0.8333 1.0000 0.4893 0.4027 0.7933 1.0000 0.8230 0.1457 0.0002 0.3579 0.0000 1.0000 0.4893 0.4027
55-GC 0.0000 0.0000 0.0000 0.0093 0.0641 0.0078 0.0169 0.0093 0.0641 2.1566 0.0001 0.0000 0.0109 0.0000 0.0159 0.0025 0.0052
56-GC 0.0062 0.0339 0.0851 0.2000 0.2500 0.1102 0.0823 0.1661 0.2438 0.7472 0.0672 0.0283 0.0713 0.0062 0.2500 0.1102 0.0823
57-GC 0.0000 0.0015 0.0156 0.1114 0.5000 0.0792 0.1401 0.1099 0.5000 1.7687 0.0044 0.0000 0.1041 0.0000 0.2500 0.0512 0.0868
58-GC 0.0000 0.2429 0.3668 0.6639 0.7778 0.4068 0.2629 0.4210 0.7778 0.6462 0.1840 0.0002 0.2138 0.0000 0.7778 0.4068 0.2629
59-GC 0.0000 0.0000 0.2857 0.3333 0.5000 0.2214 0.1889 0.3333 0.5000 0.8532 0.0069 0.0000 0.1661 0.0000 0.5000 0.2214 0.1889
60-GC 0.0000 0.0000 0.1221 0.6400 0.7273 0.2665 0.3013 0.6400 0.7273 1.1304 0.0066 0.0000 0.2721 0.0000 0.7273 0.2665 0.3013
61-GC 0.0000 0.0000 0.1065 0.4692 0.7778 0.2445 0.2843 0.4692 0.7778 1.1631 0.0091 0.0000 0.2452 0.0000 0.7778 0.2445 0.2843
62-GC 0.0169 0.0281 0.0905 0.3792 0.5556 0.1914 0.1978 0.3510 0.5386 1.0330 0.0904 0.0449 0.1744 0.0169 0.5556 0.1914 0.1978
63-GC 0.3077 0.4630 0.7059 0.8348 0.8750 0.6601 0.1824 0.3719 0.5673 0.2763 0.6325 0.6011 0.1492 0.3077 0.8750 0.6601 0.1824
64-GC 0.0000 0.0000 0.0026 0.0085 0.0390 0.0060 0.0099 0.0085 0.0390 1.6658 0.0003 0.0000 0.0063 0.0000 0.0118 0.0038 0.0047
65-GC 0.0000 0.0666 0.2076 0.5000 0.5357 0.2626 0.2222 0.4334 0.5357 0.8461 0.0609 0.0001 0.2040 0.0000 0.5357 0.2626 0.2222
66-GC 0.0022 0.0099 0.0156 0.0359 0.1429 0.0339 0.0412 0.0260 0.1406 1.2169 0.0199 0.0120 0.0276 0.0022 0.0500 0.0196 0.0138
67-GC 0.7931 0.8372 0.8963 0.9524 0.9722 0.8878 0.0643 0.1152 0.1791 0.0724 0.8855 0.8833 0.0572 0.7931 0.9722 0.8878 0.0643
68-GC 0.1079 0.5687 0.5833 0.6691 0.9432 0.5805 0.2164 0.1004 0.8353 0.3728 0.5115 0.3929 0.1238 0.5610 0.7478 0.6075 0.0663
69-GC 0.0746 0.1719 0.4584 0.8205 0.9167 0.4960 0.3374 0.6486 0.8420 0.6802 0.3461 0.2079 0.3014 0.0746 0.9167 0.4960 0.3374
70-GC 0.0000 0.0079 0.0113 0.0379 0.0833 0.0263 0.0300 0.0300 0.0833 1.1417 0.0075 0.0001 0.0241 0.0000 0.0824 0.0225 0.0268
71-GC 0.0000 0.0426 0.1086 0.4500 0.7500 0.2415 0.3066 0.4074 0.7500 1.2698 0.0439 0.0001 0.2543 0.0000 0.7500 0.2415 0.3066
72-GC 0.0036 0.0060 0.0092 0.0567 0.6000 0.0626 0.1474 0.0507 0.5964 2.3557 0.0166 0.0089 0.0785 0.0036 0.1053 0.0267 0.0357
73-GC 0.0000 0.0407 0.0683 0.3125 0.3750 0.1583 0.1489 0.2718 0.3750 0.9410 0.0565 0.0002 0.1329 0.0000 0.3750 0.1583 0.1489
74-GC 0.0000 0.0392 0.1625 0.3333 0.7500 0.2231 0.2197 0.2941 0.7500 0.9849 0.0475 0.0001 0.1846 0.0000 0.7500 0.2231 0.2197
75-GC 0.0417 0.5618 0.7163 0.8157 1.0000 0.6545 0.2815 0.2539 0.9583 0.4302 0.5083 0.2366 0.1995 0.5618 1.0000 0.7420 0.1595
29
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-DE-CLEF2007
Statistics for Precision at the 40% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0249 0.0971 0.2414 0.0604 0.0818 0.0971 0.2414 1.3542 0.0010 0.0000 0.0630 0.0000 0.2414 0.0604 0.0818
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0156 0.0450 0.1429 0.3636 0.0976 0.1174 0.1273 0.3636 1.2027 0.0133 0.0001 0.0892 0.0000 0.1429 0.0596 0.0587
54-GC 0.0000 0.0400 0.6333 0.8333 1.0000 0.4893 0.4027 0.7933 1.0000 0.8230 0.1457 0.0002 0.3579 0.0000 1.0000 0.4893 0.4027
55-GC 0.0000 0.0000 0.0000 0.0093 0.0641 0.0078 0.0169 0.0093 0.0641 2.1566 0.0001 0.0000 0.0109 0.0000 0.0159 0.0025 0.0052
56-GC 0.0062 0.0339 0.0851 0.2000 0.2500 0.1102 0.0823 0.1661 0.2438 0.7472 0.0672 0.0283 0.0713 0.0062 0.2500 0.1102 0.0823
57-GC 0.0000 0.0015 0.0156 0.1114 0.5000 0.0792 0.1401 0.1099 0.5000 1.7687 0.0044 0.0000 0.1041 0.0000 0.2500 0.0512 0.0868
58-GC 0.0000 0.2147 0.2445 0.3668 0.5500 0.2654 0.1437 0.1521 0.5500 0.5415 0.1333 0.0002 0.1077 0.0000 0.5500 0.2654 0.1437
59-GC 0.0000 0.0000 0.2857 0.3333 0.5000 0.2214 0.1889 0.3333 0.5000 0.8532 0.0069 0.0000 0.1661 0.0000 0.5000 0.2214 0.1889
60-GC 0.0000 0.0000 0.0843 0.5238 0.6667 0.2252 0.2730 0.5238 0.6667 1.2123 0.0056 0.0000 0.2393 0.0000 0.6667 0.2252 0.2730
61-GC 0.0000 0.0000 0.0000 0.1703 0.7143 0.1545 0.2642 0.1703 0.7143 1.7098 0.0008 0.0000 0.2024 0.0000 0.2209 0.0350 0.0674
62-GC 0.0164 0.0281 0.0723 0.3051 0.5200 0.1695 0.1843 0.2770 0.5036 1.0874 0.0826 0.0437 0.1517 0.0164 0.5200 0.1695 0.1843
63-GC 0.1104 0.2172 0.2931 0.3469 0.6957 0.3219 0.1568 0.1298 0.5853 0.4871 0.2907 0.2629 0.1145 0.1104 0.4706 0.2743 0.0925
64-GC 0.0000 0.0000 0.0000 0.0000 0.0390 0.0033 0.0098 0.0000 0.0390 2.9567 0.0000 0.0000 0.0054 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0566 0.1034 0.4878 0.5333 0.2099 0.2122 0.4312 0.5333 1.0112 0.0475 0.0001 0.1866 0.0000 0.5333 0.2099 0.2122
66-GC 0.0022 0.0099 0.0156 0.0359 0.1429 0.0339 0.0412 0.0260 0.1406 1.2169 0.0199 0.0120 0.0276 0.0022 0.0500 0.0196 0.0138
67-GC 0.7857 0.8372 0.8798 0.9094 0.9722 0.8724 0.0536 0.0722 0.1865 0.0614 0.8709 0.8693 0.0428 0.7857 0.9722 0.8724 0.0536
68-GC 0.0000 0.4370 0.5246 0.6123 0.8321 0.4904 0.2249 0.1754 0.8321 0.4585 0.1401 0.0001 0.1535 0.4208 0.8321 0.5605 0.1267
69-GC 0.0424 0.0717 0.3326 0.7927 0.9167 0.4348 0.3676 0.7211 0.8743 0.8453 0.2486 0.1297 0.3374 0.0424 0.9167 0.4348 0.3676
70-GC 0.0000 0.0000 0.0000 0.0227 0.0595 0.0138 0.0235 0.0227 0.0595 1.6998 0.0001 0.0000 0.0190 0.0000 0.0235 0.0035 0.0085
71-GC 0.0000 0.0426 0.1086 0.4500 0.7500 0.2415 0.3066 0.4074 0.7500 1.2698 0.0439 0.0001 0.2543 0.0000 0.7500 0.2415 0.3066
72-GC 0.0000 0.0000 0.0028 0.0181 0.3636 0.0398 0.0926 0.0181 0.3636 2.3251 0.0006 0.0000 0.0559 0.0000 0.0206 0.0054 0.0078
73-GC 0.0000 0.0407 0.0683 0.3125 0.3750 0.1583 0.1489 0.2718 0.3750 0.9410 0.0565 0.0002 0.1329 0.0000 0.3750 0.1583 0.1489
74-GC 0.0000 0.0276 0.0428 0.0851 0.4615 0.0891 0.1151 0.0575 0.4615 1.2921 0.0219 0.0001 0.0727 0.0000 0.0851 0.0444 0.0319
75-GC 0.0000 0.5618 0.6575 0.7627 1.0000 0.6243 0.2858 0.2010 1.0000 0.4578 0.1731 0.0001 0.1916 0.5618 1.0000 0.7134 0.1604
30
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-DE-CLEF2007
Statistics for Precision at the 50% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0000 0.0748 0.1974 0.0434 0.0696 0.0748 0.1974 1.6051 0.0003 0.0000 0.0542 0.0000 0.1000 0.0214 0.0378
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0069 0.0331 0.1132 0.1154 0.0526 0.0506 0.1063 0.1154 0.9623 0.0062 0.0000 0.0460 0.0000 0.1154 0.0526 0.0506
54-GC 0.0000 0.0400 0.6333 0.8333 1.0000 0.4893 0.4027 0.7933 1.0000 0.8230 0.1457 0.0002 0.3579 0.0000 1.0000 0.4893 0.4027
55-GC 0.0000 0.0000 0.0000 0.0053 0.0641 0.0070 0.0165 0.0053 0.0641 2.3566 0.0001 0.0000 0.0101 0.0000 0.0055 0.0008 0.0020
56-GC 0.0000 0.0000 0.0429 0.0476 0.1579 0.0368 0.0384 0.0476 0.1579 1.0451 0.0034 0.0000 0.0239 0.0000 0.0492 0.0287 0.0215
57-GC 0.0000 0.0015 0.0156 0.1114 0.5000 0.0792 0.1401 0.1099 0.5000 1.7687 0.0044 0.0000 0.1041 0.0000 0.2500 0.0512 0.0868
58-GC 0.0000 0.0847 0.1236 0.2153 0.5500 0.1688 0.1364 0.1305 0.5500 0.8078 0.0798 0.0002 0.1011 0.0000 0.3250 0.1434 0.0941
59-GC 0.0000 0.0000 0.2857 0.3333 0.5000 0.2214 0.1889 0.3333 0.5000 0.8532 0.0069 0.0000 0.1661 0.0000 0.5000 0.2214 0.1889
60-GC 0.0000 0.0000 0.0427 0.4407 0.6667 0.1756 0.2511 0.4407 0.6667 1.4300 0.0024 0.0000 0.2201 0.0000 0.6667 0.1756 0.2511
61-GC 0.0000 0.0000 0.0000 0.0827 0.6765 0.1374 0.2570 0.0827 0.6765 1.8702 0.0007 0.0000 0.1929 0.0000 0.1004 0.0188 0.0328
62-GC 0.0000 0.0249 0.0596 0.2523 0.4571 0.1376 0.1615 0.2273 0.4571 1.1740 0.0431 0.0002 0.1310 0.0000 0.4571 0.1376 0.1615
63-GC 0.0551 0.0976 0.1526 0.1759 0.5000 0.1789 0.1303 0.0783 0.4449 0.7282 0.1463 0.1227 0.0883 0.0551 0.2667 0.1355 0.0577
64-GC 0.0000 0.0000 0.0000 0.0000 0.0270 0.0017 0.0068 0.0000 0.0270 4.0000 0.0000 0.0000 0.0032 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0000 0.0947 0.3094 0.3721 0.1364 0.1445 0.3094 0.3721 1.0593 0.0076 0.0000 0.1241 0.0000 0.3721 0.1364 0.1445
66-GC 0.0022 0.0099 0.0156 0.0359 0.1429 0.0339 0.0412 0.0260 0.1406 1.2169 0.0199 0.0120 0.0276 0.0022 0.0500 0.0196 0.0138
67-GC 0.7826 0.7894 0.8321 0.8919 0.9722 0.8409 0.0557 0.1025 0.1896 0.0662 0.8392 0.8376 0.0451 0.7826 0.9722 0.8409 0.0557
68-GC 0.0000 0.3169 0.4606 0.5374 0.6570 0.4066 0.1956 0.2205 0.6570 0.4810 0.1171 0.0001 0.1457 0.0000 0.6570 0.4066 0.1956
69-GC 0.0000 0.0444 0.1944 0.6488 0.9143 0.3443 0.3503 0.6044 0.9143 1.0174 0.0591 0.0001 0.3102 0.0000 0.9143 0.3443 0.3503
70-GC 0.0000 0.0000 0.0000 0.0152 0.0534 0.0114 0.0201 0.0152 0.0534 1.7674 0.0001 0.0000 0.0156 0.0000 0.0157 0.0023 0.0057
71-GC 0.0000 0.0280 0.0426 0.0678 0.1290 0.0477 0.0327 0.0398 0.1290 0.6845 0.0168 0.0001 0.0245 0.0000 0.0882 0.0423 0.0253
72-GC 0.0000 0.0000 0.0000 0.0181 0.1042 0.0197 0.0366 0.0181 0.1042 1.8544 0.0002 0.0000 0.0269 0.0000 0.0206 0.0032 0.0069
73-GC 0.0000 0.0135 0.0575 0.2615 0.3125 0.1228 0.1302 0.2480 0.3125 1.0602 0.0159 0.0001 0.1168 0.0000 0.3125 0.1228 0.1302
74-GC 0.0000 0.0276 0.0428 0.0851 0.4615 0.0891 0.1151 0.0575 0.4615 1.2921 0.0219 0.0001 0.0727 0.0000 0.0851 0.0444 0.0319
75-GC 0.0000 0.5310 0.5619 0.7360 1.0000 0.5864 0.2854 0.2050 1.0000 0.4866 0.1624 0.0001 0.1992 0.4361 1.0000 0.6702 0.1830
31
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-DE-CLEF2007
Statistics for Precision at the 60% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0000 0.0677 0.1208 0.0320 0.0485 0.0677 0.1208 1.5145 0.0003 0.0000 0.0400 0.0000 0.1208 0.0320 0.0485
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0047 0.0213 0.1132 0.1154 0.0497 0.0524 0.1085 0.1154 1.0533 0.0053 0.0000 0.0482 0.0000 0.1154 0.0497 0.0524
54-GC 0.0000 0.0218 0.0268 0.1670 1.0000 0.1663 0.2904 0.1453 1.0000 1.7465 0.0300 0.0002 0.2169 0.0000 0.3000 0.0431 0.0779
55-GC 0.0000 0.0000 0.0000 0.0000 0.0641 0.0064 0.0167 0.0000 0.0641 2.6296 0.0000 0.0000 0.0103 0.0000 0.0000 0.0000 0.0000
56-GC 0.0000 0.0000 0.0429 0.0476 0.1579 0.0368 0.0384 0.0476 0.1579 1.0451 0.0034 0.0000 0.0239 0.0000 0.0492 0.0287 0.0215
57-GC 0.0000 0.0015 0.0156 0.1114 0.5000 0.0792 0.1401 0.1099 0.5000 1.7687 0.0044 0.0000 0.1041 0.0000 0.2500 0.0512 0.0868
58-GC 0.0000 0.0613 0.0793 0.1996 0.4444 0.1397 0.1227 0.1383 0.4444 0.8781 0.0631 0.0002 0.0995 0.0000 0.3250 0.1194 0.0951
59-GC 0.0000 0.0000 0.2727 0.3167 0.5000 0.1958 0.1687 0.3167 0.5000 0.8618 0.0063 0.0000 0.1468 0.0000 0.5000 0.1958 0.1687
60-GC 0.0000 0.0000 0.0360 0.2809 0.5714 0.1336 0.1999 0.2809 0.5714 1.4965 0.0021 0.0000 0.1657 0.0000 0.5714 0.1336 0.1999
61-GC 0.0000 0.0000 0.0000 0.0000 0.6222 0.1062 0.2290 0.0000 0.6222 2.1564 0.0001 0.0000 0.1726 0.0000 0.0000 0.0000 0.0000
62-GC 0.0000 0.0151 0.0490 0.1950 0.4000 0.1139 0.1363 0.1798 0.4000 1.1967 0.0098 0.0000 0.1103 0.0000 0.4000 0.1139 0.1363
63-GC 0.0000 0.0443 0.0955 0.1366 0.1983 0.0903 0.0604 0.0923 0.1983 0.6691 0.0180 0.0001 0.0482 0.0000 0.1983 0.0903 0.0604
64-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0000 0.0413 0.1848 0.1871 0.0735 0.0843 0.1848 0.1871 1.1457 0.0012 0.0000 0.0735 0.0000 0.1871 0.0735 0.0843
66-GC 0.0000 0.0000 0.0000 0.0122 0.0385 0.0069 0.0116 0.0122 0.0385 1.6942 0.0002 0.0000 0.0090 0.0000 0.0222 0.0047 0.0083
67-GC 0.7708 0.7820 0.8246 0.8302 0.9268 0.8176 0.0409 0.0482 0.1560 0.0501 0.8167 0.8158 0.0295 0.7708 0.8667 0.8104 0.0298
68-GC 0.0000 0.2491 0.3808 0.4615 0.5327 0.3403 0.1677 0.2124 0.5327 0.4928 0.0997 0.0001 0.1305 0.0000 0.5327 0.3403 0.1677
69-GC 0.0000 0.0000 0.1286 0.5212 0.9143 0.2876 0.3424 0.5212 0.9143 1.1904 0.0023 0.0000 0.2914 0.0000 0.9143 0.2876 0.3424
70-GC 0.0000 0.0000 0.0000 0.0071 0.0534 0.0103 0.0202 0.0071 0.0534 1.9558 0.0001 0.0000 0.0155 0.0000 0.0141 0.0011 0.0039
71-GC 0.0000 0.0000 0.0051 0.0597 0.1220 0.0317 0.0396 0.0597 0.1220 1.2461 0.0010 0.0000 0.0344 0.0000 0.1220 0.0317 0.0396
72-GC 0.0000 0.0000 0.0000 0.0181 0.0896 0.0149 0.0300 0.0181 0.0896 2.0133 0.0001 0.0000 0.0205 0.0000 0.0246 0.0043 0.0088
73-GC 0.0000 0.0076 0.0478 0.2369 0.3125 0.1122 0.1295 0.2293 0.3125 1.1543 0.0131 0.0001 0.1124 0.0000 0.3125 0.1122 0.1295
74-GC 0.0000 0.0138 0.0214 0.0392 0.4615 0.0695 0.1208 0.0254 0.4615 1.7371 0.0088 0.0001 0.0801 0.0000 0.0397 0.0202 0.0145
75-GC 0.0000 0.4000 0.4861 0.6514 1.0000 0.5094 0.2855 0.2514 1.0000 0.5604 0.1388 0.0001 0.2050 0.2006 1.0000 0.5822 0.2200
32
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-DE-CLEF2007
Statistics for Precision at the 70% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0000 0.0440 0.0950 0.0229 0.0410 0.0440 0.0950 1.7906 0.0001 0.0000 0.0343 0.0000 0.0950 0.0229 0.0410
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0086 0.0860 0.1111 0.0371 0.0466 0.0860 0.1111 1.2554 0.0011 0.0000 0.0430 0.0000 0.1111 0.0371 0.0466
54-GC 0.0000 0.0218 0.0268 0.1670 1.0000 0.1663 0.2904 0.1453 1.0000 1.7465 0.0300 0.0002 0.2169 0.0000 0.3000 0.0431 0.0779
55-GC 0.0000 0.0000 0.0000 0.0000 0.0641 0.0064 0.0167 0.0000 0.0641 2.6296 0.0000 0.0000 0.0103 0.0000 0.0000 0.0000 0.0000
56-GC 0.0000 0.0000 0.0035 0.0156 0.0292 0.0082 0.0109 0.0156 0.0292 1.3339 0.0004 0.0000 0.0088 0.0000 0.0292 0.0082 0.0109
57-GC 0.0000 0.0015 0.0156 0.1114 0.5000 0.0792 0.1401 0.1099 0.5000 1.7687 0.0044 0.0000 0.1041 0.0000 0.2500 0.0512 0.0868
58-GC 0.0000 0.0497 0.0650 0.1918 0.2800 0.1127 0.0909 0.1421 0.2800 0.8066 0.0513 0.0002 0.0811 0.0000 0.2800 0.1127 0.0909
59-GC 0.0000 0.0000 0.2727 0.3167 0.5000 0.1958 0.1687 0.3167 0.5000 0.8618 0.0063 0.0000 0.1468 0.0000 0.5000 0.1958 0.1687
60-GC 0.0000 0.0000 0.0000 0.1182 0.5000 0.0829 0.1616 0.1182 0.5000 1.9496 0.0002 0.0000 0.1139 0.0000 0.1370 0.0267 0.0532
61-GC 0.0000 0.0000 0.0000 0.0000 0.4459 0.0714 0.1550 0.0000 0.4459 2.1691 0.0001 0.0000 0.1161 0.0000 0.0000 0.0000 0.0000
62-GC 0.0000 0.0151 0.0372 0.1809 0.3810 0.1026 0.1254 0.1658 0.3810 1.2219 0.0090 0.0000 0.1021 0.0000 0.3810 0.1026 0.1254
63-GC 0.0000 0.0000 0.0420 0.0730 0.0836 0.0401 0.0329 0.0730 0.0836 0.8201 0.0037 0.0000 0.0263 0.0000 0.0836 0.0401 0.0329
64-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0000 0.0000 0.1236 0.1411 0.0419 0.0644 0.1236 0.1411 1.5364 0.0002 0.0000 0.0576 0.0000 0.1411 0.0419 0.0644
66-GC 0.0000 0.0000 0.0000 0.0122 0.0385 0.0069 0.0116 0.0122 0.0385 1.6942 0.0002 0.0000 0.0090 0.0000 0.0222 0.0047 0.0083
67-GC 0.7391 0.7698 0.7998 0.8302 0.8909 0.8014 0.0415 0.0604 0.1518 0.0518 0.8004 0.7994 0.0326 0.7391 0.8909 0.8014 0.0415
68-GC 0.0000 0.0000 0.2792 0.3807 0.4120 0.2319 0.1709 0.3807 0.4120 0.7370 0.0128 0.0000 0.1449 0.0000 0.4120 0.2319 0.1709
69-GC 0.0000 0.0000 0.0808 0.4244 0.9143 0.2386 0.3156 0.4244 0.9143 1.3227 0.0020 0.0000 0.2541 0.0000 0.9143 0.2386 0.3156
70-GC 0.0000 0.0000 0.0000 0.0000 0.0221 0.0040 0.0086 0.0000 0.0221 2.1509 0.0000 0.0000 0.0065 0.0000 0.0000 0.0000 0.0000
71-GC 0.0000 0.0000 0.0051 0.0597 0.1220 0.0317 0.0396 0.0597 0.1220 1.2461 0.0010 0.0000 0.0344 0.0000 0.1220 0.0317 0.0396
72-GC 0.0000 0.0000 0.0000 0.0148 0.0824 0.0123 0.0246 0.0148 0.0824 1.9965 0.0001 0.0000 0.0169 0.0000 0.0246 0.0039 0.0080
73-GC 0.0000 0.0076 0.0478 0.2369 0.3125 0.1122 0.1295 0.2293 0.3125 1.1543 0.0131 0.0001 0.1124 0.0000 0.3125 0.1122 0.1295
74-GC 0.0000 0.0000 0.0137 0.0140 0.4615 0.0500 0.1188 0.0140 0.4615 2.3759 0.0022 0.0000 0.0686 0.0000 0.0140 0.0080 0.0068
75-GC 0.0000 0.1108 0.4000 0.5114 0.8696 0.3623 0.2888 0.4006 0.8696 0.7971 0.0303 0.0000 0.2263 0.0000 0.8696 0.3623 0.2888
33
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-DE-CLEF2007
Statistics for Precision at the 80% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0000 0.0341 0.0833 0.0189 0.0341 0.0341 0.0833 1.8007 0.0001 0.0000 0.0284 0.0000 0.0833 0.0189 0.0341
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0000 0.0860 0.1013 0.0342 0.0458 0.0860 0.1013 1.3400 0.0003 0.0000 0.0427 0.0000 0.1013 0.0342 0.0458
54-GC 0.0000 0.0030 0.0169 0.0228 0.1212 0.0219 0.0300 0.0199 0.1212 1.3703 0.0030 0.0000 0.0173 0.0000 0.0278 0.0125 0.0104
55-GC 0.0000 0.0000 0.0000 0.0000 0.0484 0.0045 0.0124 0.0000 0.0484 2.7696 0.0000 0.0000 0.0072 0.0000 0.0000 0.0000 0.0000
56-GC 0.0000 0.0000 0.0035 0.0156 0.0292 0.0082 0.0109 0.0156 0.0292 1.3339 0.0004 0.0000 0.0088 0.0000 0.0292 0.0082 0.0109
57-GC 0.0000 0.0015 0.0156 0.1114 0.5000 0.0792 0.1401 0.1099 0.5000 1.7687 0.0044 0.0000 0.1041 0.0000 0.2500 0.0512 0.0868
58-GC 0.0000 0.0358 0.0492 0.1277 0.1975 0.0786 0.0653 0.0918 0.1975 0.8307 0.0367 0.0002 0.0540 0.0000 0.1975 0.0786 0.0653
59-GC 0.0000 0.0000 0.0000 0.2222 0.3077 0.0844 0.1160 0.2222 0.3077 1.3746 0.0004 0.0000 0.1055 0.0000 0.3077 0.0844 0.1160
60-GC 0.0000 0.0000 0.0000 0.0749 0.4216 0.0636 0.1310 0.0749 0.4216 2.0588 0.0002 0.0000 0.0875 0.0000 0.0940 0.0174 0.0349
61-GC 0.0000 0.0000 0.0000 0.0000 0.1796 0.0261 0.0575 0.0000 0.1796 2.2060 0.0001 0.0000 0.0424 0.0000 0.0000 0.0000 0.0000
62-GC 0.0000 0.0150 0.0366 0.1326 0.2261 0.0724 0.0796 0.1175 0.2261 1.0999 0.0077 0.0000 0.0649 0.0000 0.2261 0.0724 0.0796
63-GC 0.0000 0.0000 0.0000 0.0483 0.0562 0.0210 0.0255 0.0483 0.0562 1.2128 0.0004 0.0000 0.0236 0.0000 0.0562 0.0210 0.0255
64-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0000 0.0000 0.0776 0.0988 0.0282 0.0437 0.0776 0.0988 1.5465 0.0002 0.0000 0.0388 0.0000 0.0988 0.0282 0.0437
66-GC 0.0000 0.0000 0.0000 0.0122 0.0385 0.0069 0.0116 0.0122 0.0385 1.6942 0.0002 0.0000 0.0090 0.0000 0.0222 0.0047 0.0083
67-GC 0.7391 0.7538 0.7656 0.7961 0.8909 0.7785 0.0376 0.0422 0.1518 0.0483 0.7777 0.7769 0.0271 0.7391 0.8095 0.7710 0.0235
68-GC 0.0000 0.0000 0.1189 0.2665 0.3229 0.1368 0.1434 0.2665 0.3229 1.0485 0.0016 0.0000 0.1368 0.0000 0.3229 0.1368 0.1434
69-GC 0.0000 0.0000 0.0000 0.1396 0.3000 0.0674 0.0971 0.1396 0.3000 1.4409 0.0004 0.0000 0.0843 0.0000 0.3000 0.0674 0.0971
70-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
71-GC 0.0000 0.0000 0.0000 0.0489 0.0882 0.0207 0.0284 0.0489 0.0882 1.3695 0.0004 0.0000 0.0241 0.0000 0.0882 0.0207 0.0284
72-GC 0.0000 0.0000 0.0000 0.0054 0.0816 0.0104 0.0244 0.0054 0.0816 2.3360 0.0001 0.0000 0.0156 0.0000 0.0107 0.0008 0.0030
73-GC 0.0000 0.0000 0.0248 0.1347 0.2400 0.0696 0.1022 0.1347 0.2400 1.4686 0.0024 0.0000 0.0852 0.0000 0.2400 0.0696 0.1022
74-GC 0.0000 0.0000 0.0036 0.0094 0.1111 0.0165 0.0331 0.0094 0.1111 2.0132 0.0004 0.0000 0.0211 0.0000 0.0198 0.0046 0.0062
75-GC 0.0000 0.0000 0.2961 0.3965 0.6917 0.2491 0.2603 0.3965 0.6917 1.0447 0.0040 0.0000 0.2180 0.0000 0.6917 0.2491 0.2603
34
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-DE-CLEF2007
Statistics for Precision at the 90% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0000 0.0000 0.0452 0.0056 0.0154 0.0000 0.0452 2.7325 0.0000 0.0000 0.0099 0.0000 0.0000 0.0000 0.0000
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0000 0.0805 0.0833 0.0305 0.0407 0.0805 0.0833 1.3345 0.0003 0.0000 0.0382 0.0000 0.0833 0.0305 0.0407
54-GC 0.0000 0.0030 0.0169 0.0228 0.1212 0.0219 0.0300 0.0199 0.1212 1.3703 0.0030 0.0000 0.0173 0.0000 0.0278 0.0125 0.0104
55-GC 0.0000 0.0000 0.0000 0.0000 0.0088 0.0005 0.0022 0.0000 0.0088 4.0000 0.0000 0.0000 0.0010 0.0000 0.0000 0.0000 0.0000
56-GC 0.0000 0.0000 0.0000 0.0070 0.0085 0.0023 0.0035 0.0070 0.0085 1.5393 0.0001 0.0000 0.0031 0.0000 0.0085 0.0023 0.0035
57-GC 0.0000 0.0015 0.0156 0.1114 0.5000 0.0792 0.1401 0.1099 0.5000 1.7687 0.0044 0.0000 0.1041 0.0000 0.2500 0.0512 0.0868
58-GC 0.0000 0.0000 0.0456 0.0624 0.1125 0.0425 0.0354 0.0624 0.1125 0.8344 0.0039 0.0000 0.0265 0.0000 0.1125 0.0425 0.0354
59-GC 0.0000 0.0000 0.0000 0.2222 0.3077 0.0844 0.1160 0.2222 0.3077 1.3746 0.0004 0.0000 0.1055 0.0000 0.3077 0.0844 0.1160
60-GC 0.0000 0.0000 0.0000 0.0000 0.0729 0.0076 0.0213 0.0000 0.0729 2.7896 0.0000 0.0000 0.0134 0.0000 0.0000 0.0000 0.0000
61-GC 0.0000 0.0000 0.0000 0.0000 0.0968 0.0138 0.0305 0.0000 0.0968 2.2161 0.0001 0.0000 0.0224 0.0000 0.0000 0.0000 0.0000
62-GC 0.0000 0.0000 0.0180 0.0888 0.1518 0.0457 0.0565 0.0888 0.1518 1.2361 0.0009 0.0000 0.0481 0.0000 0.1518 0.0457 0.0565
63-GC 0.0000 0.0000 0.0000 0.0200 0.0400 0.0100 0.0179 0.0200 0.0400 1.7889 0.0001 0.0000 0.0150 0.0000 0.0400 0.0100 0.0179
64-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
66-GC 0.0000 0.0000 0.0000 0.0122 0.0385 0.0069 0.0116 0.0122 0.0385 1.6942 0.0002 0.0000 0.0090 0.0000 0.0222 0.0047 0.0083
67-GC 0.6471 0.6967 0.7238 0.7662 0.8088 0.7292 0.0494 0.0695 0.1618 0.0677 0.7277 0.7261 0.0403 0.6471 0.8088 0.7292 0.0494
68-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
69-GC 0.0000 0.0000 0.0000 0.0000 0.0479 0.0058 0.0158 0.0000 0.0479 2.7343 0.0000 0.0000 0.0101 0.0000 0.0000 0.0000 0.0000
70-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
71-GC 0.0000 0.0000 0.0000 0.0309 0.0511 0.0140 0.0181 0.0309 0.0511 1.2994 0.0003 0.0000 0.0160 0.0000 0.0511 0.0140 0.0181
72-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
73-GC 0.0000 0.0000 0.0213 0.0885 0.1489 0.0458 0.0624 0.0885 0.1489 1.3619 0.0020 0.0000 0.0516 0.0000 0.1489 0.0458 0.0624
74-GC 0.0000 0.0000 0.0000 0.0000 0.0190 0.0034 0.0073 0.0000 0.0190 2.1534 0.0000 0.0000 0.0055 0.0000 0.0000 0.0000 0.0000
75-GC 0.0000 0.0000 0.0000 0.3065 0.5508 0.1328 0.2142 0.3065 0.5508 1.6137 0.0003 0.0000 0.1825 0.0000 0.5508 0.1328 0.2142
35
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-DE-CLEF2007
Statistics for Precision at the 100% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0000 0.0000 0.0390 0.0049 0.0133 0.0000 0.0390 2.7325 0.0000 0.0000 0.0085 0.0000 0.0000 0.0000 0.0000
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0000 0.0532 0.0800 0.0233 0.0349 0.0532 0.0800 1.5000 0.0003 0.0000 0.0291 0.0000 0.0800 0.0233 0.0349
54-GC 0.0000 0.0030 0.0169 0.0228 0.1212 0.0219 0.0300 0.0199 0.1212 1.3703 0.0030 0.0000 0.0173 0.0000 0.0278 0.0125 0.0104
55-GC 0.0000 0.0000 0.0000 0.0000 0.0088 0.0005 0.0022 0.0000 0.0088 4.0000 0.0000 0.0000 0.0010 0.0000 0.0000 0.0000 0.0000
56-GC 0.0000 0.0000 0.0000 0.0070 0.0085 0.0023 0.0035 0.0070 0.0085 1.5393 0.0001 0.0000 0.0031 0.0000 0.0085 0.0023 0.0035
57-GC 0.0000 0.0015 0.0156 0.1114 0.5000 0.0792 0.1401 0.1099 0.5000 1.7687 0.0044 0.0000 0.1041 0.0000 0.2500 0.0512 0.0868
58-GC 0.0000 0.0000 0.0427 0.0433 0.0701 0.0299 0.0259 0.0433 0.0701 0.8673 0.0020 0.0000 0.0225 0.0000 0.0701 0.0299 0.0259
59-GC 0.0000 0.0000 0.0000 0.2222 0.3077 0.0844 0.1160 0.2222 0.3077 1.3746 0.0004 0.0000 0.1055 0.0000 0.3077 0.0844 0.1160
60-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
61-GC 0.0000 0.0000 0.0000 0.0000 0.0466 0.0029 0.0116 0.0000 0.0466 4.0000 0.0000 0.0000 0.0055 0.0000 0.0000 0.0000 0.0000
62-GC 0.0000 0.0000 0.0000 0.0676 0.1063 0.0254 0.0401 0.0676 0.1063 1.5785 0.0002 0.0000 0.0350 0.0000 0.1063 0.0254 0.0401
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
66-GC 0.0000 0.0000 0.0000 0.0122 0.0385 0.0069 0.0116 0.0122 0.0385 1.6942 0.0002 0.0000 0.0090 0.0000 0.0222 0.0047 0.0083
67-GC 0.0000 0.0000 0.2786 0.4586 0.6421 0.2620 0.2339 0.4586 0.6421 0.8929 0.0128 0.0000 0.2012 0.0000 0.6421 0.2620 0.2339
68-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
69-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
70-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
71-GC 0.0000 0.0000 0.0000 0.0309 0.0511 0.0140 0.0181 0.0309 0.0511 1.2994 0.0003 0.0000 0.0160 0.0000 0.0511 0.0140 0.0181
72-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
73-GC 0.0000 0.0000 0.0213 0.0885 0.1489 0.0458 0.0624 0.0885 0.1489 1.3619 0.0020 0.0000 0.0516 0.0000 0.1489 0.0458 0.0624
74-GC 0.0000 0.0000 0.0000 0.0000 0.0190 0.0034 0.0073 0.0000 0.0190 2.1534 0.0000 0.0000 0.0055 0.0000 0.0000 0.0000 0.0000
75-GC 0.0000 0.0000 0.0000 0.0000 0.2441 0.0153 0.0610 0.0000 0.2441 4.0000 0.0000 0.0000 0.0286 0.0000 0.0000 0.0000 0.0000
36
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-DE-CLEF2007
Statistics for P@5
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.1000 0.4000 0.6000 0.2000 0.2309 0.4000 0.6000 1.1547 0.0019 0.0000 0.2000 0.0000 0.6000 0.2000 0.2309
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.1000 0.3000 0.4000 0.1500 0.1713 0.3000 0.4000 1.1418 0.0017 0.0000 0.1500 0.0000 0.4000 0.1500 0.1713
54-GC 0.0000 0.2000 0.4000 0.4000 0.6000 0.3000 0.1932 0.2000 0.6000 0.6441 0.0485 0.0001 0.1625 0.0000 0.6000 0.3000 0.1932
55-GC 0.0000 0.0000 0.0000 0.2000 0.2000 0.0750 0.1000 0.2000 0.2000 1.3333 0.0004 0.0000 0.0938 0.0000 0.2000 0.0750 0.1000
56-GC 0.0000 0.0000 0.0000 0.2000 0.2000 0.0875 0.1025 0.2000 0.2000 1.1711 0.0008 0.0000 0.0984 0.0000 0.2000 0.0875 0.1025
57-GC 0.0000 0.0000 0.0000 0.1000 0.2000 0.0500 0.0894 0.1000 0.2000 1.7889 0.0001 0.0000 0.0750 0.0000 0.2000 0.0500 0.0894
58-GC 0.0000 0.1000 0.3000 0.6000 0.6000 0.3250 0.2517 0.5000 0.6000 0.7743 0.0277 0.0000 0.2250 0.0000 0.6000 0.3250 0.2517
59-GC 0.0000 0.0000 0.2000 0.2000 0.4000 0.1625 0.1500 0.2000 0.4000 0.9231 0.0056 0.0000 0.1219 0.0000 0.4000 0.1625 0.1500
60-GC 0.0000 0.3000 0.4000 0.8000 0.8000 0.4500 0.2781 0.5000 0.8000 0.6180 0.1211 0.0001 0.2188 0.0000 0.8000 0.4500 0.2781
61-GC 0.0000 0.4000 0.6000 0.7000 1.0000 0.5500 0.2366 0.3000 1.0000 0.4303 0.2823 0.0002 0.1813 0.0000 1.0000 0.5500 0.2366
62-GC 0.0000 0.0000 0.1000 0.5000 0.6000 0.2125 0.2579 0.5000 0.6000 1.2135 0.0019 0.0000 0.2172 0.0000 0.6000 0.2125 0.2579
63-GC 0.4000 0.7000 1.0000 1.0000 1.0000 0.8625 0.2029 0.3000 0.6000 0.2352 0.8345 0.8000 0.1719 0.4000 1.0000 0.8625 0.2029
64-GC 0.0000 0.0000 0.0000 0.0000 0.2000 0.0375 0.0806 0.0000 0.2000 2.1499 0.0001 0.0000 0.0609 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.2000 0.4000 0.6000 1.0000 0.3625 0.2754 0.4000 1.0000 0.7597 0.0541 0.0001 0.2172 0.0000 1.0000 0.3625 0.2754
66-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
67-GC 0.6000 0.8000 0.8000 0.8000 0.8000 0.7625 0.0806 0.0000 0.2000 0.1057 0.7580 0.7529 0.0609 0.8000 0.8000 0.8000 0.0000
68-GC 0.4000 0.6000 0.6000 0.8000 0.8000 0.6250 0.1438 0.2000 0.4000 0.2300 0.6084 0.5908 0.1094 0.4000 0.8000 0.6250 0.1438
69-GC 0.2000 0.5000 0.6000 0.6000 0.8000 0.5625 0.1821 0.1000 0.6000 0.3238 0.5247 0.4741 0.1313 0.4000 0.6000 0.5636 0.0809
70-GC 0.0000 0.0000 0.2000 0.4000 0.4000 0.1875 0.1857 0.4000 0.4000 0.9906 0.0034 0.0000 0.1641 0.0000 0.4000 0.1875 0.1857
71-GC 0.0000 0.0000 0.0000 0.4000 0.6000 0.1875 0.2579 0.4000 0.6000 1.3753 0.0010 0.0000 0.2109 0.0000 0.6000 0.1875 0.2579
72-GC 0.0000 0.0000 0.1000 0.2000 0.6000 0.1250 0.1612 0.2000 0.6000 1.2900 0.0015 0.0000 0.1250 0.0000 0.2000 0.0933 0.1033
73-GC 0.0000 0.0000 0.1000 0.4000 0.4000 0.1625 0.1821 0.4000 0.4000 1.1207 0.0018 0.0000 0.1625 0.0000 0.4000 0.1625 0.1821
74-GC 0.0000 0.0000 0.0000 0.4000 0.6000 0.1750 0.2176 0.4000 0.6000 1.2432 0.0010 0.0000 0.1969 0.0000 0.6000 0.1750 0.2176
75-GC 0.2000 0.6000 0.6000 0.9000 1.0000 0.6875 0.2527 0.3000 0.8000 0.3675 0.6272 0.5439 0.1984 0.2000 1.0000 0.6875 0.2527
37
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-DE-CLEF2007
Statistics for P@10
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.1000 0.4000 0.7000 0.2063 0.2594 0.4000 0.7000 1.2577 0.0032 0.0000 0.2203 0.0000 0.7000 0.2063 0.2594
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0500 0.2000 0.3000 0.1000 0.1265 0.2000 0.3000 1.2649 0.0013 0.0000 0.1000 0.0000 0.3000 0.1000 0.1265
54-GC 0.0000 0.1000 0.2000 0.2500 0.3000 0.1688 0.1078 0.1500 0.3000 0.6389 0.0304 0.0001 0.0891 0.0000 0.3000 0.1688 0.1078
55-GC 0.0000 0.0000 0.0000 0.1000 0.1000 0.0375 0.0500 0.1000 0.1000 1.3333 0.0003 0.0000 0.0469 0.0000 0.1000 0.0375 0.0500
56-GC 0.0000 0.0000 0.1000 0.2000 0.2000 0.1000 0.0816 0.2000 0.2000 0.8165 0.0070 0.0000 0.0625 0.0000 0.2000 0.1000 0.0816
57-GC 0.0000 0.0000 0.0000 0.0500 0.1000 0.0250 0.0447 0.0500 0.1000 1.7889 0.0001 0.0000 0.0375 0.0000 0.1000 0.0250 0.0447
58-GC 0.0000 0.1000 0.3000 0.5500 0.7000 0.3375 0.2473 0.4500 0.7000 0.7328 0.1484 0.0002 0.2047 0.0000 0.7000 0.3375 0.2473
59-GC 0.0000 0.0500 0.2000 0.3000 0.3000 0.1688 0.1195 0.2500 0.3000 0.7084 0.0175 0.0000 0.1016 0.0000 0.3000 0.1688 0.1195
60-GC 0.0000 0.2000 0.4000 0.6000 0.8000 0.3813 0.2536 0.4000 0.8000 0.6651 0.1008 0.0001 0.1984 0.0000 0.8000 0.3813 0.2536
61-GC 0.0000 0.2000 0.5000 0.7000 0.9000 0.4437 0.2683 0.5000 0.9000 0.6045 0.2082 0.0002 0.2383 0.0000 0.9000 0.4437 0.2683
62-GC 0.0000 0.0000 0.1000 0.4000 0.5000 0.2063 0.2235 0.4000 0.5000 1.0837 0.0020 0.0000 0.2070 0.0000 0.5000 0.2063 0.2235
63-GC 0.3000 0.6500 0.8500 0.9500 1.0000 0.8000 0.1966 0.3000 0.7000 0.2458 0.7699 0.7287 0.1500 0.3000 1.0000 0.8000 0.1966
64-GC 0.0000 0.0000 0.0000 0.1000 0.1000 0.0375 0.0500 0.1000 0.1000 1.3333 0.0003 0.0000 0.0469 0.0000 0.1000 0.0375 0.0500
65-GC 0.0000 0.1500 0.2500 0.5000 0.8000 0.3125 0.2579 0.3500 0.8000 0.8252 0.0461 0.0001 0.2047 0.0000 0.8000 0.3125 0.2579
66-GC 0.0000 0.0000 0.0000 0.0000 0.1000 0.0125 0.0342 0.0000 0.1000 2.7325 0.0000 0.0000 0.0219 0.0000 0.0000 0.0000 0.0000
67-GC 0.7000 0.8000 0.9000 0.9000 0.9000 0.8500 0.0730 0.1000 0.2000 0.0859 0.8469 0.8435 0.0625 0.7000 0.9000 0.8500 0.0730
68-GC 0.3000 0.5000 0.7000 0.8000 0.9000 0.6562 0.1965 0.3000 0.6000 0.2995 0.6233 0.5846 0.1617 0.3000 0.9000 0.6562 0.1965
69-GC 0.2000 0.4000 0.4000 0.7500 0.8000 0.5125 0.2156 0.3500 0.6000 0.4208 0.4667 0.4200 0.1891 0.2000 0.8000 0.5125 0.2156
70-GC 0.0000 0.0000 0.2000 0.2000 0.2000 0.1125 0.1025 0.2000 0.2000 0.9108 0.0026 0.0000 0.0984 0.0000 0.2000 0.1125 0.1025
71-GC 0.0000 0.0000 0.0000 0.2000 0.3000 0.0938 0.1289 0.2000 0.3000 1.3753 0.0007 0.0000 0.1055 0.0000 0.3000 0.0938 0.1289
72-GC 0.0000 0.0000 0.1000 0.1000 0.3000 0.0750 0.0775 0.1000 0.3000 1.0328 0.0034 0.0000 0.0563 0.0000 0.1000 0.0600 0.0507
73-GC 0.0000 0.0000 0.1000 0.2500 0.3000 0.1188 0.1223 0.2500 0.3000 1.0299 0.0043 0.0000 0.1008 0.0000 0.3000 0.1188 0.1223
74-GC 0.0000 0.0000 0.2000 0.3000 0.3000 0.1688 0.1401 0.3000 0.3000 0.8302 0.0058 0.0000 0.1266 0.0000 0.3000 0.1688 0.1401
75-GC 0.2000 0.4000 0.7000 0.9500 1.0000 0.6500 0.2875 0.5500 0.8000 0.4423 0.5772 0.4951 0.2437 0.2000 1.0000 0.6500 0.2875
38
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-DE-CLEF2007
Statistics for P@15
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0667 0.3333 0.5333 0.1667 0.1993 0.3333 0.5333 1.1955 0.0029 0.0000 0.1750 0.0000 0.5333 0.1667 0.1993
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0667 0.1667 0.2667 0.0917 0.0939 0.1667 0.2667 1.0242 0.0061 0.0000 0.0760 0.0000 0.2667 0.0917 0.0939
54-GC 0.0000 0.0667 0.1333 0.1667 0.2000 0.1125 0.0719 0.1000 0.2000 0.6389 0.0218 0.0001 0.0594 0.0000 0.2000 0.1125 0.0719
55-GC 0.0000 0.0000 0.0000 0.0667 0.0667 0.0250 0.0333 0.0667 0.0667 1.3333 0.0003 0.0000 0.0313 0.0000 0.0667 0.0250 0.0333
56-GC 0.0000 0.0667 0.0667 0.1333 0.1333 0.0833 0.0455 0.0667 0.1333 0.5465 0.0288 0.0001 0.0375 0.0000 0.1333 0.0833 0.0455
57-GC 0.0000 0.0000 0.0000 0.0333 0.0667 0.0167 0.0298 0.0333 0.0667 1.7889 0.0001 0.0000 0.0250 0.0000 0.0667 0.0167 0.0298
58-GC 0.0000 0.1667 0.3000 0.4667 0.4667 0.2875 0.1591 0.3000 0.4667 0.5534 0.1412 0.0002 0.1375 0.0000 0.4667 0.2875 0.1591
59-GC 0.0000 0.0333 0.2000 0.2000 0.2667 0.1375 0.0957 0.1667 0.2667 0.6963 0.0149 0.0000 0.0865 0.0000 0.2667 0.1375 0.0957
60-GC 0.0000 0.1333 0.4000 0.6333 0.7333 0.3667 0.2576 0.5000 0.7333 0.7026 0.0942 0.0001 0.2125 0.0000 0.7333 0.3667 0.2576
61-GC 0.0000 0.1333 0.4000 0.6333 0.7333 0.3792 0.2584 0.5000 0.7333 0.6816 0.1673 0.0002 0.2318 0.0000 0.7333 0.3792 0.2584
62-GC 0.0000 0.0000 0.1333 0.3667 0.5333 0.1875 0.2025 0.3667 0.5333 1.0802 0.0032 0.0000 0.1792 0.0000 0.5333 0.1875 0.2025
63-GC 0.2000 0.6667 0.7333 0.8000 0.8667 0.6833 0.1587 0.1333 0.6667 0.2322 0.6552 0.6070 0.1062 0.5333 0.8667 0.7156 0.0958
64-GC 0.0000 0.0000 0.0000 0.0667 0.0667 0.0250 0.0333 0.0667 0.0667 1.3333 0.0003 0.0000 0.0313 0.0000 0.0667 0.0250 0.0333
65-GC 0.0667 0.1667 0.2333 0.5333 0.6667 0.3208 0.2083 0.3667 0.6000 0.6492 0.2533 0.1922 0.1844 0.0667 0.6667 0.3208 0.2083
66-GC 0.0000 0.0000 0.0000 0.0000 0.0667 0.0083 0.0228 0.0000 0.0667 2.7325 0.0000 0.0000 0.0146 0.0000 0.0000 0.0000 0.0000
67-GC 0.7333 0.8000 0.9000 0.9333 0.9333 0.8667 0.0770 0.1333 0.2000 0.0888 0.8633 0.8599 0.0667 0.7333 0.9333 0.8667 0.0770
68-GC 0.4000 0.5667 0.6667 0.7333 0.9333 0.6500 0.1491 0.1667 0.5333 0.2293 0.6333 0.6160 0.1104 0.4000 0.9333 0.6500 0.1491
69-GC 0.2000 0.3333 0.4000 0.7667 0.8667 0.5375 0.2403 0.4333 0.6667 0.4471 0.4865 0.4391 0.2214 0.2000 0.8667 0.5375 0.2403
70-GC 0.0000 0.0000 0.1333 0.1333 0.2667 0.0917 0.0907 0.1333 0.2667 0.9892 0.0023 0.0000 0.0802 0.0000 0.2667 0.0917 0.0907
71-GC 0.0000 0.0000 0.0667 0.1667 0.2000 0.0750 0.0839 0.1667 0.2000 1.1185 0.0019 0.0000 0.0698 0.0000 0.2000 0.0750 0.0839
72-GC 0.0000 0.0000 0.0667 0.0667 0.2667 0.0583 0.0683 0.0667 0.2667 1.1711 0.0028 0.0000 0.0438 0.0000 0.1333 0.0444 0.0411
73-GC 0.0000 0.0000 0.0667 0.2333 0.2667 0.1208 0.1121 0.2333 0.2667 0.9280 0.0074 0.0000 0.1026 0.0000 0.2667 0.1208 0.1121
74-GC 0.0000 0.0000 0.1667 0.2000 0.4000 0.1292 0.1179 0.2000 0.4000 0.9130 0.0048 0.0000 0.0969 0.0000 0.4000 0.1292 0.1179
75-GC 0.1333 0.4000 0.8000 0.9000 1.0000 0.6583 0.3020 0.5000 0.8667 0.4587 0.5625 0.4357 0.2604 0.1333 1.0000 0.6583 0.3020
39
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-DE-CLEF2007
Statistics for P@20
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0500 0.2750 0.4000 0.1344 0.1557 0.2750 0.4000 1.1586 0.0026 0.0000 0.1387 0.0000 0.4000 0.1344 0.1557
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0500 0.1250 0.2000 0.0688 0.0704 0.1250 0.2000 1.0242 0.0050 0.0000 0.0570 0.0000 0.2000 0.0688 0.0704
54-GC 0.0000 0.0500 0.1000 0.1250 0.1500 0.0844 0.0539 0.0750 0.1500 0.6389 0.0173 0.0001 0.0445 0.0000 0.1500 0.0844 0.0539
55-GC 0.0000 0.0000 0.0000 0.0500 0.0500 0.0188 0.0250 0.0500 0.0500 1.3333 0.0002 0.0000 0.0234 0.0000 0.0500 0.0188 0.0250
56-GC 0.0000 0.0500 0.0500 0.1000 0.1500 0.0688 0.0403 0.0500 0.1500 0.5863 0.0239 0.0001 0.0336 0.0000 0.1500 0.0688 0.0403
57-GC 0.0000 0.0000 0.0000 0.0250 0.0500 0.0125 0.0224 0.0250 0.0500 1.7889 0.0001 0.0000 0.0188 0.0000 0.0500 0.0125 0.0224
58-GC 0.0000 0.1500 0.2750 0.3750 0.5500 0.2625 0.1489 0.2250 0.5500 0.5672 0.1315 0.0002 0.1312 0.0000 0.5500 0.2625 0.1489
59-GC 0.0000 0.0250 0.1500 0.2000 0.2000 0.1156 0.0831 0.1750 0.2000 0.7187 0.0129 0.0000 0.0742 0.0000 0.2000 0.1156 0.0831
60-GC 0.0000 0.1000 0.3000 0.6500 0.7000 0.3375 0.2649 0.5500 0.7000 0.7849 0.0826 0.0001 0.2219 0.0000 0.7000 0.3375 0.2649
61-GC 0.0000 0.1000 0.3750 0.6000 0.7500 0.3531 0.2520 0.5000 0.7500 0.7135 0.1520 0.0002 0.2219 0.0000 0.7500 0.3531 0.2520
62-GC 0.0000 0.0000 0.1250 0.4000 0.5000 0.1906 0.2043 0.4000 0.5000 1.0718 0.0032 0.0000 0.1844 0.0000 0.5000 0.1906 0.2043
63-GC 0.2500 0.5500 0.6000 0.6000 0.7500 0.5781 0.1095 0.0500 0.5000 0.1894 0.5648 0.5459 0.0676 0.5500 0.6500 0.5917 0.0289
64-GC 0.0000 0.0000 0.0000 0.0500 0.0500 0.0188 0.0250 0.0500 0.0500 1.3333 0.0002 0.0000 0.0234 0.0000 0.0500 0.0188 0.0250
65-GC 0.0500 0.1250 0.2250 0.4500 0.6500 0.2969 0.2069 0.3250 0.6000 0.6971 0.2225 0.1565 0.1777 0.0500 0.6500 0.2969 0.2069
66-GC 0.0000 0.0000 0.0000 0.0000 0.0500 0.0094 0.0202 0.0000 0.0500 2.1499 0.0000 0.0000 0.0152 0.0000 0.0000 0.0000 0.0000
67-GC 0.7000 0.7500 0.8750 0.9500 0.9500 0.8531 0.0939 0.2000 0.2500 0.1101 0.8481 0.8429 0.0781 0.7000 0.9500 0.8531 0.0939
68-GC 0.3500 0.6000 0.7000 0.7750 0.9000 0.6688 0.1569 0.1750 0.5500 0.2347 0.6479 0.6228 0.1227 0.3500 0.9000 0.6688 0.1569
69-GC 0.2500 0.3000 0.4250 0.7750 0.9000 0.5344 0.2638 0.4750 0.6500 0.4936 0.4736 0.4217 0.2406 0.2500 0.9000 0.5344 0.2638
70-GC 0.0000 0.0000 0.1500 0.2000 0.2500 0.1094 0.1020 0.2000 0.2500 0.9327 0.0026 0.0000 0.0957 0.0000 0.2500 0.1094 0.1020
71-GC 0.0000 0.0000 0.0500 0.1500 0.1500 0.0688 0.0629 0.1500 0.1500 0.9151 0.0051 0.0000 0.0547 0.0000 0.1500 0.0688 0.0629
72-GC 0.0000 0.0000 0.0500 0.0500 0.2000 0.0469 0.0531 0.0500 0.2000 1.1335 0.0024 0.0000 0.0352 0.0000 0.1000 0.0367 0.0352
73-GC 0.0000 0.0000 0.0500 0.2250 0.2500 0.1094 0.1068 0.2250 0.2500 0.9765 0.0067 0.0000 0.0980 0.0000 0.2500 0.1094 0.1068
74-GC 0.0000 0.0000 0.1250 0.1500 0.3000 0.0969 0.0884 0.1500 0.3000 0.9130 0.0040 0.0000 0.0727 0.0000 0.3000 0.0969 0.0884
75-GC 0.1500 0.4000 0.7750 0.8750 1.0000 0.6656 0.2987 0.4750 0.8500 0.4488 0.5751 0.4586 0.2617 0.1500 1.0000 0.6656 0.2987
40
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-DE-CLEF2007
Statistics for P@30
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0167 0.0833 0.2333 0.3000 0.1208 0.1167 0.2167 0.3000 0.9655 0.0114 0.0000 0.1026 0.0000 0.3000 0.1208 0.1167
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0833 0.1333 0.1333 0.0708 0.0595 0.1333 0.1333 0.8396 0.0053 0.0000 0.0542 0.0000 0.1333 0.0708 0.0595
54-GC 0.0000 0.0333 0.0667 0.0833 0.1000 0.0583 0.0355 0.0500 0.1000 0.6083 0.0130 0.0001 0.0281 0.0000 0.1000 0.0583 0.0355
55-GC 0.0000 0.0000 0.0000 0.0333 0.0333 0.0146 0.0171 0.0333 0.0333 1.1711 0.0003 0.0000 0.0164 0.0000 0.0333 0.0146 0.0171
56-GC 0.0000 0.0333 0.0667 0.0667 0.1000 0.0542 0.0269 0.0333 0.1000 0.4961 0.0200 0.0001 0.0214 0.0000 0.1000 0.0542 0.0269
57-GC 0.0000 0.0000 0.0000 0.0167 0.0333 0.0083 0.0149 0.0167 0.0333 1.7889 0.0001 0.0000 0.0125 0.0000 0.0333 0.0083 0.0149
58-GC 0.0000 0.2000 0.2333 0.2667 0.4000 0.2146 0.0935 0.0667 0.4000 0.4356 0.1143 0.0002 0.0656 0.1000 0.2667 0.2282 0.0468
59-GC 0.0000 0.0167 0.1000 0.1333 0.1333 0.0792 0.0569 0.1167 0.1333 0.7191 0.0097 0.0000 0.0510 0.0000 0.1333 0.0792 0.0569
60-GC 0.0000 0.0667 0.2667 0.5667 0.6667 0.3021 0.2496 0.5000 0.6667 0.8262 0.0704 0.0001 0.2109 0.0000 0.6667 0.3021 0.2496
61-GC 0.0000 0.0667 0.3333 0.4500 0.7000 0.2958 0.2350 0.3833 0.7000 0.7945 0.1192 0.0002 0.2005 0.0000 0.7000 0.2958 0.2350
62-GC 0.0000 0.0000 0.0833 0.3167 0.4667 0.1646 0.1844 0.3167 0.4667 1.1203 0.0029 0.0000 0.1643 0.0000 0.4667 0.1646 0.1844
63-GC 0.3333 0.4167 0.4333 0.4667 0.5667 0.4417 0.0537 0.0500 0.2333 0.1217 0.4387 0.4357 0.0365 0.4000 0.5333 0.4405 0.0350
64-GC 0.0000 0.0000 0.0000 0.0333 0.0333 0.0146 0.0171 0.0333 0.0333 1.1711 0.0003 0.0000 0.0164 0.0000 0.0333 0.0146 0.0171
65-GC 0.0667 0.1167 0.2500 0.5000 0.6667 0.3188 0.2280 0.3833 0.6000 0.7154 0.2363 0.1715 0.2021 0.0667 0.6667 0.3188 0.2280
66-GC 0.0000 0.0000 0.0000 0.0333 0.0333 0.0104 0.0160 0.0333 0.0333 1.5319 0.0001 0.0000 0.0143 0.0000 0.0333 0.0104 0.0160
67-GC 0.7000 0.7667 0.8500 0.8667 0.9667 0.8271 0.0669 0.1000 0.2667 0.0809 0.8245 0.8219 0.0536 0.7000 0.9667 0.8271 0.0669
68-GC 0.3667 0.5333 0.7000 0.7667 0.9000 0.6646 0.1783 0.2333 0.5333 0.2682 0.6387 0.6098 0.1401 0.3667 0.9000 0.6646 0.1783
69-GC 0.2667 0.3000 0.4167 0.7333 0.9000 0.5083 0.2317 0.4333 0.6333 0.4559 0.4600 0.4183 0.2094 0.2667 0.9000 0.5083 0.2317
70-GC 0.0000 0.0000 0.1000 0.1333 0.1667 0.0792 0.0708 0.1333 0.1667 0.8948 0.0035 0.0000 0.0651 0.0000 0.1667 0.0792 0.0708
71-GC 0.0000 0.0333 0.0833 0.1000 0.1000 0.0625 0.0419 0.0667 0.1000 0.6711 0.0132 0.0001 0.0380 0.0000 0.1000 0.0625 0.0419
72-GC 0.0000 0.0000 0.0333 0.0667 0.1333 0.0354 0.0375 0.0667 0.1333 1.0575 0.0021 0.0000 0.0279 0.0000 0.1333 0.0354 0.0375
73-GC 0.0000 0.0167 0.0500 0.1667 0.2000 0.0854 0.0807 0.1500 0.2000 0.9449 0.0091 0.0000 0.0711 0.0000 0.2000 0.0854 0.0807
74-GC 0.0000 0.0000 0.0833 0.1000 0.2000 0.0729 0.0680 0.1000 0.2000 0.9327 0.0033 0.0000 0.0563 0.0000 0.2000 0.0729 0.0680
75-GC 0.1667 0.4333 0.7667 0.8333 1.0000 0.6583 0.2739 0.4000 0.8333 0.4161 0.5824 0.4823 0.2354 0.1667 1.0000 0.6583 0.2739
41
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-DE-CLEF2007
Statistics for P@100
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0100 0.0250 0.0750 0.1050 0.1600 0.0700 0.0509 0.0800 0.1500 0.7266 0.0487 0.0301 0.0425 0.0100 0.1600 0.0700 0.0509
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0350 0.0800 0.0800 0.0406 0.0345 0.0800 0.0800 0.8502 0.0037 0.0000 0.0295 0.0000 0.0800 0.0406 0.0345
54-GC 0.0100 0.0200 0.0250 0.0300 0.0400 0.0250 0.0089 0.0100 0.0300 0.3578 0.0233 0.0213 0.0075 0.0100 0.0400 0.0250 0.0089
55-GC 0.0000 0.0000 0.0100 0.0200 0.0500 0.0125 0.0129 0.0200 0.0500 1.0328 0.0016 0.0000 0.0094 0.0000 0.0200 0.0100 0.0085
56-GC 0.0000 0.0200 0.0300 0.0300 0.0300 0.0237 0.0109 0.0100 0.0300 0.4580 0.0098 0.0001 0.0086 0.0100 0.0300 0.0271 0.0061
57-GC 0.0000 0.0000 0.0050 0.0100 0.0100 0.0050 0.0052 0.0100 0.0100 1.0328 0.0003 0.0000 0.0050 0.0000 0.0100 0.0050 0.0052
58-GC 0.0100 0.0900 0.1100 0.1500 0.1600 0.1106 0.0431 0.0600 0.1500 0.3898 0.0963 0.0662 0.0333 0.0100 0.1600 0.1106 0.0431
59-GC 0.0000 0.0100 0.0300 0.0400 0.0400 0.0244 0.0163 0.0300 0.0400 0.6694 0.0061 0.0001 0.0145 0.0000 0.0400 0.0244 0.0163
60-GC 0.0000 0.0200 0.1300 0.3000 0.4100 0.1606 0.1471 0.2800 0.4100 0.9160 0.0358 0.0001 0.1245 0.0000 0.4100 0.1606 0.1471
61-GC 0.0000 0.0300 0.1250 0.1700 0.3400 0.1325 0.1174 0.1400 0.3400 0.8864 0.0552 0.0002 0.0913 0.0000 0.3400 0.1325 0.1174
62-GC 0.0000 0.0100 0.0750 0.1900 0.2500 0.0994 0.0998 0.1800 0.2500 1.0046 0.0200 0.0001 0.0881 0.0000 0.2500 0.0994 0.0998
63-GC 0.1400 0.1700 0.1800 0.1900 0.2300 0.1831 0.0230 0.0200 0.0900 0.1257 0.1818 0.1805 0.0181 0.1600 0.2100 0.1800 0.0141
64-GC 0.0000 0.0000 0.0100 0.0100 0.0300 0.0081 0.0091 0.0100 0.0300 1.1207 0.0006 0.0000 0.0071 0.0000 0.0200 0.0067 0.0072
65-GC 0.0900 0.1100 0.2100 0.4000 0.4400 0.2437 0.1450 0.2900 0.3500 0.5947 0.2021 0.1681 0.1325 0.0900 0.4400 0.2437 0.1450
66-GC 0.0000 0.0000 0.0100 0.0100 0.0200 0.0081 0.0066 0.0100 0.0200 0.8063 0.0013 0.0000 0.0051 0.0000 0.0200 0.0081 0.0066
67-GC 0.5500 0.5900 0.6000 0.6000 0.6100 0.5919 0.0160 0.0100 0.0600 0.0270 0.5917 0.5915 0.0116 0.5900 0.6100 0.5985 0.0069
68-GC 0.3500 0.5600 0.6200 0.7200 0.9200 0.6275 0.1541 0.1600 0.5700 0.2455 0.6081 0.5867 0.1069 0.3500 0.9200 0.6275 0.1541
69-GC 0.1100 0.1250 0.2250 0.3200 0.3500 0.2263 0.0970 0.1950 0.2400 0.4288 0.2050 0.1843 0.0888 0.1100 0.3500 0.2263 0.0970
70-GC 0.0000 0.0250 0.0500 0.0500 0.0700 0.0400 0.0231 0.0250 0.0700 0.5774 0.0145 0.0001 0.0188 0.0000 0.0700 0.0400 0.0231
71-GC 0.0000 0.0300 0.0350 0.0500 0.0600 0.0350 0.0167 0.0200 0.0600 0.4781 0.0138 0.0001 0.0125 0.0000 0.0600 0.0350 0.0167
72-GC 0.0000 0.0200 0.0200 0.0300 0.0800 0.0262 0.0209 0.0100 0.0800 0.7976 0.0096 0.0001 0.0148 0.0100 0.0300 0.0209 0.0054
73-GC 0.0100 0.0300 0.0450 0.0600 0.0700 0.0437 0.0196 0.0300 0.0600 0.4485 0.0388 0.0328 0.0163 0.0100 0.0700 0.0437 0.0196
74-GC 0.0000 0.0300 0.0350 0.0400 0.0700 0.0350 0.0193 0.0100 0.0700 0.5521 0.0135 0.0001 0.0138 0.0200 0.0500 0.0350 0.0080
75-GC 0.1500 0.5300 0.5600 0.6550 0.8300 0.5625 0.1915 0.1250 0.6800 0.3405 0.5139 0.4385 0.1291 0.4900 0.8300 0.6214 0.1114
42
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-DE-CLEF2007
Statistics for P@200
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0050 0.0225 0.0425 0.0750 0.0950 0.0475 0.0319 0.0525 0.0900 0.6724 0.0332 0.0181 0.0256 0.0050 0.0950 0.0475 0.0319
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0100 0.0225 0.0475 0.0500 0.0266 0.0196 0.0375 0.0500 0.7362 0.0063 0.0001 0.0168 0.0000 0.0500 0.0266 0.0196
54-GC 0.0050 0.0150 0.0175 0.0200 0.0200 0.0162 0.0047 0.0050 0.0150 0.2864 0.0154 0.0141 0.0037 0.0100 0.0200 0.0170 0.0037
55-GC 0.0000 0.0025 0.0100 0.0100 0.0300 0.0087 0.0074 0.0075 0.0300 0.8476 0.0019 0.0000 0.0048 0.0000 0.0150 0.0073 0.0050
56-GC 0.0050 0.0100 0.0150 0.0175 0.0200 0.0137 0.0053 0.0075 0.0150 0.3871 0.0125 0.0109 0.0042 0.0050 0.0200 0.0137 0.0053
57-GC 0.0000 0.0000 0.0050 0.0050 0.0050 0.0034 0.0024 0.0050 0.0050 0.6963 0.0007 0.0000 0.0021 0.0000 0.0050 0.0034 0.0024
58-GC 0.0150 0.0550 0.0675 0.0825 0.0900 0.0656 0.0189 0.0275 0.0750 0.2876 0.0616 0.0547 0.0144 0.0150 0.0900 0.0656 0.0189
59-GC 0.0000 0.0050 0.0150 0.0200 0.0200 0.0122 0.0082 0.0150 0.0200 0.6694 0.0035 0.0001 0.0073 0.0000 0.0200 0.0122 0.0082
60-GC 0.0000 0.0125 0.0900 0.1700 0.2150 0.0925 0.0779 0.1575 0.2150 0.8425 0.0229 0.0001 0.0638 0.0000 0.2150 0.0925 0.0779
61-GC 0.0000 0.0150 0.0725 0.1025 0.1800 0.0734 0.0621 0.0875 0.1800 0.8463 0.0317 0.0002 0.0503 0.0000 0.1800 0.0734 0.0621
62-GC 0.0050 0.0050 0.0550 0.1250 0.1450 0.0644 0.0588 0.1200 0.1400 0.9141 0.0295 0.0119 0.0544 0.0050 0.1450 0.0644 0.0588
63-GC 0.0900 0.0950 0.1075 0.1250 0.1300 0.1100 0.0152 0.0300 0.0400 0.1379 0.1090 0.1080 0.0131 0.0900 0.1300 0.1100 0.0152
64-GC 0.0000 0.0000 0.0050 0.0100 0.0300 0.0072 0.0080 0.0100 0.0300 1.1063 0.0010 0.0000 0.0059 0.0000 0.0150 0.0057 0.0053
65-GC 0.0550 0.0875 0.1325 0.2450 0.2500 0.1503 0.0761 0.1575 0.1950 0.5066 0.1314 0.1141 0.0684 0.0550 0.2500 0.1503 0.0761
66-GC 0.0000 0.0050 0.0050 0.0075 0.0100 0.0059 0.0027 0.0025 0.0100 0.4580 0.0040 0.0002 0.0020 0.0050 0.0100 0.0063 0.0023
67-GC 0.2750 0.3000 0.3000 0.3050 0.3050 0.3006 0.0073 0.0050 0.0300 0.0242 0.3005 0.3004 0.0038 0.3000 0.3050 0.3023 0.0026
68-GC 0.2100 0.4825 0.5300 0.5850 0.6550 0.5034 0.1271 0.1025 0.4450 0.2524 0.4818 0.4511 0.0849 0.4700 0.6550 0.5454 0.0591
69-GC 0.0700 0.0700 0.1350 0.1750 0.1850 0.1266 0.0500 0.1050 0.1150 0.3953 0.1164 0.1065 0.0466 0.0700 0.1850 0.1266 0.0500
70-GC 0.0050 0.0200 0.0250 0.0350 0.0500 0.0278 0.0133 0.0150 0.0450 0.4778 0.0245 0.0202 0.0101 0.0050 0.0500 0.0278 0.0133
71-GC 0.0000 0.0200 0.0200 0.0300 0.0350 0.0219 0.0101 0.0100 0.0350 0.4638 0.0092 0.0001 0.0071 0.0200 0.0350 0.0250 0.0059
72-GC 0.0050 0.0100 0.0100 0.0150 0.0400 0.0147 0.0109 0.0050 0.0350 0.7403 0.0121 0.0105 0.0077 0.0050 0.0150 0.0100 0.0029
73-GC 0.0050 0.0175 0.0250 0.0300 0.0350 0.0231 0.0095 0.0125 0.0300 0.4093 0.0207 0.0174 0.0073 0.0050 0.0350 0.0231 0.0095
74-GC 0.0000 0.0175 0.0200 0.0250 0.0350 0.0206 0.0100 0.0075 0.0350 0.4838 0.0087 0.0001 0.0070 0.0150 0.0350 0.0236 0.0063
75-GC 0.1050 0.3575 0.4000 0.4400 0.5200 0.3734 0.1199 0.0825 0.4150 0.3210 0.3440 0.2977 0.0799 0.3200 0.5200 0.4118 0.0625
43
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-DE-CLEF2007
Statistics for P@500
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0020 0.0160 0.0230 0.0410 0.0520 0.0255 0.0175 0.0250 0.0500 0.6864 0.0170 0.0079 0.0144 0.0020 0.0520 0.0255 0.0175
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0060 0.0120 0.0200 0.0200 0.0121 0.0075 0.0140 0.0200 0.6156 0.0065 0.0002 0.0059 0.0000 0.0200 0.0121 0.0075
54-GC 0.0020 0.0060 0.0080 0.0080 0.0080 0.0070 0.0016 0.0020 0.0060 0.2333 0.0067 0.0062 0.0013 0.0060 0.0080 0.0073 0.0010
55-GC 0.0000 0.0020 0.0040 0.0060 0.0120 0.0048 0.0037 0.0040 0.0120 0.7821 0.0021 0.0001 0.0028 0.0000 0.0100 0.0037 0.0026
56-GC 0.0040 0.0040 0.0060 0.0070 0.0080 0.0059 0.0015 0.0030 0.0040 0.2628 0.0057 0.0055 0.0012 0.0040 0.0080 0.0059 0.0015
57-GC 0.0000 0.0010 0.0020 0.0020 0.0020 0.0015 0.0009 0.0010 0.0020 0.5963 0.0005 0.0000 0.0008 0.0000 0.0020 0.0015 0.0009
58-GC 0.0060 0.0320 0.0380 0.0380 0.0380 0.0336 0.0084 0.0060 0.0320 0.2488 0.0315 0.0268 0.0056 0.0260 0.0380 0.0355 0.0041
59-GC 0.0000 0.0020 0.0060 0.0080 0.0080 0.0049 0.0033 0.0060 0.0080 0.6694 0.0016 0.0001 0.0029 0.0000 0.0080 0.0049 0.0033
60-GC 0.0000 0.0080 0.0500 0.0800 0.0900 0.0440 0.0338 0.0720 0.0900 0.7689 0.0130 0.0001 0.0288 0.0000 0.0900 0.0440 0.0338
61-GC 0.0000 0.0120 0.0340 0.0500 0.0860 0.0363 0.0260 0.0380 0.0860 0.7182 0.0188 0.0002 0.0208 0.0000 0.0860 0.0363 0.0260
62-GC 0.0080 0.0260 0.0340 0.0620 0.0640 0.0391 0.0206 0.0360 0.0560 0.5269 0.0327 0.0253 0.0181 0.0080 0.0640 0.0391 0.0206
63-GC 0.0400 0.0470 0.0530 0.0580 0.0600 0.0523 0.0062 0.0110 0.0200 0.1193 0.0519 0.0515 0.0050 0.0400 0.0600 0.0523 0.0062
64-GC 0.0020 0.0020 0.0020 0.0060 0.0140 0.0041 0.0035 0.0040 0.0120 0.8577 0.0032 0.0027 0.0027 0.0020 0.0080 0.0035 0.0024
65-GC 0.0260 0.0610 0.0940 0.1320 0.1340 0.0891 0.0377 0.0710 0.1080 0.4236 0.0796 0.0681 0.0310 0.0260 0.1340 0.0891 0.0377
66-GC 0.0020 0.0020 0.0020 0.0040 0.0040 0.0028 0.0010 0.0020 0.0020 0.3636 0.0026 0.0025 0.0009 0.0020 0.0040 0.0028 0.0010
67-GC 0.1100 0.1200 0.1220 0.1220 0.1220 0.1205 0.0030 0.0020 0.0120 0.0246 0.1205 0.1204 0.0017 0.1200 0.1220 0.1212 0.0010
68-GC 0.1240 0.2840 0.3370 0.3810 0.3920 0.3156 0.0867 0.0970 0.2680 0.2748 0.2995 0.2769 0.0638 0.2520 0.3920 0.3430 0.0472
69-GC 0.0380 0.0420 0.0560 0.0750 0.0760 0.0576 0.0165 0.0330 0.0380 0.2857 0.0554 0.0532 0.0156 0.0380 0.0760 0.0576 0.0165
70-GC 0.0080 0.0120 0.0120 0.0200 0.0300 0.0159 0.0071 0.0080 0.0220 0.4471 0.0146 0.0136 0.0058 0.0080 0.0300 0.0159 0.0071
71-GC 0.0000 0.0080 0.0080 0.0140 0.0140 0.0095 0.0046 0.0060 0.0140 0.4892 0.0044 0.0001 0.0037 0.0000 0.0140 0.0095 0.0046
72-GC 0.0040 0.0060 0.0060 0.0130 0.0160 0.0086 0.0042 0.0070 0.0120 0.4917 0.0078 0.0071 0.0036 0.0040 0.0160 0.0086 0.0042
73-GC 0.0020 0.0070 0.0140 0.0140 0.0140 0.0110 0.0042 0.0070 0.0120 0.3814 0.0099 0.0081 0.0038 0.0020 0.0140 0.0110 0.0042
74-GC 0.0000 0.0100 0.0120 0.0120 0.0160 0.0106 0.0047 0.0020 0.0160 0.4440 0.0049 0.0001 0.0032 0.0080 0.0120 0.0111 0.0014
75-GC 0.0660 0.1530 0.1880 0.2080 0.2280 0.1715 0.0485 0.0550 0.1620 0.2827 0.1624 0.1496 0.0361 0.1440 0.2280 0.1866 0.0275
44
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-DE-CLEF2007
Statistics for P@1000
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0020 0.0085 0.0115 0.0225 0.0300 0.0146 0.0092 0.0140 0.0280 0.6313 0.0115 0.0083 0.0078 0.0020 0.0300 0.0146 0.0092
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0020 0.0050 0.0070 0.0100 0.0100 0.0069 0.0030 0.0050 0.0080 0.4311 0.0061 0.0051 0.0024 0.0020 0.0100 0.0069 0.0030
54-GC 0.0010 0.0035 0.0040 0.0040 0.0040 0.0036 0.0008 0.0005 0.0030 0.2224 0.0035 0.0032 0.0006 0.0030 0.0040 0.0038 0.0004
55-GC 0.0000 0.0020 0.0020 0.0040 0.0070 0.0028 0.0020 0.0020 0.0070 0.7137 0.0018 0.0001 0.0016 0.0000 0.0070 0.0028 0.0020
56-GC 0.0020 0.0020 0.0035 0.0050 0.0050 0.0035 0.0013 0.0030 0.0030 0.3614 0.0033 0.0030 0.0011 0.0020 0.0050 0.0035 0.0013
57-GC 0.0000 0.0005 0.0010 0.0010 0.0010 0.0008 0.0004 0.0005 0.0010 0.5963 0.0003 0.0000 0.0004 0.0000 0.0010 0.0008 0.0004
58-GC 0.0040 0.0170 0.0190 0.0190 0.0190 0.0174 0.0037 0.0020 0.0150 0.2152 0.0166 0.0149 0.0021 0.0160 0.0190 0.0183 0.0012
59-GC 0.0000 0.0010 0.0030 0.0040 0.0040 0.0024 0.0016 0.0030 0.0040 0.6694 0.0009 0.0001 0.0015 0.0000 0.0040 0.0024 0.0016
60-GC 0.0000 0.0075 0.0330 0.0430 0.0490 0.0260 0.0177 0.0355 0.0490 0.6826 0.0090 0.0001 0.0155 0.0000 0.0490 0.0260 0.0177
61-GC 0.0000 0.0080 0.0175 0.0270 0.0460 0.0212 0.0144 0.0190 0.0460 0.6801 0.0117 0.0002 0.0117 0.0000 0.0460 0.0212 0.0144
62-GC 0.0130 0.0225 0.0290 0.0320 0.0320 0.0266 0.0068 0.0095 0.0190 0.2568 0.0255 0.0243 0.0055 0.0130 0.0320 0.0266 0.0068
63-GC 0.0220 0.0260 0.0290 0.0355 0.0360 0.0301 0.0052 0.0095 0.0140 0.1737 0.0296 0.0292 0.0046 0.0220 0.0360 0.0301 0.0052
64-GC 0.0010 0.0010 0.0030 0.0045 0.0070 0.0032 0.0021 0.0035 0.0060 0.6502 0.0025 0.0020 0.0018 0.0010 0.0070 0.0032 0.0021
65-GC 0.0200 0.0440 0.0580 0.0760 0.0830 0.0572 0.0203 0.0320 0.0630 0.3553 0.0529 0.0474 0.0157 0.0200 0.0830 0.0572 0.0203
66-GC 0.0010 0.0010 0.0010 0.0020 0.0020 0.0014 0.0005 0.0010 0.0010 0.3636 0.0013 0.0012 0.0005 0.0010 0.0020 0.0014 0.0005
67-GC 0.0550 0.0600 0.0610 0.0610 0.0610 0.0604 0.0015 0.0010 0.0060 0.0248 0.0604 0.0603 0.0009 0.0600 0.0610 0.0607 0.0005
68-GC 0.0970 0.1850 0.2120 0.2230 0.2280 0.1962 0.0421 0.0380 0.1310 0.2147 0.1904 0.1825 0.0301 0.1760 0.2280 0.2104 0.0178
69-GC 0.0200 0.0240 0.0290 0.0390 0.0410 0.0307 0.0081 0.0150 0.0210 0.2630 0.0297 0.0287 0.0074 0.0200 0.0410 0.0307 0.0081
70-GC 0.0050 0.0070 0.0070 0.0135 0.0180 0.0097 0.0045 0.0065 0.0130 0.4597 0.0089 0.0083 0.0038 0.0050 0.0180 0.0097 0.0045
71-GC 0.0000 0.0040 0.0050 0.0070 0.0070 0.0049 0.0024 0.0030 0.0070 0.4762 0.0025 0.0001 0.0018 0.0000 0.0070 0.0049 0.0024
72-GC 0.0030 0.0030 0.0035 0.0075 0.0080 0.0048 0.0022 0.0045 0.0050 0.4644 0.0043 0.0040 0.0019 0.0030 0.0080 0.0048 0.0022
73-GC 0.0010 0.0050 0.0070 0.0070 0.0070 0.0058 0.0019 0.0020 0.0060 0.3330 0.0052 0.0043 0.0016 0.0030 0.0070 0.0061 0.0015
74-GC 0.0000 0.0050 0.0065 0.0070 0.0080 0.0057 0.0025 0.0020 0.0080 0.4388 0.0028 0.0001 0.0018 0.0040 0.0080 0.0065 0.0012
75-GC 0.0370 0.0795 0.0950 0.1095 0.1140 0.0882 0.0239 0.0300 0.0770 0.2714 0.0841 0.0785 0.0178 0.0370 0.1140 0.0882 0.0239
45
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-EN-CLEF2007
GeoCLEF Monolingual English Task Top 5 Participants − Standard Recall Levels vs Mean Interpolated Precision
100%
catalunya [Experiment TALPGEOIRTD2; MAP 28.50%; Not Pooled]
cheshire [Experiment BERKMOENBASE; MAP 26.42%; Pooled]
90% valencia [Experiment RFIAUPV06; MAP 26.36%; Not Pooled]
groningen [Experiment CLCGGEOEETD00; MAP 25.15%; Not Pooled]
csusm [Experiment GEOMOEN5; MAP 21.32%; Not Pooled]
80%
70%
60%
Precision
50%
40%
30%
20%
10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task Top 5 Participants − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
1
catalunya [Experiment TALPGEOIRTD2; MAP 28.50%; Not Pooled]
cheshire [Experiment BERKMOENBASE; MAP 26.42%; Pooled]
valencia [Experiment RFIAUPV06; MAP 26.36%; Not Pooled]
groningen [Experiment CLCGGEOEETD00; MAP 25.15%; Not Pooled]
csusm [Experiment GEOMOEN5; MAP 21.32%; Not Pooled]
0.8
0.6
0.4
0.2
Difference
0
−0.2
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
46
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-EN-CLEF2007
GeoCLEF Monolingual English Task − Box Plot of the Topics
catalunya [Experiment TALPGEOIRTD2; MAP 28.50%; Not Pooled]
catalunya [Experiment TALPGEOIRTDN3; MAP 27.87%; Not Pooled]
catalunya [Experiment TALPGEOIRTDN2; MAP 27.54%; Not Pooled]
catalunya [Experiment TALPGEOIRTD1; MAP 27.11%; Pooled]
cheshire [Experiment BERKMOENBASE; MAP 26.42%; Pooled]
valencia [Experiment RFIAUPV06; MAP 26.36%; Not Pooled]
catalunya [Experiment TALPGEOIRTDN1; MAP 26.25%; Pooled]
valencia [Experiment RFIAUPV04; MAP 25.67%; Pooled]
groningen [Experiment CLCGGEOEETD00; MAP 25.15%; Not Pooled]
valencia [Experiment RFIAUPV02; MAP 24.70%; Not Pooled]
valencia [Experiment RFIAUPV11; MAP 23.93%; Not Pooled]
valencia [Experiment RFIAUPV09; MAP 23.87%; Not Pooled]
valencia [Experiment RFIAUPV05; MAP 23.82%; Not Pooled]
valencia [Experiment RFIAUPV10; MAP 23.57%; Not Pooled]
valencia [Experiment RFIAUPV12; MAP 23.11%; Not Pooled]
valencia [Experiment RFIAUPV03; MAP 22.73%; Pooled]
valencia [Experiment RFIAUPV01; MAP 22.69%; Not Pooled]
valencia [Experiment RFIAUPV07; MAP 22.45%; Not Pooled]
valencia [Experiment RFIAUPV08; MAP 22.45%; Not Pooled]
csusm [Experiment GEOMOEN5; MAP 21.32%; Not Pooled]
groningen [Experiment CLCGGEOEETDN01; MAP 20.53%; Pooled]
groningen [Experiment CLCGGEOEETDN00; MAP 20.23%; Not Pooled]
groningen [Experiment CLCGGEOEET00; MAP 20.23%; Not Pooled]
csusm [Experiment GEOMOEN6; MAP 19.40%; Not Pooled]
csusm [Experiment GEOMOEN4; MAP 18.84%; Not Pooled]
icl [Experiment IMPCOLTEXTONLY; MAP 18.52%; Not Pooled]
Experiments
groningen [Experiment CLCGGEOEETDN01B; MAP 18.47%; Pooled]
moscow [Experiment CIRGEOEN07_RUN1; MAP 17.61%; Pooled]
moscow [Experiment CIRGEOEN07_RUN2; MAP 16.59%; Pooled]
hildesheim [Experiment HIMOENNE; MAP 15.35%; Not Pooled]
msasia [Experiment MSRATEXT; MAP 15.19%; Not Pooled]
hildesheim [Experiment HIMOENNANE; MAP 14.97%; Pooled]
linguit [Experiment LTITLEEXPMANUAL2007; MAP 14.83%; Not Pooled]
csusm [Experiment GEOMOEN1; MAP 14.69%; Pooled]
linguit [Experiment LTITLEDESC2007; MAP 14.33%; Pooled]
csusm [Experiment GEOMOEN3; MAP 14.33%; Not Pooled]
linguit [Experiment LTITLE2007; MAP 14.19%; Pooled]
hildesheim [Experiment HIMOENBASE; MAP 14.05%; Pooled]
csusm [Experiment GEOMOEN2; MAP 13.31%; Pooled]
hildesheim [Experiment HIMOENNE2; MAP 12.69%; Not Pooled]
icl [Experiment IMPCOLCOMBINATION; MAP 10.65%; Pooled]
icl [Experiment IMPCOLNOGEO; MAP 9.94%; Not Pooled]
linguit [Experiment LTITLEGEORERANK2007; MAP 9.75%; Not Pooled]
msasia [Experiment MSRAWHITELIST; MAP 8.61%; Pooled]
msasia [Experiment MSRALOCATION; MAP 8.61%; Not Pooled]
msasia [Experiment MSRALDA; MAP 7.52%; Pooled]
msasia [Experiment MSRAEXPANSION; MAP 7.01%; Not Pooled]
xldb [Experiment XLDBEN_3; MAP 3.81%; Not Pooled]
xldb [Experiment XLDBEN_2; MAP 3.81%; Pooled]
xldb [Experiment XLDBEN_4; MAP 2.54%; Not Pooled]
xldb [Experiment XLDBEN_5; MAP 2.54%; Not Pooled]
xldb [Experiment XLDBEN_1; MAP 1.67%; Pooled]
icl [Experiment IMPCOLGEOONLY; MAP 1.13%; Pooled]
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Average Precision
47
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-EN-CLEF2007
10.2455/TUKEY_T_TEST.92A2C36414C380F4108296F882F685DF
GeoCLEF Monolingual English Task − Tukey T test with "top group" highlighted
TALPGEOIRTD2
TALPGEOIRTDN3
TALPGEOIRTDN2
TALPGEOIRTD1
BERKMOENBASE
CLCGGEOEETD00
RFIAUPV06
RFIAUPV04
TALPGEOIRTDN1
RFIAUPV02
RFIAUPV11
RFIAUPV09
RFIAUPV05
RFIAUPV10
RFIAUPV12
RFIAUPV01
RFIAUPV03
RFIAUPV08
RFIAUPV07
CLCGGEOEETDN01
CLCGGEOEET00
CLCGGEOEETDN00
Experiments
GEOMOEN5
CLCGGEOEETDN01B
GEOMOEN6
IMPCOLTEXTONLY
GEOMOEN4
HIMOENNE
HIMOENNANE
CIRGEOEN07_RUN1
HIMOENBASE
CIRGEOEN07_RUN2
MSRATEXT
GEOMOEN1
HIMOENNE2
LTITLEDESC2007
LTITLEEXPMANUAL2007
LTITLE2007
GEOMOEN3
GEOMOEN2
IMPCOLCOMBINATION
IMPCOLNOGEO
MSRALDA
LTITLEGEORERANK2007
MSRALOCATION
MSRAWHITELIST
MSRAEXPANSION
XLDBEN_2
XLDBEN_3
XLDBEN_5
XLDBEN_4
XLDBEN_1
IMPCOLGEOONLY
−0.1 0 0.1 0.2 0.3 0.4 0.5 0.6 0.7
arcsin(sqrt(Average Precsion))
48
49
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-EN-CLEF2007
GeoCLEF Monolingual English Task Top 5 Participants − Retrieved documents vs Mean Precision
100%
catalunya [Experiment TALPGEOIRTD2; R−Prec 31.70%; Not Pooled]
cheshire [Experiment BERKMOENBASE; R−Prec 25.76%; Pooled]
90% valencia [Experiment RFIAUPV06; R−Prec 27.23%; Not Pooled]
groningen [Experiment CLCGGEOEETD00; R−Prec 25.95%; Not Pooled]
csusm [Experiment GEOMOEN5; R−Prec 20.97%; Not Pooled]
80%
70%
60%
Precision
50%
40%
30%
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task Top 5 Participants − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
1
catalunya [Experiment TALPGEOIRTD2; R−Prec 31.70%; Not Pooled]
cheshire [Experiment BERKMOENBASE; R−Prec 25.76%; Pooled]
valencia [Experiment RFIAUPV06; R−Prec 27.23%; Not Pooled]
groningen [Experiment CLCGGEOEETD00; R−Prec 25.95%; Not Pooled]
csusm [Experiment GEOMOEN5; R−Prec 20.97%; Not Pooled]
0.8
0.6
0.4
0.2
Difference
0
−0.2
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
50
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-EN-CLEF2007
GeoCLEF Monolingual English Task − Box Plot of the Topics
catalunya [Experiment TALPGEOIRTD2; R−Prec 31.70%; Not Pooled]
catalunya [Experiment TALPGEOIRTDN2; R−Prec 28.95%; Not Pooled]
catalunya [Experiment TALPGEOIRTDN3; R−Prec 28.90%; Not Pooled]
catalunya [Experiment TALPGEOIRTD1; R−Prec 28.47%; Pooled]
valencia [Experiment RFIAUPV06; R−Prec 27.23%; Not Pooled]
valencia [Experiment RFIAUPV02; R−Prec 26.76%; Not Pooled]
groningen [Experiment CLCGGEOEETD00; R−Prec 25.95%; Not Pooled]
valencia [Experiment RFIAUPV04; R−Prec 25.90%; Pooled]
cheshire [Experiment BERKMOENBASE; R−Prec 25.76%; Pooled]
catalunya [Experiment TALPGEOIRTDN1; R−Prec 25.26%; Pooled]
valencia [Experiment RFIAUPV11; R−Prec 24.06%; Not Pooled]
valencia [Experiment RFIAUPV09; R−Prec 23.92%; Not Pooled]
valencia [Experiment RFIAUPV10; R−Prec 23.91%; Not Pooled]
valencia [Experiment RFIAUPV05; R−Prec 23.83%; Not Pooled]
valencia [Experiment RFIAUPV01; R−Prec 23.69%; Not Pooled]
valencia [Experiment RFIAUPV12; R−Prec 23.51%; Not Pooled]
groningen [Experiment CLCGGEOEETDN01; R−Prec 22.34%; Pooled]
valencia [Experiment RFIAUPV07; R−Prec 22.33%; Not Pooled]
valencia [Experiment RFIAUPV08; R−Prec 22.33%; Not Pooled]
groningen [Experiment CLCGGEOEETDN00; R−Prec 21.86%; Not Pooled]
groningen [Experiment CLCGGEOEET00; R−Prec 21.86%; Not Pooled]
valencia [Experiment RFIAUPV03; R−Prec 21.86%; Pooled]
csusm [Experiment GEOMOEN6; R−Prec 21.34%; Not Pooled]
csusm [Experiment GEOMOEN5; R−Prec 20.97%; Not Pooled]
icl [Experiment IMPCOLTEXTONLY; R−Prec 20.53%; Not Pooled]
groningen [Experiment CLCGGEOEETDN01B; R−Prec 20.19%; Pooled]
Experiments
csusm [Experiment GEOMOEN4; R−Prec 19.61%; Not Pooled]
hildesheim [Experiment HIMOENBASE; R−Prec 19.10%; Pooled]
hildesheim [Experiment HIMOENNANE; R−Prec 18.09%; Pooled]
hildesheim [Experiment HIMOENNE; R−Prec 17.76%; Not Pooled]
linguit [Experiment LTITLEEXPMANUAL2007; R−Prec 17.57%; Not Pooled]
moscow [Experiment CIRGEOEN07_RUN1; R−Prec 17.51%; Pooled]
moscow [Experiment CIRGEOEN07_RUN2; R−Prec 17.30%; Pooled]
hildesheim [Experiment HIMOENNE2; R−Prec 17.22%; Not Pooled]
msasia [Experiment MSRATEXT; R−Prec 17.08%; Not Pooled]
linguit [Experiment LTITLEDESC2007; R−Prec 16.64%; Pooled]
linguit [Experiment LTITLE2007; R−Prec 16.64%; Pooled]
csusm [Experiment GEOMOEN1; R−Prec 16.56%; Pooled]
csusm [Experiment GEOMOEN2; R−Prec 15.25%; Pooled]
csusm [Experiment GEOMOEN3; R−Prec 14.20%; Not Pooled]
icl [Experiment IMPCOLCOMBINATION; R−Prec 12.47%; Pooled]
icl [Experiment IMPCOLNOGEO; R−Prec 12.05%; Not Pooled]
msasia [Experiment MSRAWHITELIST; R−Prec 11.85%; Pooled]
msasia [Experiment MSRALOCATION; R−Prec 11.85%; Not Pooled]
linguit [Experiment LTITLEGEORERANK2007; R−Prec 11.38%; Not Pooled]
msasia [Experiment MSRALDA; R−Prec 9.97%; Pooled]
msasia [Experiment MSRAEXPANSION; R−Prec 8.89%; Not Pooled]
xldb [Experiment XLDBEN_3; R−Prec 4.95%; Not Pooled]
xldb [Experiment XLDBEN_2; R−Prec 4.95%; Pooled]
xldb [Experiment XLDBEN_4; R−Prec 3.89%; Not Pooled]
xldb [Experiment XLDBEN_5; R−Prec 3.89%; Not Pooled]
xldb [Experiment XLDBEN_1; R−Prec 2.02%; Pooled]
icl [Experiment IMPCOLGEOONLY; R−Prec 0.64%; Pooled]
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
R−Precision
51
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-EN-CLEF2007
GeoCLEF Monolingual English Task − Tukey T test with "top group" highlighted
TALPGEOIRTD2
TALPGEOIRTD1
TALPGEOIRTDN2
CLCGGEOEETD00
TALPGEOIRTDN3
RFIAUPV02
RFIAUPV06
RFIAUPV04
BERKMOENBASE
RFIAUPV11
RFIAUPV09
RFIAUPV01
RFIAUPV10
CLCGGEOEETDN01
TALPGEOIRTDN1
RFIAUPV05
CLCGGEOEET00
CLCGGEOEETDN00
RFIAUPV12
IMPCOLTEXTONLY
CLCGGEOEETDN01B
GEOMOEN6
Experiments
HIMOENBASE
RFIAUPV03
RFIAUPV08
RFIAUPV07
GEOMOEN5
HIMOENNE
HIMOENNANE
HIMOENNE2
GEOMOEN4
LTITLEEXPMANUAL2007
MSRATEXT
CIRGEOEN07_RUN1
CIRGEOEN07_RUN2
GEOMOEN1
LTITLE2007
LTITLEDESC2007
GEOMOEN2
GEOMOEN3
IMPCOLCOMBINATION
IMPCOLNOGEO
MSRALDA
MSRALOCATION
MSRAWHITELIST
LTITLEGEORERANK2007
MSRAEXPANSION
XLDBEN_2
XLDBEN_3
XLDBEN_5
XLDBEN_4
XLDBEN_1
IMPCOLGEOONLY
−0.1 0 0.1 0.2 0.3 0.4 0.5 0.6 0.7
arcsin(sqrt(R−Precision))
52
53
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-EN-CLEF2007
Statistics for Number of relevant retrieved documents
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 1.00 98.00 103.00 110.00 112.00 91.21 34.63 12.00 111.00 0.38 63.29 10.44 23.53 82.00 112.00 104.84 6.89
52-GC 0.00 2.00 3.00 4.00 7.00 3.06 1.73 2.00 7.00 0.56 1.71 0.00 1.29 0.00 7.00 3.06 1.73
53-GC 3.00 34.00 43.00 53.00 61.00 41.38 13.82 19.00 58.00 0.33 36.96 26.90 10.68 9.00 61.00 42.86 11.79
54-GC 0.00 3.00 6.00 7.00 7.00 4.70 2.64 4.00 7.00 0.56 0.87 0.00 2.38 0.00 7.00 4.70 2.64
55-GC 0.00 8.00 14.00 16.00 16.00 11.94 4.90 8.00 16.00 0.41 6.54 0.00 4.04 0.00 16.00 11.94 4.90
56-GC 0.00 3.00 7.00 7.00 8.00 5.13 2.61 4.00 8.00 0.51 1.44 0.00 2.25 0.00 8.00 5.13 2.61
57-GC 0.00 12.00 14.00 15.00 15.00 11.72 5.00 3.00 15.00 0.43 3.16 0.00 3.76 8.00 15.00 13.80 1.71
58-GC 0.00 4.00 5.00 5.00 6.00 4.38 1.55 1.00 6.00 0.35 2.62 0.00 1.20 3.00 6.00 4.81 0.97
59-GC 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 N/D 0.00 0.00 0.00 0.00 0.00 0.00 0.00
60-GC 5.00 14.00 27.00 27.25 30.00 22.02 9.00 13.25 25.00 0.41 19.13 15.32 7.75 5.00 30.00 22.02 9.00
61-GC 0.00 12.00 16.00 19.00 21.00 15.17 4.77 7.00 21.00 0.31 11.26 0.00 4.00 4.00 21.00 15.46 4.31
62-GC 1.00 1.75 3.00 4.00 4.00 2.79 1.21 2.25 3.00 0.43 2.45 2.07 1.06 1.00 4.00 2.79 1.21
63-GC 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 N/D 0.00 0.00 0.00 0.00 0.00 0.00 0.00
64-GC 0.00 3.00 8.00 9.25 16.00 7.15 4.49 6.25 16.00 0.63 1.21 0.00 3.50 0.00 16.00 7.15 4.49
65-GC 7.00 49.00 76.00 86.00 92.00 66.81 22.56 37.00 85.00 0.34 60.95 50.32 19.74 7.00 92.00 66.81 22.56
66-GC 0.00 1.00 2.00 2.00 3.00 1.79 0.77 1.00 3.00 0.43 0.74 0.00 0.57 0.00 3.00 1.79 0.77
67-GC 0.00 8.75 17.00 17.00 17.00 12.96 6.66 8.25 17.00 0.51 2.03 0.00 5.64 0.00 17.00 12.96 6.66
68-GC 0.00 88.00 129.00 131.00 131.00 104.34 37.31 43.00 131.00 0.36 70.23 0.00 30.44 52.00 131.00 112.18 25.95
69-GC 0.00 8.50 15.00 19.25 21.00 12.77 7.65 10.75 21.00 0.60 1.01 0.00 6.60 0.00 21.00 12.77 7.65
70-GC 3.00 11.00 17.00 20.00 29.00 15.91 7.10 9.00 26.00 0.45 13.80 11.12 5.73 3.00 29.00 15.91 7.10
71-GC 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 N/D 0.00 0.00 0.00 0.00 0.00 0.00 0.00
72-GC 0.00 11.00 13.00 14.00 14.00 11.13 4.12 3.00 14.00 0.37 4.05 0.00 3.02 7.00 14.00 12.50 2.03
73-GC 0.00 1.75 7.00 7.00 7.00 4.62 3.00 5.25 7.00 0.65 0.42 0.00 2.80 0.00 7.00 4.62 3.00
74-GC 0.00 1.00 3.00 3.00 3.00 2.19 1.08 2.00 3.00 0.49 0.57 0.00 0.92 0.00 3.00 2.19 1.08
75-GC 0.00 12.75 16.00 17.00 19.00 13.81 5.53 4.25 19.00 0.40 6.07 0.00 4.32 7.00 19.00 16.00 2.63
54
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-EN-CLEF2007
Statistics for Average Precsion
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.3936 0.5258 0.6822 0.7992 0.4794 0.2396 0.2886 0.7991 0.4999 0.1690 0.0002 0.1812 0.0000 0.7992 0.4794 0.2396
52-GC 0.0000 0.0011 0.0045 0.0199 0.0963 0.0135 0.0211 0.0188 0.0963 1.5640 0.0034 0.0002 0.0144 0.0000 0.0327 0.0079 0.0096
53-GC 0.0006 0.0566 0.1089 0.1605 0.2544 0.1140 0.0659 0.1039 0.2539 0.5781 0.0809 0.0166 0.0542 0.0006 0.2544 0.1140 0.0659
54-GC 0.0000 0.0032 0.0508 0.1074 0.1432 0.0597 0.0495 0.1042 0.1432 0.8297 0.0127 0.0001 0.0451 0.0000 0.1432 0.0597 0.0495
55-GC 0.0000 0.0087 0.1127 0.2037 0.3643 0.1263 0.1074 0.1950 0.3643 0.8502 0.0398 0.0002 0.0928 0.0000 0.3643 0.1263 0.1074
56-GC 0.0000 0.0085 0.1495 0.2098 0.4777 0.1416 0.1188 0.2014 0.4777 0.8390 0.0271 0.0001 0.0877 0.0000 0.4777 0.1416 0.1188
57-GC 0.0000 0.0671 0.1698 0.2309 0.4502 0.1736 0.1303 0.1638 0.4502 0.7507 0.0513 0.0001 0.0988 0.0000 0.4502 0.1736 0.1303
58-GC 0.0000 0.0111 0.0308 0.0991 0.2358 0.0569 0.0631 0.0881 0.2358 1.1094 0.0222 0.0003 0.0515 0.0000 0.1965 0.0535 0.0585
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0008 0.1281 0.7029 0.7434 0.7818 0.5240 0.3118 0.6153 0.7810 0.5951 0.2301 0.0123 0.2802 0.0008 0.7818 0.5240 0.3118
61-GC 0.0000 0.0344 0.1012 0.1408 0.4878 0.1249 0.1204 0.1064 0.4878 0.9647 0.0677 0.0005 0.0858 0.0000 0.2635 0.0898 0.0673
62-GC 0.0003 0.0228 0.0635 0.2738 0.3509 0.1375 0.1303 0.2510 0.3506 0.9480 0.0595 0.0073 0.1218 0.0003 0.3509 0.1375 0.1303
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0029 0.0162 0.0291 0.2010 0.0280 0.0434 0.0262 0.2010 1.5496 0.0058 0.0001 0.0264 0.0000 0.0662 0.0151 0.0148
65-GC 0.0008 0.0798 0.1407 0.3547 0.4330 0.2134 0.1467 0.2749 0.4322 0.6873 0.1382 0.0262 0.1382 0.0008 0.4330 0.2134 0.1467
66-GC 0.0000 0.0089 0.1367 0.3372 0.3725 0.1663 0.1460 0.3283 0.3725 0.8779 0.0342 0.0001 0.1334 0.0000 0.3725 0.1663 0.1460
67-GC 0.0000 0.1777 0.3402 0.4246 0.5353 0.2863 0.1656 0.2469 0.5353 0.5783 0.0715 0.0001 0.1417 0.0000 0.5353 0.2863 0.1656
68-GC 0.0000 0.3234 0.5327 0.6410 0.7579 0.4713 0.2241 0.3176 0.7579 0.4754 0.3289 0.0005 0.1938 0.0000 0.7579 0.4713 0.2241
69-GC 0.0000 0.0118 0.1107 0.1645 0.3342 0.1166 0.1047 0.1528 0.3342 0.8980 0.0167 0.0001 0.0844 0.0000 0.3342 0.1166 0.1047
70-GC 0.0004 0.0081 0.0233 0.0625 0.3184 0.0587 0.0887 0.0544 0.3180 1.5116 0.0201 0.0050 0.0617 0.0004 0.1338 0.0265 0.0280
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.0000 0.2016 0.3226 0.6379 0.7071 0.3728 0.2506 0.4363 0.7071 0.6721 0.1235 0.0001 0.2246 0.0000 0.7071 0.3728 0.2506
73-GC 0.0000 0.0020 0.0216 0.0380 0.3005 0.0462 0.0778 0.0360 0.3005 1.6836 0.0055 0.0001 0.0497 0.0000 0.0825 0.0191 0.0197
74-GC 0.0000 0.0042 0.1732 0.4519 0.7222 0.2611 0.2464 0.4476 0.7222 0.9438 0.0343 0.0001 0.2229 0.0000 0.7222 0.2611 0.2464
75-GC 0.0000 0.0827 0.3022 0.4411 0.6335 0.2801 0.2105 0.3585 0.6335 0.7515 0.0903 0.0002 0.1826 0.0000 0.6335 0.2801 0.2105
55
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-EN-CLEF2007
Statistics for R-Precision
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.4554 0.5268 0.6339 0.7411 0.4773 0.2163 0.1786 0.7411 0.4532 0.1678 0.0001 0.1574 0.2946 0.7411 0.5579 0.1037
52-GC 0.0000 0.0000 0.0000 0.0909 0.0909 0.0292 0.0428 0.0909 0.0909 1.4691 0.0002 0.0000 0.0396 0.0000 0.0909 0.0292 0.0428
53-GC 0.0000 0.1250 0.1562 0.2188 0.3438 0.1595 0.0896 0.0938 0.3438 0.5619 0.0548 0.0001 0.0696 0.0000 0.3438 0.1595 0.0896
54-GC 0.0000 0.0000 0.1429 0.1429 0.2857 0.0863 0.0759 0.1429 0.2857 0.8800 0.0027 0.0000 0.0716 0.0000 0.2857 0.0863 0.0759
55-GC 0.0000 0.0000 0.1875 0.2500 0.3750 0.1462 0.1279 0.2500 0.3750 0.8749 0.0081 0.0000 0.1120 0.0000 0.3750 0.1462 0.1279
56-GC 0.0000 0.0000 0.1250 0.2500 0.5000 0.1651 0.1526 0.2500 0.5000 0.9246 0.0088 0.0000 0.1271 0.0000 0.5000 0.1651 0.1526
57-GC 0.0000 0.0667 0.2667 0.3333 0.5333 0.2201 0.1483 0.2667 0.5333 0.6735 0.0490 0.0001 0.1246 0.0000 0.5333 0.2201 0.1483
58-GC 0.0000 0.0000 0.0000 0.1667 0.3333 0.0597 0.0930 0.1667 0.3333 1.5564 0.0002 0.0000 0.0812 0.0000 0.3333 0.0597 0.0930
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0000 0.1917 0.7000 0.7000 0.7667 0.5094 0.2935 0.5083 0.7667 0.5761 0.0737 0.0001 0.2598 0.0000 0.7667 0.5094 0.2935
61-GC 0.0000 0.0455 0.1364 0.1932 0.5909 0.1458 0.1338 0.1477 0.5909 0.9179 0.0239 0.0001 0.0951 0.0000 0.3636 0.1227 0.0964
62-GC 0.0000 0.0000 0.0000 0.2500 0.2500 0.1132 0.1256 0.2500 0.2500 1.1098 0.0010 0.0000 0.1239 0.0000 0.2500 0.1132 0.1256
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0588 0.2353 0.0411 0.0688 0.0588 0.2353 1.6758 0.0002 0.0000 0.0542 0.0000 0.1176 0.0233 0.0416
65-GC 0.0108 0.1398 0.2581 0.4220 0.4624 0.2794 0.1481 0.2823 0.4516 0.5301 0.2223 0.1326 0.1349 0.0108 0.4624 0.2794 0.1481
66-GC 0.0000 0.0000 0.3333 0.3333 0.3333 0.1761 0.1680 0.3333 0.3333 0.9540 0.0025 0.0000 0.1661 0.0000 0.3333 0.1761 0.1680
67-GC 0.0000 0.1765 0.2941 0.4118 0.4706 0.2719 0.1527 0.2353 0.4706 0.5616 0.0726 0.0001 0.1289 0.0000 0.4706 0.2719 0.1527
68-GC 0.0000 0.3931 0.5725 0.6565 0.7328 0.4963 0.2037 0.2634 0.7328 0.4104 0.3639 0.0005 0.1715 0.0000 0.7328 0.4963 0.2037
69-GC 0.0000 0.0357 0.1905 0.2024 0.3810 0.1608 0.1215 0.1667 0.3810 0.7554 0.0171 0.0000 0.0989 0.0000 0.3810 0.1608 0.1215
70-GC 0.0000 0.0000 0.0345 0.1034 0.4138 0.0839 0.1149 0.1034 0.4138 1.3686 0.0053 0.0000 0.0845 0.0000 0.2414 0.0532 0.0652
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.0000 0.2143 0.3571 0.5714 0.7857 0.4043 0.2583 0.3571 0.7857 0.6388 0.0709 0.0001 0.2260 0.0000 0.7857 0.4043 0.2583
73-GC 0.0000 0.0000 0.0000 0.0000 0.1429 0.0323 0.0604 0.0000 0.1429 1.8661 0.0001 0.0000 0.0500 0.0000 0.0000 0.0000 0.0000
74-GC 0.0000 0.0000 0.3333 0.3333 0.6667 0.2201 0.2259 0.3333 0.6667 1.0263 0.0032 0.0000 0.1994 0.0000 0.6667 0.2201 0.2259
75-GC 0.0000 0.1250 0.3500 0.5000 0.6500 0.3104 0.2106 0.3750 0.6500 0.6786 0.0465 0.0001 0.1777 0.0000 0.6500 0.3104 0.2106
56
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-EN-CLEF2007
Statistics for Binary Preference
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0039 0.4901 0.5537 0.6893 0.8319 0.5331 0.2342 0.1992 0.8280 0.4394 0.3418 0.0402 0.1678 0.3029 0.8319 0.6113 0.1264
52-GC 0.0000 0.0000 0.0000 0.0413 0.0909 0.0168 0.0268 0.0413 0.0909 1.5901 0.0002 0.0000 0.0229 0.0000 0.0909 0.0168 0.0268
53-GC 0.0000 0.0896 0.1187 0.1542 0.2688 0.1221 0.0675 0.0646 0.2688 0.5527 0.0438 0.0001 0.0493 0.0000 0.2441 0.1135 0.0592
54-GC 0.0000 0.0000 0.0612 0.1020 0.1837 0.0581 0.0549 0.1020 0.1837 0.9448 0.0021 0.0000 0.0502 0.0000 0.1837 0.0581 0.0549
55-GC 0.0000 0.0000 0.0977 0.1406 0.2930 0.0916 0.0919 0.1406 0.2930 1.0035 0.0052 0.0000 0.0771 0.0000 0.2930 0.0916 0.0919
56-GC 0.0000 0.0000 0.1250 0.1758 0.4219 0.1244 0.1115 0.1758 0.4219 0.8962 0.0074 0.0000 0.0809 0.0000 0.4219 0.1244 0.1115
57-GC 0.0000 0.0611 0.1378 0.2178 0.4400 0.1611 0.1274 0.1567 0.4400 0.7912 0.0364 0.0001 0.1028 0.0000 0.4400 0.1611 0.1274
58-GC 0.0000 0.0000 0.0000 0.0833 0.1944 0.0383 0.0629 0.0833 0.1944 1.6435 0.0002 0.0000 0.0528 0.0000 0.1944 0.0383 0.0629
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0000 0.1814 0.7089 0.7278 0.7689 0.5202 0.3071 0.5464 0.7689 0.5904 0.0738 0.0001 0.2751 0.0000 0.7689 0.5202 0.3071
61-GC 0.0000 0.0196 0.1116 0.1586 0.5413 0.1305 0.1330 0.1389 0.5413 1.0193 0.0227 0.0001 0.0912 0.0000 0.3430 0.1063 0.0908
62-GC 0.0000 0.0000 0.0000 0.2500 0.3125 0.1097 0.1243 0.2500 0.3125 1.1338 0.0010 0.0000 0.1200 0.0000 0.3125 0.1097 0.1243
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0329 0.1903 0.0255 0.0471 0.0329 0.1903 1.8494 0.0002 0.0000 0.0328 0.0000 0.0727 0.0124 0.0214
65-GC 0.0079 0.1115 0.2447 0.3843 0.4203 0.2529 0.1299 0.2729 0.4124 0.5138 0.2064 0.1256 0.1175 0.0079 0.4203 0.2529 0.1299
66-GC 0.0000 0.0000 0.1111 0.3333 0.3333 0.1530 0.1544 0.3333 0.3333 1.0091 0.0022 0.0000 0.1475 0.0000 0.3333 0.1530 0.1544
67-GC 0.0000 0.1306 0.2595 0.3080 0.4740 0.2181 0.1249 0.1773 0.4740 0.5726 0.0601 0.0001 0.1035 0.0000 0.4740 0.2181 0.1249
68-GC 0.0000 0.4583 0.6167 0.7462 0.8193 0.5770 0.2138 0.2879 0.8193 0.3706 0.4328 0.0005 0.1724 0.0839 0.8193 0.5881 0.1999
69-GC 0.0000 0.0068 0.0862 0.1650 0.3492 0.1030 0.0942 0.1582 0.3492 0.9141 0.0111 0.0000 0.0768 0.0000 0.3492 0.1030 0.0942
70-GC 0.0000 0.0000 0.0083 0.0565 0.3246 0.0549 0.0898 0.0565 0.3246 1.6346 0.0028 0.0000 0.0657 0.0000 0.1237 0.0205 0.0305
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.0000 0.1735 0.3316 0.6224 0.6990 0.3623 0.2460 0.4490 0.6990 0.6790 0.0623 0.0001 0.2200 0.0000 0.6990 0.3623 0.2460
73-GC 0.0000 0.0000 0.0000 0.0000 0.1224 0.0150 0.0313 0.0000 0.1224 2.0841 0.0001 0.0000 0.0232 0.0000 0.0000 0.0000 0.0000
74-GC 0.0000 0.0000 0.2222 0.3333 0.6667 0.2096 0.2120 0.3333 0.6667 1.0113 0.0031 0.0000 0.1899 0.0000 0.6667 0.2096 0.2120
75-GC 0.0000 0.1112 0.2800 0.4388 0.6300 0.2829 0.2060 0.3275 0.6300 0.7281 0.0414 0.0001 0.1743 0.0000 0.6300 0.2829 0.2060
57
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-EN-CLEF2007
Statistics for Precision at the 0% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0021 0.9773 1.0000 1.0000 1.0000 0.8422 0.3415 0.0227 0.9979 0.4056 0.4922 0.0245 0.2477 1.0000 1.0000 1.0000 0.0000
52-GC 0.0000 0.0052 0.0157 0.1429 1.0000 0.0939 0.1959 0.1376 1.0000 2.0862 0.0181 0.0003 0.1099 0.0000 0.2500 0.0584 0.0760
53-GC 0.0122 0.2256 1.0000 1.0000 1.0000 0.6567 0.3957 0.7744 0.9878 0.6026 0.4524 0.1733 0.3757 0.0122 1.0000 0.6567 0.3957
54-GC 0.0000 0.0118 0.2222 0.3333 1.0000 0.2276 0.2144 0.3215 1.0000 0.9417 0.0382 0.0001 0.1752 0.0000 0.5000 0.2128 0.1869
55-GC 0.0000 0.0438 0.2667 0.3665 1.0000 0.2911 0.2967 0.3226 1.0000 1.0195 0.1018 0.0003 0.2132 0.0000 0.6000 0.2006 0.1601
56-GC 0.0000 0.0249 0.4286 0.5250 1.0000 0.4247 0.3592 0.5001 1.0000 0.8458 0.0791 0.0001 0.2891 0.0000 1.0000 0.4247 0.3592
57-GC 0.0000 0.2500 0.3333 0.7175 1.0000 0.4277 0.3025 0.4675 1.0000 0.7072 0.1294 0.0001 0.2414 0.0000 1.0000 0.4277 0.3025
58-GC 0.0000 0.0303 0.0556 0.2589 1.0000 0.1889 0.2742 0.2286 1.0000 1.4514 0.0560 0.0003 0.1976 0.0000 0.5000 0.1227 0.1488
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0068 1.0000 1.0000 1.0000 1.0000 0.8082 0.3812 0.0000 0.9932 0.4717 0.4975 0.0807 0.3039 1.0000 1.0000 1.0000 0.0000
61-GC 0.0000 0.0753 0.6667 1.0000 1.0000 0.5754 0.3900 0.9247 1.0000 0.6778 0.2886 0.0005 0.3389 0.0000 1.0000 0.5754 0.3900
62-GC 0.0011 0.0444 0.1429 1.0000 1.0000 0.4353 0.4407 0.9556 0.9989 1.0126 0.1642 0.0250 0.4122 0.0011 1.0000 0.4353 0.4407
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0217 0.0469 0.1257 1.0000 0.1077 0.1664 0.1040 1.0000 1.5450 0.0208 0.0001 0.0971 0.0000 0.2000 0.0680 0.0625
65-GC 0.0179 0.3333 0.5000 1.0000 1.0000 0.5848 0.3100 0.6667 0.9821 0.5301 0.4757 0.2866 0.2685 0.0179 1.0000 0.5848 0.3100
66-GC 0.0000 0.0159 0.3333 1.0000 1.0000 0.4660 0.4319 0.9841 1.0000 0.9267 0.0812 0.0001 0.3918 0.0000 1.0000 0.4660 0.4319
67-GC 0.0000 0.5000 1.0000 1.0000 1.0000 0.7350 0.3676 0.5000 1.0000 0.5001 0.1801 0.0001 0.3201 0.0000 1.0000 0.7350 0.3676
68-GC 0.0000 1.0000 1.0000 1.0000 1.0000 0.9458 0.1767 0.0000 1.0000 0.1868 0.7653 0.0005 0.0900 1.0000 1.0000 1.0000 0.0000
69-GC 0.0000 0.0660 0.2162 0.5000 1.0000 0.3041 0.2883 0.4340 1.0000 0.9479 0.0391 0.0001 0.2248 0.0000 1.0000 0.3041 0.2883
70-GC 0.0037 0.0427 0.0820 0.1750 1.0000 0.2217 0.3274 0.1323 0.9963 1.4765 0.0886 0.0351 0.2346 0.0037 0.3333 0.0889 0.0771
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.0000 0.9167 1.0000 1.0000 1.0000 0.7981 0.3823 0.0833 1.0000 0.4790 0.2843 0.0001 0.3047 1.0000 1.0000 1.0000 0.0000
73-GC 0.0000 0.0093 0.0392 0.1063 0.5000 0.0896 0.1298 0.0969 0.5000 1.4486 0.0108 0.0001 0.0969 0.0000 0.2000 0.0438 0.0529
74-GC 0.0000 0.0127 0.5000 1.0000 1.0000 0.5332 0.4608 0.9873 1.0000 0.8642 0.0700 0.0001 0.4404 0.0000 1.0000 0.5332 0.4608
75-GC 0.0000 0.4125 0.7500 1.0000 1.0000 0.6650 0.3909 0.5875 1.0000 0.5879 0.2403 0.0002 0.3385 0.0000 1.0000 0.6650 0.3909
58
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-EN-CLEF2007
Statistics for Precision at the 10% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.6701 0.8824 0.9500 1.0000 0.7442 0.3292 0.2799 1.0000 0.4423 0.2470 0.0001 0.2529 0.3673 1.0000 0.8708 0.1362
52-GC 0.0000 0.0032 0.0123 0.0452 0.1111 0.0288 0.0351 0.0421 0.1111 1.2160 0.0046 0.0001 0.0279 0.0000 0.1053 0.0239 0.0294
53-GC 0.0000 0.1452 0.2800 0.4029 0.5833 0.2703 0.1591 0.2578 0.5833 0.5885 0.1567 0.0003 0.1358 0.0000 0.5833 0.2703 0.1591
54-GC 0.0000 0.0118 0.2222 0.3333 1.0000 0.2276 0.2144 0.3215 1.0000 0.9417 0.0382 0.0001 0.1752 0.0000 0.5000 0.2128 0.1869
55-GC 0.0000 0.0390 0.2222 0.3333 1.0000 0.2321 0.2175 0.2944 1.0000 0.9373 0.0799 0.0002 0.1583 0.0000 0.6000 0.2020 0.1571
56-GC 0.0000 0.0249 0.4286 0.5250 1.0000 0.4247 0.3592 0.5001 1.0000 0.8458 0.0791 0.0001 0.2891 0.0000 1.0000 0.4247 0.3592
57-GC 0.0000 0.1141 0.2857 0.4286 1.0000 0.3441 0.2788 0.3145 1.0000 0.8102 0.0756 0.0001 0.2242 0.0000 0.8000 0.3184 0.2509
58-GC 0.0000 0.0303 0.0556 0.2589 1.0000 0.1889 0.2742 0.2286 1.0000 1.4514 0.0560 0.0003 0.1976 0.0000 0.5000 0.1227 0.1488
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0051 0.6000 1.0000 1.0000 1.0000 0.7776 0.3805 0.4000 0.9949 0.4893 0.4746 0.0734 0.3163 0.0051 1.0000 0.7776 0.3805
61-GC 0.0000 0.0523 0.2500 0.5000 1.0000 0.3517 0.3216 0.4477 1.0000 0.9143 0.1654 0.0005 0.2753 0.0000 1.0000 0.3517 0.3216
62-GC 0.0011 0.0444 0.1429 1.0000 1.0000 0.4353 0.4407 0.9556 0.9989 1.0126 0.1642 0.0250 0.4122 0.0011 1.0000 0.4353 0.4407
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0108 0.0469 0.1028 0.5000 0.0874 0.1131 0.0920 0.5000 1.2940 0.0173 0.0001 0.0756 0.0000 0.1875 0.0603 0.0579
65-GC 0.0000 0.1930 0.4545 0.5327 0.8333 0.3927 0.2245 0.3397 0.8333 0.5715 0.2618 0.0005 0.1940 0.0000 0.8333 0.3927 0.2245
66-GC 0.0000 0.0159 0.3333 1.0000 1.0000 0.4660 0.4319 0.9841 1.0000 0.9267 0.0812 0.0001 0.3918 0.0000 1.0000 0.4660 0.4319
67-GC 0.0000 0.3962 0.7500 1.0000 1.0000 0.6526 0.3930 0.6038 1.0000 0.6022 0.0905 0.0001 0.3445 0.0000 1.0000 0.6526 0.3930
68-GC 0.0000 0.7188 0.7895 0.8534 1.0000 0.7178 0.2677 0.1346 1.0000 0.3729 0.3156 0.0001 0.1802 0.7000 1.0000 0.8234 0.0735
69-GC 0.0000 0.0225 0.2000 0.3375 0.6000 0.2196 0.1795 0.3150 0.6000 0.8178 0.0303 0.0001 0.1417 0.0000 0.6000 0.2196 0.1795
70-GC 0.0037 0.0277 0.0704 0.1264 0.7500 0.1496 0.2112 0.0987 0.7463 1.4120 0.0640 0.0271 0.1497 0.0037 0.2308 0.0632 0.0536
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.0000 0.4583 0.7500 1.0000 1.0000 0.6902 0.3827 0.5417 1.0000 0.5545 0.2412 0.0001 0.3198 0.0000 1.0000 0.6902 0.3827
73-GC 0.0000 0.0093 0.0392 0.1063 0.5000 0.0896 0.1298 0.0969 0.5000 1.4486 0.0108 0.0001 0.0969 0.0000 0.2000 0.0438 0.0529
74-GC 0.0000 0.0127 0.5000 1.0000 1.0000 0.5332 0.4608 0.9873 1.0000 0.8642 0.0700 0.0001 0.4404 0.0000 1.0000 0.5332 0.4608
75-GC 0.0000 0.3368 0.7500 1.0000 1.0000 0.6329 0.3901 0.6632 1.0000 0.6163 0.2206 0.0002 0.3361 0.0000 1.0000 0.6329 0.3901
59
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-EN-CLEF2007
Statistics for Precision at the 20% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.6377 0.7419 0.9259 1.0000 0.6699 0.3095 0.2882 1.0000 0.4620 0.1691 0.0001 0.2263 0.3600 1.0000 0.7856 0.1486
52-GC 0.0000 0.0000 0.0046 0.0098 0.1000 0.0115 0.0240 0.0098 0.1000 2.0832 0.0007 0.0000 0.0132 0.0000 0.0195 0.0050 0.0056
53-GC 0.0000 0.0769 0.1593 0.2358 0.4737 0.1695 0.1072 0.1589 0.4737 0.6325 0.0754 0.0001 0.0884 0.0000 0.4737 0.1695 0.1072
54-GC 0.0000 0.0049 0.0833 0.1705 0.3333 0.0936 0.0911 0.1655 0.3333 0.9732 0.0135 0.0001 0.0820 0.0000 0.3333 0.0936 0.0911
55-GC 0.0000 0.0161 0.1818 0.2798 0.5000 0.1771 0.1440 0.2637 0.5000 0.8134 0.0386 0.0001 0.1243 0.0000 0.5000 0.1771 0.1440
56-GC 0.0000 0.0139 0.2222 0.3333 1.0000 0.2499 0.2426 0.3195 1.0000 0.9706 0.0298 0.0001 0.1859 0.0000 0.6667 0.2205 0.1944
57-GC 0.0000 0.1034 0.2667 0.4286 0.8000 0.3234 0.2619 0.3251 0.8000 0.8099 0.0706 0.0001 0.2166 0.0000 0.8000 0.3234 0.2619
58-GC 0.0000 0.0203 0.0500 0.0964 0.3333 0.0715 0.0817 0.0761 0.3333 1.1432 0.0251 0.0001 0.0567 0.0000 0.2000 0.0520 0.0456
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0000 0.2927 1.0000 1.0000 1.0000 0.7274 0.4035 0.7073 1.0000 0.5547 0.3607 0.0005 0.3525 0.0000 1.0000 0.7274 0.4035
61-GC 0.0000 0.0488 0.0795 0.2074 1.0000 0.2036 0.2818 0.1587 1.0000 1.3840 0.0751 0.0003 0.2080 0.0000 0.3571 0.0952 0.0926
62-GC 0.0011 0.0444 0.1429 1.0000 1.0000 0.4353 0.4407 0.9556 0.9989 1.0126 0.1642 0.0250 0.4122 0.0011 1.0000 0.4353 0.4407
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0339 0.0727 0.4000 0.0631 0.0930 0.0727 0.4000 1.4747 0.0048 0.0000 0.0605 0.0000 0.1087 0.0318 0.0311
65-GC 0.0000 0.1040 0.3175 0.4906 0.6216 0.3117 0.1854 0.3865 0.6216 0.5949 0.1759 0.0003 0.1662 0.0000 0.6216 0.3117 0.1854
66-GC 0.0000 0.0159 0.3333 1.0000 1.0000 0.4660 0.4319 0.9841 1.0000 0.9267 0.0812 0.0001 0.3918 0.0000 1.0000 0.4660 0.4319
67-GC 0.0000 0.2898 0.4444 0.5139 0.8000 0.3868 0.2322 0.2241 0.8000 0.6004 0.0601 0.0001 0.1795 0.0000 0.8000 0.3868 0.2322
68-GC 0.0000 0.6667 0.7317 0.8024 0.9655 0.6443 0.2585 0.1357 0.9655 0.4013 0.2794 0.0001 0.1829 0.5091 0.9655 0.7451 0.0918
69-GC 0.0000 0.0170 0.1786 0.3106 0.6000 0.1975 0.1765 0.2936 0.6000 0.8937 0.0235 0.0000 0.1394 0.0000 0.6000 0.1975 0.1765
70-GC 0.0000 0.0157 0.0550 0.0952 0.5833 0.0990 0.1359 0.0795 0.5833 1.3732 0.0173 0.0001 0.0950 0.0000 0.2143 0.0520 0.0519
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.0000 0.3077 0.7500 1.0000 1.0000 0.6187 0.3899 0.6923 1.0000 0.6302 0.1852 0.0001 0.3422 0.0000 1.0000 0.6187 0.3899
73-GC 0.0000 0.0018 0.0290 0.0392 0.4000 0.0596 0.1088 0.0375 0.4000 1.8253 0.0049 0.0000 0.0676 0.0000 0.0952 0.0214 0.0200
74-GC 0.0000 0.0127 0.5000 1.0000 1.0000 0.5332 0.4608 0.9873 1.0000 0.8642 0.0700 0.0001 0.4404 0.0000 1.0000 0.5332 0.4608
75-GC 0.0000 0.1033 0.5714 0.8000 1.0000 0.5238 0.3579 0.6967 1.0000 0.6833 0.1542 0.0001 0.3102 0.0000 1.0000 0.5238 0.3579
60
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-EN-CLEF2007
Statistics for Precision at the 30% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.6041 0.6833 0.9153 1.0000 0.6291 0.3027 0.3113 1.0000 0.4812 0.1584 0.0001 0.2225 0.2525 1.0000 0.7380 0.1664
52-GC 0.0000 0.0000 0.0000 0.0041 0.1000 0.0090 0.0246 0.0041 0.1000 2.7234 0.0001 0.0000 0.0137 0.0000 0.0090 0.0009 0.0024
53-GC 0.0000 0.0531 0.1299 0.2064 0.3704 0.1389 0.0958 0.1533 0.3704 0.6900 0.0526 0.0001 0.0777 0.0000 0.3704 0.1389 0.0958
54-GC 0.0000 0.0041 0.0248 0.0523 0.1667 0.0381 0.0483 0.0482 0.1667 1.2685 0.0056 0.0001 0.0358 0.0000 0.1111 0.0237 0.0271
55-GC 0.0000 0.0161 0.1786 0.2649 0.4545 0.1676 0.1417 0.2489 0.4545 0.8459 0.0354 0.0001 0.1238 0.0000 0.4545 0.1676 0.1417
56-GC 0.0000 0.0058 0.1212 0.2857 0.6000 0.1610 0.1768 0.2799 0.6000 1.0982 0.0184 0.0001 0.1410 0.0000 0.6000 0.1610 0.1768
57-GC 0.0000 0.0805 0.2000 0.3640 0.7273 0.2502 0.2186 0.2836 0.7273 0.8738 0.0556 0.0001 0.1771 0.0000 0.7273 0.2502 0.2186
58-GC 0.0000 0.0203 0.0500 0.0964 0.3333 0.0715 0.0817 0.0761 0.3333 1.1432 0.0251 0.0001 0.0567 0.0000 0.2000 0.0520 0.0456
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0000 0.1314 0.9000 1.0000 1.0000 0.6776 0.4150 0.8686 1.0000 0.6125 0.0853 0.0001 0.3710 0.0000 1.0000 0.6776 0.4150
61-GC 0.0000 0.0294 0.0795 0.0986 0.7778 0.1375 0.2036 0.0692 0.7778 1.4813 0.0555 0.0003 0.1289 0.0000 0.1842 0.0643 0.0391
62-GC 0.0000 0.0031 0.0444 0.1654 0.4000 0.0975 0.1223 0.1623 0.4000 1.2548 0.0074 0.0000 0.0998 0.0000 0.4000 0.0975 0.1223
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0224 0.0412 0.2500 0.0338 0.0493 0.0412 0.2500 1.4609 0.0029 0.0000 0.0304 0.0000 0.0722 0.0232 0.0224
65-GC 0.0000 0.0920 0.2214 0.4690 0.5167 0.2802 0.1884 0.3770 0.5167 0.6724 0.1306 0.0002 0.1782 0.0000 0.5167 0.2802 0.1884
66-GC 0.0000 0.0159 0.3333 1.0000 1.0000 0.4660 0.4319 0.9841 1.0000 0.9267 0.0812 0.0001 0.3918 0.0000 1.0000 0.4660 0.4319
67-GC 0.0000 0.2785 0.3750 0.4375 0.6000 0.3223 0.1845 0.1590 0.6000 0.5726 0.0509 0.0001 0.1433 0.2308 0.6000 0.4061 0.0921
68-GC 0.0000 0.5128 0.7119 0.7289 0.8723 0.5950 0.2568 0.2161 0.8723 0.4315 0.2532 0.0001 0.1945 0.2788 0.8723 0.6810 0.1369
69-GC 0.0000 0.0134 0.1556 0.3106 0.5833 0.1724 0.1552 0.2973 0.5833 0.9006 0.0178 0.0000 0.1281 0.0000 0.5833 0.1724 0.1552
70-GC 0.0000 0.0142 0.0385 0.0887 0.4583 0.0845 0.1279 0.0745 0.4583 1.5137 0.0096 0.0000 0.0889 0.0000 0.1800 0.0390 0.0419
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.0000 0.1493 0.5556 0.7692 1.0000 0.4645 0.3280 0.6200 1.0000 0.7061 0.1199 0.0001 0.2977 0.0000 1.0000 0.4645 0.3280
73-GC 0.0000 0.0000 0.0244 0.0392 0.4000 0.0563 0.1089 0.0392 0.4000 1.9353 0.0024 0.0000 0.0662 0.0000 0.0833 0.0187 0.0199
74-GC 0.0000 0.0127 0.5000 1.0000 1.0000 0.5332 0.4608 0.9873 1.0000 0.8642 0.0700 0.0001 0.4404 0.0000 1.0000 0.5332 0.4608
75-GC 0.0000 0.0750 0.4211 0.6923 0.8750 0.3957 0.3084 0.6173 0.8750 0.7795 0.0689 0.0001 0.2739 0.0000 0.8750 0.3957 0.3084
61
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-EN-CLEF2007
Statistics for Precision at the 40% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.5161 0.6479 0.7970 0.9231 0.5809 0.2901 0.2809 0.9231 0.4993 0.1460 0.0001 0.2210 0.1213 0.9231 0.6693 0.1917
52-GC 0.0000 0.0000 0.0000 0.0000 0.0909 0.0077 0.0224 0.0000 0.0909 2.9184 0.0000 0.0000 0.0122 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0435 0.1055 0.1624 0.3000 0.1197 0.0850 0.1189 0.3000 0.7098 0.0450 0.0001 0.0702 0.0000 0.3000 0.1197 0.0850
54-GC 0.0000 0.0041 0.0248 0.0523 0.1667 0.0381 0.0483 0.0482 0.1667 1.2685 0.0056 0.0001 0.0358 0.0000 0.1111 0.0237 0.0271
55-GC 0.0000 0.0158 0.1167 0.2390 0.4286 0.1463 0.1316 0.2231 0.4286 0.8994 0.0272 0.0001 0.1127 0.0000 0.4286 0.1463 0.1316
56-GC 0.0000 0.0000 0.1212 0.2857 0.5714 0.1471 0.1695 0.2857 0.5714 1.1521 0.0097 0.0000 0.1336 0.0000 0.5714 0.1471 0.1695
57-GC 0.0000 0.0742 0.1875 0.2344 0.7273 0.2081 0.1967 0.1602 0.7273 0.9452 0.0415 0.0001 0.1397 0.0000 0.4615 0.1434 0.1062
58-GC 0.0000 0.0084 0.0303 0.0551 0.2308 0.0428 0.0485 0.0467 0.2308 1.1336 0.0124 0.0001 0.0339 0.0000 0.1190 0.0338 0.0316
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0000 0.0732 0.8571 0.9286 1.0000 0.6242 0.4054 0.8554 1.0000 0.6495 0.0559 0.0000 0.3640 0.0000 1.0000 0.6242 0.4054
61-GC 0.0000 0.0277 0.0566 0.0865 0.6316 0.0816 0.1275 0.0588 0.6316 1.5621 0.0255 0.0001 0.0604 0.0000 0.1154 0.0516 0.0313
62-GC 0.0000 0.0031 0.0444 0.1654 0.4000 0.0975 0.1223 0.1623 0.4000 1.2548 0.0074 0.0000 0.0998 0.0000 0.4000 0.0975 0.1223
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0095 0.0299 0.2500 0.0261 0.0428 0.0299 0.2500 1.6387 0.0018 0.0000 0.0264 0.0000 0.0722 0.0176 0.0209
65-GC 0.0000 0.0829 0.1579 0.4432 0.4937 0.2540 0.1863 0.3603 0.4937 0.7334 0.0955 0.0001 0.1779 0.0000 0.4937 0.2540 0.1863
66-GC 0.0000 0.0000 0.0067 0.0199 0.2222 0.0302 0.0497 0.0199 0.2222 1.6425 0.0025 0.0000 0.0368 0.0000 0.0282 0.0064 0.0065
67-GC 0.0000 0.2127 0.3333 0.4375 0.5500 0.2922 0.1707 0.2248 0.5500 0.5843 0.0468 0.0001 0.1375 0.0000 0.5500 0.2922 0.1707
68-GC 0.0000 0.3974 0.6709 0.7162 0.8333 0.5297 0.2642 0.3189 0.8333 0.4988 0.1602 0.0001 0.2234 0.0000 0.8333 0.5297 0.2642
69-GC 0.0000 0.0068 0.1340 0.2500 0.4091 0.1352 0.1353 0.2432 0.4091 1.0004 0.0114 0.0000 0.1164 0.0000 0.4091 0.1352 0.1353
70-GC 0.0000 0.0000 0.0210 0.0648 0.4286 0.0692 0.1149 0.0648 0.4286 1.6620 0.0045 0.0000 0.0786 0.0000 0.1500 0.0277 0.0335
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.0000 0.0224 0.3750 0.7500 0.7857 0.3994 0.3349 0.7276 0.7857 0.8386 0.0749 0.0001 0.3212 0.0000 0.7857 0.3994 0.3349
73-GC 0.0000 0.0000 0.0244 0.0392 0.4000 0.0563 0.1089 0.0392 0.4000 1.9353 0.0024 0.0000 0.0662 0.0000 0.0833 0.0187 0.0199
74-GC 0.0000 0.0000 0.0714 0.2356 1.0000 0.1758 0.2564 0.2356 1.0000 1.4590 0.0090 0.0000 0.1918 0.0000 0.5000 0.0989 0.1334
75-GC 0.0000 0.0503 0.3077 0.6282 0.8000 0.3384 0.2932 0.5779 0.8000 0.8665 0.0355 0.0000 0.2610 0.0000 0.8000 0.3384 0.2932
62
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-EN-CLEF2007
Statistics for Precision at the 50% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.4299 0.5588 0.7297 0.8769 0.5226 0.2738 0.2997 0.8769 0.5239 0.1315 0.0001 0.2143 0.0000 0.8769 0.5226 0.2738
52-GC 0.0000 0.0000 0.0000 0.0000 0.0155 0.0016 0.0040 0.0000 0.0155 2.5304 0.0000 0.0000 0.0027 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0348 0.0838 0.1409 0.2540 0.0960 0.0729 0.1061 0.2540 0.7588 0.0235 0.0001 0.0612 0.0000 0.2540 0.0960 0.0729
54-GC 0.0000 0.0000 0.0166 0.0316 0.1333 0.0231 0.0311 0.0316 0.1333 1.3473 0.0012 0.0000 0.0211 0.0000 0.0556 0.0156 0.0163
55-GC 0.0000 0.0110 0.0964 0.2390 0.4286 0.1419 0.1338 0.2280 0.4286 0.9432 0.0194 0.0001 0.1159 0.0000 0.4286 0.1419 0.1338
56-GC 0.0000 0.0000 0.1212 0.2857 0.5714 0.1471 0.1695 0.2857 0.5714 1.1521 0.0097 0.0000 0.1336 0.0000 0.5714 0.1471 0.1695
57-GC 0.0000 0.0497 0.1579 0.2151 0.7273 0.1744 0.1675 0.1654 0.7273 0.9605 0.0309 0.0001 0.1151 0.0000 0.3636 0.1327 0.1027
58-GC 0.0000 0.0084 0.0303 0.0551 0.2308 0.0428 0.0485 0.0467 0.2308 1.1336 0.0124 0.0001 0.0339 0.0000 0.1190 0.0338 0.0316
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0000 0.0000 0.8000 0.8824 0.9412 0.5938 0.3928 0.8824 0.9412 0.6614 0.0380 0.0000 0.3532 0.0000 0.9412 0.5938 0.3928
61-GC 0.0000 0.0161 0.0308 0.0719 0.6316 0.0693 0.1291 0.0558 0.6316 1.8619 0.0113 0.0001 0.0604 0.0000 0.0973 0.0388 0.0291
62-GC 0.0000 0.0031 0.0444 0.1654 0.4000 0.0975 0.1223 0.1623 0.4000 1.2548 0.0074 0.0000 0.0998 0.0000 0.4000 0.0975 0.1223
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0148 0.2500 0.0154 0.0391 0.0148 0.2500 2.5413 0.0002 0.0000 0.0207 0.0000 0.0269 0.0045 0.0079
65-GC 0.0000 0.0513 0.1453 0.4099 0.4615 0.2161 0.1787 0.3586 0.4615 0.8269 0.0311 0.0001 0.1695 0.0000 0.4615 0.2161 0.1787
66-GC 0.0000 0.0000 0.0067 0.0199 0.2222 0.0302 0.0497 0.0199 0.2222 1.6425 0.0025 0.0000 0.0368 0.0000 0.0282 0.0064 0.0065
67-GC 0.0000 0.0083 0.3103 0.3529 0.5500 0.2396 0.1800 0.3447 0.5500 0.7514 0.0204 0.0000 0.1589 0.0000 0.5500 0.2396 0.1800
68-GC 0.0000 0.2627 0.6168 0.7103 0.8333 0.4750 0.2859 0.4476 0.8333 0.6020 0.1141 0.0001 0.2553 0.0000 0.8333 0.4750 0.2859
69-GC 0.0000 0.0000 0.1009 0.1828 0.3750 0.1185 0.1304 0.1828 0.3750 1.1000 0.0039 0.0000 0.1097 0.0000 0.3750 0.1185 0.1304
70-GC 0.0000 0.0000 0.0210 0.0320 0.3191 0.0482 0.0872 0.0320 0.3191 1.8114 0.0021 0.0000 0.0550 0.0000 0.0731 0.0178 0.0194
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.0000 0.0218 0.2500 0.7273 0.7857 0.3725 0.3273 0.7054 0.7857 0.8787 0.0588 0.0001 0.3132 0.0000 0.7857 0.3725 0.3273
73-GC 0.0000 0.0000 0.0198 0.0392 0.4000 0.0556 0.1091 0.0392 0.4000 1.9633 0.0019 0.0000 0.0662 0.0000 0.0769 0.0179 0.0196
74-GC 0.0000 0.0000 0.0714 0.2356 1.0000 0.1758 0.2564 0.2356 1.0000 1.4590 0.0090 0.0000 0.1918 0.0000 0.5000 0.0989 0.1334
75-GC 0.0000 0.0229 0.2353 0.5244 0.7692 0.2931 0.2659 0.5015 0.7692 0.9071 0.0306 0.0000 0.2385 0.0000 0.7692 0.2931 0.2659
63
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-EN-CLEF2007
Statistics for Precision at the 60% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.3487 0.4481 0.6731 0.8625 0.4495 0.2534 0.3244 0.8625 0.5638 0.1140 0.0001 0.2018 0.0000 0.8625 0.4495 0.2534
52-GC 0.0000 0.0000 0.0000 0.0000 0.0079 0.0001 0.0011 0.0000 0.0079 7.2801 0.0000 0.0000 0.0003 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0653 0.1060 0.1970 0.0626 0.0583 0.1060 0.1970 0.9309 0.0030 0.0000 0.0505 0.0000 0.1970 0.0626 0.0583
54-GC 0.0000 0.0000 0.0163 0.0258 0.1333 0.0194 0.0275 0.0258 0.1333 1.4193 0.0009 0.0000 0.0182 0.0000 0.0515 0.0129 0.0142
55-GC 0.0000 0.0000 0.0870 0.2275 0.3846 0.1237 0.1231 0.2275 0.3846 0.9953 0.0102 0.0000 0.1049 0.0000 0.3846 0.1237 0.1231
56-GC 0.0000 0.0000 0.0877 0.1515 0.5000 0.1137 0.1292 0.1515 0.5000 1.1363 0.0048 0.0000 0.1045 0.0000 0.3571 0.0939 0.1026
57-GC 0.0000 0.0364 0.1579 0.1765 0.4762 0.1392 0.1207 0.1400 0.4762 0.8668 0.0193 0.0000 0.0936 0.0000 0.3636 0.1261 0.1023
58-GC 0.0000 0.0053 0.0200 0.0350 0.1667 0.0291 0.0354 0.0297 0.1667 1.2159 0.0043 0.0000 0.0245 0.0000 0.0741 0.0197 0.0189
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0000 0.0000 0.7407 0.8000 0.9130 0.5483 0.3627 0.8000 0.9130 0.6615 0.0311 0.0000 0.3266 0.0000 0.9130 0.5483 0.3627
61-GC 0.0000 0.0000 0.0241 0.0490 0.6087 0.0573 0.1266 0.0490 0.6087 2.2109 0.0024 0.0000 0.0593 0.0000 0.0927 0.0272 0.0253
62-GC 0.0000 0.0000 0.0063 0.0132 0.0690 0.0127 0.0180 0.0132 0.0690 1.4211 0.0010 0.0000 0.0130 0.0000 0.0297 0.0065 0.0078
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0000 0.2500 0.0122 0.0394 0.0000 0.2500 3.2333 0.0000 0.0000 0.0202 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0000 0.1206 0.3789 0.4480 0.1864 0.1750 0.3789 0.4480 0.9389 0.0066 0.0000 0.1640 0.0000 0.4480 0.1864 0.1750
66-GC 0.0000 0.0000 0.0067 0.0199 0.2222 0.0302 0.0497 0.0199 0.2222 1.6425 0.0025 0.0000 0.0368 0.0000 0.0282 0.0064 0.0065
67-GC 0.0000 0.0000 0.2857 0.3529 0.5500 0.2188 0.1654 0.3529 0.5500 0.7560 0.0165 0.0000 0.1462 0.0000 0.5500 0.2188 0.1654
68-GC 0.0000 0.1428 0.5486 0.6992 0.8000 0.4215 0.3050 0.5564 0.8000 0.7235 0.0355 0.0000 0.2832 0.0000 0.8000 0.4215 0.3050
69-GC 0.0000 0.0000 0.0405 0.1643 0.3500 0.1034 0.1191 0.1643 0.3500 1.1519 0.0026 0.0000 0.1030 0.0000 0.3500 0.1034 0.1191
70-GC 0.0000 0.0000 0.0000 0.0238 0.2000 0.0288 0.0528 0.0238 0.2000 1.8332 0.0006 0.0000 0.0338 0.0000 0.0389 0.0094 0.0123
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.0000 0.0127 0.2326 0.6250 0.7857 0.3339 0.3187 0.6123 0.7857 0.9546 0.0306 0.0001 0.2975 0.0000 0.7857 0.3339 0.3187
73-GC 0.0000 0.0000 0.0160 0.0318 0.4000 0.0507 0.1100 0.0318 0.4000 2.1689 0.0014 0.0000 0.0666 0.0000 0.0704 0.0128 0.0156
74-GC 0.0000 0.0000 0.0714 0.2356 1.0000 0.1758 0.2564 0.2356 1.0000 1.4590 0.0090 0.0000 0.1918 0.0000 0.5000 0.0989 0.1334
75-GC 0.0000 0.0161 0.1429 0.4850 0.7059 0.2499 0.2431 0.4689 0.7059 0.9728 0.0256 0.0000 0.2212 0.0000 0.7059 0.2499 0.2431
64
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-EN-CLEF2007
Statistics for Precision at the 70% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.2539 0.3403 0.5926 0.8061 0.3763 0.2314 0.3387 0.8061 0.6149 0.0816 0.0001 0.1935 0.0000 0.8061 0.3763 0.2314
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0000 0.0863 0.1619 0.0464 0.0521 0.0863 0.1619 1.1226 0.0009 0.0000 0.0473 0.0000 0.1619 0.0464 0.0521
54-GC 0.0000 0.0000 0.0163 0.0258 0.1333 0.0194 0.0275 0.0258 0.1333 1.4193 0.0009 0.0000 0.0182 0.0000 0.0515 0.0129 0.0142
55-GC 0.0000 0.0000 0.0558 0.1693 0.3529 0.0952 0.1009 0.1693 0.3529 1.0606 0.0053 0.0000 0.0882 0.0000 0.3529 0.0952 0.1009
56-GC 0.0000 0.0000 0.0455 0.1138 0.3750 0.0665 0.0844 0.1138 0.3750 1.2685 0.0026 0.0000 0.0625 0.0000 0.2500 0.0606 0.0732
57-GC 0.0000 0.0154 0.1140 0.1467 0.3636 0.1046 0.0967 0.1313 0.3636 0.9244 0.0146 0.0000 0.0762 0.0000 0.3333 0.0947 0.0839
58-GC 0.0000 0.0000 0.0063 0.0315 0.1190 0.0171 0.0270 0.0315 0.1190 1.5767 0.0009 0.0000 0.0200 0.0000 0.0649 0.0134 0.0194
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0000 0.0000 0.7059 0.7778 0.9130 0.5184 0.3440 0.7778 0.9130 0.6635 0.0298 0.0000 0.3085 0.0000 0.9130 0.5184 0.3440
61-GC 0.0000 0.0000 0.0171 0.0427 0.5333 0.0442 0.1030 0.0427 0.5333 2.3292 0.0012 0.0000 0.0450 0.0000 0.0606 0.0216 0.0220
62-GC 0.0000 0.0000 0.0063 0.0132 0.0690 0.0127 0.0180 0.0132 0.0690 1.4211 0.0010 0.0000 0.0130 0.0000 0.0297 0.0065 0.0078
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0000 0.2500 0.0115 0.0389 0.0000 0.2500 3.3762 0.0000 0.0000 0.0196 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0000 0.0990 0.2920 0.4161 0.1578 0.1538 0.2920 0.4161 0.9747 0.0043 0.0000 0.1415 0.0000 0.4161 0.1578 0.1538
66-GC 0.0000 0.0000 0.0000 0.0000 0.0714 0.0027 0.0107 0.0000 0.0714 3.9249 0.0000 0.0000 0.0047 0.0000 0.0000 0.0000 0.0000
67-GC 0.0000 0.0000 0.2857 0.3429 0.3824 0.2098 0.1543 0.3429 0.3824 0.7354 0.0124 0.0000 0.1409 0.0000 0.3824 0.2098 0.1543
68-GC 0.0000 0.0714 0.5055 0.6479 0.7931 0.3849 0.3010 0.5765 0.7931 0.7820 0.0313 0.0000 0.2842 0.0000 0.7931 0.3849 0.3010
69-GC 0.0000 0.0000 0.0238 0.1504 0.3333 0.0888 0.1103 0.1504 0.3333 1.2421 0.0017 0.0000 0.0933 0.0000 0.3333 0.0888 0.1103
70-GC 0.0000 0.0000 0.0000 0.0000 0.1765 0.0174 0.0441 0.0000 0.1765 2.5416 0.0001 0.0000 0.0282 0.0000 0.0000 0.0000 0.0000
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.0000 0.0110 0.2222 0.6250 0.7857 0.3099 0.3119 0.6140 0.7857 1.0063 0.0242 0.0000 0.2839 0.0000 0.7857 0.3099 0.3119
73-GC 0.0000 0.0000 0.0160 0.0318 0.4000 0.0507 0.1100 0.0318 0.4000 2.1689 0.0014 0.0000 0.0666 0.0000 0.0704 0.0128 0.0156
74-GC 0.0000 0.0000 0.0051 0.0739 0.5000 0.0761 0.1376 0.0739 0.5000 1.8081 0.0013 0.0000 0.0999 0.0000 0.1500 0.0215 0.0410
75-GC 0.0000 0.0000 0.0862 0.3597 0.6250 0.1842 0.2073 0.3597 0.6250 1.1256 0.0123 0.0000 0.1773 0.0000 0.6250 0.1842 0.2073
65
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-EN-CLEF2007
Statistics for Precision at the 80% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.1903 0.2632 0.4338 0.6815 0.2975 0.1959 0.2435 0.6815 0.6584 0.0558 0.0001 0.1609 0.0000 0.6815 0.2975 0.1959
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0000 0.0586 0.1116 0.0244 0.0372 0.0586 0.1116 1.5234 0.0002 0.0000 0.0332 0.0000 0.1116 0.0244 0.0372
54-GC 0.0000 0.0000 0.0133 0.0166 0.1333 0.0151 0.0245 0.0166 0.1333 1.6192 0.0007 0.0000 0.0144 0.0000 0.0316 0.0091 0.0103
55-GC 0.0000 0.0000 0.0366 0.1607 0.3250 0.0802 0.0868 0.1607 0.3250 1.0825 0.0035 0.0000 0.0764 0.0000 0.3250 0.0802 0.0868
56-GC 0.0000 0.0000 0.0124 0.0236 0.2692 0.0295 0.0540 0.0236 0.2692 1.8292 0.0008 0.0000 0.0361 0.0000 0.0268 0.0073 0.0090
57-GC 0.0000 0.0154 0.0747 0.0918 0.3636 0.0817 0.0840 0.0764 0.3636 1.0285 0.0105 0.0000 0.0570 0.0000 0.1739 0.0600 0.0490
58-GC 0.0000 0.0000 0.0063 0.0315 0.1190 0.0171 0.0270 0.0315 0.1190 1.5767 0.0009 0.0000 0.0200 0.0000 0.0649 0.0134 0.0194
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0000 0.0000 0.6000 0.6490 0.7059 0.4300 0.2910 0.6490 0.7059 0.6767 0.0260 0.0000 0.2660 0.0000 0.7059 0.4300 0.2910
61-GC 0.0000 0.0000 0.0000 0.0263 0.1782 0.0204 0.0403 0.0263 0.1782 1.9746 0.0003 0.0000 0.0239 0.0000 0.0390 0.0113 0.0148
62-GC 0.0000 0.0000 0.0000 0.0101 0.0690 0.0092 0.0167 0.0101 0.0690 1.8098 0.0002 0.0000 0.0117 0.0000 0.0149 0.0026 0.0046
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0000 0.0933 0.0059 0.0183 0.0000 0.0933 3.0767 0.0000 0.0000 0.0105 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0000 0.0762 0.2020 0.3363 0.1105 0.1210 0.2020 0.3363 1.0949 0.0016 0.0000 0.1097 0.0000 0.3363 0.1105 0.1210
66-GC 0.0000 0.0000 0.0000 0.0000 0.0714 0.0027 0.0107 0.0000 0.0714 3.9249 0.0000 0.0000 0.0047 0.0000 0.0000 0.0000 0.0000
67-GC 0.0000 0.0000 0.2642 0.2932 0.3784 0.1896 0.1405 0.2932 0.3784 0.7407 0.0116 0.0000 0.1292 0.0000 0.3784 0.1896 0.1405
68-GC 0.0000 0.0000 0.2246 0.5676 0.6667 0.3060 0.2794 0.5676 0.6667 0.9130 0.0078 0.0000 0.2640 0.0000 0.6667 0.3060 0.2794
69-GC 0.0000 0.0000 0.0000 0.1308 0.2742 0.0701 0.0950 0.1308 0.2742 1.3549 0.0008 0.0000 0.0789 0.0000 0.2742 0.0701 0.0950
70-GC 0.0000 0.0000 0.0000 0.0000 0.0686 0.0087 0.0212 0.0000 0.0686 2.4385 0.0000 0.0000 0.0147 0.0000 0.0000 0.0000 0.0000
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.0000 0.0000 0.0591 0.2904 0.3871 0.1325 0.1478 0.2904 0.3871 1.1152 0.0030 0.0000 0.1346 0.0000 0.3871 0.1325 0.1478
73-GC 0.0000 0.0000 0.0106 0.0186 0.4000 0.0466 0.1071 0.0186 0.4000 2.2972 0.0011 0.0000 0.0653 0.0000 0.0347 0.0082 0.0090
74-GC 0.0000 0.0000 0.0051 0.0739 0.5000 0.0761 0.1376 0.0739 0.5000 1.8081 0.0013 0.0000 0.0999 0.0000 0.1500 0.0215 0.0410
75-GC 0.0000 0.0000 0.0397 0.1060 0.5714 0.1039 0.1549 0.1060 0.5714 1.4913 0.0026 0.0000 0.1202 0.0000 0.2388 0.0314 0.0464
66
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-EN-CLEF2007
Statistics for Precision at the 90% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.1561 0.2730 0.4903 0.1653 0.1502 0.2730 0.4903 0.9084 0.0088 0.0000 0.1206 0.0000 0.4903 0.1653 0.1502
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0000 0.0000 0.0891 0.0029 0.0148 0.0000 0.0891 5.1785 0.0000 0.0000 0.0055 0.0000 0.0000 0.0000 0.0000
54-GC 0.0000 0.0000 0.0000 0.0130 0.0583 0.0081 0.0119 0.0130 0.0583 1.4668 0.0003 0.0000 0.0085 0.0000 0.0216 0.0059 0.0074
55-GC 0.0000 0.0000 0.0000 0.0897 0.2174 0.0515 0.0747 0.0897 0.2174 1.4497 0.0006 0.0000 0.0624 0.0000 0.2174 0.0515 0.0747
56-GC 0.0000 0.0000 0.0000 0.0000 0.1633 0.0032 0.0224 0.0000 0.1633 6.9291 0.0000 0.0000 0.0062 0.0000 0.0000 0.0000 0.0000
57-GC 0.0000 0.0000 0.0210 0.0694 0.3333 0.0459 0.0651 0.0694 0.3333 1.4202 0.0009 0.0000 0.0473 0.0000 0.1628 0.0340 0.0414
58-GC 0.0000 0.0000 0.0000 0.0000 0.0588 0.0081 0.0168 0.0000 0.0588 2.0722 0.0001 0.0000 0.0126 0.0000 0.0000 0.0000 0.0000
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0000 0.0000 0.0570 0.3803 0.6279 0.1727 0.2238 0.3803 0.6279 1.2960 0.0032 0.0000 0.1963 0.0000 0.6279 0.1727 0.2238
61-GC 0.0000 0.0000 0.0000 0.0000 0.0692 0.0061 0.0136 0.0000 0.0692 2.2213 0.0001 0.0000 0.0097 0.0000 0.0000 0.0000 0.0000
62-GC 0.0000 0.0000 0.0000 0.0101 0.0690 0.0092 0.0167 0.0101 0.0690 1.8098 0.0002 0.0000 0.0117 0.0000 0.0149 0.0026 0.0046
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0000 0.0237 0.0004 0.0033 0.0000 0.0237 7.2801 0.0000 0.0000 0.0009 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0000 0.0000 0.0974 0.2809 0.0537 0.0905 0.0974 0.2809 1.6855 0.0002 0.0000 0.0729 0.0000 0.1484 0.0261 0.0488
66-GC 0.0000 0.0000 0.0000 0.0000 0.0714 0.0027 0.0107 0.0000 0.0714 3.9249 0.0000 0.0000 0.0047 0.0000 0.0000 0.0000 0.0000
67-GC 0.0000 0.0000 0.2192 0.2425 0.2963 0.1537 0.1153 0.2425 0.2963 0.7499 0.0100 0.0000 0.1062 0.0000 0.2963 0.1537 0.1153
68-GC 0.0000 0.0000 0.2198 0.4538 0.5244 0.2287 0.2114 0.4538 0.5244 0.9243 0.0056 0.0000 0.1943 0.0000 0.5244 0.2287 0.2114
69-GC 0.0000 0.0000 0.0000 0.0712 0.1667 0.0275 0.0471 0.0712 0.1667 1.7114 0.0001 0.0000 0.0395 0.0000 0.1667 0.0275 0.0471
70-GC 0.0000 0.0000 0.0000 0.0000 0.0457 0.0023 0.0097 0.0000 0.0457 4.1700 0.0000 0.0000 0.0044 0.0000 0.0000 0.0000 0.0000
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.0000 0.0000 0.0311 0.1296 0.2241 0.0632 0.0692 0.1296 0.2241 1.0953 0.0018 0.0000 0.0624 0.0000 0.2241 0.0632 0.0692
73-GC 0.0000 0.0000 0.0085 0.0146 0.2692 0.0208 0.0529 0.0146 0.2692 2.5408 0.0008 0.0000 0.0242 0.0000 0.0244 0.0078 0.0079
74-GC 0.0000 0.0000 0.0051 0.0739 0.5000 0.0761 0.1376 0.0739 0.5000 1.8081 0.0013 0.0000 0.0999 0.0000 0.1500 0.0215 0.0410
75-GC 0.0000 0.0000 0.0000 0.0000 0.2093 0.0146 0.0380 0.0000 0.2093 2.6078 0.0001 0.0000 0.0237 0.0000 0.0000 0.0000 0.0000
67
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-EN-CLEF2007
Statistics for Precision at the 100% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0000 0.0000 0.2040 0.0241 0.0587 0.0000 0.2040 2.4384 0.0000 0.0000 0.0409 0.0000 0.0000 0.0000 0.0000
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
54-GC 0.0000 0.0000 0.0000 0.0130 0.0583 0.0081 0.0119 0.0130 0.0583 1.4668 0.0003 0.0000 0.0085 0.0000 0.0216 0.0059 0.0074
55-GC 0.0000 0.0000 0.0000 0.0278 0.1905 0.0244 0.0473 0.0278 0.1905 1.9407 0.0001 0.0000 0.0344 0.0000 0.0625 0.0056 0.0144
56-GC 0.0000 0.0000 0.0000 0.0000 0.1633 0.0032 0.0224 0.0000 0.1633 6.9291 0.0000 0.0000 0.0062 0.0000 0.0000 0.0000 0.0000
57-GC 0.0000 0.0000 0.0000 0.0655 0.1923 0.0331 0.0462 0.0655 0.1923 1.3984 0.0005 0.0000 0.0374 0.0000 0.1351 0.0274 0.0365
58-GC 0.0000 0.0000 0.0000 0.0000 0.0588 0.0081 0.0168 0.0000 0.0588 2.0722 0.0001 0.0000 0.0126 0.0000 0.0000 0.0000 0.0000
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0000 0.0000 0.0000 0.0000 0.5357 0.0699 0.1701 0.0000 0.5357 2.4322 0.0001 0.0000 0.1161 0.0000 0.0000 0.0000 0.0000
61-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
62-GC 0.0000 0.0000 0.0000 0.0101 0.0690 0.0092 0.0167 0.0101 0.0690 1.8098 0.0002 0.0000 0.0117 0.0000 0.0149 0.0026 0.0046
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
66-GC 0.0000 0.0000 0.0000 0.0000 0.0714 0.0027 0.0107 0.0000 0.0714 3.9249 0.0000 0.0000 0.0047 0.0000 0.0000 0.0000 0.0000
67-GC 0.0000 0.0000 0.1932 0.2394 0.2656 0.1412 0.1069 0.2394 0.2656 0.7568 0.0094 0.0000 0.0984 0.0000 0.2656 0.1412 0.1069
68-GC 0.0000 0.0000 0.0000 0.1643 0.2151 0.0703 0.0889 0.1643 0.2151 1.2641 0.0005 0.0000 0.0849 0.0000 0.2151 0.0703 0.0889
69-GC 0.0000 0.0000 0.0000 0.0000 0.0714 0.0083 0.0198 0.0000 0.0714 2.3811 0.0000 0.0000 0.0138 0.0000 0.0000 0.0000 0.0000
70-GC 0.0000 0.0000 0.0000 0.0000 0.0349 0.0013 0.0067 0.0000 0.0349 5.0983 0.0000 0.0000 0.0025 0.0000 0.0000 0.0000 0.0000
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.0000 0.0000 0.0000 0.0711 0.1094 0.0289 0.0375 0.0711 0.1094 1.2963 0.0004 0.0000 0.0337 0.0000 0.1094 0.0289 0.0375
73-GC 0.0000 0.0000 0.0085 0.0146 0.2692 0.0208 0.0529 0.0146 0.2692 2.5408 0.0008 0.0000 0.0242 0.0000 0.0244 0.0078 0.0079
74-GC 0.0000 0.0000 0.0051 0.0739 0.5000 0.0761 0.1376 0.0739 0.5000 1.8081 0.0013 0.0000 0.0999 0.0000 0.1500 0.0215 0.0410
75-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
68
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-EN-CLEF2007
Statistics for P@5
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.8000 1.0000 1.0000 1.0000 0.7585 0.3624 0.2000 1.0000 0.4778 0.1561 0.0001 0.2831 0.8000 1.0000 0.9415 0.0921
52-GC 0.0000 0.0000 0.0000 0.0000 0.2000 0.0264 0.0684 0.0000 0.2000 2.5880 0.0000 0.0000 0.0459 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.4000 0.6000 0.6000 0.2943 0.2468 0.6000 0.6000 0.8386 0.0095 0.0000 0.2253 0.0000 0.6000 0.2943 0.2468
54-GC 0.0000 0.0000 0.2000 0.2000 0.2000 0.1057 0.1008 0.2000 0.2000 0.9540 0.0019 0.0000 0.0997 0.0000 0.2000 0.1057 0.1008
55-GC 0.0000 0.0000 0.0000 0.2000 0.6000 0.1132 0.1442 0.2000 0.6000 1.2735 0.0010 0.0000 0.1239 0.0000 0.4000 0.1038 0.1283
56-GC 0.0000 0.0000 0.2000 0.2000 0.6000 0.1698 0.1436 0.2000 0.6000 0.8454 0.0093 0.0000 0.1089 0.0000 0.4000 0.1615 0.1316
57-GC 0.0000 0.2000 0.2000 0.4000 0.8000 0.2755 0.2261 0.2000 0.8000 0.8207 0.0421 0.0001 0.1808 0.0000 0.6000 0.2440 0.1908
58-GC 0.0000 0.0000 0.0000 0.2000 0.2000 0.0566 0.0910 0.2000 0.2000 1.6069 0.0002 0.0000 0.0812 0.0000 0.2000 0.0566 0.0910
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0000 0.6000 1.0000 1.0000 1.0000 0.7396 0.3953 0.4000 1.0000 0.5345 0.1029 0.0001 0.3281 0.2000 1.0000 0.9116 0.1815
61-GC 0.0000 0.0000 0.4000 0.4000 1.0000 0.3472 0.3067 0.4000 1.0000 0.8835 0.0176 0.0000 0.2429 0.0000 1.0000 0.3472 0.3067
62-GC 0.0000 0.0000 0.0000 0.2000 0.4000 0.0981 0.1152 0.2000 0.4000 1.1739 0.0009 0.0000 0.1074 0.0000 0.4000 0.0981 0.1152
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0000 0.4000 0.0264 0.0880 0.0000 0.4000 3.3328 0.0000 0.0000 0.0478 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.2000 0.4000 0.6000 0.8000 0.3623 0.2830 0.4000 0.8000 0.7812 0.0368 0.0000 0.2498 0.0000 0.8000 0.3623 0.2830
66-GC 0.0000 0.0000 0.2000 0.2000 0.2000 0.1094 0.1005 0.2000 0.2000 0.9184 0.0023 0.0000 0.0991 0.0000 0.2000 0.1094 0.1005
67-GC 0.0000 0.2000 0.4000 0.4000 0.8000 0.3434 0.2162 0.2000 0.8000 0.6295 0.0756 0.0001 0.1686 0.0000 0.6000 0.3061 0.1784
68-GC 0.0000 0.8000 0.8000 1.0000 1.0000 0.7925 0.2147 0.2000 1.0000 0.2709 0.5282 0.0003 0.1327 0.6000 1.0000 0.8320 0.1362
69-GC 0.0000 0.0000 0.0000 0.2000 0.6000 0.1094 0.1548 0.2000 0.6000 1.4141 0.0007 0.0000 0.1280 0.0000 0.4000 0.0902 0.1221
70-GC 0.0000 0.0000 0.0000 0.0000 0.6000 0.0868 0.1861 0.0000 0.6000 2.1441 0.0001 0.0000 0.1376 0.0000 0.0000 0.0000 0.0000
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.0000 0.3500 0.6000 0.8000 1.0000 0.5094 0.3103 0.4500 1.0000 0.6090 0.0738 0.0001 0.2644 0.0000 1.0000 0.5094 0.3103
73-GC 0.0000 0.0000 0.0000 0.0000 0.2000 0.0189 0.0590 0.0000 0.2000 3.1280 0.0000 0.0000 0.0342 0.0000 0.0000 0.0000 0.0000
74-GC 0.0000 0.0000 0.2000 0.2000 0.4000 0.1585 0.1434 0.2000 0.4000 0.9045 0.0054 0.0000 0.1196 0.0000 0.4000 0.1585 0.1434
75-GC 0.0000 0.2000 0.6000 0.8000 1.0000 0.4868 0.3126 0.6000 1.0000 0.6421 0.0586 0.0000 0.2716 0.0000 1.0000 0.4868 0.3126
69
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-EN-CLEF2007
Statistics for P@10
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.6750 0.9000 0.9000 1.0000 0.7396 0.3284 0.2250 1.0000 0.4440 0.2196 0.0001 0.2549 0.4000 1.0000 0.8644 0.1448
52-GC 0.0000 0.0000 0.0000 0.1000 0.1000 0.0321 0.0471 0.1000 0.1000 1.4691 0.0002 0.0000 0.0436 0.0000 0.1000 0.0321 0.0471
53-GC 0.0000 0.1000 0.3000 0.5000 0.5000 0.2660 0.1961 0.4000 0.5000 0.7370 0.0290 0.0000 0.1731 0.0000 0.5000 0.2660 0.1961
54-GC 0.0000 0.0000 0.1000 0.1000 0.2000 0.0792 0.0689 0.1000 0.2000 0.8700 0.0041 0.0000 0.0568 0.0000 0.2000 0.0792 0.0689
55-GC 0.0000 0.0000 0.1000 0.2000 0.4000 0.1170 0.1252 0.2000 0.4000 1.0700 0.0022 0.0000 0.1111 0.0000 0.4000 0.1170 0.1252
56-GC 0.0000 0.0000 0.2000 0.2000 0.5000 0.1547 0.1309 0.2000 0.5000 0.8462 0.0087 0.0000 0.1075 0.0000 0.5000 0.1547 0.1309
57-GC 0.0000 0.1000 0.2000 0.3250 0.7000 0.2472 0.1908 0.2250 0.7000 0.7717 0.0531 0.0001 0.1533 0.0000 0.6000 0.2294 0.1712
58-GC 0.0000 0.0000 0.0000 0.1000 0.2000 0.0472 0.0668 0.1000 0.2000 1.4163 0.0003 0.0000 0.0587 0.0000 0.2000 0.0472 0.0668
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0000 0.4000 0.9000 0.9000 1.0000 0.6811 0.3726 0.5000 1.0000 0.5471 0.0960 0.0001 0.3169 0.0000 1.0000 0.6811 0.3726
61-GC 0.0000 0.0000 0.2000 0.3000 0.7000 0.2453 0.2053 0.3000 0.7000 0.8369 0.0195 0.0000 0.1631 0.0000 0.7000 0.2453 0.2053
62-GC 0.0000 0.0000 0.1000 0.1250 0.2000 0.0849 0.0794 0.1250 0.2000 0.9353 0.0031 0.0000 0.0673 0.0000 0.2000 0.0849 0.0794
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0250 0.4000 0.0434 0.0971 0.0250 0.4000 2.2373 0.0001 0.0000 0.0655 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.2000 0.3000 0.6000 0.7000 0.3679 0.2268 0.4000 0.7000 0.6165 0.1809 0.0002 0.1939 0.0000 0.7000 0.3679 0.2268
66-GC 0.0000 0.0000 0.1000 0.1000 0.2000 0.0717 0.0495 0.1000 0.2000 0.6908 0.0063 0.0000 0.0433 0.0000 0.2000 0.0717 0.0495
67-GC 0.0000 0.2000 0.4000 0.4000 0.6000 0.3075 0.1730 0.2000 0.6000 0.5626 0.0817 0.0001 0.1499 0.0000 0.6000 0.3075 0.1730
68-GC 0.0000 0.7000 0.8000 0.9000 1.0000 0.7755 0.2009 0.2000 1.0000 0.2590 0.6161 0.0005 0.1399 0.5000 1.0000 0.8140 0.1246
69-GC 0.0000 0.0000 0.1000 0.2000 0.6000 0.1623 0.1746 0.2000 0.6000 1.0758 0.0060 0.0000 0.1398 0.0000 0.5000 0.1451 0.1540
70-GC 0.0000 0.0000 0.0000 0.1000 0.5000 0.0868 0.1606 0.1000 0.5000 1.8501 0.0002 0.0000 0.1179 0.0000 0.2000 0.0244 0.0529
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.0000 0.2750 0.5000 0.7000 0.7000 0.4358 0.2646 0.4250 0.7000 0.6072 0.0759 0.0001 0.2311 0.0000 0.7000 0.4358 0.2646
73-GC 0.0000 0.0000 0.0000 0.1000 0.3000 0.0453 0.0867 0.1000 0.3000 1.9157 0.0001 0.0000 0.0649 0.0000 0.2000 0.0245 0.0480
74-GC 0.0000 0.0000 0.1000 0.2000 0.3000 0.1132 0.0962 0.2000 0.3000 0.8493 0.0082 0.0000 0.0778 0.0000 0.3000 0.1132 0.0962
75-GC 0.0000 0.2500 0.4000 0.6000 0.8000 0.4038 0.2579 0.3500 0.8000 0.6388 0.0505 0.0000 0.2078 0.0000 0.8000 0.4038 0.2579
70
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-EN-CLEF2007
Statistics for P@15
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.6500 0.8667 0.9333 1.0000 0.7170 0.3239 0.2833 1.0000 0.4518 0.2119 0.0001 0.2530 0.2667 1.0000 0.8246 0.1774
52-GC 0.0000 0.0000 0.0000 0.0667 0.0667 0.0214 0.0314 0.0667 0.0667 1.4691 0.0002 0.0000 0.0290 0.0000 0.0667 0.0214 0.0314
53-GC 0.0000 0.1333 0.2667 0.4000 0.4667 0.2428 0.1491 0.2667 0.4667 0.6143 0.0754 0.0001 0.1275 0.0000 0.4667 0.2428 0.1491
54-GC 0.0000 0.0000 0.0667 0.1333 0.1333 0.0717 0.0582 0.1333 0.1333 0.8124 0.0045 0.0000 0.0512 0.0000 0.1333 0.0717 0.0582
55-GC 0.0000 0.0000 0.1333 0.2667 0.4000 0.1434 0.1290 0.2667 0.4000 0.8998 0.0079 0.0000 0.1099 0.0000 0.4000 0.1434 0.1290
56-GC 0.0000 0.0000 0.1333 0.2667 0.3333 0.1283 0.1116 0.2667 0.3333 0.8698 0.0087 0.0000 0.0891 0.0000 0.3333 0.1283 0.1116
57-GC 0.0000 0.0667 0.2667 0.3333 0.5333 0.2201 0.1483 0.2667 0.5333 0.6735 0.0490 0.0001 0.1246 0.0000 0.5333 0.2201 0.1483
58-GC 0.0000 0.0000 0.0000 0.0667 0.2000 0.0390 0.0514 0.0667 0.2000 1.3172 0.0005 0.0000 0.0441 0.0000 0.1333 0.0359 0.0466
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0000 0.3333 0.8000 0.8667 0.9333 0.6302 0.3488 0.5333 0.9333 0.5534 0.0897 0.0001 0.3000 0.0000 0.9333 0.6302 0.3488
61-GC 0.0000 0.0667 0.2000 0.2667 0.5333 0.1887 0.1546 0.2000 0.5333 0.8191 0.0259 0.0000 0.1180 0.0000 0.5333 0.1887 0.1546
62-GC 0.0000 0.0000 0.0667 0.1333 0.1333 0.0604 0.0543 0.1333 0.1333 0.8997 0.0029 0.0000 0.0456 0.0000 0.1333 0.0604 0.0543
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0667 0.2667 0.0440 0.0750 0.0667 0.2667 1.7045 0.0002 0.0000 0.0581 0.0000 0.1333 0.0272 0.0470
65-GC 0.0000 0.2500 0.4000 0.5333 0.8000 0.3836 0.2096 0.2833 0.8000 0.5462 0.2685 0.0005 0.1752 0.0000 0.8000 0.3836 0.2096
66-GC 0.0000 0.0000 0.0667 0.0667 0.1333 0.0503 0.0368 0.0667 0.1333 0.7306 0.0049 0.0000 0.0304 0.0000 0.1333 0.0503 0.0368
67-GC 0.0000 0.1333 0.3333 0.4000 0.4667 0.2730 0.1521 0.2667 0.4667 0.5571 0.0731 0.0001 0.1310 0.0000 0.4667 0.2730 0.1521
68-GC 0.0000 0.7333 0.8000 0.8667 1.0000 0.7635 0.1791 0.1333 1.0000 0.2345 0.6121 0.0005 0.1049 0.7333 1.0000 0.8139 0.0687
69-GC 0.0000 0.0000 0.1333 0.2167 0.5333 0.1509 0.1492 0.2167 0.5333 0.9882 0.0059 0.0000 0.1194 0.0000 0.5333 0.1509 0.1492
70-GC 0.0000 0.0000 0.0000 0.0833 0.4667 0.0830 0.1294 0.0833 0.4667 1.5583 0.0008 0.0000 0.0976 0.0000 0.2000 0.0341 0.0544
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.0000 0.2000 0.3333 0.6000 0.7333 0.3849 0.2469 0.4000 0.7333 0.6415 0.0679 0.0001 0.2186 0.0000 0.7333 0.3849 0.2469
73-GC 0.0000 0.0000 0.0000 0.0667 0.4000 0.0465 0.1034 0.0667 0.4000 2.2224 0.0001 0.0000 0.0667 0.0000 0.1333 0.0153 0.0315
74-GC 0.0000 0.0000 0.0667 0.1333 0.2000 0.0780 0.0676 0.1333 0.2000 0.8669 0.0062 0.0000 0.0552 0.0000 0.2000 0.0780 0.0676
75-GC 0.0000 0.1667 0.4000 0.5500 0.7333 0.3472 0.2325 0.3833 0.7333 0.6698 0.0439 0.0000 0.1911 0.0000 0.7333 0.3472 0.2325
71
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-EN-CLEF2007
Statistics for P@20
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.6000 0.8000 0.9125 1.0000 0.6972 0.3157 0.3125 1.0000 0.4528 0.2059 0.0001 0.2419 0.2500 1.0000 0.8022 0.1725
52-GC 0.0000 0.0000 0.0000 0.0500 0.1000 0.0217 0.0333 0.0500 0.1000 1.5332 0.0002 0.0000 0.0287 0.0000 0.1000 0.0217 0.0333
53-GC 0.0000 0.1500 0.2000 0.3500 0.5000 0.2321 0.1341 0.2000 0.5000 0.5779 0.0747 0.0001 0.1157 0.0000 0.5000 0.2321 0.1341
54-GC 0.0000 0.0000 0.0500 0.1000 0.1500 0.0585 0.0488 0.1000 0.1500 0.8338 0.0039 0.0000 0.0433 0.0000 0.1500 0.0585 0.0488
55-GC 0.0000 0.0000 0.1500 0.2500 0.4000 0.1481 0.1232 0.2500 0.4000 0.8321 0.0098 0.0000 0.1023 0.0000 0.4000 0.1481 0.1232
56-GC 0.0000 0.0000 0.1000 0.2000 0.3000 0.1047 0.0926 0.2000 0.3000 0.8847 0.0076 0.0000 0.0728 0.0000 0.3000 0.1047 0.0926
57-GC 0.0000 0.1000 0.2000 0.2500 0.4500 0.1858 0.1242 0.1500 0.4500 0.6682 0.0431 0.0001 0.0982 0.0000 0.4500 0.1858 0.1242
58-GC 0.0000 0.0000 0.0500 0.0500 0.1500 0.0396 0.0442 0.0500 0.1500 1.1166 0.0012 0.0000 0.0359 0.0000 0.1000 0.0330 0.0359
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0000 0.2875 0.7500 0.8000 0.9000 0.5849 0.3312 0.5125 0.9000 0.5662 0.0835 0.0001 0.2909 0.0000 0.9000 0.5849 0.3312
61-GC 0.0000 0.0500 0.1500 0.2125 0.6000 0.1585 0.1447 0.1625 0.6000 0.9129 0.0255 0.0001 0.1040 0.0000 0.4000 0.1340 0.1066
62-GC 0.0000 0.0000 0.0500 0.1000 0.1000 0.0509 0.0386 0.1000 0.1000 0.7576 0.0055 0.0000 0.0296 0.0000 0.1000 0.0509 0.0386
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0500 0.2500 0.0396 0.0646 0.0500 0.2500 1.6296 0.0003 0.0000 0.0493 0.0000 0.1000 0.0202 0.0340
65-GC 0.0000 0.2000 0.4000 0.5125 0.8000 0.3736 0.1812 0.3125 0.8000 0.4851 0.2719 0.0005 0.1543 0.0000 0.8000 0.3736 0.1812
66-GC 0.0000 0.0000 0.0500 0.0500 0.1000 0.0406 0.0311 0.0500 0.1000 0.7666 0.0041 0.0000 0.0245 0.0000 0.1000 0.0406 0.0311
67-GC 0.0000 0.1500 0.3000 0.4000 0.5500 0.2670 0.1513 0.2500 0.5500 0.5666 0.0713 0.0001 0.1222 0.0000 0.5500 0.2670 0.1513
68-GC 0.0000 0.7000 0.7500 0.8000 1.0000 0.7208 0.1804 0.1000 1.0000 0.2503 0.5768 0.0005 0.1130 0.5500 0.9500 0.7576 0.0836
69-GC 0.0000 0.0375 0.1500 0.2000 0.4000 0.1557 0.1216 0.1625 0.4000 0.7809 0.0165 0.0000 0.0972 0.0000 0.4000 0.1557 0.1216
70-GC 0.0000 0.0000 0.0000 0.1000 0.4500 0.0811 0.1283 0.1000 0.4500 1.5815 0.0009 0.0000 0.0963 0.0000 0.2500 0.0469 0.0740
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.0000 0.1875 0.3000 0.5500 0.5500 0.3170 0.2057 0.3625 0.5500 0.6489 0.0574 0.0001 0.1815 0.0000 0.5500 0.3170 0.2057
73-GC 0.0000 0.0000 0.0000 0.0500 0.3000 0.0396 0.0884 0.0500 0.3000 2.2322 0.0001 0.0000 0.0568 0.0000 0.1000 0.0125 0.0263
74-GC 0.0000 0.0000 0.0500 0.1000 0.1500 0.0651 0.0568 0.1000 0.1500 0.8730 0.0054 0.0000 0.0490 0.0000 0.1500 0.0651 0.0568
75-GC 0.0000 0.1250 0.3500 0.5000 0.6500 0.3104 0.2106 0.3750 0.6500 0.6786 0.0465 0.0001 0.1777 0.0000 0.6500 0.3104 0.2106
72
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-EN-CLEF2007
Statistics for P@30
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.6250 0.7333 0.9000 1.0000 0.6585 0.3001 0.2750 1.0000 0.4557 0.1947 0.0001 0.2193 0.2333 1.0000 0.7580 0.1656
52-GC 0.0000 0.0000 0.0000 0.0333 0.0667 0.0170 0.0241 0.0333 0.0667 1.4209 0.0002 0.0000 0.0211 0.0000 0.0667 0.0170 0.0241
53-GC 0.0000 0.1583 0.2000 0.2667 0.4333 0.2069 0.1102 0.1083 0.4333 0.5328 0.0700 0.0001 0.0876 0.0000 0.4000 0.2026 0.1066
54-GC 0.0000 0.0000 0.0667 0.0667 0.1000 0.0440 0.0368 0.0667 0.1000 0.8370 0.0032 0.0000 0.0331 0.0000 0.1000 0.0440 0.0368
55-GC 0.0000 0.0250 0.1667 0.2000 0.3667 0.1384 0.1100 0.1750 0.3667 0.7954 0.0148 0.0000 0.0930 0.0000 0.3667 0.1384 0.1100
56-GC 0.0000 0.0000 0.1000 0.1333 0.2333 0.0912 0.0714 0.1333 0.2333 0.7825 0.0082 0.0000 0.0625 0.0000 0.2333 0.0912 0.0714
57-GC 0.0000 0.1000 0.1667 0.2000 0.3333 0.1528 0.0951 0.1000 0.3333 0.6220 0.0437 0.0001 0.0735 0.0000 0.3333 0.1528 0.0951
58-GC 0.0000 0.0000 0.0333 0.0667 0.1333 0.0346 0.0327 0.0667 0.1333 0.9442 0.0027 0.0000 0.0244 0.0000 0.1333 0.0346 0.0327
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0000 0.1917 0.7000 0.7000 0.7667 0.5094 0.2935 0.5083 0.7667 0.5761 0.0737 0.0001 0.2598 0.0000 0.7667 0.5094 0.2935
61-GC 0.0000 0.0333 0.1000 0.1667 0.5333 0.1270 0.1206 0.1333 0.5333 0.9489 0.0245 0.0001 0.0816 0.0000 0.2667 0.1040 0.0761
62-GC 0.0000 0.0333 0.0333 0.0667 0.0667 0.0421 0.0237 0.0333 0.0667 0.5626 0.0131 0.0001 0.0204 0.0000 0.0667 0.0421 0.0237
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0333 0.0667 0.2000 0.0447 0.0566 0.0667 0.2000 1.2674 0.0009 0.0000 0.0468 0.0000 0.1667 0.0386 0.0482
65-GC 0.0000 0.2000 0.4000 0.4750 0.6000 0.3421 0.1542 0.2750 0.6000 0.4506 0.2519 0.0005 0.1350 0.0000 0.6000 0.3421 0.1542
66-GC 0.0000 0.0000 0.0333 0.0333 0.0667 0.0314 0.0230 0.0333 0.0667 0.7325 0.0045 0.0000 0.0166 0.0000 0.0667 0.0314 0.0230
67-GC 0.0000 0.2000 0.2667 0.3333 0.3667 0.2365 0.1213 0.1333 0.3667 0.5129 0.0648 0.0001 0.0944 0.0000 0.3667 0.2365 0.1213
68-GC 0.0000 0.6667 0.7000 0.8000 0.9333 0.6642 0.1948 0.1333 0.9333 0.2933 0.5210 0.0005 0.1297 0.6000 0.9333 0.7363 0.0803
69-GC 0.0000 0.0250 0.1667 0.2333 0.3667 0.1484 0.1085 0.2083 0.3667 0.7311 0.0162 0.0000 0.0903 0.0000 0.3667 0.1484 0.1085
70-GC 0.0000 0.0000 0.0333 0.1000 0.4000 0.0824 0.1111 0.1000 0.4000 1.3479 0.0052 0.0000 0.0823 0.0000 0.2333 0.0528 0.0637
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.0000 0.1333 0.2000 0.3667 0.3667 0.2245 0.1404 0.2333 0.3667 0.6252 0.0440 0.0001 0.1269 0.0000 0.3667 0.2245 0.1404
73-GC 0.0000 0.0000 0.0333 0.0333 0.2333 0.0377 0.0606 0.0333 0.2333 1.6069 0.0012 0.0000 0.0364 0.0000 0.0667 0.0194 0.0204
74-GC 0.0000 0.0000 0.0667 0.0750 0.1000 0.0484 0.0390 0.0750 0.1000 0.8050 0.0045 0.0000 0.0349 0.0000 0.1000 0.0484 0.0390
75-GC 0.0000 0.1000 0.2667 0.4083 0.5333 0.2610 0.1776 0.3083 0.5333 0.6803 0.0475 0.0001 0.1523 0.0000 0.5333 0.2610 0.1776
73
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-EN-CLEF2007
Statistics for P@100
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.4800 0.5500 0.6600 0.7900 0.5032 0.2283 0.1800 0.7900 0.4536 0.1763 0.0001 0.1669 0.3100 0.7900 0.5884 0.1092
52-GC 0.0000 0.0000 0.0100 0.0200 0.0500 0.0117 0.0142 0.0200 0.0500 1.2174 0.0005 0.0000 0.0114 0.0000 0.0200 0.0086 0.0094
53-GC 0.0000 0.0900 0.1400 0.1900 0.2700 0.1436 0.0712 0.1000 0.2700 0.4959 0.0922 0.0003 0.0599 0.0000 0.2700 0.1436 0.0712
54-GC 0.0000 0.0075 0.0200 0.0300 0.0600 0.0206 0.0173 0.0225 0.0600 0.8390 0.0035 0.0000 0.0138 0.0000 0.0600 0.0206 0.0173
55-GC 0.0000 0.0300 0.0800 0.1325 0.1600 0.0821 0.0561 0.1025 0.1600 0.6840 0.0228 0.0001 0.0497 0.0000 0.1600 0.0821 0.0561
56-GC 0.0000 0.0075 0.0500 0.0600 0.0800 0.0387 0.0274 0.0525 0.0800 0.7081 0.0059 0.0000 0.0252 0.0000 0.0800 0.0387 0.0274
57-GC 0.0000 0.0675 0.1000 0.1100 0.1500 0.0845 0.0435 0.0425 0.1500 0.5144 0.0304 0.0001 0.0351 0.0100 0.1500 0.0953 0.0330
58-GC 0.0000 0.0100 0.0200 0.0300 0.0500 0.0232 0.0150 0.0200 0.0500 0.6479 0.0075 0.0001 0.0122 0.0000 0.0500 0.0232 0.0150
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0000 0.0975 0.2400 0.2700 0.3000 0.1987 0.1015 0.1725 0.3000 0.5111 0.0766 0.0001 0.0886 0.0000 0.3000 0.1987 0.1015
61-GC 0.0000 0.0400 0.0700 0.0800 0.1700 0.0626 0.0372 0.0400 0.1700 0.5941 0.0444 0.0005 0.0278 0.0000 0.0900 0.0562 0.0269
62-GC 0.0000 0.0100 0.0200 0.0200 0.0400 0.0168 0.0092 0.0100 0.0400 0.5450 0.0106 0.0002 0.0073 0.0000 0.0300 0.0154 0.0073
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0100 0.0300 0.0500 0.1300 0.0306 0.0257 0.0400 0.1300 0.8400 0.0054 0.0000 0.0199 0.0000 0.0800 0.0287 0.0218
65-GC 0.0100 0.1400 0.2400 0.4125 0.4600 0.2736 0.1442 0.2725 0.4500 0.5271 0.2189 0.1305 0.1331 0.0100 0.4600 0.2736 0.1442
66-GC 0.0000 0.0100 0.0100 0.0125 0.0300 0.0104 0.0073 0.0025 0.0300 0.7062 0.0025 0.0000 0.0051 0.0100 0.0100 0.0100 0.0000
67-GC 0.0000 0.0700 0.1700 0.1700 0.1700 0.1217 0.0675 0.1000 0.1700 0.5549 0.0346 0.0001 0.0600 0.0000 0.1700 0.1217 0.0675
68-GC 0.0000 0.4400 0.6400 0.6900 0.8000 0.5402 0.2114 0.2500 0.8000 0.3914 0.4018 0.0005 0.1730 0.0800 0.8000 0.5506 0.1993
69-GC 0.0000 0.0100 0.1000 0.1400 0.1800 0.0902 0.0648 0.1300 0.1800 0.7184 0.0141 0.0000 0.0572 0.0000 0.1800 0.0902 0.0648
70-GC 0.0000 0.0200 0.0500 0.0825 0.2000 0.0592 0.0538 0.0625 0.2000 0.9077 0.0188 0.0001 0.0414 0.0000 0.1600 0.0486 0.0398
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.0000 0.0500 0.1000 0.1225 0.1300 0.0843 0.0458 0.0725 0.1300 0.5431 0.0396 0.0001 0.0410 0.0000 0.1300 0.0843 0.0458
73-GC 0.0000 0.0000 0.0200 0.0300 0.0700 0.0221 0.0217 0.0300 0.0700 0.9827 0.0024 0.0000 0.0175 0.0000 0.0700 0.0221 0.0217
74-GC 0.0000 0.0100 0.0200 0.0300 0.0300 0.0168 0.0116 0.0200 0.0300 0.6887 0.0036 0.0000 0.0102 0.0000 0.0300 0.0168 0.0116
75-GC 0.0000 0.0600 0.1200 0.1500 0.1800 0.1015 0.0584 0.0900 0.1800 0.5755 0.0269 0.0001 0.0503 0.0000 0.1800 0.1015 0.0584
74
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-EN-CLEF2007
Statistics for P@200
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.3400 0.3700 0.4425 0.4950 0.3407 0.1521 0.1025 0.4950 0.4465 0.1414 0.0001 0.1105 0.1900 0.4950 0.4023 0.0655
52-GC 0.0000 0.0037 0.0050 0.0100 0.0250 0.0076 0.0067 0.0062 0.0250 0.8760 0.0017 0.0000 0.0051 0.0000 0.0150 0.0062 0.0046
53-GC 0.0050 0.0700 0.1050 0.1462 0.1950 0.1104 0.0491 0.0762 0.1900 0.4445 0.0937 0.0608 0.0419 0.0050 0.1950 0.1104 0.0491
54-GC 0.0000 0.0050 0.0150 0.0250 0.0350 0.0154 0.0108 0.0200 0.0350 0.7010 0.0050 0.0001 0.0094 0.0000 0.0350 0.0154 0.0108
55-GC 0.0000 0.0150 0.0550 0.0750 0.0800 0.0475 0.0285 0.0600 0.0800 0.6016 0.0212 0.0001 0.0252 0.0000 0.0800 0.0475 0.0285
56-GC 0.0000 0.0087 0.0300 0.0300 0.0400 0.0210 0.0134 0.0212 0.0400 0.6346 0.0054 0.0001 0.0118 0.0000 0.0400 0.0210 0.0134
57-GC 0.0000 0.0400 0.0600 0.0650 0.0750 0.0497 0.0245 0.0250 0.0750 0.4932 0.0192 0.0001 0.0200 0.0050 0.0750 0.0561 0.0178
58-GC 0.0000 0.0100 0.0200 0.0250 0.0300 0.0162 0.0090 0.0150 0.0300 0.5535 0.0088 0.0001 0.0076 0.0000 0.0300 0.0162 0.0090
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0000 0.0587 0.1250 0.1350 0.1500 0.1033 0.0494 0.0763 0.1500 0.4783 0.0687 0.0005 0.0422 0.0000 0.1500 0.1033 0.0494
61-GC 0.0000 0.0300 0.0450 0.0600 0.0950 0.0457 0.0206 0.0300 0.0950 0.4515 0.0360 0.0005 0.0164 0.0000 0.0950 0.0457 0.0206
62-GC 0.0000 0.0050 0.0100 0.0100 0.0200 0.0100 0.0055 0.0050 0.0200 0.5547 0.0064 0.0002 0.0038 0.0000 0.0150 0.0080 0.0035
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0050 0.0250 0.0300 0.0750 0.0227 0.0191 0.0250 0.0750 0.8380 0.0047 0.0000 0.0145 0.0000 0.0650 0.0217 0.0178
65-GC 0.0100 0.0950 0.1700 0.3200 0.3650 0.2061 0.1127 0.2250 0.3550 0.5469 0.1653 0.1059 0.1051 0.0100 0.3650 0.2061 0.1127
66-GC 0.0000 0.0050 0.0050 0.0100 0.0150 0.0069 0.0043 0.0050 0.0150 0.6243 0.0025 0.0001 0.0037 0.0000 0.0150 0.0069 0.0043
67-GC 0.0000 0.0350 0.0850 0.0850 0.0850 0.0615 0.0341 0.0500 0.0850 0.5549 0.0191 0.0001 0.0305 0.0000 0.0850 0.0615 0.0341
68-GC 0.0000 0.2988 0.4650 0.5400 0.5750 0.4024 0.1707 0.2413 0.5750 0.4243 0.2919 0.0005 0.1454 0.0000 0.5750 0.4024 0.1707
69-GC 0.0000 0.0125 0.0550 0.0900 0.1000 0.0521 0.0370 0.0775 0.1000 0.7102 0.0103 0.0001 0.0331 0.0000 0.1000 0.0521 0.0370
70-GC 0.0000 0.0187 0.0350 0.0600 0.1100 0.0403 0.0296 0.0412 0.1100 0.7353 0.0232 0.0003 0.0228 0.0000 0.1100 0.0403 0.0296
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.0000 0.0250 0.0550 0.0700 0.0700 0.0457 0.0250 0.0450 0.0700 0.5475 0.0223 0.0001 0.0226 0.0000 0.0700 0.0457 0.0250
73-GC 0.0000 0.0050 0.0150 0.0250 0.0350 0.0147 0.0117 0.0200 0.0350 0.7979 0.0030 0.0000 0.0105 0.0000 0.0350 0.0147 0.0117
74-GC 0.0000 0.0050 0.0100 0.0150 0.0150 0.0093 0.0060 0.0100 0.0150 0.6475 0.0023 0.0000 0.0052 0.0000 0.0150 0.0093 0.0060
75-GC 0.0000 0.0375 0.0750 0.0800 0.0900 0.0583 0.0294 0.0425 0.0900 0.5043 0.0306 0.0002 0.0245 0.0000 0.0900 0.0583 0.0294
75
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-EN-CLEF2007
Statistics for P@500
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0020 0.1820 0.1920 0.2120 0.2220 0.1689 0.0680 0.0300 0.2200 0.4029 0.1147 0.0201 0.0483 0.1620 0.2220 0.1979 0.0144
52-GC 0.0000 0.0020 0.0040 0.0060 0.0120 0.0048 0.0030 0.0040 0.0120 0.6295 0.0028 0.0001 0.0023 0.0000 0.0100 0.0045 0.0027
53-GC 0.0060 0.0460 0.0740 0.0870 0.1060 0.0672 0.0264 0.0410 0.1000 0.3923 0.0586 0.0419 0.0220 0.0060 0.1060 0.0672 0.0264
54-GC 0.0000 0.0040 0.0120 0.0120 0.0140 0.0082 0.0054 0.0080 0.0140 0.6572 0.0030 0.0001 0.0051 0.0000 0.0140 0.0082 0.0054
55-GC 0.0000 0.0140 0.0260 0.0300 0.0320 0.0220 0.0102 0.0160 0.0320 0.4633 0.0135 0.0002 0.0087 0.0000 0.0320 0.0220 0.0102
56-GC 0.0000 0.0040 0.0120 0.0140 0.0160 0.0094 0.0051 0.0100 0.0160 0.5379 0.0047 0.0001 0.0044 0.0000 0.0160 0.0094 0.0051
57-GC 0.0000 0.0200 0.0260 0.0300 0.0300 0.0225 0.0103 0.0100 0.0300 0.4584 0.0098 0.0001 0.0081 0.0100 0.0300 0.0264 0.0049
58-GC 0.0000 0.0060 0.0080 0.0100 0.0120 0.0079 0.0031 0.0040 0.0120 0.3960 0.0059 0.0003 0.0023 0.0020 0.0120 0.0082 0.0027
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0040 0.0260 0.0540 0.0545 0.0600 0.0430 0.0194 0.0285 0.0560 0.4504 0.0350 0.0234 0.0167 0.0040 0.0600 0.0430 0.0194
61-GC 0.0000 0.0195 0.0260 0.0340 0.0400 0.0261 0.0090 0.0145 0.0400 0.3436 0.0217 0.0005 0.0077 0.0000 0.0400 0.0261 0.0090
62-GC 0.0000 0.0035 0.0040 0.0080 0.0080 0.0050 0.0024 0.0045 0.0080 0.4830 0.0040 0.0005 0.0021 0.0000 0.0080 0.0050 0.0024
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0040 0.0120 0.0160 0.0300 0.0118 0.0087 0.0120 0.0300 0.7379 0.0040 0.0001 0.0067 0.0000 0.0300 0.0118 0.0087
65-GC 0.0080 0.0740 0.1160 0.1580 0.1800 0.1143 0.0490 0.0840 0.1720 0.4285 0.0995 0.0745 0.0447 0.0080 0.1800 0.1143 0.0490
66-GC 0.0000 0.0020 0.0040 0.0040 0.0060 0.0032 0.0017 0.0020 0.0060 0.5455 0.0013 0.0001 0.0014 0.0000 0.0060 0.0032 0.0017
67-GC 0.0000 0.0140 0.0340 0.0340 0.0340 0.0249 0.0136 0.0200 0.0340 0.5456 0.0088 0.0001 0.0121 0.0000 0.0340 0.0249 0.0136
68-GC 0.0000 0.1515 0.2140 0.2540 0.2600 0.1929 0.0762 0.1025 0.2600 0.3949 0.1438 0.0005 0.0621 0.0000 0.2600 0.1929 0.0762
69-GC 0.0000 0.0100 0.0280 0.0380 0.0420 0.0237 0.0156 0.0280 0.0420 0.6601 0.0058 0.0001 0.0139 0.0000 0.0420 0.0237 0.0156
70-GC 0.0020 0.0115 0.0220 0.0285 0.0500 0.0232 0.0135 0.0170 0.0480 0.5816 0.0185 0.0129 0.0103 0.0020 0.0500 0.0232 0.0135
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.0000 0.0140 0.0260 0.0280 0.0280 0.0202 0.0095 0.0140 0.0280 0.4712 0.0112 0.0001 0.0082 0.0000 0.0280 0.0202 0.0095
73-GC 0.0000 0.0020 0.0100 0.0140 0.0140 0.0082 0.0059 0.0120 0.0140 0.7232 0.0021 0.0000 0.0055 0.0000 0.0140 0.0082 0.0059
74-GC 0.0000 0.0020 0.0040 0.0060 0.0060 0.0041 0.0023 0.0040 0.0060 0.5526 0.0018 0.0001 0.0019 0.0000 0.0060 0.0041 0.0023
75-GC 0.0000 0.0210 0.0320 0.0340 0.0380 0.0258 0.0119 0.0130 0.0380 0.4610 0.0152 0.0002 0.0098 0.0040 0.0380 0.0274 0.0103
76
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-EN-CLEF2007
Statistics for P@1000
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0010 0.0980 0.1030 0.1100 0.1120 0.0912 0.0346 0.0120 0.1110 0.3797 0.0633 0.0104 0.0235 0.0820 0.1120 0.1048 0.0069
52-GC 0.0000 0.0020 0.0030 0.0040 0.0070 0.0031 0.0017 0.0020 0.0070 0.5645 0.0022 0.0002 0.0013 0.0000 0.0070 0.0031 0.0017
53-GC 0.0030 0.0340 0.0430 0.0530 0.0610 0.0414 0.0138 0.0190 0.0580 0.3339 0.0370 0.0269 0.0107 0.0090 0.0610 0.0429 0.0118
54-GC 0.0000 0.0030 0.0060 0.0070 0.0070 0.0047 0.0026 0.0040 0.0070 0.5610 0.0022 0.0001 0.0024 0.0000 0.0070 0.0047 0.0026
55-GC 0.0000 0.0080 0.0140 0.0160 0.0160 0.0119 0.0049 0.0080 0.0160 0.4106 0.0085 0.0003 0.0040 0.0000 0.0160 0.0119 0.0049
56-GC 0.0000 0.0030 0.0070 0.0070 0.0080 0.0051 0.0026 0.0040 0.0080 0.5085 0.0028 0.0001 0.0023 0.0000 0.0080 0.0051 0.0026
57-GC 0.0000 0.0120 0.0140 0.0150 0.0150 0.0117 0.0050 0.0030 0.0150 0.4265 0.0061 0.0001 0.0038 0.0080 0.0150 0.0138 0.0017
58-GC 0.0000 0.0040 0.0050 0.0050 0.0060 0.0044 0.0015 0.0010 0.0060 0.3534 0.0034 0.0002 0.0012 0.0030 0.0060 0.0048 0.0010
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0050 0.0140 0.0270 0.0273 0.0300 0.0220 0.0090 0.0133 0.0250 0.4088 0.0191 0.0153 0.0077 0.0050 0.0300 0.0220 0.0090
61-GC 0.0000 0.0120 0.0160 0.0190 0.0210 0.0152 0.0048 0.0070 0.0210 0.3142 0.0128 0.0005 0.0040 0.0040 0.0210 0.0155 0.0043
62-GC 0.0010 0.0018 0.0030 0.0040 0.0040 0.0028 0.0012 0.0023 0.0030 0.4350 0.0025 0.0021 0.0011 0.0010 0.0040 0.0028 0.0012
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0030 0.0080 0.0092 0.0160 0.0072 0.0045 0.0062 0.0160 0.6280 0.0030 0.0001 0.0035 0.0000 0.0160 0.0072 0.0045
65-GC 0.0070 0.0490 0.0760 0.0860 0.0920 0.0668 0.0226 0.0370 0.0850 0.3377 0.0609 0.0503 0.0197 0.0070 0.0920 0.0668 0.0226
66-GC 0.0000 0.0010 0.0020 0.0020 0.0030 0.0018 0.0008 0.0010 0.0030 0.4288 0.0012 0.0001 0.0006 0.0000 0.0030 0.0018 0.0008
67-GC 0.0000 0.0087 0.0170 0.0170 0.0170 0.0130 0.0067 0.0083 0.0170 0.5137 0.0050 0.0001 0.0056 0.0000 0.0170 0.0130 0.0067
68-GC 0.0000 0.0880 0.1290 0.1310 0.1310 0.1043 0.0373 0.0430 0.1310 0.3575 0.0800 0.0005 0.0304 0.0520 0.1310 0.1122 0.0260
69-GC 0.0000 0.0085 0.0150 0.0192 0.0210 0.0128 0.0077 0.0107 0.0210 0.5991 0.0037 0.0001 0.0066 0.0000 0.0210 0.0128 0.0077
70-GC 0.0030 0.0110 0.0170 0.0200 0.0290 0.0159 0.0071 0.0090 0.0260 0.4467 0.0138 0.0111 0.0057 0.0030 0.0290 0.0159 0.0071
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.0000 0.0110 0.0130 0.0140 0.0140 0.0111 0.0041 0.0030 0.0140 0.3700 0.0068 0.0001 0.0030 0.0070 0.0140 0.0125 0.0020
73-GC 0.0000 0.0018 0.0070 0.0070 0.0070 0.0046 0.0030 0.0053 0.0070 0.6493 0.0015 0.0001 0.0028 0.0000 0.0070 0.0046 0.0030
74-GC 0.0000 0.0010 0.0030 0.0030 0.0030 0.0022 0.0011 0.0020 0.0030 0.4912 0.0012 0.0001 0.0009 0.0000 0.0030 0.0022 0.0011
75-GC 0.0000 0.0128 0.0160 0.0170 0.0190 0.0138 0.0055 0.0043 0.0190 0.4006 0.0090 0.0002 0.0043 0.0070 0.0190 0.0160 0.0026
77
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-PT-CLEF2007
GeoCLEF Monolingual Portuguese Task Top 5 Participants − Standard Recall Levels vs Mean Interpolated Precision
100%
csusm [Experiment GEOMOPT3; MAP 17.83%; Pooled]
cheshire [Experiment BERKMOPTBASE; MAP 17.39%; Pooled]
90% xldb [Experiment XLDBPT_1; MAP 3.29%; Pooled]
80%
70%
60%
Precision
50%
40%
30%
20%
10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual Portuguese Task Top 5 Participants − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
1
csusm [Experiment GEOMOPT3; MAP 17.83%; Pooled]
cheshire [Experiment BERKMOPTBASE; MAP 17.39%; Pooled]
xldb [Experiment XLDBPT_1; MAP 3.29%; Pooled]
0.8
0.6
0.4
0.2
Difference
0
−0.2
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
78
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-PT-CLEF2007
GeoCLEF Monolingual Portuguese Task − Box Plot of the Topics
csusm [Experiment GEOMOPT1; MAP 17.83%; Pooled]
csusm [Experiment GEOMOPT3; MAP 17.83%; Pooled]
csusm [Experiment GEOMOPT2; MAP 17.81%; Pooled]
csusm [Experiment GEOMOPT4; MAP 17.81%; Pooled]
cheshire [Experiment BERKMOPTBASE; MAP 17.39%; Pooled]
Experiments
csusm [Experiment GEOBIESPT1; MAP 5.33%; Pooled]
xldb [Experiment XLDBPT_1; MAP 3.29%; Pooled]
xldb [Experiment XLDBPT_2; MAP 3.28%; Pooled]
xldb [Experiment XLDBPT_3; MAP 3.28%; Pooled]
xldb [Experiment XLDBPT_4; MAP 2.52%; Pooled]
xldb [Experiment XLDBPT_5; MAP 2.52%; Pooled]
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Average Precision
79
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-PT-CLEF2007
10.2455/TUKEY_T_TEST.DF3C5CC503E7F71A91C4541ED8A4423B
GeoCLEF Monolingual Portuguese Task − Tukey T test with "top group" highlighted
GEOMOPT1
GEOMOPT3
GEOMOPT4
GEOMOPT2
BERKMOPTBASE
Experiments
XLDBPT_1
GEOBIESPT1
XLDBPT_3
XLDBPT_2
XLDBPT_5
XLDBPT_4
0 0.05 0.1 0.15 0.2 0.25 0.3 0.35 0.4 0.45 0.5
arcsin(sqrt(Average Precsion))
80
81
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-PT-CLEF2007
GeoCLEF Monolingual Portuguese Task Top 5 Participants − Retrieved documents vs Mean Precision
100%
csusm [Experiment GEOMOPT3; R−Prec 18.45%; Pooled]
cheshire [Experiment BERKMOPTBASE; R−Prec 18.05%; Pooled]
90% xldb [Experiment XLDBPT_1; R−Prec 5.01%; Pooled]
80%
70%
60%
Precision
50%
40%
30%
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual Portuguese Task Top 5 Participants − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
1
csusm [Experiment GEOMOPT3; R−Prec 18.45%; Pooled]
cheshire [Experiment BERKMOPTBASE; R−Prec 18.05%; Pooled]
xldb [Experiment XLDBPT_1; R−Prec 5.01%; Pooled]
0.8
0.6
0.4
0.2
Difference
0
−0.2
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
82
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-PT-CLEF2007
GeoCLEF Monolingual Portuguese Task − Box Plot of the Topics
csusm [Experiment GEOMOPT2; R−Prec 18.46%; Pooled]
csusm [Experiment GEOMOPT4; R−Prec 18.46%; Pooled]
csusm [Experiment GEOMOPT1; R−Prec 18.45%; Pooled]
csusm [Experiment GEOMOPT3; R−Prec 18.45%; Pooled]
cheshire [Experiment BERKMOPTBASE; R−Prec 18.05%; Pooled]
Experiments
csusm [Experiment GEOBIESPT1; R−Prec 6.56%; Pooled]
xldb [Experiment XLDBPT_1; R−Prec 5.01%; Pooled]
xldb [Experiment XLDBPT_2; R−Prec 4.12%; Pooled]
xldb [Experiment XLDBPT_3; R−Prec 4.12%; Pooled]
xldb [Experiment XLDBPT_4; R−Prec 3.37%; Pooled]
xldb [Experiment XLDBPT_5; R−Prec 3.37%; Pooled]
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
R−Precision
83
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-PT-CLEF2007
GeoCLEF Monolingual Portuguese Task − Tukey T test with "top group" highlighted
GEOMOPT1
GEOMOPT3
GEOMOPT4
GEOMOPT2
BERKMOPTBASE
Experiments
XLDBPT_1
GEOBIESPT1
XLDBPT_3
XLDBPT_2
XLDBPT_5
XLDBPT_4
0 0.05 0.1 0.15 0.2 0.25 0.3 0.35 0.4 0.45
arcsin(sqrt(R−Precision))
84
85
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-PT-CLEF2007
Statistics for Number of relevant retrieved documents
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.00 0.00 2.00 4.00 4.00 2.00 1.84 4.00 4.00 0.92 0.03 0.00 1.64 0.00 4.00 2.00 1.84
52-GC 0.00 4.00 16.00 16.00 29.00 12.45 10.03 12.00 29.00 0.81 2.93 0.00 8.41 0.00 29.00 12.45 10.03
53-GC 0.00 0.00 1.00 1.00 5.00 0.91 1.45 1.00 5.00 1.59 0.01 0.00 0.83 0.00 1.00 0.50 0.53
54-GC 0.00 0.00 2.00 2.00 3.00 1.36 1.21 2.00 3.00 0.88 0.02 0.00 1.06 0.00 3.00 1.36 1.21
55-GC 1.00 2.00 2.00 3.00 5.00 2.55 1.04 1.00 4.00 0.41 2.37 2.19 0.78 1.00 3.00 2.30 0.67
56-GC 0.00 0.00 2.00 10.00 10.00 4.82 5.00 10.00 10.00 1.04 0.05 0.00 4.71 0.00 10.00 4.82 5.00
57-GC 1.00 1.00 2.00 2.00 2.00 1.64 0.50 1.00 1.00 0.31 1.55 1.47 0.46 1.00 2.00 1.64 0.50
58-GC 1.00 1.00 17.00 18.75 20.00 11.00 8.92 17.75 19.00 0.81 5.71 2.43 8.36 1.00 20.00 11.00 8.92
59-GC 0.00 0.00 1.00 1.00 1.00 0.55 0.52 1.00 1.00 0.96 0.01 0.00 0.50 0.00 1.00 0.55 0.52
60-GC 0.00 0.00 8.00 8.00 8.00 5.09 4.04 8.00 8.00 0.79 0.06 0.00 3.70 0.00 8.00 5.09 4.04
61-GC 0.00 10.00 12.00 12.00 13.00 10.27 3.58 2.00 13.00 0.35 3.17 0.00 2.07 10.00 13.00 11.30 1.16
62-GC 0.00 2.00 13.00 17.00 19.00 9.82 8.01 15.00 19.00 0.82 2.09 0.00 7.47 0.00 19.00 9.82 8.01
63-GC 2.00 4.00 4.00 5.00 6.00 4.36 1.21 1.00 4.00 0.28 4.19 3.98 0.94 3.00 6.00 4.60 0.97
64-GC 0.00 3.00 5.00 7.00 7.00 4.64 2.38 4.00 7.00 0.51 1.45 0.00 2.03 0.00 7.00 4.64 2.38
65-GC 3.00 21.00 21.00 97.00 99.00 49.55 41.15 76.00 96.00 0.83 29.79 14.08 37.32 3.00 99.00 49.55 41.15
66-GC 0.00 0.00 2.00 12.00 12.00 5.55 6.02 12.00 12.00 1.09 0.02 0.00 5.69 0.00 12.00 5.55 6.02
67-GC 37.00 42.00 71.00 72.00 74.00 58.00 16.35 30.00 37.00 0.28 55.78 53.55 15.45 37.00 74.00 58.00 16.35
68-GC 0.00 24.00 39.00 39.00 62.00 34.36 18.29 15.00 62.00 0.53 8.90 0.00 13.42 16.00 39.00 31.75 9.13
69-GC 0.00 0.00 9.00 9.00 10.00 5.00 4.80 9.00 10.00 0.96 0.02 0.00 4.55 0.00 10.00 5.00 4.80
70-GC 0.00 0.00 2.00 2.00 7.00 1.82 2.14 2.00 7.00 1.17 0.03 0.00 1.47 0.00 4.00 1.30 1.34
71-GC 21.00 21.00 68.00 102.00 109.00 64.45 39.73 81.00 88.00 0.62 51.13 39.49 36.05 21.00 109.00 64.45 39.73
72-GC 10.00 11.00 13.00 38.00 38.00 23.36 14.03 27.00 28.00 0.60 19.45 16.37 13.31 10.00 38.00 23.36 14.03
73-GC 0.00 0.00 1.00 1.00 11.00 1.64 3.23 1.00 11.00 1.98 0.01 0.00 1.95 0.00 1.00 0.44 0.53
74-GC 9.00 18.00 50.00 50.00 59.00 35.73 19.04 32.00 50.00 0.53 30.11 24.49 17.75 9.00 59.00 35.73 19.04
75-GC 0.00 7.00 22.00 23.00 31.00 15.73 10.18 16.00 31.00 0.65 4.03 0.00 9.21 0.00 31.00 15.73 10.18
86
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-PT-CLEF2007
Statistics for Average Precsion
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0011 0.1935 0.1935 0.0710 0.0971 0.1935 0.1935 1.3675 0.0013 0.0000 0.0891 0.0000 0.1935 0.0710 0.0971
52-GC 0.0000 0.0105 0.0271 0.0271 0.2114 0.0434 0.0638 0.0166 0.2114 1.4698 0.0129 0.0001 0.0437 0.0000 0.0271 0.0167 0.0104
53-GC 0.0000 0.0000 0.0004 0.0049 0.0430 0.0057 0.0126 0.0049 0.0430 2.1973 0.0003 0.0000 0.0068 0.0000 0.0049 0.0020 0.0025
54-GC 0.0000 0.0000 0.0029 0.0029 0.0523 0.0079 0.0161 0.0029 0.0523 2.0430 0.0005 0.0000 0.0107 0.0000 0.0029 0.0013 0.0015
55-GC 0.0002 0.0071 0.0071 0.0261 0.0343 0.0153 0.0124 0.0191 0.0340 0.8065 0.0082 0.0018 0.0113 0.0002 0.0343 0.0153 0.0124
56-GC 0.0000 0.0000 0.0014 0.3684 0.5722 0.1861 0.2211 0.3684 0.5722 1.1881 0.0027 0.0000 0.2027 0.0000 0.5722 0.1861 0.2211
57-GC 0.0028 0.0102 0.1167 0.1233 0.3750 0.0935 0.1092 0.1131 0.3722 1.1682 0.0388 0.0138 0.0771 0.0028 0.1233 0.0654 0.0598
58-GC 0.0002 0.0002 0.0093 0.1330 0.1478 0.0618 0.0689 0.1329 0.1476 1.1132 0.0069 0.0004 0.0643 0.0002 0.1478 0.0618 0.0689
59-GC 0.0000 0.0000 0.0062 0.0062 0.0093 0.0037 0.0036 0.0062 0.0093 0.9877 0.0003 0.0000 0.0034 0.0000 0.0093 0.0037 0.0036
60-GC 0.0000 0.0000 0.4229 0.5312 0.7053 0.2852 0.2815 0.5312 0.7053 0.9870 0.0069 0.0000 0.2577 0.0000 0.7053 0.2852 0.2815
61-GC 0.0000 0.1353 0.1353 0.1613 0.2783 0.1390 0.0681 0.0260 0.2783 0.4900 0.0606 0.0001 0.0416 0.1353 0.1613 0.1483 0.0139
62-GC 0.0000 0.0008 0.0096 0.0514 0.1215 0.0309 0.0386 0.0506 0.1215 1.2515 0.0047 0.0001 0.0314 0.0000 0.1215 0.0309 0.0386
63-GC 0.0035 0.0128 0.0128 0.0304 0.1889 0.0465 0.0709 0.0176 0.1855 1.5254 0.0201 0.0117 0.0518 0.0035 0.0304 0.0148 0.0095
64-GC 0.0000 0.0011 0.0074 0.0142 0.0263 0.0082 0.0086 0.0132 0.0263 1.0480 0.0027 0.0001 0.0070 0.0000 0.0263 0.0082 0.0086
65-GC 0.0001 0.0041 0.0041 0.3658 0.5941 0.1855 0.2462 0.3617 0.5940 1.3270 0.0169 0.0006 0.2142 0.0001 0.5941 0.1855 0.2462
66-GC 0.0000 0.0000 0.0007 0.6672 0.6672 0.2482 0.3327 0.6672 0.6672 1.3401 0.0019 0.0000 0.3047 0.0000 0.6672 0.2482 0.3327
67-GC 0.1062 0.1062 0.2799 0.2935 0.4728 0.2270 0.1208 0.1873 0.3666 0.5322 0.1978 0.1723 0.1027 0.1062 0.4728 0.2270 0.1208
68-GC 0.0000 0.0413 0.2606 0.2794 0.3085 0.1703 0.1320 0.2381 0.3085 0.7749 0.0484 0.0001 0.1228 0.0000 0.3085 0.1703 0.1320
69-GC 0.0000 0.0000 0.0106 0.4599 0.5580 0.2189 0.2511 0.4599 0.5580 1.1468 0.0025 0.0000 0.2369 0.0000 0.5580 0.2189 0.2511
70-GC 0.0000 0.0000 0.0065 0.0065 0.0270 0.0068 0.0092 0.0065 0.0270 1.3582 0.0006 0.0000 0.0063 0.0000 0.0065 0.0029 0.0034
71-GC 0.0044 0.0044 0.0335 0.2768 0.2768 0.1324 0.1379 0.2724 0.2724 1.0421 0.0406 0.0110 0.1307 0.0044 0.2768 0.1324 0.1379
72-GC 0.0020 0.0531 0.0531 0.1061 0.1061 0.0633 0.0387 0.0530 0.1041 0.6113 0.0410 0.0133 0.0311 0.0020 0.1061 0.0633 0.0387
73-GC 0.0000 0.0000 0.0003 0.0003 0.3088 0.0283 0.0930 0.0003 0.3088 3.2840 0.0001 0.0000 0.0510 0.0000 0.0003 0.0001 0.0001
74-GC 0.0022 0.0190 0.0976 0.1876 0.1967 0.1021 0.0870 0.1685 0.1945 0.8527 0.0516 0.0157 0.0794 0.0022 0.1967 0.1021 0.0870
75-GC 0.0000 0.0662 0.0662 0.1022 0.3047 0.0937 0.0764 0.0361 0.3047 0.8149 0.0392 0.0001 0.0445 0.0527 0.1022 0.0807 0.0209
87
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-PT-CLEF2007
Statistics for R-Precision
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0000 0.2500 0.2500 0.0909 0.1261 0.2500 0.2500 1.3874 0.0004 0.0000 0.1157 0.0000 0.2500 0.0909 0.1261
52-GC 0.0000 0.0294 0.0882 0.0882 0.3529 0.0963 0.1061 0.0588 0.3529 1.1025 0.0321 0.0001 0.0719 0.0000 0.0882 0.0523 0.0353
53-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
54-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
55-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
56-GC 0.0000 0.0000 0.0000 0.3000 0.6000 0.1636 0.2063 0.3000 0.6000 1.2605 0.0012 0.0000 0.1785 0.0000 0.6000 0.1636 0.2063
57-GC 0.0000 0.0000 0.0000 0.0000 0.5000 0.0455 0.1508 0.0000 0.5000 3.3166 0.0000 0.0000 0.0826 0.0000 0.0000 0.0000 0.0000
58-GC 0.0000 0.0000 0.0476 0.1905 0.2381 0.0866 0.1039 0.1905 0.2381 1.2004 0.0017 0.0000 0.0929 0.0000 0.2381 0.0866 0.1039
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0000 0.0000 0.3750 0.5000 0.6250 0.2614 0.2589 0.5000 0.6250 0.9907 0.0035 0.0000 0.2376 0.0000 0.6250 0.2614 0.2589
61-GC 0.0000 0.1538 0.1538 0.1538 0.3846 0.1538 0.0910 0.0000 0.3846 0.5916 0.0654 0.0001 0.0420 0.1538 0.1538 0.1538 0.0000
62-GC 0.0000 0.0000 0.0000 0.0526 0.1053 0.0287 0.0362 0.0526 0.1053 1.2605 0.0005 0.0000 0.0313 0.0000 0.1053 0.0287 0.0362
63-GC 0.0000 0.0000 0.0000 0.0000 0.1667 0.0303 0.0674 0.0000 0.1667 2.2249 0.0001 0.0000 0.0496 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0238 0.0238 0.4206 0.6429 0.2273 0.2630 0.3968 0.6429 1.1572 0.0222 0.0001 0.2306 0.0000 0.6429 0.2273 0.2630
66-GC 0.0000 0.0000 0.0000 0.5385 0.5385 0.1958 0.2717 0.5385 0.5385 1.3874 0.0005 0.0000 0.2492 0.0000 0.5385 0.1958 0.2717
67-GC 0.1733 0.1733 0.3600 0.3600 0.4400 0.2885 0.1037 0.1867 0.2667 0.3594 0.2704 0.2526 0.0950 0.1733 0.4400 0.2885 0.1037
68-GC 0.0000 0.0750 0.3375 0.3625 0.3750 0.2341 0.1552 0.2875 0.3750 0.6631 0.0737 0.0001 0.1355 0.0000 0.3750 0.2341 0.1552
69-GC 0.0000 0.0000 0.0000 0.3000 0.5000 0.1545 0.1864 0.3000 0.5000 1.2058 0.0011 0.0000 0.1686 0.0000 0.5000 0.1545 0.1864
70-GC 0.0000 0.0000 0.0000 0.0000 0.1000 0.0091 0.0302 0.0000 0.1000 3.3166 0.0000 0.0000 0.0165 0.0000 0.0000 0.0000 0.0000
71-GC 0.0194 0.0194 0.1032 0.3677 0.3871 0.1930 0.1733 0.3484 0.3677 0.8982 0.0986 0.0455 0.1624 0.0194 0.3871 0.1930 0.1733
72-GC 0.0000 0.0682 0.0682 0.1364 0.1364 0.0806 0.0512 0.0682 0.1364 0.6353 0.0176 0.0001 0.0406 0.0000 0.1364 0.0806 0.0512
73-GC 0.0000 0.0000 0.0000 0.0000 0.4167 0.0379 0.1256 0.0000 0.4167 3.3166 0.0000 0.0000 0.0689 0.0000 0.0000 0.0000 0.0000
74-GC 0.0161 0.0645 0.2097 0.2903 0.2903 0.1716 0.1152 0.2258 0.2742 0.6718 0.1234 0.0750 0.1061 0.0161 0.2903 0.1716 0.1152
75-GC 0.0000 0.0625 0.0625 0.2188 0.3750 0.1420 0.1138 0.1562 0.3750 0.8015 0.0524 0.0001 0.0981 0.0000 0.3750 0.1420 0.1138
88
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-PT-CLEF2007
Statistics for Binary Preference
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0000 0.1875 0.1875 0.0682 0.0946 0.1875 0.1875 1.3874 0.0004 0.0000 0.0868 0.0000 0.1875 0.0682 0.0946
52-GC 0.0000 0.0268 0.0433 0.0433 0.2353 0.0608 0.0697 0.0164 0.2353 1.1458 0.0222 0.0001 0.0485 0.0268 0.0433 0.0350 0.0088
53-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
54-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
55-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
56-GC 0.0000 0.0000 0.0000 0.2900 0.6100 0.1609 0.2058 0.2900 0.6100 1.2792 0.0011 0.0000 0.1755 0.0000 0.6100 0.1609 0.2058
57-GC 0.0000 0.0000 0.0000 0.0000 0.2500 0.0227 0.0754 0.0000 0.2500 3.3166 0.0000 0.0000 0.0413 0.0000 0.0000 0.0000 0.0000
58-GC 0.0000 0.0000 0.0159 0.1587 0.1746 0.0662 0.0809 0.1587 0.1746 1.2231 0.0014 0.0000 0.0731 0.0000 0.1746 0.0662 0.0809
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0000 0.0000 0.2969 0.4609 0.5938 0.2301 0.2376 0.4609 0.5938 1.0325 0.0033 0.0000 0.2092 0.0000 0.5938 0.2301 0.2376
61-GC 0.0000 0.0710 0.0710 0.1420 0.3018 0.1114 0.0778 0.0710 0.3018 0.6989 0.0465 0.0001 0.0569 0.0000 0.1420 0.0923 0.0479
62-GC 0.0000 0.0000 0.0000 0.0111 0.0554 0.0091 0.0163 0.0111 0.0554 1.7978 0.0003 0.0000 0.0099 0.0000 0.0111 0.0044 0.0057
63-GC 0.0000 0.0000 0.0000 0.0000 0.1667 0.0303 0.0674 0.0000 0.1667 2.2249 0.0001 0.0000 0.0496 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
65-GC 0.0018 0.0435 0.0435 0.5025 0.6797 0.2555 0.2811 0.4590 0.6779 1.1002 0.0760 0.0103 0.2464 0.0018 0.6797 0.2555 0.2811
66-GC 0.0000 0.0000 0.0000 0.5976 0.5976 0.2173 0.3015 0.5976 0.5976 1.3874 0.0005 0.0000 0.2766 0.0000 0.5976 0.2173 0.3015
67-GC 0.1307 0.1307 0.2773 0.2773 0.4046 0.2278 0.0915 0.1467 0.2740 0.4015 0.2109 0.1950 0.0783 0.1307 0.4046 0.2278 0.0915
68-GC 0.0000 0.0584 0.2908 0.2942 0.3200 0.1913 0.1331 0.2358 0.3200 0.6954 0.0597 0.0001 0.1203 0.0000 0.3200 0.1913 0.1331
69-GC 0.0000 0.0000 0.0000 0.3600 0.4300 0.1700 0.1963 0.3600 0.4300 1.1548 0.0012 0.0000 0.1855 0.0000 0.4300 0.1700 0.1963
70-GC 0.0000 0.0000 0.0000 0.0000 0.0100 0.0009 0.0030 0.0000 0.0100 3.3166 0.0000 0.0000 0.0017 0.0000 0.0000 0.0000 0.0000
71-GC 0.0438 0.0438 0.1117 0.4473 0.4473 0.2388 0.2001 0.4035 0.4035 0.8378 0.1488 0.0911 0.1885 0.0438 0.4473 0.2388 0.2001
72-GC 0.0000 0.0460 0.0460 0.1152 0.1152 0.0628 0.0450 0.0692 0.1152 0.7173 0.0139 0.0001 0.0381 0.0000 0.1152 0.0628 0.0450
73-GC 0.0000 0.0000 0.0000 0.0000 0.3264 0.0297 0.0984 0.0000 0.3264 3.3166 0.0000 0.0000 0.0539 0.0000 0.0000 0.0000 0.0000
74-GC 0.0070 0.0388 0.1017 0.2281 0.2281 0.1245 0.0956 0.1894 0.2211 0.7679 0.0799 0.0396 0.0879 0.0070 0.2281 0.1245 0.0956
75-GC 0.0000 0.0625 0.0625 0.1514 0.3096 0.1075 0.0873 0.0889 0.3096 0.8123 0.0401 0.0001 0.0686 0.0000 0.1514 0.0873 0.0590
89
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-PT-CLEF2007
Statistics for Precision at the 0% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0028 0.5000 0.5000 0.1831 0.2513 0.5000 0.5000 1.3726 0.0024 0.0000 0.2305 0.0000 0.5000 0.1831 0.2513
52-GC 0.0000 0.1364 0.2500 0.2500 0.3704 0.2045 0.1062 0.1136 0.3704 0.5194 0.0850 0.0001 0.0867 0.0000 0.3704 0.2045 0.1062
53-GC 0.0000 0.0000 0.0024 0.0294 0.0811 0.0183 0.0252 0.0294 0.0811 1.3793 0.0007 0.0000 0.0195 0.0000 0.0294 0.0120 0.0150
54-GC 0.0000 0.0000 0.0047 0.0047 0.0870 0.0120 0.0259 0.0047 0.0870 2.1523 0.0007 0.0000 0.0161 0.0000 0.0047 0.0022 0.0024
55-GC 0.0011 0.0190 0.0222 0.1000 0.1000 0.0484 0.0424 0.0810 0.0989 0.8752 0.0259 0.0078 0.0375 0.0011 0.1000 0.0484 0.0424
56-GC 0.0000 0.0000 0.0137 0.6000 0.7500 0.2878 0.3303 0.6000 0.7500 1.1476 0.0049 0.0000 0.3110 0.0000 0.7500 0.2878 0.3303
57-GC 0.0035 0.0204 0.1333 0.1667 0.5000 0.1259 0.1436 0.1463 0.4965 1.1403 0.0592 0.0213 0.0990 0.0035 0.1667 0.0885 0.0762
58-GC 0.0033 0.0033 0.0667 1.0000 1.0000 0.4180 0.4830 0.9967 0.9967 1.1555 0.0641 0.0086 0.4382 0.0033 1.0000 0.4180 0.4830
59-GC 0.0000 0.0000 0.0062 0.0062 0.0093 0.0037 0.0036 0.0062 0.0093 0.9877 0.0003 0.0000 0.0034 0.0000 0.0093 0.0037 0.0036
60-GC 0.0000 0.0000 0.6667 0.8000 1.0000 0.4496 0.4411 0.8000 1.0000 0.9813 0.0091 0.0000 0.4065 0.0000 1.0000 0.4496 0.4411
61-GC 0.0000 0.2174 0.5000 1.0000 1.0000 0.5450 0.3953 0.7826 1.0000 0.7254 0.1814 0.0001 0.3455 0.0000 1.0000 0.5450 0.3953
62-GC 0.0000 0.0115 0.0255 0.0739 0.5000 0.0788 0.1431 0.0624 0.5000 1.8153 0.0180 0.0001 0.0766 0.0000 0.0739 0.0367 0.0326
63-GC 0.0123 0.0234 0.0261 0.0476 1.0000 0.2049 0.3932 0.0242 0.9877 1.9187 0.0508 0.0295 0.2891 0.0123 0.0476 0.0283 0.0119
64-GC 0.0000 0.0059 0.0169 0.0303 0.0577 0.0203 0.0190 0.0244 0.0577 0.9359 0.0080 0.0001 0.0154 0.0000 0.0577 0.0203 0.0190
65-GC 0.0039 0.0690 0.0690 1.0000 1.0000 0.4354 0.4673 0.9310 0.9961 1.0733 0.1405 0.0259 0.4224 0.0039 1.0000 0.4354 0.4673
66-GC 0.0000 0.0000 0.0060 1.0000 1.0000 0.3738 0.4974 1.0000 1.0000 1.3309 0.0027 0.0000 0.4555 0.0000 1.0000 0.3738 0.4974
67-GC 0.4000 0.4000 0.5000 1.0000 1.0000 0.6868 0.3014 0.6000 0.6000 0.4388 0.6263 0.5729 0.2847 0.4000 1.0000 0.6868 0.3014
68-GC 0.0000 0.5714 1.0000 1.0000 1.0000 0.7694 0.4091 0.4286 1.0000 0.5317 0.2394 0.0001 0.3355 0.0000 1.0000 0.7694 0.4091
69-GC 0.0000 0.0000 0.0227 1.0000 1.0000 0.4566 0.5203 1.0000 1.0000 1.1395 0.0038 0.0000 0.4940 0.0000 1.0000 0.4566 0.5203
70-GC 0.0000 0.0000 0.0357 0.0357 0.1000 0.0273 0.0316 0.0357 0.1000 1.1605 0.0016 0.0000 0.0245 0.0000 0.0556 0.0200 0.0216
71-GC 0.1000 0.1000 0.2500 1.0000 1.0000 0.4973 0.4344 0.9000 0.9000 0.8735 0.3047 0.1904 0.4025 0.1000 1.0000 0.4973 0.4344
72-GC 0.0134 0.1667 0.1667 1.0000 1.0000 0.4427 0.4454 0.8333 0.9866 1.0063 0.2119 0.0717 0.4053 0.0134 1.0000 0.4427 0.4454
73-GC 0.0000 0.0000 0.0031 0.0031 0.6000 0.0564 0.1803 0.0031 0.6000 3.1963 0.0004 0.0000 0.0988 0.0000 0.0031 0.0014 0.0016
74-GC 0.0278 0.2000 0.2203 0.4375 1.0000 0.3453 0.2576 0.2375 0.9722 0.7460 0.2595 0.1556 0.1861 0.0278 0.4375 0.2798 0.1461
75-GC 0.0000 0.3571 0.3571 1.0000 1.0000 0.5792 0.3847 0.6429 1.0000 0.6642 0.1983 0.0001 0.3462 0.0000 1.0000 0.5792 0.3847
90
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-PT-CLEF2007
Statistics for Precision at the 10% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0028 0.5000 0.5000 0.1831 0.2513 0.5000 0.5000 1.3726 0.0024 0.0000 0.2305 0.0000 0.5000 0.1831 0.2513
52-GC 0.0000 0.0043 0.0930 0.0930 0.3704 0.0975 0.1285 0.0887 0.3704 1.3177 0.0168 0.0001 0.0887 0.0000 0.0930 0.0433 0.0472
53-GC 0.0000 0.0000 0.0024 0.0294 0.0811 0.0183 0.0252 0.0294 0.0811 1.3793 0.0007 0.0000 0.0195 0.0000 0.0294 0.0120 0.0150
54-GC 0.0000 0.0000 0.0047 0.0047 0.0870 0.0120 0.0259 0.0047 0.0870 2.1523 0.0007 0.0000 0.0161 0.0000 0.0047 0.0022 0.0024
55-GC 0.0011 0.0190 0.0222 0.1000 0.1000 0.0484 0.0424 0.0810 0.0989 0.8752 0.0259 0.0078 0.0375 0.0011 0.1000 0.0484 0.0424
56-GC 0.0000 0.0000 0.0137 0.6000 0.7500 0.2878 0.3303 0.6000 0.7500 1.1476 0.0049 0.0000 0.3110 0.0000 0.7500 0.2878 0.3303
57-GC 0.0035 0.0204 0.1333 0.1667 0.5000 0.1259 0.1436 0.1463 0.4965 1.1403 0.0592 0.0213 0.0990 0.0035 0.1667 0.0885 0.0762
58-GC 0.0000 0.0000 0.0448 0.4286 0.4444 0.1768 0.2096 0.4286 0.4444 1.1853 0.0049 0.0000 0.1889 0.0000 0.4444 0.1768 0.2096
59-GC 0.0000 0.0000 0.0062 0.0062 0.0093 0.0037 0.0036 0.0062 0.0093 0.9877 0.0003 0.0000 0.0034 0.0000 0.0093 0.0037 0.0036
60-GC 0.0000 0.0000 0.6667 0.8000 1.0000 0.4496 0.4411 0.8000 1.0000 0.9813 0.0091 0.0000 0.4065 0.0000 1.0000 0.4496 0.4411
61-GC 0.0000 0.2174 0.2174 0.5000 0.6250 0.3232 0.2084 0.2826 0.6250 0.6448 0.1163 0.0001 0.1835 0.0000 0.6250 0.3232 0.2084
62-GC 0.0000 0.0028 0.0255 0.0739 0.1299 0.0420 0.0447 0.0710 0.1299 1.0635 0.0096 0.0001 0.0391 0.0000 0.1299 0.0420 0.0447
63-GC 0.0123 0.0234 0.0261 0.0476 1.0000 0.2049 0.3932 0.0242 0.9877 1.9187 0.0508 0.0295 0.2891 0.0123 0.0476 0.0283 0.0119
64-GC 0.0000 0.0032 0.0135 0.0303 0.0577 0.0187 0.0200 0.0271 0.0577 1.0686 0.0061 0.0001 0.0166 0.0000 0.0577 0.0187 0.0200
65-GC 0.0000 0.0256 0.0256 0.7368 0.9583 0.3514 0.4130 0.7112 0.9583 1.1754 0.0279 0.0001 0.3647 0.0000 0.9583 0.3514 0.4130
66-GC 0.0000 0.0000 0.0033 1.0000 1.0000 0.3735 0.4976 1.0000 1.0000 1.3323 0.0026 0.0000 0.4556 0.0000 1.0000 0.3735 0.4976
67-GC 0.3214 0.3214 0.4545 0.4800 0.9000 0.4449 0.1690 0.1586 0.5786 0.3799 0.4228 0.4061 0.1101 0.3214 0.4800 0.3994 0.0801
68-GC 0.0000 0.0981 0.7273 1.0000 1.0000 0.5465 0.4347 0.9019 1.0000 0.7955 0.1412 0.0001 0.3956 0.0000 1.0000 0.5465 0.4347
69-GC 0.0000 0.0000 0.0227 1.0000 1.0000 0.4566 0.5203 1.0000 1.0000 1.1395 0.0038 0.0000 0.4940 0.0000 1.0000 0.4566 0.5203
70-GC 0.0000 0.0000 0.0357 0.0357 0.1000 0.0273 0.0316 0.0357 0.1000 1.1605 0.0016 0.0000 0.0245 0.0000 0.0556 0.0200 0.0216
71-GC 0.0266 0.0266 0.1176 0.5806 0.6250 0.2974 0.2816 0.5540 0.5984 0.9466 0.1405 0.0621 0.2655 0.0266 0.6250 0.2974 0.2816
72-GC 0.0134 0.1047 0.1047 0.3846 0.3846 0.1907 0.1572 0.2800 0.3713 0.8245 0.1212 0.0620 0.1410 0.0134 0.3846 0.1907 0.1572
73-GC 0.0000 0.0000 0.0000 0.0000 0.6000 0.0551 0.1807 0.0000 0.6000 3.2770 0.0000 0.0000 0.0991 0.0000 0.0000 0.0000 0.0000
74-GC 0.0126 0.0611 0.2203 0.4375 0.5333 0.2510 0.2052 0.3764 0.5207 0.8175 0.1482 0.0686 0.1870 0.0126 0.5333 0.2510 0.2052
75-GC 0.0000 0.0377 0.1429 0.3571 0.8000 0.2293 0.2445 0.3194 0.8000 1.0664 0.0602 0.0001 0.1967 0.0000 0.8000 0.2293 0.2445
91
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-PT-CLEF2007
Statistics for Precision at the 20% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0028 0.5000 0.5000 0.1831 0.2513 0.5000 0.5000 1.3726 0.0024 0.0000 0.2305 0.0000 0.5000 0.1831 0.2513
52-GC 0.0000 0.0000 0.0660 0.0660 0.3704 0.0857 0.1298 0.0660 0.3704 1.5158 0.0016 0.0000 0.0921 0.0000 0.0660 0.0294 0.0348
53-GC 0.0000 0.0000 0.0000 0.0000 0.0811 0.0074 0.0244 0.0000 0.0811 3.3166 0.0000 0.0000 0.0134 0.0000 0.0000 0.0000 0.0000
54-GC 0.0000 0.0000 0.0047 0.0047 0.0870 0.0120 0.0259 0.0047 0.0870 2.1523 0.0007 0.0000 0.0161 0.0000 0.0047 0.0022 0.0024
55-GC 0.0011 0.0190 0.0222 0.1000 0.1000 0.0484 0.0424 0.0810 0.0989 0.8752 0.0259 0.0078 0.0375 0.0011 0.1000 0.0484 0.0424
56-GC 0.0000 0.0000 0.0026 0.6000 0.7500 0.2866 0.3315 0.6000 0.7500 1.1567 0.0025 0.0000 0.3122 0.0000 0.7500 0.2866 0.3315
57-GC 0.0035 0.0204 0.1333 0.1667 0.5000 0.1259 0.1436 0.1463 0.4965 1.1403 0.0592 0.0213 0.0990 0.0035 0.1667 0.0885 0.0762
58-GC 0.0000 0.0000 0.0180 0.1786 0.2778 0.0975 0.1151 0.1786 0.2778 1.1810 0.0032 0.0000 0.1021 0.0000 0.2778 0.0975 0.1151
59-GC 0.0000 0.0000 0.0062 0.0062 0.0093 0.0037 0.0036 0.0062 0.0093 0.9877 0.0003 0.0000 0.0034 0.0000 0.0093 0.0037 0.0036
60-GC 0.0000 0.0000 0.5000 0.7667 1.0000 0.4039 0.4031 0.7667 1.0000 0.9981 0.0083 0.0000 0.3655 0.0000 1.0000 0.4039 0.4031
61-GC 0.0000 0.1765 0.1765 0.2174 0.6250 0.2056 0.1559 0.0409 0.6250 0.7586 0.0797 0.0001 0.0849 0.1765 0.2174 0.1969 0.0219
62-GC 0.0000 0.0000 0.0255 0.0739 0.1299 0.0410 0.0457 0.0739 0.1299 1.1146 0.0012 0.0000 0.0401 0.0000 0.1299 0.0410 0.0457
63-GC 0.0072 0.0234 0.0261 0.0441 0.0870 0.0368 0.0274 0.0207 0.0798 0.7439 0.0283 0.0210 0.0209 0.0072 0.0441 0.0256 0.0129
64-GC 0.0000 0.0032 0.0118 0.0303 0.0577 0.0184 0.0201 0.0271 0.0577 1.0923 0.0060 0.0001 0.0168 0.0000 0.0577 0.0184 0.0201
65-GC 0.0000 0.0000 0.0000 0.6667 0.9062 0.3198 0.3930 0.6667 0.9062 1.2290 0.0016 0.0000 0.3489 0.0000 0.9062 0.3198 0.3930
66-GC 0.0000 0.0000 0.0000 1.0000 1.0000 0.3732 0.4979 1.0000 1.0000 1.3341 0.0015 0.0000 0.4559 0.0000 1.0000 0.3732 0.4979
67-GC 0.1778 0.1778 0.4043 0.4286 0.6154 0.3435 0.1471 0.2508 0.4376 0.4284 0.3127 0.2825 0.1224 0.1778 0.6154 0.3435 0.1471
68-GC 0.0000 0.0808 0.5143 0.8947 1.0000 0.4757 0.4128 0.8139 1.0000 0.8679 0.1165 0.0001 0.3571 0.0000 1.0000 0.4757 0.4128
69-GC 0.0000 0.0000 0.0227 1.0000 1.0000 0.4566 0.5203 1.0000 1.0000 1.1395 0.0038 0.0000 0.4940 0.0000 1.0000 0.4566 0.5203
70-GC 0.0000 0.0000 0.0357 0.0357 0.0549 0.0226 0.0226 0.0357 0.0549 0.9983 0.0009 0.0000 0.0206 0.0000 0.0549 0.0226 0.0226
71-GC 0.0000 0.0000 0.0774 0.5294 0.5439 0.2539 0.2677 0.5294 0.5439 1.0543 0.0069 0.0000 0.2531 0.0000 0.5439 0.2539 0.2677
72-GC 0.0126 0.0126 0.0213 0.1047 0.1047 0.0553 0.0473 0.0920 0.0920 0.8555 0.0348 0.0226 0.0449 0.0126 0.1047 0.0553 0.0473
73-GC 0.0000 0.0000 0.0000 0.0000 0.6000 0.0551 0.1807 0.0000 0.6000 3.2786 0.0000 0.0000 0.0991 0.0000 0.0000 0.0000 0.0000
74-GC 0.0000 0.0547 0.2203 0.4375 0.4375 0.2301 0.1899 0.3828 0.4375 0.8254 0.0714 0.0001 0.1712 0.0000 0.4375 0.2301 0.1899
75-GC 0.0000 0.0073 0.1429 0.2500 0.4706 0.1493 0.1571 0.2427 0.4706 1.0519 0.0277 0.0001 0.1316 0.0000 0.4706 0.1493 0.1571
92
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-PT-CLEF2007
Statistics for Precision at the 30% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0028 0.1364 0.1364 0.0507 0.0679 0.1364 0.1364 1.3388 0.0010 0.0000 0.0623 0.0000 0.1364 0.0507 0.0679
52-GC 0.0000 0.0000 0.0428 0.0428 0.3636 0.0766 0.1303 0.0428 0.3636 1.7008 0.0014 0.0000 0.0942 0.0000 0.0428 0.0190 0.0226
53-GC 0.0000 0.0000 0.0000 0.0000 0.0811 0.0074 0.0244 0.0000 0.0811 3.3166 0.0000 0.0000 0.0134 0.0000 0.0000 0.0000 0.0000
54-GC 0.0000 0.0000 0.0047 0.0047 0.0870 0.0120 0.0259 0.0047 0.0870 2.1523 0.0007 0.0000 0.0161 0.0000 0.0047 0.0022 0.0024
55-GC 0.0000 0.0190 0.0222 0.0222 0.0417 0.0197 0.0108 0.0032 0.0417 0.5470 0.0097 0.0001 0.0067 0.0190 0.0222 0.0214 0.0015
56-GC 0.0000 0.0000 0.0000 0.6000 0.7500 0.2864 0.3317 0.6000 0.7500 1.1584 0.0015 0.0000 0.3124 0.0000 0.7500 0.2864 0.3317
57-GC 0.0035 0.0204 0.1333 0.1667 0.5000 0.1259 0.1436 0.1463 0.4965 1.1403 0.0592 0.0213 0.0990 0.0035 0.1667 0.0885 0.0762
58-GC 0.0000 0.0000 0.0180 0.0886 0.1364 0.0445 0.0506 0.0886 0.1364 1.1360 0.0013 0.0000 0.0453 0.0000 0.1364 0.0445 0.0506
59-GC 0.0000 0.0000 0.0062 0.0062 0.0093 0.0037 0.0036 0.0062 0.0093 0.9877 0.0003 0.0000 0.0034 0.0000 0.0093 0.0037 0.0036
60-GC 0.0000 0.0000 0.4375 0.7250 1.0000 0.3622 0.3834 0.7250 1.0000 1.0585 0.0077 0.0000 0.3276 0.0000 1.0000 0.3622 0.3834
61-GC 0.0000 0.0845 0.0845 0.2174 0.6250 0.1721 0.1691 0.1329 0.6250 0.9827 0.0610 0.0001 0.1153 0.0000 0.2174 0.1268 0.0819
62-GC 0.0000 0.0000 0.0139 0.0739 0.1299 0.0399 0.0462 0.0739 0.1299 1.1569 0.0012 0.0000 0.0410 0.0000 0.1299 0.0399 0.0462
63-GC 0.0072 0.0234 0.0261 0.0441 0.0870 0.0368 0.0274 0.0207 0.0798 0.7439 0.0283 0.0210 0.0209 0.0072 0.0441 0.0256 0.0129
64-GC 0.0000 0.0000 0.0118 0.0303 0.0577 0.0165 0.0200 0.0303 0.0577 1.2147 0.0007 0.0000 0.0167 0.0000 0.0577 0.0165 0.0200
65-GC 0.0000 0.0000 0.0000 0.5672 0.8667 0.2755 0.3657 0.5672 0.8667 1.3276 0.0014 0.0000 0.3211 0.0000 0.8667 0.2755 0.3657
66-GC 0.0000 0.0000 0.0000 1.0000 1.0000 0.3732 0.4979 1.0000 1.0000 1.3341 0.0015 0.0000 0.4559 0.0000 1.0000 0.3732 0.4979
67-GC 0.1523 0.1523 0.3662 0.3662 0.5349 0.3042 0.1310 0.2139 0.3826 0.4307 0.2756 0.2470 0.1104 0.1523 0.5349 0.3042 0.1310
68-GC 0.0000 0.0241 0.3827 0.4286 0.4310 0.2348 0.2071 0.4044 0.4310 0.8823 0.0295 0.0001 0.1956 0.0000 0.4310 0.2348 0.2071
69-GC 0.0000 0.0000 0.0227 1.0000 1.0000 0.4566 0.5203 1.0000 1.0000 1.1395 0.0038 0.0000 0.4940 0.0000 1.0000 0.4566 0.5203
70-GC 0.0000 0.0000 0.0000 0.0000 0.0549 0.0080 0.0184 0.0000 0.0549 2.3083 0.0000 0.0000 0.0131 0.0000 0.0000 0.0000 0.0000
71-GC 0.0000 0.0000 0.0774 0.4747 0.4796 0.2233 0.2427 0.4747 0.4796 1.0872 0.0030 0.0000 0.2295 0.0000 0.4796 0.2233 0.2427
72-GC 0.0000 0.0000 0.0000 0.0556 0.0556 0.0253 0.0290 0.0556 0.0556 1.1489 0.0005 0.0000 0.0275 0.0000 0.0556 0.0253 0.0290
73-GC 0.0000 0.0000 0.0000 0.0000 0.5714 0.0519 0.1723 0.0000 0.5714 3.3166 0.0000 0.0000 0.0945 0.0000 0.0000 0.0000 0.0000
74-GC 0.0000 0.0000 0.1484 0.3151 0.3151 0.1497 0.1514 0.3151 0.3151 1.0114 0.0026 0.0000 0.1363 0.0000 0.3151 0.1497 0.1514
75-GC 0.0000 0.0000 0.1319 0.1319 0.4583 0.1026 0.1357 0.1319 0.4583 1.3228 0.0020 0.0000 0.0933 0.0000 0.1429 0.0670 0.0707
93
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-PT-CLEF2007
Statistics for Precision at the 40% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0028 0.1364 0.1364 0.0507 0.0679 0.1364 0.1364 1.3388 0.0010 0.0000 0.0623 0.0000 0.1364 0.0507 0.0679
52-GC 0.0000 0.0000 0.0255 0.0255 0.3415 0.0538 0.1046 0.0255 0.3415 1.9435 0.0011 0.0000 0.0696 0.0000 0.0255 0.0113 0.0134
53-GC 0.0000 0.0000 0.0000 0.0000 0.0811 0.0074 0.0244 0.0000 0.0811 3.3166 0.0000 0.0000 0.0134 0.0000 0.0000 0.0000 0.0000
54-GC 0.0000 0.0000 0.0047 0.0047 0.0870 0.0116 0.0258 0.0047 0.0870 2.2253 0.0004 0.0000 0.0156 0.0000 0.0047 0.0021 0.0025
55-GC 0.0000 0.0190 0.0222 0.0222 0.0417 0.0197 0.0108 0.0032 0.0417 0.5470 0.0097 0.0001 0.0067 0.0190 0.0222 0.0214 0.0015
56-GC 0.0000 0.0000 0.0000 0.3846 0.7500 0.2080 0.2604 0.3846 0.7500 1.2517 0.0013 0.0000 0.2270 0.0000 0.7500 0.2080 0.2604
57-GC 0.0035 0.0204 0.1333 0.1667 0.5000 0.1259 0.1436 0.1463 0.4965 1.1403 0.0592 0.0213 0.0990 0.0035 0.1667 0.0885 0.0762
58-GC 0.0000 0.0000 0.0180 0.0362 0.1364 0.0255 0.0401 0.0362 0.1364 1.5767 0.0009 0.0000 0.0258 0.0000 0.0410 0.0144 0.0169
59-GC 0.0000 0.0000 0.0062 0.0062 0.0093 0.0037 0.0036 0.0062 0.0093 0.9877 0.0003 0.0000 0.0034 0.0000 0.0093 0.0037 0.0036
60-GC 0.0000 0.0000 0.4375 0.7250 0.8333 0.3470 0.3581 0.7250 0.8333 1.0319 0.0076 0.0000 0.3138 0.0000 0.8333 0.3470 0.3581
61-GC 0.0000 0.0845 0.0845 0.1944 0.2500 0.1270 0.0811 0.1099 0.2500 0.6389 0.0507 0.0001 0.0714 0.0000 0.2500 0.1270 0.0811
62-GC 0.0000 0.0000 0.0139 0.0739 0.1299 0.0399 0.0462 0.0739 0.1299 1.1569 0.0012 0.0000 0.0410 0.0000 0.1299 0.0399 0.0462
63-GC 0.0000 0.0171 0.0261 0.0261 0.0441 0.0233 0.0133 0.0090 0.0441 0.5706 0.0114 0.0001 0.0096 0.0072 0.0261 0.0210 0.0068
64-GC 0.0000 0.0000 0.0118 0.0292 0.0577 0.0159 0.0194 0.0292 0.0577 1.2212 0.0007 0.0000 0.0160 0.0000 0.0577 0.0159 0.0194
65-GC 0.0000 0.0000 0.0000 0.5204 0.8043 0.2475 0.3416 0.5204 0.8043 1.3803 0.0013 0.0000 0.3017 0.0000 0.8043 0.2475 0.3416
66-GC 0.0000 0.0000 0.0000 0.8571 0.8571 0.3213 0.4260 0.8571 0.8571 1.3260 0.0014 0.0000 0.3897 0.0000 0.8571 0.3213 0.4260
67-GC 0.1523 0.1523 0.3488 0.3488 0.4839 0.2910 0.1171 0.1966 0.3316 0.4025 0.2668 0.2421 0.1009 0.1523 0.4839 0.2910 0.1171
68-GC 0.0000 0.0000 0.1441 0.2807 0.3556 0.1458 0.1483 0.2807 0.3556 1.0173 0.0053 0.0000 0.1253 0.0000 0.3556 0.1458 0.1483
69-GC 0.0000 0.0000 0.0124 0.4167 0.5000 0.1981 0.2265 0.4167 0.5000 1.1432 0.0024 0.0000 0.2138 0.0000 0.5000 0.1981 0.2265
70-GC 0.0000 0.0000 0.0000 0.0000 0.0549 0.0075 0.0178 0.0000 0.0549 2.3696 0.0000 0.0000 0.0123 0.0000 0.0000 0.0000 0.0000
71-GC 0.0000 0.0000 0.0722 0.3621 0.3621 0.1699 0.1826 0.3621 0.3621 1.0748 0.0026 0.0000 0.1722 0.0000 0.3621 0.1699 0.1826
72-GC 0.0000 0.0000 0.0000 0.0556 0.0556 0.0253 0.0290 0.0556 0.0556 1.1489 0.0005 0.0000 0.0275 0.0000 0.0556 0.0253 0.0290
73-GC 0.0000 0.0000 0.0000 0.0000 0.4167 0.0379 0.1256 0.0000 0.4167 3.3166 0.0000 0.0000 0.0689 0.0000 0.0000 0.0000 0.0000
74-GC 0.0000 0.0000 0.0930 0.2976 0.2976 0.1293 0.1408 0.2976 0.2976 1.0891 0.0023 0.0000 0.1241 0.0000 0.2976 0.1293 0.1408
75-GC 0.0000 0.0000 0.0631 0.1287 0.3824 0.0873 0.1152 0.1287 0.3824 1.3191 0.0018 0.0000 0.0838 0.0000 0.1287 0.0578 0.0640
94
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-PT-CLEF2007
Statistics for Precision at the 50% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0028 0.1364 0.1364 0.0507 0.0679 0.1364 0.1364 1.3388 0.0010 0.0000 0.0623 0.0000 0.1364 0.0507 0.0679
52-GC 0.0000 0.0000 0.0000 0.0000 0.2500 0.0282 0.0758 0.0000 0.2500 2.6855 0.0001 0.0000 0.0462 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0000 0.0000 0.0811 0.0074 0.0244 0.0000 0.0811 3.3166 0.0000 0.0000 0.0134 0.0000 0.0000 0.0000 0.0000
54-GC 0.0000 0.0000 0.0047 0.0047 0.0870 0.0116 0.0258 0.0047 0.0870 2.2253 0.0004 0.0000 0.0156 0.0000 0.0047 0.0021 0.0025
55-GC 0.0000 0.0000 0.0000 0.0085 0.0360 0.0064 0.0107 0.0085 0.0360 1.6763 0.0002 0.0000 0.0070 0.0000 0.0085 0.0034 0.0044
56-GC 0.0000 0.0000 0.0000 0.3846 0.7500 0.2080 0.2604 0.3846 0.7500 1.2517 0.0013 0.0000 0.2270 0.0000 0.7500 0.2080 0.2604
57-GC 0.0035 0.0204 0.1333 0.1667 0.5000 0.1259 0.1436 0.1463 0.4965 1.1403 0.0592 0.0213 0.0990 0.0035 0.1667 0.0885 0.0762
58-GC 0.0000 0.0000 0.0180 0.0358 0.1364 0.0252 0.0402 0.0358 0.1364 1.5942 0.0009 0.0000 0.0260 0.0000 0.0410 0.0141 0.0168
59-GC 0.0000 0.0000 0.0062 0.0062 0.0093 0.0037 0.0036 0.0062 0.0093 0.9877 0.0003 0.0000 0.0034 0.0000 0.0093 0.0037 0.0036
60-GC 0.0000 0.0000 0.4375 0.7250 0.8333 0.3470 0.3581 0.7250 0.8333 1.0319 0.0076 0.0000 0.3138 0.0000 0.8333 0.3470 0.3581
61-GC 0.0000 0.0833 0.0833 0.1944 0.2500 0.1254 0.0829 0.1111 0.2500 0.6612 0.0481 0.0001 0.0728 0.0000 0.2500 0.1254 0.0829
62-GC 0.0000 0.0000 0.0139 0.0739 0.1299 0.0399 0.0462 0.0739 0.1299 1.1569 0.0012 0.0000 0.0410 0.0000 0.1299 0.0399 0.0462
63-GC 0.0000 0.0171 0.0261 0.0261 0.0441 0.0233 0.0133 0.0090 0.0441 0.5706 0.0114 0.0001 0.0096 0.0072 0.0261 0.0210 0.0068
64-GC 0.0000 0.0000 0.0000 0.0158 0.0577 0.0103 0.0173 0.0158 0.0577 1.6850 0.0003 0.0000 0.0113 0.0000 0.0177 0.0055 0.0076
65-GC 0.0000 0.0000 0.0000 0.3580 0.8043 0.2113 0.3254 0.3580 0.8043 1.5399 0.0005 0.0000 0.2690 0.0000 0.8043 0.2113 0.3254
66-GC 0.0000 0.0000 0.0000 0.5556 0.5556 0.2116 0.2744 0.5556 0.5556 1.2970 0.0012 0.0000 0.2502 0.0000 0.5556 0.2116 0.2744
67-GC 0.0000 0.1211 0.2708 0.2708 0.4471 0.2125 0.1262 0.1497 0.4471 0.5939 0.0850 0.0001 0.1051 0.0000 0.4471 0.2125 0.1262
68-GC 0.0000 0.0000 0.0000 0.0000 0.1567 0.0285 0.0634 0.0000 0.1567 2.2249 0.0001 0.0000 0.0466 0.0000 0.0000 0.0000 0.0000
69-GC 0.0000 0.0000 0.0124 0.4167 0.5000 0.1981 0.2265 0.4167 0.5000 1.1432 0.0024 0.0000 0.2138 0.0000 0.5000 0.1981 0.2265
70-GC 0.0000 0.0000 0.0000 0.0000 0.0549 0.0050 0.0166 0.0000 0.0549 3.3166 0.0000 0.0000 0.0091 0.0000 0.0000 0.0000 0.0000
71-GC 0.0000 0.0000 0.0000 0.2609 0.2609 0.1157 0.1332 0.2609 0.2609 1.1515 0.0010 0.0000 0.1262 0.0000 0.2609 0.1157 0.1332
72-GC 0.0000 0.0000 0.0000 0.0463 0.0463 0.0210 0.0242 0.0463 0.0463 1.1489 0.0005 0.0000 0.0229 0.0000 0.0463 0.0210 0.0242
73-GC 0.0000 0.0000 0.0000 0.0000 0.4000 0.0364 0.1206 0.0000 0.4000 3.3166 0.0000 0.0000 0.0661 0.0000 0.0000 0.0000 0.0000
74-GC 0.0000 0.0000 0.0789 0.1600 0.1600 0.0764 0.0770 0.1600 0.1600 1.0067 0.0018 0.0000 0.0695 0.0000 0.1600 0.0764 0.0770
75-GC 0.0000 0.0000 0.0416 0.0505 0.2742 0.0471 0.0792 0.0505 0.2742 1.6832 0.0012 0.0000 0.0438 0.0000 0.0505 0.0243 0.0258
95
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-PT-CLEF2007
Statistics for Precision at the 60% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0000 0.1364 0.1364 0.0505 0.0681 0.1364 0.1364 1.3494 0.0006 0.0000 0.0624 0.0000 0.1364 0.0505 0.0681
52-GC 0.0000 0.0000 0.0000 0.0000 0.2500 0.0254 0.0750 0.0000 0.2500 2.9545 0.0001 0.0000 0.0415 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0000 0.0000 0.0615 0.0056 0.0186 0.0000 0.0615 3.3166 0.0000 0.0000 0.0102 0.0000 0.0000 0.0000 0.0000
54-GC 0.0000 0.0000 0.0047 0.0047 0.0870 0.0116 0.0258 0.0047 0.0870 2.2253 0.0004 0.0000 0.0156 0.0000 0.0047 0.0021 0.0025
55-GC 0.0000 0.0000 0.0000 0.0085 0.0360 0.0064 0.0107 0.0085 0.0360 1.6763 0.0002 0.0000 0.0070 0.0000 0.0085 0.0034 0.0044
56-GC 0.0000 0.0000 0.0000 0.3529 0.7500 0.1965 0.2522 0.3529 0.7500 1.2832 0.0012 0.0000 0.2144 0.0000 0.7500 0.1965 0.2522
57-GC 0.0000 0.0000 0.0800 0.0800 0.2500 0.0643 0.0778 0.0800 0.2500 1.2102 0.0027 0.0000 0.0578 0.0000 0.1333 0.0457 0.0500
58-GC 0.0000 0.0000 0.0180 0.0358 0.1287 0.0245 0.0381 0.0358 0.1287 1.5535 0.0008 0.0000 0.0250 0.0000 0.0410 0.0141 0.0168
59-GC 0.0000 0.0000 0.0062 0.0062 0.0093 0.0037 0.0036 0.0062 0.0093 0.9877 0.0003 0.0000 0.0034 0.0000 0.0093 0.0037 0.0036
60-GC 0.0000 0.0000 0.4167 0.4844 0.8333 0.2849 0.2929 0.4844 0.8333 1.0280 0.0068 0.0000 0.2574 0.0000 0.8333 0.2849 0.2929
61-GC 0.0000 0.0708 0.0708 0.1765 0.2353 0.1130 0.0774 0.1057 0.2353 0.6846 0.0436 0.0001 0.0684 0.0000 0.2353 0.1130 0.0774
62-GC 0.0000 0.0000 0.0139 0.0739 0.1081 0.0380 0.0423 0.0739 0.1081 1.1134 0.0011 0.0000 0.0389 0.0000 0.1081 0.0380 0.0423
63-GC 0.0000 0.0092 0.0102 0.0183 0.0220 0.0119 0.0077 0.0092 0.0220 0.6481 0.0037 0.0001 0.0060 0.0000 0.0220 0.0119 0.0077
64-GC 0.0000 0.0000 0.0000 0.0092 0.0148 0.0044 0.0063 0.0092 0.0148 1.4459 0.0001 0.0000 0.0056 0.0000 0.0148 0.0044 0.0063
65-GC 0.0000 0.0000 0.0000 0.2630 0.8000 0.1933 0.3174 0.2630 0.8000 1.6423 0.0005 0.0000 0.2460 0.0000 0.2630 0.0584 0.1160
66-GC 0.0000 0.0000 0.0000 0.5556 0.5556 0.2116 0.2744 0.5556 0.5556 1.2970 0.0012 0.0000 0.2502 0.0000 0.5556 0.2116 0.2744
67-GC 0.0000 0.0000 0.2103 0.2103 0.3913 0.1371 0.1412 0.2103 0.3913 1.0295 0.0025 0.0000 0.1247 0.0000 0.3913 0.1371 0.1412
68-GC 0.0000 0.0000 0.0000 0.0000 0.1270 0.0231 0.0514 0.0000 0.1270 2.2249 0.0001 0.0000 0.0378 0.0000 0.0000 0.0000 0.0000
69-GC 0.0000 0.0000 0.0098 0.3158 0.4615 0.1577 0.1840 0.3158 0.4615 1.1668 0.0021 0.0000 0.1702 0.0000 0.4615 0.1577 0.1840
70-GC 0.0000 0.0000 0.0000 0.0000 0.0166 0.0015 0.0050 0.0000 0.0166 3.3166 0.0000 0.0000 0.0027 0.0000 0.0000 0.0000 0.0000
71-GC 0.0000 0.0000 0.0000 0.1710 0.1710 0.0769 0.0884 0.1710 0.1710 1.1494 0.0008 0.0000 0.0839 0.0000 0.1710 0.0769 0.0884
72-GC 0.0000 0.0000 0.0000 0.0463 0.0463 0.0210 0.0242 0.0463 0.0463 1.1489 0.0005 0.0000 0.0229 0.0000 0.0463 0.0210 0.0242
73-GC 0.0000 0.0000 0.0000 0.0000 0.2667 0.0242 0.0804 0.0000 0.2667 3.3166 0.0000 0.0000 0.0441 0.0000 0.0000 0.0000 0.0000
74-GC 0.0000 0.0000 0.0661 0.1324 0.1324 0.0622 0.0631 0.1324 0.1324 1.0137 0.0016 0.0000 0.0566 0.0000 0.1324 0.0622 0.0631
75-GC 0.0000 0.0000 0.0333 0.0333 0.1680 0.0311 0.0487 0.0333 0.1680 1.5672 0.0010 0.0000 0.0282 0.0000 0.0402 0.0174 0.0184
96
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-PT-CLEF2007
Statistics for Precision at the 70% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0000 0.1364 0.1364 0.0505 0.0681 0.1364 0.1364 1.3494 0.0006 0.0000 0.0624 0.0000 0.1364 0.0505 0.0681
52-GC 0.0000 0.0000 0.0000 0.0000 0.1592 0.0171 0.0479 0.0000 0.1592 2.7973 0.0000 0.0000 0.0280 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0000 0.0000 0.0065 0.0006 0.0020 0.0000 0.0065 3.3166 0.0000 0.0000 0.0011 0.0000 0.0000 0.0000 0.0000
54-GC 0.0000 0.0000 0.0000 0.0000 0.0217 0.0023 0.0065 0.0000 0.0217 2.8681 0.0000 0.0000 0.0037 0.0000 0.0000 0.0000 0.0000
55-GC 0.0000 0.0000 0.0000 0.0000 0.0360 0.0033 0.0109 0.0000 0.0360 3.3166 0.0000 0.0000 0.0060 0.0000 0.0000 0.0000 0.0000
56-GC 0.0000 0.0000 0.0000 0.3500 0.6364 0.1851 0.2276 0.3500 0.6364 1.2294 0.0012 0.0000 0.2020 0.0000 0.6364 0.1851 0.2276
57-GC 0.0000 0.0000 0.0800 0.0800 0.2500 0.0643 0.0778 0.0800 0.2500 1.2102 0.0027 0.0000 0.0578 0.0000 0.1333 0.0457 0.0500
58-GC 0.0000 0.0000 0.0173 0.0330 0.1154 0.0225 0.0341 0.0330 0.1154 1.5133 0.0008 0.0000 0.0222 0.0000 0.0372 0.0132 0.0154
59-GC 0.0000 0.0000 0.0062 0.0062 0.0093 0.0037 0.0036 0.0062 0.0093 0.9877 0.0003 0.0000 0.0034 0.0000 0.0093 0.0037 0.0036
60-GC 0.0000 0.0000 0.3684 0.4375 0.4615 0.2324 0.2226 0.4375 0.4615 0.9578 0.0062 0.0000 0.2096 0.0000 0.4615 0.2324 0.2226
61-GC 0.0000 0.0162 0.0187 0.0730 0.1282 0.0458 0.0401 0.0568 0.1282 0.8758 0.0175 0.0001 0.0348 0.0000 0.1282 0.0458 0.0401
62-GC 0.0000 0.0000 0.0000 0.0664 0.1007 0.0333 0.0395 0.0664 0.1007 1.1853 0.0006 0.0000 0.0363 0.0000 0.1007 0.0333 0.0395
63-GC 0.0000 0.0000 0.0000 0.0085 0.0177 0.0054 0.0071 0.0085 0.0177 1.3027 0.0002 0.0000 0.0059 0.0000 0.0177 0.0054 0.0071
64-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0000 0.0000 0.2065 0.3190 0.0955 0.1373 0.2065 0.3190 1.4365 0.0004 0.0000 0.1216 0.0000 0.3190 0.0955 0.1373
66-GC 0.0000 0.0000 0.0000 0.5556 0.5556 0.2110 0.2747 0.5556 0.5556 1.3017 0.0012 0.0000 0.2506 0.0000 0.5556 0.2110 0.2747
67-GC 0.0000 0.0000 0.1518 0.1518 0.3313 0.1053 0.1133 0.1518 0.3313 1.0756 0.0021 0.0000 0.0957 0.0000 0.3313 0.1053 0.1133
68-GC 0.0000 0.0000 0.0000 0.0000 0.0958 0.0174 0.0388 0.0000 0.0958 2.2249 0.0001 0.0000 0.0285 0.0000 0.0000 0.0000 0.0000
69-GC 0.0000 0.0000 0.0098 0.2414 0.3750 0.1228 0.1442 0.2414 0.3750 1.1749 0.0019 0.0000 0.1321 0.0000 0.3750 0.1228 0.1442
70-GC 0.0000 0.0000 0.0000 0.0000 0.0091 0.0008 0.0027 0.0000 0.0091 3.3166 0.0000 0.0000 0.0015 0.0000 0.0000 0.0000 0.0000
71-GC 0.0000 0.0000 0.0000 0.0000 0.1183 0.0108 0.0357 0.0000 0.1183 3.3166 0.0000 0.0000 0.0196 0.0000 0.0000 0.0000 0.0000
72-GC 0.0000 0.0000 0.0000 0.0417 0.0417 0.0190 0.0218 0.0417 0.0417 1.1489 0.0004 0.0000 0.0207 0.0000 0.0417 0.0190 0.0218
73-GC 0.0000 0.0000 0.0000 0.0000 0.2195 0.0200 0.0662 0.0000 0.2195 3.3166 0.0000 0.0000 0.0363 0.0000 0.0000 0.0000 0.0000
74-GC 0.0000 0.0000 0.0634 0.0810 0.0810 0.0420 0.0405 0.0810 0.0810 0.9650 0.0013 0.0000 0.0382 0.0000 0.0810 0.0420 0.0405
75-GC 0.0000 0.0000 0.0000 0.0292 0.1176 0.0213 0.0350 0.0292 0.1176 1.6428 0.0004 0.0000 0.0232 0.0000 0.0292 0.0117 0.0151
97
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-PT-CLEF2007
Statistics for Precision at the 80% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0000 0.0426 0.0426 0.0155 0.0215 0.0426 0.0426 1.3874 0.0002 0.0000 0.0197 0.0000 0.0426 0.0155 0.0215
52-GC 0.0000 0.0000 0.0000 0.0000 0.0361 0.0059 0.0132 0.0000 0.0361 2.2416 0.0000 0.0000 0.0097 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0000 0.0000 0.0065 0.0006 0.0020 0.0000 0.0065 3.3166 0.0000 0.0000 0.0011 0.0000 0.0000 0.0000 0.0000
54-GC 0.0000 0.0000 0.0000 0.0000 0.0217 0.0023 0.0065 0.0000 0.0217 2.8681 0.0000 0.0000 0.0037 0.0000 0.0000 0.0000 0.0000
55-GC 0.0000 0.0000 0.0000 0.0000 0.0360 0.0033 0.0109 0.0000 0.0360 3.3166 0.0000 0.0000 0.0060 0.0000 0.0000 0.0000 0.0000
56-GC 0.0000 0.0000 0.0000 0.3478 0.5714 0.1784 0.2145 0.3478 0.5714 1.2023 0.0012 0.0000 0.1947 0.0000 0.5714 0.1784 0.2145
57-GC 0.0000 0.0000 0.0800 0.0800 0.2500 0.0643 0.0778 0.0800 0.2500 1.2102 0.0027 0.0000 0.0578 0.0000 0.1333 0.0457 0.0500
58-GC 0.0000 0.0000 0.0173 0.0299 0.0372 0.0151 0.0158 0.0299 0.0372 1.0508 0.0007 0.0000 0.0137 0.0000 0.0372 0.0151 0.0158
59-GC 0.0000 0.0000 0.0062 0.0062 0.0093 0.0037 0.0036 0.0062 0.0093 0.9877 0.0003 0.0000 0.0034 0.0000 0.0093 0.0037 0.0036
60-GC 0.0000 0.0000 0.3500 0.3778 0.4375 0.2121 0.2034 0.3778 0.4375 0.9592 0.0059 0.0000 0.1912 0.0000 0.4375 0.2121 0.2034
61-GC 0.0000 0.0000 0.0187 0.0220 0.1158 0.0202 0.0335 0.0220 0.1158 1.6535 0.0008 0.0000 0.0187 0.0000 0.0220 0.0107 0.0113
62-GC 0.0000 0.0000 0.0000 0.0516 0.0955 0.0275 0.0339 0.0516 0.0955 1.2347 0.0005 0.0000 0.0299 0.0000 0.0955 0.0275 0.0339
63-GC 0.0000 0.0000 0.0000 0.0085 0.0177 0.0054 0.0071 0.0085 0.0177 1.3027 0.0002 0.0000 0.0059 0.0000 0.0177 0.0054 0.0071
64-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
66-GC 0.0000 0.0000 0.0000 0.5000 0.5000 0.1904 0.2470 0.5000 0.5000 1.2970 0.0012 0.0000 0.2251 0.0000 0.5000 0.1904 0.2470
67-GC 0.0000 0.0000 0.1336 0.1336 0.2727 0.0903 0.0952 0.1336 0.2727 1.0548 0.0020 0.0000 0.0821 0.0000 0.2727 0.0903 0.0952
68-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
69-GC 0.0000 0.0000 0.0098 0.2286 0.3750 0.1181 0.1401 0.2286 0.3750 1.1863 0.0019 0.0000 0.1271 0.0000 0.3750 0.1181 0.1401
70-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.0000 0.0000 0.0000 0.0414 0.0414 0.0188 0.0216 0.0414 0.0414 1.1489 0.0004 0.0000 0.0205 0.0000 0.0414 0.0188 0.0216
73-GC 0.0000 0.0000 0.0000 0.0000 0.0565 0.0051 0.0170 0.0000 0.0565 3.3166 0.0000 0.0000 0.0093 0.0000 0.0000 0.0000 0.0000
74-GC 0.0000 0.0000 0.0510 0.0510 0.0666 0.0303 0.0294 0.0510 0.0666 0.9718 0.0011 0.0000 0.0275 0.0000 0.0666 0.0303 0.0294
75-GC 0.0000 0.0000 0.0000 0.0000 0.1008 0.0092 0.0304 0.0000 0.1008 3.3166 0.0000 0.0000 0.0167 0.0000 0.0000 0.0000 0.0000
98
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-PT-CLEF2007
Statistics for Precision at the 90% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0000 0.0426 0.0426 0.0155 0.0215 0.0426 0.0426 1.3874 0.0002 0.0000 0.0197 0.0000 0.0426 0.0155 0.0215
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
54-GC 0.0000 0.0000 0.0000 0.0000 0.0217 0.0023 0.0065 0.0000 0.0217 2.8681 0.0000 0.0000 0.0037 0.0000 0.0000 0.0000 0.0000
55-GC 0.0000 0.0000 0.0000 0.0000 0.0128 0.0012 0.0039 0.0000 0.0128 3.3166 0.0000 0.0000 0.0021 0.0000 0.0000 0.0000 0.0000
56-GC 0.0000 0.0000 0.0000 0.3214 0.4500 0.1578 0.1849 0.3214 0.4500 1.1718 0.0012 0.0000 0.1721 0.0000 0.4500 0.1578 0.1849
57-GC 0.0000 0.0000 0.0800 0.0800 0.2500 0.0643 0.0778 0.0800 0.2500 1.2102 0.0027 0.0000 0.0578 0.0000 0.1333 0.0457 0.0500
58-GC 0.0000 0.0000 0.0000 0.0150 0.0300 0.0073 0.0127 0.0150 0.0300 1.7495 0.0001 0.0000 0.0106 0.0000 0.0300 0.0073 0.0127
59-GC 0.0000 0.0000 0.0062 0.0062 0.0093 0.0037 0.0036 0.0062 0.0093 0.9877 0.0003 0.0000 0.0034 0.0000 0.0093 0.0037 0.0036
60-GC 0.0000 0.0000 0.1951 0.3378 0.3810 0.1621 0.1640 0.3378 0.3810 1.0115 0.0050 0.0000 0.1458 0.0000 0.3810 0.1621 0.1640
61-GC 0.0000 0.0000 0.0170 0.0220 0.0769 0.0165 0.0227 0.0220 0.0769 1.3695 0.0007 0.0000 0.0150 0.0000 0.0220 0.0105 0.0112
62-GC 0.0000 0.0000 0.0000 0.0000 0.0833 0.0076 0.0251 0.0000 0.0833 3.3166 0.0000 0.0000 0.0138 0.0000 0.0000 0.0000 0.0000
63-GC 0.0000 0.0000 0.0000 0.0000 0.0137 0.0025 0.0056 0.0000 0.0137 2.2249 0.0000 0.0000 0.0041 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
66-GC 0.0000 0.0000 0.0000 0.1935 0.1935 0.0704 0.0976 0.1935 0.1935 1.3874 0.0004 0.0000 0.0896 0.0000 0.1935 0.0704 0.0976
67-GC 0.0000 0.0000 0.1252 0.1290 0.2125 0.0776 0.0782 0.1290 0.2125 1.0075 0.0018 0.0000 0.0706 0.0000 0.2125 0.0776 0.0782
68-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
69-GC 0.0000 0.0000 0.0098 0.0332 0.3750 0.0471 0.1099 0.0332 0.3750 2.3354 0.0009 0.0000 0.0596 0.0000 0.0332 0.0143 0.0166
70-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
73-GC 0.0000 0.0000 0.0000 0.0000 0.0372 0.0034 0.0112 0.0000 0.0372 3.3166 0.0000 0.0000 0.0061 0.0000 0.0000 0.0000 0.0000
74-GC 0.0000 0.0000 0.0000 0.0000 0.0626 0.0057 0.0189 0.0000 0.0626 3.3166 0.0000 0.0000 0.0103 0.0000 0.0000 0.0000 0.0000
75-GC 0.0000 0.0000 0.0000 0.0000 0.0769 0.0070 0.0232 0.0000 0.0769 3.3166 0.0000 0.0000 0.0127 0.0000 0.0000 0.0000 0.0000
99
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-PT-CLEF2007
Statistics for Precision at the 100% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0000 0.0426 0.0426 0.0155 0.0215 0.0426 0.0426 1.3874 0.0002 0.0000 0.0197 0.0000 0.0426 0.0155 0.0215
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
54-GC 0.0000 0.0000 0.0000 0.0000 0.0217 0.0023 0.0065 0.0000 0.0217 2.8681 0.0000 0.0000 0.0037 0.0000 0.0000 0.0000 0.0000
55-GC 0.0000 0.0000 0.0000 0.0000 0.0128 0.0012 0.0039 0.0000 0.0128 3.3166 0.0000 0.0000 0.0021 0.0000 0.0000 0.0000 0.0000
56-GC 0.0000 0.0000 0.0000 0.1299 0.1299 0.0487 0.0645 0.1299 0.1299 1.3248 0.0006 0.0000 0.0590 0.0000 0.1299 0.0487 0.0645
57-GC 0.0000 0.0000 0.0800 0.0800 0.2500 0.0643 0.0778 0.0800 0.2500 1.2102 0.0027 0.0000 0.0578 0.0000 0.1333 0.0457 0.0500
58-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
59-GC 0.0000 0.0000 0.0062 0.0062 0.0093 0.0037 0.0036 0.0062 0.0093 0.9877 0.0003 0.0000 0.0034 0.0000 0.0093 0.0037 0.0036
60-GC 0.0000 0.0000 0.1951 0.3378 0.3810 0.1621 0.1640 0.3378 0.3810 1.0115 0.0050 0.0000 0.1458 0.0000 0.3810 0.1621 0.1640
61-GC 0.0000 0.0000 0.0000 0.0000 0.0151 0.0014 0.0046 0.0000 0.0151 3.3166 0.0000 0.0000 0.0025 0.0000 0.0000 0.0000 0.0000
62-GC 0.0000 0.0000 0.0000 0.0000 0.0411 0.0037 0.0124 0.0000 0.0411 3.3166 0.0000 0.0000 0.0068 0.0000 0.0000 0.0000 0.0000
63-GC 0.0000 0.0000 0.0000 0.0000 0.0137 0.0025 0.0056 0.0000 0.0137 2.2249 0.0000 0.0000 0.0041 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
66-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
67-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
68-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
69-GC 0.0000 0.0000 0.0000 0.0000 0.1333 0.0121 0.0402 0.0000 0.1333 3.3166 0.0000 0.0000 0.0220 0.0000 0.0000 0.0000 0.0000
70-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
73-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
74-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
75-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
100
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-PT-CLEF2007
Statistics for P@5
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0000 0.2000 0.2000 0.0727 0.1009 0.2000 0.2000 1.3874 0.0004 0.0000 0.0926 0.0000 0.2000 0.0727 0.1009
52-GC 0.0000 0.0000 0.2000 0.2000 0.2000 0.1091 0.1044 0.2000 0.2000 0.9574 0.0022 0.0000 0.0992 0.0000 0.2000 0.1091 0.1044
53-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
54-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
55-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
56-GC 0.0000 0.0000 0.0000 0.6000 0.6000 0.2727 0.3133 0.6000 0.6000 1.1489 0.0015 0.0000 0.2975 0.0000 0.6000 0.2727 0.3133
57-GC 0.0000 0.0000 0.0000 0.0000 0.2000 0.0182 0.0603 0.0000 0.2000 3.3166 0.0000 0.0000 0.0331 0.0000 0.0000 0.0000 0.0000
58-GC 0.0000 0.0000 0.0000 0.2000 0.2000 0.0909 0.1044 0.2000 0.2000 1.1489 0.0009 0.0000 0.0992 0.0000 0.2000 0.0909 0.1044
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0000 0.0000 0.4000 0.7000 0.8000 0.3273 0.3495 0.7000 0.8000 1.0681 0.0039 0.0000 0.2975 0.0000 0.8000 0.3273 0.3495
61-GC 0.0000 0.2000 0.2000 0.4000 0.4000 0.2727 0.1348 0.2000 0.4000 0.4944 0.1114 0.0001 0.1157 0.0000 0.4000 0.2727 0.1348
62-GC 0.0000 0.0000 0.0000 0.0000 0.2000 0.0182 0.0603 0.0000 0.2000 3.3166 0.0000 0.0000 0.0331 0.0000 0.0000 0.0000 0.0000
63-GC 0.0000 0.0000 0.0000 0.0000 0.2000 0.0364 0.0809 0.0000 0.2000 2.2249 0.0001 0.0000 0.0595 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0000 0.0000 0.6000 1.0000 0.3091 0.4134 0.6000 1.0000 1.3375 0.0015 0.0000 0.3570 0.0000 1.0000 0.3091 0.4134
66-GC 0.0000 0.0000 0.0000 1.0000 1.0000 0.3636 0.5045 1.0000 1.0000 1.3874 0.0007 0.0000 0.4628 0.0000 1.0000 0.3636 0.5045
67-GC 0.0000 0.4000 0.4000 0.8000 1.0000 0.5636 0.2942 0.4000 1.0000 0.5219 0.2135 0.0001 0.2512 0.0000 1.0000 0.5636 0.2942
68-GC 0.0000 0.4500 0.6000 1.0000 1.0000 0.6182 0.3737 0.5500 1.0000 0.6045 0.0942 0.0001 0.2777 0.0000 1.0000 0.6182 0.3737
69-GC 0.0000 0.0000 0.0000 0.6000 0.6000 0.2727 0.3133 0.6000 0.6000 1.1489 0.0015 0.0000 0.2975 0.0000 0.6000 0.2727 0.3133
70-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
71-GC 0.0000 0.0000 0.2000 0.8000 0.8000 0.3455 0.3804 0.8000 0.8000 1.1012 0.0039 0.0000 0.3405 0.0000 0.8000 0.3455 0.3804
72-GC 0.0000 0.0000 0.0000 0.8000 0.8000 0.2909 0.4036 0.8000 0.8000 1.3874 0.0006 0.0000 0.3702 0.0000 0.8000 0.2909 0.4036
73-GC 0.0000 0.0000 0.0000 0.0000 0.6000 0.0545 0.1809 0.0000 0.6000 3.3166 0.0000 0.0000 0.0992 0.0000 0.0000 0.0000 0.0000
74-GC 0.0000 0.2000 0.2000 0.2000 0.6000 0.2000 0.1549 0.0000 0.6000 0.7746 0.0365 0.0001 0.0727 0.2000 0.2000 0.2000 0.0000
75-GC 0.0000 0.2000 0.2000 0.4000 0.8000 0.2909 0.2256 0.2000 0.8000 0.7756 0.0482 0.0001 0.1719 0.0000 0.4000 0.2400 0.1578
101
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-PT-CLEF2007
Statistics for P@10
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0000 0.1000 0.1000 0.0364 0.0505 0.1000 0.1000 1.3874 0.0003 0.0000 0.0463 0.0000 0.1000 0.0364 0.0505
52-GC 0.0000 0.0000 0.1000 0.1000 0.3000 0.0727 0.0905 0.1000 0.3000 1.2437 0.0017 0.0000 0.0661 0.0000 0.1000 0.0500 0.0527
53-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
54-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
55-GC 0.0000 0.0000 0.0000 0.1000 0.1000 0.0364 0.0505 0.1000 0.1000 1.3874 0.0003 0.0000 0.0463 0.0000 0.1000 0.0364 0.0505
56-GC 0.0000 0.0000 0.0000 0.3000 0.6000 0.1636 0.2063 0.3000 0.6000 1.2605 0.0012 0.0000 0.1785 0.0000 0.6000 0.1636 0.2063
57-GC 0.0000 0.0000 0.1000 0.1000 0.2000 0.0636 0.0674 0.1000 0.2000 1.0595 0.0016 0.0000 0.0579 0.0000 0.2000 0.0636 0.0674
58-GC 0.0000 0.0000 0.0000 0.4000 0.4000 0.1545 0.1968 0.4000 0.4000 1.2734 0.0011 0.0000 0.1785 0.0000 0.4000 0.1545 0.1968
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0000 0.0000 0.3000 0.4750 0.5000 0.2273 0.2284 0.4750 0.5000 1.0051 0.0033 0.0000 0.2066 0.0000 0.5000 0.2273 0.2284
61-GC 0.0000 0.1000 0.1000 0.2000 0.5000 0.1636 0.1286 0.1000 0.5000 0.7861 0.0645 0.0001 0.0876 0.0000 0.2000 0.1300 0.0675
62-GC 0.0000 0.0000 0.0000 0.0000 0.1000 0.0091 0.0302 0.0000 0.1000 3.3166 0.0000 0.0000 0.0165 0.0000 0.0000 0.0000 0.0000
63-GC 0.0000 0.0000 0.0000 0.0000 0.1000 0.0182 0.0405 0.0000 0.1000 2.2249 0.0001 0.0000 0.0298 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0000 0.0000 0.7000 1.0000 0.3273 0.4292 0.7000 1.0000 1.3113 0.0015 0.0000 0.3802 0.0000 1.0000 0.3273 0.4292
66-GC 0.0000 0.0000 0.0000 0.6000 0.6000 0.2182 0.3027 0.6000 0.6000 1.3874 0.0005 0.0000 0.2777 0.0000 0.6000 0.2182 0.3027
67-GC 0.3000 0.3000 0.3000 0.6000 0.9000 0.4636 0.2063 0.3000 0.6000 0.4449 0.4265 0.3960 0.1785 0.3000 0.9000 0.4636 0.2063
68-GC 0.0000 0.3250 0.7000 0.9000 1.0000 0.5727 0.3744 0.5750 1.0000 0.6537 0.0860 0.0001 0.3207 0.0000 1.0000 0.5727 0.3744
69-GC 0.0000 0.0000 0.0000 0.3000 0.5000 0.1545 0.1864 0.3000 0.5000 1.2058 0.0011 0.0000 0.1686 0.0000 0.5000 0.1545 0.1864
70-GC 0.0000 0.0000 0.0000 0.0000 0.1000 0.0091 0.0302 0.0000 0.1000 3.3166 0.0000 0.0000 0.0165 0.0000 0.0000 0.0000 0.0000
71-GC 0.0000 0.1000 0.1000 0.8000 0.8000 0.3909 0.3590 0.7000 0.8000 0.9185 0.1085 0.0001 0.3355 0.0000 0.8000 0.3909 0.3590
72-GC 0.0000 0.0000 0.0000 0.4000 0.4000 0.1455 0.2018 0.4000 0.4000 1.3874 0.0005 0.0000 0.1851 0.0000 0.4000 0.1455 0.2018
73-GC 0.0000 0.0000 0.0000 0.0000 0.4000 0.0364 0.1206 0.0000 0.4000 3.3166 0.0000 0.0000 0.0661 0.0000 0.0000 0.0000 0.0000
74-GC 0.0000 0.1000 0.1000 0.2000 0.4000 0.1455 0.1128 0.1000 0.4000 0.7756 0.0273 0.0001 0.0860 0.0000 0.2000 0.1200 0.0789
75-GC 0.0000 0.2000 0.2000 0.2000 0.5000 0.1909 0.1300 0.0000 0.5000 0.6811 0.0359 0.0001 0.0694 0.2000 0.2000 0.2000 0.0000
102
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-PT-CLEF2007
Statistics for P@15
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0000 0.0667 0.0667 0.0242 0.0336 0.0667 0.0667 1.3874 0.0002 0.0000 0.0309 0.0000 0.0667 0.0242 0.0336
52-GC 0.0000 0.0000 0.0667 0.0667 0.3333 0.0788 0.1148 0.0667 0.3333 1.4567 0.0016 0.0000 0.0804 0.0000 0.0667 0.0296 0.0351
53-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
54-GC 0.0000 0.0000 0.0000 0.0000 0.0667 0.0061 0.0201 0.0000 0.0667 3.3166 0.0000 0.0000 0.0110 0.0000 0.0000 0.0000 0.0000
55-GC 0.0000 0.0000 0.0000 0.0667 0.0667 0.0242 0.0336 0.0667 0.0667 1.3874 0.0002 0.0000 0.0309 0.0000 0.0667 0.0242 0.0336
56-GC 0.0000 0.0000 0.0000 0.3333 0.5333 0.1697 0.2030 0.3333 0.5333 1.1963 0.0012 0.0000 0.1851 0.0000 0.5333 0.1697 0.2030
57-GC 0.0000 0.0000 0.0667 0.0667 0.1333 0.0485 0.0524 0.0667 0.1333 1.0811 0.0014 0.0000 0.0441 0.0000 0.1333 0.0485 0.0524
58-GC 0.0000 0.0000 0.0667 0.2667 0.2667 0.1091 0.1274 0.2667 0.2667 1.1683 0.0020 0.0000 0.1146 0.0000 0.2667 0.1091 0.1274
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0000 0.0000 0.3333 0.4000 0.4000 0.2061 0.1988 0.4000 0.4000 0.9647 0.0031 0.0000 0.1873 0.0000 0.4000 0.2061 0.1988
61-GC 0.0000 0.1333 0.1333 0.1333 0.3333 0.1333 0.0789 0.0000 0.3333 0.5916 0.0574 0.0001 0.0364 0.1333 0.1333 0.1333 0.0000
62-GC 0.0000 0.0000 0.0000 0.0000 0.0667 0.0061 0.0201 0.0000 0.0667 3.3166 0.0000 0.0000 0.0110 0.0000 0.0000 0.0000 0.0000
63-GC 0.0000 0.0000 0.0000 0.0000 0.0667 0.0121 0.0270 0.0000 0.0667 2.2249 0.0000 0.0000 0.0198 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0000 0.0000 0.7333 0.9333 0.3152 0.4175 0.7333 0.9333 1.3247 0.0015 0.0000 0.3769 0.0000 0.9333 0.3152 0.4175
66-GC 0.0000 0.0000 0.0000 0.4667 0.4667 0.1697 0.2354 0.4667 0.4667 1.3874 0.0005 0.0000 0.2160 0.0000 0.4667 0.1697 0.2354
67-GC 0.2667 0.2667 0.3333 0.4667 0.7333 0.3879 0.1485 0.2000 0.4667 0.3829 0.3657 0.3472 0.1201 0.2667 0.7333 0.3879 0.1485
68-GC 0.0000 0.2167 0.5333 0.8667 1.0000 0.5030 0.3834 0.6500 1.0000 0.7622 0.0728 0.0001 0.3240 0.0000 1.0000 0.5030 0.3834
69-GC 0.0000 0.0000 0.0000 0.3333 0.4000 0.1576 0.1820 0.3333 0.4000 1.1551 0.0012 0.0000 0.1719 0.0000 0.4000 0.1576 0.1820
70-GC 0.0000 0.0000 0.0000 0.0000 0.0667 0.0061 0.0201 0.0000 0.0667 3.3166 0.0000 0.0000 0.0110 0.0000 0.0000 0.0000 0.0000
71-GC 0.0000 0.0667 0.1333 0.6667 0.6667 0.3394 0.3148 0.6000 0.6667 0.9274 0.0908 0.0001 0.2975 0.0000 0.6667 0.3394 0.3148
72-GC 0.0000 0.0667 0.0667 0.3333 0.3333 0.1515 0.1463 0.2667 0.3333 0.9658 0.0241 0.0001 0.1322 0.0000 0.3333 0.1515 0.1463
73-GC 0.0000 0.0000 0.0000 0.0000 0.4000 0.0364 0.1206 0.0000 0.4000 3.3166 0.0000 0.0000 0.0661 0.0000 0.0000 0.0000 0.0000
74-GC 0.0000 0.1333 0.1333 0.3333 0.5333 0.2182 0.1662 0.2000 0.5333 0.7619 0.0375 0.0001 0.1410 0.0000 0.5333 0.2182 0.1662
75-GC 0.0000 0.1333 0.1333 0.3333 0.4000 0.2061 0.1444 0.2000 0.4000 0.7007 0.0366 0.0001 0.1278 0.0000 0.4000 0.2061 0.1444
103
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-PT-CLEF2007
Statistics for P@20
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0000 0.0500 0.0500 0.0182 0.0252 0.0500 0.0500 1.3874 0.0002 0.0000 0.0231 0.0000 0.0500 0.0182 0.0252
52-GC 0.0000 0.0500 0.1000 0.1000 0.2500 0.1000 0.0806 0.0500 0.2500 0.8062 0.0397 0.0001 0.0545 0.0000 0.1000 0.0667 0.0354
53-GC 0.0000 0.0000 0.0000 0.0000 0.0500 0.0045 0.0151 0.0000 0.0500 3.3166 0.0000 0.0000 0.0083 0.0000 0.0000 0.0000 0.0000
54-GC 0.0000 0.0000 0.0000 0.0000 0.0500 0.0045 0.0151 0.0000 0.0500 3.3166 0.0000 0.0000 0.0083 0.0000 0.0000 0.0000 0.0000
55-GC 0.0000 0.0000 0.0000 0.0500 0.0500 0.0182 0.0252 0.0500 0.0500 1.3874 0.0002 0.0000 0.0231 0.0000 0.0500 0.0182 0.0252
56-GC 0.0000 0.0000 0.0000 0.3500 0.4500 0.1682 0.1953 0.3500 0.4500 1.1612 0.0012 0.0000 0.1835 0.0000 0.4500 0.1682 0.1953
57-GC 0.0000 0.0000 0.0500 0.0500 0.1000 0.0364 0.0393 0.0500 0.1000 1.0811 0.0012 0.0000 0.0331 0.0000 0.1000 0.0364 0.0393
58-GC 0.0000 0.0000 0.0500 0.2000 0.2500 0.0909 0.1091 0.2000 0.2500 1.2004 0.0018 0.0000 0.0975 0.0000 0.2500 0.0909 0.1091
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0000 0.0000 0.3500 0.3500 0.3500 0.1909 0.1828 0.3500 0.3500 0.9574 0.0030 0.0000 0.1736 0.0000 0.3500 0.1909 0.1828
61-GC 0.0000 0.1500 0.1500 0.1500 0.2500 0.1364 0.0636 0.0000 0.2500 0.4664 0.0593 0.0001 0.0405 0.1500 0.1500 0.1500 0.0000
62-GC 0.0000 0.0000 0.0000 0.0500 0.1000 0.0273 0.0344 0.0500 0.1000 1.2605 0.0005 0.0000 0.0298 0.0000 0.1000 0.0273 0.0344
63-GC 0.0000 0.0000 0.0000 0.0000 0.0500 0.0091 0.0202 0.0000 0.0500 2.2249 0.0000 0.0000 0.0149 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0000 0.0000 0.7000 0.9500 0.3182 0.4137 0.7000 0.9500 1.3002 0.0015 0.0000 0.3686 0.0000 0.9500 0.3182 0.4137
66-GC 0.0000 0.0000 0.0000 0.5000 0.5000 0.1818 0.2523 0.5000 0.5000 1.3874 0.0005 0.0000 0.2314 0.0000 0.5000 0.1818 0.2523
67-GC 0.2000 0.3000 0.4000 0.4000 0.7000 0.3727 0.1272 0.1000 0.5000 0.3413 0.3559 0.3410 0.0843 0.2000 0.4000 0.3400 0.0699
68-GC 0.0000 0.1625 0.5000 0.8500 0.8500 0.4500 0.3557 0.6875 0.8500 0.7904 0.0643 0.0001 0.3091 0.0000 0.8500 0.4500 0.3557
69-GC 0.0000 0.0000 0.0000 0.3000 0.3000 0.1364 0.1567 0.3000 0.3000 1.1489 0.0011 0.0000 0.1488 0.0000 0.3000 0.1364 0.1567
70-GC 0.0000 0.0000 0.0000 0.0000 0.0500 0.0091 0.0202 0.0000 0.0500 2.2249 0.0000 0.0000 0.0149 0.0000 0.0000 0.0000 0.0000
71-GC 0.0000 0.0500 0.1000 0.6000 0.7000 0.3091 0.2998 0.5500 0.7000 0.9701 0.0770 0.0001 0.2826 0.0000 0.7000 0.3091 0.2998
72-GC 0.0000 0.1500 0.1500 0.2500 0.2500 0.1591 0.0917 0.1000 0.2500 0.5764 0.0314 0.0001 0.0661 0.1500 0.2500 0.1944 0.0527
73-GC 0.0000 0.0000 0.0000 0.0000 0.3000 0.0273 0.0905 0.0000 0.3000 3.3166 0.0000 0.0000 0.0496 0.0000 0.0000 0.0000 0.0000
74-GC 0.0000 0.1000 0.1000 0.4000 0.4500 0.2273 0.1780 0.3000 0.4500 0.7832 0.0771 0.0001 0.1661 0.0000 0.4500 0.2273 0.1780
75-GC 0.0000 0.1000 0.1000 0.2500 0.4500 0.1727 0.1292 0.1500 0.4500 0.7478 0.0650 0.0001 0.1066 0.0000 0.4500 0.1727 0.1292
104
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-PT-CLEF2007
Statistics for P@30
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0000 0.1000 0.1000 0.0364 0.0505 0.1000 0.1000 1.3874 0.0003 0.0000 0.0463 0.0000 0.1000 0.0364 0.0505
52-GC 0.0000 0.0333 0.1000 0.1000 0.3333 0.0939 0.0929 0.0667 0.3333 0.9887 0.0339 0.0001 0.0612 0.0000 0.1667 0.0700 0.0508
53-GC 0.0000 0.0000 0.0000 0.0000 0.0333 0.0030 0.0101 0.0000 0.0333 3.3166 0.0000 0.0000 0.0055 0.0000 0.0000 0.0000 0.0000
54-GC 0.0000 0.0000 0.0000 0.0000 0.0667 0.0061 0.0201 0.0000 0.0667 3.3166 0.0000 0.0000 0.0110 0.0000 0.0000 0.0000 0.0000
55-GC 0.0000 0.0000 0.0000 0.0333 0.0333 0.0152 0.0174 0.0333 0.0333 1.1489 0.0004 0.0000 0.0165 0.0000 0.0333 0.0152 0.0174
56-GC 0.0000 0.0000 0.0000 0.3000 0.3000 0.1364 0.1567 0.3000 0.3000 1.1489 0.0011 0.0000 0.1488 0.0000 0.3000 0.1364 0.1567
57-GC 0.0000 0.0000 0.0667 0.0667 0.0667 0.0364 0.0348 0.0667 0.0667 0.9574 0.0012 0.0000 0.0331 0.0000 0.0667 0.0364 0.0348
58-GC 0.0000 0.0000 0.0333 0.1667 0.1667 0.0667 0.0803 0.1667 0.1667 1.2042 0.0015 0.0000 0.0727 0.0000 0.1667 0.0667 0.0803
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0000 0.0000 0.2333 0.2667 0.2667 0.1394 0.1340 0.2667 0.2667 0.9614 0.0025 0.0000 0.1267 0.0000 0.2667 0.1394 0.1340
61-GC 0.0000 0.1000 0.1000 0.1667 0.2333 0.1212 0.0671 0.0667 0.2333 0.5537 0.0509 0.0001 0.0534 0.0000 0.2333 0.1212 0.0671
62-GC 0.0000 0.0000 0.0000 0.0333 0.0667 0.0182 0.0229 0.0333 0.0667 1.2605 0.0004 0.0000 0.0198 0.0000 0.0667 0.0182 0.0229
63-GC 0.0000 0.0000 0.0000 0.0333 0.0667 0.0182 0.0273 0.0333 0.0667 1.5037 0.0002 0.0000 0.0231 0.0000 0.0667 0.0182 0.0273
64-GC 0.0000 0.0000 0.0000 0.0000 0.0333 0.0030 0.0101 0.0000 0.0333 3.3166 0.0000 0.0000 0.0055 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0667 0.0667 0.7000 0.9000 0.3333 0.3789 0.6333 0.9000 1.1367 0.0366 0.0001 0.3394 0.0000 0.9000 0.3333 0.3789
66-GC 0.0000 0.0000 0.0000 0.3667 0.3667 0.1333 0.1850 0.3667 0.3667 1.3874 0.0005 0.0000 0.1697 0.0000 0.3667 0.1333 0.1850
67-GC 0.2333 0.3000 0.4000 0.4333 0.5667 0.3758 0.0967 0.1333 0.3333 0.2574 0.3645 0.3535 0.0810 0.2333 0.5667 0.3758 0.0967
68-GC 0.0000 0.1250 0.5000 0.6333 0.6667 0.3758 0.2700 0.5083 0.6667 0.7186 0.1176 0.0001 0.2446 0.0000 0.6667 0.3758 0.2700
69-GC 0.0000 0.0000 0.0000 0.2333 0.3000 0.1121 0.1302 0.2333 0.3000 1.1612 0.0010 0.0000 0.1223 0.0000 0.3000 0.1121 0.1302
70-GC 0.0000 0.0000 0.0000 0.0000 0.0333 0.0061 0.0135 0.0000 0.0333 2.2249 0.0000 0.0000 0.0099 0.0000 0.0000 0.0000 0.0000
71-GC 0.0333 0.0667 0.1333 0.5667 0.6000 0.3000 0.2629 0.5000 0.5667 0.8763 0.1773 0.1036 0.2485 0.0333 0.6000 0.3000 0.2629
72-GC 0.0000 0.1000 0.1000 0.1667 0.1667 0.1061 0.0611 0.0667 0.1667 0.5764 0.0226 0.0001 0.0441 0.0000 0.1667 0.1061 0.0611
73-GC 0.0000 0.0000 0.0000 0.0000 0.2667 0.0242 0.0804 0.0000 0.2667 3.3166 0.0000 0.0000 0.0441 0.0000 0.0000 0.0000 0.0000
74-GC 0.0000 0.0667 0.1333 0.4333 0.4333 0.2273 0.1879 0.3667 0.4333 0.8266 0.0735 0.0001 0.1752 0.0000 0.4333 0.2273 0.1879
75-GC 0.0000 0.0667 0.0667 0.2333 0.4000 0.1485 0.1242 0.1667 0.4000 0.8361 0.0522 0.0001 0.1074 0.0000 0.4000 0.1485 0.1242
105
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-PT-CLEF2007
Statistics for P@100
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0000 0.0400 0.0400 0.0145 0.0202 0.0400 0.0400 1.3874 0.0002 0.0000 0.0185 0.0000 0.0400 0.0145 0.0202
52-GC 0.0000 0.0300 0.0600 0.0600 0.2200 0.0655 0.0623 0.0300 0.2200 0.9525 0.0257 0.0001 0.0417 0.0000 0.0600 0.0400 0.0212
53-GC 0.0000 0.0000 0.0000 0.0100 0.0400 0.0073 0.0119 0.0100 0.0400 1.6375 0.0003 0.0000 0.0079 0.0000 0.0100 0.0040 0.0052
54-GC 0.0000 0.0000 0.0000 0.0000 0.0200 0.0027 0.0065 0.0000 0.0200 2.3711 0.0000 0.0000 0.0045 0.0000 0.0000 0.0000 0.0000
55-GC 0.0000 0.0100 0.0200 0.0200 0.0300 0.0155 0.0093 0.0100 0.0300 0.6045 0.0046 0.0001 0.0076 0.0000 0.0300 0.0155 0.0093
56-GC 0.0000 0.0000 0.0100 0.1000 0.1000 0.0455 0.0505 0.1000 0.1000 1.1104 0.0012 0.0000 0.0478 0.0000 0.1000 0.0455 0.0505
57-GC 0.0000 0.0100 0.0200 0.0200 0.0200 0.0145 0.0069 0.0100 0.0200 0.4727 0.0078 0.0001 0.0060 0.0000 0.0200 0.0145 0.0069
58-GC 0.0000 0.0000 0.0300 0.0775 0.1200 0.0409 0.0441 0.0775 0.1200 1.0792 0.0012 0.0000 0.0392 0.0000 0.1200 0.0409 0.0441
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0000 0.0000 0.0800 0.0800 0.0800 0.0445 0.0408 0.0800 0.0800 0.9166 0.0025 0.0000 0.0387 0.0000 0.0800 0.0445 0.0408
61-GC 0.0000 0.0700 0.0700 0.0900 0.1100 0.0718 0.0299 0.0200 0.1100 0.4169 0.0340 0.0001 0.0202 0.0400 0.1100 0.0790 0.0191
62-GC 0.0000 0.0100 0.0100 0.0400 0.1000 0.0282 0.0286 0.0300 0.1000 1.0138 0.0109 0.0001 0.0217 0.0000 0.0400 0.0210 0.0166
63-GC 0.0100 0.0100 0.0100 0.0200 0.0300 0.0164 0.0081 0.0100 0.0200 0.4944 0.0148 0.0135 0.0069 0.0100 0.0300 0.0164 0.0081
64-GC 0.0000 0.0000 0.0100 0.0200 0.0500 0.0127 0.0162 0.0200 0.0500 1.2713 0.0006 0.0000 0.0126 0.0000 0.0300 0.0090 0.0110
65-GC 0.0000 0.0300 0.0300 0.5100 0.7900 0.2791 0.3221 0.4800 0.7900 1.1542 0.0265 0.0001 0.2826 0.0000 0.7900 0.2791 0.3221
66-GC 0.0000 0.0000 0.0000 0.1200 0.1200 0.0518 0.0601 0.1200 0.1200 1.1605 0.0007 0.0000 0.0565 0.0000 0.1200 0.0518 0.0601
67-GC 0.1600 0.1600 0.3300 0.3300 0.4100 0.2745 0.0942 0.1700 0.2500 0.3430 0.2579 0.2406 0.0833 0.1600 0.4100 0.2745 0.0942
68-GC 0.0000 0.0625 0.2700 0.3100 0.3300 0.1982 0.1327 0.2475 0.3300 0.6693 0.0627 0.0001 0.1147 0.0000 0.3300 0.1982 0.1327
69-GC 0.0000 0.0000 0.0000 0.0800 0.1000 0.0382 0.0442 0.0800 0.1000 1.1584 0.0006 0.0000 0.0417 0.0000 0.1000 0.0382 0.0442
70-GC 0.0000 0.0000 0.0200 0.0200 0.0500 0.0145 0.0163 0.0200 0.0500 1.1240 0.0007 0.0000 0.0132 0.0000 0.0300 0.0110 0.0120
71-GC 0.0200 0.0200 0.1200 0.4700 0.4700 0.2418 0.2212 0.4500 0.4500 0.9148 0.1154 0.0482 0.2074 0.0200 0.4700 0.2418 0.2212
72-GC 0.0000 0.0700 0.0700 0.1000 0.1000 0.0709 0.0378 0.0300 0.1000 0.5331 0.0165 0.0001 0.0264 0.0700 0.1000 0.0867 0.0158
73-GC 0.0000 0.0000 0.0000 0.0000 0.0900 0.0082 0.0271 0.0000 0.0900 3.3166 0.0000 0.0000 0.0149 0.0000 0.0000 0.0000 0.0000
74-GC 0.0100 0.0600 0.1700 0.2600 0.2600 0.1509 0.1016 0.2000 0.2500 0.6735 0.1066 0.0570 0.0917 0.0100 0.2600 0.1509 0.1016
75-GC 0.0000 0.0200 0.1100 0.1200 0.1800 0.0773 0.0617 0.1000 0.1800 0.7979 0.0274 0.0001 0.0557 0.0000 0.1800 0.0773 0.0617
106
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-PT-CLEF2007
Statistics for P@200
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0000 0.0200 0.0200 0.0077 0.0098 0.0200 0.0200 1.2734 0.0003 0.0000 0.0089 0.0000 0.0200 0.0077 0.0098
52-GC 0.0000 0.0150 0.0500 0.0500 0.1250 0.0418 0.0359 0.0350 0.1250 0.8593 0.0168 0.0001 0.0271 0.0000 0.0750 0.0335 0.0243
53-GC 0.0000 0.0000 0.0000 0.0050 0.0200 0.0036 0.0060 0.0050 0.0200 1.6375 0.0002 0.0000 0.0040 0.0000 0.0050 0.0020 0.0026
54-GC 0.0000 0.0000 0.0000 0.0000 0.0150 0.0023 0.0052 0.0000 0.0150 2.2786 0.0000 0.0000 0.0037 0.0000 0.0000 0.0000 0.0000
55-GC 0.0000 0.0100 0.0100 0.0100 0.0200 0.0091 0.0054 0.0000 0.0200 0.5933 0.0030 0.0001 0.0033 0.0100 0.0100 0.0100 0.0000
56-GC 0.0000 0.0000 0.0050 0.0500 0.0500 0.0227 0.0252 0.0500 0.0500 1.1104 0.0008 0.0000 0.0239 0.0000 0.0500 0.0227 0.0252
57-GC 0.0000 0.0050 0.0100 0.0100 0.0100 0.0073 0.0034 0.0050 0.0100 0.4727 0.0041 0.0001 0.0030 0.0000 0.0100 0.0073 0.0034
58-GC 0.0000 0.0000 0.0150 0.0400 0.0800 0.0236 0.0263 0.0400 0.0800 1.1117 0.0016 0.0000 0.0221 0.0000 0.0800 0.0236 0.0263
59-GC 0.0000 0.0000 0.0050 0.0050 0.0050 0.0027 0.0026 0.0050 0.0050 0.9574 0.0003 0.0000 0.0025 0.0000 0.0050 0.0027 0.0026
60-GC 0.0000 0.0000 0.0400 0.0400 0.0400 0.0223 0.0204 0.0400 0.0400 0.9166 0.0016 0.0000 0.0193 0.0000 0.0400 0.0223 0.0204
61-GC 0.0000 0.0400 0.0400 0.0500 0.0600 0.0409 0.0158 0.0100 0.0600 0.3858 0.0206 0.0001 0.0101 0.0300 0.0600 0.0450 0.0085
62-GC 0.0000 0.0050 0.0200 0.0650 0.0850 0.0350 0.0334 0.0600 0.0850 0.9540 0.0106 0.0001 0.0309 0.0000 0.0850 0.0350 0.0334
63-GC 0.0050 0.0150 0.0150 0.0150 0.0200 0.0141 0.0049 0.0000 0.0150 0.3483 0.0129 0.0114 0.0033 0.0150 0.0150 0.0150 0.0000
64-GC 0.0000 0.0050 0.0100 0.0250 0.0300 0.0132 0.0108 0.0200 0.0300 0.8183 0.0059 0.0001 0.0095 0.0000 0.0300 0.0132 0.0108
65-GC 0.0000 0.0150 0.0150 0.3300 0.4150 0.1582 0.1795 0.3150 0.4150 1.1347 0.0281 0.0001 0.1607 0.0000 0.4150 0.1582 0.1795
66-GC 0.0000 0.0000 0.0050 0.0600 0.0600 0.0273 0.0304 0.0600 0.0600 1.1163 0.0009 0.0000 0.0288 0.0000 0.0600 0.0273 0.0304
67-GC 0.1500 0.1500 0.2200 0.2200 0.2900 0.2009 0.0479 0.0700 0.1400 0.2384 0.1958 0.1909 0.0399 0.1500 0.2900 0.2009 0.0479
68-GC 0.0000 0.0462 0.1450 0.1650 0.1850 0.1105 0.0705 0.1188 0.1850 0.6384 0.0384 0.0001 0.0595 0.0000 0.1850 0.1105 0.0705
69-GC 0.0000 0.0000 0.0150 0.0400 0.0500 0.0205 0.0213 0.0400 0.0500 1.0397 0.0009 0.0000 0.0196 0.0000 0.0500 0.0205 0.0213
70-GC 0.0000 0.0000 0.0100 0.0100 0.0250 0.0077 0.0088 0.0100 0.0250 1.1342 0.0005 0.0000 0.0070 0.0000 0.0200 0.0060 0.0070
71-GC 0.0250 0.0250 0.0900 0.3350 0.3350 0.1750 0.1511 0.3100 0.3100 0.8633 0.1010 0.0554 0.1418 0.0250 0.3350 0.1750 0.1511
72-GC 0.0000 0.0350 0.0350 0.0600 0.0600 0.0409 0.0214 0.0250 0.0600 0.5238 0.0190 0.0001 0.0174 0.0000 0.0600 0.0409 0.0214
73-GC 0.0000 0.0000 0.0000 0.0000 0.0500 0.0050 0.0150 0.0000 0.0500 3.0000 0.0000 0.0000 0.0082 0.0000 0.0000 0.0000 0.0000
74-GC 0.0150 0.0550 0.1050 0.1600 0.1600 0.1005 0.0551 0.1050 0.1450 0.5486 0.0823 0.0605 0.0486 0.0150 0.1600 0.1005 0.0551
75-GC 0.0000 0.0250 0.0600 0.0700 0.1150 0.0505 0.0330 0.0450 0.1150 0.6550 0.0222 0.0001 0.0277 0.0000 0.1150 0.0505 0.0330
107
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-PT-CLEF2007
Statistics for P@500
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0000 0.0080 0.0080 0.0035 0.0040 0.0080 0.0080 1.1605 0.0002 0.0000 0.0038 0.0000 0.0080 0.0035 0.0040
52-GC 0.0000 0.0060 0.0260 0.0260 0.0520 0.0196 0.0161 0.0200 0.0520 0.8222 0.0082 0.0001 0.0135 0.0000 0.0520 0.0196 0.0161
53-GC 0.0000 0.0000 0.0020 0.0020 0.0080 0.0016 0.0023 0.0020 0.0080 1.4272 0.0002 0.0000 0.0015 0.0000 0.0020 0.0010 0.0011
54-GC 0.0000 0.0000 0.0040 0.0040 0.0060 0.0024 0.0023 0.0040 0.0060 0.9881 0.0003 0.0000 0.0021 0.0000 0.0060 0.0024 0.0023
55-GC 0.0000 0.0040 0.0040 0.0060 0.0100 0.0047 0.0026 0.0020 0.0100 0.5442 0.0027 0.0001 0.0019 0.0020 0.0060 0.0047 0.0014
56-GC 0.0000 0.0000 0.0020 0.0200 0.0200 0.0091 0.0101 0.0200 0.0200 1.1104 0.0005 0.0000 0.0096 0.0000 0.0200 0.0091 0.0101
57-GC 0.0020 0.0020 0.0040 0.0040 0.0040 0.0031 0.0010 0.0020 0.0020 0.3379 0.0029 0.0028 0.0010 0.0020 0.0040 0.0031 0.0010
58-GC 0.0020 0.0020 0.0060 0.0285 0.0360 0.0142 0.0145 0.0265 0.0340 1.0237 0.0072 0.0038 0.0126 0.0020 0.0360 0.0142 0.0145
59-GC 0.0000 0.0000 0.0020 0.0020 0.0020 0.0011 0.0010 0.0020 0.0020 0.9574 0.0002 0.0000 0.0010 0.0000 0.0020 0.0011 0.0010
60-GC 0.0000 0.0000 0.0160 0.0160 0.0160 0.0095 0.0079 0.0160 0.0160 0.8306 0.0010 0.0000 0.0071 0.0000 0.0160 0.0095 0.0079
61-GC 0.0000 0.0180 0.0180 0.0200 0.0240 0.0175 0.0061 0.0020 0.0240 0.3516 0.0096 0.0001 0.0034 0.0160 0.0200 0.0187 0.0014
62-GC 0.0000 0.0020 0.0100 0.0340 0.0380 0.0175 0.0168 0.0320 0.0380 0.9643 0.0052 0.0001 0.0158 0.0000 0.0380 0.0175 0.0168
63-GC 0.0040 0.0080 0.0080 0.0080 0.0120 0.0082 0.0023 0.0000 0.0080 0.2777 0.0079 0.0075 0.0014 0.0080 0.0080 0.0080 0.0000
64-GC 0.0000 0.0020 0.0100 0.0115 0.0140 0.0071 0.0055 0.0095 0.0140 0.7710 0.0032 0.0001 0.0050 0.0000 0.0140 0.0071 0.0055
65-GC 0.0020 0.0180 0.0180 0.1860 0.1860 0.0831 0.0848 0.1680 0.1840 1.0203 0.0361 0.0119 0.0761 0.0020 0.1860 0.0831 0.0848
66-GC 0.0000 0.0000 0.0020 0.0240 0.0240 0.0109 0.0122 0.0240 0.0240 1.1163 0.0006 0.0000 0.0115 0.0000 0.0240 0.0109 0.0122
67-GC 0.0740 0.0840 0.1300 0.1300 0.1480 0.1100 0.0274 0.0460 0.0740 0.2494 0.1068 0.1035 0.0255 0.0740 0.1480 0.1100 0.0274
68-GC 0.0000 0.0400 0.0680 0.0740 0.1040 0.0587 0.0317 0.0340 0.1040 0.5405 0.0270 0.0001 0.0254 0.0000 0.1040 0.0587 0.0317
69-GC 0.0000 0.0000 0.0100 0.0180 0.0200 0.0093 0.0092 0.0180 0.0200 0.9944 0.0006 0.0000 0.0084 0.0000 0.0200 0.0093 0.0092
70-GC 0.0000 0.0000 0.0040 0.0040 0.0120 0.0033 0.0039 0.0040 0.0120 1.1998 0.0003 0.0000 0.0030 0.0000 0.0080 0.0024 0.0028
71-GC 0.0280 0.0280 0.0680 0.1780 0.1800 0.1024 0.0739 0.1500 0.1520 0.7215 0.0748 0.0539 0.0691 0.0280 0.1800 0.1024 0.0739
72-GC 0.0080 0.0160 0.0180 0.0420 0.0420 0.0273 0.0143 0.0260 0.0340 0.5250 0.0235 0.0200 0.0134 0.0080 0.0420 0.0273 0.0143
73-GC 0.0000 0.0000 0.0020 0.0020 0.0220 0.0033 0.0065 0.0020 0.0220 1.9759 0.0002 0.0000 0.0039 0.0000 0.0020 0.0009 0.0011
74-GC 0.0120 0.0300 0.0680 0.0820 0.0820 0.0551 0.0282 0.0520 0.0700 0.5122 0.0467 0.0375 0.0261 0.0120 0.0820 0.0551 0.0282
75-GC 0.0000 0.0100 0.0320 0.0320 0.0580 0.0240 0.0172 0.0220 0.0580 0.7178 0.0108 0.0001 0.0145 0.0000 0.0580 0.0240 0.0172
108
GC-MONO-CLEF2007 Track Overview Results and Graphs GC-MONO-PT-CLEF2007
Statistics for P@1000
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0020 0.0040 0.0040 0.0020 0.0018 0.0040 0.0040 0.9220 0.0004 0.0000 0.0016 0.0000 0.0040 0.0020 0.0018
52-GC 0.0000 0.0040 0.0160 0.0160 0.0290 0.0125 0.0100 0.0120 0.0290 0.8056 0.0055 0.0001 0.0084 0.0000 0.0290 0.0125 0.0100
53-GC 0.0000 0.0000 0.0010 0.0010 0.0050 0.0009 0.0014 0.0010 0.0050 1.5906 0.0001 0.0000 0.0008 0.0000 0.0010 0.0005 0.0005
54-GC 0.0000 0.0000 0.0020 0.0020 0.0030 0.0014 0.0012 0.0020 0.0030 0.8844 0.0003 0.0000 0.0011 0.0000 0.0030 0.0014 0.0012
55-GC 0.0010 0.0020 0.0020 0.0030 0.0050 0.0025 0.0010 0.0010 0.0040 0.4069 0.0024 0.0022 0.0008 0.0010 0.0030 0.0023 0.0007
56-GC 0.0000 0.0000 0.0020 0.0100 0.0100 0.0048 0.0050 0.0100 0.0100 1.0370 0.0006 0.0000 0.0047 0.0000 0.0100 0.0048 0.0050
57-GC 0.0010 0.0010 0.0020 0.0020 0.0020 0.0016 0.0005 0.0010 0.0010 0.3083 0.0016 0.0015 0.0005 0.0010 0.0020 0.0016 0.0005
58-GC 0.0010 0.0010 0.0170 0.0187 0.0200 0.0110 0.0089 0.0177 0.0190 0.8111 0.0057 0.0024 0.0084 0.0010 0.0200 0.0110 0.0089
59-GC 0.0000 0.0000 0.0010 0.0010 0.0010 0.0005 0.0005 0.0010 0.0010 0.9574 0.0001 0.0000 0.0005 0.0000 0.0010 0.0005 0.0005
60-GC 0.0000 0.0000 0.0080 0.0080 0.0080 0.0051 0.0040 0.0080 0.0080 0.7928 0.0007 0.0000 0.0037 0.0000 0.0080 0.0051 0.0040
61-GC 0.0000 0.0100 0.0120 0.0120 0.0130 0.0103 0.0036 0.0020 0.0130 0.3485 0.0059 0.0001 0.0021 0.0100 0.0130 0.0113 0.0012
62-GC 0.0000 0.0020 0.0130 0.0170 0.0190 0.0098 0.0080 0.0150 0.0190 0.8159 0.0039 0.0001 0.0075 0.0000 0.0190 0.0098 0.0080
63-GC 0.0020 0.0040 0.0040 0.0050 0.0060 0.0044 0.0012 0.0010 0.0040 0.2764 0.0042 0.0040 0.0009 0.0030 0.0060 0.0046 0.0010
64-GC 0.0000 0.0030 0.0050 0.0070 0.0070 0.0046 0.0024 0.0040 0.0070 0.5129 0.0027 0.0001 0.0020 0.0000 0.0070 0.0046 0.0024
65-GC 0.0030 0.0210 0.0210 0.0970 0.0990 0.0495 0.0412 0.0760 0.0960 0.8306 0.0298 0.0141 0.0373 0.0030 0.0990 0.0495 0.0412
66-GC 0.0000 0.0000 0.0020 0.0120 0.0120 0.0055 0.0060 0.0120 0.0120 1.0861 0.0004 0.0000 0.0057 0.0000 0.0120 0.0055 0.0060
67-GC 0.0370 0.0420 0.0710 0.0720 0.0740 0.0580 0.0164 0.0300 0.0370 0.2819 0.0558 0.0535 0.0155 0.0370 0.0740 0.0580 0.0164
68-GC 0.0000 0.0240 0.0390 0.0390 0.0620 0.0344 0.0183 0.0150 0.0620 0.5324 0.0167 0.0001 0.0134 0.0160 0.0390 0.0318 0.0091
69-GC 0.0000 0.0000 0.0090 0.0090 0.0100 0.0050 0.0048 0.0090 0.0100 0.9592 0.0004 0.0000 0.0045 0.0000 0.0100 0.0050 0.0048
70-GC 0.0000 0.0000 0.0020 0.0020 0.0070 0.0018 0.0021 0.0020 0.0070 1.1749 0.0003 0.0000 0.0015 0.0000 0.0040 0.0013 0.0013
71-GC 0.0210 0.0210 0.0680 0.1020 0.1090 0.0645 0.0397 0.0810 0.0880 0.6164 0.0511 0.0395 0.0360 0.0210 0.1090 0.0645 0.0397
72-GC 0.0100 0.0110 0.0130 0.0380 0.0380 0.0234 0.0140 0.0270 0.0280 0.6005 0.0195 0.0164 0.0133 0.0100 0.0380 0.0234 0.0140
73-GC 0.0000 0.0000 0.0010 0.0010 0.0110 0.0016 0.0032 0.0010 0.0110 1.9759 0.0002 0.0000 0.0020 0.0000 0.0010 0.0004 0.0005
74-GC 0.0090 0.0180 0.0500 0.0500 0.0590 0.0357 0.0190 0.0320 0.0500 0.5330 0.0301 0.0245 0.0178 0.0090 0.0590 0.0357 0.0190
75-GC 0.0000 0.0070 0.0220 0.0230 0.0310 0.0157 0.0102 0.0160 0.0310 0.6472 0.0076 0.0001 0.0092 0.0000 0.0310 0.0157 0.0102
109
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2DE-CLEF2007
GeoCLEF Bilingual German Task Top 5 Participants − Standard Recall Levels vs Mean Interpolated Precision
100%
hagen [Experiment FUHTDN4EN; MAP 20.92%; Pooled]
cheshire [Experiment BERKBIPTDEBASE; MAP 11.09%; Pooled]
90%
80%
70%
60%
Precision
50%
40%
30%
20%
10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Bilingual German Task Top 5 Participants − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
1
hagen [Experiment FUHTDN4EN; MAP 20.92%; Pooled]
cheshire [Experiment BERKBIPTDEBASE; MAP 11.09%; Pooled]
0.8
0.6
0.4
0.2
Difference
0
−0.2
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
110
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2DE-CLEF2007
GeoCLEF Bilingual German Task − Box Plot of the Topics
hagen [Experiment FUHTDN4EN; MAP 20.92%; Pooled]
hagen [Experiment FUHTDN5EN; MAP 18.87%; Pooled]
hagen [Experiment FUHTD2EN; MAP 14.64%; Pooled]
hagen [Experiment FUHTD3EN; MAP 14.49%; Pooled]
Experiments
hagen [Experiment FUHTD1EN; MAP 11.36%; Pooled]
cheshire [Experiment BERKBIPTDEBASE; MAP 11.09%; Pooled]
cheshire [Experiment BERKBIENDEBASE; MAP 9.02%; Pooled]
cheshire [Experiment BERKBIESDEBASE; MAP 7.24%; Pooled]
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Average Precision
111
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2DE-CLEF2007
10.2455/TUKEY_T_TEST.2925D495E0B8EDE299872E94479E0834
GeoCLEF Bilingual German Task − Tukey T test with "top group" highlighted
FUHTDN4EN
FUHTDN5EN
FUHTD2EN
Experiments
FUHTD3EN
FUHTD1EN
BERKBIPTDEBASE
BERKBIENDEBASE
BERKBIESDEBASE
0.1 0.15 0.2 0.25 0.3 0.35 0.4 0.45 0.5
arcsin(sqrt(Average Precsion))
112
113
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2DE-CLEF2007
GeoCLEF Bilingual German Task Top 5 Participants − Retrieved documents vs Mean Precision
100%
hagen [Experiment FUHTDN4EN; R−Prec 21.25%; Pooled]
cheshire [Experiment BERKBIPTDEBASE; R−Prec 12.83%; Pooled]
90%
80%
70%
60%
Precision
50%
40%
30%
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Bilingual German Task Top 5 Participants − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
1
hagen [Experiment FUHTDN4EN; R−Prec 21.25%; Pooled]
cheshire [Experiment BERKBIPTDEBASE; R−Prec 12.83%; Pooled]
0.8
0.6
0.4
0.2
Difference
0
−0.2
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
114
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2DE-CLEF2007
GeoCLEF Bilingual German Task − Box Plot of the Topics
hagen [Experiment FUHTDN4EN; R−Prec 21.25%; Pooled]
hagen [Experiment FUHTDN5EN; R−Prec 18.81%; Pooled]
hagen [Experiment FUHTD2EN; R−Prec 16.26%; Pooled]
hagen [Experiment FUHTD3EN; R−Prec 15.51%; Pooled]
Experiments
cheshire [Experiment BERKBIPTDEBASE; R−Prec 12.83%; Pooled]
cheshire [Experiment BERKBIENDEBASE; R−Prec 11.75%; Pooled]
hagen [Experiment FUHTD1EN; R−Prec 11.70%; Pooled]
cheshire [Experiment BERKBIESDEBASE; R−Prec 8.49%; Pooled]
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
R−Precision
115
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2DE-CLEF2007
GeoCLEF Bilingual German Task − Tukey T test with "top group" highlighted
FUHTDN4EN
FUHTDN5EN
FUHTD2EN
Experiments
FUHTD3EN
FUHTD1EN
BERKBIPTDEBASE
BERKBIENDEBASE
BERKBIESDEBASE
0.05 0.1 0.15 0.2 0.25 0.3 0.35 0.4 0.45 0.5
arcsin(sqrt(R−Precision))
116
117
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2DE-CLEF2007
Statistics for Number of relevant retrieved documents
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 1.00 4.00 9.50 14.00 27.00 10.38 8.37 10.00 26.00 0.81 6.97 3.88 5.97 1.00 27.00 10.38 8.37
52-GC 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 N/D 0.00 0.00 0.00 0.00 0.00 0.00 0.00
53-GC 4.00 6.00 6.00 6.50 7.00 6.00 0.93 0.50 3.00 0.15 5.93 5.84 0.50 6.00 7.00 6.29 0.49
54-GC 0.00 1.00 3.00 4.00 4.00 2.50 1.60 3.00 4.00 0.64 0.52 0.00 1.38 0.00 4.00 2.50 1.60
55-GC 0.00 1.00 1.00 6.00 6.00 2.75 2.71 5.00 6.00 0.99 0.46 0.00 2.44 0.00 6.00 2.75 2.71
56-GC 2.00 2.00 5.00 5.00 5.00 3.88 1.55 3.00 3.00 0.40 3.55 3.20 1.41 2.00 5.00 3.88 1.55
57-GC 0.00 0.00 1.00 1.00 1.00 0.62 0.52 1.00 1.00 0.83 0.01 0.00 0.47 0.00 1.00 0.62 0.52
58-GC 1.00 2.50 7.00 13.50 15.00 7.75 5.90 11.00 14.00 0.76 5.33 3.33 5.25 1.00 15.00 7.75 5.90
59-GC 0.00 0.00 0.00 2.00 4.00 1.00 1.85 2.00 4.00 1.85 0.00 0.00 1.50 0.00 4.00 1.00 1.85
60-GC 0.00 0.50 21.00 46.00 49.00 23.00 23.75 45.50 49.00 1.03 0.43 0.00 22.00 0.00 49.00 23.00 23.75
61-GC 0.00 2.00 37.00 39.00 41.00 24.62 19.35 37.00 41.00 0.79 2.67 0.00 17.47 0.00 41.00 24.62 19.35
62-GC 7.00 8.50 22.00 31.00 31.00 20.12 11.36 22.50 24.00 0.56 16.86 13.87 10.38 7.00 31.00 20.12 11.36
63-GC 19.00 23.50 33.00 35.00 36.00 29.75 6.65 11.50 17.00 0.22 29.02 28.24 5.81 19.00 36.00 29.75 6.65
64-GC 1.00 2.00 6.00 8.50 9.00 5.38 3.34 6.50 8.00 0.62 4.17 2.97 2.88 1.00 9.00 5.38 3.34
65-GC 32.00 40.00 68.00 74.50 75.00 59.00 18.67 34.50 43.00 0.32 56.04 52.86 16.25 32.00 75.00 59.00 18.67
66-GC 0.00 0.50 1.00 2.00 2.00 1.12 0.83 1.50 2.00 0.74 0.07 0.00 0.66 0.00 2.00 1.12 0.83
67-GC 0.00 10.00 23.50 32.50 38.00 21.25 14.62 22.50 38.00 0.69 2.82 0.00 11.25 0.00 38.00 21.25 14.62
68-GC 34.00 124.00 134.00 165.50 173.00 131.75 44.63 41.50 139.00 0.34 120.41 102.01 30.00 123.00 173.00 145.71 22.44
69-GC 12.00 17.00 31.00 34.50 39.00 27.00 10.27 17.50 27.00 0.38 24.94 22.66 8.75 12.00 39.00 27.00 10.27
70-GC 5.00 5.00 13.50 17.50 20.00 12.12 6.47 12.50 15.00 0.53 10.38 8.73 5.38 5.00 20.00 12.12 6.47
71-GC 5.00 5.50 7.00 7.00 7.00 6.38 0.92 1.50 2.00 0.14 6.31 6.25 0.78 5.00 7.00 6.38 0.92
72-GC 3.00 3.50 4.00 5.50 7.00 4.50 1.41 2.00 4.00 0.31 4.32 4.15 1.12 3.00 7.00 4.50 1.41
73-GC 0.00 3.50 7.00 7.00 7.00 5.25 2.76 3.50 7.00 0.53 1.07 0.00 2.19 0.00 7.00 5.25 2.76
74-GC 4.00 5.50 6.50 7.50 8.00 6.38 1.41 2.00 4.00 0.22 6.23 6.06 1.12 4.00 8.00 6.38 1.41
75-GC 72.00 72.00 83.00 99.00 114.00 86.75 16.49 27.00 42.00 0.19 85.46 84.27 12.94 72.00 114.00 86.75 16.49
118
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2DE-CLEF2007
Statistics for Average Precsion
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0002 0.0050 0.0124 0.0536 0.0671 0.0262 0.0276 0.0486 0.0669 1.0530 0.0092 0.0013 0.0239 0.0002 0.0671 0.0262 0.0276
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0025 0.0092 0.0939 0.1510 0.2312 0.0927 0.0849 0.1418 0.2288 0.9154 0.0408 0.0114 0.0670 0.0025 0.2312 0.0927 0.0849
54-GC 0.0000 0.0122 0.0607 0.1716 0.5114 0.1250 0.1770 0.1594 0.5114 1.4158 0.0150 0.0001 0.1302 0.0000 0.2594 0.0699 0.0902
55-GC 0.0000 0.0002 0.0012 0.0139 0.0160 0.0058 0.0073 0.0137 0.0160 1.2565 0.0010 0.0001 0.0066 0.0000 0.0160 0.0058 0.0073
56-GC 0.0287 0.1240 0.2399 0.2719 0.2771 0.1972 0.0932 0.1479 0.2484 0.4727 0.1638 0.1138 0.0787 0.0287 0.2771 0.1972 0.0932
57-GC 0.0000 0.0000 0.2917 0.3333 0.5000 0.2188 0.1938 0.3333 0.5000 0.8861 0.0068 0.0000 0.1641 0.0000 0.5000 0.2188 0.1938
58-GC 0.0001 0.0004 0.0024 0.0566 0.1486 0.0334 0.0593 0.0562 0.1485 1.7757 0.0030 0.0005 0.0472 0.0001 0.1071 0.0170 0.0398
59-GC 0.0000 0.0000 0.0000 0.0045 0.0193 0.0035 0.0071 0.0045 0.0193 2.0117 0.0001 0.0000 0.0053 0.0000 0.0089 0.0013 0.0034
60-GC 0.0000 0.0000 0.0448 0.3242 0.5472 0.1607 0.2325 0.3242 0.5472 1.4472 0.0027 0.0000 0.1834 0.0000 0.5472 0.1607 0.2325
61-GC 0.0000 0.0001 0.1444 0.2179 0.2851 0.1262 0.1148 0.2178 0.2851 0.9097 0.0081 0.0001 0.0946 0.0000 0.2851 0.1262 0.1148
62-GC 0.0016 0.0045 0.0298 0.0846 0.1098 0.0437 0.0432 0.0801 0.1082 0.9885 0.0186 0.0057 0.0370 0.0016 0.1098 0.0437 0.0432
63-GC 0.1200 0.1832 0.4027 0.4445 0.4591 0.3300 0.1440 0.2613 0.3391 0.4364 0.2945 0.2551 0.1259 0.1200 0.4591 0.3300 0.1440
64-GC 0.0001 0.0008 0.0166 0.0258 0.0460 0.0166 0.0162 0.0250 0.0459 0.9774 0.0048 0.0005 0.0128 0.0001 0.0460 0.0166 0.0162
65-GC 0.0244 0.0852 0.2295 0.3087 0.3310 0.2003 0.1261 0.2236 0.3065 0.6294 0.1453 0.0867 0.1085 0.0244 0.3310 0.2003 0.1261
66-GC 0.0000 0.0010 0.0164 0.0275 0.0680 0.0197 0.0226 0.0265 0.0680 1.1470 0.0027 0.0000 0.0160 0.0000 0.0300 0.0128 0.0123
67-GC 0.0000 0.0044 0.0339 0.0575 0.0780 0.0337 0.0313 0.0531 0.0780 0.9283 0.0051 0.0001 0.0238 0.0000 0.0780 0.0337 0.0313
68-GC 0.0052 0.1345 0.2475 0.2610 0.2977 0.1986 0.0987 0.1266 0.2925 0.4969 0.1359 0.0352 0.0804 0.0052 0.2977 0.1986 0.0987
69-GC 0.0558 0.1434 0.2010 0.2838 0.3742 0.2108 0.1077 0.1404 0.3184 0.5111 0.1834 0.1528 0.0773 0.0558 0.3742 0.2108 0.1077
70-GC 0.0021 0.0051 0.0190 0.0664 0.1243 0.0384 0.0493 0.0613 0.1222 1.2843 0.0158 0.0064 0.0393 0.0021 0.1243 0.0384 0.0493
71-GC 0.0209 0.0292 0.1110 0.3622 0.5474 0.1966 0.2007 0.3329 0.5265 1.0205 0.1046 0.0556 0.1704 0.0209 0.5474 0.1966 0.2007
72-GC 0.0020 0.0024 0.0041 0.0052 0.1728 0.0248 0.0598 0.0028 0.1708 2.4162 0.0055 0.0036 0.0370 0.0020 0.0052 0.0036 0.0014
73-GC 0.0000 0.0083 0.2216 0.3866 0.5488 0.2227 0.2171 0.3783 0.5488 0.9746 0.0308 0.0001 0.1660 0.0000 0.5488 0.2227 0.2171
74-GC 0.0464 0.1866 0.2460 0.3361 0.4175 0.2502 0.1197 0.1495 0.3710 0.4786 0.2140 0.1631 0.0915 0.0464 0.4175 0.2502 0.1197
75-GC 0.5126 0.5337 0.5443 0.6225 0.7892 0.5878 0.0926 0.0888 0.2766 0.1576 0.5822 0.5772 0.0677 0.5126 0.6507 0.5591 0.0478
119
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2DE-CLEF2007
Statistics for R-Precision
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0500 0.0833 0.1000 0.0458 0.0434 0.0833 0.1000 0.9473 0.0025 0.0000 0.0375 0.0000 0.1000 0.0458 0.0434
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.2000 0.3000 0.4000 0.1750 0.1581 0.3000 0.4000 0.9035 0.0059 0.0000 0.1313 0.0000 0.4000 0.1750 0.1581
54-GC 0.0000 0.0000 0.0000 0.1250 0.5000 0.0938 0.1860 0.1250 0.5000 1.9841 0.0001 0.0000 0.1406 0.0000 0.2500 0.0357 0.0945
55-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
56-GC 0.0000 0.0000 0.2000 0.3000 0.4000 0.1750 0.1669 0.3000 0.4000 0.9537 0.0058 0.0000 0.1313 0.0000 0.4000 0.1750 0.1669
57-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
58-GC 0.0000 0.0000 0.0000 0.0789 0.1579 0.0395 0.0731 0.0789 0.1579 1.8516 0.0001 0.0000 0.0592 0.0000 0.1579 0.0395 0.0731
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0000 0.0000 0.0962 0.4038 0.5962 0.1995 0.2528 0.4038 0.5962 1.2672 0.0019 0.0000 0.2013 0.0000 0.5962 0.1995 0.2528
61-GC 0.0000 0.0000 0.2065 0.3043 0.3913 0.1766 0.1604 0.3043 0.3913 0.9079 0.0059 0.0000 0.1332 0.0000 0.3913 0.1766 0.1604
62-GC 0.0000 0.0000 0.0312 0.0781 0.1562 0.0469 0.0554 0.0781 0.1562 1.1819 0.0023 0.0000 0.0430 0.0000 0.1562 0.0469 0.0554
63-GC 0.1750 0.3125 0.4125 0.4750 0.4750 0.3812 0.1124 0.1625 0.3000 0.2948 0.3634 0.3418 0.0937 0.1750 0.4750 0.3812 0.1124
64-GC 0.0000 0.0000 0.0000 0.0769 0.0769 0.0288 0.0398 0.0769 0.0769 1.3801 0.0003 0.0000 0.0361 0.0000 0.0769 0.0288 0.0398
65-GC 0.0947 0.1842 0.3526 0.4421 0.4632 0.3145 0.1509 0.2579 0.3684 0.4799 0.2720 0.2239 0.1276 0.0947 0.4632 0.3145 0.1509
66-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
67-GC 0.0000 0.0082 0.0984 0.1311 0.1475 0.0779 0.0630 0.1230 0.1475 0.8095 0.0089 0.0000 0.0543 0.0000 0.1475 0.0779 0.0630
68-GC 0.0483 0.2230 0.3086 0.3569 0.4015 0.2783 0.1132 0.1338 0.3532 0.4067 0.2417 0.1807 0.0852 0.0483 0.4015 0.2783 0.1132
69-GC 0.0667 0.2111 0.3111 0.3667 0.6000 0.3056 0.1561 0.1556 0.5333 0.5109 0.2632 0.2100 0.1111 0.0667 0.3778 0.2635 0.1092
70-GC 0.0000 0.0000 0.0000 0.1087 0.2174 0.0543 0.0893 0.1087 0.2174 1.6423 0.0003 0.0000 0.0707 0.0000 0.2174 0.0543 0.0893
71-GC 0.0000 0.0000 0.0714 0.3571 0.4286 0.1607 0.1937 0.3571 0.4286 1.2055 0.0017 0.0000 0.1652 0.0000 0.4286 0.1607 0.1937
72-GC 0.0000 0.0000 0.0000 0.0000 0.3000 0.0375 0.1061 0.0000 0.3000 2.8284 0.0000 0.0000 0.0656 0.0000 0.0000 0.0000 0.0000
73-GC 0.0000 0.0000 0.1429 0.2857 0.4286 0.1607 0.1781 0.2857 0.4286 1.1079 0.0052 0.0000 0.1339 0.0000 0.4286 0.1607 0.1781
74-GC 0.1250 0.2500 0.2500 0.3125 0.3750 0.2656 0.0801 0.0625 0.2500 0.3016 0.2537 0.2400 0.0547 0.2500 0.3750 0.2857 0.0610
75-GC 0.5702 0.6184 0.6228 0.6491 0.6579 0.6261 0.0277 0.0307 0.0877 0.0443 0.6255 0.6250 0.0195 0.6140 0.6579 0.6341 0.0173
120
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2DE-CLEF2007
Statistics for Binary Preference
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0250 0.0456 0.0667 0.0260 0.0254 0.0456 0.0667 0.9782 0.0017 0.0000 0.0207 0.0000 0.0667 0.0260 0.0254
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.1500 0.2250 0.2700 0.1275 0.1155 0.2250 0.2700 0.9057 0.0048 0.0000 0.0956 0.0000 0.2700 0.1275 0.1155
54-GC 0.0000 0.0000 0.0000 0.1250 0.5000 0.0938 0.1860 0.1250 0.5000 1.9841 0.0001 0.0000 0.1406 0.0000 0.2500 0.0357 0.0945
55-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
56-GC 0.0000 0.0000 0.1800 0.2000 0.2400 0.1250 0.1057 0.2000 0.2400 0.8456 0.0049 0.0000 0.0938 0.0000 0.2400 0.1250 0.1057
57-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
58-GC 0.0000 0.0000 0.0000 0.0416 0.0859 0.0211 0.0391 0.0416 0.0859 1.8520 0.0001 0.0000 0.0317 0.0000 0.0859 0.0211 0.0391
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0000 0.0000 0.0542 0.3571 0.5544 0.1721 0.2418 0.3571 0.5544 1.4048 0.0016 0.0000 0.1893 0.0000 0.5544 0.1721 0.2418
61-GC 0.0000 0.0000 0.1503 0.2117 0.3010 0.1281 0.1187 0.2117 0.3010 0.9265 0.0048 0.0000 0.0961 0.0000 0.3010 0.1281 0.1187
62-GC 0.0000 0.0000 0.0049 0.0381 0.0615 0.0184 0.0240 0.0381 0.0615 1.3034 0.0011 0.0000 0.0206 0.0000 0.0615 0.0184 0.0240
63-GC 0.1450 0.2356 0.3828 0.4313 0.4419 0.3358 0.1180 0.1956 0.2969 0.3515 0.3131 0.2869 0.0978 0.1450 0.4419 0.3358 0.1180
64-GC 0.0000 0.0000 0.0000 0.0178 0.0651 0.0126 0.0235 0.0178 0.0651 1.8729 0.0002 0.0000 0.0174 0.0000 0.0296 0.0051 0.0110
65-GC 0.0496 0.1329 0.2883 0.3631 0.3847 0.2504 0.1351 0.2302 0.3351 0.5395 0.2028 0.1478 0.1127 0.0496 0.3847 0.2504 0.1351
66-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
67-GC 0.0000 0.0050 0.0425 0.0871 0.1021 0.0464 0.0423 0.0821 0.1021 0.9121 0.0058 0.0000 0.0343 0.0000 0.1021 0.0464 0.0423
68-GC 0.0876 0.3878 0.4119 0.4388 0.4837 0.3811 0.1231 0.0509 0.3961 0.3231 0.3465 0.2851 0.0734 0.3878 0.4837 0.4230 0.0358
69-GC 0.0642 0.1649 0.2395 0.2941 0.4938 0.2444 0.1288 0.1291 0.4296 0.5272 0.2125 0.1774 0.0886 0.0642 0.3353 0.2087 0.0867
70-GC 0.0000 0.0000 0.0000 0.0671 0.1474 0.0352 0.0632 0.0671 0.1474 1.7939 0.0002 0.0000 0.0509 0.0000 0.1474 0.0352 0.0632
71-GC 0.0000 0.0000 0.0612 0.3265 0.4082 0.1480 0.1785 0.3265 0.4082 1.2064 0.0016 0.0000 0.1543 0.0000 0.4082 0.1480 0.1785
72-GC 0.0000 0.0000 0.0000 0.0000 0.1800 0.0225 0.0636 0.0000 0.1800 2.8284 0.0000 0.0000 0.0394 0.0000 0.0000 0.0000 0.0000
73-GC 0.0000 0.0000 0.1327 0.2551 0.4694 0.1556 0.1762 0.2551 0.4694 1.1324 0.0051 0.0000 0.1314 0.0000 0.4694 0.1556 0.1762
74-GC 0.0156 0.2188 0.2344 0.2969 0.3906 0.2383 0.1088 0.0781 0.3750 0.4567 0.1853 0.0878 0.0703 0.2188 0.3906 0.2701 0.0661
75-GC 0.5900 0.5913 0.6207 0.7038 0.7992 0.6526 0.0780 0.1126 0.2092 0.1195 0.6488 0.6452 0.0623 0.5900 0.7992 0.6526 0.0780
121
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2DE-CLEF2007
Statistics for Precision at the 0% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0062 0.0289 0.1676 0.6250 1.0000 0.3311 0.4218 0.5961 0.9938 1.2737 0.1155 0.0313 0.3344 0.0062 1.0000 0.3311 0.4218
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0098 0.0358 0.4000 0.4643 0.7500 0.3200 0.2673 0.4284 0.7402 0.8353 0.1505 0.0440 0.2196 0.0098 0.7500 0.3200 0.2673
54-GC 0.0000 0.0318 0.1742 0.6000 1.0000 0.3265 0.4229 0.5682 1.0000 1.2952 0.0380 0.0001 0.3367 0.0000 1.0000 0.3265 0.4229
55-GC 0.0000 0.0015 0.0083 0.0224 0.0258 0.0113 0.0109 0.0209 0.0258 0.9715 0.0033 0.0001 0.0096 0.0000 0.0258 0.0113 0.0109
56-GC 0.0909 0.1667 0.4000 0.7500 1.0000 0.4655 0.3586 0.5833 0.9091 0.7703 0.3453 0.2500 0.2759 0.0909 1.0000 0.4655 0.3586
57-GC 0.0000 0.0000 0.2917 0.3333 0.5000 0.2188 0.1938 0.3333 0.5000 0.8861 0.0068 0.0000 0.1641 0.0000 0.5000 0.2188 0.1938
58-GC 0.0023 0.0032 0.0081 0.1221 0.2963 0.0707 0.1204 0.1190 0.2940 1.7030 0.0138 0.0057 0.0964 0.0023 0.2963 0.0707 0.1204
59-GC 0.0000 0.0000 0.0000 0.0070 0.0303 0.0055 0.0111 0.0070 0.0303 2.0122 0.0001 0.0000 0.0083 0.0000 0.0140 0.0020 0.0053
60-GC 0.0000 0.0009 0.1276 0.6667 1.0000 0.3238 0.4367 0.6657 1.0000 1.3486 0.0097 0.0000 0.3405 0.0000 1.0000 0.3238 0.4367
61-GC 0.0000 0.0025 0.3889 0.9000 1.0000 0.4479 0.4382 0.8975 1.0000 0.9784 0.0405 0.0001 0.3641 0.0000 1.0000 0.4479 0.4382
62-GC 0.0090 0.0250 0.0742 0.1514 0.1892 0.0874 0.0707 0.1264 0.1801 0.8083 0.0541 0.0280 0.0613 0.0090 0.1892 0.0874 0.0707
63-GC 0.7778 1.0000 1.0000 1.0000 1.0000 0.9722 0.0786 0.0000 0.2222 0.0808 0.9691 0.9655 0.0486 1.0000 1.0000 1.0000 0.0000
64-GC 0.0011 0.0084 0.0661 0.0940 0.2500 0.0735 0.0815 0.0856 0.2489 1.1086 0.0278 0.0055 0.0544 0.0011 0.1111 0.0483 0.0426
65-GC 0.1042 0.5000 1.0000 1.0000 1.0000 0.7630 0.3491 0.5000 0.8958 0.4576 0.6338 0.4301 0.2962 0.1042 1.0000 0.7630 0.3491
66-GC 0.0000 0.0010 0.0328 0.0500 0.1250 0.0366 0.0415 0.0490 0.1250 1.1355 0.0040 0.0000 0.0288 0.0000 0.0500 0.0239 0.0229
67-GC 0.0000 0.0211 0.1064 0.5667 0.8000 0.2735 0.3416 0.5456 0.8000 1.2489 0.0327 0.0001 0.2782 0.0000 0.8000 0.2735 0.3416
68-GC 0.0519 0.5000 1.0000 1.0000 1.0000 0.7565 0.3634 0.5000 0.9481 0.4804 0.5809 0.2828 0.3044 0.0519 1.0000 0.7565 0.3634
69-GC 0.4444 0.6190 1.0000 1.0000 1.0000 0.8353 0.2350 0.3810 0.5556 0.2813 0.8009 0.7619 0.2059 0.4444 1.0000 0.8353 0.2350
70-GC 0.0222 0.0301 0.0470 0.5250 1.0000 0.2783 0.4456 0.4949 0.9778 1.6010 0.0821 0.0442 0.3608 0.0222 1.0000 0.2783 0.4456
71-GC 0.0426 0.0571 0.3125 0.8750 1.0000 0.4415 0.4272 0.8179 0.9574 0.9676 0.2245 0.1109 0.3710 0.0426 1.0000 0.4415 0.4272
72-GC 0.0081 0.0109 0.0124 0.0294 1.0000 0.1392 0.3479 0.0185 0.9919 2.4994 0.0244 0.0148 0.2152 0.0081 0.0294 0.0162 0.0092
73-GC 0.0000 0.0257 0.7500 1.0000 1.0000 0.5689 0.4874 0.9743 1.0000 0.8567 0.0777 0.0001 0.4311 0.0000 1.0000 0.5689 0.4874
74-GC 0.1250 0.8333 1.0000 1.0000 1.0000 0.8490 0.3149 0.1667 0.8750 0.3710 0.7330 0.5161 0.2266 0.6667 1.0000 0.9524 0.1260
75-GC 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 0.0000 0.0000 0.0000 0.0000 1.0000 1.0000 0.0000 1.0000 1.0000 1.0000 0.0000
122
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2DE-CLEF2007
Statistics for Precision at the 10% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0071 0.0283 0.1176 0.1667 0.0591 0.0656 0.1105 0.1667 1.1097 0.0062 0.0000 0.0561 0.0000 0.1667 0.0591 0.0656
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0098 0.0358 0.4000 0.4643 0.7500 0.3200 0.2673 0.4284 0.7402 0.8353 0.1505 0.0440 0.2196 0.0098 0.7500 0.3200 0.2673
54-GC 0.0000 0.0318 0.1742 0.6000 1.0000 0.3265 0.4229 0.5682 1.0000 1.2952 0.0380 0.0001 0.3367 0.0000 1.0000 0.3265 0.4229
55-GC 0.0000 0.0015 0.0083 0.0224 0.0258 0.0113 0.0109 0.0209 0.0258 0.9715 0.0033 0.0001 0.0096 0.0000 0.0258 0.0113 0.0109
56-GC 0.0909 0.1667 0.4000 0.7500 1.0000 0.4655 0.3586 0.5833 0.9091 0.7703 0.3453 0.2500 0.2759 0.0909 1.0000 0.4655 0.3586
57-GC 0.0000 0.0000 0.2917 0.3333 0.5000 0.2188 0.1938 0.3333 0.5000 0.8861 0.0068 0.0000 0.1641 0.0000 0.5000 0.2188 0.1938
58-GC 0.0000 0.0028 0.0081 0.1221 0.2963 0.0703 0.1206 0.1193 0.2963 1.7155 0.0068 0.0001 0.0966 0.0000 0.2963 0.0703 0.1206
59-GC 0.0000 0.0000 0.0000 0.0070 0.0303 0.0055 0.0111 0.0070 0.0303 2.0122 0.0001 0.0000 0.0083 0.0000 0.0140 0.0020 0.0053
60-GC 0.0000 0.0000 0.1000 0.5167 0.8571 0.2613 0.3442 0.5167 0.8571 1.3174 0.0021 0.0000 0.2766 0.0000 0.8571 0.2613 0.3442
61-GC 0.0000 0.0000 0.3188 0.3987 0.7500 0.2731 0.2650 0.3987 0.7500 0.9702 0.0077 0.0000 0.2049 0.0000 0.7500 0.2731 0.2650
62-GC 0.0090 0.0186 0.0605 0.1260 0.1892 0.0761 0.0666 0.1074 0.1801 0.8754 0.0472 0.0263 0.0532 0.0090 0.1892 0.0761 0.0666
63-GC 0.3448 0.5889 1.0000 1.0000 1.0000 0.8153 0.2843 0.4111 0.6552 0.3487 0.7565 0.6846 0.2308 0.3448 1.0000 0.8153 0.2843
64-GC 0.0000 0.0027 0.0422 0.0655 0.1429 0.0455 0.0480 0.0628 0.1429 1.0562 0.0097 0.0001 0.0352 0.0000 0.1429 0.0455 0.0480
65-GC 0.1042 0.2525 0.5556 0.6217 0.6552 0.4523 0.2242 0.3693 0.5510 0.4956 0.3762 0.2840 0.1870 0.1042 0.6552 0.4523 0.2242
66-GC 0.0000 0.0010 0.0328 0.0500 0.1250 0.0366 0.0415 0.0490 0.1250 1.1355 0.0040 0.0000 0.0288 0.0000 0.0500 0.0239 0.0229
67-GC 0.0000 0.0162 0.0932 0.1556 0.1739 0.0880 0.0715 0.1394 0.1739 0.8130 0.0102 0.0000 0.0579 0.0000 0.1739 0.0880 0.0715
68-GC 0.0439 0.2582 0.6677 0.7541 0.7778 0.5227 0.2887 0.4959 0.7339 0.5523 0.3937 0.2135 0.2519 0.0439 0.7778 0.5227 0.2887
69-GC 0.0870 0.3669 0.4722 0.7500 1.0000 0.5331 0.2926 0.3831 0.9130 0.5488 0.4395 0.3186 0.2251 0.0870 1.0000 0.5331 0.2926
70-GC 0.0054 0.0217 0.0399 0.1583 0.3000 0.0932 0.1205 0.1366 0.2946 1.2930 0.0398 0.0168 0.0966 0.0054 0.3000 0.0932 0.1205
71-GC 0.0426 0.0571 0.3125 0.8750 1.0000 0.4415 0.4272 0.8179 0.9574 0.9676 0.2245 0.1109 0.3710 0.0426 1.0000 0.4415 0.4272
72-GC 0.0081 0.0109 0.0124 0.0294 1.0000 0.1392 0.3479 0.0185 0.9919 2.4994 0.0244 0.0148 0.2152 0.0081 0.0294 0.0162 0.0092
73-GC 0.0000 0.0257 0.7500 1.0000 1.0000 0.5689 0.4874 0.9743 1.0000 0.8567 0.0777 0.0001 0.4311 0.0000 1.0000 0.5689 0.4874
74-GC 0.1250 0.8333 1.0000 1.0000 1.0000 0.8490 0.3149 0.1667 0.8750 0.3710 0.7330 0.5161 0.2266 0.6667 1.0000 0.9524 0.1260
75-GC 0.8136 0.9354 0.9474 0.9783 1.0000 0.9420 0.0581 0.0428 0.1864 0.0616 0.9403 0.9385 0.0354 0.9333 1.0000 0.9603 0.0281
123
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2DE-CLEF2007
Statistics for Precision at the 20% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0051 0.0159 0.0675 0.1250 0.0378 0.0474 0.0624 0.1250 1.2553 0.0043 0.0000 0.0367 0.0000 0.1250 0.0378 0.0474
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0098 0.0306 0.4000 0.4643 0.7500 0.3187 0.2690 0.4336 0.7402 0.8440 0.1376 0.0344 0.2213 0.0098 0.7500 0.3187 0.2690
54-GC 0.0000 0.0318 0.1742 0.6000 1.0000 0.3265 0.4229 0.5682 1.0000 1.2952 0.0380 0.0001 0.3367 0.0000 1.0000 0.3265 0.4229
55-GC 0.0000 0.0000 0.0000 0.0224 0.0258 0.0088 0.0122 0.0224 0.0258 1.3854 0.0002 0.0000 0.0110 0.0000 0.0258 0.0088 0.0122
56-GC 0.0909 0.1667 0.4000 0.7500 1.0000 0.4655 0.3586 0.5833 0.9091 0.7703 0.3453 0.2500 0.2759 0.0909 1.0000 0.4655 0.3586
57-GC 0.0000 0.0000 0.2917 0.3333 0.5000 0.2188 0.1938 0.3333 0.5000 0.8861 0.0068 0.0000 0.1641 0.0000 0.5000 0.2188 0.1938
58-GC 0.0000 0.0000 0.0081 0.1179 0.2963 0.0685 0.1195 0.1179 0.2963 1.7433 0.0017 0.0000 0.0954 0.0000 0.2222 0.0360 0.0823
59-GC 0.0000 0.0000 0.0000 0.0070 0.0303 0.0055 0.0111 0.0070 0.0303 2.0122 0.0001 0.0000 0.0083 0.0000 0.0140 0.0020 0.0053
60-GC 0.0000 0.0000 0.0948 0.4686 0.6667 0.2242 0.2855 0.4686 0.6667 1.2736 0.0020 0.0000 0.2328 0.0000 0.6667 0.2242 0.2855
61-GC 0.0000 0.0000 0.2409 0.3507 0.4722 0.2069 0.1907 0.3507 0.4722 0.9217 0.0065 0.0000 0.1559 0.0000 0.4722 0.2069 0.1907
62-GC 0.0090 0.0157 0.0484 0.1260 0.1892 0.0723 0.0677 0.1103 0.1801 0.9365 0.0437 0.0250 0.0561 0.0090 0.1892 0.0723 0.0677
63-GC 0.1667 0.5057 0.8889 0.8889 0.8889 0.7028 0.2903 0.3831 0.7222 0.4131 0.6179 0.4992 0.2326 0.1667 0.8889 0.7028 0.2903
64-GC 0.0000 0.0000 0.0294 0.0500 0.0698 0.0286 0.0277 0.0500 0.0698 0.9712 0.0018 0.0000 0.0226 0.0000 0.0698 0.0286 0.0277
65-GC 0.0826 0.2317 0.4676 0.5690 0.6552 0.4093 0.2151 0.3372 0.5725 0.5256 0.3359 0.2485 0.1704 0.0826 0.6552 0.4093 0.2151
66-GC 0.0000 0.0010 0.0328 0.0500 0.1250 0.0366 0.0415 0.0490 0.1250 1.1355 0.0040 0.0000 0.0288 0.0000 0.0500 0.0239 0.0229
67-GC 0.0000 0.0120 0.0353 0.0523 0.0583 0.0322 0.0238 0.0404 0.0583 0.7397 0.0051 0.0000 0.0201 0.0000 0.0583 0.0322 0.0238
68-GC 0.0000 0.2308 0.6165 0.6962 0.7778 0.4831 0.2872 0.4654 0.7778 0.5946 0.1288 0.0001 0.2469 0.0000 0.7778 0.4831 0.2872
69-GC 0.0566 0.2580 0.3911 0.5833 0.6923 0.4017 0.2162 0.3253 0.6357 0.5382 0.3273 0.2251 0.1683 0.0566 0.6923 0.4017 0.2162
70-GC 0.0051 0.0148 0.0373 0.0861 0.2778 0.0699 0.0925 0.0713 0.2727 1.3234 0.0329 0.0153 0.0666 0.0051 0.1282 0.0402 0.0418
71-GC 0.0426 0.0509 0.1433 0.8750 1.0000 0.3976 0.4386 0.8241 0.9574 1.1032 0.1893 0.0994 0.3893 0.0426 1.0000 0.3976 0.4386
72-GC 0.0050 0.0060 0.0080 0.0100 0.3333 0.0483 0.1152 0.0039 0.3284 2.3855 0.0118 0.0080 0.0713 0.0050 0.0100 0.0076 0.0021
73-GC 0.0000 0.0154 0.1981 0.3750 0.6000 0.2221 0.2260 0.3596 0.6000 1.0173 0.0379 0.0001 0.1709 0.0000 0.6000 0.2221 0.2260
74-GC 0.1250 0.5000 0.6667 1.0000 1.0000 0.6823 0.3118 0.5000 0.8750 0.4569 0.5859 0.4444 0.2383 0.1250 1.0000 0.6823 0.3118
75-GC 0.8136 0.8698 0.9060 0.9296 0.9643 0.8986 0.0486 0.0598 0.1507 0.0541 0.8974 0.8962 0.0356 0.8136 0.9643 0.8986 0.0486
124
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2DE-CLEF2007
Statistics for Precision at the 30% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0110 0.0432 0.1053 0.0267 0.0367 0.0432 0.1053 1.3734 0.0015 0.0000 0.0279 0.0000 0.1053 0.0267 0.0367
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0043 0.0110 0.1818 0.4643 0.7500 0.2586 0.2788 0.4533 0.7457 1.0784 0.0809 0.0175 0.2293 0.0043 0.7500 0.2586 0.2788
54-GC 0.0000 0.0000 0.0209 0.1166 1.0000 0.1594 0.3450 0.1166 1.0000 2.1650 0.0028 0.0000 0.2158 0.0000 0.1818 0.0393 0.0655
55-GC 0.0000 0.0000 0.0000 0.0224 0.0258 0.0088 0.0122 0.0224 0.0258 1.3854 0.0002 0.0000 0.0110 0.0000 0.0258 0.0088 0.0122
56-GC 0.0909 0.1375 0.2000 0.3667 0.4000 0.2374 0.1263 0.2292 0.3091 0.5319 0.2073 0.1805 0.1084 0.0909 0.4000 0.2374 0.1263
57-GC 0.0000 0.0000 0.2917 0.3333 0.5000 0.2188 0.1938 0.3333 0.5000 0.8861 0.0068 0.0000 0.1641 0.0000 0.5000 0.2188 0.1938
58-GC 0.0000 0.0000 0.0051 0.1179 0.2963 0.0678 0.1200 0.1179 0.2963 1.7700 0.0007 0.0000 0.0957 0.0000 0.2222 0.0351 0.0827
59-GC 0.0000 0.0000 0.0000 0.0070 0.0202 0.0043 0.0081 0.0070 0.0202 1.8920 0.0001 0.0000 0.0064 0.0000 0.0140 0.0020 0.0053
60-GC 0.0000 0.0000 0.0645 0.4241 0.6667 0.2055 0.2831 0.4241 0.6667 1.3777 0.0018 0.0000 0.2246 0.0000 0.6667 0.2055 0.2831
61-GC 0.0000 0.0000 0.1980 0.3151 0.4722 0.1873 0.1813 0.3151 0.4722 0.9677 0.0060 0.0000 0.1435 0.0000 0.4722 0.1873 0.1813
62-GC 0.0000 0.0000 0.0354 0.1047 0.1466 0.0533 0.0578 0.1047 0.1466 1.0828 0.0026 0.0000 0.0490 0.0000 0.1466 0.0533 0.0578
63-GC 0.1333 0.3860 0.7000 0.8661 0.8750 0.6141 0.2822 0.4801 0.7417 0.4596 0.5289 0.4164 0.2342 0.1333 0.8750 0.6141 0.2822
64-GC 0.0000 0.0000 0.0242 0.0457 0.0556 0.0244 0.0239 0.0457 0.0556 0.9782 0.0016 0.0000 0.0211 0.0000 0.0556 0.0244 0.0239
65-GC 0.0454 0.1252 0.3282 0.4750 0.5000 0.3003 0.1967 0.3498 0.4546 0.6551 0.2162 0.1330 0.1747 0.0454 0.5000 0.3003 0.1967
66-GC 0.0000 0.0010 0.0328 0.0500 0.1250 0.0366 0.0415 0.0490 0.1250 1.1355 0.0040 0.0000 0.0288 0.0000 0.0500 0.0239 0.0229
67-GC 0.0000 0.0106 0.0311 0.0459 0.0535 0.0286 0.0212 0.0353 0.0535 0.7415 0.0046 0.0000 0.0173 0.0000 0.0535 0.0286 0.0212
68-GC 0.0000 0.2094 0.3785 0.4940 0.5031 0.3334 0.1799 0.2846 0.5031 0.5396 0.0968 0.0001 0.1453 0.0000 0.5031 0.3334 0.1799
69-GC 0.0000 0.1312 0.3125 0.4905 0.6667 0.3169 0.2331 0.3593 0.6667 0.7358 0.0772 0.0001 0.1784 0.0000 0.6667 0.3169 0.2331
70-GC 0.0000 0.0000 0.0357 0.0609 0.0833 0.0346 0.0337 0.0609 0.0833 0.9741 0.0021 0.0000 0.0262 0.0000 0.0833 0.0346 0.0337
71-GC 0.0426 0.0509 0.1433 0.4583 0.7500 0.2622 0.3052 0.4075 0.7074 1.1639 0.1460 0.0932 0.2439 0.0426 0.7500 0.2622 0.3052
72-GC 0.0041 0.0052 0.0068 0.0079 0.3333 0.0472 0.1156 0.0027 0.3292 2.4526 0.0100 0.0067 0.0715 0.0041 0.0081 0.0063 0.0016
73-GC 0.0000 0.0061 0.1786 0.3750 0.6000 0.2149 0.2297 0.3689 0.6000 1.0690 0.0152 0.0000 0.1763 0.0000 0.6000 0.2149 0.2297
74-GC 0.0380 0.1127 0.1882 0.4167 0.7500 0.2779 0.2419 0.3039 0.7120 0.8704 0.1892 0.1206 0.1874 0.0380 0.7500 0.2779 0.2419
75-GC 0.8136 0.8629 0.8974 0.9084 0.9459 0.8871 0.0411 0.0455 0.1324 0.0464 0.8863 0.8854 0.0305 0.8136 0.9459 0.8871 0.0411
125
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2DE-CLEF2007
Statistics for Precision at the 40% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0000 0.0204 0.0631 0.0130 0.0225 0.0204 0.0631 1.7373 0.0002 0.0000 0.0162 0.0000 0.0273 0.0058 0.0107
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0043 0.0110 0.0524 0.1861 0.4000 0.1129 0.1379 0.1751 0.3957 1.2211 0.0452 0.0164 0.1084 0.0043 0.4000 0.1129 0.1379
54-GC 0.0000 0.0000 0.0209 0.1166 1.0000 0.1594 0.3450 0.1166 1.0000 2.1650 0.0028 0.0000 0.2158 0.0000 0.1818 0.0393 0.0655
55-GC 0.0000 0.0000 0.0000 0.0224 0.0258 0.0088 0.0122 0.0224 0.0258 1.3854 0.0002 0.0000 0.0110 0.0000 0.0258 0.0088 0.0122
56-GC 0.0909 0.1375 0.2000 0.3667 0.4000 0.2374 0.1263 0.2292 0.3091 0.5319 0.2073 0.1805 0.1084 0.0909 0.4000 0.2374 0.1263
57-GC 0.0000 0.0000 0.2917 0.3333 0.5000 0.2188 0.1938 0.3333 0.5000 0.8861 0.0068 0.0000 0.1641 0.0000 0.5000 0.2188 0.1938
58-GC 0.0000 0.0000 0.0051 0.1179 0.2963 0.0678 0.1200 0.1179 0.2963 1.7700 0.0007 0.0000 0.0957 0.0000 0.2222 0.0351 0.0827
59-GC 0.0000 0.0000 0.0000 0.0070 0.0202 0.0043 0.0081 0.0070 0.0202 1.8920 0.0001 0.0000 0.0064 0.0000 0.0140 0.0020 0.0053
60-GC 0.0000 0.0000 0.0498 0.4017 0.6667 0.1962 0.2843 0.4017 0.6667 1.4491 0.0017 0.0000 0.2240 0.0000 0.6667 0.1962 0.2843
61-GC 0.0000 0.0000 0.1723 0.2464 0.3167 0.1442 0.1319 0.2464 0.3167 0.9146 0.0052 0.0000 0.1082 0.0000 0.3167 0.1442 0.1319
62-GC 0.0000 0.0000 0.0295 0.0996 0.1466 0.0506 0.0570 0.0996 0.1466 1.1270 0.0024 0.0000 0.0485 0.0000 0.1466 0.0506 0.0570
63-GC 0.0370 0.1221 0.4738 0.6643 0.7619 0.4149 0.2934 0.5422 0.7249 0.7071 0.2810 0.1529 0.2494 0.0370 0.7619 0.4149 0.2934
64-GC 0.0000 0.0000 0.0067 0.0278 0.0500 0.0149 0.0196 0.0278 0.0500 1.3178 0.0005 0.0000 0.0153 0.0000 0.0500 0.0149 0.0196
65-GC 0.0000 0.0519 0.2756 0.4722 0.5000 0.2624 0.2287 0.4203 0.5000 0.8717 0.0220 0.0000 0.2098 0.0000 0.5000 0.2624 0.2287
66-GC 0.0000 0.0010 0.0328 0.0500 0.1250 0.0366 0.0415 0.0490 0.1250 1.1355 0.0040 0.0000 0.0288 0.0000 0.0500 0.0239 0.0229
67-GC 0.0000 0.0000 0.0191 0.0459 0.0535 0.0229 0.0252 0.0459 0.0535 1.0984 0.0007 0.0000 0.0229 0.0000 0.0535 0.0229 0.0252
68-GC 0.0000 0.1958 0.2100 0.2751 0.4059 0.2209 0.1190 0.0793 0.4059 0.5385 0.0686 0.0001 0.0759 0.1821 0.3396 0.2269 0.0563
69-GC 0.0000 0.0222 0.1261 0.3271 0.6667 0.2022 0.2319 0.3049 0.6667 1.1469 0.0156 0.0000 0.1786 0.0000 0.6667 0.2022 0.2319
70-GC 0.0000 0.0000 0.0282 0.0396 0.0529 0.0236 0.0214 0.0396 0.0529 0.9092 0.0017 0.0000 0.0185 0.0000 0.0529 0.0236 0.0214
71-GC 0.0426 0.0509 0.1433 0.4583 0.7500 0.2622 0.3052 0.4075 0.7074 1.1639 0.1460 0.0932 0.2439 0.0426 0.7500 0.2622 0.3052
72-GC 0.0000 0.0025 0.0058 0.0079 0.0562 0.0111 0.0185 0.0054 0.0562 1.6710 0.0017 0.0000 0.0113 0.0000 0.0081 0.0046 0.0033
73-GC 0.0000 0.0061 0.1786 0.3750 0.6000 0.2149 0.2297 0.3689 0.6000 1.0690 0.0152 0.0000 0.1763 0.0000 0.6000 0.2149 0.2297
74-GC 0.0310 0.0375 0.0482 0.2133 0.4000 0.1286 0.1378 0.1759 0.3690 1.0710 0.0801 0.0570 0.1102 0.0310 0.4000 0.1286 0.1378
75-GC 0.8136 0.8391 0.8759 0.9002 0.9123 0.8695 0.0371 0.0611 0.0987 0.0426 0.8688 0.8681 0.0323 0.8136 0.9123 0.8695 0.0371
126
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2DE-CLEF2007
Statistics for Precision at the 50% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0000 0.0106 0.0631 0.0105 0.0225 0.0106 0.0631 2.1351 0.0001 0.0000 0.0158 0.0000 0.0212 0.0030 0.0080
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0104 0.0248 0.0567 0.1515 0.0419 0.0494 0.0463 0.1515 1.1782 0.0112 0.0001 0.0348 0.0000 0.0649 0.0263 0.0236
54-GC 0.0000 0.0000 0.0209 0.1166 1.0000 0.1594 0.3450 0.1166 1.0000 2.1650 0.0028 0.0000 0.2158 0.0000 0.1818 0.0393 0.0655
55-GC 0.0000 0.0000 0.0000 0.0222 0.0258 0.0088 0.0122 0.0222 0.0258 1.3864 0.0002 0.0000 0.0110 0.0000 0.0258 0.0088 0.0122
56-GC 0.0000 0.0000 0.1500 0.2917 0.3333 0.1521 0.1438 0.2917 0.3333 0.9453 0.0053 0.0000 0.1151 0.0000 0.3333 0.1521 0.1438
57-GC 0.0000 0.0000 0.2917 0.3333 0.5000 0.2188 0.1938 0.3333 0.5000 0.8861 0.0068 0.0000 0.1641 0.0000 0.5000 0.2188 0.1938
58-GC 0.0000 0.0000 0.0051 0.1179 0.2264 0.0590 0.1022 0.1179 0.2264 1.7304 0.0007 0.0000 0.0826 0.0000 0.2264 0.0590 0.1022
59-GC 0.0000 0.0000 0.0000 0.0070 0.0202 0.0043 0.0081 0.0070 0.0202 1.8920 0.0001 0.0000 0.0064 0.0000 0.0140 0.0020 0.0053
60-GC 0.0000 0.0000 0.0349 0.3678 0.6667 0.1840 0.2847 0.3678 0.6667 1.5472 0.0016 0.0000 0.2274 0.0000 0.6667 0.1840 0.2847
61-GC 0.0000 0.0000 0.1613 0.2006 0.2526 0.1220 0.1061 0.2006 0.2526 0.8696 0.0047 0.0000 0.0915 0.0000 0.2526 0.1220 0.1061
62-GC 0.0000 0.0000 0.0187 0.0996 0.1466 0.0479 0.0590 0.0996 0.1466 1.2326 0.0009 0.0000 0.0505 0.0000 0.1466 0.0479 0.0590
63-GC 0.0000 0.0889 0.2825 0.4498 0.4878 0.2663 0.2033 0.3609 0.4878 0.7636 0.0672 0.0001 0.1835 0.0000 0.4878 0.2663 0.2033
64-GC 0.0000 0.0000 0.0054 0.0164 0.0354 0.0099 0.0127 0.0164 0.0354 1.2847 0.0004 0.0000 0.0099 0.0000 0.0354 0.0099 0.0127
65-GC 0.0000 0.0000 0.2058 0.3918 0.4571 0.2066 0.2060 0.3918 0.4571 0.9974 0.0061 0.0000 0.1853 0.0000 0.4571 0.2066 0.2060
66-GC 0.0000 0.0010 0.0328 0.0500 0.1250 0.0366 0.0415 0.0490 0.1250 1.1355 0.0040 0.0000 0.0288 0.0000 0.0500 0.0239 0.0229
67-GC 0.0000 0.0000 0.0000 0.0266 0.0533 0.0133 0.0247 0.0266 0.0533 1.8516 0.0001 0.0000 0.0200 0.0000 0.0533 0.0133 0.0247
68-GC 0.0000 0.0000 0.1013 0.2077 0.2807 0.1124 0.1226 0.2077 0.2807 1.0910 0.0015 0.0000 0.1124 0.0000 0.2807 0.1124 0.1226
69-GC 0.0000 0.0000 0.1261 0.2788 0.6667 0.1846 0.2300 0.2788 0.6667 1.2462 0.0052 0.0000 0.1707 0.0000 0.6667 0.1846 0.2300
70-GC 0.0000 0.0000 0.0247 0.0373 0.0480 0.0215 0.0195 0.0373 0.0480 0.9061 0.0016 0.0000 0.0165 0.0000 0.0480 0.0215 0.0195
71-GC 0.0426 0.0506 0.0685 0.1558 0.3636 0.1195 0.1104 0.1052 0.3211 0.9234 0.0900 0.0737 0.0792 0.0426 0.1905 0.0846 0.0535
72-GC 0.0000 0.0000 0.0000 0.0079 0.0562 0.0090 0.0194 0.0079 0.0562 2.1558 0.0002 0.0000 0.0118 0.0000 0.0081 0.0023 0.0039
73-GC 0.0000 0.0061 0.1121 0.3750 0.5000 0.1858 0.2112 0.3689 0.5000 1.1365 0.0132 0.0000 0.1731 0.0000 0.5000 0.1858 0.2112
74-GC 0.0310 0.0375 0.0482 0.2133 0.4000 0.1286 0.1378 0.1759 0.3690 1.0710 0.0801 0.0570 0.1102 0.0310 0.4000 0.1286 0.1378
75-GC 0.7973 0.8172 0.8420 0.8703 0.8939 0.8438 0.0336 0.0531 0.0966 0.0398 0.8432 0.8426 0.0275 0.7973 0.8939 0.8438 0.0336
127
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2DE-CLEF2007
Statistics for Precision at the 60% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0000 0.0000 0.0631 0.0079 0.0223 0.0000 0.0631 2.8284 0.0000 0.0000 0.0138 0.0000 0.0000 0.0000 0.0000
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0078 0.0107 0.0249 0.0438 0.0163 0.0158 0.0171 0.0438 0.9669 0.0058 0.0001 0.0124 0.0000 0.0438 0.0163 0.0158
54-GC 0.0000 0.0000 0.0209 0.0279 0.0476 0.0182 0.0174 0.0279 0.0476 0.9609 0.0014 0.0000 0.0136 0.0000 0.0476 0.0182 0.0174
55-GC 0.0000 0.0000 0.0000 0.0148 0.0169 0.0058 0.0081 0.0148 0.0169 1.3845 0.0002 0.0000 0.0073 0.0000 0.0169 0.0058 0.0081
56-GC 0.0000 0.0000 0.1500 0.2917 0.3333 0.1521 0.1438 0.2917 0.3333 0.9453 0.0053 0.0000 0.1151 0.0000 0.3333 0.1521 0.1438
57-GC 0.0000 0.0000 0.2917 0.3333 0.5000 0.2188 0.1938 0.3333 0.5000 0.8861 0.0068 0.0000 0.1641 0.0000 0.5000 0.2188 0.1938
58-GC 0.0000 0.0000 0.0000 0.0321 0.2264 0.0363 0.0789 0.0321 0.2264 2.1716 0.0002 0.0000 0.0514 0.0000 0.0517 0.0092 0.0193
59-GC 0.0000 0.0000 0.0000 0.0034 0.0152 0.0027 0.0056 0.0034 0.0152 2.0262 0.0001 0.0000 0.0041 0.0000 0.0068 0.0010 0.0026
60-GC 0.0000 0.0000 0.0349 0.3212 0.6111 0.1654 0.2588 0.3212 0.6111 1.5649 0.0015 0.0000 0.2072 0.0000 0.6111 0.1654 0.2588
61-GC 0.0000 0.0000 0.1314 0.1352 0.1472 0.0850 0.0706 0.1352 0.1472 0.8302 0.0038 0.0000 0.0638 0.0000 0.1472 0.0850 0.0706
62-GC 0.0000 0.0000 0.0187 0.0979 0.1164 0.0437 0.0519 0.0979 0.1164 1.1875 0.0009 0.0000 0.0453 0.0000 0.1164 0.0437 0.0519
63-GC 0.0000 0.0123 0.1369 0.2495 0.3038 0.1376 0.1287 0.2372 0.3038 0.9352 0.0127 0.0000 0.1118 0.0000 0.3038 0.1376 0.1287
64-GC 0.0000 0.0000 0.0000 0.0148 0.0170 0.0058 0.0081 0.0148 0.0170 1.3874 0.0002 0.0000 0.0073 0.0000 0.0170 0.0058 0.0081
65-GC 0.0000 0.0000 0.1136 0.1583 0.1610 0.0881 0.0787 0.1583 0.1610 0.8930 0.0038 0.0000 0.0702 0.0000 0.1610 0.0881 0.0787
66-GC 0.0000 0.0000 0.0000 0.0060 0.0110 0.0029 0.0047 0.0060 0.0110 1.6527 0.0001 0.0000 0.0038 0.0000 0.0110 0.0029 0.0047
67-GC 0.0000 0.0000 0.0000 0.0207 0.0415 0.0104 0.0192 0.0207 0.0415 1.8516 0.0001 0.0000 0.0156 0.0000 0.0415 0.0104 0.0192
68-GC 0.0000 0.0000 0.0000 0.0959 0.1917 0.0479 0.0887 0.0959 0.1917 1.8516 0.0001 0.0000 0.0719 0.0000 0.1917 0.0479 0.0887
69-GC 0.0000 0.0000 0.0776 0.1887 0.6136 0.1433 0.2061 0.1887 0.6136 1.4386 0.0043 0.0000 0.1403 0.0000 0.1985 0.0761 0.0861
70-GC 0.0000 0.0000 0.0138 0.0373 0.0464 0.0186 0.0205 0.0373 0.0464 1.1030 0.0006 0.0000 0.0186 0.0000 0.0464 0.0186 0.0205
71-GC 0.0051 0.0208 0.0603 0.1327 0.2778 0.0888 0.0911 0.1119 0.2726 1.0261 0.0494 0.0227 0.0692 0.0051 0.2778 0.0888 0.0911
72-GC 0.0000 0.0000 0.0000 0.0039 0.0275 0.0044 0.0097 0.0039 0.0275 2.2066 0.0001 0.0000 0.0066 0.0000 0.0077 0.0011 0.0029
73-GC 0.0000 0.0061 0.1040 0.3054 0.5000 0.1664 0.2009 0.2993 0.5000 1.2075 0.0120 0.0000 0.1555 0.0000 0.5000 0.1664 0.2009
74-GC 0.0000 0.0079 0.0099 0.0913 0.2500 0.0585 0.0913 0.0834 0.2500 1.5599 0.0096 0.0001 0.0700 0.0000 0.1471 0.0312 0.0523
75-GC 0.3594 0.7122 0.7346 0.7680 0.7889 0.6972 0.1396 0.0558 0.4295 0.2003 0.6801 0.6565 0.0845 0.7000 0.7889 0.7455 0.0317
128
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2DE-CLEF2007
Statistics for Precision at the 70% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0000 0.0000 0.0598 0.0075 0.0211 0.0000 0.0598 2.8284 0.0000 0.0000 0.0131 0.0000 0.0000 0.0000 0.0000
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0000 0.0055 0.0184 0.0037 0.0071 0.0055 0.0184 1.9267 0.0001 0.0000 0.0055 0.0000 0.0111 0.0016 0.0042
54-GC 0.0000 0.0000 0.0209 0.0279 0.0476 0.0182 0.0174 0.0279 0.0476 0.9609 0.0014 0.0000 0.0136 0.0000 0.0476 0.0182 0.0174
55-GC 0.0000 0.0000 0.0000 0.0148 0.0169 0.0058 0.0081 0.0148 0.0169 1.3845 0.0002 0.0000 0.0073 0.0000 0.0169 0.0058 0.0081
56-GC 0.0000 0.0000 0.1026 0.2000 0.2500 0.1069 0.1015 0.2000 0.2500 0.9497 0.0042 0.0000 0.0823 0.0000 0.2500 0.1069 0.1015
57-GC 0.0000 0.0000 0.2917 0.3333 0.5000 0.2188 0.1938 0.3333 0.5000 0.8861 0.0068 0.0000 0.1641 0.0000 0.5000 0.2188 0.1938
58-GC 0.0000 0.0000 0.0000 0.0246 0.0517 0.0126 0.0234 0.0246 0.0517 1.8523 0.0001 0.0000 0.0189 0.0000 0.0517 0.0126 0.0234
59-GC 0.0000 0.0000 0.0000 0.0034 0.0152 0.0027 0.0056 0.0034 0.0152 2.0262 0.0001 0.0000 0.0041 0.0000 0.0068 0.0010 0.0026
60-GC 0.0000 0.0000 0.0252 0.3131 0.5692 0.1557 0.2473 0.3131 0.5692 1.5881 0.0014 0.0000 0.1985 0.0000 0.5692 0.1557 0.2473
61-GC 0.0000 0.0000 0.0736 0.1022 0.1187 0.0588 0.0514 0.1022 0.1187 0.8741 0.0030 0.0000 0.0441 0.0000 0.1187 0.0588 0.0514
62-GC 0.0000 0.0000 0.0187 0.0966 0.1080 0.0423 0.0499 0.0966 0.1080 1.1780 0.0009 0.0000 0.0436 0.0000 0.1080 0.0423 0.0499
63-GC 0.0000 0.0000 0.0468 0.0666 0.0753 0.0378 0.0331 0.0666 0.0753 0.8761 0.0023 0.0000 0.0283 0.0000 0.0753 0.0378 0.0331
64-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0000 0.0519 0.1040 0.1040 0.0520 0.0556 0.1040 0.1040 1.0690 0.0010 0.0000 0.0520 0.0000 0.1040 0.0520 0.0556
66-GC 0.0000 0.0000 0.0000 0.0060 0.0110 0.0029 0.0047 0.0060 0.0110 1.6527 0.0001 0.0000 0.0038 0.0000 0.0110 0.0029 0.0047
67-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
68-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
69-GC 0.0000 0.0000 0.0227 0.0547 0.3232 0.0598 0.1095 0.0547 0.3232 1.8332 0.0009 0.0000 0.0659 0.0000 0.0596 0.0221 0.0279
70-GC 0.0000 0.0000 0.0000 0.0116 0.0406 0.0080 0.0155 0.0116 0.0406 1.9407 0.0001 0.0000 0.0120 0.0000 0.0232 0.0033 0.0088
71-GC 0.0051 0.0208 0.0603 0.1327 0.2778 0.0888 0.0911 0.1119 0.2726 1.0261 0.0494 0.0227 0.0692 0.0051 0.2778 0.0888 0.0911
72-GC 0.0000 0.0000 0.0000 0.0000 0.0091 0.0011 0.0032 0.0000 0.0091 2.8284 0.0000 0.0000 0.0020 0.0000 0.0000 0.0000 0.0000
73-GC 0.0000 0.0061 0.1040 0.3054 0.5000 0.1664 0.2009 0.2993 0.5000 1.2075 0.0120 0.0000 0.1555 0.0000 0.5000 0.1664 0.2009
74-GC 0.0000 0.0045 0.0097 0.0195 0.0438 0.0139 0.0142 0.0150 0.0438 1.0165 0.0025 0.0000 0.0103 0.0000 0.0201 0.0097 0.0080
75-GC 0.0000 0.0000 0.1012 0.4362 0.6029 0.2097 0.2448 0.4362 0.6029 1.1676 0.0057 0.0000 0.2115 0.0000 0.6029 0.2097 0.2448
129
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2DE-CLEF2007
Statistics for Precision at the 80% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0000 0.0000 0.0527 0.0066 0.0186 0.0000 0.0527 2.8284 0.0000 0.0000 0.0115 0.0000 0.0000 0.0000 0.0000
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
54-GC 0.0000 0.0000 0.0000 0.0080 0.0360 0.0065 0.0126 0.0080 0.0360 1.9435 0.0001 0.0000 0.0087 0.0000 0.0118 0.0023 0.0045
55-GC 0.0000 0.0000 0.0000 0.0118 0.0166 0.0050 0.0073 0.0118 0.0166 1.4525 0.0001 0.0000 0.0063 0.0000 0.0166 0.0050 0.0073
56-GC 0.0000 0.0000 0.1026 0.2000 0.2500 0.1069 0.1015 0.2000 0.2500 0.9497 0.0042 0.0000 0.0823 0.0000 0.2500 0.1069 0.1015
57-GC 0.0000 0.0000 0.2917 0.3333 0.5000 0.2188 0.1938 0.3333 0.5000 0.8861 0.0068 0.0000 0.1641 0.0000 0.5000 0.2188 0.1938
58-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
59-GC 0.0000 0.0000 0.0000 0.0024 0.0152 0.0025 0.0054 0.0024 0.0152 2.1670 0.0001 0.0000 0.0037 0.0000 0.0047 0.0007 0.0018
60-GC 0.0000 0.0000 0.0000 0.1774 0.4200 0.0969 0.1687 0.1774 0.4200 1.7413 0.0004 0.0000 0.1339 0.0000 0.4200 0.0969 0.1687
61-GC 0.0000 0.0000 0.0428 0.0651 0.0830 0.0373 0.0345 0.0651 0.0830 0.9239 0.0022 0.0000 0.0280 0.0000 0.0830 0.0373 0.0345
62-GC 0.0000 0.0000 0.0178 0.0811 0.0949 0.0366 0.0426 0.0811 0.0949 1.1654 0.0008 0.0000 0.0368 0.0000 0.0949 0.0366 0.0426
63-GC 0.0000 0.0000 0.0337 0.0391 0.0547 0.0250 0.0217 0.0391 0.0547 0.8681 0.0018 0.0000 0.0188 0.0000 0.0547 0.0250 0.0217
64-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
66-GC 0.0000 0.0000 0.0000 0.0060 0.0110 0.0029 0.0047 0.0060 0.0110 1.6527 0.0001 0.0000 0.0038 0.0000 0.0110 0.0029 0.0047
67-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
68-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
69-GC 0.0000 0.0000 0.0000 0.0227 0.0596 0.0131 0.0246 0.0227 0.0596 1.8739 0.0001 0.0000 0.0197 0.0000 0.0455 0.0065 0.0172
70-GC 0.0000 0.0000 0.0000 0.0116 0.0291 0.0065 0.0122 0.0116 0.0291 1.8670 0.0001 0.0000 0.0098 0.0000 0.0232 0.0033 0.0088
71-GC 0.0000 0.0072 0.0520 0.1327 0.2258 0.0762 0.0811 0.1255 0.2258 1.0637 0.0079 0.0000 0.0656 0.0000 0.2258 0.0762 0.0811
72-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
73-GC 0.0000 0.0000 0.0883 0.2636 0.5000 0.1505 0.1933 0.2636 0.5000 1.2845 0.0046 0.0000 0.1498 0.0000 0.5000 0.1505 0.1933
74-GC 0.0000 0.0000 0.0048 0.0123 0.0292 0.0079 0.0104 0.0123 0.0292 1.3109 0.0004 0.0000 0.0079 0.0000 0.0292 0.0079 0.0104
75-GC 0.0000 0.0000 0.0000 0.0928 0.5549 0.0926 0.1978 0.0928 0.5549 2.1368 0.0001 0.0000 0.1388 0.0000 0.1855 0.0265 0.0701
130
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2DE-CLEF2007
Statistics for Precision at the 90% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0000 0.0000 0.0501 0.0063 0.0177 0.0000 0.0501 2.8284 0.0000 0.0000 0.0110 0.0000 0.0000 0.0000 0.0000
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
54-GC 0.0000 0.0000 0.0000 0.0080 0.0360 0.0065 0.0126 0.0080 0.0360 1.9435 0.0001 0.0000 0.0087 0.0000 0.0118 0.0023 0.0045
55-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
56-GC 0.0000 0.0000 0.0758 0.1058 0.1190 0.0603 0.0526 0.1058 0.1190 0.8719 0.0031 0.0000 0.0452 0.0000 0.1190 0.0603 0.0526
57-GC 0.0000 0.0000 0.2917 0.3333 0.5000 0.2188 0.1938 0.3333 0.5000 0.8861 0.0068 0.0000 0.1641 0.0000 0.5000 0.2188 0.1938
58-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
59-GC 0.0000 0.0000 0.0000 0.0024 0.0152 0.0025 0.0054 0.0024 0.0152 2.1670 0.0001 0.0000 0.0037 0.0000 0.0047 0.0007 0.0018
60-GC 0.0000 0.0000 0.0000 0.0673 0.2127 0.0434 0.0831 0.0673 0.2127 1.9129 0.0001 0.0000 0.0651 0.0000 0.1347 0.0192 0.0509
61-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
62-GC 0.0000 0.0000 0.0165 0.0599 0.0720 0.0281 0.0320 0.0599 0.0720 1.1391 0.0007 0.0000 0.0281 0.0000 0.0720 0.0281 0.0320
63-GC 0.0000 0.0000 0.0000 0.0000 0.0375 0.0047 0.0132 0.0000 0.0375 2.8284 0.0000 0.0000 0.0082 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
66-GC 0.0000 0.0000 0.0000 0.0060 0.0110 0.0029 0.0047 0.0060 0.0110 1.6527 0.0001 0.0000 0.0038 0.0000 0.0110 0.0029 0.0047
67-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
68-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
69-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
70-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
71-GC 0.0000 0.0000 0.0404 0.0822 0.2258 0.0589 0.0771 0.0822 0.2258 1.3095 0.0026 0.0000 0.0544 0.0000 0.1094 0.0350 0.0404
72-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
73-GC 0.0000 0.0000 0.0687 0.1843 0.3500 0.1070 0.1281 0.1843 0.3500 1.1972 0.0039 0.0000 0.0994 0.0000 0.3500 0.1070 0.1281
74-GC 0.0000 0.0000 0.0000 0.0044 0.0292 0.0048 0.0103 0.0044 0.0292 2.1776 0.0001 0.0000 0.0071 0.0000 0.0088 0.0013 0.0033
75-GC 0.0000 0.0000 0.0000 0.0742 0.5508 0.0874 0.1943 0.0742 0.5508 2.2231 0.0001 0.0000 0.1311 0.0000 0.1485 0.0212 0.0561
131
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2DE-CLEF2007
Statistics for Precision at the 100% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
54-GC 0.0000 0.0000 0.0000 0.0080 0.0360 0.0065 0.0126 0.0080 0.0360 1.9435 0.0001 0.0000 0.0087 0.0000 0.0118 0.0023 0.0045
55-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
56-GC 0.0000 0.0000 0.0758 0.1058 0.1190 0.0603 0.0526 0.1058 0.1190 0.8719 0.0031 0.0000 0.0452 0.0000 0.1190 0.0603 0.0526
57-GC 0.0000 0.0000 0.2917 0.3333 0.5000 0.2188 0.1938 0.3333 0.5000 0.8861 0.0068 0.0000 0.1641 0.0000 0.5000 0.2188 0.1938
58-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
59-GC 0.0000 0.0000 0.0000 0.0024 0.0152 0.0025 0.0054 0.0024 0.0152 2.1670 0.0001 0.0000 0.0037 0.0000 0.0047 0.0007 0.0018
60-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
61-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
62-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
66-GC 0.0000 0.0000 0.0000 0.0060 0.0110 0.0029 0.0047 0.0060 0.0110 1.6527 0.0001 0.0000 0.0038 0.0000 0.0110 0.0029 0.0047
67-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
68-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
69-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
70-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
71-GC 0.0000 0.0000 0.0404 0.0822 0.2258 0.0589 0.0771 0.0822 0.2258 1.3095 0.0026 0.0000 0.0544 0.0000 0.1094 0.0350 0.0404
72-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
73-GC 0.0000 0.0000 0.0687 0.1843 0.3500 0.1070 0.1281 0.1843 0.3500 1.1972 0.0039 0.0000 0.0994 0.0000 0.3500 0.1070 0.1281
74-GC 0.0000 0.0000 0.0000 0.0044 0.0292 0.0048 0.0103 0.0044 0.0292 2.1776 0.0001 0.0000 0.0071 0.0000 0.0088 0.0013 0.0033
75-GC 0.0000 0.0000 0.0000 0.0000 0.3444 0.0431 0.1218 0.0000 0.3444 2.8284 0.0000 0.0000 0.0753 0.0000 0.0000 0.0000 0.0000
132
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2DE-CLEF2007
Statistics for P@5
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.1000 0.2000 0.2000 0.1000 0.1069 0.2000 0.2000 1.0690 0.0014 0.0000 0.1000 0.0000 0.2000 0.1000 0.1069
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.3000 0.4000 0.6000 0.2500 0.2330 0.4000 0.6000 0.9320 0.0073 0.0000 0.2000 0.0000 0.6000 0.2500 0.2330
54-GC 0.0000 0.0000 0.0000 0.2000 0.4000 0.1000 0.1512 0.2000 0.4000 1.5119 0.0004 0.0000 0.1250 0.0000 0.4000 0.1000 0.1512
55-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
56-GC 0.0000 0.0000 0.2000 0.3000 0.4000 0.1750 0.1669 0.3000 0.4000 0.9537 0.0058 0.0000 0.1313 0.0000 0.4000 0.1750 0.1669
57-GC 0.0000 0.0000 0.2000 0.2000 0.2000 0.1250 0.1035 0.2000 0.2000 0.8281 0.0049 0.0000 0.0938 0.0000 0.2000 0.1250 0.1035
58-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0000 0.0000 0.0000 0.4000 0.8000 0.2000 0.3207 0.4000 0.8000 1.6036 0.0006 0.0000 0.2500 0.0000 0.8000 0.2000 0.3207
61-GC 0.0000 0.0000 0.1000 0.5000 0.8000 0.2500 0.3162 0.5000 0.8000 1.2649 0.0021 0.0000 0.2625 0.0000 0.8000 0.2500 0.3162
62-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
63-GC 0.4000 0.5000 1.0000 1.0000 1.0000 0.8000 0.2828 0.5000 0.6000 0.3536 0.7461 0.6857 0.2500 0.4000 1.0000 0.8000 0.2828
64-GC 0.0000 0.0000 0.0000 0.0000 0.2000 0.0250 0.0707 0.0000 0.2000 2.8284 0.0000 0.0000 0.0438 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.2000 0.4000 0.6000 0.6000 0.3750 0.2252 0.4000 0.6000 0.6005 0.1041 0.0001 0.1813 0.0000 0.6000 0.3750 0.2252
66-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
67-GC 0.0000 0.0000 0.0000 0.5000 0.8000 0.2250 0.3615 0.5000 0.8000 1.6069 0.0006 0.0000 0.2875 0.0000 0.8000 0.2250 0.3615
68-GC 0.0000 0.2000 0.8000 1.0000 1.0000 0.6250 0.4200 0.8000 1.0000 0.6721 0.1500 0.0001 0.3688 0.0000 1.0000 0.6250 0.4200
69-GC 0.2000 0.4000 0.5000 0.8000 1.0000 0.5750 0.2712 0.4000 0.8000 0.4717 0.5146 0.4528 0.2250 0.2000 1.0000 0.5750 0.2712
70-GC 0.0000 0.0000 0.0000 0.1000 0.2000 0.0500 0.0926 0.1000 0.2000 1.8516 0.0001 0.0000 0.0750 0.0000 0.2000 0.0500 0.0926
71-GC 0.0000 0.0000 0.1000 0.5000 0.6000 0.2250 0.2712 0.5000 0.6000 1.2055 0.0020 0.0000 0.2313 0.0000 0.6000 0.2250 0.2712
72-GC 0.0000 0.0000 0.0000 0.0000 0.2000 0.0250 0.0707 0.0000 0.2000 2.8284 0.0000 0.0000 0.0438 0.0000 0.0000 0.0000 0.0000
73-GC 0.0000 0.0000 0.2000 0.3000 0.6000 0.2000 0.2138 0.3000 0.6000 1.0690 0.0061 0.0000 0.1500 0.0000 0.6000 0.2000 0.2138
74-GC 0.0000 0.4000 0.4000 0.4000 0.6000 0.3750 0.1669 0.0000 0.6000 0.4451 0.1119 0.0001 0.0938 0.4000 0.4000 0.4000 0.0000
75-GC 0.8000 0.8000 1.0000 1.0000 1.0000 0.9250 0.1035 0.2000 0.2000 0.1119 0.9197 0.9143 0.0937 0.8000 1.0000 0.9250 0.1035
133
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2DE-CLEF2007
Statistics for P@10
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0500 0.1000 0.1000 0.0500 0.0535 0.1000 0.1000 1.0690 0.0010 0.0000 0.0500 0.0000 0.1000 0.0500 0.0535
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.2000 0.3000 0.4000 0.1750 0.1581 0.3000 0.4000 0.9035 0.0059 0.0000 0.1313 0.0000 0.4000 0.1750 0.1581
54-GC 0.0000 0.0000 0.1000 0.1000 0.2000 0.0750 0.0707 0.1000 0.2000 0.9428 0.0034 0.0000 0.0563 0.0000 0.2000 0.0750 0.0707
55-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
56-GC 0.0000 0.1000 0.1000 0.2500 0.3000 0.1500 0.1069 0.1500 0.3000 0.7127 0.0454 0.0001 0.0875 0.0000 0.3000 0.1500 0.1069
57-GC 0.0000 0.0000 0.1000 0.1000 0.1000 0.0625 0.0518 0.1000 0.1000 0.8281 0.0032 0.0000 0.0469 0.0000 0.1000 0.0625 0.0518
58-GC 0.0000 0.0000 0.0000 0.0000 0.2000 0.0250 0.0707 0.0000 0.2000 2.8284 0.0000 0.0000 0.0438 0.0000 0.0000 0.0000 0.0000
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0000 0.0000 0.0500 0.4500 0.7000 0.2125 0.3091 0.4500 0.7000 1.4545 0.0018 0.0000 0.2437 0.0000 0.7000 0.2125 0.3091
61-GC 0.0000 0.0000 0.2500 0.4000 0.6000 0.2375 0.2264 0.4000 0.6000 0.9532 0.0070 0.0000 0.1875 0.0000 0.6000 0.2375 0.2264
62-GC 0.0000 0.0000 0.0000 0.0000 0.1000 0.0125 0.0354 0.0000 0.1000 2.8284 0.0000 0.0000 0.0219 0.0000 0.0000 0.0000 0.0000
63-GC 0.3000 0.5500 0.8000 0.8000 0.8000 0.6750 0.2053 0.2500 0.5000 0.3041 0.6382 0.5921 0.1625 0.3000 0.8000 0.6750 0.2053
64-GC 0.0000 0.0000 0.0000 0.0500 0.1000 0.0250 0.0463 0.0500 0.1000 1.8516 0.0001 0.0000 0.0375 0.0000 0.1000 0.0250 0.0463
65-GC 0.0000 0.2000 0.4000 0.6500 0.7000 0.4000 0.2619 0.4500 0.7000 0.6547 0.1044 0.0001 0.2000 0.0000 0.7000 0.4000 0.2619
66-GC 0.0000 0.0000 0.0000 0.0000 0.1000 0.0125 0.0354 0.0000 0.1000 2.8284 0.0000 0.0000 0.0219 0.0000 0.0000 0.0000 0.0000
67-GC 0.0000 0.0000 0.0000 0.3000 0.5000 0.1375 0.2264 0.3000 0.5000 1.6464 0.0005 0.0000 0.1812 0.0000 0.5000 0.1375 0.2264
68-GC 0.0000 0.2000 0.7000 0.8500 0.9000 0.5500 0.3586 0.6500 0.9000 0.6519 0.1374 0.0001 0.3125 0.0000 0.9000 0.5500 0.3586
69-GC 0.2000 0.3500 0.4000 0.6000 0.7000 0.4500 0.1773 0.2500 0.5000 0.3940 0.4185 0.3867 0.1375 0.2000 0.7000 0.4500 0.1773
70-GC 0.0000 0.0000 0.0000 0.1000 0.3000 0.0625 0.1188 0.1000 0.3000 1.9004 0.0001 0.0000 0.0938 0.0000 0.2000 0.0286 0.0756
71-GC 0.0000 0.0000 0.1000 0.2500 0.3000 0.1250 0.1282 0.2500 0.3000 1.0254 0.0045 0.0000 0.1063 0.0000 0.3000 0.1250 0.1282
72-GC 0.0000 0.0000 0.0000 0.0000 0.3000 0.0375 0.1061 0.0000 0.3000 2.8284 0.0000 0.0000 0.0656 0.0000 0.0000 0.0000 0.0000
73-GC 0.0000 0.0000 0.1000 0.3000 0.5000 0.1625 0.1923 0.3000 0.5000 1.1831 0.0050 0.0000 0.1531 0.0000 0.5000 0.1625 0.1923
74-GC 0.1000 0.2000 0.2000 0.3000 0.4000 0.2375 0.0916 0.1000 0.3000 0.3857 0.2213 0.2043 0.0719 0.1000 0.4000 0.2375 0.0916
75-GC 0.8000 0.9000 0.9000 1.0000 1.0000 0.9250 0.0707 0.1000 0.2000 0.0764 0.9226 0.9201 0.0563 0.8000 1.0000 0.9250 0.0707
134
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2DE-CLEF2007
Statistics for P@15
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0333 0.0667 0.0667 0.0333 0.0356 0.0667 0.0667 1.0690 0.0008 0.0000 0.0333 0.0000 0.0667 0.0333 0.0356
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.1667 0.2000 0.2667 0.1250 0.1095 0.2000 0.2667 0.8758 0.0048 0.0000 0.0938 0.0000 0.2667 0.1250 0.1095
54-GC 0.0000 0.0000 0.0667 0.1000 0.1333 0.0583 0.0556 0.1000 0.1333 0.9537 0.0029 0.0000 0.0438 0.0000 0.1333 0.0583 0.0556
55-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
56-GC 0.0000 0.0667 0.1000 0.2000 0.2000 0.1167 0.0777 0.1333 0.2000 0.6657 0.0365 0.0001 0.0667 0.0000 0.2000 0.1167 0.0777
57-GC 0.0000 0.0000 0.0667 0.0667 0.0667 0.0417 0.0345 0.0667 0.0667 0.8281 0.0025 0.0000 0.0313 0.0000 0.0667 0.0417 0.0345
58-GC 0.0000 0.0000 0.0000 0.0333 0.2000 0.0333 0.0713 0.0333 0.2000 2.1381 0.0001 0.0000 0.0500 0.0000 0.0667 0.0095 0.0252
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0000 0.0000 0.1000 0.3667 0.6000 0.1917 0.2480 0.3667 0.6000 1.2940 0.0018 0.0000 0.1917 0.0000 0.6000 0.1917 0.2480
61-GC 0.0000 0.0000 0.3000 0.3667 0.4667 0.2250 0.1950 0.3667 0.4667 0.8666 0.0070 0.0000 0.1688 0.0000 0.4667 0.2250 0.1950
62-GC 0.0000 0.0000 0.0000 0.0667 0.1333 0.0333 0.0504 0.0667 0.1333 1.5119 0.0003 0.0000 0.0417 0.0000 0.1333 0.0333 0.0504
63-GC 0.2000 0.4667 0.6667 0.8333 0.8667 0.6250 0.2441 0.3667 0.6667 0.3906 0.5670 0.4931 0.1854 0.2000 0.8667 0.6250 0.2441
64-GC 0.0000 0.0000 0.0000 0.0667 0.1333 0.0333 0.0504 0.0667 0.1333 1.5119 0.0003 0.0000 0.0417 0.0000 0.1333 0.0333 0.0504
65-GC 0.0000 0.2000 0.5333 0.5333 0.6000 0.3917 0.2266 0.3333 0.6000 0.5786 0.1071 0.0001 0.1938 0.0000 0.6000 0.3917 0.2266
66-GC 0.0000 0.0000 0.0000 0.0000 0.0667 0.0083 0.0236 0.0000 0.0667 2.8284 0.0000 0.0000 0.0146 0.0000 0.0000 0.0000 0.0000
67-GC 0.0000 0.0000 0.0000 0.2000 0.3333 0.0917 0.1509 0.2000 0.3333 1.6464 0.0004 0.0000 0.1208 0.0000 0.3333 0.0917 0.1509
68-GC 0.0000 0.2667 0.6667 0.7000 0.8000 0.5083 0.2894 0.4333 0.8000 0.5692 0.1369 0.0001 0.2479 0.0000 0.8000 0.5083 0.2894
69-GC 0.2000 0.3000 0.3667 0.4667 0.6000 0.3833 0.1272 0.1667 0.4000 0.3319 0.3642 0.3448 0.1000 0.2000 0.6000 0.3833 0.1272
70-GC 0.0000 0.0000 0.0000 0.1000 0.2667 0.0583 0.1095 0.1000 0.2667 1.8767 0.0001 0.0000 0.0875 0.0000 0.2000 0.0286 0.0756
71-GC 0.0000 0.0000 0.0667 0.1667 0.2667 0.0917 0.1004 0.1667 0.2667 1.0952 0.0037 0.0000 0.0813 0.0000 0.2667 0.0917 0.1004
72-GC 0.0000 0.0000 0.0000 0.0000 0.2000 0.0250 0.0707 0.0000 0.2000 2.8284 0.0000 0.0000 0.0438 0.0000 0.0000 0.0000 0.0000
73-GC 0.0000 0.0000 0.1667 0.3000 0.4000 0.1667 0.1671 0.3000 0.4000 1.0029 0.0055 0.0000 0.1333 0.0000 0.4000 0.1667 0.1671
74-GC 0.0667 0.1333 0.1667 0.2333 0.2667 0.1750 0.0707 0.1000 0.2000 0.4041 0.1609 0.1455 0.0583 0.0667 0.2667 0.1750 0.0707
75-GC 0.6667 0.9333 0.9333 0.9667 1.0000 0.9167 0.1054 0.0333 0.3333 0.1150 0.9105 0.9032 0.0625 0.9333 1.0000 0.9524 0.0325
135
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2DE-CLEF2007
Statistics for P@20
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0500 0.0750 0.1500 0.0500 0.0535 0.0750 0.1500 1.0690 0.0026 0.0000 0.0375 0.0000 0.1500 0.0500 0.0535
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.1250 0.1500 0.2000 0.0938 0.0821 0.1500 0.2000 0.8758 0.0040 0.0000 0.0703 0.0000 0.2000 0.0938 0.0821
54-GC 0.0000 0.0250 0.0500 0.0750 0.1000 0.0500 0.0378 0.0500 0.1000 0.7559 0.0071 0.0000 0.0250 0.0000 0.1000 0.0500 0.0378
55-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
56-GC 0.0500 0.1000 0.1500 0.2000 0.2000 0.1438 0.0563 0.1000 0.1500 0.3916 0.1316 0.1171 0.0453 0.0500 0.2000 0.1438 0.0563
57-GC 0.0000 0.0000 0.0500 0.0500 0.0500 0.0313 0.0259 0.0500 0.0500 0.8281 0.0021 0.0000 0.0234 0.0000 0.0500 0.0313 0.0259
58-GC 0.0000 0.0000 0.0000 0.0750 0.2000 0.0438 0.0821 0.0750 0.2000 1.8767 0.0001 0.0000 0.0656 0.0000 0.1500 0.0214 0.0567
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0000 0.0000 0.1000 0.3750 0.6000 0.1938 0.2513 0.3750 0.6000 1.2972 0.0018 0.0000 0.1938 0.0000 0.6000 0.1938 0.2513
61-GC 0.0000 0.0000 0.2250 0.3250 0.4000 0.1875 0.1664 0.3250 0.4000 0.8873 0.0062 0.0000 0.1406 0.0000 0.4000 0.1875 0.1664
62-GC 0.0000 0.0000 0.0000 0.0500 0.1000 0.0250 0.0378 0.0500 0.1000 1.5119 0.0003 0.0000 0.0313 0.0000 0.1000 0.0250 0.0378
63-GC 0.2500 0.4250 0.6750 0.7250 0.7500 0.5812 0.1926 0.3000 0.5000 0.3314 0.5455 0.5025 0.1609 0.2500 0.7500 0.5812 0.1926
64-GC 0.0000 0.0000 0.0250 0.0500 0.1000 0.0313 0.0372 0.0500 0.1000 1.1904 0.0008 0.0000 0.0313 0.0000 0.1000 0.0313 0.0372
65-GC 0.0500 0.2250 0.5000 0.5250 0.5500 0.3875 0.2031 0.3000 0.5000 0.5241 0.3003 0.1883 0.1656 0.0500 0.5500 0.3875 0.2031
66-GC 0.0000 0.0000 0.0000 0.0500 0.0500 0.0188 0.0259 0.0500 0.0500 1.3801 0.0002 0.0000 0.0234 0.0000 0.0500 0.0188 0.0259
67-GC 0.0000 0.0000 0.0500 0.1750 0.2500 0.0875 0.1061 0.1750 0.2500 1.2122 0.0033 0.0000 0.0844 0.0000 0.2500 0.0875 0.1061
68-GC 0.0000 0.2000 0.7000 0.7500 0.8000 0.5125 0.3227 0.5500 0.8000 0.6296 0.1312 0.0001 0.2844 0.0000 0.8000 0.5125 0.3227
69-GC 0.1500 0.2750 0.3750 0.5000 0.5000 0.3688 0.1308 0.2250 0.3500 0.3546 0.3442 0.3155 0.1062 0.1500 0.5000 0.3688 0.1308
70-GC 0.0000 0.0000 0.0000 0.1250 0.2500 0.0625 0.1026 0.1250 0.2500 1.6423 0.0004 0.0000 0.0813 0.0000 0.2500 0.0625 0.1026
71-GC 0.0000 0.0250 0.1000 0.1500 0.2500 0.1000 0.0886 0.1250 0.2500 0.8864 0.0110 0.0000 0.0750 0.0000 0.2500 0.1000 0.0886
72-GC 0.0000 0.0000 0.0000 0.0000 0.1500 0.0188 0.0530 0.0000 0.1500 2.8284 0.0000 0.0000 0.0328 0.0000 0.0000 0.0000 0.0000
73-GC 0.0000 0.0000 0.1250 0.2500 0.3500 0.1375 0.1382 0.2500 0.3500 1.0053 0.0049 0.0000 0.1125 0.0000 0.3500 0.1375 0.1382
74-GC 0.1000 0.1250 0.1500 0.1750 0.2500 0.1563 0.0496 0.0500 0.1500 0.3171 0.1498 0.1437 0.0344 0.1000 0.2500 0.1563 0.0496
75-GC 0.7000 0.8250 0.8750 0.9250 0.9500 0.8625 0.0835 0.1000 0.2500 0.0968 0.8588 0.8548 0.0625 0.7000 0.9500 0.8625 0.0835
136
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2DE-CLEF2007
Statistics for P@30
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0500 0.0833 0.1000 0.0458 0.0434 0.0833 0.1000 0.9473 0.0025 0.0000 0.0375 0.0000 0.1000 0.0458 0.0434
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0833 0.1333 0.1333 0.0708 0.0628 0.1333 0.1333 0.8871 0.0033 0.0000 0.0542 0.0000 0.1333 0.0708 0.0628
54-GC 0.0000 0.0167 0.0333 0.0500 0.0667 0.0333 0.0252 0.0333 0.0667 0.7559 0.0052 0.0000 0.0167 0.0000 0.0667 0.0333 0.0252
55-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
56-GC 0.0667 0.0667 0.1000 0.1333 0.1333 0.1000 0.0309 0.0667 0.0667 0.3086 0.0957 0.0914 0.0250 0.0667 0.1333 0.1000 0.0309
57-GC 0.0000 0.0000 0.0333 0.0333 0.0333 0.0208 0.0173 0.0333 0.0333 0.8281 0.0016 0.0000 0.0156 0.0000 0.0333 0.0208 0.0173
58-GC 0.0000 0.0000 0.0000 0.0667 0.2667 0.0500 0.0992 0.0667 0.2667 1.9841 0.0001 0.0000 0.0750 0.0000 0.1333 0.0190 0.0504
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0000 0.0000 0.0833 0.4333 0.6000 0.2042 0.2579 0.4333 0.6000 1.2630 0.0019 0.0000 0.2135 0.0000 0.6000 0.2042 0.2579
61-GC 0.0000 0.0000 0.2167 0.3167 0.4333 0.1875 0.1754 0.3167 0.4333 0.9356 0.0061 0.0000 0.1406 0.0000 0.4333 0.1875 0.1754
62-GC 0.0000 0.0000 0.0333 0.0667 0.1333 0.0417 0.0463 0.0667 0.1333 1.1110 0.0023 0.0000 0.0354 0.0000 0.1333 0.0417 0.0463
63-GC 0.2333 0.3833 0.5000 0.5667 0.5667 0.4625 0.1278 0.1833 0.3333 0.2763 0.4438 0.4219 0.1042 0.2333 0.5667 0.4625 0.1278
64-GC 0.0000 0.0000 0.0333 0.0333 0.0667 0.0250 0.0236 0.0333 0.0667 0.9428 0.0017 0.0000 0.0188 0.0000 0.0667 0.0250 0.0236
65-GC 0.0333 0.2000 0.5000 0.5667 0.6333 0.4000 0.2309 0.3667 0.6000 0.5774 0.2901 0.1524 0.1917 0.0333 0.6333 0.4000 0.2309
66-GC 0.0000 0.0000 0.0167 0.0333 0.0333 0.0167 0.0178 0.0333 0.0333 1.0690 0.0006 0.0000 0.0167 0.0000 0.0333 0.0167 0.0178
67-GC 0.0000 0.0167 0.0667 0.1667 0.1667 0.0833 0.0735 0.1500 0.1667 0.8816 0.0095 0.0000 0.0625 0.0000 0.1667 0.0833 0.0735
68-GC 0.0333 0.2333 0.6500 0.7167 0.7333 0.4958 0.2825 0.4833 0.7000 0.5698 0.3608 0.1746 0.2469 0.0333 0.7333 0.4958 0.2825
69-GC 0.1000 0.2667 0.3167 0.4333 0.6000 0.3417 0.1520 0.1667 0.5000 0.4448 0.3065 0.2641 0.1167 0.1000 0.6000 0.3417 0.1520
70-GC 0.0000 0.0000 0.0000 0.0833 0.1667 0.0417 0.0684 0.0833 0.1667 1.6423 0.0003 0.0000 0.0542 0.0000 0.1667 0.0417 0.0684
71-GC 0.0000 0.0167 0.1000 0.1167 0.2000 0.0833 0.0690 0.1000 0.2000 0.8281 0.0099 0.0000 0.0542 0.0000 0.2000 0.0833 0.0690
72-GC 0.0000 0.0000 0.0000 0.0000 0.1000 0.0125 0.0354 0.0000 0.1000 2.8284 0.0000 0.0000 0.0219 0.0000 0.0000 0.0000 0.0000
73-GC 0.0000 0.0167 0.1000 0.1833 0.2333 0.1042 0.0933 0.1667 0.2333 0.8960 0.0112 0.0000 0.0719 0.0000 0.2333 0.1042 0.0933
74-GC 0.0667 0.0833 0.1000 0.1333 0.1667 0.1083 0.0345 0.0500 0.1000 0.3185 0.1035 0.0988 0.0271 0.0667 0.1667 0.1083 0.0345
75-GC 0.7000 0.8333 0.8833 0.9167 0.9333 0.8625 0.0786 0.0833 0.2333 0.0911 0.8591 0.8555 0.0562 0.8000 0.9333 0.8857 0.0466
137
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2DE-CLEF2007
Statistics for P@100
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0050 0.0150 0.0500 0.1000 0.0300 0.0363 0.0450 0.1000 1.2084 0.0038 0.0000 0.0275 0.0000 0.1000 0.0300 0.0363
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0150 0.0400 0.0450 0.0500 0.0312 0.0189 0.0300 0.0500 0.6032 0.0116 0.0001 0.0159 0.0000 0.0500 0.0312 0.0189
54-GC 0.0000 0.0050 0.0100 0.0250 0.0300 0.0137 0.0119 0.0200 0.0300 0.8638 0.0026 0.0000 0.0097 0.0000 0.0300 0.0137 0.0119
55-GC 0.0000 0.0000 0.0000 0.0050 0.0100 0.0025 0.0046 0.0050 0.0100 1.8516 0.0001 0.0000 0.0037 0.0000 0.0100 0.0025 0.0046
56-GC 0.0200 0.0200 0.0500 0.0500 0.0500 0.0388 0.0155 0.0300 0.0300 0.4007 0.0355 0.0320 0.0141 0.0200 0.0500 0.0388 0.0155
57-GC 0.0000 0.0000 0.0100 0.0100 0.0100 0.0062 0.0052 0.0100 0.0100 0.8281 0.0007 0.0000 0.0047 0.0000 0.0100 0.0062 0.0052
58-GC 0.0000 0.0000 0.0000 0.0500 0.1300 0.0287 0.0538 0.0500 0.1300 1.8725 0.0001 0.0000 0.0431 0.0000 0.1000 0.0143 0.0378
59-GC 0.0000 0.0000 0.0000 0.0050 0.0200 0.0037 0.0074 0.0050 0.0200 1.9841 0.0001 0.0000 0.0056 0.0000 0.0100 0.0014 0.0038
60-GC 0.0000 0.0000 0.0600 0.2950 0.4200 0.1412 0.1819 0.2950 0.4200 1.2880 0.0016 0.0000 0.1466 0.0000 0.4200 0.1412 0.1819
61-GC 0.0000 0.0000 0.1650 0.2000 0.2400 0.1212 0.1037 0.2000 0.2400 0.8553 0.0047 0.0000 0.0909 0.0000 0.2400 0.1212 0.1037
62-GC 0.0000 0.0100 0.0400 0.0900 0.1300 0.0512 0.0479 0.0800 0.1300 0.9354 0.0065 0.0000 0.0391 0.0000 0.1300 0.0512 0.0479
63-GC 0.1200 0.1450 0.2000 0.2400 0.2500 0.1925 0.0531 0.0950 0.1300 0.2759 0.1857 0.1789 0.0475 0.1200 0.2500 0.1925 0.0531
64-GC 0.0000 0.0050 0.0250 0.0350 0.0500 0.0225 0.0183 0.0300 0.0500 0.8143 0.0037 0.0000 0.0150 0.0000 0.0500 0.0225 0.0183
65-GC 0.1000 0.1750 0.3450 0.4300 0.4400 0.3050 0.1456 0.2550 0.3400 0.4774 0.2650 0.2206 0.1250 0.1000 0.4400 0.3050 0.1456
66-GC 0.0000 0.0000 0.0100 0.0100 0.0100 0.0062 0.0052 0.0100 0.0100 0.8281 0.0007 0.0000 0.0047 0.0000 0.0100 0.0062 0.0052
67-GC 0.0000 0.0200 0.0600 0.1050 0.1100 0.0600 0.0450 0.0850 0.1100 0.7507 0.0080 0.0000 0.0350 0.0000 0.1100 0.0600 0.0450
68-GC 0.0300 0.2100 0.5850 0.6500 0.6500 0.4462 0.2537 0.4400 0.6200 0.5684 0.3248 0.1572 0.2222 0.0300 0.6500 0.4462 0.2537
69-GC 0.0600 0.1250 0.1700 0.2500 0.3200 0.1837 0.0867 0.1250 0.2600 0.4717 0.1630 0.1405 0.0672 0.0600 0.3200 0.1837 0.0867
70-GC 0.0100 0.0200 0.0300 0.0550 0.0700 0.0362 0.0233 0.0350 0.0600 0.6417 0.0292 0.0226 0.0178 0.0100 0.0700 0.0362 0.0233
71-GC 0.0400 0.0400 0.0500 0.0650 0.0700 0.0525 0.0128 0.0250 0.0300 0.2441 0.0512 0.0499 0.0106 0.0400 0.0700 0.0525 0.0128
72-GC 0.0000 0.0100 0.0100 0.0100 0.0500 0.0137 0.0151 0.0000 0.0500 1.0952 0.0052 0.0001 0.0091 0.0100 0.0100 0.0100 0.0000
73-GC 0.0000 0.0100 0.0650 0.0700 0.0700 0.0450 0.0325 0.0600 0.0700 0.7225 0.0064 0.0000 0.0288 0.0000 0.0700 0.0450 0.0325
74-GC 0.0300 0.0300 0.0400 0.0450 0.0500 0.0387 0.0083 0.0150 0.0200 0.2154 0.0380 0.0372 0.0066 0.0300 0.0500 0.0387 0.0083
75-GC 0.6400 0.6950 0.7050 0.7200 0.7400 0.7025 0.0301 0.0250 0.1000 0.0429 0.7019 0.7013 0.0200 0.6900 0.7400 0.7114 0.0177
138
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2DE-CLEF2007
Statistics for P@200
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0050 0.0075 0.0150 0.0325 0.0600 0.0219 0.0202 0.0250 0.0550 0.9219 0.0151 0.0108 0.0153 0.0050 0.0600 0.0219 0.0202
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0050 0.0100 0.0225 0.0275 0.0300 0.0194 0.0098 0.0175 0.0250 0.5057 0.0165 0.0134 0.0083 0.0050 0.0300 0.0194 0.0098
54-GC 0.0000 0.0025 0.0150 0.0150 0.0200 0.0106 0.0078 0.0125 0.0200 0.7307 0.0022 0.0000 0.0067 0.0000 0.0200 0.0106 0.0078
55-GC 0.0000 0.0000 0.0025 0.0200 0.0200 0.0081 0.0100 0.0200 0.0200 1.2280 0.0004 0.0000 0.0089 0.0000 0.0200 0.0081 0.0100
56-GC 0.0100 0.0100 0.0250 0.0250 0.0250 0.0194 0.0078 0.0150 0.0150 0.4007 0.0177 0.0160 0.0070 0.0100 0.0250 0.0194 0.0078
57-GC 0.0000 0.0000 0.0050 0.0050 0.0050 0.0031 0.0026 0.0050 0.0050 0.8281 0.0005 0.0000 0.0023 0.0000 0.0050 0.0031 0.0026
58-GC 0.0000 0.0000 0.0000 0.0250 0.0650 0.0144 0.0269 0.0250 0.0650 1.8725 0.0001 0.0000 0.0216 0.0000 0.0500 0.0071 0.0189
59-GC 0.0000 0.0000 0.0000 0.0050 0.0100 0.0025 0.0046 0.0050 0.0100 1.8516 0.0001 0.0000 0.0037 0.0000 0.0100 0.0025 0.0046
60-GC 0.0000 0.0000 0.0525 0.1750 0.2300 0.0856 0.1004 0.1750 0.2300 1.1722 0.0027 0.0000 0.0844 0.0000 0.2300 0.0856 0.1004
61-GC 0.0000 0.0000 0.1350 0.1350 0.1450 0.0856 0.0710 0.1350 0.1450 0.8290 0.0038 0.0000 0.0642 0.0000 0.1450 0.0856 0.0710
62-GC 0.0000 0.0125 0.0400 0.0900 0.1100 0.0494 0.0425 0.0775 0.1100 0.8617 0.0066 0.0000 0.0355 0.0000 0.1100 0.0494 0.0425
63-GC 0.0600 0.0950 0.1200 0.1325 0.1350 0.1113 0.0268 0.0375 0.0750 0.2411 0.1078 0.1038 0.0212 0.0600 0.1350 0.1113 0.0268
64-GC 0.0000 0.0025 0.0175 0.0250 0.0350 0.0156 0.0132 0.0225 0.0350 0.8456 0.0027 0.0000 0.0106 0.0000 0.0350 0.0156 0.0132
65-GC 0.0850 0.1375 0.2200 0.2725 0.2750 0.2025 0.0802 0.1350 0.1900 0.3962 0.1858 0.1676 0.0700 0.0850 0.2750 0.2025 0.0802
66-GC 0.0000 0.0000 0.0050 0.0050 0.0100 0.0037 0.0035 0.0050 0.0100 0.9428 0.0005 0.0000 0.0028 0.0000 0.0100 0.0037 0.0035
67-GC 0.0000 0.0150 0.0550 0.0575 0.0600 0.0394 0.0261 0.0425 0.0600 0.6631 0.0061 0.0000 0.0220 0.0000 0.0600 0.0394 0.0261
68-GC 0.0350 0.2450 0.4000 0.4375 0.4550 0.3319 0.1467 0.1925 0.4200 0.4420 0.2712 0.1649 0.1177 0.0350 0.4550 0.3319 0.1467
69-GC 0.0450 0.0700 0.1075 0.1400 0.1600 0.1050 0.0431 0.0700 0.1150 0.4104 0.0961 0.0868 0.0375 0.0450 0.1600 0.1050 0.0431
70-GC 0.0100 0.0150 0.0325 0.0425 0.0500 0.0300 0.0154 0.0275 0.0400 0.5118 0.0257 0.0211 0.0125 0.0100 0.0500 0.0300 0.0154
71-GC 0.0200 0.0225 0.0325 0.0350 0.0350 0.0294 0.0068 0.0125 0.0150 0.2308 0.0286 0.0278 0.0058 0.0200 0.0350 0.0294 0.0068
72-GC 0.0000 0.0050 0.0050 0.0050 0.0250 0.0069 0.0075 0.0000 0.0250 1.0952 0.0028 0.0001 0.0045 0.0050 0.0050 0.0050 0.0000
73-GC 0.0000 0.0050 0.0350 0.0350 0.0350 0.0231 0.0167 0.0300 0.0350 0.7212 0.0039 0.0000 0.0148 0.0000 0.0350 0.0231 0.0167
74-GC 0.0200 0.0200 0.0200 0.0250 0.0300 0.0225 0.0038 0.0050 0.0100 0.1680 0.0222 0.0220 0.0031 0.0200 0.0300 0.0225 0.0038
75-GC 0.3500 0.3550 0.3675 0.3975 0.5250 0.3894 0.0587 0.0425 0.1750 0.1508 0.3860 0.3831 0.0403 0.3500 0.4150 0.3700 0.0227
139
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2DE-CLEF2007
Statistics for P@500
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0020 0.0070 0.0130 0.0230 0.0500 0.0173 0.0154 0.0160 0.0480 0.8915 0.0117 0.0072 0.0111 0.0020 0.0260 0.0126 0.0085
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0040 0.0070 0.0100 0.0110 0.0140 0.0093 0.0035 0.0040 0.0100 0.3822 0.0085 0.0076 0.0026 0.0040 0.0140 0.0093 0.0035
54-GC 0.0000 0.0010 0.0060 0.0070 0.0080 0.0045 0.0033 0.0060 0.0080 0.7418 0.0011 0.0000 0.0029 0.0000 0.0080 0.0045 0.0033
55-GC 0.0000 0.0000 0.0020 0.0110 0.0120 0.0048 0.0055 0.0110 0.0120 1.1681 0.0005 0.0000 0.0049 0.0000 0.0120 0.0048 0.0055
56-GC 0.0040 0.0040 0.0100 0.0100 0.0100 0.0077 0.0031 0.0060 0.0060 0.4007 0.0071 0.0064 0.0028 0.0040 0.0100 0.0077 0.0031
57-GC 0.0000 0.0000 0.0020 0.0020 0.0020 0.0013 0.0010 0.0020 0.0020 0.8281 0.0003 0.0000 0.0009 0.0000 0.0020 0.0013 0.0010
58-GC 0.0020 0.0020 0.0040 0.0190 0.0300 0.0103 0.0119 0.0170 0.0280 1.1588 0.0057 0.0037 0.0094 0.0020 0.0300 0.0103 0.0119
59-GC 0.0000 0.0000 0.0000 0.0030 0.0080 0.0018 0.0033 0.0030 0.0080 1.8767 0.0001 0.0000 0.0026 0.0000 0.0060 0.0009 0.0023
60-GC 0.0000 0.0000 0.0330 0.0860 0.0960 0.0418 0.0453 0.0860 0.0960 1.0850 0.0018 0.0000 0.0413 0.0000 0.0960 0.0418 0.0453
61-GC 0.0000 0.0000 0.0670 0.0720 0.0760 0.0443 0.0368 0.0720 0.0760 0.8318 0.0025 0.0000 0.0332 0.0000 0.0760 0.0443 0.0368
62-GC 0.0060 0.0110 0.0280 0.0570 0.0600 0.0323 0.0231 0.0460 0.0540 0.7175 0.0232 0.0153 0.0197 0.0060 0.0600 0.0323 0.0231
63-GC 0.0340 0.0400 0.0540 0.0550 0.0560 0.0485 0.0089 0.0150 0.0220 0.1841 0.0477 0.0469 0.0079 0.0340 0.0560 0.0485 0.0089
64-GC 0.0000 0.0010 0.0110 0.0140 0.0160 0.0085 0.0067 0.0130 0.0160 0.7929 0.0017 0.0000 0.0059 0.0000 0.0160 0.0085 0.0067
65-GC 0.0440 0.0660 0.1050 0.1230 0.1240 0.0945 0.0338 0.0570 0.0800 0.3573 0.0881 0.0810 0.0285 0.0440 0.1240 0.0945 0.0338
66-GC 0.0000 0.0000 0.0020 0.0030 0.0040 0.0018 0.0017 0.0030 0.0040 0.9537 0.0003 0.0000 0.0013 0.0000 0.0040 0.0018 0.0017
67-GC 0.0000 0.0100 0.0260 0.0390 0.0500 0.0250 0.0191 0.0290 0.0500 0.7626 0.0042 0.0000 0.0140 0.0000 0.0500 0.0250 0.0191
68-GC 0.0420 0.1780 0.2040 0.2290 0.2700 0.1918 0.0686 0.0510 0.2280 0.3576 0.1723 0.1395 0.0443 0.1780 0.2700 0.2131 0.0348
69-GC 0.0240 0.0320 0.0540 0.0600 0.0660 0.0477 0.0161 0.0280 0.0420 0.3369 0.0450 0.0419 0.0138 0.0240 0.0660 0.0477 0.0161
70-GC 0.0040 0.0070 0.0220 0.0280 0.0360 0.0193 0.0120 0.0210 0.0320 0.6232 0.0147 0.0101 0.0099 0.0040 0.0360 0.0193 0.0120
71-GC 0.0080 0.0110 0.0140 0.0140 0.0140 0.0125 0.0023 0.0030 0.0060 0.1864 0.0123 0.0120 0.0019 0.0080 0.0140 0.0125 0.0023
72-GC 0.0040 0.0040 0.0060 0.0060 0.0120 0.0060 0.0026 0.0020 0.0080 0.4364 0.0056 0.0053 0.0015 0.0040 0.0060 0.0051 0.0011
73-GC 0.0000 0.0070 0.0140 0.0140 0.0140 0.0105 0.0055 0.0070 0.0140 0.5266 0.0046 0.0001 0.0044 0.0000 0.0140 0.0105 0.0055
74-GC 0.0080 0.0080 0.0090 0.0130 0.0160 0.0105 0.0032 0.0050 0.0080 0.3012 0.0101 0.0098 0.0026 0.0080 0.0160 0.0105 0.0032
75-GC 0.1420 0.1440 0.1540 0.1770 0.2280 0.1650 0.0291 0.0330 0.0860 0.1765 0.1630 0.1613 0.0218 0.1420 0.1800 0.1560 0.0153
140
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2DE-CLEF2007
Statistics for P@1000
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0010 0.0040 0.0095 0.0140 0.0270 0.0104 0.0084 0.0100 0.0260 0.8063 0.0070 0.0039 0.0060 0.0010 0.0270 0.0104 0.0084
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0040 0.0060 0.0060 0.0065 0.0070 0.0060 0.0009 0.0005 0.0030 0.1543 0.0059 0.0058 0.0005 0.0060 0.0070 0.0063 0.0005
54-GC 0.0000 0.0010 0.0030 0.0040 0.0040 0.0025 0.0016 0.0030 0.0040 0.6414 0.0012 0.0001 0.0014 0.0000 0.0040 0.0025 0.0016
55-GC 0.0000 0.0010 0.0010 0.0060 0.0060 0.0028 0.0027 0.0050 0.0060 0.9863 0.0011 0.0001 0.0024 0.0000 0.0060 0.0028 0.0027
56-GC 0.0020 0.0020 0.0050 0.0050 0.0050 0.0039 0.0016 0.0030 0.0030 0.4007 0.0035 0.0032 0.0014 0.0020 0.0050 0.0039 0.0016
57-GC 0.0000 0.0000 0.0010 0.0010 0.0010 0.0006 0.0005 0.0010 0.0010 0.8281 0.0002 0.0000 0.0005 0.0000 0.0010 0.0006 0.0005
58-GC 0.0010 0.0025 0.0070 0.0135 0.0150 0.0077 0.0059 0.0110 0.0140 0.7610 0.0053 0.0033 0.0052 0.0010 0.0150 0.0077 0.0059
59-GC 0.0000 0.0000 0.0000 0.0020 0.0040 0.0010 0.0019 0.0020 0.0040 1.8516 0.0000 0.0000 0.0015 0.0000 0.0040 0.0010 0.0019
60-GC 0.0000 0.0005 0.0210 0.0460 0.0490 0.0230 0.0238 0.0455 0.0490 1.0328 0.0024 0.0000 0.0220 0.0000 0.0490 0.0230 0.0238
61-GC 0.0000 0.0020 0.0370 0.0390 0.0410 0.0246 0.0194 0.0370 0.0410 0.7859 0.0063 0.0001 0.0175 0.0000 0.0410 0.0246 0.0194
62-GC 0.0070 0.0085 0.0220 0.0310 0.0310 0.0201 0.0114 0.0225 0.0240 0.5643 0.0169 0.0139 0.0104 0.0070 0.0310 0.0201 0.0114
63-GC 0.0190 0.0235 0.0330 0.0350 0.0360 0.0297 0.0066 0.0115 0.0170 0.2235 0.0290 0.0282 0.0058 0.0190 0.0360 0.0297 0.0066
64-GC 0.0010 0.0020 0.0060 0.0085 0.0090 0.0054 0.0033 0.0065 0.0080 0.6205 0.0042 0.0030 0.0029 0.0010 0.0090 0.0054 0.0033
65-GC 0.0320 0.0400 0.0680 0.0745 0.0750 0.0590 0.0187 0.0345 0.0430 0.3164 0.0560 0.0529 0.0163 0.0320 0.0750 0.0590 0.0187
66-GC 0.0000 0.0005 0.0010 0.0020 0.0020 0.0011 0.0008 0.0015 0.0020 0.7418 0.0004 0.0000 0.0007 0.0000 0.0020 0.0011 0.0008
67-GC 0.0000 0.0100 0.0235 0.0325 0.0380 0.0212 0.0146 0.0225 0.0380 0.6878 0.0067 0.0001 0.0112 0.0000 0.0380 0.0212 0.0146
68-GC 0.0340 0.1240 0.1340 0.1655 0.1730 0.1318 0.0446 0.0415 0.1390 0.3387 0.1204 0.1020 0.0300 0.1230 0.1730 0.1457 0.0224
69-GC 0.0120 0.0170 0.0310 0.0345 0.0390 0.0270 0.0103 0.0175 0.0270 0.3803 0.0249 0.0227 0.0087 0.0120 0.0390 0.0270 0.0103
70-GC 0.0050 0.0050 0.0135 0.0175 0.0200 0.0121 0.0065 0.0125 0.0150 0.5335 0.0104 0.0087 0.0054 0.0050 0.0200 0.0121 0.0065
71-GC 0.0050 0.0055 0.0070 0.0070 0.0070 0.0064 0.0009 0.0015 0.0020 0.1437 0.0063 0.0062 0.0008 0.0050 0.0070 0.0064 0.0009
72-GC 0.0030 0.0035 0.0040 0.0055 0.0070 0.0045 0.0014 0.0020 0.0040 0.3143 0.0043 0.0042 0.0011 0.0030 0.0070 0.0045 0.0014
73-GC 0.0000 0.0035 0.0070 0.0070 0.0070 0.0053 0.0028 0.0035 0.0070 0.5266 0.0025 0.0001 0.0022 0.0000 0.0070 0.0053 0.0028
74-GC 0.0040 0.0055 0.0065 0.0075 0.0080 0.0064 0.0014 0.0020 0.0040 0.2208 0.0062 0.0061 0.0011 0.0040 0.0080 0.0064 0.0014
75-GC 0.0720 0.0720 0.0830 0.0990 0.1140 0.0867 0.0165 0.0270 0.0420 0.1901 0.0855 0.0843 0.0129 0.0720 0.1140 0.0867 0.0165
141
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2EN-CLEF2007
GeoCLEF Bilingual English Task Top 5 Participants − Standard Recall Levels vs Mean Interpolated Precision
100%
cheshire [Experiment BERKBIDEENBASE; MAP 22.08%; Pooled]
depok [Experiment UIBITDGP; MAP 20.96%; Pooled]
90% csusm [Experiment GEOBIESEN2; MAP 19.62%; Pooled]
80%
70%
60%
Precision
50%
40%
30%
20%
10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Bilingual English Task Top 5 Participants − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
1
cheshire [Experiment BERKBIDEENBASE; MAP 22.08%; Pooled]
depok [Experiment UIBITDGP; MAP 20.96%; Pooled]
csusm [Experiment GEOBIESEN2; MAP 19.62%; Pooled]
0.8
0.6
0.4
0.2
Difference
0
−0.2
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
142
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2EN-CLEF2007
GeoCLEF Bilingual English Task − Box Plot of the Topics
cheshire [Experiment BERKBIDEENBASE; MAP 22.08%; Pooled]
cheshire [Experiment BERKBIESENBASE; MAP 21.95%; Pooled]
cheshire [Experiment BERKBIPTENBASE; MAP 21.12%; Not Pooled]
depok [Experiment UIBITDGP; MAP 20.96%; Pooled]
depok [Experiment UIBITDGPGEOFB; MAP 20.91%; Not Pooled]
csusm [Experiment GEOBIESEN2; MAP 19.62%; Pooled]
Experiments
depok [Experiment UIBITDGPPF5; MAP 19.39%; Pooled]
depok [Experiment UIBITGPPF5; MAP 19.36%; Not Pooled]
csusm [Experiment GEOBIESEN3; MAP 18.66%; Not Pooled]
depok [Experiment UIBITGP; MAP 17.36%; Not Pooled]
csusm [Experiment GEOBIESEN4; MAP 15.94%; Not Pooled]
csusm [Experiment GEOBIESEN1; MAP 15.94%; Pooled]
depok [Experiment UIBITGPGEOFB; MAP 13.89%; Not Pooled]
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Average Precision
143
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2EN-CLEF2007
10.2455/TUKEY_T_TEST.30441D8E0662738822D50931F9103E96
GeoCLEF Bilingual English Task − Tukey T test with "top group" highlighted
BERKBIDEENBASE
BERKBIESENBASE
UIBITDGPGEOFB
UIBITDGP
BERKBIPTENBASE
GEOBIESEN2
Experiments
UIBITDGPPF5
GEOBIESEN3
UIBITGPPF5
UIBITGP
UIBITGPGEOFB
GEOBIESEN1
GEOBIESEN4
0.2 0.25 0.3 0.35 0.4 0.45 0.5
arcsin(sqrt(Average Precsion))
144
145
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2EN-CLEF2007
GeoCLEF Bilingual English Task Top 5 Participants − Retrieved documents vs Mean Precision
100%
cheshire [Experiment BERKBIDEENBASE; R−Prec 21.97%; Pooled]
depok [Experiment UIBITDGP; R−Prec 21.11%; Pooled]
90% csusm [Experiment GEOBIESEN2; R−Prec 20.81%; Pooled]
80%
70%
60%
Precision
50%
40%
30%
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Bilingual English Task Top 5 Participants − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
1
cheshire [Experiment BERKBIDEENBASE; R−Prec 21.97%; Pooled]
depok [Experiment UIBITDGP; R−Prec 21.11%; Pooled]
csusm [Experiment GEOBIESEN2; R−Prec 20.81%; Pooled]
0.8
0.6
0.4
0.2
Difference
0
−0.2
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
146
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2EN-CLEF2007
GeoCLEF Bilingual English Task − Box Plot of the Topics
cheshire [Experiment BERKBIPTENBASE; R−Prec 23.18%; Not Pooled]
cheshire [Experiment BERKBIESENBASE; R−Prec 23.08%; Pooled]
cheshire [Experiment BERKBIDEENBASE; R−Prec 21.97%; Pooled]
csusm [Experiment GEOBIESEN3; R−Prec 21.32%; Not Pooled]
depok [Experiment UIBITDGP; R−Prec 21.11%; Pooled]
csusm [Experiment GEOBIESEN2; R−Prec 20.81%; Pooled]
Experiments
depok [Experiment UIBITDGPGEOFB; R−Prec 20.75%; Not Pooled]
depok [Experiment UIBITDGPPF5; R−Prec 20.09%; Pooled]
depok [Experiment UIBITGPPF5; R−Prec 19.07%; Not Pooled]
depok [Experiment UIBITGP; R−Prec 18.77%; Not Pooled]
csusm [Experiment GEOBIESEN4; R−Prec 16.38%; Not Pooled]
csusm [Experiment GEOBIESEN1; R−Prec 16.38%; Pooled]
depok [Experiment UIBITGPGEOFB; R−Prec 14.83%; Not Pooled]
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
R−Precision
147
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2EN-CLEF2007
GeoCLEF Bilingual English Task − Tukey T test with "top group" highlighted
BERKBIESENBASE
BERKBIPTENBASE
UIBITDGP
BERKBIDEENBASE
GEOBIESEN3
UIBITDGPGEOFB
Experiments
UIBITDGPPF5
GEOBIESEN2
UIBITGP
UIBITGPPF5
GEOBIESEN1
GEOBIESEN4
UIBITGPGEOFB
0.2 0.25 0.3 0.35 0.4 0.45 0.5 0.55
arcsin(sqrt(R−Precision))
148
149
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2EN-CLEF2007
Statistics for Number of relevant retrieved documents
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 19.00 85.25 92.00 108.25 110.00 89.92 24.75 23.00 91.00 0.28 83.91 72.15 16.39 72.00 110.00 95.83 13.16
52-GC 2.00 2.00 3.00 4.00 6.00 3.15 1.14 2.00 4.00 0.36 2.98 2.84 0.83 2.00 6.00 3.15 1.14
53-GC 32.00 38.75 47.00 51.25 58.00 44.92 8.18 12.50 26.00 0.18 44.20 43.44 6.86 32.00 58.00 44.92 8.18
54-GC 0.00 2.00 7.00 7.00 7.00 4.92 2.84 5.00 7.00 0.58 0.70 0.00 2.41 0.00 7.00 4.92 2.84
55-GC 0.00 16.00 16.00 16.00 16.00 13.54 6.01 0.00 16.00 0.44 1.78 0.00 4.17 16.00 16.00 16.00 0.00
56-GC 0.00 0.00 5.00 7.25 8.00 3.85 3.53 7.25 8.00 0.92 0.08 0.00 3.24 0.00 8.00 3.85 3.53
57-GC 0.00 12.00 15.00 15.00 15.00 11.92 5.42 3.00 15.00 0.45 1.59 0.00 3.67 12.00 15.00 14.09 1.30
58-GC 4.00 5.75 6.00 6.00 6.00 5.69 0.63 0.25 2.00 0.11 5.65 5.61 0.47 6.00 6.00 6.00 0.00
59-GC 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 N/D 0.00 0.00 0.00 0.00 0.00 0.00 0.00
60-GC 21.00 27.00 30.00 30.00 30.00 28.08 3.15 3.00 9.00 0.11 27.89 27.69 2.37 27.00 30.00 29.27 1.27
61-GC 9.00 10.00 13.00 16.25 21.00 13.54 3.76 6.25 12.00 0.28 13.07 12.62 3.20 9.00 21.00 13.54 3.76
62-GC 0.00 2.75 4.00 4.00 4.00 3.00 1.47 1.25 4.00 0.49 0.49 0.00 1.08 2.00 4.00 3.55 0.69
63-GC 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 N/D 0.00 0.00 0.00 0.00 0.00 0.00 0.00
64-GC 3.00 7.25 9.00 13.25 16.00 9.92 4.13 6.00 13.00 0.42 8.98 7.89 3.30 3.00 16.00 9.92 4.13
65-GC 38.00 51.25 80.00 89.00 90.00 72.08 20.33 37.75 52.00 0.28 68.87 65.18 17.29 38.00 90.00 72.08 20.33
66-GC 1.00 2.75 3.00 3.00 3.00 2.69 0.63 0.25 2.00 0.23 2.59 2.44 0.47 3.00 3.00 3.00 0.00
67-GC 17.00 17.00 17.00 17.00 17.00 17.00 0.00 0.00 0.00 0.00 17.00 17.00 0.00 17.00 17.00 17.00 0.00
68-GC 105.00 109.25 128.00 130.00 131.00 121.54 10.49 20.75 26.00 0.09 121.10 120.66 8.96 105.00 131.00 121.54 10.49
69-GC 6.00 12.50 16.00 20.25 21.00 16.00 5.02 7.75 15.00 0.31 15.10 13.99 4.15 6.00 21.00 16.00 5.02
70-GC 0.00 8.75 14.00 25.00 26.00 15.31 9.53 16.25 26.00 0.62 1.83 0.00 8.18 0.00 26.00 15.31 9.53
71-GC 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 N/D 0.00 0.00 0.00 0.00 0.00 0.00 0.00
72-GC 12.00 12.75 13.00 14.00 14.00 13.23 0.83 1.25 2.00 0.06 13.21 13.18 0.71 12.00 14.00 13.23 0.83
73-GC 0.00 0.75 2.00 4.50 6.00 2.62 2.26 3.75 6.00 0.86 0.16 0.00 1.83 0.00 6.00 2.62 2.26
74-GC 0.00 2.00 3.00 3.00 3.00 2.38 1.12 1.00 3.00 0.47 0.40 0.00 0.85 2.00 3.00 2.82 0.40
75-GC 17.00 17.75 18.00 19.00 19.00 18.15 0.80 1.25 2.00 0.04 18.14 18.12 0.65 17.00 19.00 18.15 0.80
150
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2EN-CLEF2007
Statistics for Average Precsion
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0096 0.1131 0.2405 0.4505 0.6948 0.2908 0.2264 0.3374 0.6852 0.7786 0.1922 0.0780 0.1865 0.0096 0.6948 0.2908 0.2264
52-GC 0.0004 0.0015 0.0020 0.0033 0.0065 0.0026 0.0018 0.0017 0.0061 0.6754 0.0021 0.0015 0.0013 0.0004 0.0049 0.0023 0.0014
53-GC 0.0585 0.0828 0.1103 0.1848 0.2346 0.1313 0.0609 0.1020 0.1761 0.4636 0.1189 0.1080 0.0523 0.0585 0.2346 0.1313 0.0609
54-GC 0.0000 0.0008 0.0978 0.2657 0.4050 0.1426 0.1483 0.2649 0.4050 1.0398 0.0146 0.0001 0.1308 0.0000 0.4050 0.1426 0.1483
55-GC 0.0000 0.1302 0.2644 0.3211 0.3845 0.2252 0.1304 0.1909 0.3845 0.5791 0.0524 0.0001 0.1071 0.0000 0.3845 0.2252 0.1304
56-GC 0.0000 0.0000 0.0139 0.1774 0.4161 0.0993 0.1531 0.1774 0.4161 1.5418 0.0023 0.0000 0.1237 0.0000 0.4161 0.0993 0.1531
57-GC 0.0000 0.0778 0.1281 0.1909 0.2711 0.1267 0.0831 0.1131 0.2711 0.6557 0.0315 0.0001 0.0661 0.0000 0.2711 0.1267 0.0831
58-GC 0.0152 0.0276 0.0702 0.1104 0.2442 0.0802 0.0619 0.0829 0.2289 0.7721 0.0601 0.0435 0.0452 0.0152 0.1171 0.0665 0.0391
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0889 0.3991 0.7716 0.7773 0.8046 0.6108 0.2713 0.3782 0.7158 0.4442 0.5119 0.3694 0.2302 0.0889 0.8046 0.6108 0.2713
61-GC 0.0041 0.0131 0.0186 0.0832 0.6765 0.0899 0.1815 0.0701 0.6724 2.0193 0.0295 0.0144 0.1018 0.0041 0.1275 0.0410 0.0453
62-GC 0.0000 0.0218 0.1335 0.2780 0.3081 0.1402 0.1299 0.2561 0.3081 0.9264 0.0251 0.0001 0.1146 0.0000 0.3081 0.1402 0.1299
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0012 0.0062 0.0090 0.0184 0.1881 0.0375 0.0673 0.0122 0.1869 1.7939 0.0125 0.0062 0.0463 0.0012 0.0320 0.0101 0.0082
65-GC 0.0240 0.0528 0.3053 0.3519 0.4325 0.2287 0.1572 0.2991 0.4085 0.6873 0.1518 0.0828 0.1389 0.0240 0.4325 0.2287 0.1572
66-GC 0.0004 0.0134 0.0523 0.1560 0.3651 0.1100 0.1213 0.1426 0.3647 1.1033 0.0434 0.0048 0.0928 0.0004 0.3651 0.1100 0.1213
67-GC 0.2095 0.3352 0.3918 0.4611 0.5548 0.3973 0.0999 0.1259 0.3453 0.2515 0.3844 0.3702 0.0768 0.2095 0.5548 0.3973 0.0999
68-GC 0.2872 0.4207 0.5665 0.7066 0.7626 0.5460 0.1696 0.2860 0.4755 0.3105 0.5193 0.4910 0.1444 0.2872 0.7626 0.5460 0.1696
69-GC 0.0020 0.1268 0.2350 0.2545 0.3276 0.1831 0.1120 0.1277 0.3256 0.6115 0.0928 0.0151 0.0893 0.0020 0.3276 0.1831 0.1120
70-GC 0.0000 0.0036 0.0255 0.3208 0.3480 0.1374 0.1541 0.3172 0.3480 1.1212 0.0146 0.0001 0.1394 0.0000 0.3480 0.1374 0.1541
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.3050 0.3354 0.4300 0.4914 0.6248 0.4286 0.1010 0.1560 0.3198 0.2358 0.4180 0.4079 0.0774 0.3050 0.6248 0.4286 0.1010
73-GC 0.0000 0.0002 0.0015 0.0070 0.0193 0.0045 0.0059 0.0068 0.0193 1.3111 0.0008 0.0000 0.0045 0.0000 0.0126 0.0033 0.0041
74-GC 0.0000 0.0163 0.1702 0.5300 0.6712 0.2740 0.2708 0.5137 0.6712 0.9883 0.0356 0.0001 0.2492 0.0000 0.6712 0.2740 0.2708
75-GC 0.3116 0.4005 0.4397 0.5078 0.7023 0.4666 0.1085 0.1072 0.3906 0.2325 0.4559 0.4461 0.0804 0.3116 0.6346 0.4470 0.0859
151
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2EN-CLEF2007
Statistics for R-Precision
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0179 0.2076 0.3036 0.5223 0.6339 0.3407 0.1999 0.3147 0.6161 0.5868 0.2577 0.1303 0.1649 0.0179 0.6339 0.3407 0.1999
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.1250 0.1406 0.2031 0.2617 0.3125 0.2043 0.0670 0.1211 0.1875 0.3281 0.1945 0.1854 0.0544 0.1250 0.3125 0.2043 0.0670
54-GC 0.0000 0.0000 0.1429 0.4286 0.4286 0.1868 0.1968 0.4286 0.4286 1.0534 0.0027 0.0000 0.1792 0.0000 0.4286 0.1868 0.1968
55-GC 0.0000 0.1719 0.1875 0.3125 0.3750 0.2115 0.1184 0.1406 0.3750 0.5598 0.0505 0.0001 0.0932 0.0000 0.3750 0.2115 0.1184
56-GC 0.0000 0.0000 0.0000 0.1562 0.5000 0.1058 0.1899 0.1562 0.5000 1.7953 0.0002 0.0000 0.1464 0.0000 0.2500 0.0341 0.0808
57-GC 0.0000 0.1333 0.2000 0.2667 0.2667 0.1692 0.0928 0.1333 0.2667 0.5481 0.0420 0.0001 0.0742 0.0000 0.2667 0.1692 0.0928
58-GC 0.0000 0.0000 0.0000 0.1667 0.1667 0.0769 0.0865 0.1667 0.1667 1.1242 0.0009 0.0000 0.0828 0.0000 0.1667 0.0769 0.0865
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.1333 0.4250 0.7000 0.7167 0.8000 0.5821 0.2356 0.2917 0.6667 0.4047 0.5112 0.4128 0.1941 0.1333 0.8000 0.5821 0.2356
61-GC 0.0000 0.0000 0.0455 0.1364 0.6364 0.0944 0.1725 0.1364 0.6364 1.8277 0.0016 0.0000 0.1027 0.0000 0.1364 0.0492 0.0596
62-GC 0.0000 0.0000 0.2500 0.2500 0.2500 0.1346 0.1297 0.2500 0.2500 0.9636 0.0023 0.0000 0.1243 0.0000 0.2500 0.1346 0.1297
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0147 0.2353 0.0407 0.0879 0.0147 0.2353 2.1574 0.0001 0.0000 0.0627 0.0000 0.0000 0.0000 0.0000
65-GC 0.0430 0.1075 0.3441 0.3710 0.4194 0.2597 0.1441 0.2634 0.3763 0.5546 0.2068 0.1491 0.1287 0.0430 0.4194 0.2597 0.1441
66-GC 0.0000 0.0000 0.0000 0.3333 0.3333 0.1026 0.1601 0.3333 0.3333 1.5612 0.0002 0.0000 0.1420 0.0000 0.3333 0.1026 0.1601
67-GC 0.1765 0.2941 0.2941 0.3676 0.4706 0.3258 0.0782 0.0735 0.2941 0.2402 0.3166 0.3066 0.0613 0.2353 0.4706 0.3382 0.0670
68-GC 0.2824 0.5076 0.5725 0.6546 0.6870 0.5514 0.1338 0.1469 0.4046 0.2426 0.5330 0.5111 0.1006 0.3588 0.6870 0.5738 0.1113
69-GC 0.0000 0.1548 0.2857 0.3333 0.3333 0.2271 0.1306 0.1786 0.3333 0.5752 0.0512 0.0001 0.1088 0.0000 0.3333 0.2271 0.1306
70-GC 0.0000 0.0000 0.0690 0.3190 0.3793 0.1592 0.1577 0.3190 0.3793 0.9911 0.0086 0.0000 0.1449 0.0000 0.3793 0.1592 0.1577
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.2143 0.2857 0.5000 0.6429 0.6429 0.4505 0.1659 0.3571 0.4286 0.3683 0.4189 0.3859 0.1412 0.2143 0.6429 0.4505 0.1659
73-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
74-GC 0.0000 0.0000 0.3333 0.4167 0.6667 0.2564 0.2774 0.4167 0.6667 1.0817 0.0032 0.0000 0.2367 0.0000 0.6667 0.2564 0.2774
75-GC 0.3500 0.3875 0.4500 0.5750 0.7000 0.4769 0.1218 0.1875 0.3500 0.2554 0.4636 0.4516 0.0988 0.3500 0.7000 0.4769 0.1218
152
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2EN-CLEF2007
Statistics for Binary Preference
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0721 0.2703 0.3409 0.5590 0.7499 0.3947 0.2174 0.2887 0.6779 0.5507 0.3270 0.2488 0.1733 0.0721 0.7499 0.3947 0.2174
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.1060 0.1101 0.1436 0.1922 0.2512 0.1606 0.0546 0.0821 0.1453 0.3400 0.1527 0.1457 0.0449 0.1060 0.2512 0.1606 0.0546
54-GC 0.0000 0.0000 0.1224 0.3316 0.3673 0.1538 0.1619 0.3316 0.3673 1.0524 0.0024 0.0000 0.1468 0.0000 0.3673 0.1538 0.1619
55-GC 0.0000 0.0684 0.1641 0.2510 0.3242 0.1641 0.1097 0.1826 0.3242 0.6686 0.0380 0.0001 0.0889 0.0000 0.3242 0.1641 0.1097
56-GC 0.0000 0.0000 0.0000 0.1484 0.4219 0.0889 0.1558 0.1484 0.4219 1.7515 0.0002 0.0000 0.1232 0.0000 0.2188 0.0312 0.0726
57-GC 0.0000 0.0933 0.1200 0.1589 0.2178 0.1179 0.0634 0.0656 0.2178 0.5377 0.0312 0.0001 0.0467 0.0000 0.2178 0.1179 0.0634
58-GC 0.0000 0.0000 0.0000 0.0833 0.1667 0.0427 0.0563 0.0833 0.1667 1.3166 0.0006 0.0000 0.0483 0.0000 0.1667 0.0427 0.0563
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.1489 0.3750 0.7267 0.7578 0.7678 0.5925 0.2482 0.3828 0.6189 0.4190 0.5166 0.4165 0.2130 0.1489 0.7678 0.5925 0.2482
61-GC 0.0000 0.0000 0.0269 0.0646 0.6529 0.0791 0.1765 0.0646 0.6529 2.2296 0.0013 0.0000 0.0957 0.0000 0.1033 0.0313 0.0394
62-GC 0.0000 0.0000 0.1875 0.2500 0.2500 0.1250 0.1224 0.2500 0.2500 0.9789 0.0022 0.0000 0.1154 0.0000 0.2500 0.1250 0.1224
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0087 0.1592 0.0271 0.0594 0.0087 0.1592 2.1865 0.0001 0.0000 0.0418 0.0000 0.0000 0.0000 0.0000
65-GC 0.0513 0.0811 0.2914 0.3552 0.4622 0.2419 0.1493 0.2741 0.4109 0.6172 0.1841 0.1297 0.1328 0.0513 0.4622 0.2419 0.1493
66-GC 0.0000 0.0000 0.0000 0.1389 0.3333 0.0769 0.1313 0.1389 0.3333 1.7075 0.0002 0.0000 0.1065 0.0000 0.3333 0.0769 0.1313
67-GC 0.1246 0.1756 0.2422 0.3417 0.4533 0.2747 0.1123 0.1661 0.3287 0.4087 0.2529 0.2316 0.0930 0.1246 0.4533 0.2747 0.1123
68-GC 0.4482 0.5832 0.7435 0.7860 0.8270 0.6811 0.1291 0.2028 0.3788 0.1895 0.6687 0.6552 0.1113 0.4482 0.8270 0.6811 0.1291
69-GC 0.0000 0.1026 0.1746 0.2426 0.2857 0.1641 0.0980 0.1400 0.2857 0.5970 0.0667 0.0001 0.0803 0.0000 0.2857 0.1641 0.0980
70-GC 0.0000 0.0000 0.0452 0.3210 0.4078 0.1515 0.1683 0.3210 0.4078 1.1114 0.0072 0.0000 0.1498 0.0000 0.4078 0.1515 0.1683
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.2296 0.3036 0.4541 0.5089 0.5969 0.4199 0.1258 0.2054 0.3673 0.2996 0.4003 0.3790 0.1040 0.2296 0.5969 0.4199 0.1258
73-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
74-GC 0.0000 0.0000 0.2222 0.3889 0.6667 0.2308 0.2504 0.3889 0.6667 1.0849 0.0030 0.0000 0.2143 0.0000 0.6667 0.2308 0.2504
75-GC 0.3025 0.3719 0.4075 0.4862 0.6800 0.4415 0.1234 0.1144 0.3775 0.2795 0.4273 0.4149 0.0939 0.3025 0.6300 0.4217 0.1050
153
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2EN-CLEF2007
Statistics for Precision at the 0% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.1290 0.5000 0.5111 1.0000 1.0000 0.6324 0.2900 0.5000 0.8710 0.4586 0.5556 0.4572 0.2329 0.1290 1.0000 0.6324 0.2900
52-GC 0.0022 0.0068 0.0085 0.0131 0.0270 0.0107 0.0066 0.0063 0.0248 0.6183 0.0090 0.0073 0.0049 0.0022 0.0174 0.0093 0.0046
53-GC 0.3333 0.9375 1.0000 1.0000 1.0000 0.9103 0.1968 0.0625 0.6667 0.2162 0.8792 0.8298 0.1381 1.0000 1.0000 1.0000 0.0000
54-GC 0.0000 0.0031 0.5000 0.6667 1.0000 0.3908 0.3927 0.6636 1.0000 1.0048 0.0339 0.0001 0.3484 0.0000 1.0000 0.3908 0.3927
55-GC 0.0000 0.1925 0.7500 1.0000 1.0000 0.5988 0.4269 0.8075 1.0000 0.7129 0.1086 0.0001 0.3936 0.0000 1.0000 0.5988 0.4269
56-GC 0.0000 0.0000 0.0333 0.5000 0.5714 0.1819 0.2496 0.5000 0.5714 1.3725 0.0048 0.0000 0.2177 0.0000 0.5714 0.1819 0.2496
57-GC 0.0000 0.3182 0.3333 0.6250 1.0000 0.4697 0.3417 0.3068 1.0000 0.7274 0.0936 0.0001 0.2587 0.0000 1.0000 0.4697 0.3417
58-GC 0.0385 0.0980 0.1667 0.2500 1.0000 0.2259 0.2494 0.1520 0.9615 1.1039 0.1544 0.1102 0.1468 0.0385 0.3333 0.1614 0.0939
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.6000 1.0000 1.0000 1.0000 1.0000 0.9692 0.1109 0.0000 0.4000 0.1145 0.9615 0.9512 0.0568 1.0000 1.0000 1.0000 0.0000
61-GC 0.0122 0.0328 0.1111 1.0000 1.0000 0.4195 0.4795 0.9672 0.9878 1.1431 0.1371 0.0468 0.4466 0.0122 1.0000 0.4195 0.4795
62-GC 0.0000 0.0417 0.5000 1.0000 1.0000 0.4840 0.4547 0.9583 1.0000 0.9395 0.0660 0.0001 0.4019 0.0000 1.0000 0.4840 0.4547
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0076 0.0195 0.0217 0.0938 0.4286 0.0955 0.1514 0.0743 0.4209 1.5860 0.0388 0.0233 0.1070 0.0076 0.1250 0.0349 0.0360
65-GC 0.0909 0.1524 1.0000 1.0000 1.0000 0.7015 0.4100 0.8476 0.9091 0.5845 0.5001 0.2896 0.3578 0.0909 1.0000 0.7015 0.4100
66-GC 0.0013 0.0304 0.0769 0.3750 1.0000 0.2794 0.3524 0.3446 0.9987 1.2610 0.0966 0.0136 0.2639 0.0013 0.5000 0.1484 0.1621
67-GC 0.3214 0.9167 1.0000 1.0000 1.0000 0.8709 0.2581 0.0833 0.6786 0.2963 0.8163 0.7382 0.1986 1.0000 1.0000 1.0000 0.0000
68-GC 0.8571 1.0000 1.0000 1.0000 1.0000 0.9890 0.0396 0.0000 0.1429 0.0401 0.9882 0.9873 0.0203 1.0000 1.0000 1.0000 0.0000
69-GC 0.0090 0.2268 0.5000 1.0000 1.0000 0.5030 0.3845 0.7732 0.9910 0.7643 0.2664 0.0636 0.3058 0.0090 1.0000 0.5030 0.3845
70-GC 0.0000 0.0143 0.3333 1.0000 1.0000 0.5043 0.4855 0.9857 1.0000 0.9627 0.0554 0.0001 0.4576 0.0000 1.0000 0.5043 0.4855
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.5714 0.7443 1.0000 1.0000 1.0000 0.8787 0.1665 0.2557 0.4286 0.1894 0.8625 0.8446 0.1492 0.5714 1.0000 0.8787 0.1665
73-GC 0.0000 0.0014 0.0070 0.0233 0.0625 0.0144 0.0181 0.0218 0.0625 1.2592 0.0022 0.0000 0.0138 0.0000 0.0328 0.0104 0.0114
74-GC 0.0000 0.0201 0.5000 1.0000 1.0000 0.5147 0.4850 0.9799 1.0000 0.9424 0.0558 0.0001 0.4480 0.0000 1.0000 0.5147 0.4850
75-GC 0.6000 1.0000 1.0000 1.0000 1.0000 0.9582 0.1147 0.0000 0.4000 0.1196 0.9501 0.9398 0.0707 1.0000 1.0000 1.0000 0.0000
154
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2EN-CLEF2007
Statistics for Precision at the 10% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0359 0.2692 0.3947 0.6226 0.9474 0.4544 0.2816 0.3534 0.9114 0.6198 0.3500 0.2115 0.2245 0.0359 0.9474 0.4544 0.2816
52-GC 0.0022 0.0054 0.0076 0.0131 0.0270 0.0102 0.0068 0.0078 0.0248 0.6664 0.0084 0.0069 0.0052 0.0022 0.0174 0.0088 0.0048
53-GC 0.1522 0.2432 0.2500 0.3888 0.6667 0.3300 0.1476 0.1456 0.5145 0.4474 0.3045 0.2836 0.1125 0.1522 0.5625 0.3019 0.1123
54-GC 0.0000 0.0031 0.5000 0.6667 1.0000 0.3908 0.3927 0.6636 1.0000 1.0048 0.0339 0.0001 0.3484 0.0000 1.0000 0.3908 0.3927
55-GC 0.0000 0.1925 0.4000 0.8125 1.0000 0.4885 0.3651 0.6200 1.0000 0.7474 0.0930 0.0001 0.3055 0.0000 1.0000 0.4885 0.3651
56-GC 0.0000 0.0000 0.0333 0.5000 0.5714 0.1819 0.2496 0.5000 0.5714 1.3725 0.0048 0.0000 0.2177 0.0000 0.5714 0.1819 0.2496
57-GC 0.0000 0.2222 0.2727 0.3813 0.6667 0.2846 0.1727 0.1590 0.6667 0.6068 0.0646 0.0001 0.1200 0.0000 0.4000 0.2527 0.1347
58-GC 0.0385 0.0980 0.1667 0.2500 1.0000 0.2259 0.2494 0.1520 0.9615 1.1039 0.1544 0.1102 0.1468 0.0385 0.3333 0.1614 0.0939
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.5714 1.0000 1.0000 1.0000 1.0000 0.9363 0.1557 0.0000 0.4286 0.1663 0.9210 0.9017 0.1079 1.0000 1.0000 1.0000 0.0000
61-GC 0.0122 0.0249 0.0656 0.1579 1.0000 0.1430 0.2636 0.1330 0.9878 1.8438 0.0626 0.0368 0.1401 0.0122 0.1667 0.0716 0.0589
62-GC 0.0000 0.0417 0.5000 1.0000 1.0000 0.4840 0.4547 0.9583 1.0000 0.9395 0.0660 0.0001 0.4019 0.0000 1.0000 0.4840 0.4547
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0067 0.0173 0.0215 0.0443 0.4286 0.0871 0.1527 0.0270 0.4219 1.7529 0.0329 0.0207 0.1051 0.0067 0.0833 0.0250 0.0203
65-GC 0.0763 0.1323 0.3750 0.7328 0.9091 0.4262 0.3090 0.6006 0.8328 0.7251 0.3031 0.2025 0.2677 0.0763 0.9091 0.4262 0.3090
66-GC 0.0013 0.0304 0.0769 0.3750 1.0000 0.2794 0.3524 0.3446 0.9987 1.2610 0.0966 0.0136 0.2639 0.0013 0.5000 0.1484 0.1621
67-GC 0.3214 0.9167 1.0000 1.0000 1.0000 0.8709 0.2581 0.0833 0.6786 0.2963 0.8163 0.7382 0.1986 1.0000 1.0000 1.0000 0.0000
68-GC 0.3625 0.6391 0.7778 0.9146 1.0000 0.7413 0.2041 0.2755 0.6375 0.2754 0.7103 0.6740 0.1699 0.3625 1.0000 0.7413 0.2041
69-GC 0.0065 0.2189 0.3750 0.5000 0.7500 0.3465 0.2224 0.2811 0.7435 0.6417 0.1917 0.0454 0.1653 0.0065 0.7500 0.3465 0.2224
70-GC 0.0000 0.0143 0.0360 1.0000 1.0000 0.4221 0.4691 0.9857 1.0000 1.1114 0.0358 0.0001 0.4373 0.0000 1.0000 0.4221 0.4691
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.5714 0.6667 0.7500 1.0000 1.0000 0.8275 0.1729 0.3333 0.4286 0.2090 0.8103 0.7931 0.1593 0.5714 1.0000 0.8275 0.1729
73-GC 0.0000 0.0014 0.0070 0.0233 0.0625 0.0144 0.0181 0.0218 0.0625 1.2592 0.0022 0.0000 0.0138 0.0000 0.0328 0.0104 0.0114
74-GC 0.0000 0.0201 0.5000 1.0000 1.0000 0.5147 0.4850 0.9799 1.0000 0.9424 0.0558 0.0001 0.4480 0.0000 1.0000 0.5147 0.4850
75-GC 0.6000 0.9643 1.0000 1.0000 1.0000 0.9363 0.1320 0.0357 0.4000 0.1410 0.9259 0.9133 0.0981 1.0000 1.0000 1.0000 0.0000
155
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2EN-CLEF2007
Statistics for Precision at the 20% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.2214 0.3457 0.6226 0.9355 0.4304 0.2950 0.4012 0.9355 0.6854 0.1726 0.0001 0.2429 0.0000 0.9355 0.4304 0.2950
52-GC 0.0000 0.0000 0.0073 0.0113 0.0270 0.0075 0.0074 0.0113 0.0270 0.9870 0.0012 0.0000 0.0050 0.0000 0.0270 0.0075 0.0074
53-GC 0.0612 0.1432 0.2063 0.3085 0.5000 0.2301 0.1289 0.1653 0.4388 0.5603 0.1932 0.1556 0.1029 0.0612 0.5000 0.2301 0.1289
54-GC 0.0000 0.0025 0.0571 0.6667 1.0000 0.3310 0.3662 0.6642 1.0000 1.1062 0.0273 0.0001 0.3354 0.0000 1.0000 0.3310 0.3662
55-GC 0.0000 0.1925 0.3182 0.4583 1.0000 0.3451 0.2707 0.2659 1.0000 0.7844 0.0710 0.0001 0.1930 0.0000 0.6667 0.2905 0.1941
56-GC 0.0000 0.0000 0.0299 0.3125 0.5714 0.1617 0.2327 0.3125 0.5714 1.4388 0.0019 0.0000 0.1917 0.0000 0.5714 0.1617 0.2327
57-GC 0.0000 0.1228 0.2727 0.3031 0.5000 0.2221 0.1464 0.1803 0.5000 0.6592 0.0502 0.0001 0.1197 0.0000 0.5000 0.2221 0.1464
58-GC 0.0274 0.0502 0.1071 0.1806 0.2500 0.1163 0.0771 0.1304 0.2226 0.6628 0.0921 0.0716 0.0624 0.0274 0.2500 0.1163 0.0771
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.1228 0.6719 1.0000 1.0000 1.0000 0.7931 0.3292 0.3281 0.8772 0.4150 0.6715 0.4825 0.2608 0.4375 1.0000 0.9110 0.1748
61-GC 0.0112 0.0225 0.0288 0.0704 1.0000 0.1125 0.2679 0.0479 0.9888 2.3809 0.0405 0.0273 0.1365 0.0112 0.0870 0.0386 0.0271
62-GC 0.0000 0.0417 0.5000 1.0000 1.0000 0.4840 0.4547 0.9583 1.0000 0.9395 0.0660 0.0001 0.4019 0.0000 1.0000 0.4840 0.4547
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0125 0.0208 0.0438 0.2857 0.0628 0.1008 0.0313 0.2857 1.6043 0.0167 0.0001 0.0715 0.0000 0.0816 0.0223 0.0213
65-GC 0.0671 0.1024 0.3750 0.6505 0.7600 0.3832 0.2697 0.5482 0.6929 0.7038 0.2736 0.1813 0.2320 0.0671 0.7600 0.3832 0.2697
66-GC 0.0013 0.0304 0.0769 0.3750 1.0000 0.2794 0.3524 0.3446 0.9987 1.2610 0.0966 0.0136 0.2639 0.0013 0.5000 0.1484 0.1621
67-GC 0.2500 0.3192 0.4375 0.5744 0.8333 0.4715 0.1888 0.2552 0.5833 0.4003 0.4399 0.4126 0.1541 0.2500 0.8333 0.4715 0.1888
68-GC 0.3625 0.5879 0.7500 0.8847 0.9118 0.7006 0.2008 0.2967 0.5492 0.2866 0.6695 0.6345 0.1689 0.3625 0.9118 0.7006 0.2008
69-GC 0.0065 0.1439 0.3429 0.3930 0.5000 0.2842 0.1793 0.2491 0.4935 0.6307 0.1635 0.0445 0.1496 0.0065 0.5000 0.2842 0.1793
70-GC 0.0000 0.0111 0.0328 0.7125 0.8571 0.3063 0.3585 0.7014 0.8571 1.1705 0.0285 0.0001 0.3270 0.0000 0.8571 0.3063 0.3585
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.4000 0.5929 0.7273 0.7625 0.8000 0.6646 0.1400 0.1696 0.4000 0.2107 0.6485 0.6298 0.1118 0.4000 0.8000 0.6646 0.1400
73-GC 0.0000 0.0000 0.0070 0.0128 0.0328 0.0088 0.0106 0.0128 0.0328 1.2065 0.0011 0.0000 0.0081 0.0000 0.0230 0.0068 0.0082
74-GC 0.0000 0.0201 0.5000 1.0000 1.0000 0.5147 0.4850 0.9799 1.0000 0.9424 0.0558 0.0001 0.4480 0.0000 1.0000 0.5147 0.4850
75-GC 0.5833 0.6667 0.8571 1.0000 1.0000 0.8375 0.1719 0.3333 0.4167 0.2053 0.8203 0.8026 0.1530 0.5833 1.0000 0.8375 0.1719
156
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2EN-CLEF2007
Statistics for Precision at the 30% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.1776 0.3231 0.6226 0.8519 0.3891 0.2804 0.4450 0.8519 0.7205 0.1539 0.0001 0.2344 0.0000 0.8519 0.3891 0.2804
52-GC 0.0000 0.0000 0.0000 0.0055 0.0118 0.0028 0.0047 0.0055 0.0118 1.6744 0.0001 0.0000 0.0039 0.0000 0.0118 0.0028 0.0047
53-GC 0.0566 0.0962 0.1148 0.2528 0.3509 0.1619 0.0972 0.1566 0.2943 0.6005 0.1367 0.1161 0.0840 0.0566 0.3509 0.1619 0.0972
54-GC 0.0000 0.0000 0.0571 0.4286 0.6000 0.1858 0.2214 0.4286 0.6000 1.1914 0.0085 0.0000 0.1867 0.0000 0.6000 0.1858 0.2214
55-GC 0.0000 0.1925 0.3158 0.4167 0.5000 0.2804 0.1637 0.2242 0.5000 0.5837 0.0635 0.0001 0.1315 0.0000 0.5000 0.2804 0.1637
56-GC 0.0000 0.0000 0.0169 0.2708 0.5714 0.1469 0.2178 0.2708 0.5714 1.4822 0.0017 0.0000 0.1756 0.0000 0.5714 0.1469 0.2178
57-GC 0.0000 0.0789 0.1613 0.2527 0.3125 0.1510 0.1043 0.1739 0.3125 0.6911 0.0349 0.0001 0.0880 0.0000 0.3125 0.1510 0.1043
58-GC 0.0274 0.0502 0.1071 0.1806 0.2500 0.1163 0.0771 0.1304 0.2226 0.6628 0.0921 0.0716 0.0624 0.0274 0.2500 0.1163 0.0771
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0500 0.4991 0.9167 1.0000 1.0000 0.7428 0.3607 0.5009 0.9500 0.4856 0.5533 0.2670 0.2997 0.0500 1.0000 0.7428 0.3607
61-GC 0.0112 0.0179 0.0243 0.0361 1.0000 0.1005 0.2705 0.0182 0.9888 2.6922 0.0306 0.0223 0.1384 0.0112 0.0485 0.0255 0.0126
62-GC 0.0000 0.0074 0.0331 0.0493 0.1250 0.0367 0.0354 0.0419 0.1250 0.9638 0.0092 0.0001 0.0248 0.0000 0.0833 0.0293 0.0244
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0082 0.0198 0.0243 0.2400 0.0490 0.0853 0.0161 0.2400 1.7413 0.0049 0.0000 0.0588 0.0000 0.0290 0.0142 0.0102
65-GC 0.0479 0.1009 0.3542 0.4235 0.6250 0.3002 0.1937 0.3226 0.5771 0.6451 0.2230 0.1477 0.1636 0.0479 0.6250 0.3002 0.1937
66-GC 0.0013 0.0304 0.0769 0.3750 1.0000 0.2794 0.3524 0.3446 0.9987 1.2610 0.0966 0.0136 0.2639 0.0013 0.5000 0.1484 0.1621
67-GC 0.2500 0.3073 0.3636 0.4435 0.6667 0.3932 0.1208 0.1362 0.4167 0.3073 0.3782 0.3652 0.0907 0.2500 0.5833 0.3704 0.0925
68-GC 0.3625 0.5823 0.7500 0.8627 0.9038 0.6849 0.1952 0.2804 0.5413 0.2850 0.6545 0.6201 0.1607 0.3625 0.9038 0.6849 0.1952
69-GC 0.0000 0.1439 0.3429 0.3684 0.4667 0.2632 0.1599 0.2245 0.4667 0.6075 0.0929 0.0001 0.1351 0.0000 0.4667 0.2632 0.1599
70-GC 0.0000 0.0073 0.0312 0.4464 0.7143 0.2148 0.2582 0.4391 0.7143 1.2021 0.0133 0.0000 0.2303 0.0000 0.7143 0.2148 0.2582
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.3125 0.4000 0.6250 0.7175 0.7500 0.5721 0.1559 0.3175 0.4375 0.2725 0.5498 0.5254 0.1292 0.3125 0.7500 0.5721 0.1559
73-GC 0.0000 0.0000 0.0000 0.0078 0.0166 0.0041 0.0060 0.0078 0.0166 1.4628 0.0001 0.0000 0.0050 0.0000 0.0166 0.0041 0.0060
74-GC 0.0000 0.0201 0.5000 1.0000 1.0000 0.5147 0.4850 0.9799 1.0000 0.9424 0.0558 0.0001 0.4480 0.0000 1.0000 0.5147 0.4850
75-GC 0.5000 0.5341 0.6000 0.8835 1.0000 0.7028 0.1953 0.3494 0.5000 0.2778 0.6789 0.6569 0.1734 0.5000 1.0000 0.7028 0.1953
157
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2EN-CLEF2007
Statistics for Precision at the 40% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.1410 0.2822 0.6185 0.8519 0.3669 0.2875 0.4775 0.8519 0.7836 0.1397 0.0001 0.2415 0.0000 0.8519 0.3669 0.2875
52-GC 0.0000 0.0000 0.0000 0.0000 0.0096 0.0007 0.0027 0.0000 0.0096 3.6056 0.0000 0.0000 0.0014 0.0000 0.0000 0.0000 0.0000
53-GC 0.0495 0.0498 0.0927 0.1698 0.2432 0.1133 0.0673 0.1200 0.1938 0.5937 0.0962 0.0824 0.0555 0.0495 0.2432 0.1133 0.0673
54-GC 0.0000 0.0000 0.0571 0.4286 0.6000 0.1858 0.2214 0.4286 0.6000 1.1914 0.0085 0.0000 0.1867 0.0000 0.6000 0.1858 0.2214
55-GC 0.0000 0.1700 0.2381 0.2905 0.3500 0.2147 0.1144 0.1205 0.3500 0.5328 0.0517 0.0001 0.0874 0.0000 0.3500 0.2147 0.1144
56-GC 0.0000 0.0000 0.0169 0.1944 0.5714 0.1341 0.2161 0.1944 0.5714 1.6111 0.0016 0.0000 0.1674 0.0000 0.3333 0.0546 0.1040
57-GC 0.0000 0.0583 0.1084 0.2077 0.3000 0.1305 0.1000 0.1493 0.3000 0.7666 0.0300 0.0001 0.0831 0.0000 0.3000 0.1305 0.1000
58-GC 0.0063 0.0090 0.0615 0.0857 0.1071 0.0522 0.0382 0.0767 0.1008 0.7318 0.0332 0.0182 0.0336 0.0063 0.1071 0.0522 0.0382
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0463 0.4657 0.8421 0.8667 0.9333 0.6645 0.3310 0.4010 0.8871 0.4981 0.4911 0.2422 0.2730 0.0463 0.9333 0.6645 0.3310
61-GC 0.0108 0.0117 0.0189 0.0322 0.7500 0.0775 0.2025 0.0205 0.7392 2.6131 0.0245 0.0176 0.1035 0.0108 0.0485 0.0214 0.0138
62-GC 0.0000 0.0074 0.0331 0.0493 0.1250 0.0367 0.0354 0.0419 0.1250 0.9638 0.0092 0.0001 0.0248 0.0000 0.0833 0.0293 0.0244
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0082 0.0139 0.0241 0.2400 0.0475 0.0859 0.0160 0.2400 1.8088 0.0045 0.0000 0.0592 0.0000 0.0284 0.0125 0.0097
65-GC 0.0427 0.0922 0.2794 0.3880 0.4691 0.2575 0.1597 0.2958 0.4264 0.6203 0.1939 0.1305 0.1381 0.0427 0.4691 0.2575 0.1597
66-GC 0.0000 0.0044 0.0541 0.0685 0.0909 0.0415 0.0328 0.0641 0.0909 0.7903 0.0146 0.0001 0.0286 0.0000 0.0909 0.0415 0.0328
67-GC 0.2500 0.3073 0.3636 0.4435 0.5833 0.3804 0.0956 0.1362 0.3333 0.2513 0.3699 0.3601 0.0769 0.2500 0.5833 0.3804 0.0956
68-GC 0.3274 0.5706 0.6709 0.8554 0.8689 0.6576 0.1946 0.2848 0.5415 0.2960 0.6256 0.5888 0.1497 0.3274 0.8689 0.6576 0.1946
69-GC 0.0000 0.1426 0.2195 0.3357 0.3667 0.2241 0.1372 0.1931 0.3667 0.6122 0.0781 0.0001 0.1079 0.0000 0.3667 0.2241 0.1372
70-GC 0.0000 0.0000 0.0263 0.2305 0.3714 0.1094 0.1330 0.2305 0.3714 1.2152 0.0032 0.0000 0.1112 0.0000 0.3714 0.1094 0.1330
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.2609 0.3882 0.5625 0.7068 0.7500 0.5382 0.1697 0.3186 0.4891 0.3153 0.5110 0.4823 0.1430 0.2609 0.7500 0.5382 0.1697
73-GC 0.0000 0.0000 0.0000 0.0078 0.0166 0.0041 0.0060 0.0078 0.0166 1.4628 0.0001 0.0000 0.0050 0.0000 0.0166 0.0041 0.0060
74-GC 0.0000 0.0104 0.0909 0.4667 1.0000 0.2641 0.3295 0.4562 1.0000 1.2476 0.0286 0.0001 0.2686 0.0000 1.0000 0.2641 0.3295
75-GC 0.3636 0.4508 0.4762 0.6265 0.9091 0.5462 0.1662 0.1757 0.5455 0.3042 0.5256 0.5078 0.1277 0.3636 0.8000 0.5160 0.1310
158
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2EN-CLEF2007
Statistics for Precision at the 50% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.1274 0.1972 0.5674 0.7632 0.3262 0.2636 0.4401 0.7632 0.8082 0.1240 0.0001 0.2258 0.0000 0.7632 0.3262 0.2636
52-GC 0.0000 0.0000 0.0000 0.0000 0.0062 0.0005 0.0017 0.0000 0.0062 3.6056 0.0000 0.0000 0.0009 0.0000 0.0000 0.0000 0.0000
53-GC 0.0343 0.0413 0.0885 0.1366 0.1818 0.0927 0.0504 0.0953 0.1475 0.5444 0.0794 0.0673 0.0410 0.0343 0.1818 0.0927 0.0504
54-GC 0.0000 0.0000 0.0388 0.1040 0.4000 0.0867 0.1215 0.1040 0.4000 1.4010 0.0053 0.0000 0.0845 0.0000 0.1081 0.0402 0.0396
55-GC 0.0000 0.1589 0.2222 0.2520 0.3333 0.1904 0.0995 0.0931 0.3333 0.5228 0.0469 0.0001 0.0737 0.1250 0.3333 0.2250 0.0576
56-GC 0.0000 0.0000 0.0169 0.1944 0.5714 0.1341 0.2161 0.1944 0.5714 1.6111 0.0016 0.0000 0.1674 0.0000 0.3333 0.0546 0.1040
57-GC 0.0000 0.0491 0.0851 0.1384 0.2500 0.0926 0.0718 0.0893 0.2500 0.7757 0.0229 0.0001 0.0560 0.0000 0.2500 0.0926 0.0718
58-GC 0.0063 0.0090 0.0615 0.0857 0.1071 0.0522 0.0382 0.0767 0.1008 0.7318 0.0332 0.0182 0.0336 0.0063 0.1071 0.0522 0.0382
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0345 0.3907 0.7500 0.8333 0.8421 0.6031 0.3227 0.4427 0.8076 0.5351 0.4128 0.1741 0.2677 0.0345 0.8421 0.6031 0.3227
61-GC 0.0000 0.0000 0.0165 0.0245 0.7368 0.0696 0.2008 0.0245 0.7368 2.8852 0.0025 0.0000 0.1027 0.0000 0.0320 0.0140 0.0121
62-GC 0.0000 0.0074 0.0331 0.0493 0.1250 0.0367 0.0354 0.0419 0.1250 0.9638 0.0092 0.0001 0.0248 0.0000 0.0833 0.0293 0.0244
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0121 0.0233 0.2400 0.0457 0.0867 0.0233 0.2400 1.8958 0.0024 0.0000 0.0598 0.0000 0.0284 0.0104 0.0098
65-GC 0.0000 0.0773 0.2581 0.3545 0.3817 0.2172 0.1475 0.2772 0.3817 0.6792 0.0470 0.0001 0.1300 0.0000 0.3817 0.2172 0.1475
66-GC 0.0000 0.0044 0.0541 0.0685 0.0909 0.0415 0.0328 0.0641 0.0909 0.7903 0.0146 0.0001 0.0286 0.0000 0.0909 0.0415 0.0328
67-GC 0.2500 0.3073 0.3333 0.4021 0.5217 0.3598 0.0795 0.0949 0.2717 0.2210 0.3522 0.3451 0.0632 0.2500 0.5217 0.3598 0.0795
68-GC 0.2895 0.5448 0.6273 0.8322 0.8571 0.6268 0.1947 0.2875 0.5677 0.3107 0.5937 0.5561 0.1438 0.2895 0.8571 0.6268 0.1947
69-GC 0.0000 0.0430 0.1930 0.3284 0.3667 0.1741 0.1396 0.2853 0.3667 0.8020 0.0333 0.0001 0.1157 0.0000 0.3667 0.1741 0.1396
70-GC 0.0000 0.0000 0.0000 0.1401 0.2286 0.0649 0.0848 0.1401 0.2286 1.3072 0.0008 0.0000 0.0704 0.0000 0.2286 0.0649 0.0848
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.1944 0.3474 0.5294 0.6571 0.7273 0.4996 0.1740 0.3097 0.5328 0.3483 0.4680 0.4330 0.1501 0.1944 0.7273 0.4996 0.1740
73-GC 0.0000 0.0000 0.0000 0.0052 0.0135 0.0027 0.0046 0.0052 0.0135 1.7153 0.0001 0.0000 0.0037 0.0000 0.0095 0.0018 0.0034
74-GC 0.0000 0.0104 0.0909 0.4667 1.0000 0.2641 0.3295 0.4562 1.0000 1.2476 0.0286 0.0001 0.2686 0.0000 1.0000 0.2641 0.3295
75-GC 0.2857 0.3984 0.4444 0.6107 0.9091 0.4977 0.1829 0.2122 0.6234 0.3676 0.4699 0.4454 0.1411 0.2857 0.9091 0.4977 0.1829
159
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2EN-CLEF2007
Statistics for Precision at the 60% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.1122 0.1736 0.5114 0.6733 0.2871 0.2323 0.3991 0.6733 0.8090 0.1107 0.0001 0.1982 0.0000 0.6733 0.2871 0.2323
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0307 0.0727 0.1013 0.1625 0.0679 0.0505 0.0706 0.1625 0.7430 0.0102 0.0000 0.0397 0.0000 0.1625 0.0679 0.0505
54-GC 0.0000 0.0000 0.0175 0.0345 0.0463 0.0198 0.0164 0.0345 0.0463 0.8305 0.0023 0.0000 0.0136 0.0000 0.0463 0.0198 0.0164
55-GC 0.0000 0.1404 0.2157 0.2339 0.2564 0.1718 0.0873 0.0935 0.2564 0.5082 0.0431 0.0001 0.0677 0.1205 0.2564 0.2030 0.0466
56-GC 0.0000 0.0000 0.0169 0.0874 0.5556 0.1068 0.2013 0.0874 0.5556 1.8848 0.0013 0.0000 0.1427 0.0000 0.1471 0.0261 0.0456
57-GC 0.0000 0.0409 0.0769 0.1160 0.2432 0.0823 0.0692 0.0752 0.2432 0.8406 0.0203 0.0001 0.0510 0.0000 0.1698 0.0689 0.0516
58-GC 0.0052 0.0088 0.0505 0.0717 0.1026 0.0459 0.0348 0.0629 0.0973 0.7584 0.0294 0.0163 0.0288 0.0052 0.1026 0.0459 0.0348
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0315 0.2766 0.7200 0.7938 0.8333 0.5605 0.3178 0.5172 0.8018 0.5670 0.3642 0.1428 0.2712 0.0315 0.8333 0.5605 0.3178
61-GC 0.0000 0.0000 0.0000 0.0228 0.7368 0.0656 0.2021 0.0228 0.7368 3.0797 0.0005 0.0000 0.1033 0.0000 0.0320 0.0097 0.0129
62-GC 0.0000 0.0028 0.0263 0.0416 0.0638 0.0266 0.0231 0.0388 0.0638 0.8696 0.0043 0.0000 0.0188 0.0000 0.0638 0.0266 0.0231
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0176 0.2400 0.0417 0.0883 0.0176 0.2400 2.1203 0.0004 0.0000 0.0610 0.0000 0.0208 0.0056 0.0081
65-GC 0.0000 0.0000 0.2276 0.3220 0.3557 0.1862 0.1485 0.3220 0.3557 0.7973 0.0111 0.0000 0.1304 0.0000 0.3557 0.1862 0.1485
66-GC 0.0000 0.0044 0.0541 0.0685 0.0909 0.0415 0.0328 0.0641 0.0909 0.7903 0.0146 0.0001 0.0286 0.0000 0.0909 0.0415 0.0328
67-GC 0.2500 0.2854 0.3333 0.4021 0.5217 0.3528 0.0852 0.1167 0.2717 0.2415 0.3439 0.3357 0.0686 0.2500 0.5217 0.3528 0.0852
68-GC 0.2832 0.4609 0.5488 0.6978 0.8144 0.5562 0.1718 0.2369 0.5313 0.3089 0.5283 0.4977 0.1348 0.2832 0.8144 0.5562 0.1718
69-GC 0.0000 0.0234 0.0844 0.3060 0.3415 0.1462 0.1372 0.2826 0.3415 0.9389 0.0154 0.0000 0.1218 0.0000 0.3415 0.1462 0.1372
70-GC 0.0000 0.0000 0.0000 0.0890 0.1513 0.0427 0.0543 0.0890 0.1513 1.2730 0.0007 0.0000 0.0460 0.0000 0.1513 0.0427 0.0543
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.1250 0.2818 0.5000 0.6552 0.6923 0.4553 0.1968 0.3734 0.5673 0.4323 0.4082 0.3543 0.1730 0.1250 0.6923 0.4553 0.1968
73-GC 0.0000 0.0000 0.0000 0.0018 0.0135 0.0023 0.0046 0.0018 0.0135 1.9867 0.0000 0.0000 0.0036 0.0000 0.0000 0.0000 0.0000
74-GC 0.0000 0.0104 0.0909 0.4667 1.0000 0.2641 0.3295 0.4562 1.0000 1.2476 0.0286 0.0001 0.2686 0.0000 1.0000 0.2641 0.3295
75-GC 0.2222 0.2720 0.4118 0.5801 0.8000 0.4397 0.1937 0.3082 0.5778 0.4406 0.4020 0.3682 0.1524 0.2222 0.8000 0.4397 0.1937
160
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2EN-CLEF2007
Statistics for Precision at the 70% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0954 0.1452 0.4151 0.5926 0.2371 0.2089 0.3197 0.5926 0.8808 0.0470 0.0001 0.1757 0.0000 0.5926 0.2371 0.2089
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0560 0.0678 0.1054 0.0425 0.0375 0.0678 0.1054 0.8833 0.0023 0.0000 0.0327 0.0000 0.1054 0.0425 0.0375
54-GC 0.0000 0.0000 0.0175 0.0345 0.0463 0.0198 0.0164 0.0345 0.0463 0.8305 0.0023 0.0000 0.0136 0.0000 0.0463 0.0198 0.0164
55-GC 0.0000 0.0813 0.1558 0.1974 0.2206 0.1355 0.0747 0.1161 0.2206 0.5514 0.0345 0.0001 0.0594 0.0000 0.2206 0.1355 0.0747
56-GC 0.0000 0.0000 0.0000 0.0506 0.5455 0.0784 0.1658 0.0506 0.5455 2.1151 0.0004 0.0000 0.1125 0.0000 0.1053 0.0143 0.0321
57-GC 0.0000 0.0204 0.0526 0.0840 0.1146 0.0535 0.0405 0.0636 0.1146 0.7577 0.0140 0.0001 0.0333 0.0000 0.1146 0.0535 0.0405
58-GC 0.0000 0.0088 0.0323 0.0507 0.0923 0.0335 0.0275 0.0419 0.0923 0.8212 0.0142 0.0001 0.0230 0.0000 0.0923 0.0335 0.0275
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0249 0.2131 0.7097 0.7833 0.8077 0.5463 0.3202 0.5702 0.7828 0.5861 0.3430 0.1238 0.2772 0.0249 0.8077 0.5463 0.3202
61-GC 0.0000 0.0000 0.0000 0.0226 0.5517 0.0500 0.1512 0.0226 0.5517 3.0237 0.0003 0.0000 0.0772 0.0000 0.0311 0.0082 0.0128
62-GC 0.0000 0.0028 0.0263 0.0416 0.0638 0.0266 0.0231 0.0388 0.0638 0.8696 0.0043 0.0000 0.0188 0.0000 0.0638 0.0266 0.0231
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0140 0.2400 0.0392 0.0893 0.0140 0.2400 2.2773 0.0001 0.0000 0.0618 0.0000 0.0165 0.0027 0.0061
65-GC 0.0000 0.0000 0.1769 0.2697 0.3557 0.1569 0.1316 0.2697 0.3557 0.8391 0.0098 0.0000 0.1100 0.0000 0.3557 0.1569 0.1316
66-GC 0.0000 0.0023 0.0047 0.0110 0.0469 0.0097 0.0126 0.0087 0.0469 1.3013 0.0019 0.0000 0.0081 0.0000 0.0185 0.0066 0.0061
67-GC 0.2449 0.2840 0.3333 0.4021 0.5217 0.3518 0.0864 0.1182 0.2768 0.2456 0.3426 0.3340 0.0695 0.2449 0.5217 0.3518 0.0864
68-GC 0.2022 0.3321 0.5000 0.6238 0.6866 0.4743 0.1652 0.2916 0.4844 0.3482 0.4428 0.4075 0.1413 0.2022 0.6866 0.4743 0.1652
69-GC 0.0000 0.0000 0.0562 0.2761 0.3191 0.1246 0.1319 0.2761 0.3191 1.0589 0.0040 0.0000 0.1169 0.0000 0.3191 0.1246 0.1319
70-GC 0.0000 0.0000 0.0000 0.0463 0.0792 0.0240 0.0305 0.0463 0.0792 1.2685 0.0005 0.0000 0.0259 0.0000 0.0792 0.0240 0.0305
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.0738 0.2404 0.3448 0.5066 0.5882 0.3536 0.1637 0.2662 0.5144 0.4628 0.3083 0.2522 0.1397 0.0738 0.5882 0.3536 0.1637
73-GC 0.0000 0.0000 0.0000 0.0018 0.0135 0.0023 0.0046 0.0018 0.0135 1.9867 0.0000 0.0000 0.0036 0.0000 0.0000 0.0000 0.0000
74-GC 0.0000 0.0000 0.0135 0.0759 0.1875 0.0448 0.0632 0.0759 0.1875 1.4089 0.0028 0.0000 0.0503 0.0000 0.1875 0.0448 0.0632
75-GC 0.0515 0.2129 0.2857 0.4651 0.7000 0.3306 0.2114 0.2522 0.6485 0.6395 0.2539 0.1715 0.1616 0.0515 0.7000 0.3306 0.2114
161
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2EN-CLEF2007
Statistics for Precision at the 80% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0944 0.2686 0.5389 0.1666 0.1999 0.2686 0.5389 1.1999 0.0024 0.0000 0.1649 0.0000 0.5389 0.1666 0.1999
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0000 0.0135 0.0793 0.0144 0.0281 0.0135 0.0793 1.9439 0.0001 0.0000 0.0222 0.0000 0.0000 0.0000 0.0000
54-GC 0.0000 0.0000 0.0175 0.0307 0.0378 0.0151 0.0150 0.0307 0.0378 0.9906 0.0011 0.0000 0.0130 0.0000 0.0378 0.0151 0.0150
55-GC 0.0000 0.0764 0.1413 0.1954 0.2206 0.1299 0.0745 0.1190 0.2206 0.5734 0.0328 0.0001 0.0591 0.0000 0.2206 0.1299 0.0745
56-GC 0.0000 0.0000 0.0000 0.0312 0.3043 0.0507 0.1031 0.0312 0.3043 2.0348 0.0003 0.0000 0.0732 0.0000 0.0737 0.0095 0.0222
57-GC 0.0000 0.0178 0.0522 0.0738 0.0992 0.0446 0.0327 0.0560 0.0992 0.7329 0.0122 0.0001 0.0278 0.0000 0.0992 0.0446 0.0327
58-GC 0.0000 0.0088 0.0323 0.0507 0.0923 0.0335 0.0275 0.0419 0.0923 0.8212 0.0142 0.0001 0.0230 0.0000 0.0923 0.0335 0.0275
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0000 0.1932 0.6000 0.6648 0.8000 0.4779 0.2966 0.4716 0.8000 0.6206 0.0896 0.0001 0.2498 0.0000 0.8000 0.4779 0.2966
61-GC 0.0000 0.0000 0.0000 0.0000 0.5294 0.0407 0.1468 0.0000 0.5294 3.6056 0.0000 0.0000 0.0752 0.0000 0.0000 0.0000 0.0000
62-GC 0.0000 0.0000 0.0042 0.0353 0.0588 0.0173 0.0215 0.0353 0.0588 1.2434 0.0007 0.0000 0.0191 0.0000 0.0588 0.0173 0.0215
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0035 0.0888 0.0147 0.0331 0.0035 0.0888 2.2432 0.0001 0.0000 0.0228 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0000 0.1194 0.2116 0.3348 0.1227 0.1194 0.2116 0.3348 0.9732 0.0042 0.0000 0.0976 0.0000 0.3348 0.1227 0.1194
66-GC 0.0000 0.0023 0.0047 0.0110 0.0469 0.0097 0.0126 0.0087 0.0469 1.3013 0.0019 0.0000 0.0081 0.0000 0.0185 0.0066 0.0061
67-GC 0.1515 0.2644 0.2830 0.2932 0.3590 0.2774 0.0525 0.0288 0.2075 0.1894 0.2721 0.2658 0.0339 0.2297 0.2979 0.2737 0.0206
68-GC 0.1244 0.1345 0.3520 0.5687 0.6176 0.3557 0.2022 0.4342 0.4932 0.5686 0.2953 0.2408 0.1811 0.1244 0.6176 0.3557 0.2022
69-GC 0.0000 0.0000 0.0000 0.1874 0.2576 0.0802 0.1010 0.1874 0.2576 1.2585 0.0009 0.0000 0.0864 0.0000 0.2576 0.0802 0.1010
70-GC 0.0000 0.0000 0.0000 0.0316 0.0628 0.0132 0.0218 0.0316 0.0628 1.6536 0.0001 0.0000 0.0183 0.0000 0.0628 0.0132 0.0218
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.0348 0.1121 0.1667 0.3336 0.4444 0.2054 0.1346 0.2215 0.4097 0.6551 0.1633 0.1234 0.1123 0.0348 0.4444 0.2054 0.1346
73-GC 0.0000 0.0000 0.0000 0.0018 0.0135 0.0022 0.0045 0.0018 0.0135 1.9990 0.0000 0.0000 0.0034 0.0000 0.0000 0.0000 0.0000
74-GC 0.0000 0.0000 0.0135 0.0759 0.1875 0.0448 0.0632 0.0759 0.1875 1.4089 0.0028 0.0000 0.0503 0.0000 0.1875 0.0448 0.0632
75-GC 0.0498 0.0976 0.2319 0.3934 0.4848 0.2493 0.1620 0.2958 0.4350 0.6497 0.1913 0.1368 0.1346 0.0498 0.4848 0.2493 0.1620
162
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2EN-CLEF2007
Statistics for Precision at the 90% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0000 0.1585 0.3108 0.0927 0.1187 0.1585 0.3108 1.2814 0.0009 0.0000 0.0998 0.0000 0.3108 0.0927 0.1187
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0000 0.0000 0.0678 0.0052 0.0188 0.0000 0.0678 3.6056 0.0000 0.0000 0.0096 0.0000 0.0000 0.0000 0.0000
54-GC 0.0000 0.0000 0.0131 0.0261 0.0378 0.0128 0.0139 0.0261 0.0378 1.0868 0.0006 0.0000 0.0118 0.0000 0.0378 0.0128 0.0139
55-GC 0.0000 0.0248 0.0932 0.1954 0.2206 0.1033 0.0807 0.1707 0.2206 0.7809 0.0233 0.0001 0.0687 0.0000 0.2206 0.1033 0.0807
56-GC 0.0000 0.0000 0.0000 0.0040 0.1739 0.0258 0.0599 0.0040 0.1739 2.3192 0.0001 0.0000 0.0412 0.0000 0.0000 0.0000 0.0000
57-GC 0.0000 0.0000 0.0310 0.0541 0.0657 0.0282 0.0284 0.0541 0.0657 1.0063 0.0010 0.0000 0.0261 0.0000 0.0657 0.0282 0.0284
58-GC 0.0000 0.0052 0.0151 0.0465 0.0923 0.0250 0.0271 0.0413 0.0923 1.0863 0.0040 0.0000 0.0210 0.0000 0.0923 0.0250 0.0271
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0000 0.1488 0.5192 0.5625 0.5870 0.3938 0.2410 0.4137 0.5870 0.6120 0.0747 0.0001 0.2089 0.0000 0.5870 0.3938 0.2410
61-GC 0.0000 0.0000 0.0000 0.0000 0.2062 0.0159 0.0572 0.0000 0.2062 3.6056 0.0000 0.0000 0.0293 0.0000 0.0000 0.0000 0.0000
62-GC 0.0000 0.0000 0.0042 0.0353 0.0588 0.0173 0.0215 0.0353 0.0588 1.2434 0.0007 0.0000 0.0191 0.0000 0.0588 0.0173 0.0215
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0000 0.0329 0.0051 0.0123 0.0000 0.0329 2.4410 0.0000 0.0000 0.0086 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0000 0.0000 0.1172 0.2538 0.0728 0.0950 0.1172 0.2538 1.3051 0.0008 0.0000 0.0784 0.0000 0.2538 0.0728 0.0950
66-GC 0.0000 0.0023 0.0047 0.0110 0.0469 0.0097 0.0126 0.0087 0.0469 1.3013 0.0019 0.0000 0.0081 0.0000 0.0185 0.0066 0.0061
67-GC 0.1404 0.2222 0.2424 0.2591 0.2807 0.2345 0.0359 0.0369 0.1404 0.1533 0.2314 0.2277 0.0254 0.1975 0.2807 0.2423 0.0232
68-GC 0.0000 0.0000 0.2902 0.4669 0.5315 0.2561 0.2149 0.4669 0.5315 0.8393 0.0135 0.0000 0.1941 0.0000 0.5315 0.2561 0.2149
69-GC 0.0000 0.0000 0.0000 0.0954 0.2262 0.0560 0.0819 0.0954 0.2262 1.4622 0.0007 0.0000 0.0653 0.0000 0.2262 0.0560 0.0819
70-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.0000 0.0108 0.0346 0.0912 0.1688 0.0578 0.0539 0.0804 0.1688 0.9328 0.0080 0.0000 0.0452 0.0000 0.1688 0.0578 0.0539
73-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
74-GC 0.0000 0.0000 0.0135 0.0759 0.1875 0.0448 0.0632 0.0759 0.1875 1.4089 0.0028 0.0000 0.0503 0.0000 0.1875 0.0448 0.0632
75-GC 0.0000 0.0300 0.0490 0.0768 0.2432 0.0678 0.0719 0.0468 0.2432 1.0608 0.0092 0.0000 0.0485 0.0000 0.0773 0.0407 0.0289
163
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2EN-CLEF2007
Statistics for Precision at the 100% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
54-GC 0.0000 0.0000 0.0131 0.0261 0.0378 0.0128 0.0139 0.0261 0.0378 1.0868 0.0006 0.0000 0.0118 0.0000 0.0378 0.0128 0.0139
55-GC 0.0000 0.0248 0.0731 0.1626 0.1975 0.0899 0.0708 0.1378 0.1975 0.7879 0.0209 0.0001 0.0620 0.0000 0.1975 0.0899 0.0708
56-GC 0.0000 0.0000 0.0000 0.0040 0.1739 0.0258 0.0599 0.0040 0.1739 2.3192 0.0001 0.0000 0.0412 0.0000 0.0000 0.0000 0.0000
57-GC 0.0000 0.0000 0.0210 0.0415 0.0489 0.0211 0.0213 0.0415 0.0489 1.0092 0.0008 0.0000 0.0195 0.0000 0.0489 0.0211 0.0213
58-GC 0.0000 0.0052 0.0151 0.0465 0.0923 0.0250 0.0271 0.0413 0.0923 1.0863 0.0040 0.0000 0.0210 0.0000 0.0923 0.0250 0.0271
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0000 0.0000 0.1327 0.4507 0.5455 0.2100 0.2334 0.4507 0.5455 1.1112 0.0052 0.0000 0.2112 0.0000 0.5455 0.2100 0.2334
61-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
62-GC 0.0000 0.0000 0.0042 0.0353 0.0588 0.0173 0.0215 0.0353 0.0588 1.2434 0.0007 0.0000 0.0191 0.0000 0.0588 0.0173 0.0215
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
66-GC 0.0000 0.0023 0.0047 0.0110 0.0469 0.0097 0.0126 0.0087 0.0469 1.3013 0.0019 0.0000 0.0081 0.0000 0.0185 0.0066 0.0061
67-GC 0.1371 0.1792 0.2237 0.2297 0.2537 0.2090 0.0341 0.0506 0.1166 0.1631 0.2061 0.2029 0.0279 0.1371 0.2537 0.2090 0.0341
68-GC 0.0000 0.0000 0.0000 0.0000 0.1918 0.0264 0.0651 0.0000 0.1918 2.4603 0.0000 0.0000 0.0448 0.0000 0.0000 0.0000 0.0000
69-GC 0.0000 0.0000 0.0000 0.0059 0.1061 0.0126 0.0301 0.0059 0.1061 2.3958 0.0001 0.0000 0.0193 0.0000 0.0000 0.0000 0.0000
70-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.0000 0.0000 0.0000 0.0306 0.0686 0.0168 0.0224 0.0306 0.0686 1.3338 0.0004 0.0000 0.0185 0.0000 0.0686 0.0168 0.0224
73-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
74-GC 0.0000 0.0000 0.0135 0.0759 0.1875 0.0448 0.0632 0.0759 0.1875 1.4089 0.0028 0.0000 0.0503 0.0000 0.1875 0.0448 0.0632
75-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
164
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2EN-CLEF2007
Statistics for P@5
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.2000 0.2000 0.4500 1.0000 0.3538 0.3178 0.2500 1.0000 0.8983 0.1373 0.0001 0.2438 0.0000 0.6000 0.2364 0.1502
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.2000 0.2000 0.4000 0.6000 0.8000 0.3846 0.2075 0.4000 0.6000 0.5396 0.3364 0.2971 0.1704 0.2000 0.8000 0.3846 0.2075
54-GC 0.0000 0.0000 0.2000 0.4000 0.6000 0.2154 0.2230 0.4000 0.6000 1.0355 0.0029 0.0000 0.2012 0.0000 0.6000 0.2154 0.2230
55-GC 0.0000 0.0000 0.4000 0.4000 0.8000 0.2769 0.2651 0.4000 0.8000 0.9572 0.0070 0.0000 0.2249 0.0000 0.8000 0.2769 0.2651
56-GC 0.0000 0.0000 0.0000 0.2500 0.4000 0.1077 0.1754 0.2500 0.4000 1.6288 0.0002 0.0000 0.1491 0.0000 0.4000 0.1077 0.1754
57-GC 0.0000 0.2000 0.2000 0.2500 0.4000 0.2154 0.1281 0.0500 0.4000 0.5948 0.0511 0.0001 0.0852 0.2000 0.2000 0.2000 0.0000
58-GC 0.0000 0.0000 0.0000 0.2000 0.2000 0.0769 0.1013 0.2000 0.2000 1.3166 0.0005 0.0000 0.0947 0.0000 0.2000 0.0769 0.1013
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.4000 0.9000 1.0000 1.0000 1.0000 0.8923 0.2100 0.1000 0.6000 0.2354 0.8615 0.8211 0.1657 1.0000 1.0000 1.0000 0.0000
61-GC 0.0000 0.0000 0.0000 0.2500 1.0000 0.1692 0.2926 0.2500 1.0000 1.7293 0.0006 0.0000 0.2083 0.0000 0.4000 0.1000 0.1595
62-GC 0.0000 0.0000 0.2000 0.2000 0.2000 0.1077 0.1038 0.2000 0.2000 0.9636 0.0021 0.0000 0.0994 0.0000 0.2000 0.1077 0.1038
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0000 0.2000 0.0308 0.0751 0.0000 0.2000 2.4410 0.0000 0.0000 0.0521 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0000 0.4000 0.6500 1.0000 0.4000 0.3559 0.6500 1.0000 0.8898 0.0181 0.0000 0.3077 0.0000 1.0000 0.4000 0.3559
66-GC 0.0000 0.0000 0.0000 0.2000 0.2000 0.0923 0.1038 0.2000 0.2000 1.1242 0.0010 0.0000 0.0994 0.0000 0.2000 0.0923 0.1038
67-GC 0.0000 0.4000 0.4000 0.6000 0.8000 0.4462 0.2184 0.2000 0.8000 0.4895 0.1987 0.0001 0.1562 0.2000 0.8000 0.4833 0.1801
68-GC 0.4000 0.8000 1.0000 1.0000 1.0000 0.8923 0.1754 0.2000 0.6000 0.1966 0.8701 0.8387 0.1325 0.8000 1.0000 0.9333 0.0985
69-GC 0.0000 0.0000 0.2000 0.4000 0.6000 0.2462 0.2025 0.4000 0.6000 0.8229 0.0135 0.0000 0.1728 0.0000 0.6000 0.2462 0.2025
70-GC 0.0000 0.0000 0.2000 0.8000 0.8000 0.3538 0.3755 0.8000 0.8000 1.0613 0.0038 0.0000 0.3503 0.0000 0.8000 0.3538 0.3755
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.4000 0.4000 0.6000 0.6500 0.8000 0.5846 0.1519 0.2500 0.4000 0.2598 0.5660 0.5474 0.1136 0.4000 0.8000 0.5846 0.1519
73-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
74-GC 0.0000 0.0000 0.2000 0.4000 0.4000 0.1692 0.1797 0.4000 0.4000 1.0621 0.0026 0.0000 0.1562 0.0000 0.4000 0.1692 0.1797
75-GC 0.4000 0.6000 0.8000 0.8500 1.0000 0.7538 0.1854 0.2500 0.6000 0.2459 0.7309 0.7059 0.1491 0.4000 1.0000 0.7538 0.1854
165
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2EN-CLEF2007
Statistics for P@10
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.1750 0.3000 0.5250 1.0000 0.3769 0.3219 0.3500 1.0000 0.8539 0.1409 0.0001 0.2485 0.0000 1.0000 0.3769 0.3219
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.1000 0.2750 0.3000 0.4000 0.6000 0.3154 0.1214 0.1250 0.5000 0.3850 0.2920 0.2644 0.0828 0.1000 0.4000 0.2917 0.0900
54-GC 0.0000 0.0000 0.1000 0.3000 0.4000 0.1385 0.1502 0.3000 0.4000 1.0849 0.0023 0.0000 0.1337 0.0000 0.4000 0.1385 0.1502
55-GC 0.0000 0.0750 0.3000 0.4000 0.5000 0.2462 0.1808 0.3250 0.5000 0.7345 0.0271 0.0000 0.1503 0.0000 0.5000 0.2462 0.1808
56-GC 0.0000 0.0000 0.0000 0.2250 0.5000 0.1154 0.1951 0.2250 0.5000 1.6912 0.0003 0.0000 0.1598 0.0000 0.5000 0.1154 0.1951
57-GC 0.0000 0.2000 0.2000 0.3000 0.3000 0.2000 0.1000 0.1000 0.3000 0.5000 0.0494 0.0001 0.0615 0.2000 0.3000 0.2364 0.0505
58-GC 0.0000 0.0000 0.1000 0.1250 0.2000 0.0923 0.0760 0.1250 0.2000 0.8229 0.0069 0.0000 0.0568 0.0000 0.2000 0.0923 0.0760
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.3000 0.5750 0.9000 0.9250 1.0000 0.7846 0.2444 0.3500 0.7000 0.3115 0.7376 0.6783 0.2059 0.3000 1.0000 0.7846 0.2444
61-GC 0.0000 0.0000 0.0000 0.1250 0.8000 0.1077 0.2216 0.1250 0.8000 2.0576 0.0005 0.0000 0.1349 0.0000 0.2000 0.0500 0.0798
62-GC 0.0000 0.0000 0.1000 0.1000 0.1000 0.0615 0.0506 0.1000 0.1000 0.8229 0.0029 0.0000 0.0473 0.0000 0.1000 0.0615 0.0506
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0250 0.3000 0.0538 0.1127 0.0250 0.3000 2.0923 0.0001 0.0000 0.0828 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0750 0.2000 0.6500 0.9000 0.3615 0.3380 0.5750 0.9000 0.9348 0.0317 0.0000 0.2970 0.0000 0.9000 0.3615 0.3380
66-GC 0.0000 0.0000 0.0000 0.1000 0.1000 0.0462 0.0519 0.1000 0.1000 1.1242 0.0007 0.0000 0.0497 0.0000 0.1000 0.0462 0.0519
67-GC 0.1000 0.2750 0.4000 0.5000 0.6000 0.3692 0.1494 0.2250 0.5000 0.4045 0.3342 0.2910 0.1254 0.1000 0.6000 0.3692 0.1494
68-GC 0.3000 0.8000 0.8000 0.9000 1.0000 0.8077 0.1706 0.1000 0.7000 0.2112 0.7816 0.7400 0.1006 0.7000 1.0000 0.8500 0.0798
69-GC 0.0000 0.0750 0.3000 0.4000 0.5000 0.2385 0.1850 0.3250 0.5000 0.7759 0.0257 0.0000 0.1586 0.0000 0.5000 0.2385 0.1850
70-GC 0.0000 0.0000 0.1000 0.6250 0.7000 0.2923 0.3148 0.6250 0.7000 1.0770 0.0065 0.0000 0.2840 0.0000 0.7000 0.2923 0.3148
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.2000 0.3750 0.5000 0.6250 0.7000 0.5000 0.1780 0.2500 0.5000 0.3559 0.4626 0.4178 0.1385 0.2000 0.7000 0.5000 0.1780
73-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
74-GC 0.0000 0.0000 0.1000 0.2000 0.2000 0.1077 0.0954 0.2000 0.2000 0.8859 0.0040 0.0000 0.0852 0.0000 0.2000 0.1077 0.0954
75-GC 0.4000 0.5000 0.6000 0.6250 0.9000 0.5846 0.1463 0.1250 0.5000 0.2503 0.5689 0.5542 0.1089 0.4000 0.8000 0.5583 0.1165
166
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2EN-CLEF2007
Statistics for P@15
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0667 0.1667 0.3333 0.4833 0.9333 0.3795 0.2885 0.3167 0.8667 0.7603 0.2739 0.1814 0.2138 0.0667 0.9333 0.3795 0.2885
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.1333 0.2000 0.2667 0.4000 0.6000 0.3077 0.1454 0.2000 0.4667 0.4725 0.2774 0.2498 0.1160 0.1333 0.6000 0.3077 0.1454
54-GC 0.0000 0.0000 0.0667 0.2000 0.2667 0.0974 0.1075 0.2000 0.2667 1.1038 0.0019 0.0000 0.0947 0.0000 0.2667 0.0974 0.1075
55-GC 0.0000 0.1167 0.2000 0.3333 0.4000 0.2103 0.1301 0.2167 0.4000 0.6187 0.0482 0.0001 0.1034 0.0000 0.4000 0.2103 0.1301
56-GC 0.0000 0.0000 0.0000 0.2167 0.4000 0.0974 0.1481 0.2167 0.4000 1.5201 0.0005 0.0000 0.1247 0.0000 0.4000 0.0974 0.1481
57-GC 0.0000 0.1333 0.2000 0.2667 0.2667 0.1692 0.0928 0.1333 0.2667 0.5481 0.0420 0.0001 0.0742 0.0000 0.2667 0.1692 0.0928
58-GC 0.0000 0.0500 0.0667 0.1333 0.1333 0.0718 0.0506 0.0833 0.1333 0.7053 0.0108 0.0000 0.0379 0.0000 0.1333 0.0718 0.0506
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.2000 0.4000 0.8000 0.8667 0.9333 0.6821 0.2497 0.4667 0.7333 0.3661 0.6229 0.5466 0.2146 0.2000 0.9333 0.6821 0.2497
61-GC 0.0000 0.0000 0.0000 0.0833 0.6667 0.0872 0.1813 0.0833 0.6667 2.0799 0.0008 0.0000 0.1034 0.0000 0.1333 0.0389 0.0529
62-GC 0.0000 0.0000 0.0667 0.0667 0.0667 0.0462 0.0320 0.0667 0.0667 0.6939 0.0044 0.0000 0.0284 0.0000 0.0667 0.0462 0.0320
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0167 0.2667 0.0462 0.0996 0.0167 0.2667 2.1574 0.0001 0.0000 0.0710 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0500 0.2000 0.6833 0.8667 0.3487 0.3368 0.6333 0.8667 0.9659 0.0289 0.0000 0.3037 0.0000 0.8667 0.3487 0.3368
66-GC 0.0000 0.0000 0.0667 0.0667 0.0667 0.0462 0.0320 0.0667 0.0667 0.6939 0.0044 0.0000 0.0284 0.0000 0.0667 0.0462 0.0320
67-GC 0.2000 0.2667 0.3333 0.4000 0.4667 0.3282 0.0921 0.1333 0.2667 0.2807 0.3160 0.3038 0.0773 0.2000 0.4667 0.3282 0.0921
68-GC 0.2667 0.6000 0.7333 0.8667 1.0000 0.7128 0.1913 0.2667 0.7333 0.2683 0.6823 0.6412 0.1452 0.2667 1.0000 0.7128 0.1913
69-GC 0.0000 0.1000 0.2667 0.3333 0.4667 0.2308 0.1530 0.2333 0.4667 0.6631 0.0268 0.0000 0.1262 0.0000 0.4667 0.2308 0.1530
70-GC 0.0000 0.0000 0.0667 0.4833 0.6667 0.2359 0.2591 0.4833 0.6667 1.0983 0.0056 0.0000 0.2335 0.0000 0.6667 0.2359 0.2591
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.2667 0.3167 0.4667 0.6000 0.6000 0.4410 0.1375 0.2833 0.3333 0.3119 0.4201 0.3990 0.1199 0.2667 0.6000 0.4410 0.1375
73-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
74-GC 0.0000 0.0000 0.0667 0.1333 0.1333 0.0718 0.0636 0.1333 0.1333 0.8859 0.0031 0.0000 0.0568 0.0000 0.1333 0.0718 0.0636
75-GC 0.4000 0.4667 0.4667 0.6167 0.8000 0.5231 0.1212 0.1500 0.4000 0.2318 0.5116 0.5016 0.0986 0.4000 0.8000 0.5231 0.1212
167
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2EN-CLEF2007
Statistics for P@20
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0500 0.1750 0.3500 0.5125 0.9000 0.3846 0.2802 0.3375 0.8500 0.7284 0.2842 0.1930 0.2219 0.0500 0.9000 0.3846 0.2802
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.1500 0.2000 0.2500 0.3750 0.5500 0.2962 0.1298 0.1750 0.4000 0.4384 0.2725 0.2521 0.1030 0.1500 0.5500 0.2962 0.1298
54-GC 0.0000 0.0000 0.0500 0.1500 0.2000 0.0808 0.0855 0.1500 0.2000 1.0584 0.0017 0.0000 0.0793 0.0000 0.2000 0.0808 0.0855
55-GC 0.0000 0.1500 0.2500 0.3000 0.3500 0.2154 0.1162 0.1500 0.3500 0.5393 0.0516 0.0001 0.0911 0.0000 0.3500 0.2154 0.1162
56-GC 0.0000 0.0000 0.0000 0.1625 0.3000 0.0846 0.1197 0.1625 0.3000 1.4146 0.0005 0.0000 0.1041 0.0000 0.3000 0.0846 0.1197
57-GC 0.0000 0.1000 0.1500 0.2500 0.3000 0.1462 0.0946 0.1500 0.3000 0.6470 0.0358 0.0001 0.0734 0.0000 0.3000 0.1462 0.0946
58-GC 0.0000 0.0500 0.0500 0.1000 0.1000 0.0654 0.0376 0.0500 0.1000 0.5743 0.0186 0.0001 0.0320 0.0000 0.1000 0.0654 0.0376
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.2000 0.4625 0.7500 0.8000 0.8000 0.6269 0.2223 0.3375 0.6000 0.3546 0.5744 0.5056 0.1858 0.2000 0.8000 0.6269 0.2223
61-GC 0.0000 0.0000 0.0500 0.1500 0.7000 0.1038 0.1898 0.1500 0.7000 1.8277 0.0016 0.0000 0.1130 0.0000 0.1500 0.0542 0.0656
62-GC 0.0000 0.0000 0.0500 0.0500 0.1000 0.0385 0.0300 0.0500 0.1000 0.7789 0.0038 0.0000 0.0237 0.0000 0.1000 0.0385 0.0300
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0500 0.2000 0.0385 0.0740 0.0500 0.2000 1.9248 0.0002 0.0000 0.0533 0.0000 0.0500 0.0091 0.0202
65-GC 0.0000 0.0500 0.2500 0.6625 0.8000 0.3385 0.3110 0.6125 0.8000 0.9189 0.1012 0.0001 0.2781 0.0000 0.8000 0.3385 0.3110
66-GC 0.0000 0.0000 0.0500 0.0500 0.0500 0.0346 0.0240 0.0500 0.0500 0.6939 0.0036 0.0000 0.0213 0.0000 0.0500 0.0346 0.0240
67-GC 0.1500 0.2500 0.3500 0.4000 0.4500 0.3231 0.1013 0.1500 0.3000 0.3135 0.3067 0.2891 0.0905 0.1500 0.4500 0.3231 0.1013
68-GC 0.2500 0.6000 0.7500 0.8625 1.0000 0.7038 0.2106 0.2625 0.7500 0.2992 0.6665 0.6177 0.1728 0.2500 1.0000 0.7038 0.2106
69-GC 0.0000 0.1625 0.3000 0.3500 0.3500 0.2385 0.1372 0.1875 0.3500 0.5752 0.0533 0.0001 0.1142 0.0000 0.3500 0.2385 0.1372
70-GC 0.0000 0.0000 0.0500 0.4125 0.5000 0.1962 0.2086 0.4125 0.5000 1.0636 0.0093 0.0000 0.1882 0.0000 0.5000 0.1962 0.2086
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.2500 0.3000 0.4500 0.5000 0.5000 0.4077 0.0909 0.2000 0.2500 0.2230 0.3973 0.3861 0.0763 0.2500 0.5000 0.4077 0.0909
73-GC 0.0000 0.0000 0.0000 0.0000 0.0500 0.0038 0.0139 0.0000 0.0500 3.6056 0.0000 0.0000 0.0071 0.0000 0.0000 0.0000 0.0000
74-GC 0.0000 0.0000 0.0500 0.1000 0.1500 0.0577 0.0534 0.1000 0.1500 0.9258 0.0027 0.0000 0.0467 0.0000 0.1500 0.0577 0.0534
75-GC 0.3500 0.3875 0.4500 0.5750 0.7000 0.4769 0.1218 0.1875 0.3500 0.2554 0.4636 0.4516 0.0988 0.3500 0.7000 0.4769 0.1218
168
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2EN-CLEF2007
Statistics for P@30
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0333 0.1917 0.3667 0.5500 0.9333 0.4051 0.2905 0.3583 0.9000 0.7172 0.2960 0.1798 0.2312 0.0333 0.9333 0.4051 0.2905
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.1333 0.1917 0.2333 0.2917 0.4333 0.2513 0.0888 0.1000 0.3000 0.3535 0.2378 0.2256 0.0682 0.1333 0.4333 0.2513 0.0888
54-GC 0.0000 0.0000 0.0333 0.1000 0.1333 0.0538 0.0570 0.1000 0.1333 1.0584 0.0014 0.0000 0.0529 0.0000 0.1333 0.0538 0.0570
55-GC 0.0000 0.1583 0.2000 0.2333 0.2667 0.1769 0.0865 0.0750 0.2667 0.4888 0.0446 0.0001 0.0643 0.1333 0.2667 0.2091 0.0397
56-GC 0.0000 0.0000 0.0333 0.1333 0.2333 0.0692 0.0887 0.1333 0.2333 1.2809 0.0014 0.0000 0.0750 0.0000 0.2333 0.0692 0.0887
57-GC 0.0000 0.1000 0.1333 0.1750 0.2333 0.1308 0.0751 0.0750 0.2333 0.5743 0.0335 0.0001 0.0592 0.0000 0.2333 0.1308 0.0751
58-GC 0.0333 0.0333 0.0667 0.0667 0.1000 0.0564 0.0210 0.0333 0.0667 0.3725 0.0527 0.0491 0.0178 0.0333 0.1000 0.0564 0.0210
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.1333 0.4250 0.7000 0.7167 0.8000 0.5821 0.2356 0.2917 0.6667 0.4047 0.5112 0.4128 0.1941 0.1333 0.8000 0.5821 0.2356
61-GC 0.0000 0.0000 0.0333 0.1000 0.5333 0.0795 0.1424 0.1000 0.5333 1.7918 0.0026 0.0000 0.0793 0.0000 0.1000 0.0417 0.0429
62-GC 0.0000 0.0333 0.0333 0.0333 0.0667 0.0333 0.0192 0.0000 0.0667 0.5774 0.0106 0.0001 0.0103 0.0333 0.0333 0.0333 0.0000
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0417 0.1667 0.0333 0.0624 0.0417 0.1667 1.8708 0.0002 0.0000 0.0462 0.0000 0.0667 0.0091 0.0216
65-GC 0.0333 0.0917 0.2667 0.6417 0.6667 0.3436 0.2678 0.5500 0.6333 0.7795 0.2267 0.1341 0.2383 0.0333 0.6667 0.3436 0.2678
66-GC 0.0000 0.0000 0.0333 0.0667 0.0667 0.0333 0.0272 0.0667 0.0667 0.8165 0.0034 0.0000 0.0205 0.0000 0.0667 0.0333 0.0272
67-GC 0.1667 0.2667 0.3000 0.3500 0.4000 0.3051 0.0705 0.0833 0.2333 0.2311 0.2970 0.2881 0.0568 0.1667 0.4000 0.3051 0.0705
68-GC 0.3000 0.5917 0.7000 0.8333 0.9000 0.6821 0.1980 0.2417 0.6000 0.2902 0.6484 0.6068 0.1578 0.3000 0.9000 0.6821 0.1980
69-GC 0.0000 0.1083 0.2667 0.3083 0.3667 0.2154 0.1331 0.2000 0.3667 0.6178 0.0472 0.0001 0.1144 0.0000 0.3667 0.2154 0.1331
70-GC 0.0000 0.0000 0.0667 0.3333 0.3667 0.1564 0.1554 0.3333 0.3667 0.9935 0.0085 0.0000 0.1428 0.0000 0.3667 0.1564 0.1554
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.2000 0.2667 0.3333 0.3667 0.4000 0.3154 0.0555 0.1000 0.2000 0.1759 0.3105 0.3052 0.0450 0.2000 0.4000 0.3154 0.0555
73-GC 0.0000 0.0000 0.0000 0.0000 0.0333 0.0026 0.0092 0.0000 0.0333 3.6056 0.0000 0.0000 0.0047 0.0000 0.0000 0.0000 0.0000
74-GC 0.0000 0.0000 0.0667 0.0750 0.1000 0.0462 0.0420 0.0750 0.1000 0.9106 0.0023 0.0000 0.0375 0.0000 0.1000 0.0462 0.0420
75-GC 0.3000 0.3333 0.4000 0.4500 0.5000 0.3974 0.0739 0.1167 0.2000 0.1859 0.3911 0.3848 0.0596 0.3000 0.5000 0.3974 0.0739
169
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2EN-CLEF2007
Statistics for P@100
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0200 0.2250 0.3000 0.5600 0.6700 0.3592 0.2114 0.3350 0.6500 0.5885 0.2726 0.1418 0.1746 0.0200 0.6700 0.3592 0.2114
52-GC 0.0000 0.0000 0.0000 0.0025 0.0200 0.0031 0.0063 0.0025 0.0200 2.0489 0.0001 0.0000 0.0047 0.0000 0.0000 0.0000 0.0000
53-GC 0.1000 0.1250 0.1500 0.2325 0.2500 0.1669 0.0560 0.1075 0.1500 0.3357 0.1585 0.1506 0.0485 0.1000 0.2500 0.1669 0.0560
54-GC 0.0000 0.0000 0.0300 0.0400 0.0400 0.0254 0.0181 0.0400 0.0400 0.7123 0.0029 0.0000 0.0156 0.0000 0.0400 0.0254 0.0181
55-GC 0.0000 0.1075 0.1300 0.1600 0.1600 0.1162 0.0552 0.0525 0.1600 0.4749 0.0314 0.0001 0.0392 0.1000 0.1600 0.1373 0.0215
56-GC 0.0000 0.0000 0.0200 0.0550 0.0800 0.0277 0.0324 0.0550 0.0800 1.1716 0.0009 0.0000 0.0279 0.0000 0.0800 0.0277 0.0324
57-GC 0.0000 0.0550 0.0800 0.0925 0.1100 0.0669 0.0361 0.0375 0.1100 0.5401 0.0192 0.0001 0.0279 0.0000 0.1100 0.0669 0.0361
58-GC 0.0200 0.0200 0.0400 0.0500 0.0600 0.0354 0.0145 0.0300 0.0400 0.4098 0.0326 0.0299 0.0127 0.0200 0.0600 0.0354 0.0145
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0600 0.2125 0.2800 0.3000 0.3000 0.2392 0.0900 0.0875 0.2400 0.3760 0.2133 0.1759 0.0704 0.1300 0.3000 0.2709 0.0503
61-GC 0.0000 0.0200 0.0400 0.0525 0.2000 0.0446 0.0506 0.0325 0.2000 1.1341 0.0114 0.0001 0.0295 0.0000 0.0600 0.0317 0.0204
62-GC 0.0000 0.0100 0.0100 0.0300 0.0400 0.0185 0.0141 0.0200 0.0400 0.7611 0.0058 0.0001 0.0122 0.0000 0.0400 0.0185 0.0141
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0100 0.0275 0.1300 0.0292 0.0466 0.0275 0.1300 1.5952 0.0021 0.0000 0.0342 0.0000 0.0500 0.0109 0.0145
65-GC 0.0500 0.1000 0.3300 0.3675 0.4100 0.2546 0.1417 0.2675 0.3600 0.5565 0.2033 0.1493 0.1266 0.0500 0.4100 0.2546 0.1417
66-GC 0.0000 0.0100 0.0200 0.0200 0.0300 0.0162 0.0077 0.0100 0.0300 0.4754 0.0093 0.0001 0.0063 0.0000 0.0300 0.0162 0.0077
67-GC 0.1500 0.1675 0.1700 0.1700 0.1700 0.1669 0.0063 0.0025 0.0200 0.0378 0.1668 0.1667 0.0047 0.1700 0.1700 0.1700 0.0000
68-GC 0.2300 0.5625 0.6300 0.7525 0.8100 0.6046 0.1738 0.1900 0.5800 0.2875 0.5738 0.5333 0.1267 0.3400 0.8100 0.6358 0.1383
69-GC 0.0000 0.0775 0.1200 0.1700 0.2000 0.1123 0.0691 0.0925 0.2000 0.6149 0.0265 0.0001 0.0541 0.0000 0.2000 0.1123 0.0691
70-GC 0.0000 0.0075 0.0300 0.1425 0.1700 0.0708 0.0693 0.1350 0.1700 0.9798 0.0083 0.0000 0.0639 0.0000 0.1700 0.0708 0.0693
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.0900 0.1100 0.1200 0.1200 0.1300 0.1154 0.0105 0.0100 0.0400 0.0910 0.1149 0.1144 0.0079 0.1000 0.1300 0.1175 0.0075
73-GC 0.0000 0.0000 0.0000 0.0125 0.0200 0.0062 0.0087 0.0125 0.0200 1.4133 0.0002 0.0000 0.0076 0.0000 0.0200 0.0062 0.0087
74-GC 0.0000 0.0100 0.0200 0.0300 0.0300 0.0185 0.0107 0.0200 0.0300 0.5786 0.0063 0.0001 0.0083 0.0000 0.0300 0.0185 0.0107
75-GC 0.1200 0.1375 0.1600 0.1700 0.1800 0.1554 0.0198 0.0325 0.0600 0.1277 0.1542 0.1529 0.0164 0.1200 0.1800 0.1554 0.0198
170
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2EN-CLEF2007
Statistics for P@200
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0250 0.1613 0.2500 0.4062 0.4600 0.2631 0.1436 0.2450 0.4350 0.5459 0.2104 0.1362 0.1172 0.0250 0.4600 0.2631 0.1436
52-GC 0.0000 0.0000 0.0050 0.0100 0.0150 0.0054 0.0048 0.0100 0.0150 0.8859 0.0009 0.0000 0.0036 0.0000 0.0150 0.0054 0.0048
53-GC 0.0600 0.0975 0.1050 0.1475 0.1700 0.1142 0.0347 0.0500 0.1100 0.3037 0.1090 0.1033 0.0275 0.0600 0.1700 0.1142 0.0347
54-GC 0.0000 0.0000 0.0200 0.0263 0.0350 0.0173 0.0128 0.0263 0.0350 0.7423 0.0022 0.0000 0.0107 0.0000 0.0350 0.0173 0.0128
55-GC 0.0000 0.0675 0.0750 0.0800 0.0800 0.0635 0.0288 0.0125 0.0800 0.4542 0.0189 0.0001 0.0201 0.0600 0.0800 0.0750 0.0067
56-GC 0.0000 0.0000 0.0150 0.0312 0.0400 0.0154 0.0166 0.0312 0.0400 1.0817 0.0007 0.0000 0.0143 0.0000 0.0400 0.0154 0.0166
57-GC 0.0000 0.0387 0.0500 0.0612 0.0650 0.0442 0.0221 0.0225 0.0650 0.4989 0.0138 0.0001 0.0163 0.0350 0.0650 0.0523 0.0110
58-GC 0.0100 0.0100 0.0250 0.0300 0.0300 0.0208 0.0086 0.0200 0.0200 0.4152 0.0189 0.0169 0.0076 0.0100 0.0300 0.0208 0.0086
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0450 0.1213 0.1400 0.1500 0.1500 0.1250 0.0372 0.0288 0.1050 0.2980 0.1176 0.1075 0.0292 0.0800 0.1500 0.1382 0.0203
61-GC 0.0000 0.0187 0.0250 0.0300 0.1000 0.0296 0.0242 0.0113 0.1000 0.8169 0.0149 0.0001 0.0156 0.0150 0.0450 0.0259 0.0102
62-GC 0.0000 0.0050 0.0150 0.0200 0.0200 0.0127 0.0078 0.0150 0.0200 0.6148 0.0045 0.0001 0.0067 0.0000 0.0200 0.0127 0.0078
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0050 0.0100 0.0150 0.0250 0.0750 0.0235 0.0238 0.0150 0.0700 1.0123 0.0163 0.0123 0.0163 0.0050 0.0250 0.0141 0.0070
65-GC 0.0650 0.0938 0.2450 0.3000 0.3500 0.2127 0.1067 0.2062 0.2850 0.5019 0.1811 0.1480 0.0936 0.0650 0.3500 0.2127 0.1067
66-GC 0.0000 0.0050 0.0100 0.0112 0.0150 0.0092 0.0045 0.0062 0.0150 0.4868 0.0055 0.0001 0.0034 0.0000 0.0150 0.0092 0.0045
67-GC 0.0850 0.0850 0.0850 0.0850 0.0850 0.0850 0.0000 0.0000 0.0000 0.0000 0.0850 0.0850 0.0000 0.0850 0.0850 0.0850 0.0000
68-GC 0.3000 0.4063 0.4700 0.5413 0.5600 0.4612 0.0869 0.1350 0.2600 0.1885 0.4528 0.4438 0.0711 0.3000 0.5600 0.4612 0.0869
69-GC 0.0000 0.0388 0.0650 0.0913 0.1050 0.0612 0.0373 0.0525 0.1050 0.6092 0.0252 0.0001 0.0301 0.0000 0.1050 0.0612 0.0373
70-GC 0.0000 0.0087 0.0300 0.0863 0.0950 0.0450 0.0387 0.0775 0.0950 0.8595 0.0103 0.0001 0.0354 0.0000 0.0950 0.0450 0.0387
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.0500 0.0600 0.0600 0.0650 0.0650 0.0615 0.0043 0.0050 0.0150 0.0695 0.0614 0.0612 0.0032 0.0600 0.0650 0.0625 0.0026
73-GC 0.0000 0.0000 0.0000 0.0062 0.0150 0.0035 0.0052 0.0062 0.0150 1.4900 0.0001 0.0000 0.0043 0.0000 0.0150 0.0035 0.0052
74-GC 0.0000 0.0087 0.0100 0.0150 0.0150 0.0104 0.0056 0.0062 0.0150 0.5369 0.0039 0.0001 0.0043 0.0000 0.0150 0.0104 0.0056
75-GC 0.0650 0.0787 0.0850 0.0850 0.0950 0.0812 0.0087 0.0063 0.0300 0.1072 0.0807 0.0802 0.0064 0.0750 0.0900 0.0830 0.0042
171
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2EN-CLEF2007
Statistics for P@500
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0300 0.1140 0.1500 0.1925 0.2100 0.1503 0.0537 0.0785 0.1800 0.3572 0.1365 0.1142 0.0425 0.0300 0.2100 0.1503 0.0537
52-GC 0.0020 0.0040 0.0060 0.0065 0.0080 0.0055 0.0019 0.0025 0.0060 0.3347 0.0052 0.0048 0.0015 0.0020 0.0080 0.0055 0.0019
53-GC 0.0500 0.0500 0.0740 0.0820 0.0920 0.0692 0.0161 0.0320 0.0420 0.2319 0.0674 0.0656 0.0142 0.0500 0.0920 0.0692 0.0161
54-GC 0.0000 0.0020 0.0120 0.0140 0.0140 0.0091 0.0058 0.0120 0.0140 0.6400 0.0032 0.0001 0.0050 0.0000 0.0140 0.0091 0.0058
55-GC 0.0000 0.0275 0.0320 0.0320 0.0320 0.0263 0.0118 0.0045 0.0320 0.4496 0.0090 0.0001 0.0081 0.0260 0.0320 0.0311 0.0021
56-GC 0.0000 0.0000 0.0100 0.0145 0.0160 0.0074 0.0071 0.0145 0.0160 0.9600 0.0007 0.0000 0.0065 0.0000 0.0160 0.0074 0.0071
57-GC 0.0000 0.0215 0.0280 0.0300 0.0300 0.0229 0.0108 0.0085 0.0300 0.4707 0.0080 0.0001 0.0078 0.0200 0.0300 0.0271 0.0039
58-GC 0.0060 0.0075 0.0120 0.0120 0.0120 0.0102 0.0026 0.0045 0.0060 0.2601 0.0098 0.0093 0.0023 0.0060 0.0120 0.0102 0.0026
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0300 0.0520 0.0600 0.0600 0.0600 0.0537 0.0105 0.0080 0.0300 0.1947 0.0525 0.0510 0.0079 0.0460 0.0600 0.0576 0.0044
61-GC 0.0080 0.0120 0.0160 0.0225 0.0400 0.0191 0.0091 0.0105 0.0320 0.4778 0.0173 0.0159 0.0069 0.0080 0.0300 0.0173 0.0069
62-GC 0.0000 0.0040 0.0060 0.0080 0.0080 0.0057 0.0029 0.0040 0.0080 0.5141 0.0024 0.0001 0.0023 0.0000 0.0080 0.0057 0.0029
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0060 0.0080 0.0120 0.0185 0.0320 0.0152 0.0085 0.0105 0.0260 0.5585 0.0134 0.0119 0.0064 0.0060 0.0320 0.0152 0.0085
65-GC 0.0460 0.0875 0.1440 0.1565 0.1760 0.1231 0.0463 0.0690 0.1300 0.3758 0.1127 0.1003 0.0402 0.0460 0.1760 0.1231 0.0463
66-GC 0.0000 0.0020 0.0040 0.0060 0.0060 0.0042 0.0021 0.0040 0.0060 0.4997 0.0026 0.0001 0.0017 0.0000 0.0060 0.0042 0.0021
67-GC 0.0340 0.0340 0.0340 0.0340 0.0340 0.0340 0.0000 0.0000 0.0000 0.0000 0.0340 0.0340 0.0000 0.0340 0.0340 0.0340 0.0000
68-GC 0.1880 0.1900 0.2480 0.2560 0.2600 0.2277 0.0319 0.0660 0.0720 0.1401 0.2256 0.2234 0.0296 0.1880 0.2600 0.2277 0.0319
69-GC 0.0040 0.0230 0.0320 0.0400 0.0420 0.0295 0.0121 0.0170 0.0380 0.4111 0.0256 0.0190 0.0098 0.0040 0.0420 0.0295 0.0121
70-GC 0.0000 0.0100 0.0260 0.0410 0.0500 0.0258 0.0179 0.0310 0.0500 0.6910 0.0078 0.0001 0.0156 0.0000 0.0500 0.0258 0.0179
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.0240 0.0240 0.0260 0.0280 0.0280 0.0262 0.0017 0.0040 0.0040 0.0659 0.0261 0.0260 0.0014 0.0240 0.0280 0.0262 0.0017
73-GC 0.0000 0.0000 0.0020 0.0045 0.0120 0.0032 0.0034 0.0045 0.0120 1.0584 0.0006 0.0000 0.0026 0.0000 0.0060 0.0025 0.0023
74-GC 0.0000 0.0040 0.0060 0.0060 0.0060 0.0046 0.0022 0.0020 0.0060 0.4807 0.0020 0.0001 0.0017 0.0040 0.0060 0.0055 0.0009
75-GC 0.0340 0.0355 0.0360 0.0365 0.0380 0.0360 0.0014 0.0010 0.0040 0.0393 0.0360 0.0359 0.0009 0.0340 0.0360 0.0354 0.0010
172
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2EN-CLEF2007
Statistics for P@1000
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0190 0.0852 0.0920 0.1083 0.1100 0.0899 0.0248 0.0230 0.0910 0.2753 0.0839 0.0721 0.0164 0.0720 0.1100 0.0958 0.0132
52-GC 0.0020 0.0020 0.0030 0.0040 0.0060 0.0032 0.0011 0.0020 0.0040 0.3626 0.0030 0.0028 0.0008 0.0020 0.0060 0.0032 0.0011
53-GC 0.0320 0.0388 0.0470 0.0512 0.0580 0.0449 0.0082 0.0125 0.0260 0.1821 0.0442 0.0434 0.0069 0.0320 0.0580 0.0449 0.0082
54-GC 0.0000 0.0020 0.0070 0.0070 0.0070 0.0049 0.0028 0.0050 0.0070 0.5773 0.0020 0.0001 0.0024 0.0000 0.0070 0.0049 0.0028
55-GC 0.0000 0.0160 0.0160 0.0160 0.0160 0.0135 0.0060 0.0000 0.0160 0.4438 0.0051 0.0001 0.0042 0.0160 0.0160 0.0160 0.0000
56-GC 0.0000 0.0000 0.0050 0.0073 0.0080 0.0038 0.0035 0.0073 0.0080 0.9183 0.0007 0.0000 0.0032 0.0000 0.0080 0.0038 0.0035
57-GC 0.0000 0.0120 0.0150 0.0150 0.0150 0.0119 0.0054 0.0030 0.0150 0.4548 0.0046 0.0001 0.0037 0.0120 0.0150 0.0141 0.0013
58-GC 0.0040 0.0058 0.0060 0.0060 0.0060 0.0057 0.0006 0.0003 0.0020 0.1108 0.0057 0.0056 0.0005 0.0060 0.0060 0.0060 0.0000
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.0210 0.0270 0.0300 0.0300 0.0300 0.0281 0.0031 0.0030 0.0090 0.1121 0.0279 0.0277 0.0024 0.0270 0.0300 0.0293 0.0013
61-GC 0.0090 0.0100 0.0130 0.0163 0.0210 0.0135 0.0038 0.0063 0.0120 0.2774 0.0131 0.0126 0.0032 0.0090 0.0210 0.0135 0.0038
62-GC 0.0000 0.0028 0.0040 0.0040 0.0040 0.0030 0.0015 0.0013 0.0040 0.4907 0.0014 0.0001 0.0011 0.0020 0.0040 0.0035 0.0007
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0030 0.0073 0.0090 0.0133 0.0160 0.0099 0.0041 0.0060 0.0130 0.4164 0.0090 0.0079 0.0033 0.0030 0.0160 0.0099 0.0041
65-GC 0.0380 0.0513 0.0800 0.0890 0.0900 0.0721 0.0203 0.0378 0.0520 0.2821 0.0689 0.0652 0.0173 0.0380 0.0900 0.0721 0.0203
66-GC 0.0010 0.0028 0.0030 0.0030 0.0030 0.0027 0.0006 0.0002 0.0020 0.2342 0.0026 0.0024 0.0005 0.0030 0.0030 0.0030 0.0000
67-GC 0.0170 0.0170 0.0170 0.0170 0.0170 0.0170 0.0000 0.0000 0.0000 0.0000 0.0170 0.0170 0.0000 0.0170 0.0170 0.0170 0.0000
68-GC 0.1050 0.1092 0.1280 0.1300 0.1310 0.1215 0.0105 0.0207 0.0260 0.0863 0.1211 0.1207 0.0090 0.1050 0.1310 0.1215 0.0105
69-GC 0.0060 0.0125 0.0160 0.0202 0.0210 0.0160 0.0050 0.0077 0.0150 0.3135 0.0151 0.0140 0.0042 0.0060 0.0210 0.0160 0.0050
70-GC 0.0000 0.0087 0.0140 0.0250 0.0260 0.0153 0.0095 0.0163 0.0260 0.6228 0.0053 0.0001 0.0082 0.0000 0.0260 0.0153 0.0095
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.0120 0.0128 0.0130 0.0140 0.0140 0.0132 0.0008 0.0013 0.0020 0.0629 0.0132 0.0132 0.0007 0.0120 0.0140 0.0132 0.0008
73-GC 0.0000 0.0008 0.0020 0.0045 0.0060 0.0026 0.0023 0.0038 0.0060 0.8626 0.0008 0.0000 0.0018 0.0000 0.0060 0.0026 0.0023
74-GC 0.0000 0.0020 0.0030 0.0030 0.0030 0.0024 0.0011 0.0010 0.0030 0.4701 0.0012 0.0001 0.0009 0.0020 0.0030 0.0028 0.0004
75-GC 0.0170 0.0177 0.0180 0.0190 0.0190 0.0182 0.0008 0.0012 0.0020 0.0441 0.0181 0.0181 0.0007 0.0170 0.0190 0.0182 0.0008
173
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2PT-CLEF2007
GeoCLEF Bilingual Portuguese Task Top 5 Participants − Standard Recall Levels vs Mean Interpolated Precision
100%
cheshire [Experiment BERKBIENPTBASE; MAP 20.12%; Pooled]
csusm [Experiment GEOBIESPT4; MAP 5.33%; Pooled]
90%
80%
70%
60%
Precision
50%
40%
30%
20%
10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Bilingual Portuguese Task Top 5 Participants − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
1
cheshire [Experiment BERKBIENPTBASE; MAP 20.12%; Pooled]
csusm [Experiment GEOBIESPT4; MAP 5.33%; Pooled]
0.8
0.6
0.4
0.2
Difference
0
−0.2
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
174
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2PT-CLEF2007
GeoCLEF Bilingual Portuguese Task − Box Plot of the Topics
cheshire [Experiment BERKBIENPTBASE; MAP 20.12%; Pooled]
cheshire [Experiment BERKBIESPTBASE; MAP 19.24%; Pooled]
cheshire [Experiment BERKBIDEPTBASE; MAP 9.15%; Pooled]
Experiments
csusm [Experiment GEOBIESPT4; MAP 5.33%; Pooled]
csusm [Experiment GEOBIESPT1; MAP 5.33%; Pooled]
csusm [Experiment GEOBIESPT2; MAP 5.33%; Pooled]
csusm [Experiment GEOBIESPT3; MAP 5.33%; Pooled]
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Average Precision
175
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2PT-CLEF2007
10.2455/TUKEY_T_TEST.4E0464EB7FFAB53B7C6DDFAF77A71451
GeoCLEF Bilingual Portuguese Task − Tukey T test with "top group" highlighted
BERKBIENPTBASE
BERKBIESPTBASE
BERKBIDEPTBASE
Experiments
GEOBIESPT1
GEOBIESPT4
GEOBIESPT3
GEOBIESPT2
0.05 0.1 0.15 0.2 0.25 0.3 0.35 0.4 0.45 0.5
arcsin(sqrt(Average Precsion))
176
177
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2PT-CLEF2007
GeoCLEF Bilingual Portuguese Task Top 5 Participants − Retrieved documents vs Mean Precision
100%
cheshire [Experiment BERKBIENPTBASE; R−Prec 21.25%; Pooled]
csusm [Experiment GEOBIESPT4; R−Prec 6.56%; Pooled]
90%
80%
70%
60%
Precision
50%
40%
30%
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Bilingual Portuguese Task Top 5 Participants − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
1
cheshire [Experiment BERKBIENPTBASE; R−Prec 21.25%; Pooled]
csusm [Experiment GEOBIESPT4; R−Prec 6.56%; Pooled]
0.8
0.6
0.4
0.2
Difference
0
−0.2
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
178
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2PT-CLEF2007
GeoCLEF Bilingual Portuguese Task − Box Plot of the Topics
cheshire [Experiment BERKBIENPTBASE; R−Prec 21.25%; Pooled]
cheshire [Experiment BERKBIESPTBASE; R−Prec 21.20%; Pooled]
cheshire [Experiment BERKBIDEPTBASE; R−Prec 10.79%; Pooled]
Experiments
csusm [Experiment GEOBIESPT2; R−Prec 6.56%; Pooled]
csusm [Experiment GEOBIESPT4; R−Prec 6.56%; Pooled]
csusm [Experiment GEOBIESPT3; R−Prec 6.56%; Pooled]
csusm [Experiment GEOBIESPT1; R−Prec 6.56%; Pooled]
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
R−Precision
179
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2PT-CLEF2007
GeoCLEF Bilingual Portuguese Task − Tukey T test with "top group" highlighted
BERKBIENPTBASE
BERKBIESPTBASE
BERKBIDEPTBASE
Experiments
GEOBIESPT1
GEOBIESPT3
GEOBIESPT4
GEOBIESPT2
0 0.05 0.1 0.15 0.2 0.25 0.3 0.35 0.4 0.45 0.5
arcsin(sqrt(R−Precision))
180
181
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2PT-CLEF2007
Statistics for Number of relevant retrieved documents
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.00 0.00 3.00 3.00 3.00 1.71 1.60 3.00 3.00 0.94 0.01 0.00 1.47 0.00 3.00 1.71 1.60
52-GC 0.00 0.00 0.00 3.00 4.00 1.43 1.81 3.00 4.00 1.27 0.00 0.00 1.63 0.00 4.00 1.43 1.81
53-GC 0.00 0.00 0.00 1.75 3.00 0.86 1.21 1.75 3.00 1.42 0.00 0.00 0.98 0.00 3.00 0.86 1.21
54-GC 3.00 3.00 3.00 3.00 3.00 3.00 0.00 0.00 0.00 0.00 3.00 3.00 0.00 3.00 3.00 3.00 0.00
55-GC 1.00 1.00 1.00 5.00 5.00 2.71 2.14 4.00 4.00 0.79 1.99 1.52 1.96 1.00 5.00 2.71 2.14
56-GC 1.00 1.00 1.00 9.00 10.00 4.57 4.47 8.00 9.00 0.98 2.60 1.62 4.08 1.00 10.00 4.57 4.47
57-GC 2.00 2.00 2.00 2.00 2.00 2.00 0.00 0.00 0.00 0.00 2.00 2.00 0.00 2.00 2.00 2.00 0.00
58-GC 5.00 5.00 5.00 18.75 19.00 10.86 7.31 13.75 14.00 0.67 8.79 7.29 6.69 5.00 19.00 10.86 7.31
59-GC 0.00 0.00 0.00 0.75 1.00 0.29 0.49 0.75 1.00 1.71 0.00 0.00 0.41 0.00 1.00 0.29 0.49
60-GC 5.00 8.00 8.00 8.00 8.00 7.57 1.13 0.00 3.00 0.15 7.48 7.37 0.73 8.00 8.00 8.00 0.00
61-GC 0.00 0.00 0.00 5.75 11.00 3.14 4.34 5.75 11.00 1.38 0.00 0.00 3.59 0.00 11.00 3.14 4.34
62-GC 11.00 13.00 13.00 16.75 19.00 14.29 2.98 3.75 8.00 0.21 14.04 13.81 2.41 11.00 19.00 14.29 2.98
63-GC 0.00 1.25 2.00 2.00 2.00 1.57 0.79 0.75 2.00 0.50 0.32 0.00 0.61 1.00 2.00 1.83 0.41
64-GC 0.00 0.00 0.00 0.75 4.00 0.71 1.50 0.75 4.00 2.09 0.00 0.00 1.02 0.00 1.00 0.17 0.41
65-GC 0.00 0.00 0.00 3.75 5.00 1.43 2.44 3.75 5.00 1.71 0.00 0.00 2.04 0.00 5.00 1.43 2.44
66-GC 0.00 1.00 11.00 11.00 11.00 6.57 5.53 10.00 11.00 0.84 0.76 0.00 5.06 0.00 11.00 6.57 5.53
67-GC 71.00 71.00 71.00 73.50 74.00 72.00 1.41 2.50 3.00 0.02 71.99 71.98 1.14 71.00 74.00 72.00 1.41
68-GC 0.00 0.00 0.00 29.75 64.00 16.71 24.59 29.75 64.00 1.47 0.01 0.00 19.10 0.00 64.00 16.71 24.59
69-GC 0.00 0.00 0.00 9.75 10.00 4.14 5.18 9.75 10.00 1.25 0.00 0.00 4.73 0.00 10.00 4.14 5.18
70-GC 0.00 0.25 4.00 4.00 4.00 2.43 1.99 3.75 4.00 0.82 0.08 0.00 1.80 0.00 4.00 2.43 1.99
71-GC 40.00 40.00 40.00 86.00 128.00 64.29 34.59 46.00 88.00 0.54 57.65 52.68 27.76 40.00 128.00 64.29 34.59
72-GC 10.00 10.00 10.00 16.25 41.00 15.71 11.53 6.25 31.00 0.73 13.49 12.26 7.88 10.00 18.00 11.50 3.21
73-GC 1.00 3.00 3.00 6.75 12.00 4.71 3.86 3.75 11.00 0.82 3.60 2.75 3.02 1.00 12.00 4.71 3.86
74-GC 9.00 9.00 9.00 47.25 52.00 25.86 21.12 38.25 43.00 0.82 18.48 13.81 19.27 9.00 52.00 25.86 21.12
75-GC 0.00 0.00 0.00 31.00 31.00 13.29 16.57 31.00 31.00 1.25 0.01 0.00 15.18 0.00 31.00 13.29 16.57
182
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2PT-CLEF2007
Statistics for Average Precsion
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0058 0.0058 0.0058 0.0033 0.0031 0.0058 0.0058 0.9354 0.0004 0.0000 0.0029 0.0000 0.0058 0.0033 0.0031
52-GC 0.0000 0.0000 0.0000 0.0005 0.0013 0.0003 0.0005 0.0005 0.0013 1.5007 0.0001 0.0000 0.0004 0.0000 0.0013 0.0003 0.0005
53-GC 0.0000 0.0000 0.0000 0.0160 0.0458 0.0096 0.0178 0.0160 0.0458 1.8529 0.0002 0.0000 0.0137 0.0000 0.0212 0.0036 0.0087
54-GC 0.0154 0.0259 0.0523 0.0523 0.1759 0.0597 0.0540 0.0264 0.1606 0.9054 0.0445 0.0340 0.0332 0.0154 0.0523 0.0403 0.0186
55-GC 0.0002 0.0002 0.0002 0.0776 0.1358 0.0369 0.0556 0.0774 0.1356 1.5074 0.0026 0.0004 0.0447 0.0002 0.1358 0.0369 0.0556
56-GC 0.0014 0.0014 0.0014 0.5206 0.5759 0.2197 0.2786 0.5192 0.5745 1.2678 0.0172 0.0024 0.2496 0.0014 0.5759 0.2197 0.2786
57-GC 0.0098 0.0643 0.3750 0.3750 0.3750 0.2407 0.1716 0.3107 0.3652 0.7131 0.1402 0.0484 0.1535 0.0098 0.3750 0.2407 0.1716
58-GC 0.0074 0.0074 0.0074 0.3736 0.4039 0.1684 0.2010 0.3662 0.3966 1.1941 0.0401 0.0127 0.1840 0.0074 0.4039 0.1684 0.2010
59-GC 0.0000 0.0000 0.0000 0.0045 0.0667 0.0104 0.0249 0.0045 0.0667 2.3997 0.0001 0.0000 0.0161 0.0000 0.0060 0.0010 0.0025
60-GC 0.0666 0.4837 0.4837 0.6890 0.7929 0.5074 0.2383 0.2053 0.7263 0.4696 0.4169 0.2707 0.1530 0.4837 0.7929 0.5809 0.1509
61-GC 0.0000 0.0000 0.0000 0.0049 0.0935 0.0147 0.0348 0.0049 0.0935 2.3693 0.0002 0.0000 0.0225 0.0000 0.0052 0.0016 0.0024
62-GC 0.0096 0.0096 0.0096 0.1315 0.1720 0.0575 0.0767 0.1219 0.1624 1.3348 0.0250 0.0149 0.0640 0.0096 0.1720 0.0575 0.0767
63-GC 0.0000 0.0012 0.0035 0.0035 0.0035 0.0023 0.0015 0.0023 0.0035 0.6359 0.0011 0.0001 0.0013 0.0000 0.0035 0.0023 0.0015
64-GC 0.0000 0.0000 0.0000 0.0006 0.0034 0.0006 0.0013 0.0006 0.0034 2.1294 0.0000 0.0000 0.0009 0.0000 0.0008 0.0001 0.0003
65-GC 0.0000 0.0000 0.0000 0.0002 0.0003 0.0001 0.0001 0.0002 0.0003 1.7078 0.0000 0.0000 0.0001 0.0000 0.0003 0.0001 0.0001
66-GC 0.0000 0.0610 0.0610 0.0730 0.0769 0.0569 0.0262 0.0119 0.0769 0.4602 0.0188 0.0001 0.0162 0.0610 0.0769 0.0663 0.0082
67-GC 0.2581 0.2799 0.2799 0.3905 0.4543 0.3228 0.0814 0.1106 0.1963 0.2523 0.3150 0.3083 0.0675 0.2581 0.4543 0.3228 0.0814
68-GC 0.0000 0.0000 0.0000 0.0420 0.3855 0.0636 0.1434 0.0420 0.3855 2.2552 0.0004 0.0000 0.0920 0.0000 0.0543 0.0099 0.0218
69-GC 0.0000 0.0000 0.0000 0.3506 0.4554 0.1598 0.2047 0.3506 0.4554 1.2810 0.0009 0.0000 0.1826 0.0000 0.4554 0.1598 0.2047
70-GC 0.0000 0.0000 0.0212 0.0212 0.0212 0.0121 0.0113 0.0212 0.0212 0.9322 0.0011 0.0000 0.0104 0.0000 0.0212 0.0121 0.0113
71-GC 0.0243 0.0243 0.0243 0.1148 0.6272 0.1352 0.2208 0.0906 0.6029 1.6330 0.0596 0.0379 0.1406 0.0243 0.1185 0.0532 0.0451
72-GC 0.0020 0.0020 0.0020 0.0216 0.6666 0.1007 0.2497 0.0195 0.6646 2.4804 0.0067 0.0028 0.1617 0.0020 0.0281 0.0064 0.0106
73-GC 0.0001 0.0018 0.0018 0.0133 0.1119 0.0195 0.0412 0.0115 0.1118 2.1179 0.0030 0.0006 0.0264 0.0001 0.0171 0.0040 0.0064
74-GC 0.0022 0.0022 0.0022 0.1535 0.2815 0.0853 0.1121 0.1513 0.2793 1.3139 0.0148 0.0038 0.0950 0.0022 0.2815 0.0853 0.1121
75-GC 0.0000 0.0000 0.0000 0.4889 0.5388 0.2061 0.2622 0.4889 0.5388 1.2720 0.0010 0.0000 0.2356 0.0000 0.5388 0.2061 0.2622
183
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2PT-CLEF2007
Statistics for R-Precision
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0000 0.0000 0.1667 0.0238 0.0630 0.0000 0.1667 2.6458 0.0000 0.0000 0.0408 0.0000 0.0000 0.0000 0.0000
54-GC 0.0000 0.0000 0.0000 0.0000 0.3333 0.0476 0.1260 0.0000 0.3333 2.6458 0.0000 0.0000 0.0816 0.0000 0.0000 0.0000 0.0000
55-GC 0.0000 0.0000 0.0000 0.0000 0.2000 0.0286 0.0756 0.0000 0.2000 2.6458 0.0000 0.0000 0.0490 0.0000 0.0000 0.0000 0.0000
56-GC 0.0000 0.0000 0.0000 0.6500 0.7000 0.2714 0.3450 0.6500 0.7000 1.2712 0.0011 0.0000 0.3102 0.0000 0.7000 0.2714 0.3450
57-GC 0.0000 0.0000 0.5000 0.5000 0.5000 0.2857 0.2673 0.5000 0.5000 0.9354 0.0048 0.0000 0.2449 0.0000 0.5000 0.2857 0.2673
58-GC 0.0476 0.0476 0.0476 0.4762 0.6190 0.2517 0.2590 0.4286 0.5714 1.0288 0.1326 0.0779 0.2332 0.0476 0.6190 0.2517 0.2590
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.1250 0.5000 0.5000 0.5938 0.6250 0.4821 0.1681 0.0938 0.5000 0.3488 0.4372 0.3646 0.1020 0.5000 0.6250 0.5417 0.0645
61-GC 0.0000 0.0000 0.0000 0.0000 0.2308 0.0330 0.0872 0.0000 0.2308 2.6458 0.0000 0.0000 0.0565 0.0000 0.0000 0.0000 0.0000
62-GC 0.0000 0.0000 0.0000 0.2105 0.2632 0.0827 0.1248 0.2105 0.2632 1.5085 0.0006 0.0000 0.1031 0.0000 0.2632 0.0827 0.1248
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
66-GC 0.0000 0.0000 0.0000 0.0577 0.0769 0.0220 0.0375 0.0577 0.0769 1.7078 0.0001 0.0000 0.0314 0.0000 0.0769 0.0220 0.0375
67-GC 0.2133 0.3733 0.3733 0.4633 0.5067 0.3867 0.0971 0.0900 0.2933 0.2510 0.3746 0.3608 0.0648 0.3733 0.5067 0.4156 0.0655
68-GC 0.0000 0.0000 0.0000 0.0687 0.4500 0.0786 0.1669 0.0687 0.4500 2.1240 0.0005 0.0000 0.1087 0.0000 0.0875 0.0167 0.0351
69-GC 0.0000 0.0000 0.0000 0.3500 0.4000 0.1429 0.1902 0.3500 0.4000 1.3317 0.0008 0.0000 0.1633 0.0000 0.4000 0.1429 0.1902
70-GC 0.0000 0.0000 0.1000 0.1000 0.1000 0.0571 0.0535 0.1000 0.1000 0.9354 0.0019 0.0000 0.0490 0.0000 0.1000 0.0571 0.0535
71-GC 0.1032 0.1032 0.1032 0.2177 0.5871 0.2046 0.1769 0.1145 0.4839 0.8644 0.1634 0.1408 0.1159 0.1032 0.2194 0.1409 0.0583
72-GC 0.0000 0.0000 0.0000 0.0170 0.6591 0.0974 0.2478 0.0170 0.6591 2.5443 0.0001 0.0000 0.1605 0.0000 0.0227 0.0038 0.0093
73-GC 0.0000 0.0000 0.0000 0.0625 0.1667 0.0357 0.0656 0.0625 0.1667 1.8359 0.0001 0.0000 0.0510 0.0000 0.0833 0.0139 0.0340
74-GC 0.0161 0.0161 0.0161 0.2016 0.3871 0.1198 0.1448 0.1855 0.3710 1.2087 0.0516 0.0268 0.1185 0.0161 0.3871 0.1198 0.1448
75-GC 0.0000 0.0000 0.0000 0.4453 0.4688 0.1875 0.2359 0.4453 0.4688 1.2583 0.0010 0.0000 0.2143 0.0000 0.4688 0.1875 0.2359
184
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2PT-CLEF2007
Statistics for Binary Preference
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0000 0.0000 0.0833 0.0119 0.0315 0.0000 0.0833 2.6458 0.0000 0.0000 0.0204 0.0000 0.0000 0.0000 0.0000
54-GC 0.0000 0.0000 0.0000 0.0000 0.2222 0.0317 0.0840 0.0000 0.2222 2.6458 0.0000 0.0000 0.0544 0.0000 0.0000 0.0000 0.0000
55-GC 0.0000 0.0000 0.0000 0.0000 0.1200 0.0171 0.0454 0.0000 0.1200 2.6458 0.0000 0.0000 0.0294 0.0000 0.0000 0.0000 0.0000
56-GC 0.0000 0.0000 0.0000 0.5800 0.6300 0.2414 0.3084 0.5800 0.6300 1.2774 0.0011 0.0000 0.2759 0.0000 0.6300 0.2414 0.3084
57-GC 0.0000 0.0000 0.2500 0.2500 0.2500 0.1429 0.1336 0.2500 0.2500 0.9354 0.0033 0.0000 0.1224 0.0000 0.2500 0.1429 0.1336
58-GC 0.0159 0.0159 0.0159 0.4274 0.5011 0.2018 0.2334 0.4116 0.4853 1.1563 0.0664 0.0271 0.2125 0.0159 0.5011 0.2018 0.2334
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.1094 0.3438 0.3438 0.5664 0.6406 0.3951 0.1883 0.2227 0.5312 0.4766 0.3487 0.2929 0.1403 0.1094 0.6406 0.3951 0.1883
61-GC 0.0000 0.0000 0.0000 0.0000 0.0769 0.0110 0.0291 0.0000 0.0769 2.6458 0.0000 0.0000 0.0188 0.0000 0.0000 0.0000 0.0000
62-GC 0.0000 0.0000 0.0000 0.1011 0.1468 0.0408 0.0679 0.1011 0.1468 1.6650 0.0004 0.0000 0.0566 0.0000 0.1468 0.0408 0.0679
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0000 0.0000 0.0014 0.0018 0.0005 0.0009 0.0014 0.0018 1.7078 0.0000 0.0000 0.0007 0.0000 0.0018 0.0005 0.0009
66-GC 0.0000 0.0000 0.0000 0.0577 0.0769 0.0220 0.0375 0.0577 0.0769 1.7078 0.0001 0.0000 0.0314 0.0000 0.0769 0.0220 0.0375
67-GC 0.1851 0.2830 0.2830 0.3893 0.4375 0.3113 0.0894 0.1063 0.2524 0.2871 0.3004 0.2895 0.0684 0.1851 0.4375 0.3113 0.0894
68-GC 0.0000 0.0000 0.0000 0.0396 0.4145 0.0675 0.1541 0.0396 0.4145 2.2824 0.0004 0.0000 0.0991 0.0000 0.0502 0.0097 0.0201
69-GC 0.0000 0.0000 0.0000 0.3075 0.3800 0.1271 0.1748 0.3075 0.3800 1.3749 0.0008 0.0000 0.1453 0.0000 0.3800 0.1271 0.1748
70-GC 0.0000 0.0000 0.0100 0.0100 0.0100 0.0057 0.0053 0.0100 0.0100 0.9354 0.0005 0.0000 0.0049 0.0000 0.0100 0.0057 0.0053
71-GC 0.1089 0.1089 0.1089 0.1991 0.6969 0.2179 0.2152 0.0902 0.5879 0.9876 0.1680 0.1448 0.1368 0.1089 0.2019 0.1381 0.0453
72-GC 0.0000 0.0000 0.0000 0.0170 0.6457 0.0955 0.2428 0.0170 0.6457 2.5423 0.0001 0.0000 0.1572 0.0000 0.0227 0.0038 0.0093
73-GC 0.0000 0.0000 0.0000 0.0156 0.1111 0.0188 0.0414 0.0156 0.1111 2.1973 0.0001 0.0000 0.0269 0.0000 0.0208 0.0035 0.0085
74-GC 0.0070 0.0070 0.0070 0.1485 0.3197 0.0918 0.1203 0.1415 0.3127 1.3109 0.0289 0.0119 0.0969 0.0070 0.3197 0.0918 0.1203
75-GC 0.0000 0.0000 0.0000 0.4028 0.4590 0.1696 0.2185 0.4028 0.4590 1.2881 0.0009 0.0000 0.1939 0.0000 0.4590 0.1696 0.2185
185
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2PT-CLEF2007
Statistics for Precision at the 0% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0100 0.0100 0.0100 0.0057 0.0053 0.0100 0.0100 0.9354 0.0005 0.0000 0.0049 0.0000 0.0100 0.0057 0.0053
52-GC 0.0000 0.0000 0.0000 0.0068 0.0213 0.0049 0.0079 0.0068 0.0213 1.6126 0.0002 0.0000 0.0056 0.0000 0.0072 0.0021 0.0033
53-GC 0.0000 0.0000 0.0000 0.0941 0.2500 0.0538 0.0982 0.0941 0.2500 1.8270 0.0003 0.0000 0.0764 0.0000 0.1250 0.0211 0.0509
54-GC 0.0188 0.0377 0.0870 0.0870 0.5000 0.1268 0.1676 0.0493 0.4812 1.3210 0.0733 0.0472 0.1066 0.0188 0.0870 0.0646 0.0346
55-GC 0.0011 0.0011 0.0011 0.1520 0.3333 0.0832 0.1289 0.1509 0.3322 1.5496 0.0093 0.0020 0.0997 0.0011 0.3333 0.0832 0.1289
56-GC 0.0137 0.0137 0.0137 0.7292 0.8000 0.3245 0.3896 0.7155 0.7863 1.2006 0.0756 0.0236 0.3552 0.0137 0.8000 0.3245 0.3896
57-GC 0.0116 0.0723 0.5000 0.5000 0.5000 0.3148 0.2343 0.4277 0.4884 0.7445 0.1752 0.0576 0.2117 0.0116 0.5000 0.3148 0.2343
58-GC 0.0667 0.0667 0.0667 0.7250 0.7500 0.3452 0.3490 0.6583 0.6833 1.0110 0.1843 0.1090 0.3184 0.0667 0.7500 0.3452 0.3490
59-GC 0.0000 0.0000 0.0000 0.0045 0.0667 0.0104 0.0249 0.0045 0.0667 2.3997 0.0001 0.0000 0.0161 0.0000 0.0060 0.0010 0.0025
60-GC 0.5000 1.0000 1.0000 1.0000 1.0000 0.9286 0.1890 0.0000 0.5000 0.2035 0.9057 0.8750 0.1224 1.0000 1.0000 1.0000 0.0000
61-GC 0.0000 0.0000 0.0000 0.0246 0.2308 0.0395 0.0850 0.0246 0.2308 2.1515 0.0004 0.0000 0.0546 0.0000 0.0263 0.0077 0.0120
62-GC 0.0255 0.0255 0.0255 0.2406 0.5000 0.1394 0.1868 0.2151 0.4745 1.3399 0.0651 0.0400 0.1472 0.0255 0.5000 0.1394 0.1868
63-GC 0.0000 0.0050 0.0123 0.0123 0.0123 0.0087 0.0050 0.0073 0.0123 0.5750 0.0036 0.0001 0.0042 0.0000 0.0123 0.0087 0.0050
64-GC 0.0000 0.0000 0.0000 0.0065 0.0213 0.0043 0.0082 0.0065 0.0213 1.9101 0.0001 0.0000 0.0061 0.0000 0.0086 0.0014 0.0035
65-GC 0.0000 0.0000 0.0000 0.0072 0.0096 0.0027 0.0047 0.0072 0.0096 1.7078 0.0001 0.0000 0.0039 0.0000 0.0096 0.0027 0.0047
66-GC 0.0000 0.1053 0.1053 0.7763 1.0000 0.3459 0.4485 0.6711 1.0000 1.2968 0.0533 0.0001 0.3738 0.0000 1.0000 0.3459 0.4485
67-GC 0.4545 0.4545 0.4545 0.9583 1.0000 0.6645 0.2677 0.5038 0.5455 0.4028 0.6209 0.5833 0.2400 0.4545 1.0000 0.6645 0.2677
68-GC 0.0000 0.0000 0.0000 0.7583 1.0000 0.2905 0.4848 0.7583 1.0000 1.6692 0.0009 0.0000 0.4054 0.0000 1.0000 0.2905 0.4848
69-GC 0.0000 0.0000 0.0000 0.9500 1.0000 0.4000 0.5033 0.9500 1.0000 1.2583 0.0013 0.0000 0.4571 0.0000 1.0000 0.4000 0.5033
70-GC 0.0000 0.0003 0.1000 0.1000 0.1000 0.0573 0.0532 0.0997 0.1000 0.9287 0.0038 0.0000 0.0488 0.0000 0.1000 0.0573 0.0532
71-GC 0.2500 0.2500 0.2500 1.0000 1.0000 0.5714 0.4009 0.7500 0.7500 0.7016 0.4529 0.3684 0.3673 0.2500 1.0000 0.5714 0.4009
72-GC 0.0125 0.0134 0.0134 0.7533 1.0000 0.2951 0.4815 0.7400 0.9875 1.6316 0.0454 0.0183 0.4028 0.0125 1.0000 0.2951 0.4815
73-GC 0.0014 0.0081 0.0081 0.0770 0.3333 0.0667 0.1226 0.0689 0.3320 1.8370 0.0153 0.0056 0.0857 0.0014 0.1000 0.0223 0.0382
74-GC 0.0278 0.0278 0.0278 1.0000 1.0000 0.4444 0.5197 0.9722 0.9722 1.1693 0.1290 0.0476 0.4762 0.0278 1.0000 0.4444 0.5197
75-GC 0.0000 0.0000 0.0000 1.0000 1.0000 0.4286 0.5345 1.0000 1.0000 1.2472 0.0014 0.0000 0.4898 0.0000 1.0000 0.4286 0.5345
186
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2PT-CLEF2007
Statistics for Precision at the 10% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0100 0.0100 0.0100 0.0057 0.0053 0.0100 0.0100 0.9354 0.0005 0.0000 0.0049 0.0000 0.0100 0.0057 0.0053
52-GC 0.0000 0.0000 0.0000 0.0000 0.0043 0.0006 0.0016 0.0000 0.0043 2.6458 0.0000 0.0000 0.0011 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0000 0.0941 0.2500 0.0538 0.0982 0.0941 0.2500 1.8270 0.0003 0.0000 0.0764 0.0000 0.1250 0.0211 0.0509
54-GC 0.0188 0.0377 0.0870 0.0870 0.5000 0.1268 0.1676 0.0493 0.4812 1.3210 0.0733 0.0472 0.1066 0.0188 0.0870 0.0646 0.0346
55-GC 0.0011 0.0011 0.0011 0.1520 0.3333 0.0832 0.1289 0.1509 0.3322 1.5496 0.0093 0.0020 0.0997 0.0011 0.3333 0.0832 0.1289
56-GC 0.0137 0.0137 0.0137 0.7292 0.8000 0.3245 0.3896 0.7155 0.7863 1.2006 0.0756 0.0236 0.3552 0.0137 0.8000 0.3245 0.3896
57-GC 0.0116 0.0723 0.5000 0.5000 0.5000 0.3148 0.2343 0.4277 0.4884 0.7445 0.1752 0.0576 0.2117 0.0116 0.5000 0.3148 0.2343
58-GC 0.0448 0.0448 0.0448 0.7250 0.7500 0.3327 0.3607 0.6802 0.7052 1.0840 0.1468 0.0748 0.3291 0.0448 0.7500 0.3327 0.3607
59-GC 0.0000 0.0000 0.0000 0.0045 0.0667 0.0104 0.0249 0.0045 0.0667 2.3997 0.0001 0.0000 0.0161 0.0000 0.0060 0.0010 0.0025
60-GC 0.5000 1.0000 1.0000 1.0000 1.0000 0.9286 0.1890 0.0000 0.5000 0.2035 0.9057 0.8750 0.1224 1.0000 1.0000 1.0000 0.0000
61-GC 0.0000 0.0000 0.0000 0.0113 0.2308 0.0359 0.0861 0.0113 0.2308 2.3942 0.0003 0.0000 0.0557 0.0000 0.0122 0.0035 0.0055
62-GC 0.0255 0.0255 0.0255 0.2343 0.2941 0.1088 0.1253 0.2088 0.2686 1.1517 0.0601 0.0397 0.1035 0.0255 0.2941 0.1088 0.1253
63-GC 0.0000 0.0050 0.0123 0.0123 0.0123 0.0087 0.0050 0.0073 0.0123 0.5750 0.0036 0.0001 0.0042 0.0000 0.0123 0.0087 0.0050
64-GC 0.0000 0.0000 0.0000 0.0000 0.0060 0.0009 0.0023 0.0000 0.0060 2.6458 0.0000 0.0000 0.0015 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
66-GC 0.0000 0.0000 0.1053 0.1053 0.1053 0.0602 0.0563 0.1053 0.1053 0.9354 0.0020 0.0000 0.0516 0.0000 0.1053 0.0602 0.0563
67-GC 0.4545 0.4545 0.4545 0.6106 0.8000 0.5411 0.1330 0.1561 0.3455 0.2458 0.5290 0.5187 0.1012 0.4545 0.8000 0.5411 0.1330
68-GC 0.0000 0.0000 0.0000 0.0845 0.8182 0.1349 0.3037 0.0845 0.8182 2.2508 0.0006 0.0000 0.1952 0.0000 0.1058 0.0211 0.0423
69-GC 0.0000 0.0000 0.0000 0.9500 1.0000 0.4000 0.5033 0.9500 1.0000 1.2583 0.0013 0.0000 0.4571 0.0000 1.0000 0.4000 0.5033
70-GC 0.0000 0.0003 0.1000 0.1000 0.1000 0.0573 0.0532 0.0997 0.1000 0.9287 0.0038 0.0000 0.0488 0.0000 0.1000 0.0573 0.0532
71-GC 0.1176 0.1176 0.1176 0.3140 1.0000 0.2943 0.3230 0.1964 0.8824 1.0974 0.2071 0.1670 0.2128 0.1176 0.3333 0.1767 0.0946
72-GC 0.0125 0.0134 0.0134 0.0170 1.0000 0.1549 0.3727 0.0037 0.9875 2.4063 0.0256 0.0161 0.2415 0.0125 0.0182 0.0140 0.0021
73-GC 0.0000 0.0066 0.0066 0.0166 0.3333 0.0542 0.1232 0.0100 0.3333 2.2713 0.0054 0.0001 0.0797 0.0000 0.0199 0.0077 0.0065
74-GC 0.0126 0.0126 0.0126 0.3768 0.5185 0.1848 0.2216 0.3642 0.5059 1.1991 0.0559 0.0216 0.1968 0.0126 0.5185 0.1848 0.2216
75-GC 0.0000 0.0000 0.0000 0.9583 1.0000 0.4048 0.5079 0.9583 1.0000 1.2547 0.0014 0.0000 0.4626 0.0000 1.0000 0.4048 0.5079
187
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2PT-CLEF2007
Statistics for Precision at the 20% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0100 0.0100 0.0100 0.0057 0.0053 0.0100 0.0100 0.9354 0.0005 0.0000 0.0049 0.0000 0.0100 0.0057 0.0053
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0000 0.0018 0.0211 0.0034 0.0079 0.0018 0.0211 2.3422 0.0001 0.0000 0.0051 0.0000 0.0024 0.0004 0.0010
54-GC 0.0188 0.0377 0.0870 0.0870 0.5000 0.1268 0.1676 0.0493 0.4812 1.3210 0.0733 0.0472 0.1066 0.0188 0.0870 0.0646 0.0346
55-GC 0.0011 0.0011 0.0011 0.1520 0.3333 0.0832 0.1289 0.1509 0.3322 1.5496 0.0093 0.0020 0.0997 0.0011 0.3333 0.0832 0.1289
56-GC 0.0000 0.0000 0.0000 0.7292 0.8000 0.3167 0.3969 0.7292 0.8000 1.2533 0.0012 0.0000 0.3619 0.0000 0.8000 0.3167 0.3969
57-GC 0.0116 0.0723 0.5000 0.5000 0.5000 0.3148 0.2343 0.4277 0.4884 0.7445 0.1752 0.0576 0.2117 0.0116 0.5000 0.3148 0.2343
58-GC 0.0052 0.0052 0.0052 0.7250 0.7500 0.3101 0.3818 0.7198 0.7448 1.2312 0.0427 0.0090 0.3485 0.0052 0.7500 0.3101 0.3818
59-GC 0.0000 0.0000 0.0000 0.0045 0.0667 0.0104 0.0249 0.0045 0.0667 2.3997 0.0001 0.0000 0.0161 0.0000 0.0060 0.0010 0.0025
60-GC 0.0094 0.5000 0.5000 0.8750 1.0000 0.5728 0.3425 0.3750 0.9906 0.5979 0.3454 0.0600 0.2441 0.0094 1.0000 0.5728 0.3425
61-GC 0.0000 0.0000 0.0000 0.0113 0.2308 0.0359 0.0861 0.0113 0.2308 2.3942 0.0003 0.0000 0.0557 0.0000 0.0122 0.0035 0.0055
62-GC 0.0255 0.0255 0.0255 0.2090 0.2941 0.1008 0.1220 0.1836 0.2686 1.2102 0.0550 0.0377 0.1016 0.0255 0.2941 0.1008 0.1220
63-GC 0.0000 0.0011 0.0084 0.0084 0.0084 0.0054 0.0040 0.0073 0.0084 0.7378 0.0011 0.0000 0.0034 0.0000 0.0084 0.0054 0.0040
64-GC 0.0000 0.0000 0.0000 0.0000 0.0060 0.0009 0.0023 0.0000 0.0060 2.6458 0.0000 0.0000 0.0015 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
66-GC 0.0000 0.0000 0.1053 0.1053 0.1053 0.0602 0.0563 0.1053 0.1053 0.9354 0.0020 0.0000 0.0516 0.0000 0.1053 0.0602 0.0563
67-GC 0.3191 0.4043 0.4043 0.5049 0.6000 0.4392 0.0957 0.1007 0.2809 0.2180 0.4308 0.4229 0.0743 0.3191 0.6000 0.4392 0.0957
68-GC 0.0000 0.0000 0.0000 0.0653 0.5714 0.0960 0.2117 0.0653 0.5714 2.2038 0.0005 0.0000 0.1358 0.0000 0.0802 0.0168 0.0321
69-GC 0.0000 0.0000 0.0000 0.6458 0.8000 0.2690 0.3667 0.6458 0.8000 1.3630 0.0011 0.0000 0.3075 0.0000 0.8000 0.2690 0.3667
70-GC 0.0000 0.0000 0.0513 0.0513 0.0513 0.0293 0.0274 0.0513 0.0513 0.9354 0.0013 0.0000 0.0251 0.0000 0.0513 0.0293 0.0274
71-GC 0.0541 0.0541 0.0541 0.2445 0.9778 0.2394 0.3373 0.1905 0.9237 1.4088 0.1253 0.0840 0.2134 0.0541 0.2480 0.1164 0.0967
72-GC 0.0125 0.0134 0.0134 0.0170 1.0000 0.1549 0.3727 0.0037 0.9875 2.4063 0.0256 0.0161 0.2415 0.0125 0.0182 0.0140 0.0021
73-GC 0.0000 0.0063 0.0063 0.0165 0.1875 0.0333 0.0683 0.0102 0.1875 2.0534 0.0048 0.0001 0.0441 0.0000 0.0199 0.0075 0.0066
74-GC 0.0000 0.0000 0.0000 0.2083 0.5185 0.1322 0.1956 0.2083 0.5185 1.4790 0.0008 0.0000 0.1511 0.0000 0.5185 0.1322 0.1956
75-GC 0.0000 0.0000 0.0000 0.6841 0.7059 0.2917 0.3646 0.6841 0.7059 1.2496 0.0012 0.0000 0.3334 0.0000 0.7059 0.2917 0.3646
188
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2PT-CLEF2007
Statistics for Precision at the 30% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0100 0.0100 0.0100 0.0057 0.0053 0.0100 0.0100 0.9354 0.0005 0.0000 0.0049 0.0000 0.0100 0.0057 0.0053
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0000 0.0018 0.0211 0.0034 0.0079 0.0018 0.0211 2.3422 0.0001 0.0000 0.0051 0.0000 0.0024 0.0004 0.0010
54-GC 0.0188 0.0377 0.0870 0.0870 0.5000 0.1268 0.1676 0.0493 0.4812 1.3210 0.0733 0.0472 0.1066 0.0188 0.0870 0.0646 0.0346
55-GC 0.0000 0.0000 0.0000 0.1466 0.2000 0.0604 0.0906 0.1466 0.2000 1.4999 0.0005 0.0000 0.0746 0.0000 0.2000 0.0604 0.0906
56-GC 0.0000 0.0000 0.0000 0.6971 0.8000 0.2984 0.3806 0.6971 0.8000 1.2758 0.0012 0.0000 0.3410 0.0000 0.8000 0.2984 0.3806
57-GC 0.0116 0.0723 0.5000 0.5000 0.5000 0.3148 0.2343 0.4277 0.4884 0.7445 0.1752 0.0576 0.2117 0.0116 0.5000 0.3148 0.2343
58-GC 0.0000 0.0000 0.0000 0.6466 0.7000 0.2838 0.3544 0.6466 0.7000 1.2491 0.0012 0.0000 0.3243 0.0000 0.7000 0.2838 0.3544
59-GC 0.0000 0.0000 0.0000 0.0045 0.0667 0.0104 0.0249 0.0045 0.0667 2.3997 0.0001 0.0000 0.0161 0.0000 0.0060 0.0010 0.0025
60-GC 0.0094 0.5000 0.5000 0.8750 1.0000 0.5728 0.3425 0.3750 0.9906 0.5979 0.3454 0.0600 0.2441 0.0094 1.0000 0.5728 0.3425
61-GC 0.0000 0.0000 0.0000 0.0089 0.1923 0.0299 0.0717 0.0089 0.1923 2.3981 0.0003 0.0000 0.0464 0.0000 0.0092 0.0028 0.0044
62-GC 0.0139 0.0139 0.0139 0.1415 0.2286 0.0720 0.0902 0.1275 0.2146 1.2530 0.0354 0.0220 0.0736 0.0139 0.2286 0.0720 0.0902
63-GC 0.0000 0.0011 0.0084 0.0084 0.0084 0.0054 0.0040 0.0073 0.0084 0.7378 0.0011 0.0000 0.0034 0.0000 0.0084 0.0054 0.0040
64-GC 0.0000 0.0000 0.0000 0.0000 0.0060 0.0009 0.0023 0.0000 0.0060 2.6458 0.0000 0.0000 0.0015 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
66-GC 0.0000 0.0000 0.1053 0.1053 0.1053 0.0602 0.0563 0.1053 0.1053 0.9354 0.0020 0.0000 0.0516 0.0000 0.1053 0.0602 0.0563
67-GC 0.2176 0.4035 0.4035 0.4943 0.5581 0.4163 0.1095 0.0908 0.3405 0.2630 0.4018 0.3845 0.0714 0.4035 0.5581 0.4495 0.0720
68-GC 0.0000 0.0000 0.0000 0.0513 0.5714 0.0914 0.2132 0.0513 0.5714 2.3324 0.0002 0.0000 0.1371 0.0000 0.0684 0.0114 0.0279
69-GC 0.0000 0.0000 0.0000 0.6458 0.8000 0.2690 0.3667 0.6458 0.8000 1.3630 0.0011 0.0000 0.3075 0.0000 0.8000 0.2690 0.3667
70-GC 0.0000 0.0000 0.0330 0.0330 0.0330 0.0188 0.0176 0.0330 0.0330 0.9354 0.0010 0.0000 0.0161 0.0000 0.0330 0.0188 0.0176
71-GC 0.0000 0.0000 0.0000 0.1829 0.9400 0.1812 0.3441 0.1829 0.9400 1.8992 0.0008 0.0000 0.2226 0.0000 0.2016 0.0547 0.0880
72-GC 0.0000 0.0000 0.0000 0.0137 0.8636 0.1260 0.3253 0.0137 0.8636 2.5825 0.0001 0.0000 0.2108 0.0000 0.0182 0.0030 0.0074
73-GC 0.0000 0.0000 0.0000 0.0149 0.1148 0.0192 0.0428 0.0149 0.1148 2.2233 0.0001 0.0000 0.0275 0.0000 0.0199 0.0033 0.0081
74-GC 0.0000 0.0000 0.0000 0.1405 0.4872 0.1078 0.1789 0.1405 0.4872 1.6597 0.0007 0.0000 0.1232 0.0000 0.1473 0.0446 0.0696
75-GC 0.0000 0.0000 0.0000 0.6094 0.7059 0.2526 0.3329 0.6094 0.7059 1.3176 0.0011 0.0000 0.2887 0.0000 0.7059 0.2526 0.3329
189
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2PT-CLEF2007
Statistics for Precision at the 40% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0100 0.0100 0.0100 0.0057 0.0053 0.0100 0.0100 0.9354 0.0005 0.0000 0.0049 0.0000 0.0100 0.0057 0.0053
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0000 0.0000 0.0036 0.0005 0.0014 0.0000 0.0036 2.6458 0.0000 0.0000 0.0009 0.0000 0.0000 0.0000 0.0000
54-GC 0.0174 0.0194 0.0870 0.0870 0.0870 0.0579 0.0363 0.0676 0.0696 0.6265 0.0454 0.0343 0.0332 0.0174 0.0870 0.0579 0.0363
55-GC 0.0000 0.0000 0.0000 0.1466 0.2000 0.0604 0.0906 0.1466 0.2000 1.4999 0.0005 0.0000 0.0746 0.0000 0.2000 0.0604 0.0906
56-GC 0.0000 0.0000 0.0000 0.6971 0.8000 0.2984 0.3806 0.6971 0.8000 1.2758 0.0012 0.0000 0.3410 0.0000 0.8000 0.2984 0.3806
57-GC 0.0116 0.0723 0.5000 0.5000 0.5000 0.3148 0.2343 0.4277 0.4884 0.7445 0.1752 0.0576 0.2117 0.0116 0.5000 0.3148 0.2343
58-GC 0.0000 0.0000 0.0000 0.5971 0.6500 0.2626 0.3281 0.5971 0.6500 1.2493 0.0011 0.0000 0.3001 0.0000 0.6500 0.2626 0.3281
59-GC 0.0000 0.0000 0.0000 0.0045 0.0667 0.0104 0.0249 0.0045 0.0667 2.3997 0.0001 0.0000 0.0161 0.0000 0.0060 0.0010 0.0025
60-GC 0.0087 0.5000 0.5000 0.8750 1.0000 0.5727 0.3426 0.3750 0.9913 0.5983 0.3417 0.0560 0.2442 0.0087 1.0000 0.5727 0.3426
61-GC 0.0000 0.0000 0.0000 0.0069 0.0741 0.0119 0.0276 0.0069 0.0741 2.3214 0.0001 0.0000 0.0178 0.0000 0.0092 0.0015 0.0038
62-GC 0.0139 0.0139 0.0139 0.1393 0.2286 0.0708 0.0907 0.1254 0.2146 1.2814 0.0344 0.0217 0.0743 0.0139 0.2286 0.0708 0.0907
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
66-GC 0.0000 0.0000 0.1053 0.1053 0.1053 0.0602 0.0563 0.1053 0.1053 0.9354 0.0020 0.0000 0.0516 0.0000 0.1053 0.0602 0.0563
67-GC 0.2176 0.3797 0.3797 0.4884 0.5455 0.4010 0.1092 0.1086 0.3278 0.2724 0.3868 0.3710 0.0766 0.2176 0.5455 0.4010 0.1092
68-GC 0.0000 0.0000 0.0000 0.0288 0.4706 0.0727 0.1760 0.0288 0.4706 2.4206 0.0002 0.0000 0.1137 0.0000 0.0385 0.0064 0.0157
69-GC 0.0000 0.0000 0.0000 0.4583 0.8000 0.2333 0.3215 0.4583 0.8000 1.3777 0.0010 0.0000 0.2667 0.0000 0.8000 0.2333 0.3215
70-GC 0.0000 0.0000 0.0276 0.0276 0.0276 0.0158 0.0147 0.0276 0.0276 0.9354 0.0009 0.0000 0.0135 0.0000 0.0276 0.0158 0.0147
71-GC 0.0000 0.0000 0.0000 0.1185 0.9041 0.1597 0.3324 0.1185 0.9041 2.0805 0.0007 0.0000 0.2127 0.0000 0.1300 0.0357 0.0572
72-GC 0.0000 0.0000 0.0000 0.0137 0.8636 0.1260 0.3253 0.0137 0.8636 2.5825 0.0001 0.0000 0.2108 0.0000 0.0182 0.0030 0.0074
73-GC 0.0000 0.0000 0.0000 0.0138 0.1148 0.0190 0.0428 0.0138 0.1148 2.2486 0.0001 0.0000 0.0274 0.0000 0.0184 0.0031 0.0075
74-GC 0.0000 0.0000 0.0000 0.1064 0.3968 0.0856 0.1454 0.1064 0.3968 1.6985 0.0006 0.0000 0.0978 0.0000 0.1116 0.0337 0.0527
75-GC 0.0000 0.0000 0.0000 0.5804 0.6842 0.2437 0.3196 0.5804 0.6842 1.3118 0.0011 0.0000 0.2785 0.0000 0.6842 0.2437 0.3196
190
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2PT-CLEF2007
Statistics for Precision at the 50% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0100 0.0100 0.0100 0.0057 0.0053 0.0100 0.0100 0.9354 0.0005 0.0000 0.0049 0.0000 0.0100 0.0057 0.0053
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0000 0.0000 0.0036 0.0005 0.0014 0.0000 0.0036 2.6458 0.0000 0.0000 0.0009 0.0000 0.0000 0.0000 0.0000
54-GC 0.0174 0.0194 0.0870 0.0870 0.0870 0.0579 0.0363 0.0676 0.0696 0.6265 0.0454 0.0343 0.0332 0.0174 0.0870 0.0579 0.0363
55-GC 0.0000 0.0000 0.0000 0.0440 0.0732 0.0200 0.0308 0.0440 0.0732 1.5396 0.0003 0.0000 0.0251 0.0000 0.0732 0.0200 0.0308
56-GC 0.0000 0.0000 0.0000 0.6703 0.7500 0.2861 0.3628 0.6703 0.7500 1.2680 0.0012 0.0000 0.3270 0.0000 0.7500 0.2861 0.3628
57-GC 0.0116 0.0723 0.5000 0.5000 0.5000 0.3148 0.2343 0.4277 0.4884 0.7445 0.1752 0.0576 0.2117 0.0116 0.5000 0.3148 0.2343
58-GC 0.0000 0.0000 0.0000 0.4784 0.6500 0.2234 0.2870 0.4784 0.6500 1.2849 0.0010 0.0000 0.2553 0.0000 0.6500 0.2234 0.2870
59-GC 0.0000 0.0000 0.0000 0.0045 0.0667 0.0104 0.0249 0.0045 0.0667 2.3997 0.0001 0.0000 0.0161 0.0000 0.0060 0.0010 0.0025
60-GC 0.0087 0.5000 0.5000 0.8750 1.0000 0.5727 0.3426 0.3750 0.9913 0.5983 0.3417 0.0560 0.2442 0.0087 1.0000 0.5727 0.3426
61-GC 0.0000 0.0000 0.0000 0.0000 0.0696 0.0099 0.0263 0.0000 0.0696 2.6458 0.0000 0.0000 0.0170 0.0000 0.0000 0.0000 0.0000
62-GC 0.0139 0.0139 0.0139 0.1326 0.2083 0.0666 0.0832 0.1187 0.1944 1.2486 0.0337 0.0216 0.0684 0.0139 0.2083 0.0666 0.0832
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
66-GC 0.0000 0.0000 0.1053 0.1053 0.1053 0.0602 0.0563 0.1053 0.1053 0.9354 0.0020 0.0000 0.0516 0.0000 0.1053 0.0602 0.0563
67-GC 0.2077 0.3223 0.3223 0.4324 0.5128 0.3541 0.1032 0.1101 0.3052 0.2915 0.3413 0.3285 0.0782 0.2077 0.5128 0.3541 0.1032
68-GC 0.0000 0.0000 0.0000 0.0000 0.4490 0.0641 0.1697 0.0000 0.4490 2.6458 0.0000 0.0000 0.1100 0.0000 0.0000 0.0000 0.0000
69-GC 0.0000 0.0000 0.0000 0.3289 0.4167 0.1523 0.1924 0.3289 0.4167 1.2639 0.0009 0.0000 0.1740 0.0000 0.4167 0.1523 0.1924
70-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
71-GC 0.0000 0.0000 0.0000 0.0870 0.8421 0.1369 0.3140 0.0870 0.8421 2.2939 0.0002 0.0000 0.2015 0.0000 0.1160 0.0193 0.0474
72-GC 0.0000 0.0000 0.0000 0.0000 0.7419 0.1060 0.2804 0.0000 0.7419 2.6458 0.0000 0.0000 0.1817 0.0000 0.0000 0.0000 0.0000
73-GC 0.0000 0.0000 0.0000 0.0134 0.1148 0.0189 0.0428 0.0134 0.1148 2.2576 0.0001 0.0000 0.0274 0.0000 0.0179 0.0030 0.0073
74-GC 0.0000 0.0000 0.0000 0.0875 0.2925 0.0662 0.1076 0.0875 0.2925 1.6264 0.0006 0.0000 0.0756 0.0000 0.0896 0.0285 0.0442
75-GC 0.0000 0.0000 0.0000 0.4229 0.4706 0.1782 0.2275 0.4229 0.4706 1.2761 0.0009 0.0000 0.2037 0.0000 0.4706 0.1782 0.2275
191
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2PT-CLEF2007
Statistics for Precision at the 60% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0100 0.0100 0.0100 0.0057 0.0053 0.0100 0.0100 0.9354 0.0005 0.0000 0.0049 0.0000 0.0100 0.0057 0.0053
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
54-GC 0.0174 0.0194 0.0870 0.0870 0.0870 0.0579 0.0363 0.0676 0.0696 0.6265 0.0454 0.0343 0.0332 0.0174 0.0870 0.0579 0.0363
55-GC 0.0000 0.0000 0.0000 0.0440 0.0732 0.0200 0.0308 0.0440 0.0732 1.5396 0.0003 0.0000 0.0251 0.0000 0.0732 0.0200 0.0308
56-GC 0.0000 0.0000 0.0000 0.6596 0.7500 0.2841 0.3600 0.6596 0.7500 1.2673 0.0012 0.0000 0.3246 0.0000 0.7500 0.2841 0.3600
57-GC 0.0116 0.0678 0.2500 0.2500 0.2500 0.1693 0.1060 0.1822 0.2384 0.6259 0.1157 0.0536 0.0922 0.0116 0.2500 0.1693 0.1060
58-GC 0.0000 0.0000 0.0000 0.3521 0.6500 0.1909 0.2593 0.3521 0.6500 1.3586 0.0010 0.0000 0.2181 0.0000 0.6500 0.1909 0.2593
59-GC 0.0000 0.0000 0.0000 0.0045 0.0667 0.0104 0.0249 0.0045 0.0667 2.3997 0.0001 0.0000 0.0161 0.0000 0.0060 0.0010 0.0025
60-GC 0.0078 0.4167 0.4167 0.6399 1.0000 0.4841 0.3066 0.2232 0.9922 0.6334 0.2890 0.0500 0.2132 0.4167 0.7143 0.4762 0.1331
61-GC 0.0000 0.0000 0.0000 0.0000 0.0696 0.0099 0.0263 0.0000 0.0696 2.6458 0.0000 0.0000 0.0170 0.0000 0.0000 0.0000 0.0000
62-GC 0.0000 0.0139 0.0139 0.1174 0.1791 0.0553 0.0759 0.1035 0.1791 1.3734 0.0100 0.0001 0.0630 0.0000 0.1791 0.0553 0.0759
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
66-GC 0.0000 0.0000 0.1053 0.1053 0.1053 0.0602 0.0563 0.1053 0.1053 0.9354 0.0020 0.0000 0.0516 0.0000 0.1053 0.0602 0.0563
67-GC 0.1631 0.2761 0.2761 0.3904 0.4310 0.3039 0.0954 0.1144 0.2680 0.3140 0.2906 0.2770 0.0720 0.1631 0.4310 0.3039 0.0954
68-GC 0.0000 0.0000 0.0000 0.0000 0.2981 0.0426 0.1127 0.0000 0.2981 2.6458 0.0000 0.0000 0.0730 0.0000 0.0000 0.0000 0.0000
69-GC 0.0000 0.0000 0.0000 0.3050 0.4000 0.1412 0.1801 0.3050 0.4000 1.2750 0.0009 0.0000 0.1614 0.0000 0.4000 0.1412 0.1801
70-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
71-GC 0.0000 0.0000 0.0000 0.0000 0.5813 0.0830 0.2197 0.0000 0.5813 2.6458 0.0000 0.0000 0.1423 0.0000 0.0000 0.0000 0.0000
72-GC 0.0000 0.0000 0.0000 0.0000 0.6744 0.0963 0.2549 0.0000 0.6744 2.6458 0.0000 0.0000 0.1652 0.0000 0.0000 0.0000 0.0000
73-GC 0.0000 0.0000 0.0000 0.0077 0.0650 0.0108 0.0242 0.0077 0.0650 2.2547 0.0001 0.0000 0.0155 0.0000 0.0102 0.0017 0.0042
74-GC 0.0000 0.0000 0.0000 0.0691 0.1490 0.0401 0.0573 0.0691 0.1490 1.4299 0.0005 0.0000 0.0458 0.0000 0.1490 0.0401 0.0573
75-GC 0.0000 0.0000 0.0000 0.3696 0.4167 0.1575 0.2004 0.3696 0.4167 1.2719 0.0009 0.0000 0.1800 0.0000 0.4167 0.1575 0.2004
192
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2PT-CLEF2007
Statistics for Precision at the 70% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0100 0.0100 0.0100 0.0057 0.0053 0.0100 0.0100 0.9354 0.0005 0.0000 0.0049 0.0000 0.0100 0.0057 0.0053
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
54-GC 0.0033 0.0033 0.0033 0.0101 0.0188 0.0074 0.0059 0.0068 0.0154 0.7987 0.0058 0.0048 0.0047 0.0033 0.0188 0.0074 0.0059
55-GC 0.0000 0.0000 0.0000 0.0316 0.0494 0.0142 0.0209 0.0316 0.0494 1.4674 0.0003 0.0000 0.0169 0.0000 0.0494 0.0142 0.0209
56-GC 0.0000 0.0000 0.0000 0.6596 0.7000 0.2769 0.3496 0.6596 0.7000 1.2623 0.0011 0.0000 0.3165 0.0000 0.7000 0.2769 0.3496
57-GC 0.0116 0.0678 0.2500 0.2500 0.2500 0.1693 0.1060 0.1822 0.2384 0.6259 0.1157 0.0536 0.0922 0.0116 0.2500 0.1693 0.1060
58-GC 0.0000 0.0000 0.0000 0.1691 0.3191 0.0858 0.1267 0.1691 0.3191 1.4765 0.0007 0.0000 0.0985 0.0000 0.3191 0.0858 0.1267
59-GC 0.0000 0.0000 0.0000 0.0045 0.0667 0.0104 0.0249 0.0045 0.0667 2.3997 0.0001 0.0000 0.0161 0.0000 0.0060 0.0010 0.0025
60-GC 0.0000 0.3810 0.3810 0.4414 0.5455 0.3615 0.1713 0.0604 0.5455 0.4738 0.0913 0.0001 0.1033 0.3810 0.4615 0.3971 0.0360
61-GC 0.0000 0.0000 0.0000 0.0000 0.0261 0.0037 0.0099 0.0000 0.0261 2.6458 0.0000 0.0000 0.0064 0.0000 0.0000 0.0000 0.0000
62-GC 0.0000 0.0000 0.0000 0.0694 0.1129 0.0294 0.0505 0.0694 0.1129 1.7195 0.0001 0.0000 0.0419 0.0000 0.1129 0.0294 0.0505
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
66-GC 0.0000 0.0000 0.0990 0.0990 0.0990 0.0566 0.0529 0.0990 0.0990 0.9354 0.0019 0.0000 0.0485 0.0000 0.0990 0.0566 0.0529
67-GC 0.1631 0.2199 0.2199 0.3034 0.3841 0.2512 0.0772 0.0835 0.2210 0.3073 0.2419 0.2338 0.0609 0.1631 0.3841 0.2512 0.0772
68-GC 0.0000 0.0000 0.0000 0.0000 0.1918 0.0274 0.0725 0.0000 0.1918 2.6458 0.0000 0.0000 0.0470 0.0000 0.0000 0.0000 0.0000
69-GC 0.0000 0.0000 0.0000 0.2349 0.3684 0.1100 0.1533 0.2349 0.3684 1.3942 0.0007 0.0000 0.1257 0.0000 0.3684 0.1100 0.1533
70-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
71-GC 0.0000 0.0000 0.0000 0.0000 0.3759 0.0537 0.1421 0.0000 0.3759 2.6458 0.0000 0.0000 0.0920 0.0000 0.0000 0.0000 0.0000
72-GC 0.0000 0.0000 0.0000 0.0000 0.6200 0.0886 0.2343 0.0000 0.6200 2.6458 0.0000 0.0000 0.1518 0.0000 0.0000 0.0000 0.0000
73-GC 0.0000 0.0000 0.0000 0.0000 0.0418 0.0060 0.0158 0.0000 0.0418 2.6458 0.0000 0.0000 0.0102 0.0000 0.0000 0.0000 0.0000
74-GC 0.0000 0.0000 0.0000 0.0544 0.1100 0.0305 0.0428 0.0544 0.1100 1.4034 0.0004 0.0000 0.0349 0.0000 0.1100 0.0305 0.0428
75-GC 0.0000 0.0000 0.0000 0.3061 0.3651 0.1318 0.1698 0.3061 0.3651 1.2885 0.0008 0.0000 0.1506 0.0000 0.3651 0.1318 0.1698
193
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2PT-CLEF2007
Statistics for Precision at the 80% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
54-GC 0.0033 0.0033 0.0033 0.0101 0.0188 0.0074 0.0059 0.0068 0.0154 0.7987 0.0058 0.0048 0.0047 0.0033 0.0188 0.0074 0.0059
55-GC 0.0000 0.0000 0.0000 0.0316 0.0494 0.0142 0.0209 0.0316 0.0494 1.4674 0.0003 0.0000 0.0169 0.0000 0.0494 0.0142 0.0209
56-GC 0.0000 0.0000 0.0000 0.5282 0.6154 0.2139 0.2910 0.5282 0.6154 1.3604 0.0010 0.0000 0.2445 0.0000 0.6154 0.2139 0.2910
57-GC 0.0116 0.0678 0.2500 0.2500 0.2500 0.1693 0.1060 0.1822 0.2384 0.6259 0.1157 0.0536 0.0922 0.0116 0.2500 0.1693 0.1060
58-GC 0.0000 0.0000 0.0000 0.0548 0.0746 0.0234 0.0330 0.0548 0.0746 1.4080 0.0004 0.0000 0.0268 0.0000 0.0746 0.0234 0.0330
59-GC 0.0000 0.0000 0.0000 0.0045 0.0667 0.0104 0.0249 0.0045 0.0667 2.3997 0.0001 0.0000 0.0161 0.0000 0.0060 0.0010 0.0025
60-GC 0.0000 0.3810 0.3810 0.4286 0.4667 0.3478 0.1575 0.0476 0.4667 0.4528 0.0888 0.0001 0.0994 0.3810 0.4667 0.4058 0.0392
61-GC 0.0000 0.0000 0.0000 0.0000 0.0261 0.0037 0.0099 0.0000 0.0261 2.6458 0.0000 0.0000 0.0064 0.0000 0.0000 0.0000 0.0000
62-GC 0.0000 0.0000 0.0000 0.0645 0.0925 0.0255 0.0436 0.0645 0.0925 1.7094 0.0001 0.0000 0.0364 0.0000 0.0925 0.0255 0.0436
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
66-GC 0.0000 0.0000 0.0948 0.0948 0.0948 0.0542 0.0507 0.0948 0.0948 0.9354 0.0019 0.0000 0.0464 0.0000 0.0948 0.0542 0.0507
67-GC 0.1455 0.1858 0.1858 0.2243 0.2844 0.2014 0.0452 0.0385 0.1388 0.2244 0.1974 0.1937 0.0339 0.1455 0.2372 0.1876 0.0291
68-GC 0.0000 0.0000 0.0000 0.0000 0.0913 0.0130 0.0345 0.0000 0.0913 2.6458 0.0000 0.0000 0.0224 0.0000 0.0000 0.0000 0.0000
69-GC 0.0000 0.0000 0.0000 0.1454 0.1905 0.0659 0.0850 0.1454 0.1905 1.2892 0.0006 0.0000 0.0754 0.0000 0.1905 0.0659 0.0850
70-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
71-GC 0.0000 0.0000 0.0000 0.0000 0.1694 0.0242 0.0640 0.0000 0.1694 2.6458 0.0000 0.0000 0.0415 0.0000 0.0000 0.0000 0.0000
72-GC 0.0000 0.0000 0.0000 0.0000 0.3830 0.0547 0.1448 0.0000 0.3830 2.6458 0.0000 0.0000 0.0938 0.0000 0.0000 0.0000 0.0000
73-GC 0.0000 0.0000 0.0000 0.0000 0.0418 0.0060 0.0158 0.0000 0.0418 2.6458 0.0000 0.0000 0.0102 0.0000 0.0000 0.0000 0.0000
74-GC 0.0000 0.0000 0.0000 0.0000 0.0600 0.0086 0.0227 0.0000 0.0600 2.6458 0.0000 0.0000 0.0147 0.0000 0.0000 0.0000 0.0000
75-GC 0.0000 0.0000 0.0000 0.2564 0.2826 0.1065 0.1370 0.2564 0.2826 1.2860 0.0008 0.0000 0.1217 0.0000 0.2826 0.1065 0.1370
194
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2PT-CLEF2007
Statistics for Precision at the 90% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
54-GC 0.0033 0.0033 0.0033 0.0101 0.0188 0.0074 0.0059 0.0068 0.0154 0.7987 0.0058 0.0048 0.0047 0.0033 0.0188 0.0074 0.0059
55-GC 0.0000 0.0000 0.0000 0.0302 0.0417 0.0129 0.0184 0.0302 0.0417 1.4320 0.0003 0.0000 0.0149 0.0000 0.0417 0.0129 0.0184
56-GC 0.0000 0.0000 0.0000 0.2060 0.3462 0.0915 0.1484 0.2060 0.3462 1.6212 0.0006 0.0000 0.1222 0.0000 0.3462 0.0915 0.1484
57-GC 0.0116 0.0678 0.2500 0.2500 0.2500 0.1693 0.1060 0.1822 0.2384 0.6259 0.1157 0.0536 0.0922 0.0116 0.2500 0.1693 0.1060
58-GC 0.0000 0.0000 0.0000 0.0216 0.0352 0.0091 0.0157 0.0216 0.0352 1.7196 0.0001 0.0000 0.0131 0.0000 0.0352 0.0091 0.0157
59-GC 0.0000 0.0000 0.0000 0.0045 0.0667 0.0104 0.0249 0.0045 0.0667 2.3997 0.0001 0.0000 0.0161 0.0000 0.0060 0.0010 0.0025
60-GC 0.0000 0.3452 0.3810 0.3810 0.4444 0.3288 0.1485 0.0357 0.4444 0.4518 0.0847 0.0001 0.0939 0.3333 0.3810 0.3714 0.0213
61-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
62-GC 0.0000 0.0000 0.0000 0.0464 0.0833 0.0207 0.0360 0.0464 0.0833 1.7338 0.0001 0.0000 0.0296 0.0000 0.0833 0.0207 0.0360
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
66-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
67-GC 0.1051 0.1252 0.1252 0.1542 0.1780 0.1354 0.0257 0.0290 0.0729 0.1897 0.1335 0.1316 0.0203 0.1051 0.1780 0.1354 0.0257
68-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
69-GC 0.0000 0.0000 0.0000 0.0872 0.1552 0.0463 0.0625 0.0872 0.1552 1.3488 0.0005 0.0000 0.0529 0.0000 0.1552 0.0463 0.0625
70-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.0000 0.0000 0.0000 0.0000 0.0980 0.0140 0.0371 0.0000 0.0980 2.6458 0.0000 0.0000 0.0240 0.0000 0.0000 0.0000 0.0000
73-GC 0.0000 0.0000 0.0000 0.0000 0.0418 0.0060 0.0158 0.0000 0.0418 2.6458 0.0000 0.0000 0.0102 0.0000 0.0000 0.0000 0.0000
74-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
75-GC 0.0000 0.0000 0.0000 0.2076 0.2400 0.0854 0.1134 0.2076 0.2400 1.3272 0.0007 0.0000 0.0976 0.0000 0.2400 0.0854 0.1134
195
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2PT-CLEF2007
Statistics for Precision at the 100% interpolated recall level
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
54-GC 0.0033 0.0033 0.0033 0.0101 0.0188 0.0074 0.0059 0.0068 0.0154 0.7987 0.0058 0.0048 0.0047 0.0033 0.0188 0.0074 0.0059
55-GC 0.0000 0.0000 0.0000 0.0302 0.0417 0.0129 0.0184 0.0302 0.0417 1.4320 0.0003 0.0000 0.0149 0.0000 0.0417 0.0129 0.0184
56-GC 0.0000 0.0000 0.0000 0.0000 0.0103 0.0015 0.0039 0.0000 0.0103 2.6458 0.0000 0.0000 0.0025 0.0000 0.0000 0.0000 0.0000
57-GC 0.0116 0.0678 0.2500 0.2500 0.2500 0.1693 0.1060 0.1822 0.2384 0.6259 0.1157 0.0536 0.0922 0.0116 0.2500 0.1693 0.1060
58-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
59-GC 0.0000 0.0000 0.0000 0.0045 0.0667 0.0104 0.0249 0.0045 0.0667 2.3997 0.0001 0.0000 0.0161 0.0000 0.0060 0.0010 0.0025
60-GC 0.0000 0.3452 0.3810 0.3810 0.4444 0.3288 0.1485 0.0357 0.4444 0.4518 0.0847 0.0001 0.0939 0.3333 0.3810 0.3714 0.0213
61-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
62-GC 0.0000 0.0000 0.0000 0.0000 0.0833 0.0119 0.0315 0.0000 0.0833 2.6458 0.0000 0.0000 0.0204 0.0000 0.0000 0.0000 0.0000
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
66-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
67-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
68-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
69-GC 0.0000 0.0000 0.0000 0.0436 0.1429 0.0287 0.0548 0.0436 0.1429 1.9084 0.0001 0.0000 0.0410 0.0000 0.0581 0.0097 0.0237
70-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
71-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
72-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
73-GC 0.0000 0.0000 0.0000 0.0000 0.0334 0.0048 0.0126 0.0000 0.0334 2.6458 0.0000 0.0000 0.0082 0.0000 0.0000 0.0000 0.0000
74-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
75-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
196
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2PT-CLEF2007
Statistics for P@5
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0000 0.0000 0.2000 0.0286 0.0756 0.0000 0.2000 2.6458 0.0000 0.0000 0.0490 0.0000 0.0000 0.0000 0.0000
54-GC 0.0000 0.0000 0.0000 0.0000 0.2000 0.0286 0.0756 0.0000 0.2000 2.6458 0.0000 0.0000 0.0490 0.0000 0.0000 0.0000 0.0000
55-GC 0.0000 0.0000 0.0000 0.0000 0.2000 0.0286 0.0756 0.0000 0.2000 2.6458 0.0000 0.0000 0.0490 0.0000 0.0000 0.0000 0.0000
56-GC 0.0000 0.0000 0.0000 0.5500 0.8000 0.2571 0.3409 0.5500 0.8000 1.3256 0.0011 0.0000 0.2939 0.0000 0.8000 0.2571 0.3409
57-GC 0.0000 0.0000 0.2000 0.2000 0.2000 0.1143 0.1069 0.2000 0.2000 0.9354 0.0029 0.0000 0.0980 0.0000 0.2000 0.1143 0.1069
58-GC 0.0000 0.0000 0.0000 0.6000 0.6000 0.2571 0.3207 0.6000 0.6000 1.2472 0.0011 0.0000 0.2939 0.0000 0.6000 0.2571 0.3207
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.2000 0.4000 0.4000 0.7000 1.0000 0.5143 0.2795 0.3000 0.8000 0.5434 0.4559 0.4058 0.2204 0.2000 1.0000 0.5143 0.2795
61-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
62-GC 0.0000 0.0000 0.0000 0.0000 0.2000 0.0286 0.0756 0.0000 0.2000 2.6458 0.0000 0.0000 0.0490 0.0000 0.0000 0.0000 0.0000
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
66-GC 0.0000 0.0000 0.0000 0.1500 0.2000 0.0571 0.0976 0.1500 0.2000 1.7078 0.0002 0.0000 0.0816 0.0000 0.2000 0.0571 0.0976
67-GC 0.0000 0.0000 0.0000 0.8000 0.8000 0.3429 0.4276 0.8000 0.8000 1.2472 0.0013 0.0000 0.3918 0.0000 0.8000 0.3429 0.4276
68-GC 0.0000 0.0000 0.0000 0.3000 1.0000 0.2000 0.3830 0.3000 1.0000 1.9149 0.0002 0.0000 0.2857 0.0000 0.4000 0.0667 0.1633
69-GC 0.0000 0.0000 0.0000 0.5000 0.8000 0.2286 0.3352 0.5000 0.8000 1.4666 0.0010 0.0000 0.2694 0.0000 0.8000 0.2286 0.3352
70-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
71-GC 0.2000 0.2000 0.2000 0.4000 1.0000 0.3714 0.2928 0.2000 0.8000 0.7882 0.3068 0.2692 0.1959 0.2000 0.4000 0.2667 0.1033
72-GC 0.0000 0.0000 0.0000 0.1500 1.0000 0.1714 0.3729 0.1500 1.0000 2.1752 0.0002 0.0000 0.2449 0.0000 0.2000 0.0333 0.0816
73-GC 0.0000 0.0000 0.0000 0.0000 0.2000 0.0286 0.0756 0.0000 0.2000 2.6458 0.0000 0.0000 0.0490 0.0000 0.0000 0.0000 0.0000
74-GC 0.0000 0.0000 0.0000 0.7500 0.8000 0.3143 0.3976 0.7500 0.8000 1.2651 0.0012 0.0000 0.3592 0.0000 0.8000 0.3143 0.3976
75-GC 0.0000 0.0000 0.0000 0.9500 1.0000 0.4000 0.5033 0.9500 1.0000 1.2583 0.0013 0.0000 0.4571 0.0000 1.0000 0.4000 0.5033
197
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2PT-CLEF2007
Statistics for P@10
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0000 0.0750 0.1000 0.0286 0.0488 0.0750 0.1000 1.7078 0.0001 0.0000 0.0408 0.0000 0.1000 0.0286 0.0488
54-GC 0.0000 0.0000 0.0000 0.0000 0.1000 0.0143 0.0378 0.0000 0.1000 2.6458 0.0000 0.0000 0.0245 0.0000 0.0000 0.0000 0.0000
55-GC 0.0000 0.0000 0.0000 0.0750 0.2000 0.0429 0.0787 0.0750 0.2000 1.8359 0.0002 0.0000 0.0612 0.0000 0.1000 0.0167 0.0408
56-GC 0.0000 0.0000 0.0000 0.6500 0.7000 0.2714 0.3450 0.6500 0.7000 1.2712 0.0011 0.0000 0.3102 0.0000 0.7000 0.2714 0.3450
57-GC 0.0000 0.0250 0.2000 0.2000 0.2000 0.1286 0.0951 0.1750 0.2000 0.7398 0.0107 0.0000 0.0816 0.0000 0.2000 0.1286 0.0951
58-GC 0.0000 0.0000 0.0000 0.5750 0.7000 0.2571 0.3259 0.5750 0.7000 1.2673 0.0011 0.0000 0.2939 0.0000 0.7000 0.2571 0.3259
59-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
60-GC 0.1000 0.4000 0.4000 0.4750 0.5000 0.3857 0.1345 0.0750 0.4000 0.3488 0.3497 0.2917 0.0816 0.4000 0.5000 0.4333 0.0516
61-GC 0.0000 0.0000 0.0000 0.0000 0.1000 0.0143 0.0378 0.0000 0.1000 2.6458 0.0000 0.0000 0.0245 0.0000 0.0000 0.0000 0.0000
62-GC 0.0000 0.0000 0.0000 0.1500 0.2000 0.0571 0.0976 0.1500 0.2000 1.7078 0.0002 0.0000 0.0816 0.0000 0.2000 0.0571 0.0976
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
66-GC 0.0000 0.0000 0.0000 0.0750 0.1000 0.0286 0.0488 0.0750 0.1000 1.7078 0.0001 0.0000 0.0408 0.0000 0.1000 0.0286 0.0488
67-GC 0.3000 0.3000 0.3000 0.6500 0.8000 0.4571 0.2149 0.3500 0.5000 0.4701 0.4190 0.3886 0.1796 0.3000 0.8000 0.4571 0.2149
68-GC 0.0000 0.0000 0.0000 0.1500 0.8000 0.1429 0.2992 0.1500 0.8000 2.0944 0.0002 0.0000 0.2041 0.0000 0.2000 0.0333 0.0816
69-GC 0.0000 0.0000 0.0000 0.3500 0.4000 0.1429 0.1902 0.3500 0.4000 1.3317 0.0008 0.0000 0.1633 0.0000 0.4000 0.1429 0.1902
70-GC 0.0000 0.0000 0.1000 0.1000 0.1000 0.0571 0.0535 0.1000 0.1000 0.9354 0.0019 0.0000 0.0490 0.0000 0.1000 0.0571 0.0535
71-GC 0.1000 0.1000 0.1000 0.4500 1.0000 0.3143 0.3388 0.3500 0.9000 1.0779 0.2046 0.1511 0.2490 0.1000 0.5000 0.2000 0.1673
72-GC 0.0000 0.0000 0.0000 0.0750 0.9000 0.1429 0.3359 0.0750 0.9000 2.3516 0.0002 0.0000 0.2163 0.0000 0.1000 0.0167 0.0408
73-GC 0.0000 0.0000 0.0000 0.0750 0.2000 0.0429 0.0787 0.0750 0.2000 1.8359 0.0002 0.0000 0.0612 0.0000 0.1000 0.0167 0.0408
74-GC 0.0000 0.0000 0.0000 0.4750 0.5000 0.2000 0.2517 0.4750 0.5000 1.2583 0.0010 0.0000 0.2286 0.0000 0.5000 0.2000 0.2517
75-GC 0.0000 0.0000 0.0000 0.6750 0.7000 0.2857 0.3579 0.6750 0.7000 1.2527 0.0012 0.0000 0.3265 0.0000 0.7000 0.2857 0.3579
198
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2PT-CLEF2007
Statistics for P@15
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0000 0.0500 0.0667 0.0190 0.0325 0.0500 0.0667 1.7078 0.0001 0.0000 0.0272 0.0000 0.0667 0.0190 0.0325
54-GC 0.0000 0.0167 0.0667 0.0667 0.0667 0.0476 0.0325 0.0500 0.0667 0.6831 0.0054 0.0000 0.0272 0.0000 0.0667 0.0476 0.0325
55-GC 0.0000 0.0000 0.0000 0.1000 0.1333 0.0381 0.0651 0.1000 0.1333 1.7078 0.0002 0.0000 0.0544 0.0000 0.1333 0.0381 0.0651
56-GC 0.0000 0.0000 0.0000 0.5167 0.5333 0.2190 0.2741 0.5167 0.5333 1.2513 0.0010 0.0000 0.2503 0.0000 0.5333 0.2190 0.2741
57-GC 0.0000 0.0167 0.1333 0.1333 0.1333 0.0857 0.0634 0.1167 0.1333 0.7398 0.0080 0.0000 0.0544 0.0000 0.1333 0.0857 0.0634
58-GC 0.0667 0.0667 0.0667 0.5833 0.6000 0.2857 0.2741 0.5167 0.5333 0.9594 0.1681 0.1073 0.2503 0.0667 0.6000 0.2857 0.2741
59-GC 0.0000 0.0000 0.0000 0.0000 0.0667 0.0095 0.0252 0.0000 0.0667 2.6458 0.0000 0.0000 0.0163 0.0000 0.0000 0.0000 0.0000
60-GC 0.0667 0.3333 0.3333 0.3833 0.4667 0.3238 0.1243 0.0500 0.4000 0.3839 0.2852 0.2212 0.0735 0.3333 0.4000 0.3467 0.0298
61-GC 0.0000 0.0000 0.0000 0.0000 0.2000 0.0286 0.0756 0.0000 0.2000 2.6458 0.0000 0.0000 0.0490 0.0000 0.0000 0.0000 0.0000
62-GC 0.0000 0.0000 0.0000 0.1500 0.2667 0.0667 0.1155 0.1500 0.2667 1.7321 0.0002 0.0000 0.0952 0.0000 0.2667 0.0667 0.1155
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
66-GC 0.0000 0.0000 0.0000 0.0500 0.0667 0.0190 0.0325 0.0500 0.0667 1.7078 0.0001 0.0000 0.0272 0.0000 0.0667 0.0190 0.0325
67-GC 0.3333 0.3333 0.3333 0.5333 0.6667 0.4381 0.1380 0.2000 0.3333 0.3150 0.4209 0.4058 0.1197 0.3333 0.6667 0.4381 0.1380
68-GC 0.0000 0.0000 0.0000 0.1000 0.6667 0.1143 0.2486 0.1000 0.6667 2.1752 0.0002 0.0000 0.1633 0.0000 0.1333 0.0222 0.0544
69-GC 0.0000 0.0000 0.0000 0.3167 0.4000 0.1429 0.1823 0.3167 0.4000 1.2760 0.0009 0.0000 0.1633 0.0000 0.4000 0.1429 0.1823
70-GC 0.0000 0.0000 0.0667 0.0667 0.0667 0.0381 0.0356 0.0667 0.0667 0.9354 0.0015 0.0000 0.0327 0.0000 0.0667 0.0381 0.0356
71-GC 0.1333 0.1333 0.1333 0.3500 1.0000 0.3048 0.3217 0.2167 0.8667 1.0556 0.2204 0.1818 0.2259 0.1333 0.4000 0.1889 0.1068
72-GC 0.0000 0.0000 0.0000 0.0500 0.8667 0.1333 0.3243 0.0500 0.8667 2.4324 0.0002 0.0000 0.2095 0.0000 0.0667 0.0111 0.0272
73-GC 0.0000 0.0000 0.0000 0.0500 0.1333 0.0286 0.0525 0.0500 0.1333 1.8359 0.0001 0.0000 0.0408 0.0000 0.0667 0.0111 0.0272
74-GC 0.0000 0.0000 0.0000 0.3833 0.4000 0.1619 0.2031 0.3833 0.4000 1.2547 0.0009 0.0000 0.1850 0.0000 0.4000 0.1619 0.2031
75-GC 0.0000 0.0000 0.0000 0.6167 0.6667 0.2571 0.3276 0.6167 0.6667 1.2739 0.0011 0.0000 0.2939 0.0000 0.6667 0.2571 0.3276
199
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2PT-CLEF2007
Statistics for P@20
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0000 0.0375 0.0500 0.0143 0.0244 0.0375 0.0500 1.7078 0.0001 0.0000 0.0204 0.0000 0.0500 0.0143 0.0244
54-GC 0.0000 0.0125 0.0500 0.0500 0.0500 0.0357 0.0244 0.0375 0.0500 0.6831 0.0044 0.0000 0.0204 0.0000 0.0500 0.0357 0.0244
55-GC 0.0000 0.0000 0.0000 0.0875 0.1000 0.0357 0.0476 0.0875 0.1000 1.3317 0.0005 0.0000 0.0408 0.0000 0.1000 0.0357 0.0476
56-GC 0.0000 0.0000 0.0000 0.3875 0.4000 0.1643 0.2056 0.3875 0.4000 1.2513 0.0009 0.0000 0.1878 0.0000 0.4000 0.1643 0.2056
57-GC 0.0000 0.0250 0.1000 0.1000 0.1000 0.0714 0.0488 0.0750 0.1000 0.6831 0.0072 0.0000 0.0408 0.0000 0.1000 0.0714 0.0488
58-GC 0.0500 0.0500 0.0500 0.5000 0.6500 0.2643 0.2719 0.4500 0.6000 1.0288 0.1393 0.0818 0.2449 0.0500 0.6500 0.2643 0.2719
59-GC 0.0000 0.0000 0.0000 0.0000 0.0500 0.0071 0.0189 0.0000 0.0500 2.6458 0.0000 0.0000 0.0122 0.0000 0.0000 0.0000 0.0000
60-GC 0.0500 0.3500 0.3500 0.3500 0.4000 0.3143 0.1180 0.0000 0.3500 0.3755 0.2702 0.1903 0.0755 0.3500 0.3500 0.3500 0.0000
61-GC 0.0000 0.0000 0.0000 0.0000 0.1500 0.0214 0.0567 0.0000 0.1500 2.6458 0.0000 0.0000 0.0367 0.0000 0.0000 0.0000 0.0000
62-GC 0.0000 0.0000 0.0000 0.2000 0.2500 0.0786 0.1185 0.2000 0.2500 1.5085 0.0006 0.0000 0.0980 0.0000 0.2500 0.0786 0.1185
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
66-GC 0.0000 0.0000 0.0000 0.0375 0.0500 0.0143 0.0244 0.0375 0.0500 1.7078 0.0001 0.0000 0.0204 0.0000 0.0500 0.0143 0.0244
67-GC 0.4000 0.4000 0.4000 0.5250 0.6000 0.4571 0.0838 0.1250 0.2000 0.1833 0.4511 0.4457 0.0673 0.4000 0.6000 0.4571 0.0838
68-GC 0.0000 0.0000 0.0000 0.0750 0.6500 0.1071 0.2423 0.0750 0.6500 2.2611 0.0002 0.0000 0.1551 0.0000 0.1000 0.0167 0.0408
69-GC 0.0000 0.0000 0.0000 0.2875 0.3500 0.1286 0.1629 0.2875 0.3500 1.2673 0.0008 0.0000 0.1469 0.0000 0.3500 0.1286 0.1629
70-GC 0.0000 0.0000 0.0500 0.0500 0.0500 0.0286 0.0267 0.0500 0.0500 0.9354 0.0013 0.0000 0.0245 0.0000 0.0500 0.0286 0.0267
71-GC 0.1000 0.1000 0.1000 0.3750 1.0000 0.3000 0.3317 0.2750 0.9000 1.1055 0.1982 0.1495 0.2286 0.1000 0.4000 0.1833 0.1329
72-GC 0.0000 0.0000 0.0000 0.0375 0.8500 0.1286 0.3187 0.0375 0.8500 2.4785 0.0002 0.0000 0.2061 0.0000 0.0500 0.0083 0.0204
73-GC 0.0000 0.0000 0.0000 0.0375 0.1500 0.0286 0.0567 0.0375 0.1500 1.9843 0.0001 0.0000 0.0408 0.0000 0.0500 0.0083 0.0204
74-GC 0.0000 0.0000 0.0000 0.3375 0.4500 0.1571 0.2009 0.3375 0.4500 1.2784 0.0009 0.0000 0.1796 0.0000 0.4500 0.1571 0.2009
75-GC 0.0000 0.0000 0.0000 0.5750 0.6500 0.2357 0.3105 0.5750 0.6500 1.3174 0.0011 0.0000 0.2694 0.0000 0.6500 0.2357 0.3105
200
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2PT-CLEF2007
Statistics for P@30
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
52-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0000 0.0250 0.0333 0.0095 0.0163 0.0250 0.0333 1.7078 0.0001 0.0000 0.0136 0.0000 0.0333 0.0095 0.0163
54-GC 0.0000 0.0083 0.0667 0.0667 0.0667 0.0429 0.0317 0.0583 0.0667 0.7398 0.0049 0.0000 0.0272 0.0000 0.0667 0.0429 0.0317
55-GC 0.0000 0.0000 0.0000 0.0583 0.0667 0.0238 0.0317 0.0583 0.0667 1.3317 0.0004 0.0000 0.0272 0.0000 0.0667 0.0238 0.0317
56-GC 0.0000 0.0000 0.0000 0.2667 0.3000 0.1190 0.1489 0.2667 0.3000 1.2507 0.0008 0.0000 0.1361 0.0000 0.3000 0.1190 0.1489
57-GC 0.0000 0.0417 0.0667 0.0667 0.0667 0.0524 0.0262 0.0250 0.0667 0.5007 0.0172 0.0001 0.0204 0.0333 0.0667 0.0611 0.0136
58-GC 0.0333 0.0333 0.0333 0.4000 0.4667 0.2000 0.2091 0.3667 0.4333 1.0453 0.0988 0.0551 0.1905 0.0333 0.4667 0.2000 0.2091
59-GC 0.0000 0.0000 0.0000 0.0000 0.0333 0.0048 0.0126 0.0000 0.0333 2.6458 0.0000 0.0000 0.0082 0.0000 0.0000 0.0000 0.0000
60-GC 0.0333 0.2667 0.2667 0.2667 0.2667 0.2333 0.0882 0.0000 0.2333 0.3780 0.1981 0.1333 0.0571 0.2667 0.2667 0.2667 0.0000
61-GC 0.0000 0.0000 0.0000 0.0000 0.1667 0.0238 0.0630 0.0000 0.1667 2.6458 0.0000 0.0000 0.0408 0.0000 0.0000 0.0000 0.0000
62-GC 0.0000 0.0000 0.0000 0.1417 0.1667 0.0571 0.0787 0.1417 0.1667 1.3769 0.0006 0.0000 0.0653 0.0000 0.1667 0.0571 0.0787
63-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
64-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
66-GC 0.0000 0.0000 0.0000 0.0250 0.0333 0.0095 0.0163 0.0250 0.0333 1.7078 0.0001 0.0000 0.0136 0.0000 0.0333 0.0095 0.0163
67-GC 0.3667 0.4000 0.4000 0.4750 0.5667 0.4333 0.0720 0.0750 0.2000 0.1662 0.4287 0.4244 0.0571 0.3667 0.5667 0.4333 0.0720
68-GC 0.0000 0.0000 0.0000 0.0583 0.5667 0.0952 0.2094 0.0583 0.5667 2.1991 0.0005 0.0000 0.1347 0.0000 0.0667 0.0167 0.0279
69-GC 0.0000 0.0000 0.0000 0.2250 0.2333 0.0952 0.1193 0.2250 0.2333 1.2527 0.0007 0.0000 0.1088 0.0000 0.2333 0.0952 0.1193
70-GC 0.0000 0.0000 0.0333 0.0333 0.0333 0.0190 0.0178 0.0333 0.0333 0.9354 0.0010 0.0000 0.0163 0.0000 0.0333 0.0190 0.0178
71-GC 0.1333 0.1333 0.1333 0.3250 1.0000 0.3095 0.3166 0.1917 0.8667 1.0230 0.2276 0.1875 0.2041 0.1333 0.3333 0.1944 0.0953
72-GC 0.0000 0.0000 0.0000 0.0250 0.7333 0.1095 0.2754 0.0250 0.7333 2.5141 0.0002 0.0000 0.1782 0.0000 0.0333 0.0056 0.0136
73-GC 0.0000 0.0000 0.0000 0.0250 0.1000 0.0190 0.0378 0.0250 0.1000 1.9843 0.0001 0.0000 0.0272 0.0000 0.0333 0.0056 0.0136
74-GC 0.0000 0.0000 0.0000 0.3000 0.5000 0.1571 0.2070 0.3000 0.5000 1.3174 0.0009 0.0000 0.1796 0.0000 0.5000 0.1571 0.2070
75-GC 0.0000 0.0000 0.0000 0.4583 0.5000 0.1905 0.2440 0.4583 0.5000 1.2809 0.0010 0.0000 0.2177 0.0000 0.5000 0.1905 0.2440
201
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2PT-CLEF2007
Statistics for P@100
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
52-GC 0.0000 0.0000 0.0000 0.0000 0.0200 0.0029 0.0076 0.0000 0.0200 2.6458 0.0000 0.0000 0.0049 0.0000 0.0000 0.0000 0.0000
53-GC 0.0000 0.0000 0.0000 0.0075 0.0200 0.0043 0.0079 0.0075 0.0200 1.8359 0.0001 0.0000 0.0061 0.0000 0.0100 0.0017 0.0041
54-GC 0.0000 0.0125 0.0200 0.0200 0.0200 0.0157 0.0079 0.0075 0.0200 0.5007 0.0061 0.0001 0.0061 0.0100 0.0200 0.0183 0.0041
55-GC 0.0000 0.0000 0.0000 0.0275 0.0400 0.0129 0.0170 0.0275 0.0400 1.3256 0.0003 0.0000 0.0147 0.0000 0.0400 0.0129 0.0170
56-GC 0.0100 0.0100 0.0100 0.0875 0.0900 0.0429 0.0411 0.0775 0.0800 0.9594 0.0252 0.0161 0.0376 0.0100 0.0900 0.0429 0.0411
57-GC 0.0000 0.0200 0.0200 0.0200 0.0200 0.0171 0.0076 0.0000 0.0200 0.4410 0.0068 0.0001 0.0049 0.0200 0.0200 0.0200 0.0000
58-GC 0.0300 0.0300 0.0300 0.1475 0.1600 0.0814 0.0644 0.1175 0.1300 0.7909 0.0598 0.0456 0.0588 0.0300 0.1600 0.0814 0.0644
59-GC 0.0000 0.0000 0.0000 0.0000 0.0100 0.0014 0.0038 0.0000 0.0100 2.6458 0.0000 0.0000 0.0024 0.0000 0.0000 0.0000 0.0000
60-GC 0.0100 0.0800 0.0800 0.0800 0.0800 0.0700 0.0265 0.0000 0.0700 0.3780 0.0594 0.0400 0.0171 0.0800 0.0800 0.0800 0.0000
61-GC 0.0000 0.0000 0.0000 0.0100 0.0600 0.0114 0.0219 0.0100 0.0600 1.9189 0.0002 0.0000 0.0139 0.0000 0.0100 0.0033 0.0052
62-GC 0.0100 0.0100 0.0100 0.1000 0.1300 0.0471 0.0544 0.0900 0.1200 1.1535 0.0251 0.0159 0.0445 0.0100 0.1300 0.0471 0.0544
63-GC 0.0000 0.0000 0.0100 0.0100 0.0100 0.0057 0.0053 0.0100 0.0100 0.9354 0.0005 0.0000 0.0049 0.0000 0.0100 0.0057 0.0053
64-GC 0.0000 0.0000 0.0000 0.0000 0.0100 0.0014 0.0038 0.0000 0.0100 2.6458 0.0000 0.0000 0.0024 0.0000 0.0000 0.0000 0.0000
65-GC 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
66-GC 0.0000 0.0100 0.0900 0.0900 0.0900 0.0543 0.0447 0.0800 0.0900 0.8228 0.0131 0.0001 0.0408 0.0000 0.0900 0.0543 0.0447
67-GC 0.2200 0.3400 0.3400 0.4075 0.4300 0.3486 0.0708 0.0675 0.2100 0.2031 0.3417 0.3339 0.0465 0.3400 0.4300 0.3700 0.0465
68-GC 0.0000 0.0000 0.0000 0.0800 0.4400 0.0800 0.1629 0.0800 0.4400 2.0361 0.0005 0.0000 0.1086 0.0000 0.1000 0.0200 0.0400
69-GC 0.0000 0.0000 0.0000 0.0875 0.1000 0.0386 0.0485 0.0875 0.1000 1.2562 0.0005 0.0000 0.0441 0.0000 0.1000 0.0386 0.0485
70-GC 0.0000 0.0000 0.0300 0.0300 0.0300 0.0171 0.0160 0.0300 0.0300 0.9354 0.0010 0.0000 0.0147 0.0000 0.0300 0.0171 0.0160
71-GC 0.1100 0.1100 0.1100 0.2700 0.8300 0.2557 0.2632 0.1600 0.7200 1.0292 0.1876 0.1545 0.1710 0.1100 0.2800 0.1600 0.0785
72-GC 0.0000 0.0000 0.0000 0.0075 0.3600 0.0529 0.1355 0.0075 0.3600 2.5633 0.0001 0.0000 0.0878 0.0000 0.0100 0.0017 0.0041
73-GC 0.0000 0.0000 0.0000 0.0075 0.0700 0.0114 0.0261 0.0075 0.0700 2.2833 0.0001 0.0000 0.0167 0.0000 0.0100 0.0017 0.0041
74-GC 0.0100 0.0100 0.0100 0.1575 0.3000 0.0929 0.1141 0.1475 0.2900 1.2290 0.0356 0.0168 0.0947 0.0100 0.3000 0.0929 0.1141
75-GC 0.0000 0.0000 0.0000 0.2575 0.2700 0.1086 0.1364 0.2575 0.2700 1.2566 0.0008 0.0000 0.1241 0.0000 0.2700 0.1086 0.1364
202
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2PT-CLEF2007
Statistics for P@200
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0050 0.0050 0.0050 0.0029 0.0027 0.0050 0.0050 0.9354 0.0003 0.0000 0.0024 0.0000 0.0050 0.0029 0.0027
52-GC 0.0000 0.0000 0.0000 0.0037 0.0100 0.0021 0.0039 0.0037 0.0100 1.8359 0.0001 0.0000 0.0031 0.0000 0.0050 0.0008 0.0020
53-GC 0.0000 0.0000 0.0000 0.0037 0.0100 0.0021 0.0039 0.0037 0.0100 1.8359 0.0001 0.0000 0.0031 0.0000 0.0050 0.0008 0.0020
54-GC 0.0100 0.0100 0.0100 0.0100 0.0150 0.0107 0.0019 0.0000 0.0050 0.1764 0.0106 0.0105 0.0012 0.0100 0.0100 0.0100 0.0000
55-GC 0.0000 0.0000 0.0000 0.0213 0.0250 0.0086 0.0118 0.0213 0.0250 1.3769 0.0003 0.0000 0.0098 0.0000 0.0250 0.0086 0.0118
56-GC 0.0050 0.0050 0.0050 0.0438 0.0450 0.0214 0.0206 0.0388 0.0400 0.9594 0.0126 0.0081 0.0188 0.0050 0.0450 0.0214 0.0206
57-GC 0.0100 0.0100 0.0100 0.0100 0.0100 0.0100 0.0000 0.0000 0.0000 0.0000 0.0100 0.0100 0.0000 0.0100 0.0100 0.0100 0.0000
58-GC 0.0150 0.0150 0.0150 0.0787 0.0800 0.0421 0.0339 0.0637 0.0650 0.8043 0.0305 0.0230 0.0310 0.0150 0.0800 0.0421 0.0339
59-GC 0.0000 0.0000 0.0000 0.0037 0.0050 0.0014 0.0024 0.0037 0.0050 1.7078 0.0001 0.0000 0.0020 0.0000 0.0050 0.0014 0.0024
60-GC 0.0050 0.0400 0.0400 0.0400 0.0400 0.0350 0.0132 0.0000 0.0350 0.3780 0.0297 0.0200 0.0086 0.0400 0.0400 0.0400 0.0000
61-GC 0.0000 0.0000 0.0000 0.0050 0.0400 0.0071 0.0147 0.0050 0.0400 2.0551 0.0002 0.0000 0.0094 0.0000 0.0050 0.0017 0.0026
62-GC 0.0200 0.0200 0.0200 0.0687 0.0800 0.0393 0.0283 0.0487 0.0600 0.7216 0.0322 0.0276 0.0233 0.0200 0.0800 0.0393 0.0283
63-GC 0.0000 0.0012 0.0050 0.0050 0.0050 0.0036 0.0024 0.0037 0.0050 0.6831 0.0008 0.0000 0.0020 0.0000 0.0050 0.0036 0.0024
64-GC 0.0000 0.0000 0.0000 0.0037 0.0050 0.0014 0.0024 0.0037 0.0050 1.7078 0.0001 0.0000 0.0020 0.0000 0.0050 0.0014 0.0024
65-GC 0.0000 0.0000 0.0000 0.0037 0.0050 0.0014 0.0024 0.0037 0.0050 1.7078 0.0001 0.0000 0.0020 0.0000 0.0050 0.0014 0.0024
66-GC 0.0000 0.0050 0.0550 0.0550 0.0550 0.0329 0.0277 0.0500 0.0550 0.8420 0.0081 0.0001 0.0253 0.0000 0.0550 0.0329 0.0277
67-GC 0.1950 0.2550 0.2550 0.2737 0.2950 0.2557 0.0311 0.0188 0.1000 0.1218 0.2539 0.2520 0.0182 0.2550 0.2950 0.2658 0.0174
68-GC 0.0000 0.0000 0.0000 0.0613 0.2550 0.0500 0.0945 0.0613 0.2550 1.8894 0.0005 0.0000 0.0657 0.0000 0.0750 0.0158 0.0301
69-GC 0.0000 0.0000 0.0000 0.0488 0.0500 0.0207 0.0259 0.0488 0.0500 1.2498 0.0004 0.0000 0.0237 0.0000 0.0500 0.0207 0.0259
70-GC 0.0000 0.0000 0.0200 0.0200 0.0200 0.0114 0.0107 0.0200 0.0200 0.9354 0.0008 0.0000 0.0098 0.0000 0.0200 0.0114 0.0107
71-GC 0.0800 0.0800 0.0800 0.2037 0.5000 0.1736 0.1544 0.1237 0.4200 0.8895 0.1345 0.1126 0.1069 0.0800 0.2100 0.1192 0.0612
72-GC 0.0000 0.0000 0.0000 0.0037 0.1900 0.0279 0.0715 0.0037 0.1900 2.5675 0.0001 0.0000 0.0463 0.0000 0.0050 0.0008 0.0020
73-GC 0.0000 0.0050 0.0050 0.0125 0.0400 0.0107 0.0137 0.0075 0.0400 1.2760 0.0032 0.0001 0.0096 0.0000 0.0150 0.0058 0.0049
74-GC 0.0150 0.0150 0.0150 0.1138 0.1800 0.0664 0.0680 0.0988 0.1650 1.0235 0.0380 0.0241 0.0588 0.0150 0.1800 0.0664 0.0680
75-GC 0.0000 0.0000 0.0000 0.1500 0.1550 0.0636 0.0796 0.1500 0.1550 1.2516 0.0006 0.0000 0.0727 0.0000 0.1550 0.0636 0.0796
203
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2PT-CLEF2007
Statistics for P@500
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0060 0.0060 0.0060 0.0034 0.0032 0.0060 0.0060 0.9354 0.0004 0.0000 0.0029 0.0000 0.0060 0.0034 0.0032
52-GC 0.0000 0.0000 0.0000 0.0035 0.0060 0.0017 0.0024 0.0035 0.0060 1.4175 0.0001 0.0000 0.0020 0.0000 0.0060 0.0017 0.0024
53-GC 0.0000 0.0000 0.0000 0.0015 0.0040 0.0009 0.0016 0.0015 0.0040 1.8359 0.0001 0.0000 0.0012 0.0000 0.0020 0.0003 0.0008
54-GC 0.0040 0.0040 0.0040 0.0060 0.0060 0.0049 0.0011 0.0020 0.0020 0.2201 0.0048 0.0047 0.0010 0.0040 0.0060 0.0049 0.0011
55-GC 0.0000 0.0000 0.0000 0.0100 0.0100 0.0043 0.0053 0.0100 0.0100 1.2472 0.0002 0.0000 0.0049 0.0000 0.0100 0.0043 0.0053
56-GC 0.0020 0.0020 0.0020 0.0180 0.0180 0.0089 0.0086 0.0160 0.0160 0.9656 0.0051 0.0032 0.0078 0.0020 0.0180 0.0089 0.0086
57-GC 0.0040 0.0040 0.0040 0.0040 0.0040 0.0040 0.0000 0.0000 0.0000 0.0000 0.0040 0.0040 0.0000 0.0040 0.0040 0.0040 0.0000
58-GC 0.0060 0.0060 0.0060 0.0350 0.0360 0.0183 0.0154 0.0290 0.0300 0.8411 0.0127 0.0093 0.0140 0.0060 0.0360 0.0183 0.0154
59-GC 0.0000 0.0000 0.0000 0.0015 0.0020 0.0006 0.0010 0.0015 0.0020 1.7078 0.0000 0.0000 0.0008 0.0000 0.0020 0.0006 0.0010
60-GC 0.0080 0.0160 0.0160 0.0160 0.0160 0.0149 0.0030 0.0000 0.0080 0.2035 0.0145 0.0140 0.0020 0.0160 0.0160 0.0160 0.0000
61-GC 0.0000 0.0000 0.0000 0.0075 0.0220 0.0051 0.0082 0.0075 0.0220 1.5854 0.0002 0.0000 0.0059 0.0000 0.0080 0.0023 0.0037
62-GC 0.0100 0.0100 0.0100 0.0325 0.0380 0.0194 0.0128 0.0225 0.0280 0.6584 0.0163 0.0140 0.0108 0.0100 0.0380 0.0194 0.0128
63-GC 0.0000 0.0025 0.0040 0.0040 0.0040 0.0031 0.0016 0.0015 0.0040 0.5007 0.0015 0.0001 0.0012 0.0020 0.0040 0.0037 0.0008
64-GC 0.0000 0.0000 0.0000 0.0015 0.0040 0.0009 0.0016 0.0015 0.0040 1.8359 0.0001 0.0000 0.0012 0.0000 0.0020 0.0003 0.0008
65-GC 0.0000 0.0000 0.0000 0.0045 0.0060 0.0017 0.0029 0.0045 0.0060 1.7078 0.0001 0.0000 0.0024 0.0000 0.0060 0.0017 0.0029
66-GC 0.0000 0.0020 0.0220 0.0220 0.0220 0.0131 0.0111 0.0200 0.0220 0.8420 0.0037 0.0001 0.0101 0.0000 0.0220 0.0131 0.0111
67-GC 0.1280 0.1320 0.1320 0.1395 0.1420 0.1343 0.0055 0.0075 0.0140 0.0407 0.1342 0.1341 0.0044 0.1280 0.1420 0.1343 0.0055
68-GC 0.0000 0.0000 0.0000 0.0470 0.1220 0.0283 0.0462 0.0470 0.1220 1.6341 0.0004 0.0000 0.0347 0.0000 0.0560 0.0127 0.0227
69-GC 0.0000 0.0000 0.0000 0.0195 0.0200 0.0083 0.0104 0.0195 0.0200 1.2498 0.0003 0.0000 0.0095 0.0000 0.0200 0.0083 0.0104
70-GC 0.0000 0.0000 0.0080 0.0080 0.0080 0.0046 0.0043 0.0080 0.0080 0.9354 0.0005 0.0000 0.0039 0.0000 0.0080 0.0046 0.0043
71-GC 0.0540 0.0540 0.0540 0.1225 0.2340 0.0977 0.0673 0.0685 0.1800 0.6891 0.0829 0.0732 0.0500 0.0540 0.1280 0.0750 0.0333
72-GC 0.0020 0.0080 0.0080 0.0095 0.0800 0.0177 0.0276 0.0015 0.0780 1.5568 0.0094 0.0063 0.0178 0.0080 0.0100 0.0084 0.0009
73-GC 0.0000 0.0060 0.0060 0.0105 0.0240 0.0086 0.0076 0.0045 0.0240 0.8907 0.0032 0.0001 0.0054 0.0000 0.0120 0.0060 0.0038
74-GC 0.0120 0.0120 0.0120 0.0705 0.0920 0.0397 0.0354 0.0585 0.0800 0.8926 0.0265 0.0188 0.0317 0.0120 0.0920 0.0397 0.0354
75-GC 0.0000 0.0000 0.0000 0.0620 0.0620 0.0266 0.0331 0.0620 0.0620 1.2472 0.0004 0.0000 0.0304 0.0000 0.0620 0.0266 0.0331
204
GC-BILI-CLEF2007 Track Overview Results and Graphs GC-BILI-X2PT-CLEF2007
Statistics for P@1000
Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO
51-GC 0.0000 0.0000 0.0030 0.0030 0.0030 0.0017 0.0016 0.0030 0.0030 0.9354 0.0003 0.0000 0.0015 0.0000 0.0030 0.0017 0.0016
52-GC 0.0000 0.0000 0.0000 0.0030 0.0040 0.0014 0.0018 0.0030 0.0040 1.2689 0.0001 0.0000 0.0016 0.0000 0.0040 0.0014 0.0018
53-GC 0.0000 0.0000 0.0000 0.0018 0.0030 0.0009 0.0012 0.0018 0.0030 1.4175 0.0001 0.0000 0.0010 0.0000 0.0030 0.0009 0.0012
54-GC 0.0030 0.0030 0.0030 0.0030 0.0030 0.0030 0.0000 0.0000 0.0000 0.0000 0.0030 0.0030 0.0000 0.0030 0.0030 0.0030 0.0000
55-GC 0.0010 0.0010 0.0010 0.0050 0.0050 0.0027 0.0021 0.0040 0.0040 0.7877 0.0020 0.0015 0.0020 0.0010 0.0050 0.0027 0.0021
56-GC 0.0010 0.0010 0.0010 0.0090 0.0100 0.0046 0.0045 0.0080 0.0090 0.9771 0.0026 0.0016 0.0041 0.0010 0.0100 0.0046 0.0045
57-GC 0.0020 0.0020 0.0020 0.0020 0.0020 0.0020 0.0000 0.0000 0.0000 0.0000 0.0020 0.0020 0.0000 0.0020 0.0020 0.0020 0.0000
58-GC 0.0050 0.0050 0.0050 0.0187 0.0190 0.0109 0.0073 0.0137 0.0140 0.6735 0.0088 0.0073 0.0067 0.0050 0.0190 0.0109 0.0073
59-GC 0.0000 0.0000 0.0000 0.0008 0.0010 0.0003 0.0005 0.0008 0.0010 1.7078 0.0000 0.0000 0.0004 0.0000 0.0010 0.0003 0.0005
60-GC 0.0050 0.0080 0.0080 0.0080 0.0080 0.0076 0.0011 0.0000 0.0030 0.1498 0.0075 0.0074 0.0007 0.0080 0.0080 0.0080 0.0000
61-GC 0.0000 0.0000 0.0000 0.0058 0.0110 0.0031 0.0043 0.0058 0.0110 1.3800 0.0002 0.0000 0.0036 0.0000 0.0110 0.0031 0.0043
62-GC 0.0110 0.0130 0.0130 0.0167 0.0190 0.0143 0.0030 0.0037 0.0080 0.2089 0.0140 0.0138 0.0024 0.0110 0.0190 0.0143 0.0030
63-GC 0.0000 0.0013 0.0020 0.0020 0.0020 0.0016 0.0008 0.0008 0.0020 0.5007 0.0008 0.0001 0.0006 0.0010 0.0020 0.0018 0.0004
64-GC 0.0000 0.0000 0.0000 0.0008 0.0040 0.0007 0.0015 0.0008 0.0040 2.0944 0.0000 0.0000 0.0010 0.0000 0.0010 0.0002 0.0004
65-GC 0.0000 0.0000 0.0000 0.0037 0.0050 0.0014 0.0024 0.0037 0.0050 1.7078 0.0001 0.0000 0.0020 0.0000 0.0050 0.0014 0.0024
66-GC 0.0000 0.0010 0.0110 0.0110 0.0110 0.0066 0.0055 0.0100 0.0110 0.8420 0.0020 0.0001 0.0051 0.0000 0.0110 0.0066 0.0055
67-GC 0.0710 0.0710 0.0710 0.0735 0.0740 0.0720 0.0014 0.0025 0.0030 0.0196 0.0720 0.0720 0.0011 0.0710 0.0740 0.0720 0.0014
68-GC 0.0000 0.0000 0.0000 0.0297 0.0640 0.0167 0.0246 0.0297 0.0640 1.4715 0.0003 0.0000 0.0191 0.0000 0.0640 0.0167 0.0246
69-GC 0.0000 0.0000 0.0000 0.0097 0.0100 0.0041 0.0052 0.0097 0.0100 1.2498 0.0002 0.0000 0.0047 0.0000 0.0100 0.0041 0.0052
70-GC 0.0000 0.0003 0.0040 0.0040 0.0040 0.0024 0.0020 0.0038 0.0040 0.8186 0.0006 0.0000 0.0018 0.0000 0.0040 0.0024 0.0020
71-GC 0.0400 0.0400 0.0400 0.0860 0.1280 0.0643 0.0346 0.0460 0.0880 0.5380 0.0577 0.0527 0.0278 0.0400 0.1280 0.0643 0.0346
72-GC 0.0100 0.0100 0.0100 0.0162 0.0410 0.0157 0.0115 0.0062 0.0310 0.7336 0.0135 0.0123 0.0079 0.0100 0.0180 0.0115 0.0032
73-GC 0.0010 0.0030 0.0030 0.0068 0.0120 0.0047 0.0039 0.0038 0.0110 0.8189 0.0036 0.0028 0.0030 0.0010 0.0120 0.0047 0.0039
74-GC 0.0090 0.0090 0.0090 0.0473 0.0520 0.0259 0.0211 0.0383 0.0430 0.8169 0.0185 0.0138 0.0193 0.0090 0.0520 0.0259 0.0211
75-GC 0.0000 0.0000 0.0000 0.0310 0.0310 0.0133 0.0166 0.0310 0.0310 1.2472 0.0003 0.0000 0.0152 0.0000 0.0310 0.0133 0.0166
205
Individual Experiment Results and Graphs
206
207
cheshire 10.2415/GC-MONO-DE-CLEF2007.CHESHIRE.BERKMODEBASE GC-MONO-DE-CLEF2007
Overall statistics for 25 queries : Priority 1
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language German
Relevant 904 Topic Fields title, description
Relevant retrieved 525 Pooled true
Geometric Mean Average Precision 0.0143 Baseline German monolingual searching using TREC2
Binary Preference (BPREF) 0.1508 ranking with Blind Feedback
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual German Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 38.93 BERKMODEBASE
10 32.56 90%
20 27.53
80%
30 21.69
40 16.93 70%
50 12.43
60%
60 10.07
Precision
70 5.37 50%
80 4.16 40%
90 3.00
30%
100 0.08
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
13.92 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual German Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.8074
Minimum 0.0000
First Quartile 0.0029
Second Quartile 0.0749
Third Quartile 0.1917
Interquartile range 0.1888 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.1392
GeoCLEF Monolingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1967 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.4655 10
Mean With No Outliers 0.1114
Std With No Outliers 0.1420 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual German Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries BERKMODEBASE
51-GC 4.10 64-GC 0.57 0.8
52-GC 0.00 65-GC 24.77
53-GC 0.21 66-GC 0.40
0.6
54-GC 25.00 67-GC 80.74
55-GC 3.71 68-GC 34.50
56-GC 9.30 69-GC 44.46 0.4
57-GC 0.00 70-GC 0.29
58-GC 0.29 71-GC 7.49 0.2
59-GC 0.00 72-GC 10.31
Difference
60-GC 17.31 73-GC 1.82 0
61-GC 0.00 74-GC 8.26
62-GC 13.29 75-GC 46.55
−0.2
63-GC 14.71
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
208
cheshire 10.2415/GC-MONO-DE-CLEF2007.CHESHIRE.BERKMODEBASE GC-MONO-DE-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual German Task − Retrieved documents vs Mean Precision
100%
5 docs 20.00 BERKMODEBASE
10 docs 20.00 90%
15 docs 20.00
80%
20 docs 20.60
30 docs 21.07 70%
100 docs 12.92
60%
200 docs 8.02
Precision
500 docs 3.86 50%
1000 docs 2.10 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
16.36
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual German Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.8033
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0000
Third Quartile 0.3066
Interquartile range 0.3066 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.1636
GeoCLEF Monolingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2282 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.5789 10
Mean With No Outliers 0.1370
Std With No Outliers 0.1892 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual German Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries BERKMODEBASE
51-GC 13.33 64-GC 0.00 0.8
52-GC 0.00 65-GC 32.63
53-GC 0.00 66-GC 0.00
0.6
54-GC 25.00 67-GC 80.33
55-GC 0.00 68-GC 44.98
56-GC 0.00 69-GC 53.33 0.4
57-GC 0.00 70-GC 0.00
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 10.00
Difference
60-GC 36.54 73-GC 0.00 0
61-GC 0.00 74-GC 12.50
62-GC 12.50 75-GC 57.89
−0.2
63-GC 30.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
209
csusm 10.2415/GC-MONO-DE-CLEF2007.CSUSM.GEOMODE1 GC-MONO-DE-CLEF2007
Overall statistics for 25 queries : Priority 1
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language German
Relevant 904 Topic Fields title, description
Relevant retrieved 628 Pooled true
Geometric Mean Average Precision 0.0703 Automatic processing of topic's title & description
Binary Preference (BPREF) 0.2120 using stopwords
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual German Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 68.57 GEOMODE1
10 48.90 90%
20 40.23
80%
30 27.08
40 21.29 70%
50 14.98
60%
60 10.80
Precision
70 8.54 50%
80 7.27 40%
90 5.20
30%
100 2.18
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
20.38 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual German Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.8126
Minimum 0.0000
First Quartile 0.0300
Second Quartile 0.1237
Third Quartile 0.3182
Interquartile range 0.2883 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.2038
GeoCLEF Monolingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1964 8
Number of Topics of the Experiment
7
Lower Outlier Threshold 0.0000
6
Upper Outlier Threshold 0.4452 5
Mean With No Outliers 0.1784 4
3
Std With No Outliers 0.1532
2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual German Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries GEOMODE1
51-GC 13.57 64-GC 0.12 0.8
52-GC 0.00 65-GC 8.19
53-GC 11.63 66-GC 0.77
0.6
54-GC 30.25 67-GC 81.26
55-GC 7.29 68-GC 29.88
56-GC 25.12 69-GC 12.37 0.4
57-GC 2.27 70-GC 10.84
58-GC 27.79 71-GC 34.92 0.2
59-GC 44.52 72-GC 0.42
Difference
60-GC 12.14 73-GC 41.20 0
61-GC 3.24 74-GC 30.79
62-GC 2.12 75-GC 39.63
−0.2
63-GC 39.15
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
210
csusm 10.2415/GC-MONO-DE-CLEF2007.CSUSM.GEOMODE1 GC-MONO-DE-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual German Task − Retrieved documents vs Mean Precision
100%
5 docs 36.00 GEOMODE1
10 docs 30.40 90%
15 docs 24.27
80%
20 docs 21.20
30 docs 17.47 70%
100 docs 11.64
60%
200 docs 7.58
Precision
500 docs 4.10 50%
1000 docs 2.51 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
22.10
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual German Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7541
Minimum 0.0000
First Quartile 0.0326
Second Quartile 0.2000
Third Quartile 0.3546
Interquartile range 0.3220 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.2210
GeoCLEF Monolingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1975 8
Number of Topics of the Experiment
7
Lower Outlier Threshold 0.0000
6
Upper Outlier Threshold 0.7541 5
Mean With No Outliers 0.2210 4
3
Std With No Outliers 0.1975
2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual German Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries GEOMODE1
51-GC 20.00 64-GC 0.00 0.8
52-GC 0.00 65-GC 11.58
53-GC 10.00 66-GC 0.00
0.6
54-GC 50.00 67-GC 75.41
55-GC 14.29 68-GC 40.52
56-GC 20.00 69-GC 20.00 0.4
57-GC 0.00 70-GC 17.39
58-GC 36.84 71-GC 42.86 0.2
59-GC 25.00 72-GC 0.00
Difference
60-GC 23.08 73-GC 28.57 0
61-GC 4.35 74-GC 25.00
62-GC 0.00 75-GC 52.63
−0.2
63-GC 35.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
211
csusm 10.2415/GC-MONO-DE-CLEF2007.CSUSM.GEOMODE2 GC-MONO-DE-CLEF2007
Overall statistics for 25 queries : Priority 2
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language German
Relevant 904 Topic Fields title, description, narrative
Relevant retrieved 378 Pooled true
Geometric Mean Average Precision 0.0081 Automatic processing of topic's title, description,
Binary Preference (BPREF) 0.1357 & narrative using language modelling
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual German Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 49.64 GEOMODE2
10 34.29 90%
20 22.10
80%
30 12.87
40 10.78 70%
50 7.05
60%
60 5.77
Precision
70 5.26 50%
80 4.23 40%
90 3.83
30%
100 0.83
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
11.70 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual German Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7690
Minimum 0.0000
First Quartile 0.0005
Second Quartile 0.0476
Third Quartile 0.1877
Interquartile range 0.1872 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.1170
GeoCLEF Monolingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1673 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.3041 10
Mean With No Outliers 0.0898
Std With No Outliers 0.0998 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual German Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries GEOMODE2
51-GC 26.01 64-GC 0.07 0.8
52-GC 0.00 65-GC 2.38
53-GC 19.85 66-GC 0.50
0.6
54-GC 1.86 67-GC 76.90
55-GC 14.67 68-GC 8.60
56-GC 21.34 69-GC 18.15 0.4
57-GC 0.00 70-GC 8.98
58-GC 24.01 71-GC 0.00 0.2
59-GC 0.00 72-GC 10.46
Difference
60-GC 0.00 73-GC 18.41 0
61-GC 4.47 74-GC 0.00
62-GC 0.64 75-GC 4.76
−0.2
63-GC 30.41
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
212
csusm 10.2415/GC-MONO-DE-CLEF2007.CSUSM.GEOMODE2 GC-MONO-DE-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual German Task − Retrieved documents vs Mean Precision
100%
5 docs 24.00 GEOMODE2
10 docs 19.60 90%
15 docs 17.87
80%
20 docs 15.80
30 docs 13.07 70%
100 docs 8.44
60%
200 docs 4.92
Precision
500 docs 2.50 50%
1000 docs 1.51 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
14.75
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual German Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.8033
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.1000
Third Quartile 0.2222
Interquartile range 0.2222 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.1475
GeoCLEF Monolingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1890 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 8
Upper Outlier Threshold 0.4211
6
Mean With No Outliers 0.1201
4
Std With No Outliers 0.1333
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual German Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries GEOMODE2
51-GC 30.00 64-GC 0.00 0.8
52-GC 0.00 65-GC 9.47
53-GC 30.00 66-GC 0.00
0.6
54-GC 0.00 67-GC 80.33
55-GC 14.29 68-GC 18.22
56-GC 20.00 69-GC 28.89 0.4
57-GC 0.00 70-GC 13.04
58-GC 42.11 71-GC 0.00 0.2
59-GC 0.00 72-GC 10.00
Difference
60-GC 0.00 73-GC 14.29 0
61-GC 6.52 74-GC 0.00
62-GC 0.00 75-GC 14.04
−0.2
63-GC 37.50
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
213
csusm 10.2415/GC-MONO-DE-CLEF2007.CSUSM.GEOMODE3 GC-MONO-DE-CLEF2007
Overall statistics for 25 queries : Priority 3
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language German
Relevant 904 Topic Fields title, description
Relevant retrieved 378 Pooled true
Geometric Mean Average Precision 0.0081 Automatic processing of topic's title & description
Binary Preference (BPREF) 0.1357 using language modeling
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual German Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 49.64 GEOMODE3
10 34.29 90%
20 22.10
80%
30 12.87
40 10.78 70%
50 7.05
60%
60 5.77
Precision
70 5.26 50%
80 4.23 40%
90 3.83
30%
100 0.83
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
11.70 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual German Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7690
Minimum 0.0000
First Quartile 0.0005
Second Quartile 0.0476
Third Quartile 0.1877
Interquartile range 0.1872 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.1170
GeoCLEF Monolingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1673 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.3041 10
Mean With No Outliers 0.0898
Std With No Outliers 0.0998 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual German Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries GEOMODE3
51-GC 26.01 64-GC 0.07 0.8
52-GC 0.00 65-GC 2.38
53-GC 19.85 66-GC 0.50
0.6
54-GC 1.86 67-GC 76.90
55-GC 14.67 68-GC 8.60
56-GC 21.34 69-GC 18.15 0.4
57-GC 0.00 70-GC 8.98
58-GC 24.01 71-GC 0.00 0.2
59-GC 0.00 72-GC 10.46
Difference
60-GC 0.00 73-GC 18.41 0
61-GC 4.47 74-GC 0.00
62-GC 0.64 75-GC 4.76
−0.2
63-GC 30.41
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
214
csusm 10.2415/GC-MONO-DE-CLEF2007.CSUSM.GEOMODE3 GC-MONO-DE-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual German Task − Retrieved documents vs Mean Precision
100%
5 docs 24.00 GEOMODE3
10 docs 19.60 90%
15 docs 17.87
80%
20 docs 15.80
30 docs 13.07 70%
100 docs 8.44
60%
200 docs 4.92
Precision
500 docs 2.50 50%
1000 docs 1.51 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
14.75
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual German Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.8033
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.1000
Third Quartile 0.2222
Interquartile range 0.2222 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.1475
GeoCLEF Monolingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1890 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 8
Upper Outlier Threshold 0.4211
6
Mean With No Outliers 0.1201
4
Std With No Outliers 0.1333
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual German Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries GEOMODE3
51-GC 30.00 64-GC 0.00 0.8
52-GC 0.00 65-GC 9.47
53-GC 30.00 66-GC 0.00
0.6
54-GC 0.00 67-GC 80.33
55-GC 14.29 68-GC 18.22
56-GC 20.00 69-GC 28.89 0.4
57-GC 0.00 70-GC 13.04
58-GC 42.11 71-GC 0.00 0.2
59-GC 0.00 72-GC 10.00
Difference
60-GC 0.00 73-GC 14.29 0
61-GC 6.52 74-GC 0.00
62-GC 0.00 75-GC 14.04
−0.2
63-GC 37.50
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
215
csusm 10.2415/GC-MONO-DE-CLEF2007.CSUSM.GEOMODE4 GC-MONO-DE-CLEF2007
Overall statistics for 25 queries : Priority 4
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language German
Relevant 904 Topic Fields title, description
Relevant retrieved 671 Pooled true
Geometric Mean Average Precision 0.0730 Automatic processing of topic's title & description
Binary Preference (BPREF) 0.2200 with relevance feedback
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual German Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 68.53 GEOMODE4
10 49.30 90%
20 41.77
80%
30 28.43
40 22.29 70%
50 16.33
60%
60 11.83
Precision
70 10.59 50%
80 8.91 40%
90 5.40
30%
100 2.36
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
21.41 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual German Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.8126
Minimum 0.0000
First Quartile 0.0300
Second Quartile 0.1237
Third Quartile 0.3598
Interquartile range 0.3298 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.2141
GeoCLEF Monolingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2050 8
Number of Topics of the Experiment
7
Lower Outlier Threshold 0.0000
6
Upper Outlier Threshold 0.8126 5
Mean With No Outliers 0.2141 4
3
Std With No Outliers 0.2050
2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual German Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries GEOMODE4
51-GC 20.05 64-GC 0.12 0.8
52-GC 0.00 65-GC 6.04
53-GC 11.63 66-GC 1.04
0.6
54-GC 30.25 67-GC 81.26
55-GC 7.29 68-GC 51.03
56-GC 25.12 69-GC 12.37 0.4
57-GC 2.27 70-GC 10.84
58-GC 27.79 71-GC 34.92 0.2
59-GC 44.52 72-GC 0.42
Difference
60-GC 12.14 73-GC 41.20 0
61-GC 3.24 74-GC 30.79
62-GC 2.12 75-GC 39.63
−0.2
63-GC 39.15
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
216
csusm 10.2415/GC-MONO-DE-CLEF2007.CSUSM.GEOMODE4 GC-MONO-DE-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual German Task − Retrieved documents vs Mean Precision
100%
5 docs 34.40 GEOMODE4
10 docs 28.00 90%
15 docs 23.73
80%
20 docs 21.60
30 docs 18.93 70%
100 docs 12.40
60%
200 docs 8.36
Precision
500 docs 4.61 50%
1000 docs 2.68 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
22.99
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual German Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7541
Minimum 0.0000
First Quartile 0.0326
Second Quartile 0.2000
Third Quartile 0.3546
Interquartile range 0.3220 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.2299
GeoCLEF Monolingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2041 8
Number of Topics of the Experiment
7
Lower Outlier Threshold 0.0000
6
Upper Outlier Threshold 0.7541 5
Mean With No Outliers 0.2299 4
3
Std With No Outliers 0.2041
2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual German Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries GEOMODE4
51-GC 26.67 64-GC 0.00 0.8
52-GC 0.00 65-GC 13.68
53-GC 10.00 66-GC 0.00
0.6
54-GC 50.00 67-GC 75.41
55-GC 14.29 68-GC 53.90
56-GC 20.00 69-GC 20.00 0.4
57-GC 0.00 70-GC 17.39
58-GC 36.84 71-GC 42.86 0.2
59-GC 25.00 72-GC 0.00
Difference
60-GC 23.08 73-GC 28.57 0
61-GC 4.35 74-GC 25.00
62-GC 0.00 75-GC 52.63
−0.2
63-GC 35.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
217
csusm 10.2415/GC-MONO-DE-CLEF2007.CSUSM.GEOMODE5 GC-MONO-DE-CLEF2007
Overall statistics for 25 queries : Priority 5
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language German
Relevant 904 Topic Fields title, description, narrative
Relevant retrieved 671 Pooled true
Geometric Mean Average Precision 0.0730 Automatic processing of topic's title, description
Binary Preference (BPREF) 0.2200 & narrative with relevance feedback
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual German Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 68.53 GEOMODE5
10 49.30 90%
20 41.77
80%
30 28.43
40 22.29 70%
50 16.33
60%
60 11.83
Precision
70 10.59 50%
80 8.91 40%
90 5.40
30%
100 2.36
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
21.41 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual German Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.8126
Minimum 0.0000
First Quartile 0.0300
Second Quartile 0.1237
Third Quartile 0.3598
Interquartile range 0.3298 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.2141
GeoCLEF Monolingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2050 8
Number of Topics of the Experiment
7
Lower Outlier Threshold 0.0000
6
Upper Outlier Threshold 0.8126 5
Mean With No Outliers 0.2141 4
3
Std With No Outliers 0.2050
2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual German Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries GEOMODE5
51-GC 20.05 64-GC 0.12 0.8
52-GC 0.00 65-GC 6.04
53-GC 11.63 66-GC 1.04
0.6
54-GC 30.25 67-GC 81.26
55-GC 7.29 68-GC 51.03
56-GC 25.12 69-GC 12.37 0.4
57-GC 2.27 70-GC 10.84
58-GC 27.79 71-GC 34.92 0.2
59-GC 44.52 72-GC 0.42
Difference
60-GC 12.14 73-GC 41.20 0
61-GC 3.24 74-GC 30.79
62-GC 2.12 75-GC 39.63
−0.2
63-GC 39.15
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
218
csusm 10.2415/GC-MONO-DE-CLEF2007.CSUSM.GEOMODE5 GC-MONO-DE-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual German Task − Retrieved documents vs Mean Precision
100%
5 docs 34.40 GEOMODE5
10 docs 28.00 90%
15 docs 23.73
80%
20 docs 21.60
30 docs 18.93 70%
100 docs 12.40
60%
200 docs 8.36
Precision
500 docs 4.61 50%
1000 docs 2.68 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
22.99
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual German Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7541
Minimum 0.0000
First Quartile 0.0326
Second Quartile 0.2000
Third Quartile 0.3546
Interquartile range 0.3220 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.2299
GeoCLEF Monolingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2041 8
Number of Topics of the Experiment
7
Lower Outlier Threshold 0.0000
6
Upper Outlier Threshold 0.7541 5
Mean With No Outliers 0.2299 4
3
Std With No Outliers 0.2041
2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual German Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries GEOMODE5
51-GC 26.67 64-GC 0.00 0.8
52-GC 0.00 65-GC 13.68
53-GC 10.00 66-GC 0.00
0.6
54-GC 50.00 67-GC 75.41
55-GC 14.29 68-GC 53.90
56-GC 20.00 69-GC 20.00 0.4
57-GC 0.00 70-GC 17.39
58-GC 36.84 71-GC 42.86 0.2
59-GC 25.00 72-GC 0.00
Difference
60-GC 23.08 73-GC 28.57 0
61-GC 4.35 74-GC 25.00
62-GC 0.00 75-GC 52.63
−0.2
63-GC 35.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
219
csusm 10.2415/GC-MONO-DE-CLEF2007.CSUSM.GEOMODE6 GC-MONO-DE-CLEF2007
Overall statistics for 25 queries : Priority 6
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language German
Relevant 904 Topic Fields title, description, narrative
Relevant retrieved 628 Pooled true
Geometric Mean Average Precision 0.0703 Automatic processing of topic's title, description
Binary Preference (BPREF) 0.2120 & narrative
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual German Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 68.57 GEOMODE6
10 48.90 90%
20 40.23
80%
30 27.08
40 21.29 70%
50 14.98
60%
60 10.80
Precision
70 8.54 50%
80 7.27 40%
90 5.20
30%
100 2.18
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
20.38 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual German Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.8126
Minimum 0.0000
First Quartile 0.0300
Second Quartile 0.1237
Third Quartile 0.3182
Interquartile range 0.2883 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.2038
GeoCLEF Monolingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1964 8
Number of Topics of the Experiment
7
Lower Outlier Threshold 0.0000
6
Upper Outlier Threshold 0.4452 5
Mean With No Outliers 0.1784 4
3
Std With No Outliers 0.1532
2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual German Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries GEOMODE6
51-GC 13.57 64-GC 0.12 0.8
52-GC 0.00 65-GC 8.19
53-GC 11.63 66-GC 0.77
0.6
54-GC 30.25 67-GC 81.26
55-GC 7.29 68-GC 29.88
56-GC 25.12 69-GC 12.37 0.4
57-GC 2.27 70-GC 10.84
58-GC 27.79 71-GC 34.92 0.2
59-GC 44.52 72-GC 0.42
Difference
60-GC 12.14 73-GC 41.20 0
61-GC 3.24 74-GC 30.79
62-GC 2.12 75-GC 39.63
−0.2
63-GC 39.15
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
220
csusm 10.2415/GC-MONO-DE-CLEF2007.CSUSM.GEOMODE6 GC-MONO-DE-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual German Task − Retrieved documents vs Mean Precision
100%
5 docs 36.00 GEOMODE6
10 docs 30.40 90%
15 docs 24.27
80%
20 docs 21.20
30 docs 17.47 70%
100 docs 11.64
60%
200 docs 7.58
Precision
500 docs 4.10 50%
1000 docs 2.51 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
22.10
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual German Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7541
Minimum 0.0000
First Quartile 0.0326
Second Quartile 0.2000
Third Quartile 0.3546
Interquartile range 0.3220 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.2210
GeoCLEF Monolingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1975 8
Number of Topics of the Experiment
7
Lower Outlier Threshold 0.0000
6
Upper Outlier Threshold 0.7541 5
Mean With No Outliers 0.2210 4
3
Std With No Outliers 0.1975
2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual German Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries GEOMODE6
51-GC 20.00 64-GC 0.00 0.8
52-GC 0.00 65-GC 11.58
53-GC 10.00 66-GC 0.00
0.6
54-GC 50.00 67-GC 75.41
55-GC 14.29 68-GC 40.52
56-GC 20.00 69-GC 20.00 0.4
57-GC 0.00 70-GC 17.39
58-GC 36.84 71-GC 42.86 0.2
59-GC 25.00 72-GC 0.00
Difference
60-GC 23.08 73-GC 28.57 0
61-GC 4.35 74-GC 25.00
62-GC 0.00 75-GC 52.63
−0.2
63-GC 35.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
221
hagen 10.2415/GC-MONO-DE-CLEF2007.HAGEN.FUHTD2DE GC-MONO-DE-CLEF2007
Overall statistics for 25 queries : Priority 4
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 24,967 Source Language German
Relevant 904 Topic Fields title, description
Relevant retrieved 707 Pooled true
Geometric Mean Average Precision 0.0249 FUHtd2de
Binary Preference (BPREF) 0.2102
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual German Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 45.40 FUHTD2DE
10 36.53 90%
20 32.69
80%
30 26.55
40 22.00 70%
50 19.88
60%
60 15.99
Precision
70 12.38 50%
80 7.45 40%
90 4.66
30%
100 3.09
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
19.11 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual German Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7759
Minimum 0.0000
First Quartile 0.0029
Second Quartile 0.0421
Third Quartile 0.3311
Interquartile range 0.3282 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.1911
GeoCLEF Monolingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2305 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.7759 10
Mean With No Outliers 0.1911
Std With No Outliers 0.2305 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual German Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries FUHTD2DE
51-GC 0.14 64-GC 0.23 0.8
52-GC 0.00 65-GC 30.11
53-GC 4.21 66-GC 2.50
0.6
54-GC 25.94 67-GC 77.59
55-GC 0.00 68-GC 42.46
56-GC 0.31 69-GC 63.47 0.4
57-GC 0.71 70-GC 1.57
58-GC 23.10 71-GC 1.85 0.2
59-GC 0.32 72-GC 0.14
Difference
60-GC 42.10 73-GC 0.24 0
61-GC 22.53 74-GC 19.34
62-GC 21.45 75-GC 52.39
−0.2
63-GC 45.04
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
222
hagen 10.2415/GC-MONO-DE-CLEF2007.HAGEN.FUHTD2DE GC-MONO-DE-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual German Task − Retrieved documents vs Mean Precision
100%
5 docs 28.80 FUHTD2DE
10 docs 26.40 90%
15 docs 27.20
80%
20 docs 25.40
30 docs 24.00 70%
100 docs 14.48
60%
200 docs 9.50
Precision
500 docs 5.07 50%
1000 docs 2.83 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
21.66
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual German Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7869
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0333
Third Quartile 0.4408
Interquartile range 0.4408 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.2166
GeoCLEF Monolingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2611 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.7869 10
Mean With No Outliers 0.2166
Std With No Outliers 0.2611 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual German Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries FUHTD2DE
51-GC 3.33 64-GC 0.00 0.8
52-GC 0.00 65-GC 42.11
53-GC 0.00 66-GC 0.00
0.6
54-GC 25.00 67-GC 78.69
55-GC 0.00 68-GC 52.04
56-GC 0.00 69-GC 73.33 0.4
57-GC 0.00 70-GC 0.00
58-GC 21.05 71-GC 0.00 0.2
59-GC 0.00 72-GC 0.00
Difference
60-GC 50.00 73-GC 0.00 0
61-GC 30.43 74-GC 37.50
62-GC 21.88 75-GC 56.14
−0.2
63-GC 50.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
223
hagen 10.2415/GC-MONO-DE-CLEF2007.HAGEN.FUHTD3DE GC-MONO-DE-CLEF2007
Overall statistics for 25 queries : Priority 3
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language German
Relevant 904 Topic Fields title, description
Relevant retrieved 677 Pooled true
Geometric Mean Average Precision 0.0462 FUHtd3de
Binary Preference (BPREF) 0.2012
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual German Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 49.99 FUHTD3DE
10 36.52 90%
20 34.82
80%
30 30.32
40 23.92 70%
50 19.63
60%
60 12.77
Precision
70 9.46 50%
80 5.90 40%
90 4.54
30%
100 2.96
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
19.09 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual German Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7922
Minimum 0.0000
First Quartile 0.0209
Second Quartile 0.1151
Third Quartile 0.3560
Interquartile range 0.3352 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.1909
GeoCLEF Monolingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2173 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.7922 10
Mean With No Outliers 0.1909
Std With No Outliers 0.2173 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual German Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries FUHTD3DE
51-GC 0.15 64-GC 2.38 0.8
52-GC 0.00 65-GC 34.79
53-GC 2.88 66-GC 1.67
0.6
54-GC 51.14 67-GC 79.22
55-GC 0.05 68-GC 38.03
56-GC 0.25 69-GC 12.25 0.4
57-GC 20.00 70-GC 11.51
58-GC 18.22 71-GC 2.26 0.2
59-GC 4.17 72-GC 2.23
Difference
60-GC 39.18 73-GC 0.95 0
61-GC 53.04 74-GC 6.40
62-GC 18.17 75-GC 43.98
−0.2
63-GC 34.40
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
224
hagen 10.2415/GC-MONO-DE-CLEF2007.HAGEN.FUHTD3DE GC-MONO-DE-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual German Task − Retrieved documents vs Mean Precision
100%
5 docs 27.20 FUHTD3DE
10 docs 27.60 90%
15 docs 26.67
80%
20 docs 26.00
30 docs 24.40 70%
100 docs 15.08
60%
200 docs 9.06
Precision
500 docs 4.69 50%
1000 docs 2.71 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
21.58
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual German Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7213
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.1579
Third Quartile 0.4396
Interquartile range 0.4396 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.2158
GeoCLEF Monolingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2248 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 8
Upper Outlier Threshold 0.7213
6
Mean With No Outliers 0.2158
4
Std With No Outliers 0.2248
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual German Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries FUHTD3DE
51-GC 3.33 64-GC 7.69 0.8
52-GC 0.00 65-GC 45.26
53-GC 0.00 66-GC 0.00
0.6
54-GC 50.00 67-GC 72.13
55-GC 0.00 68-GC 43.87
56-GC 0.00 69-GC 31.11 0.4
57-GC 0.00 70-GC 21.74
58-GC 15.79 71-GC 0.00 0.2
59-GC 0.00 72-GC 10.00
Difference
60-GC 44.23 73-GC 0.00 0
61-GC 54.35 74-GC 25.00
62-GC 28.12 75-GC 51.75
−0.2
63-GC 35.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
225
hagen 10.2415/GC-MONO-DE-CLEF2007.HAGEN.FUHTD6DE GC-MONO-DE-CLEF2007
Overall statistics for 25 queries : Priority 5
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language German
Relevant 904 Topic Fields title, description
Relevant retrieved 680 Pooled true
Geometric Mean Average Precision 0.0550 merged deep results
Binary Preference (BPREF) 0.2095
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual German Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 49.71 FUHTD6DE
10 38.28 90%
20 36.93
80%
30 32.17
40 24.94 70%
50 19.82
60%
60 13.21
Precision
70 9.54 50%
80 5.94 40%
90 4.54
30%
100 2.96
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
19.57 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual German Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7922
Minimum 0.0000
First Quartile 0.0235
Second Quartile 0.1131
Third Quartile 0.3522
Interquartile range 0.3287 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.1957
GeoCLEF Monolingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2108 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 8
Upper Outlier Threshold 0.7922
6
Mean With No Outliers 0.1957
4
Std With No Outliers 0.2108
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual German Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries FUHTD6DE
51-GC 0.15 64-GC 2.38 0.8
52-GC 0.00 65-GC 29.07
53-GC 2.88 66-GC 1.67
0.6
54-GC 51.14 67-GC 79.22
55-GC 0.05 68-GC 37.69
56-GC 2.98 69-GC 11.08 0.4
57-GC 20.00 70-GC 11.31
58-GC 18.22 71-GC 2.26 0.2
59-GC 4.17 72-GC 20.81
Difference
60-GC 39.18 73-GC 0.95 0
61-GC 49.20 74-GC 6.40
62-GC 18.17 75-GC 45.99
−0.2
63-GC 34.40
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
226
hagen 10.2415/GC-MONO-DE-CLEF2007.HAGEN.FUHTD6DE GC-MONO-DE-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual German Task − Retrieved documents vs Mean Precision
100%
5 docs 28.00 FUHTD6DE
10 docs 28.00 90%
15 docs 26.93
80%
20 docs 26.00
30 docs 23.60 70%
100 docs 15.20
60%
200 docs 9.16
Precision
500 docs 4.71 50%
1000 docs 2.72 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
22.68
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual German Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7213
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.2174
Third Quartile 0.4396
Interquartile range 0.4396 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.2268
GeoCLEF Monolingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2287 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 8
Upper Outlier Threshold 0.7213
6
Mean With No Outliers 0.2268
4
Std With No Outliers 0.2287
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual German Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries FUHTD6DE
51-GC 3.33 64-GC 7.69 0.8
52-GC 0.00 65-GC 46.32
53-GC 0.00 66-GC 0.00
0.6
54-GC 50.00 67-GC 72.13
55-GC 0.00 68-GC 43.87
56-GC 0.00 69-GC 31.11 0.4
57-GC 0.00 70-GC 21.74
58-GC 15.79 71-GC 0.00 0.2
59-GC 0.00 72-GC 30.00
Difference
60-GC 44.23 73-GC 0.00 0
61-GC 60.87 74-GC 25.00
62-GC 28.12 75-GC 51.75
−0.2
63-GC 35.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
227
hagen 10.2415/GC-MONO-DE-CLEF2007.HAGEN.FUHTDN4DE GC-MONO-DE-CLEF2007
Overall statistics for 25 queries : Priority 2
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language German
Relevant 904 Topic Fields title, description, narrative
Relevant retrieved 722 Pooled true
Geometric Mean Average Precision 0.0545 FUHtdn4de
Binary Preference (BPREF) 0.2320
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual German Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 46.33 FUHTDN4DE
10 41.47 90%
20 39.95
80%
30 32.82
40 27.78 70%
50 24.64
60%
60 20.17
Precision
70 18.26 50%
80 11.51 40%
90 7.46
30%
100 5.46
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
23.58 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual German Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7759
Minimum 0.0000
First Quartile 0.0203
Second Quartile 0.1356
Third Quartile 0.4417
Interquartile range 0.4214 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.2358
GeoCLEF Monolingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2449 8
Number of Topics of the Experiment
7
Lower Outlier Threshold 0.0000
6
Upper Outlier Threshold 0.7759 5
Mean With No Outliers 0.2358 4
3
Std With No Outliers 0.2449
2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual German Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries FUHTDN4DE
51-GC 5.80 64-GC 0.03 0.8
52-GC 0.00 65-GC 30.11
53-GC 13.56 66-GC 8.10
0.6
54-GC 2.14 67-GC 77.59
55-GC 0.06 68-GC 42.46
56-GC 3.67 69-GC 64.40 0.4
57-GC 25.00 70-GC 1.67
58-GC 19.37 71-GC 9.51 0.2
59-GC 43.85 72-GC 0.14
Difference
60-GC 54.36 73-GC 5.21 0
61-GC 22.90 74-GC 48.10
62-GC 1.23 75-GC 65.16
−0.2
63-GC 45.13
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
228
hagen 10.2415/GC-MONO-DE-CLEF2007.HAGEN.FUHTDN4DE GC-MONO-DE-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual German Task − Retrieved documents vs Mean Precision
100%
5 docs 32.80 FUHTDN4DE
10 docs 28.80 90%
15 docs 28.80
80%
20 docs 27.20
30 docs 25.20 70%
100 docs 15.68
60%
200 docs 10.18
Precision
500 docs 5.24 50%
1000 docs 2.89 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
23.67
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual German Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7869
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.1429
Third Quartile 0.4283
Interquartile range 0.4283 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.2367
GeoCLEF Monolingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2569 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 8
Upper Outlier Threshold 0.7869
6
Mean With No Outliers 0.2367
4
Std With No Outliers 0.2569
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual German Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries FUHTDN4DE
51-GC 10.00 64-GC 0.00 0.8
52-GC 0.00 65-GC 42.11
53-GC 30.00 66-GC 0.00
0.6
54-GC 0.00 67-GC 78.69
55-GC 0.00 68-GC 52.04
56-GC 0.00 69-GC 73.33 0.4
57-GC 0.00 70-GC 0.00
58-GC 15.79 71-GC 14.29 0.2
59-GC 25.00 72-GC 0.00
Difference
60-GC 53.85 73-GC 14.29 0
61-GC 32.61 74-GC 37.50
62-GC 3.12 75-GC 64.04
−0.2
63-GC 45.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
229
hagen 10.2415/GC-MONO-DE-CLEF2007.HAGEN.FUHTDN5DE GC-MONO-DE-CLEF2007
Overall statistics for 25 queries : Priority 1
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language German
Relevant 904 Topic Fields title, description, narrative
Relevant retrieved 717 Pooled true
Geometric Mean Average Precision 0.0949 FUHtdn5de
Binary Preference (BPREF) 0.2394
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual German Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 58.01 FUHTDN5DE
10 49.99 90%
20 45.42
80%
30 36.34
40 29.90 70%
50 23.85
60%
60 19.75
Precision
70 16.61 50%
80 10.65 40%
90 7.61
30%
100 5.76
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
25.76 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual German Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7922
Minimum 0.0000
First Quartile 0.0489
Second Quartile 0.2618
Third Quartile 0.4435
Interquartile range 0.3946 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.2576
GeoCLEF Monolingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2254 6
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 5
Upper Outlier Threshold 0.7922 4
Mean With No Outliers 0.2576 3
Std With No Outliers 0.2254 2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual German Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries FUHTDN5DE
51-GC 5.02 64-GC 1.94 0.8
52-GC 0.00 65-GC 34.79
53-GC 13.22 66-GC 7.36
0.6
54-GC 8.40 67-GC 79.22
55-GC 0.13 68-GC 38.03
56-GC 4.50 69-GC 30.30 0.4
57-GC 50.00 70-GC 12.43
58-GC 26.18 71-GC 9.31 0.2
59-GC 54.57 72-GC 2.23
Difference
60-GC 51.20 73-GC 27.84 0
61-GC 54.00 74-GC 42.47
62-GC 1.49 75-GC 50.03
−0.2
63-GC 39.41
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
230
hagen 10.2415/GC-MONO-DE-CLEF2007.HAGEN.FUHTDN5DE GC-MONO-DE-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual German Task − Retrieved documents vs Mean Precision
100%
5 docs 33.60 FUHTDN5DE
10 docs 32.80 90%
15 docs 29.60
80%
20 docs 28.80
30 docs 26.27 70%
100 docs 16.92
60%
200 docs 10.26
Precision
500 docs 5.03 50%
1000 docs 2.87 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
26.58
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual German Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7213
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.2857
Third Quartile 0.4422
Interquartile range 0.4422 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.2658
GeoCLEF Monolingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2373 8
Number of Topics of the Experiment
7
Lower Outlier Threshold 0.0000
6
Upper Outlier Threshold 0.7213 5
Mean With No Outliers 0.2658 4
3
Std With No Outliers 0.2373
2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual German Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries FUHTDN5DE
51-GC 6.67 64-GC 0.00 0.8
52-GC 0.00 65-GC 45.26
53-GC 30.00 66-GC 0.00
0.6
54-GC 0.00 67-GC 72.13
55-GC 0.00 68-GC 43.87
56-GC 0.00 69-GC 42.22 0.4
57-GC 0.00 70-GC 21.74
58-GC 42.11 71-GC 14.29 0.2
59-GC 50.00 72-GC 10.00
Difference
60-GC 55.77 73-GC 28.57 0
61-GC 56.52 74-GC 37.50
62-GC 3.12 75-GC 62.28
−0.2
63-GC 42.50
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
231
hildesheim 10.2415/GC-MONO-DE-CLEF2007.HILDESHEIM.HIMODEBASE GC-MONO-DE-CLEF2007
Overall statistics for 25 queries : Priority 1
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 22,709 Source Language German
Relevant 904 Topic Fields title, description
Relevant retrieved 640 Pooled true
Geometric Mean Average Precision 0.0403 Base Run, BRF only
Binary Preference (BPREF) 0.2061
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual German Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 44.91 HIMODEBASE
10 38.60 90%
20 31.85
80%
30 26.04
40 23.10 70%
50 20.81
60%
60 19.07
Precision
70 16.46 50%
80 9.05 40%
90 5.96
30%
100 1.78
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
20.19 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual German Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.8396
Minimum 0.0000
First Quartile 0.0077
Second Quartile 0.0462
Third Quartile 0.3834
Interquartile range 0.3758 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.2019
GeoCLEF Monolingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2602 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.8396 10
Mean With No Outliers 0.2019
Std With No Outliers 0.2602 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual German Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries HIMODEBASE
51-GC 0.80 64-GC 1.54 0.8
52-GC 0.00 65-GC 3.54
53-GC 0.09 66-GC 0.39
0.6
54-GC 53.19 67-GC 73.39
55-GC 0.66 68-GC 44.30
56-GC 4.62 69-GC 61.67 0.4
57-GC 0.29 70-GC 0.51
58-GC 14.24 71-GC 5.17 0.2
59-GC 47.50 72-GC 12.55
Difference
60-GC 2.41 73-GC 4.08 0
61-GC 19.82 74-GC 2.24
62-GC 36.36 75-GC 83.96
−0.2
63-GC 31.45
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
232
hildesheim 10.2415/GC-MONO-DE-CLEF2007.HILDESHEIM.HIMODEBASE GC-MONO-DE-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual German Task − Retrieved documents vs Mean Precision
100%
5 docs 28.00 HIMODEBASE
10 docs 24.80 90%
15 docs 24.53
80%
20 docs 23.40
30 docs 21.47 70%
100 docs 13.92
60%
200 docs 9.04
Precision
500 docs 4.49 50%
1000 docs 2.56 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
19.93
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual German Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7705
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0769
Third Quartile 0.3828
Interquartile range 0.3828 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.1993
GeoCLEF Monolingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2595 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.7705 10
Mean With No Outliers 0.1993
Std With No Outliers 0.2595 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual German Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries HIMODEBASE
51-GC 0.00 64-GC 7.69 0.8
52-GC 0.00 65-GC 11.58
53-GC 0.00 66-GC 0.00
0.6
54-GC 50.00 67-GC 77.05
55-GC 0.00 68-GC 50.93
56-GC 0.00 69-GC 66.67 0.4
57-GC 0.00 70-GC 0.00
58-GC 15.79 71-GC 0.00 0.2
59-GC 25.00 72-GC 10.00
Difference
60-GC 3.85 73-GC 0.00 0
61-GC 26.09 74-GC 0.00
62-GC 40.62 75-GC 75.44
−0.2
63-GC 37.50
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
233
hildesheim 10.2415/GC-MONO-DE-CLEF2007.HILDESHEIM.HIMODENE2 GC-MONO-DE-CLEF2007
Overall statistics for 25 queries : Priority 2
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 23,986 Source Language Spanish; Castilian
Relevant 904 Topic Fields title, description
Relevant retrieved 674 Pooled true
Geometric Mean Average Precision 0.0434 NER new lingpipe model
Binary Preference (BPREF) 0.1941
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual German Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 43.02 HIMODENE2
10 35.40 90%
20 28.72
80%
30 26.12
40 23.90 70%
50 21.16
60%
60 17.22
Precision
70 14.94 50%
80 9.37 40%
90 5.90
30%
100 2.40
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
19.53 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual German Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.8481
Minimum 0.0000
First Quartile 0.0136
Second Quartile 0.0689
Third Quartile 0.2882
Interquartile range 0.2747 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.1953
GeoCLEF Monolingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2565 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.6383 10
Mean With No Outliers 0.1427
Std With No Outliers 0.1882 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual German Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries HIMODENE2
51-GC 1.08 64-GC 1.45 0.8
52-GC 0.00 65-GC 13.41
53-GC 0.04 66-GC 1.75
0.6
54-GC 63.83 67-GC 75.18
55-GC 0.77 68-GC 54.44
56-GC 4.56 69-GC 45.91 0.4
57-GC 0.78 70-GC 0.35
58-GC 7.88 71-GC 6.89 0.2
59-GC 22.92 72-GC 15.74
Difference
60-GC 2.48 73-GC 4.24 0
61-GC 15.03 74-GC 2.33
62-GC 35.82 75-GC 84.81
−0.2
63-GC 26.49
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
234
hildesheim 10.2415/GC-MONO-DE-CLEF2007.HILDESHEIM.HIMODENE2 GC-MONO-DE-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual German Task − Retrieved documents vs Mean Precision
100%
5 docs 24.80 HIMODENE2
10 docs 24.80 90%
15 docs 23.47
80%
20 docs 23.40
30 docs 21.47 70%
100 docs 15.40
60%
200 docs 9.72
Precision
500 docs 4.72 50%
1000 docs 2.70 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
19.48
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual German Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7544
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0769
Third Quartile 0.3531
Interquartile range 0.3531 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.1948
GeoCLEF Monolingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2433 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.7544 10
Mean With No Outliers 0.1948
Std With No Outliers 0.2433 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual German Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries HIMODENE2
51-GC 0.00 64-GC 7.69 0.8
52-GC 0.00 65-GC 30.53
53-GC 0.00 66-GC 0.00
0.6
54-GC 50.00 67-GC 72.13
55-GC 0.00 68-GC 52.04
56-GC 0.00 69-GC 46.67 0.4
57-GC 0.00 70-GC 0.00
58-GC 15.79 71-GC 0.00 0.2
59-GC 25.00 72-GC 10.00
Difference
60-GC 3.85 73-GC 0.00 0
61-GC 21.74 74-GC 0.00
62-GC 43.75 75-GC 75.44
−0.2
63-GC 32.50
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
235
hildesheim 10.2415/GC-MONO-DE-CLEF2007.HILDESHEIM.HIMODENE2NA GC-MONO-DE-CLEF2007
Overall statistics for 25 queries : Priority 3
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 24,346 Source Language Spanish; Castilian
Relevant 904 Topic Fields title, description, narrative
Relevant retrieved 645 Pooled true
Geometric Mean Average Precision 0.0622 using new NER model and narratives
Binary Preference (BPREF) 0.2135
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual German Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 44.44 HIMODENE2NA
10 37.65 90%
20 33.31
80%
30 28.48
40 25.19 70%
50 22.67
60%
60 18.55
Precision
70 14.48 50%
80 7.71 40%
90 4.46
30%
100 2.81
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
20.67 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual German Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.8153
Minimum 0.0000
First Quartile 0.0196
Second Quartile 0.1092
Third Quartile 0.3419
Interquartile range 0.3223 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.2067
GeoCLEF Monolingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2403 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 8
Upper Outlier Threshold 0.8153
6
Mean With No Outliers 0.2067
4
Std With No Outliers 0.2403
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual German Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries HIMODENE2NA
51-GC 1.43 64-GC 1.22 0.8
52-GC 0.00 65-GC 15.02
53-GC 1.16 66-GC 3.11
0.6
54-GC 78.03 67-GC 81.53
55-GC 2.42 68-GC 57.82
56-GC 17.25 69-GC 41.54 0.4
57-GC 0.85 70-GC 0.49
58-GC 35.09 71-GC 10.92 0.2
59-GC 23.81 72-GC 8.98
Difference
60-GC 3.33 73-GC 5.61 0
61-GC 21.99 74-GC 2.14
62-GC 33.89 75-GC 42.55
−0.2
63-GC 26.63
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
236
hildesheim 10.2415/GC-MONO-DE-CLEF2007.HILDESHEIM.HIMODENE2NA GC-MONO-DE-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual German Task − Retrieved documents vs Mean Precision
100%
5 docs 30.40 HIMODENE2NA
10 docs 27.60 90%
15 docs 26.67
80%
20 docs 25.00
30 docs 22.93 70%
100 docs 14.80
60%
200 docs 9.44
Precision
500 docs 4.60 50%
1000 docs 2.58 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
23.41
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual German Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.8033
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.1429
Third Quartile 0.3975
Interquartile range 0.3975 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.2341
GeoCLEF Monolingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2499 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 8
Upper Outlier Threshold 0.8033
6
Mean With No Outliers 0.2341
4
Std With No Outliers 0.2499
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual German Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries HIMODENE2NA
51-GC 0.00 64-GC 7.69 0.8
52-GC 0.00 65-GC 30.53
53-GC 0.00 66-GC 0.00
0.6
54-GC 75.00 67-GC 80.33
55-GC 0.00 68-GC 57.62
56-GC 20.00 69-GC 51.11 0.4
57-GC 0.00 70-GC 0.00
58-GC 52.63 71-GC 14.29 0.2
59-GC 25.00 72-GC 10.00
Difference
60-GC 3.85 73-GC 14.29 0
61-GC 23.91 74-GC 0.00
62-GC 37.50 75-GC 46.49
−0.2
63-GC 35.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
237
hildesheim 10.2415/GC-MONO-DE-CLEF2007.HILDESHEIM.HIMODENE3 GC-MONO-DE-CLEF2007
Overall statistics for 25 queries : Priority 4
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 23,331 Source Language Spanish; Castilian
Relevant 904 Topic Fields title, description
Relevant retrieved 640 Pooled true
Geometric Mean Average Precision 0.0280 GeoBRF with fewer Terms and heigher weight
Binary Preference (BPREF) 0.1786
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual German Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 40.37 HIMODENE3
10 35.11 90%
20 27.72
80%
30 23.42
40 20.10 70%
50 17.99
60%
60 15.53
Precision
70 14.13 50%
80 8.85 40%
90 5.06
30%
100 1.76
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
17.95 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual German Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.8020
Minimum 0.0000
First Quartile 0.0092
Second Quartile 0.0488
Third Quartile 0.3106
Interquartile range 0.3013 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.1795
GeoCLEF Monolingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2404 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.7407 10
Mean With No Outliers 0.1536
Std With No Outliers 0.2068 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual German Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries HIMODENE3
51-GC 0.64 64-GC 1.28 0.8
52-GC 0.00 65-GC 3.61
53-GC 0.05 66-GC 0.11
0.6
54-GC 22.68 67-GC 74.07
55-GC 1.83 68-GC 46.15
56-GC 4.31 69-GC 53.56 0.4
57-GC 0.00 70-GC 0.81
58-GC 7.59 71-GC 4.88 0.2
59-GC 40.83 72-GC 11.83
Difference
60-GC 0.96 73-GC 5.97 0
61-GC 20.91 74-GC 1.96
62-GC 34.69 75-GC 80.20
−0.2
63-GC 29.85
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
238
hildesheim 10.2415/GC-MONO-DE-CLEF2007.HILDESHEIM.HIMODENE3 GC-MONO-DE-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual German Task − Retrieved documents vs Mean Precision
100%
5 docs 24.80 HIMODENE3
10 docs 24.00 90%
15 docs 23.47
80%
20 docs 22.00
30 docs 21.07 70%
100 docs 14.12
60%
200 docs 8.94
Precision
500 docs 4.55 50%
1000 docs 2.56 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
18.60
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual German Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7705
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0769
Third Quartile 0.3383
Interquartile range 0.3383 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.1860
GeoCLEF Monolingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2467 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.7705 10
Mean With No Outliers 0.1860
Std With No Outliers 0.2467 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual German Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries HIMODENE3
51-GC 0.00 64-GC 7.69 0.8
52-GC 0.00 65-GC 11.58
53-GC 0.00 66-GC 0.00
0.6
54-GC 25.00 67-GC 77.05
55-GC 0.00 68-GC 51.30
56-GC 0.00 69-GC 57.78 0.4
57-GC 0.00 70-GC 0.00
58-GC 10.53 71-GC 0.00 0.2
59-GC 25.00 72-GC 10.00
Difference
60-GC 3.85 73-GC 0.00 0
61-GC 32.61 74-GC 0.00
62-GC 40.62 75-GC 74.56
−0.2
63-GC 37.50
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
239
catalunya 10.2415/GC-MONO-EN-CLEF2007.CATALUNYA.TALPGEOIRTD1 GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 1
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language English
Relevant 650 Topic Fields title, description
Relevant retrieved 593 Pooled true
Geometric Mean Average Precision 0.0502 (See overleaf for description)
Binary Preference (BPREF) 0.2500
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 48.28 TALPGEOIRTD1
10 46.91 90%
20 42.47
80%
30 36.73
40 27.79 70%
50 26.77
60%
60 24.23
Precision
70 21.18 50%
80 16.74 40%
90 11.20
30%
100 5.11
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
27.11 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7816
Minimum 0.0000
First Quartile 0.0234
Second Quartile 0.2053
Third Quartile 0.4422
Interquartile range 0.4188 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.2711
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2681 8
Number of Topics of the Experiment
7
Lower Outlier Threshold 0.0000
6
Upper Outlier Threshold 0.7816 5
Mean With No Outliers 0.2711 4
3
Std With No Outliers 0.2681
2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries TALPGEOIRTD1
51-GC 70.45 64-GC 1.16 0.8
52-GC 1.44 65-GC 43.04
53-GC 15.44 66-GC 16.89
0.6
54-GC 11.47 67-GC 41.41
55-GC 20.53 68-GC 75.16
56-GC 47.77 69-GC 29.58 0.4
57-GC 21.49 70-GC 0.58
58-GC 5.49 71-GC 0.00 0.2
59-GC 0.00 72-GC 70.71
Difference
60-GC 78.16 73-GC 2.64 0
61-GC 5.04 74-GC 34.06
62-GC 22.96 75-GC 62.33
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
240
catalunya 10.2415/GC-MONO-EN-CLEF2007.CATALUNYA.TALPGEOIRTD1 GC-MONO-EN-CLEF2007
pure IR-based experiment with no Geographical
processing. UsingTerrier over a lemmatized
collection applying TFIDF with Porter Stemmer and
Query Expansion (docs=10;terms=40)
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 30.40 TALPGEOIRTD1
10 docs 30.00 90%
15 docs 28.53
80%
20 docs 25.40
30 docs 22.40 70%
100 docs 14.80
60%
200 docs 9.76
Precision
500 docs 4.56 50%
1000 docs 2.37 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
28.47
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7857
Minimum 0.0000
First Quartile 0.0341
Second Quartile 0.2500
Third Quartile 0.4395
Interquartile range 0.4054 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.2847
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2520 8
Number of Topics of the Experiment
7
Lower Outlier Threshold 0.0000
6
Upper Outlier Threshold 0.7857 5
Mean With No Outliers 0.2847 4
3
Std With No Outliers 0.2520
2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries TALPGEOIRTD1
51-GC 64.29 64-GC 0.00 0.8
52-GC 9.09 65-GC 41.94
53-GC 23.44 66-GC 33.33
0.6
54-GC 14.29 67-GC 29.41
55-GC 25.00 68-GC 70.99
56-GC 50.00 69-GC 28.57 0.4
57-GC 33.33 70-GC 0.00
58-GC 16.67 71-GC 0.00 0.2
59-GC 0.00 72-GC 78.57
Difference
60-GC 70.00 73-GC 0.00 0
61-GC 4.55 74-GC 33.33
62-GC 25.00 75-GC 60.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
241
catalunya 10.2415/GC-MONO-EN-CLEF2007.CATALUNYA.TALPGEOIRTD2 GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 3
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language English
Relevant 650 Topic Fields title, description
Relevant retrieved 587 Pooled false
Geometric Mean Average Precision 0.0594 (See overleaf for description)
Binary Preference (BPREF) 0.2746
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 53.40 TALPGEOIRTD2
10 48.33 90%
20 46.11
80%
30 40.09
40 31.25 70%
50 29.45
60%
60 26.27
Precision
70 21.27 50%
80 16.23 40%
90 9.28
30%
100 3.78
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
28.50 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7757
Minimum 0.0000
First Quartile 0.0527
Second Quartile 0.2031
Third Quartile 0.4587
Interquartile range 0.4060 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.2850
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2609 6
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 5
Upper Outlier Threshold 0.7757 4
Mean With No Outliers 0.2850 3
Std With No Outliers 0.2609 2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries TALPGEOIRTD2
51-GC 68.20 64-GC 1.49 0.8
52-GC 2.39 65-GC 43.30
53-GC 19.91 66-GC 16.89
0.6
54-GC 13.80 67-GC 17.15
55-GC 20.31 68-GC 75.15
56-GC 47.77 69-GC 29.58 0.4
57-GC 21.69 70-GC 6.23
58-GC 6.64 71-GC 0.00 0.2
59-GC 0.00 72-GC 70.71
Difference
60-GC 77.57 73-GC 0.88 0
61-GC 45.23 74-GC 45.00
62-GC 22.96 75-GC 59.68
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
242
catalunya 10.2415/GC-MONO-EN-CLEF2007.CATALUNYA.TALPGEOIRTD2 GC-MONO-EN-CLEF2007
Textual serach with Geographical document
filtering. Terrier IR with Query Expansion,
Stemmer, over a lemmatized collection with TFIDF
and retrieving 10000 docs per topic. A process of
geo-filtering based on hierachical geographical
matching re-ranks the textually retrieved docs.
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 33.60 TALPGEOIRTD2
10 docs 33.20 90%
15 docs 30.93
80%
20 docs 29.00
30 docs 25.33 70%
100 docs 15.28
60%
200 docs 9.82
Precision
500 docs 4.44 50%
1000 docs 2.35 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
31.70
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7857
Minimum 0.0000
First Quartile 0.1003
Second Quartile 0.3333
Third Quartile 0.5227
Interquartile range 0.4224 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.3170
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2488 5
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 4
Upper Outlier Threshold 0.7857
3
Mean With No Outliers 0.3170
2
Std With No Outliers 0.2488
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries TALPGEOIRTD2
51-GC 63.39 64-GC 0.00 0.8
52-GC 9.09 65-GC 41.94
53-GC 34.38 66-GC 33.33
0.6
54-GC 14.29 67-GC 35.29
55-GC 25.00 68-GC 70.99
56-GC 50.00 69-GC 28.57 0.4
57-GC 33.33 70-GC 10.34
58-GC 16.67 71-GC 0.00 0.2
59-GC 0.00 72-GC 78.57
Difference
60-GC 70.00 73-GC 0.00 0
61-GC 59.09 74-GC 33.33
62-GC 25.00 75-GC 60.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
243
catalunya 10.2415/GC-MONO-EN-CLEF2007.CATALUNYA.TALPGEOIRTDN1 GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 2
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language Spanish; Castilian
Relevant 650 Topic Fields title, description, narrative
Relevant retrieved 606 Pooled true
Geometric Mean Average Precision 0.0373 (See overleaf for description)
Binary Preference (BPREF) 0.2352
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 47.03 TALPGEOIRTDN1
10 42.38 90%
20 37.85
80%
30 34.12
40 28.71 70%
50 27.14
60%
60 25.03
Precision
70 22.63 50%
80 18.74 40%
90 12.45
30%
100 6.02
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
26.25 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7818
Minimum 0.0000
First Quartile 0.0119
Second Quartile 0.2239
Third Quartile 0.4241
Interquartile range 0.4122 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.2625
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2750 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 8
Upper Outlier Threshold 0.7818
6
Mean With No Outliers 0.2625
4
Std With No Outliers 0.2750
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries TALPGEOIRTDN1
51-GC 77.28 64-GC 6.62 0.8
52-GC 0.11 65-GC 40.97
53-GC 25.44 66-GC 4.38
0.6
54-GC 0.25 67-GC 39.94
55-GC 22.39 68-GC 75.79
56-GC 22.96 69-GC 29.42 0.4
57-GC 42.62 70-GC 0.40
58-GC 12.21 71-GC 0.00 0.2
59-GC 0.00 72-GC 63.79
Difference
60-GC 78.18 73-GC 1.46 0
61-GC 3.69 74-GC 42.34
62-GC 4.31 75-GC 61.73
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
244
catalunya 10.2415/GC-MONO-EN-CLEF2007.CATALUNYA.TALPGEOIRTDN1 GC-MONO-EN-CLEF2007
pure IR-based experiment with no Geographical
processing. UsingTerrier over a lemmatized
collection applying TFIDF with Porter Stemmer and
Query Expansion (docs=10;terms=40). This experiment
uses the topic title, description, and narrative
tags.
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 31.20 TALPGEOIRTDN1
10 docs 30.40 90%
15 docs 27.47
80%
20 docs 25.20
30 docs 22.93 70%
100 docs 14.68
60%
200 docs 9.92
Precision
500 docs 4.63 50%
1000 docs 2.42 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
25.26
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7328
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.2500
Third Quartile 0.4048
Interquartile range 0.4048 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.2526
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2583 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 8
Upper Outlier Threshold 0.7328
6
Mean With No Outliers 0.2526
4
Std With No Outliers 0.2583
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries TALPGEOIRTDN1
51-GC 69.64 64-GC 11.76 0.8
52-GC 0.00 65-GC 41.94
53-GC 26.56 66-GC 0.00
0.6
54-GC 0.00 67-GC 35.29
55-GC 25.00 68-GC 73.28
56-GC 37.50 69-GC 33.33 0.4
57-GC 40.00 70-GC 0.00
58-GC 16.67 71-GC 0.00 0.2
59-GC 0.00 72-GC 57.14
Difference
60-GC 70.00 73-GC 0.00 0
61-GC 0.00 74-GC 33.33
62-GC 0.00 75-GC 60.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
245
catalunya 10.2415/GC-MONO-EN-CLEF2007.CATALUNYA.TALPGEOIRTDN2 GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 4
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language English
Relevant 650 Topic Fields title, description, narrative
Relevant retrieved 588 Pooled false
Geometric Mean Average Precision 0.0475 (See overleaf for description)
Binary Preference (BPREF) 0.2636
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 51.53 TALPGEOIRTDN2
10 43.90 90%
20 41.47
80%
30 36.42
40 30.98 70%
50 29.58
60%
60 27.40
Precision
70 23.46 50%
80 16.27 40%
90 9.71
30%
100 3.63
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
27.54 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7701
Minimum 0.0000
First Quartile 0.0363
Second Quartile 0.2163
Third Quartile 0.5156
Interquartile range 0.4793 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.2754
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2732 8
Number of Topics of the Experiment
7
Lower Outlier Threshold 0.0000
6
Upper Outlier Threshold 0.7701 5
Mean With No Outliers 0.2754 4
3
Std With No Outliers 0.2732
2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries TALPGEOIRTDN2
51-GC 73.53 64-GC 6.99 0.8
52-GC 1.59 65-GC 41.61
53-GC 22.85 66-GC 4.38
0.6
54-GC 0.25 67-GC 17.98
55-GC 21.63 68-GC 75.79
56-GC 22.96 69-GC 29.42 0.4
57-GC 34.90 70-GC 6.53
58-GC 11.91 71-GC 0.00 0.2
59-GC 0.00 72-GC 63.79
Difference
60-GC 77.01 73-GC 0.47 0
61-GC 48.78 74-GC 61.81
62-GC 4.32 75-GC 59.93
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
246
catalunya 10.2415/GC-MONO-EN-CLEF2007.CATALUNYA.TALPGEOIRTDN2 GC-MONO-EN-CLEF2007
Textual serach with Geographical document
filtering. Terrier IR with Query Expansion,
Stemmer, over a lemmatized collection with TFIDF
and retrieving 10000 docs per topic. A process of
geo-filtering based on hierachical geographical
matching re-ranks the textually retrieved docs.
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 34.40 TALPGEOIRTDN2
10 docs 33.60 90%
15 docs 29.87
80%
20 docs 28.20
30 docs 25.33 70%
100 docs 15.16
60%
200 docs 9.96
Precision
500 docs 4.50 50%
1000 docs 2.35 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
28.95
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7328
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.2969
Third Quartile 0.5179
Interquartile range 0.5179 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.2895
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2632 8
Number of Topics of the Experiment
7
Lower Outlier Threshold 0.0000
6
Upper Outlier Threshold 0.7328 5
Mean With No Outliers 0.2895 4
3
Std With No Outliers 0.2632
2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries TALPGEOIRTDN2
51-GC 69.64 64-GC 11.76 0.8
52-GC 9.09 65-GC 41.94
53-GC 29.69 66-GC 0.00
0.6
54-GC 0.00 67-GC 35.29
55-GC 25.00 68-GC 73.28
56-GC 37.50 69-GC 33.33 0.4
57-GC 33.33 70-GC 3.45
58-GC 16.67 71-GC 0.00 0.2
59-GC 0.00 72-GC 57.14
Difference
60-GC 70.00 73-GC 0.00 0
61-GC 50.00 74-GC 66.67
62-GC 0.00 75-GC 60.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
247
catalunya 10.2415/GC-MONO-EN-CLEF2007.CATALUNYA.TALPGEOIRTDN3 GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 5
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language English
Relevant 650 Topic Fields title, description, narrative
Relevant retrieved 602 Pooled false
Geometric Mean Average Precision 0.0506
Binary Preference (BPREF) 0.2640
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 51.37 TALPGEOIRTDN3
10 43.52 90%
20 41.31
80%
30 36.43
40 31.18 70%
50 29.96
60%
60 28.17
Precision
70 24.24 50%
80 18.29 40%
90 10.51
30%
100 2.69
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
27.87 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7851
Minimum 0.0000
First Quartile 0.0348
Second Quartile 0.2163
Third Quartile 0.5193
Interquartile range 0.4845 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.2787
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2752 8
Number of Topics of the Experiment
7
Lower Outlier Threshold 0.0000
6
Upper Outlier Threshold 0.7851 5
Mean With No Outliers 0.2787 4
3
Std With No Outliers 0.2752
2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries TALPGEOIRTDN3
51-GC 78.51 64-GC 6.99 0.8
52-GC 1.48 65-GC 41.61
53-GC 23.60 66-GC 3.92
0.6
54-GC 0.25 67-GC 17.98
55-GC 21.63 68-GC 75.79
56-GC 22.96 69-GC 28.08 0.4
57-GC 38.00 70-GC 6.34
58-GC 13.16 71-GC 0.00 0.2
59-GC 0.00 72-GC 63.79
Difference
60-GC 74.29 73-GC 2.16 0
61-GC 48.78 74-GC 61.81
62-GC 4.32 75-GC 61.38
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
248
catalunya 10.2415/GC-MONO-EN-CLEF2007.CATALUNYA.TALPGEOIRTDN3 GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 33.60 TALPGEOIRTDN3
10 docs 33.20 90%
15 docs 29.33
80%
20 docs 27.40
30 docs 25.33 70%
100 docs 15.40
60%
200 docs 10.22
Precision
500 docs 4.65 50%
1000 docs 2.41 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
28.90
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7328
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.2656
Third Quartile 0.5179
Interquartile range 0.5179 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.2890
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2644 8
Number of Topics of the Experiment
7
Lower Outlier Threshold 0.0000
6
Upper Outlier Threshold 0.7328 5
Mean With No Outliers 0.2890 4
3
Std With No Outliers 0.2644
2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries TALPGEOIRTDN3
51-GC 71.43 64-GC 11.76 0.8
52-GC 9.09 65-GC 41.94
53-GC 26.56 66-GC 0.00
0.6
54-GC 0.00 67-GC 35.29
55-GC 25.00 68-GC 73.28
56-GC 37.50 69-GC 33.33 0.4
57-GC 33.33 70-GC 3.45
58-GC 16.67 71-GC 0.00 0.2
59-GC 0.00 72-GC 57.14
Difference
60-GC 70.00 73-GC 0.00 0
61-GC 50.00 74-GC 66.67
62-GC 0.00 75-GC 60.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
249
cheshire 10.2415/GC-MONO-EN-CLEF2007.CHESHIRE.BERKMOENBASE GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 1
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language English
Relevant 650 Topic Fields title, description
Relevant retrieved 596 Pooled true
Geometric Mean Average Precision 0.0504 Baseline English monolingual searching using TREC2
Binary Preference (BPREF) 0.2358 ranking with Blind Feedback
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 54.79 BERKMOENBASE
10 45.31 90%
20 42.25
80%
30 38.38
40 27.47 70%
50 24.92
60%
60 22.15
Precision
70 19.31 50%
80 16.03 40%
90 9.87
30%
100 4.20
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
26.42 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7706
Minimum 0.0000
First Quartile 0.0416
Second Quartile 0.1733
Third Quartile 0.3974
Interquartile range 0.3558 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.2642
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2454 8
Number of Topics of the Experiment
7
Lower Outlier Threshold 0.0000
6
Upper Outlier Threshold 0.7706 5
Mean With No Outliers 0.2642 4
3
Std With No Outliers 0.2454
2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries BERKMOENBASE
51-GC 68.28 64-GC 0.83 0.8
52-GC 0.21 65-GC 37.09
53-GC 16.91 66-GC 33.53
0.6
54-GC 4.69 67-GC 45.33
55-GC 17.33 68-GC 60.20
56-GC 36.28 69-GC 29.56 0.4
57-GC 37.88 70-GC 2.54
58-GC 7.41 71-GC 0.00 0.2
59-GC 0.00 72-GC 56.64
Difference
60-GC 77.06 73-GC 9.46 0
61-GC 12.85 74-GC 36.13
62-GC 6.99 75-GC 63.35
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
250
cheshire 10.2415/GC-MONO-EN-CLEF2007.CHESHIRE.BERKMOENBASE GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 35.20 BERKMOENBASE
10 docs 30.80 90%
15 docs 26.93
80%
20 docs 24.60
30 docs 22.67 70%
100 docs 13.76
60%
200 docs 9.50
Precision
500 docs 4.50 50%
1000 docs 2.38 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
25.76
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7000
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.2188
Third Quartile 0.4476
Interquartile range 0.4476 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.2576
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2451 8
Number of Topics of the Experiment
7
Lower Outlier Threshold 0.0000
6
Upper Outlier Threshold 0.7000 5
Mean With No Outliers 0.2576 4
3
Std With No Outliers 0.2451
2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries BERKMOENBASE
51-GC 60.71 64-GC 0.00 0.8
52-GC 0.00 65-GC 43.01
53-GC 21.88 66-GC 33.33
0.6
54-GC 0.00 67-GC 29.41
55-GC 18.75 68-GC 62.60
56-GC 50.00 69-GC 28.57 0.4
57-GC 40.00 70-GC 6.90
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 57.14
Difference
60-GC 70.00 73-GC 14.29 0
61-GC 9.09 74-GC 33.33
62-GC 0.00 75-GC 65.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
251
csusm 10.2415/GC-MONO-EN-CLEF2007.CSUSM.GEOMOEN1 GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 1
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language English
Relevant 650 Topic Fields title, description
Relevant retrieved 460 Pooled true
Geometric Mean Average Precision 0.0217 Automatic processing of topic's title and
Binary Preference (BPREF) 0.1379 description using stopwords and stemming
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 39.94 GEOMOEN1
10 28.86 90%
20 23.35
80%
30 21.37
40 17.12 70%
50 13.96
60%
60 12.00
Precision
70 8.89 50%
80 5.62 40%
90 4.27
30%
100 1.28
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
14.69 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7570
Minimum 0.0000
First Quartile 0.0064
Second Quartile 0.0786
Third Quartile 0.2737
Interquartile range 0.2673 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.1469
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1959 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.5327 10
Mean With No Outliers 0.1215
Std With No Outliers 0.1522 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries GEOMOEN1
51-GC 40.32 64-GC 0.34 0.8
52-GC 0.57 65-GC 9.27
53-GC 3.50 66-GC 11.24
0.6
54-GC 10.06 67-GC 32.63
55-GC 14.34 68-GC 53.27
56-GC 26.42 69-GC 1.31 0.4
57-GC 6.81 70-GC 0.67
58-GC 0.92 71-GC 0.00 0.2
59-GC 0.00 72-GC 31.95
Difference
60-GC 75.70 73-GC 0.47 0
61-GC 7.86 74-GC 8.38
62-GC 1.09 75-GC 30.22
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
252
csusm 10.2415/GC-MONO-EN-CLEF2007.CSUSM.GEOMOEN1 GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 23.20 GEOMOEN1
10 docs 21.60 90%
15 docs 18.93
80%
20 docs 17.60
30 docs 16.13 70%
100 docs 9.72
60%
200 docs 6.38
Precision
500 docs 3.30 50%
1000 docs 1.84 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
16.56
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.6667
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.1176
Third Quartile 0.3375
Interquartile range 0.3375 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.1656
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1957 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.6667 10
Mean With No Outliers 0.1656
Std With No Outliers 0.1957 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries GEOMOEN1
51-GC 42.86 64-GC 0.00 0.8
52-GC 0.00 65-GC 17.20
53-GC 12.50 66-GC 33.33
0.6
54-GC 14.29 67-GC 11.76
55-GC 12.50 68-GC 57.25
56-GC 37.50 69-GC 4.76 0.4
57-GC 20.00 70-GC 3.45
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 35.71
Difference
60-GC 66.67 73-GC 0.00 0
61-GC 9.09 74-GC 0.00
62-GC 0.00 75-GC 35.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
253
csusm 10.2415/GC-MONO-EN-CLEF2007.CSUSM.GEOMOEN2 GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 2
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 24,999 Source Language English
Relevant 650 Topic Fields title, description, narrative
Relevant retrieved 412 Pooled true
Geometric Mean Average Precision 0.0044 Automatic processing of topic's title, description
Binary Preference (BPREF) 0.1355 and narrative using language modelling
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 34.98 GEOMOEN2
10 24.27 90%
20 19.91
80%
30 17.40
40 16.55 70%
50 13.29
60%
60 10.80
Precision
70 10.02 50%
80 6.76 40%
90 4.78
30%
100 1.57
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
13.31 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7920
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0293
Third Quartile 0.1618
Interquartile range 0.1618 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.1331
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2199 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.3460 10
Mean With No Outliers 0.0777
Std With No Outliers 0.1120 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries GEOMOEN2
51-GC 79.20 64-GC 19.01 0.8
52-GC 0.04 65-GC 3.25
53-GC 5.23 66-GC 2.93
0.6
54-GC 0.00 67-GC 27.01
55-GC 0.00 68-GC 33.37
56-GC 0.89 69-GC 15.24 0.4
57-GC 0.00 70-GC 0.10
58-GC 13.49 71-GC 0.00 0.2
59-GC 0.00 72-GC 15.18
Difference
60-GC 74.95 73-GC 0.09 0
61-GC 7.19 74-GC 0.00
62-GC 1.08 75-GC 34.60
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
254
csusm 10.2415/GC-MONO-EN-CLEF2007.CSUSM.GEOMOEN2 GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 20.80 GEOMOEN2
10 docs 18.80 90%
15 docs 18.40
80%
20 docs 17.00
30 docs 15.87 70%
100 docs 9.52
60%
200 docs 6.14
Precision
500 docs 2.93 50%
1000 docs 1.65 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
15.25
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7667
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0000
Third Quartile 0.2353
Interquartile range 0.2353 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.1525
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2240 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.4000 10
Mean With No Outliers 0.1002
Std With No Outliers 0.1378 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries GEOMOEN2
51-GC 74.11 64-GC 23.53 0.8
52-GC 0.00 65-GC 10.75
53-GC 12.50 66-GC 0.00
0.6
54-GC 0.00 67-GC 23.53
55-GC 0.00 68-GC 39.69
56-GC 0.00 69-GC 33.33 0.4
57-GC 0.00 70-GC 0.00
58-GC 16.67 71-GC 0.00 0.2
59-GC 0.00 72-GC 21.43
Difference
60-GC 76.67 73-GC 0.00 0
61-GC 9.09 74-GC 0.00
62-GC 0.00 75-GC 40.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
255
csusm 10.2415/GC-MONO-EN-CLEF2007.CSUSM.GEOMOEN3 GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 3
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 24,999 Source Language English
Relevant 650 Topic Fields title, description
Relevant retrieved 412 Pooled false
Geometric Mean Average Precision 0.0107 Automatic processing of topic's title & description
Binary Preference (BPREF) 0.1373 using language modelling
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 40.21 GEOMOEN3
10 29.95 90%
20 24.07
80%
30 21.13
40 15.48 70%
50 13.32
60%
60 9.98
Precision
70 6.99 50%
80 5.21 40%
90 3.01
30%
100 1.01
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
14.33 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7473
Minimum 0.0000
First Quartile 0.0019
Second Quartile 0.0429
Third Quartile 0.2655
Interquartile range 0.2637 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.1433
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1992 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.4392 10
Mean With No Outliers 0.1181
Std With No Outliers 0.1577 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries GEOMOEN3
51-GC 43.92 64-GC 0.73 0.8
52-GC 0.19 65-GC 4.27
53-GC 5.69 66-GC 4.29
0.6
54-GC 8.93 67-GC 24.86
55-GC 17.71 68-GC 37.79
56-GC 8.23 69-GC 2.47 0.4
57-GC 0.00 70-GC 0.16
58-GC 0.60 71-GC 0.00 0.2
59-GC 0.00 72-GC 31.61
Difference
60-GC 74.73 73-GC 0.00 0
61-GC 7.31 74-GC 40.34
62-GC 1.00 75-GC 43.30
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
256
csusm 10.2415/GC-MONO-EN-CLEF2007.CSUSM.GEOMOEN3 GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 22.40 GEOMOEN3
10 docs 22.00 90%
15 docs 18.40
80%
20 docs 17.40
30 docs 15.07 70%
100 docs 8.64
60%
200 docs 5.84
Precision
500 docs 3.02 50%
1000 docs 1.65 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
14.20
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.6667
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0781
Third Quartile 0.2121
Interquartile range 0.2121 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.1420
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1966 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.5000 10
Mean With No Outliers 0.1201
Std With No Outliers 0.1669 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries GEOMOEN3
51-GC 43.75 64-GC 0.00 0.8
52-GC 0.00 65-GC 11.83
53-GC 7.81 66-GC 0.00
0.6
54-GC 14.29 67-GC 11.76
55-GC 18.75 68-GC 49.62
56-GC 0.00 69-GC 9.52 0.4
57-GC 0.00 70-GC 0.00
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 28.57
Difference
60-GC 66.67 73-GC 0.00 0
61-GC 9.09 74-GC 33.33
62-GC 0.00 75-GC 50.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
257
csusm 10.2415/GC-MONO-EN-CLEF2007.CSUSM.GEOMOEN4 GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 4
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language English
Relevant 650 Topic Fields title, description
Relevant retrieved 530 Pooled false
Geometric Mean Average Precision 0.0239 Automated processing of topic's title and
Binary Preference (BPREF) 0.1797 description with relevance feedback
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 39.42 GEOMOEN4
10 33.20 90%
20 27.66
80%
30 25.24
40 22.75 70%
50 19.89
60%
60 16.76
Precision
70 13.60 50%
80 10.42 40%
90 6.29
30%
100 3.69
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
18.84 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7666
Minimum 0.0000
First Quartile 0.0050
Second Quartile 0.0709
Third Quartile 0.3360
Interquartile range 0.3310 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.1884
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2315 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.7666 10
Mean With No Outliers 0.1884
Std With No Outliers 0.2315 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries GEOMOEN4
51-GC 58.14 64-GC 0.18 0.8
52-GC 0.55 65-GC 24.71
53-GC 3.40 66-GC 0.38
0.6
54-GC 12.80 67-GC 33.33
55-GC 30.67 68-GC 61.40
56-GC 34.43 69-GC 7.09 0.4
57-GC 19.06 70-GC 1.31
58-GC 3.38 71-GC 0.00 0.2
59-GC 0.00 72-GC 47.82
Difference
60-GC 76.66 73-GC 0.24 0
61-GC 1.61 74-GC 8.38
62-GC 1.83 75-GC 43.57
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
258
csusm 10.2415/GC-MONO-EN-CLEF2007.CSUSM.GEOMOEN4 GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 27.20 GEOMOEN4
10 docs 23.60 90%
15 docs 22.93
80%
20 docs 21.00
30 docs 19.60 70%
100 docs 11.52
60%
200 docs 7.96
Precision
500 docs 3.89 50%
1000 docs 2.12 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
19.61
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.6667
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0938
Third Quartile 0.3625
Interquartile range 0.3625 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.1961
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2301 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.6667 10
Mean With No Outliers 0.1961
Std With No Outliers 0.2301 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries GEOMOEN4
51-GC 51.79 64-GC 0.00 0.8
52-GC 0.00 65-GC 29.03
53-GC 9.38 66-GC 0.00
0.6
54-GC 14.29 67-GC 17.65
55-GC 31.25 68-GC 58.78
56-GC 50.00 69-GC 19.05 0.4
57-GC 33.33 70-GC 6.90
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 57.14
Difference
60-GC 66.67 73-GC 0.00 0
61-GC 0.00 74-GC 0.00
62-GC 0.00 75-GC 45.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
259
csusm 10.2415/GC-MONO-EN-CLEF2007.CSUSM.GEOMOEN5 GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 5
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language English
Relevant 650 Topic Fields title, description, narrative
Relevant retrieved 534 Pooled false
Geometric Mean Average Precision 0.0317 Automatic processing of topic's title, description
Binary Preference (BPREF) 0.1918 & narrative with relevance feedback
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 50.98 GEOMOEN5
10 43.58 90%
20 32.11
80%
30 27.40
40 23.93 70%
50 21.50
60%
60 18.55
Precision
70 11.87 50%
80 9.03 40%
90 6.47
30%
100 4.34
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
21.32 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7554
Minimum 0.0000
First Quartile 0.0120
Second Quartile 0.1396
Third Quartile 0.2945
Interquartile range 0.2825 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.2132
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2453 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 8
Upper Outlier Threshold 0.6713
6
Mean With No Outliers 0.1668
4
Std With No Outliers 0.1936
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries GEOMOEN5
51-GC 73.85 64-GC 1.78 0.8
52-GC 0.24 65-GC 25.39
53-GC 7.42 66-GC 10.96
0.6
54-GC 1.63 67-GC 34.67
55-GC 36.43 68-GC 60.45
56-GC 27.71 69-GC 13.96 0.4
57-GC 16.81 70-GC 0.49
58-GC 23.58 71-GC 0.00 0.2
59-GC 0.00 72-GC 24.36
Difference
60-GC 75.54 73-GC 0.89 0
61-GC 1.46 74-GC 67.13
62-GC 1.30 75-GC 27.03
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
260
csusm 10.2415/GC-MONO-EN-CLEF2007.CSUSM.GEOMOEN5 GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 28.00 GEOMOEN5
10 docs 22.40 90%
15 docs 21.07
80%
20 docs 20.20
30 docs 19.87 70%
100 docs 12.40
60%
200 docs 8.18
Precision
500 docs 3.92 50%
1000 docs 2.14 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
20.97
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.6667
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.1667
Third Quartile 0.3375
Interquartile range 0.3375 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.2097
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2342 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.6667 10
Mean With No Outliers 0.2097
Std With No Outliers 0.2342 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries GEOMOEN5
51-GC 66.07 64-GC 0.00 0.8
52-GC 0.00 65-GC 31.18
53-GC 12.50 66-GC 0.00
0.6
54-GC 0.00 67-GC 17.65
55-GC 37.50 68-GC 57.25
56-GC 25.00 69-GC 33.33 0.4
57-GC 26.67 70-GC 3.45
58-GC 16.67 71-GC 0.00 0.2
59-GC 0.00 72-GC 28.57
Difference
60-GC 66.67 73-GC 0.00 0
61-GC 0.00 74-GC 66.67
62-GC 0.00 75-GC 35.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
261
csusm 10.2415/GC-MONO-EN-CLEF2007.CSUSM.GEOMOEN6 GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 6
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language English
Relevant 650 Topic Fields title, description, narrative
Relevant retrieved 478 Pooled false
Geometric Mean Average Precision 0.0310 Atomatic processing of topic's title, description,
Binary Preference (BPREF) 0.1829 & narrative using stopwords and stemming
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 52.41 GEOMOEN6
10 40.05 90%
20 29.55
80%
30 25.38
40 21.95 70%
50 19.43
60%
60 16.30
Precision
70 10.54 50%
80 7.02 40%
90 5.09
30%
100 1.71
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
19.40 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7536
Minimum 0.0000
First Quartile 0.0120
Second Quartile 0.1367
Third Quartile 0.2720
Interquartile range 0.2600 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.1940
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2290 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 8
Upper Outlier Threshold 0.6516
6
Mean With No Outliers 0.1489
4
Std With No Outliers 0.1747
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries GEOMOEN6
51-GC 65.16 64-GC 1.78 0.8
52-GC 0.27 65-GC 8.71
53-GC 7.42 66-GC 13.67
0.6
54-GC 1.63 67-GC 34.67
55-GC 20.73 68-GC 51.27
56-GC 27.71 69-GC 13.96 0.4
57-GC 16.81 70-GC 0.49
58-GC 19.62 71-GC 0.00 0.2
59-GC 0.00 72-GC 24.36
Difference
60-GC 75.36 73-GC 0.89 0
61-GC 4.96 74-GC 67.13
62-GC 1.30 75-GC 27.03
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
262
csusm 10.2415/GC-MONO-EN-CLEF2007.CSUSM.GEOMOEN6 GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 28.00 GEOMOEN6
10 docs 22.80 90%
15 docs 20.80
80%
20 docs 19.40
30 docs 18.53 70%
100 docs 11.16
60%
200 docs 7.30
Precision
500 docs 3.54 50%
1000 docs 1.91 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
21.34
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7333
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.1720
Third Quartile 0.3333
Interquartile range 0.3333 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.2134
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2262 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 8
Upper Outlier Threshold 0.7333
6
Mean With No Outliers 0.2134
4
Std With No Outliers 0.2262
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries GEOMOEN6
51-GC 58.93 64-GC 0.00 0.8
52-GC 0.00 65-GC 17.20
53-GC 12.50 66-GC 33.33
0.6
54-GC 0.00 67-GC 17.65
55-GC 18.75 68-GC 57.25
56-GC 25.00 69-GC 33.33 0.4
57-GC 26.67 70-GC 3.45
58-GC 16.67 71-GC 0.00 0.2
59-GC 0.00 72-GC 28.57
Difference
60-GC 73.33 73-GC 0.00 0
61-GC 9.09 74-GC 66.67
62-GC 0.00 75-GC 35.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
263
groningen 10.2415/GC-MONO-EN-CLEF2007.GRONINGEN.CLCGGEOEET00 GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 5
Total number of documents over all queries Query Construction MANUAL
Retrieved 25,000 Source Language English
Relevant 650 Topic Fields title
Relevant retrieved 568 Pooled false
Geometric Mean Average Precision 0.0469 uploaded by G. Andogah
Binary Preference (BPREF) 0.1899
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 47.25 CLCGGEOEET00
10 37.77 90%
20 32.12
80%
30 26.20
40 23.15 70%
50 21.90
60%
60 18.22
Precision
70 15.22 50%
80 10.39 40%
90 6.48
30%
100 2.43
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
20.23 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7029
Minimum 0.0000
First Quartile 0.0545
Second Quartile 0.1504
Third Quartile 0.3109
Interquartile range 0.2564 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.2023
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1976 6
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 5
Upper Outlier Threshold 0.6410 4
Mean With No Outliers 0.1814 3
Std With No Outliers 0.1714 2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries CLCGGEOEET00
51-GC 43.75 64-GC 2.52 0.8
52-GC 3.27 65-GC 7.39
53-GC 16.29 66-GC 9.26
0.6
54-GC 11.67 67-GC 34.02
55-GC 30.11 68-GC 64.10
56-GC 20.98 69-GC 6.54 0.4
57-GC 6.42 70-GC 28.14
58-GC 1.30 71-GC 0.00 0.2
59-GC 0.00 72-GC 44.88
Difference
60-GC 70.29 73-GC 26.12 0
61-GC 22.38 74-GC 6.17
62-GC 35.09 75-GC 15.04
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
264
groningen 10.2415/GC-MONO-EN-CLEF2007.GRONINGEN.CLCGGEOEET00 GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 27.20 CLCGGEOEET00
10 docs 26.00 90%
15 docs 25.87
80%
20 docs 24.40
30 docs 20.93 70%
100 docs 11.88
60%
200 docs 7.94
Precision
500 docs 3.94 50%
1000 docs 2.27 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
21.86
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7000
Minimum 0.0000
First Quartile 0.0441
Second Quartile 0.1905
Third Quartile 0.3469
Interquartile range 0.3027 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.2186
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2090 6
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 5
Upper Outlier Threshold 0.7000 4
Mean With No Outliers 0.2186 3
Std With No Outliers 0.2090 2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries CLCGGEOEET00
51-GC 46.43 64-GC 5.88 0.8
52-GC 9.09 65-GC 9.68
53-GC 23.44 66-GC 0.00
0.6
54-GC 14.29 67-GC 35.29
55-GC 37.50 68-GC 65.65
56-GC 25.00 69-GC 19.05 0.4
57-GC 6.67 70-GC 34.48
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 57.14
Difference
60-GC 70.00 73-GC 14.29 0
61-GC 22.73 74-GC 0.00
62-GC 25.00 75-GC 25.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
265
groningen 10.2415/GC-MONO-EN-CLEF2007.GRONINGEN.CLCGGEOEETD00 GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 3
Total number of documents over all queries Query Construction MANUAL
Retrieved 25,000 Source Language English
Relevant 650 Topic Fields title, description
Relevant retrieved 588 Pooled false
Geometric Mean Average Precision 0.0599 uploaded by G. Andogah
Binary Preference (BPREF) 0.2293
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 56.84 CLCGGEOEETD00
10 50.59 90%
20 42.98
80%
30 32.84
40 26.12 70%
50 24.14
60%
60 21.03
Precision
70 17.61 50%
80 13.55 40%
90 6.42
30%
100 2.44
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
25.15 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7078
Minimum 0.0000
First Quartile 0.0940
Second Quartile 0.2303
Third Quartile 0.3358
Interquartile range 0.2417 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.2515
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2105 6
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 5
Upper Outlier Threshold 0.6411 4
Mean With No Outliers 0.2325 3
Std With No Outliers 0.1919 2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries CLCGGEOEETD00
51-GC 55.78 64-GC 2.52 0.8
52-GC 1.67 65-GC 13.57
53-GC 17.72 66-GC 24.07
0.6
54-GC 11.70 67-GC 42.60
55-GC 29.85 68-GC 64.11
56-GC 20.53 69-GC 14.54 0.4
57-GC 14.10 70-GC 31.84
58-GC 1.62 71-GC 0.00 0.2
59-GC 0.00 72-GC 61.92
Difference
60-GC 70.78 73-GC 23.03 0
61-GC 26.35 74-GC 37.05
62-GC 32.42 75-GC 30.95
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
266
groningen 10.2415/GC-MONO-EN-CLEF2007.GRONINGEN.CLCGGEOEETD00 GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 32.80 CLCGGEOEETD00
10 docs 29.60 90%
15 docs 28.53
80%
20 docs 26.80
30 docs 22.67 70%
100 docs 12.64
60%
200 docs 8.66
Precision
500 docs 4.38 50%
1000 docs 2.35 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
25.95
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7000
Minimum 0.0000
First Quartile 0.1195
Second Quartile 0.2273
Third Quartile 0.3507
Interquartile range 0.2312 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.2595
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2050 4
Number of Topics of the Experiment
3.5
Lower Outlier Threshold 0.0000
3
Upper Outlier Threshold 0.6565 2.5
Mean With No Outliers 0.2412 2
1.5
Std With No Outliers 0.1872
1
0.5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries CLCGGEOEETD00
51-GC 52.68 64-GC 5.88 0.8
52-GC 9.09 65-GC 12.90
53-GC 21.88 66-GC 33.33
0.6
54-GC 14.29 67-GC 35.29
55-GC 31.25 68-GC 65.65
56-GC 25.00 69-GC 19.05 0.4
57-GC 20.00 70-GC 37.93
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 64.29
Difference
60-GC 70.00 73-GC 14.29 0
61-GC 22.73 74-GC 33.33
62-GC 25.00 75-GC 35.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
267
groningen 10.2415/GC-MONO-EN-CLEF2007.GRONINGEN.CLCGGEOEETDN00 GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 4
Total number of documents over all queries Query Construction MANUAL
Retrieved 25,000 Source Language English
Relevant 650 Topic Fields title, description, narrative
Relevant retrieved 568 Pooled false
Geometric Mean Average Precision 0.0469 uploaded by G. Andogah
Binary Preference (BPREF) 0.1899
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 47.25 CLCGGEOEETDN00
10 37.77 90%
20 32.12
80%
30 26.20
40 23.15 70%
50 21.90
60%
60 18.22
Precision
70 15.22 50%
80 10.39 40%
90 6.48
30%
100 2.43
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
20.23 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7029
Minimum 0.0000
First Quartile 0.0545
Second Quartile 0.1504
Third Quartile 0.3109
Interquartile range 0.2564 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.2023
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1976 6
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 5
Upper Outlier Threshold 0.6410 4
Mean With No Outliers 0.1814 3
Std With No Outliers 0.1714 2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries CLCGGEOEETDN00
51-GC 43.75 64-GC 2.52 0.8
52-GC 3.27 65-GC 7.39
53-GC 16.29 66-GC 9.26
0.6
54-GC 11.67 67-GC 34.02
55-GC 30.11 68-GC 64.10
56-GC 20.98 69-GC 6.54 0.4
57-GC 6.42 70-GC 28.14
58-GC 1.30 71-GC 0.00 0.2
59-GC 0.00 72-GC 44.88
Difference
60-GC 70.29 73-GC 26.12 0
61-GC 22.38 74-GC 6.17
62-GC 35.09 75-GC 15.04
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
268
groningen 10.2415/GC-MONO-EN-CLEF2007.GRONINGEN.CLCGGEOEETDN00 GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 27.20 CLCGGEOEETDN00
10 docs 26.00 90%
15 docs 25.87
80%
20 docs 24.40
30 docs 20.93 70%
100 docs 11.88
60%
200 docs 7.94
Precision
500 docs 3.94 50%
1000 docs 2.27 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
21.86
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7000
Minimum 0.0000
First Quartile 0.0441
Second Quartile 0.1905
Third Quartile 0.3469
Interquartile range 0.3027 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.2186
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2090 6
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 5
Upper Outlier Threshold 0.7000 4
Mean With No Outliers 0.2186 3
Std With No Outliers 0.2090 2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries CLCGGEOEETDN00
51-GC 46.43 64-GC 5.88 0.8
52-GC 9.09 65-GC 9.68
53-GC 23.44 66-GC 0.00
0.6
54-GC 14.29 67-GC 35.29
55-GC 37.50 68-GC 65.65
56-GC 25.00 69-GC 19.05 0.4
57-GC 6.67 70-GC 34.48
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 57.14
Difference
60-GC 70.00 73-GC 14.29 0
61-GC 22.73 74-GC 0.00
62-GC 25.00 75-GC 25.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
269
groningen 10.2415/GC-MONO-EN-CLEF2007.GRONINGEN.CLCGGEOEETDN01 GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 2
Total number of documents over all queries Query Construction MANUAL
Retrieved 25,000 Source Language English
Relevant 650 Topic Fields title, description, narrative
Relevant retrieved 568 Pooled true
Geometric Mean Average Precision 0.0479 uploaded by G. Andogah
Binary Preference (BPREF) 0.1878
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 46.96 CLCGGEOEETDN01
10 38.36 90%
20 32.54
80%
30 26.45
40 23.31 70%
50 21.61
60%
60 18.20
Precision
70 15.05 50%
80 11.03 40%
90 7.16
30%
100 3.46
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
20.53 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.6867
Minimum 0.0000
First Quartile 0.0534
Second Quartile 0.1765
Third Quartile 0.3146
Interquartile range 0.2612 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.2053
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1977 6
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 5
Upper Outlier Threshold 0.6867 4
Mean With No Outliers 0.2053 3
Std With No Outliers 0.1977 2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries CLCGGEOEETDN01
51-GC 46.24 64-GC 2.91 0.8
52-GC 2.72 65-GC 8.17
53-GC 17.65 66-GC 8.45
0.6
54-GC 9.05 67-GC 34.02
55-GC 30.79 68-GC 64.10
56-GC 20.98 69-GC 6.54 0.4
57-GC 6.15 70-GC 30.12
58-GC 1.70 71-GC 0.00 0.2
59-GC 0.00 72-GC 44.88
Difference
60-GC 68.67 73-GC 30.05 0
61-GC 21.39 74-GC 7.14
62-GC 33.45 75-GC 18.08
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
270
groningen 10.2415/GC-MONO-EN-CLEF2007.GRONINGEN.CLCGGEOEETDN01 GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 28.00 CLCGGEOEETDN01
10 docs 27.60 90%
15 docs 26.13
80%
20 docs 24.60
30 docs 21.33 70%
100 docs 12.12
60%
200 docs 8.02
Precision
500 docs 4.02 50%
1000 docs 2.27 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
22.34
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7000
Minimum 0.0000
First Quartile 0.0441
Second Quartile 0.1905
Third Quartile 0.3585
Interquartile range 0.3143 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.2234
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2116 6
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 5
Upper Outlier Threshold 0.7000 4
Mean With No Outliers 0.2234 3
Std With No Outliers 0.2116 2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries CLCGGEOEETDN01
51-GC 47.32 64-GC 5.88 0.8
52-GC 9.09 65-GC 10.75
53-GC 26.56 66-GC 0.00
0.6
54-GC 14.29 67-GC 35.29
55-GC 37.50 68-GC 65.65
56-GC 25.00 69-GC 19.05 0.4
57-GC 6.67 70-GC 41.38
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 57.14
Difference
60-GC 70.00 73-GC 14.29 0
61-GC 22.73 74-GC 0.00
62-GC 25.00 75-GC 25.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
271
groningen 10.2415/GC-MONO-EN-CLEF2007.GRONINGEN.CLCGGEOEETDN01B GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 1
Total number of documents over all queries Query Construction MANUAL
Retrieved 25,000 Source Language English
Relevant 650 Topic Fields title, description, narrative
Relevant retrieved 568 Pooled true
Geometric Mean Average Precision 0.0446 uploaded by G. Andogah
Binary Preference (BPREF) 0.1730
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 49.23 CLCGGEOEETDN01B
10 39.81 90%
20 31.19
80%
30 24.79
40 18.95 70%
50 17.29
60%
60 13.46
Precision
70 11.02 50%
80 8.76 40%
90 5.50
30%
100 3.24
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
18.47 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.6867
Minimum 0.0000
First Quartile 0.0534
Second Quartile 0.0985
Third Quartile 0.3028
Interquartile range 0.2495 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.1847
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1779 8
Number of Topics of the Experiment
7
Lower Outlier Threshold 0.0000
6
Upper Outlier Threshold 0.4712 5
Mean With No Outliers 0.1638 4
3
Std With No Outliers 0.1470
2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries CLCGGEOEETDN01B
51-GC 46.24 64-GC 2.91 0.8
52-GC 2.72 65-GC 8.17
53-GC 17.65 66-GC 8.45
0.6
54-GC 9.05 67-GC 33.65
55-GC 30.79 68-GC 47.12
56-GC 9.85 69-GC 6.54 0.4
57-GC 6.15 70-GC 30.12
58-GC 1.70 71-GC 0.00 0.2
59-GC 0.00 72-GC 21.82
Difference
60-GC 68.67 73-GC 30.05 0
61-GC 21.39 74-GC 7.14
62-GC 33.45 75-GC 18.08
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
272
groningen 10.2415/GC-MONO-EN-CLEF2007.GRONINGEN.CLCGGEOEETDN01B GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 28.80 CLCGGEOEETDN01B
10 docs 27.20 90%
15 docs 24.53
80%
20 docs 23.40
30 docs 20.53 70%
100 docs 11.12
60%
200 docs 7.04
Precision
500 docs 3.75 50%
1000 docs 2.27 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
20.19
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7000
Minimum 0.0000
First Quartile 0.0441
Second Quartile 0.1429
Third Quartile 0.3540
Interquartile range 0.3099 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.2019
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1866 6
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 5
Upper Outlier Threshold 0.7000 4
Mean With No Outliers 0.2019 3
Std With No Outliers 0.1866 2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries CLCGGEOEETDN01B
51-GC 47.32 64-GC 5.88 0.8
52-GC 9.09 65-GC 10.75
53-GC 26.56 66-GC 0.00
0.6
54-GC 14.29 67-GC 35.29
55-GC 37.50 68-GC 45.80
56-GC 12.50 69-GC 19.05 0.4
57-GC 6.67 70-GC 41.38
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 35.71
Difference
60-GC 70.00 73-GC 14.29 0
61-GC 22.73 74-GC 0.00
62-GC 25.00 75-GC 25.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
273
hildesheim 10.2415/GC-MONO-EN-CLEF2007.HILDESHEIM.HIMOENBASE GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 1
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 24,081 Source Language Spanish; Castilian
Relevant 650 Topic Fields title, description
Relevant retrieved 441 Pooled true
Geometric Mean Average Precision 0.0320 Base Run
Binary Preference (BPREF) 0.1586
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 48.69 HIMOENBASE
10 38.20 90%
20 31.55
80%
30 22.39
40 11.03 70%
50 7.40
60%
60 4.77
Precision
70 4.01 50%
80 2.70 40%
90 0.97
30%
100 0.22
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
14.05 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.5375
Minimum 0.0000
First Quartile 0.0114
Second Quartile 0.1287
Third Quartile 0.2106
Interquartile range 0.1993 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.1405
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1318 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 8
Upper Outlier Threshold 0.3333
6
Mean With No Outliers 0.1240
4
Std With No Outliers 0.1049
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries HIMOENBASE
51-GC 53.75 64-GC 1.13 0.8
52-GC 0.98 65-GC 11.79
53-GC 12.87 66-GC 33.33
0.6
54-GC 8.29 67-GC 21.10
55-GC 19.05 68-GC 31.07
56-GC 17.35 69-GC 15.42 0.4
57-GC 11.88 70-GC 0.86
58-GC 1.14 71-GC 0.00 0.2
59-GC 0.00 72-GC 25.34
Difference
60-GC 15.60 73-GC 4.42 0
61-GC 2.67 74-GC 17.22
62-GC 25.00 75-GC 21.05
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
274
hildesheim 10.2415/GC-MONO-EN-CLEF2007.HILDESHEIM.HIMOENBASE GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 21.60 HIMOENBASE
10 docs 21.60 90%
15 docs 19.47
80%
20 docs 17.40
30 docs 15.33 70%
100 docs 9.40
60%
200 docs 6.38
Precision
500 docs 3.16 50%
1000 docs 1.76 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
19.10
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.5268
Minimum 0.0000
First Quartile 0.0259
Second Quartile 0.1905
Third Quartile 0.3333
Interquartile range 0.3075 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.1910
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1532 8
Number of Topics of the Experiment
7
Lower Outlier Threshold 0.0000
6
Upper Outlier Threshold 0.5268 5
Mean With No Outliers 0.1910 4
3
Std With No Outliers 0.1532
2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries HIMOENBASE
51-GC 52.68 64-GC 0.00 0.8
52-GC 0.00 65-GC 23.66
53-GC 17.19 66-GC 33.33
0.6
54-GC 14.29 67-GC 35.29
55-GC 25.00 68-GC 37.40
56-GC 25.00 69-GC 19.05 0.4
57-GC 13.33 70-GC 3.45
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 35.71
Difference
60-GC 30.00 73-GC 14.29 0
61-GC 4.55 74-GC 33.33
62-GC 25.00 75-GC 35.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
275
hildesheim 10.2415/GC-MONO-EN-CLEF2007.HILDESHEIM.HIMOENNANE GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 2
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language Spanish; Castilian
Relevant 650 Topic Fields title, description, narrative
Relevant retrieved 434 Pooled true
Geometric Mean Average Precision 0.0324 using narrative and Named Entities
Binary Preference (BPREF) 0.1560
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 46.53 HIMOENNANE
10 39.04 90%
20 32.48
80%
30 23.84
40 11.70 70%
50 8.19
60%
60 6.28
Precision
70 5.23 50%
80 4.38 40%
90 2.70
30%
100 1.14
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
14.97 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.5447
Minimum 0.0000
First Quartile 0.0212
Second Quartile 0.1178
Third Quartile 0.2455
Interquartile range 0.2243 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.1497
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1468 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 8
Upper Outlier Threshold 0.5447
6
Mean With No Outliers 0.1497
4
Std With No Outliers 0.1468
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries HIMOENNANE
51-GC 54.47 64-GC 0.98 0.8
52-GC 0.45 65-GC 17.70
53-GC 11.78 66-GC 33.33
0.6
54-GC 10.64 67-GC 10.22
55-GC 18.78 68-GC 30.17
56-GC 22.73 69-GC 23.63 0.4
57-GC 27.30 70-GC 1.82
58-GC 3.73 71-GC 0.00 0.2
59-GC 0.00 72-GC 32.26
Difference
60-GC 13.27 73-GC 4.35 0
61-GC 2.21 74-GC 38.93
62-GC 12.50 75-GC 2.87
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
276
hildesheim 10.2415/GC-MONO-EN-CLEF2007.HILDESHEIM.HIMOENNANE GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 21.60 HIMOENNANE
10 docs 21.60 90%
15 docs 18.40
80%
20 docs 16.20
30 docs 14.27 70%
100 docs 10.16
60%
200 docs 6.66
Precision
500 docs 3.22 50%
1000 docs 1.74 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
18.09
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.5714
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.1765
Third Quartile 0.3120
Interquartile range 0.3120 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.1809
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1586 8
Number of Topics of the Experiment
7
Lower Outlier Threshold 0.0000
6
Upper Outlier Threshold 0.5714 5
Mean With No Outliers 0.1809 4
3
Std With No Outliers 0.1586
2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries HIMOENNANE
51-GC 57.14 64-GC 0.00 0.8
52-GC 0.00 65-GC 31.18
53-GC 21.88 66-GC 33.33
0.6
54-GC 14.29 67-GC 17.65
55-GC 31.25 68-GC 38.17
56-GC 25.00 69-GC 23.81 0.4
57-GC 26.67 70-GC 6.90
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 35.71
Difference
60-GC 16.67 73-GC 14.29 0
61-GC 0.00 74-GC 33.33
62-GC 25.00 75-GC 0.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
277
hildesheim 10.2415/GC-MONO-EN-CLEF2007.HILDESHEIM.HIMOENNE GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 3
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language English
Relevant 650 Topic Fields title, description
Relevant retrieved 429 Pooled false
Geometric Mean Average Precision 0.0326 Using Geo Named Entities, small weight more terms
Binary Preference (BPREF) 0.1625
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 47.36 HIMOENNE
10 38.70 90%
20 29.79
80%
30 21.82
40 12.67 70%
50 10.10
60%
60 8.56
Precision
70 7.01 50%
80 5.01 40%
90 3.55
30%
100 1.20
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
15.35 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7805
Minimum 0.0000
First Quartile 0.0200
Second Quartile 0.1127
Third Quartile 0.2505
Interquartile range 0.2305 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.1535
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1736 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 8
Upper Outlier Threshold 0.3333
6
Mean With No Outliers 0.1274
4
Std With No Outliers 0.1168
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries HIMOENNE
51-GC 78.05 64-GC 1.34 0.8
52-GC 0.43 65-GC 8.41
53-GC 9.10 66-GC 33.33
0.6
54-GC 8.52 67-GC 12.35
55-GC 11.27 68-GC 28.05
56-GC 14.22 69-GC 24.30 0.4
57-GC 17.58 70-GC 2.86
58-GC 2.06 71-GC 0.00 0.2
59-GC 0.00 72-GC 25.21
Difference
60-GC 11.43 73-GC 3.52 0
61-GC 1.85 74-GC 31.77
62-GC 25.00 75-GC 33.06
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
278
hildesheim 10.2415/GC-MONO-EN-CLEF2007.HILDESHEIM.HIMOENNE GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 20.80 HIMOENNE
10 docs 20.40 90%
15 docs 18.93
80%
20 docs 17.00
30 docs 16.27 70%
100 docs 10.20
60%
200 docs 6.44
Precision
500 docs 3.16 50%
1000 docs 1.72 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
17.76
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7411
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.1667
Third Quartile 0.2708
Interquartile range 0.2708 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.1776
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1776 8
Number of Topics of the Experiment
7
Lower Outlier Threshold 0.0000
6
Upper Outlier Threshold 0.4000 5
Mean With No Outliers 0.1541 4
3
Std With No Outliers 0.1361
2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries HIMOENNE
51-GC 74.11 64-GC 0.00 0.8
52-GC 0.00 65-GC 21.51
53-GC 17.19 66-GC 33.33
0.6
54-GC 14.29 67-GC 23.53
55-GC 18.75 68-GC 37.40
56-GC 12.50 69-GC 19.05 0.4
57-GC 6.67 70-GC 10.34
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 35.71
Difference
60-GC 16.67 73-GC 0.00 0
61-GC 4.55 74-GC 33.33
62-GC 25.00 75-GC 40.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
279
hildesheim 10.2415/GC-MONO-EN-CLEF2007.HILDESHEIM.HIMOENNE2 GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 4
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 23,932 Source Language English
Relevant 650 Topic Fields title, description
Relevant retrieved 422 Pooled false
Geometric Mean Average Precision 0.0284 GeoBRF fewer Terms higher weight
Binary Preference (BPREF) 0.1448
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 44.38 HIMOENNE2
10 35.10 90%
20 26.24
80%
30 20.78
40 9.77 70%
50 6.76
60%
60 5.02
Precision
70 4.31 50%
80 2.88 40%
90 1.11
30%
100 0.23
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
12.69 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.5330
Minimum 0.0000
First Quartile 0.0115
Second Quartile 0.1139
Third Quartile 0.1830
Interquartile range 0.1715 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.1269
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1306 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 8
Upper Outlier Threshold 0.3333
6
Mean With No Outliers 0.1100
4
Std With No Outliers 0.1016
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries HIMOENNE2
51-GC 53.30 64-GC 1.05 0.8
52-GC 0.74 65-GC 5.79
53-GC 12.95 66-GC 33.33
0.6
54-GC 8.52 67-GC 18.69
55-GC 18.16 68-GC 32.80
56-GC 14.22 69-GC 11.76 0.4
57-GC 15.02 70-GC 1.10
58-GC 1.16 71-GC 0.00 0.2
59-GC 0.00 72-GC 25.21
Difference
60-GC 11.39 73-GC 4.24 0
61-GC 1.85 74-GC 17.32
62-GC 8.33 75-GC 20.30
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
280
hildesheim 10.2415/GC-MONO-EN-CLEF2007.HILDESHEIM.HIMOENNE2 GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 20.00 HIMOENNE2
10 docs 18.80 90%
15 docs 17.33
80%
20 docs 16.00
30 docs 14.27 70%
100 docs 9.04
60%
200 docs 6.02
Precision
500 docs 2.99 50%
1000 docs 1.69 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
17.22
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.5357
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.1720
Third Quartile 0.2956
Interquartile range 0.2956 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.1722
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1534 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 8
Upper Outlier Threshold 0.5357
6
Mean With No Outliers 0.1722
4
Std With No Outliers 0.1534
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries HIMOENNE2
51-GC 53.57 64-GC 0.00 0.8
52-GC 0.00 65-GC 17.20
53-GC 20.31 66-GC 33.33
0.6
54-GC 14.29 67-GC 29.41
55-GC 25.00 68-GC 40.46
56-GC 12.50 69-GC 19.05 0.4
57-GC 20.00 70-GC 3.45
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 35.71
Difference
60-GC 13.33 73-GC 0.00 0
61-GC 4.55 74-GC 33.33
62-GC 25.00 75-GC 30.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
281
icl 10.2415/GC-MONO-EN-CLEF2007.ICL.IMPCOLCOMBINATION GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 1
Total number of documents over all queries Query Construction MANUAL
Retrieved 25,000 Source Language English
Relevant 650 Topic Fields title, description, narrative
Relevant retrieved 330 Pooled true
Geometric Mean Average Precision 0.0086 Combination of Geographic and Textual relevance
Binary Preference (BPREF) 0.1044
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 28.78 IMPCOLCOMBINATION
10 27.40 90%
20 18.51
80%
30 15.14
40 11.32 70%
50 8.35
60%
60 6.79
Precision
70 4.90 50%
80 2.96 40%
90 2.09
30%
100 1.50
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10.65 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.5481
Minimum 0.0000
First Quartile 0.0017
Second Quartile 0.0225
Third Quartile 0.1181
Interquartile range 0.1164 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.1065
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1704 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.1697 10
Mean With No Outliers 0.0387
Std With No Outliers 0.0531 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries IMPCOLCOMBINATION
51-GC 0.18 64-GC 3.47 0.8
52-GC 2.25 65-GC 0.94
53-GC 0.14 66-GC 0.94
0.6
54-GC 0.00 67-GC 53.53
55-GC 0.06 68-GC 46.14
56-GC 16.97 69-GC 0.78 0.4
57-GC 0.64 70-GC 10.15
58-GC 11.31 71-GC 0.00 0.2
59-GC 0.00 72-GC 54.81
Difference
60-GC 11.43 73-GC 3.64 0
61-GC 5.26 74-GC 12.93
62-GC 0.19 75-GC 30.50
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
282
icl 10.2415/GC-MONO-EN-CLEF2007.ICL.IMPCOLCOMBINATION GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 16.00 IMPCOLCOMBINATION
10 docs 14.40 90%
15 docs 13.33
80%
20 docs 12.60
30 docs 10.93 70%
100 docs 5.96
60%
200 docs 3.96
Precision
500 docs 2.18 50%
1000 docs 1.32 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
12.47
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.5000
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0179
Third Quartile 0.2177
Interquartile range 0.2177 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.1247
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1707 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.5000 10
Mean With No Outliers 0.1247
Std With No Outliers 0.1707 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries IMPCOLCOMBINATION
51-GC 1.79 64-GC 5.88 0.8
52-GC 0.00 65-GC 3.23
53-GC 0.00 66-GC 0.00
0.6
54-GC 0.00 67-GC 47.06
55-GC 0.00 68-GC 43.51
56-GC 25.00 69-GC 0.00 0.4
57-GC 0.00 70-GC 20.69
58-GC 16.67 71-GC 0.00 0.2
59-GC 0.00 72-GC 50.00
Difference
60-GC 30.00 73-GC 14.29 0
61-GC 13.64 74-GC 0.00
62-GC 0.00 75-GC 40.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
283
icl 10.2415/GC-MONO-EN-CLEF2007.ICL.IMPCOLGEOONLY GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 2
Total number of documents over all queries Query Construction MANUAL
Retrieved 21,004 Source Language English
Relevant 650 Topic Fields title, description, narrative
Relevant retrieved 99 Pooled true
Geometric Mean Average Precision 0.0004 Geographic relevance only
Binary Preference (BPREF) 0.0020
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 2.97 IMPCOLGEOONLY
10 2.78 90%
20 2.50
80%
30 2.06
40 1.19 70%
50 0.93
60%
60 0.79
Precision
70 0.46 50%
80 0.41 40%
90 0.12
30%
100 0.12
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
1.13 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.0971
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0006
Third Quartile 0.0093
Interquartile range 0.0093 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.0113
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.0245 25
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 20
Upper Outlier Threshold 0.0167
15
Mean With No Outliers 0.0029
10
Std With No Outliers 0.0052
5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries IMPCOLGEOONLY
51-GC 0.01 64-GC 1.67 0.8
52-GC 0.79 65-GC 0.08
53-GC 0.06 66-GC 0.51
0.6
54-GC 0.02 67-GC 0.00
55-GC 0.00 68-GC 0.00
56-GC 0.00 69-GC 0.31 0.4
57-GC 0.01 70-GC 5.30
58-GC 0.23 71-GC 0.00 0.2
59-GC 0.00 72-GC 0.00
Difference
60-GC 1.35 73-GC 0.00 0
61-GC 1.37 74-GC 9.71
62-GC 0.06 75-GC 6.81
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
284
icl 10.2415/GC-MONO-EN-CLEF2007.ICL.IMPCOLGEOONLY GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 0.80 IMPCOLGEOONLY
10 docs 0.40 90%
15 docs 0.53
80%
20 docs 0.80
30 docs 1.07 70%
100 docs 1.36
60%
200 docs 1.16
Precision
500 docs 0.66 50%
1000 docs 0.40 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
0.64
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.1034
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0000
Third Quartile 0.0000
Interquartile range 0.0000 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.0064
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.0222 25
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 20
Upper Outlier Threshold 0.0000
15
Mean With No Outliers 0.0000
10
Std With No Outliers 0.0000
5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries IMPCOLGEOONLY
51-GC 0.00 64-GC 0.00 0.8
52-GC 0.00 65-GC 1.08
53-GC 0.00 66-GC 0.00
0.6
54-GC 0.00 67-GC 0.00
55-GC 0.00 68-GC 0.00
56-GC 0.00 69-GC 0.00 0.4
57-GC 0.00 70-GC 10.34
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 0.00
Difference
60-GC 0.00 73-GC 0.00 0
61-GC 4.55 74-GC 0.00
62-GC 0.00 75-GC 0.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
285
icl 10.2415/GC-MONO-EN-CLEF2007.ICL.IMPCOLNOGEO GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 4
Total number of documents over all queries Query Construction MANUAL
Retrieved 24,001 Source Language English
Relevant 650 Topic Fields title, description, narrative
Relevant retrieved 354 Pooled false
Geometric Mean Average Precision 0.0060 Text with no Geographic Entities
Binary Preference (BPREF) 0.1261
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 36.35 IMPCOLNOGEO
10 32.05 90%
20 15.40
80%
30 9.66
40 8.15 70%
50 7.07
60%
60 6.07
Precision
70 4.55 50%
80 2.28 40%
90 1.39
30%
100 0.42
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
9.94 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.4818
Minimum 0.0000
First Quartile 0.0007
Second Quartile 0.0105
Third Quartile 0.1561
Interquartile range 0.1554 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.0994
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1473 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.3875 10
Mean With No Outliers 0.0835
Std With No Outliers 0.1265 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries IMPCOLNOGEO
51-GC 16.92 64-GC 0.21 0.8
52-GC 0.66 65-GC 0.33
53-GC 1.89 66-GC 0.00
0.6
54-GC 14.32 67-GC 38.75
55-GC 27.70 68-GC 37.89
56-GC 15.18 69-GC 0.11 0.4
57-GC 28.67 70-GC 0.04
58-GC 0.08 71-GC 0.00 0.2
59-GC 0.00 72-GC 48.18
Difference
60-GC 0.08 73-GC 7.31 0
61-GC 1.05 74-GC 0.04
62-GC 6.35 75-GC 2.83
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
286
icl 10.2415/GC-MONO-EN-CLEF2007.ICL.IMPCOLNOGEO GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 17.60 IMPCOLNOGEO
10 docs 14.40 90%
15 docs 12.53
80%
20 docs 11.20
30 docs 9.20 70%
100 docs 5.48
60%
200 docs 3.48
Precision
500 docs 2.09 50%
1000 docs 1.42 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
12.05
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.5714
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0215
Third Quartile 0.2500
Interquartile range 0.2500 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.1205
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1617 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.5714 10
Mean With No Outliers 0.1205
Std With No Outliers 0.1617 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries IMPCOLNOGEO
51-GC 30.36 64-GC 0.00 0.8
52-GC 0.00 65-GC 2.15
53-GC 10.94 66-GC 0.00
0.6
54-GC 14.29 67-GC 41.18
55-GC 25.00 68-GC 36.64
56-GC 12.50 69-GC 0.00 0.4
57-GC 26.67 70-GC 0.00
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 57.14
Difference
60-GC 0.00 73-GC 14.29 0
61-GC 0.00 74-GC 0.00
62-GC 25.00 75-GC 5.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
287
icl 10.2415/GC-MONO-EN-CLEF2007.ICL.IMPCOLTEXTONLY GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 3
Total number of documents over all queries Query Construction MANUAL
Retrieved 25,000 Source Language English
Relevant 650 Topic Fields title, description, narrative
Relevant retrieved 490 Pooled false
Geometric Mean Average Precision 0.0331 Text Only
Binary Preference (BPREF) 0.1978
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 52.15 IMPCOLTEXTONLY
10 45.55 90%
20 33.25
80%
30 25.60
40 17.74 70%
50 14.10
60%
60 11.73
Precision
70 9.10 50%
80 5.88 40%
90 2.94
30%
100 1.71
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
18.52 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.6436
Minimum 0.0000
First Quartile 0.0187
Second Quartile 0.1003
Third Quartile 0.3696
Interquartile range 0.3508 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.1852
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2078 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 8
Upper Outlier Threshold 0.6436
6
Mean With No Outliers 0.1852
4
Std With No Outliers 0.2078
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries IMPCOLTEXTONLY
51-GC 45.67 64-GC 3.17 0.8
52-GC 0.46 65-GC 10.64
53-GC 1.94 66-GC 0.75
0.6
54-GC 2.86 67-GC 53.53
55-GC 10.33 68-GC 46.14
56-GC 16.97 69-GC 10.03 0.4
57-GC 36.83 70-GC 3.80
58-GC 9.45 71-GC 0.00 0.2
59-GC 0.00 72-GC 54.81
Difference
60-GC 64.36 73-GC 5.47 0
61-GC 16.51 74-GC 37.35
62-GC 1.69 75-GC 30.26
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
288
icl 10.2415/GC-MONO-EN-CLEF2007.ICL.IMPCOLTEXTONLY GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 32.80 IMPCOLTEXTONLY
10 docs 26.40 90%
15 docs 23.20
80%
20 docs 21.80
30 docs 18.27 70%
100 docs 9.92
60%
200 docs 6.44
Precision
500 docs 3.37 50%
1000 docs 1.96 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
20.53
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.6333
Minimum 0.0000
First Quartile 0.0441
Second Quartile 0.1875
Third Quartile 0.3083
Interquartile range 0.2642 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.2053
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1838 6
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 5
Upper Outlier Threshold 0.6333 4
Mean With No Outliers 0.2053 3
Std With No Outliers 0.1838 2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries IMPCOLTEXTONLY
51-GC 46.43 64-GC 5.88 0.8
52-GC 0.00 65-GC 21.51
53-GC 7.81 66-GC 0.00
0.6
54-GC 14.29 67-GC 47.06
55-GC 18.75 68-GC 43.51
56-GC 25.00 69-GC 19.05 0.4
57-GC 26.67 70-GC 6.90
58-GC 16.67 71-GC 0.00 0.2
59-GC 0.00 72-GC 50.00
Difference
60-GC 63.33 73-GC 14.29 0
61-GC 22.73 74-GC 33.33
62-GC 0.00 75-GC 30.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
289
linguit 10.2415/GC-MONO-EN-CLEF2007.LINGUIT.LTITLE2007 GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 1
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 23,678 Source Language English
Relevant 650 Topic Fields title
Relevant retrieved 450 Pooled true
Geometric Mean Average Precision 0.0108 see README
Binary Preference (BPREF) 0.1528
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 43.48 LTITLE2007
10 33.31 90%
20 28.64
80%
30 20.29
40 13.22 70%
50 10.74
60%
60 8.80
Precision
70 7.26 50%
80 5.30 40%
90 1.26
30%
100 0.85
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
14.19 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.6808
Minimum 0.0000
First Quartile 0.0014
Second Quartile 0.0753
Third Quartile 0.2862
Interquartile range 0.2849 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.1419
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1754 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.6808 10
Mean With No Outliers 0.1419
Std With No Outliers 0.1754 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries LTITLE2007
51-GC 36.34 64-GC 0.17 0.8
52-GC 1.99 65-GC 33.53
53-GC 10.24 66-GC 33.90
0.6
54-GC 9.57 67-GC 33.81
55-GC 0.56 68-GC 32.34
56-GC 0.03 69-GC 0.00 0.4
57-GC 7.53 70-GC 3.77
58-GC 3.18 71-GC 0.00 0.2
59-GC 0.00 72-GC 23.90
Difference
60-GC 68.08 73-GC 0.00 0
61-GC 13.26 74-GC 0.42
62-GC 27.38 75-GC 14.61
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
290
linguit 10.2415/GC-MONO-EN-CLEF2007.LINGUIT.LTITLE2007 GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 23.20 LTITLE2007
10 docs 21.20 90%
15 docs 18.67
80%
20 docs 17.40
30 docs 15.73 70%
100 docs 9.56
60%
200 docs 6.28
Precision
500 docs 3.17 50%
1000 docs 1.80 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
16.64
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7000
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.1333
Third Quartile 0.2878
Interquartile range 0.2878 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.1664
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1876 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 8
Upper Outlier Threshold 0.7000
6
Mean With No Outliers 0.1664
4
Std With No Outliers 0.1876
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries LTITLE2007
51-GC 45.54 64-GC 0.00 0.8
52-GC 9.09 65-GC 39.78
53-GC 17.19 66-GC 33.33
0.6
54-GC 14.29 67-GC 29.41
55-GC 0.00 68-GC 40.46
56-GC 0.00 69-GC 0.00 0.4
57-GC 13.33 70-GC 6.90
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 28.57
Difference
60-GC 70.00 73-GC 0.00 0
61-GC 18.18 74-GC 0.00
62-GC 25.00 75-GC 25.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
291
linguit 10.2415/GC-MONO-EN-CLEF2007.LINGUIT.LTITLEDESC2007 GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 2
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 24,678 Source Language English
Relevant 650 Topic Fields title, description
Relevant retrieved 457 Pooled true
Geometric Mean Average Precision 0.0150 see README
Binary Preference (BPREF) 0.1528
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 43.65 LTITLEDESC2007
10 33.48 90%
20 28.81
80%
30 20.46
40 13.40 70%
50 10.90
60%
60 8.93
Precision
70 7.39 50%
80 5.44 40%
90 1.36
30%
100 0.95
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
14.33 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.6808
Minimum 0.0000
First Quartile 0.0036
Second Quartile 0.0753
Third Quartile 0.2862
Interquartile range 0.2826 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.1433
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1743 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.6808 10
Mean With No Outliers 0.1433
Std With No Outliers 0.1743 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries LTITLEDESC2007
51-GC 36.34 64-GC 0.17 0.8
52-GC 1.99 65-GC 33.53
53-GC 10.24 66-GC 33.90
0.6
54-GC 9.57 67-GC 33.81
55-GC 0.56 68-GC 32.34
56-GC 0.03 69-GC 0.00 0.4
57-GC 7.53 70-GC 3.77
58-GC 3.18 71-GC 0.00 0.2
59-GC 0.00 72-GC 23.90
Difference
60-GC 68.08 73-GC 3.65 0
61-GC 13.26 74-GC 0.42
62-GC 27.38 75-GC 14.61
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
292
linguit 10.2415/GC-MONO-EN-CLEF2007.LINGUIT.LTITLEDESC2007 GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 23.20 LTITLEDESC2007
10 docs 21.20 90%
15 docs 18.67
80%
20 docs 17.40
30 docs 15.87 70%
100 docs 9.68
60%
200 docs 6.40
Precision
500 docs 3.22 50%
1000 docs 1.83 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
16.64
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7000
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.1333
Third Quartile 0.2878
Interquartile range 0.2878 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.1664
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1876 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 8
Upper Outlier Threshold 0.7000
6
Mean With No Outliers 0.1664
4
Std With No Outliers 0.1876
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries LTITLEDESC2007
51-GC 45.54 64-GC 0.00 0.8
52-GC 9.09 65-GC 39.78
53-GC 17.19 66-GC 33.33
0.6
54-GC 14.29 67-GC 29.41
55-GC 0.00 68-GC 40.46
56-GC 0.00 69-GC 0.00 0.4
57-GC 13.33 70-GC 6.90
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 28.57
Difference
60-GC 70.00 73-GC 0.00 0
61-GC 18.18 74-GC 0.00
62-GC 25.00 75-GC 25.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
293
linguit 10.2415/GC-MONO-EN-CLEF2007.LINGUIT.LTITLEEXPMANUAL2007 GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 3
Total number of documents over all queries Query Construction MANUAL
Retrieved 22,678 Source Language English
Relevant 650 Topic Fields title
Relevant retrieved 425 Pooled false
Geometric Mean Average Precision 0.0114 see README
Binary Preference (BPREF) 0.1744
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 44.32 LTITLEEXPMANUAL2007
10 32.56 90%
20 27.42
80%
30 20.51
40 13.92 70%
50 12.15
60%
60 10.08
Precision
70 8.03 50%
80 6.21 40%
90 3.59
30%
100 0.88
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
14.83 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7152
Minimum 0.0000
First Quartile 0.0026
Second Quartile 0.0555
Third Quartile 0.2862
Interquartile range 0.2836 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.1483
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1914 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.5042 10
Mean With No Outliers 0.1247
Std With No Outliers 0.1538 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries LTITLEEXPMANUAL2007
51-GC 9.59 64-GC 0.71 0.8
52-GC 1.99 65-GC 33.53
53-GC 5.55 66-GC 36.90
0.6
54-GC 0.33 67-GC 35.47
55-GC 0.66 68-GC 32.34
56-GC 0.03 69-GC 3.84 0.4
57-GC 0.00 70-GC 7.14
58-GC 4.88 71-GC 0.00 0.2
59-GC 0.00 72-GC 23.90
Difference
60-GC 71.52 73-GC 0.00 0
61-GC 13.26 74-GC 11.24
62-GC 27.38 75-GC 50.42
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
294
linguit 10.2415/GC-MONO-EN-CLEF2007.LINGUIT.LTITLEEXPMANUAL2007 GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 21.60 LTITLEEXPMANUAL2007
10 docs 20.80 90%
15 docs 19.20
80%
20 docs 17.60
30 docs 15.60 70%
100 docs 8.48
60%
200 docs 5.42
Precision
500 docs 2.82 50%
1000 docs 1.70 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
17.57
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7000
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0952
Third Quartile 0.3333
Interquartile range 0.3333 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.1757
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1984 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 8
Upper Outlier Threshold 0.7000
6
Mean With No Outliers 0.1757
4
Std With No Outliers 0.1984
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries LTITLEEXPMANUAL2007
51-GC 15.18 64-GC 0.00 0.8
52-GC 9.09 65-GC 39.78
53-GC 9.38 66-GC 33.33
0.6
54-GC 0.00 67-GC 35.29
55-GC 0.00 68-GC 40.46
56-GC 0.00 69-GC 9.52 0.4
57-GC 0.00 70-GC 17.24
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 28.57
Difference
60-GC 70.00 73-GC 0.00 0
61-GC 18.18 74-GC 33.33
62-GC 25.00 75-GC 55.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
295
linguit 10.2415/GC-MONO-EN-CLEF2007.LINGUIT.LTITLEGEORERANK2007 GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 4
Total number of documents over all queries Query Construction MANUAL
Retrieved 10,910 Source Language English
Relevant 650 Topic Fields title
Relevant retrieved 273 Pooled false
Geometric Mean Average Precision 0.0018 see README
Binary Preference (BPREF) 0.1156
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 33.89 LTITLEGEORERANK2007
10 22.65 90%
20 19.45
80%
30 14.39
40 9.01 70%
50 7.64
60%
60 6.37
Precision
70 4.45 50%
80 2.65 40%
90 0.08
30%
100 0.08
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
9.75 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.6808
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0089
Third Quartile 0.1015
Interquartile range 0.1015 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.0975
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1731 20
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
15
Upper Outlier Threshold 0.1189
Mean With No Outliers 0.0203 10
Std With No Outliers 0.0361
5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries LTITLEGEORERANK2007
51-GC 36.51 64-GC 0.00 0.8
52-GC 0.89 65-GC 11.89
53-GC 1.72 66-GC 37.25
0.6
54-GC 9.57 67-GC 0.00
55-GC 0.56 68-GC 32.34
56-GC 0.00 69-GC 0.00 0.4
57-GC 2.22 70-GC 1.12
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 8.63
Difference
60-GC 68.08 73-GC 0.00 0
61-GC 0.00 74-GC 0.42
62-GC 28.85 75-GC 3.62
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
296
linguit 10.2415/GC-MONO-EN-CLEF2007.LINGUIT.LTITLEGEORERANK2007 GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 16.80 LTITLEGEORERANK2007
10 docs 14.00 90%
15 docs 13.33
80%
20 docs 13.60
30 docs 12.00 70%
100 docs 6.48
60%
200 docs 4.28
Precision
500 docs 2.04 50%
1000 docs 1.09 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
11.38
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7000
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0000
Third Quartile 0.1609
Interquartile range 0.1609 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.1138
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1853 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.3333 10
Mean With No Outliers 0.0576
Std With No Outliers 0.0968 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries LTITLEGEORERANK2007
51-GC 47.32 64-GC 0.00 0.8
52-GC 0.00 65-GC 21.51
53-GC 3.12 66-GC 33.33
0.6
54-GC 14.29 67-GC 0.00
55-GC 0.00 68-GC 40.46
56-GC 0.00 69-GC 0.00 0.4
57-GC 6.67 70-GC 3.45
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 14.29
Difference
60-GC 70.00 73-GC 0.00 0
61-GC 0.00 74-GC 0.00
62-GC 25.00 75-GC 5.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
297
moscow 10.2415/GC-MONO-EN-CLEF2007.MOSCOW.CIRGEOEN07_RUN1 GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 2
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 20,600 Source Language Spanish; Castilian
Relevant 650 Topic Fields title, description
Relevant retrieved 524 Pooled true
Geometric Mean Average Precision 0.0091 tfidf+near
Binary Preference (BPREF) 0.1707
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 46.69 CIRGEOEN07_RUN1
10 36.91 90%
20 23.37
80%
30 22.02
40 17.63 70%
50 16.75
60%
60 13.78
Precision
70 11.37 50%
80 8.98 40%
90 5.67
30%
100 2.31
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
17.61 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7283
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0875
Third Quartile 0.2820
Interquartile range 0.2820 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.1761
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2292 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 8
Upper Outlier Threshold 0.6999
6
Mean With No Outliers 0.1531
4
Std With No Outliers 0.2025
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries CIRGEOEN07_RUN1
51-GC 72.83 64-GC 0.00 0.8
52-GC 9.63 65-GC 34.92
53-GC 10.03 66-GC 16.87
0.6
54-GC 0.00 67-GC 38.57
55-GC 0.88 68-GC 69.99
56-GC 13.90 69-GC 32.79 0.4
57-GC 0.00 70-GC 2.13
58-GC 19.65 71-GC 0.00 0.2
59-GC 0.00 72-GC 26.67
Difference
60-GC 66.31 73-GC 8.25 0
61-GC 7.53 74-GC 0.00
62-GC 0.58 75-GC 8.75
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
298
moscow 10.2415/GC-MONO-EN-CLEF2007.MOSCOW.CIRGEOEN07_RUN1 GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 28.00 CIRGEOEN07_RUN1
10 docs 23.20 90%
15 docs 21.60
80%
20 docs 20.00
30 docs 17.07 70%
100 docs 11.68
60%
200 docs 7.84
Precision
500 docs 3.92 50%
1000 docs 2.10 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
17.51
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.6947
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.1250
Third Quartile 0.2598
Interquartile range 0.2598 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.1751
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2183 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.6339 10
Mean With No Outliers 0.1534
Std With No Outliers 0.1936 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries CIRGEOEN07_RUN1
51-GC 63.39 64-GC 0.00 0.8
52-GC 9.09 65-GC 44.09
53-GC 14.06 66-GC 33.33
0.6
54-GC 0.00 67-GC 23.53
55-GC 0.00 68-GC 69.47
56-GC 12.50 69-GC 38.10 0.4
57-GC 0.00 70-GC 3.45
58-GC 16.67 71-GC 0.00 0.2
59-GC 0.00 72-GC 21.43
Difference
60-GC 60.00 73-GC 0.00 0
61-GC 13.64 74-GC 0.00
62-GC 0.00 75-GC 15.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
299
moscow 10.2415/GC-MONO-EN-CLEF2007.MOSCOW.CIRGEOEN07_RUN2 GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 1
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 22,000 Source Language English
Relevant 650 Topic Fields title, narrative
Relevant retrieved 524 Pooled true
Geometric Mean Average Precision 0.0102 separate union of geo terms
Binary Preference (BPREF) 0.1653
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 45.86 CIRGEOEN07_RUN2
10 32.80 90%
20 21.15
80%
30 20.17
40 16.29 70%
50 15.42
60%
60 13.05
Precision
70 11.27 50%
80 9.20 40%
90 5.69
30%
100 2.33
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
16.59 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7283
Minimum 0.0000
First Quartile 0.0019
Second Quartile 0.0875
Third Quartile 0.2229
Interquartile range 0.2210 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.1659
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2305 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.3857 10
Mean With No Outliers 0.0935
Std With No Outliers 0.1217 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries CIRGEOEN07_RUN2
51-GC 72.83 64-GC 0.00 0.8
52-GC 9.63 65-GC 34.92
53-GC 10.03 66-GC 16.87
0.6
54-GC 0.25 67-GC 38.57
55-GC 0.85 68-GC 69.99
56-GC 1.50 69-GC 33.42 0.4
57-GC 0.00 70-GC 2.13
58-GC 18.58 71-GC 0.00 0.2
59-GC 0.00 72-GC 9.88
Difference
60-GC 66.31 73-GC 12.10 0
61-GC 7.53 74-GC 0.00
62-GC 0.58 75-GC 8.75
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
300
moscow 10.2415/GC-MONO-EN-CLEF2007.MOSCOW.CIRGEOEN07_RUN2 GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 27.20 CIRGEOEN07_RUN2
10 docs 21.60 90%
15 docs 20.53
80%
20 docs 18.80
30 docs 16.40 70%
100 docs 11.32
60%
200 docs 7.70
Precision
500 docs 3.90 50%
1000 docs 2.10 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
17.30
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.6947
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.1364
Third Quartile 0.2598
Interquartile range 0.2598 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.1730
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2181 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.6339 10
Mean With No Outliers 0.1512
Std With No Outliers 0.1931 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries CIRGEOEN07_RUN2
51-GC 63.39 64-GC 0.00 0.8
52-GC 9.09 65-GC 44.09
53-GC 14.06 66-GC 33.33
0.6
54-GC 0.00 67-GC 23.53
55-GC 0.00 68-GC 69.47
56-GC 0.00 69-GC 38.10 0.4
57-GC 0.00 70-GC 3.45
58-GC 16.67 71-GC 0.00 0.2
59-GC 0.00 72-GC 14.29
Difference
60-GC 60.00 73-GC 14.29 0
61-GC 13.64 74-GC 0.00
62-GC 0.00 75-GC 15.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
301
msasia 10.2415/GC-MONO-EN-CLEF2007.MSASIA.MSRAEXPANSION GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 3
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 13,154 Source Language English
Relevant 650 Topic Fields title, description
Relevant retrieved 249 Pooled false
Geometric Mean Average Precision 0.0014 using query expansion
Binary Preference (BPREF) 0.0807
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 24.89 MSRAEXPANSION
10 19.12 90%
20 15.23
80%
30 9.16
40 5.27 70%
50 4.22
60%
60 3.27
Precision
70 2.56 50%
80 1.67 40%
90 0.00
30%
100 0.00
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
7.01 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.5801
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0035
Third Quartile 0.0834
Interquartile range 0.0834 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.0701
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1349 20
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
15
Upper Outlier Threshold 0.1338
Mean With No Outliers 0.0273 10
Std With No Outliers 0.0438
5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries MSRAEXPANSION
51-GC 58.01 64-GC 0.35 0.8
52-GC 4.82 65-GC 12.36
53-GC 7.99 66-GC 1.15
0.6
54-GC 0.00 67-GC 1.96
55-GC 0.16 68-GC 8.26
56-GC 0.00 69-GC 0.00 0.4
57-GC 8.58 70-GC 13.38
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 0.00
Difference
60-GC 0.92 73-GC 0.12 0
61-GC 32.27 74-GC 0.00
62-GC 25.00 75-GC 0.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
302
msasia 10.2415/GC-MONO-EN-CLEF2007.MSASIA.MSRAEXPANSION GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 16.00 MSRAEXPANSION
10 docs 14.80 90%
15 docs 13.07
80%
20 docs 11.20
30 docs 9.60 70%
100 docs 6.20
60%
200 docs 4.16
Precision
500 docs 1.88 50%
1000 docs 1.00 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
8.89
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.6429
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0000
Third Quartile 0.1391
Interquartile range 0.1391 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.0889
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1541 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.2500 10
Mean With No Outliers 0.0529
Std With No Outliers 0.0847 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries MSRAEXPANSION
51-GC 64.29 64-GC 0.00 0.8
52-GC 9.09 65-GC 23.66
53-GC 15.62 66-GC 0.00
0.6
54-GC 0.00 67-GC 5.88
55-GC 0.00 68-GC 8.40
56-GC 0.00 69-GC 0.00 0.4
57-GC 13.33 70-GC 20.69
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 0.00
Difference
60-GC 0.00 73-GC 0.00 0
61-GC 36.36 74-GC 0.00
62-GC 25.00 75-GC 0.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
303
msasia 10.2415/GC-MONO-EN-CLEF2007.MSASIA.MSRALDA GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 1
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 24,999 Source Language English
Relevant 650 Topic Fields title, description, narrative
Relevant retrieved 418 Pooled true
Geometric Mean Average Precision 0.0074 combine Latent Dirichlet Allocation model
Binary Preference (BPREF) 0.0886
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 34.80 MSRALDA
10 22.55 90%
20 17.83
80%
30 7.44
40 5.09 70%
50 3.99
60%
60 2.56
Precision
70 1.82 50%
80 1.24 40%
90 0.18
30%
100 0.09
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
7.52 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.3375
Minimum 0.0000
First Quartile 0.0015
Second Quartile 0.0455
Third Quartile 0.1249
Interquartile range 0.1234 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.0752
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.0901 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.2390 10
Mean With No Outliers 0.0642
Std With No Outliers 0.0731 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries MSRALDA
51-GC 33.75 64-GC 0.31 0.8
52-GC 0.00 65-GC 12.68
53-GC 15.97 66-GC 0.00
0.6
54-GC 2.72 67-GC 23.90
55-GC 10.04 68-GC 12.43
56-GC 0.71 69-GC 10.39 0.4
57-GC 7.92 70-GC 6.95
58-GC 5.31 71-GC 0.00 0.2
59-GC 0.00 72-GC 4.55
Difference
60-GC 20.18 73-GC 0.19 0
61-GC 17.00 74-GC 0.78
62-GC 0.03 75-GC 2.11
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
304
msasia 10.2415/GC-MONO-EN-CLEF2007.MSASIA.MSRALDA GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 20.80 MSRALDA
10 docs 15.20 90%
15 docs 13.87
80%
20 docs 13.00
30 docs 11.33 70%
100 docs 6.32
60%
200 docs 4.30
Precision
500 docs 2.82 50%
1000 docs 1.67 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
9.97
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.2946
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0667
Third Quartile 0.1929
Interquartile range 0.1929 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.0997
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1067 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.2946 10
Mean With No Outliers 0.0997
Std With No Outliers 0.1067 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries MSRALDA
51-GC 29.46 64-GC 0.00 0.8
52-GC 0.00 65-GC 13.98
53-GC 26.56 66-GC 0.00
0.6
54-GC 0.00 67-GC 23.53
55-GC 18.75 68-GC 25.95
56-GC 0.00 69-GC 19.05 0.4
57-GC 6.67 70-GC 13.79
58-GC 16.67 71-GC 0.00 0.2
59-GC 0.00 72-GC 7.14
Difference
60-GC 20.00 73-GC 0.00 0
61-GC 22.73 74-GC 0.00
62-GC 0.00 75-GC 5.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
305
msasia 10.2415/GC-MONO-EN-CLEF2007.MSASIA.MSRALOCATION GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 4
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 9,983 Source Language English
Relevant 650 Topic Fields title, description
Relevant retrieved 241 Pooled false
Geometric Mean Average Precision 0.0018 using locaitons extracted from topics without
Binary Preference (BPREF) 0.1055 expansion
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 29.59 MSRALOCATION
10 22.73 90%
20 18.62
80%
30 12.67
40 8.73 70%
50 6.84
60%
60 2.69
Precision
70 2.37 50%
80 1.55 40%
90 0.00
30%
100 0.00
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
8.61 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.5801
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0101
Third Quartile 0.1313
Interquartile range 0.1313 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.0861
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1454 20
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
15
Upper Outlier Threshold 0.3227
Mean With No Outliers 0.0655 10
Std With No Outliers 0.1050
5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries MSRALOCATION
51-GC 58.01 64-GC 2.16 0.8
52-GC 4.82 65-GC 12.36
53-GC 15.43 66-GC 0.00
0.6
54-GC 0.00 67-GC 1.96
55-GC 0.16 68-GC 8.26
56-GC 0.00 69-GC 0.00 0.4
57-GC 31.49 70-GC 20.34
58-GC 1.01 71-GC 0.00 0.2
59-GC 0.00 72-GC 0.00
Difference
60-GC 0.92 73-GC 1.08 0
61-GC 32.27 74-GC 0.00
62-GC 25.00 75-GC 0.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
306
msasia 10.2415/GC-MONO-EN-CLEF2007.MSASIA.MSRALOCATION GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 19.20 MSRALOCATION
10 docs 17.60 90%
15 docs 16.00
80%
20 docs 13.60
30 docs 11.20 70%
100 docs 6.92
60%
200 docs 4.20
Precision
500 docs 1.84 50%
1000 docs 0.96 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
11.85
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.6429
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0000
Third Quartile 0.2378
Interquartile range 0.2378 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.1185
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1833 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.5333 10
Mean With No Outliers 0.0967
Std With No Outliers 0.1503 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries MSRALOCATION
51-GC 64.29 64-GC 11.76 0.8
52-GC 9.09 65-GC 23.66
53-GC 34.38 66-GC 0.00
0.6
54-GC 0.00 67-GC 5.88
55-GC 0.00 68-GC 8.40
56-GC 0.00 69-GC 0.00 0.4
57-GC 53.33 70-GC 24.14
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 0.00
Difference
60-GC 0.00 73-GC 0.00 0
61-GC 36.36 74-GC 0.00
62-GC 25.00 75-GC 0.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
307
msasia 10.2415/GC-MONO-EN-CLEF2007.MSASIA.MSRATEXT GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 5
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 24,999 Source Language English
Relevant 650 Topic Fields title, description, narrative
Relevant retrieved 408 Pooled false
Geometric Mean Average Precision 0.0149 only use text search engine
Binary Preference (BPREF) 0.1652
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 46.37 MSRATEXT
10 37.49 90%
20 30.63
80%
30 19.37
40 12.87 70%
50 10.31
60%
60 8.98
Precision
70 7.01 50%
80 5.35 40%
90 1.49
30%
100 0.75
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
15.19 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7791
Minimum 0.0000
First Quartile 0.0021
Second Quartile 0.0582
Third Quartile 0.2609
Interquartile range 0.2588 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.1519
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1975 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.5422 10
Mean With No Outliers 0.1258
Std With No Outliers 0.1513 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries MSRATEXT
51-GC 54.22 64-GC 0.03 0.8
52-GC 0.00 65-GC 14.07
53-GC 9.84 66-GC 0.21
0.6
54-GC 0.85 67-GC 36.63
55-GC 0.60 68-GC 25.66
56-GC 14.66 69-GC 5.82 0.4
57-GC 34.03 70-GC 3.40
58-GC 14.81 71-GC 0.00 0.2
59-GC 0.00 72-GC 27.37
Difference
60-GC 77.91 73-GC 0.21 0
61-GC 4.68 74-GC 33.56
62-GC 4.91 75-GC 16.31
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
308
msasia 10.2415/GC-MONO-EN-CLEF2007.MSASIA.MSRATEXT GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 31.20 MSRATEXT
10 docs 24.80 90%
15 docs 21.33
80%
20 docs 20.60
30 docs 16.40 70%
100 docs 9.12
60%
200 docs 5.74
Precision
500 docs 2.85 50%
1000 docs 1.63 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
17.08
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7333
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.1429
Third Quartile 0.2878
Interquartile range 0.2878 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.1708
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1960 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 8
Upper Outlier Threshold 0.5536
6
Mean With No Outliers 0.1473
4
Std With No Outliers 0.1605
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries MSRATEXT
51-GC 55.36 64-GC 0.00 0.8
52-GC 0.00 65-GC 25.81
53-GC 15.62 66-GC 0.00
0.6
54-GC 0.00 67-GC 29.41
55-GC 0.00 68-GC 33.59
56-GC 25.00 69-GC 14.29 0.4
57-GC 40.00 70-GC 6.90
58-GC 16.67 71-GC 0.00 0.2
59-GC 0.00 72-GC 28.57
Difference
60-GC 73.33 73-GC 0.00 0
61-GC 9.09 74-GC 33.33
62-GC 0.00 75-GC 20.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
309
msasia 10.2415/GC-MONO-EN-CLEF2007.MSASIA.MSRAWHITELIST GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 2
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 9,213 Source Language English
Relevant 650 Topic Fields title, description
Relevant retrieved 241 Pooled true
Geometric Mean Average Precision 0.0018 using geo knowledge base
Binary Preference (BPREF) 0.1055
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 29.59 MSRAWHITELIST
10 22.73 90%
20 18.62
80%
30 12.67
40 8.73 70%
50 6.84
60%
60 2.69
Precision
70 2.37 50%
80 1.55 40%
90 0.00
30%
100 0.00
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
8.61 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.5801
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0101
Third Quartile 0.1313
Interquartile range 0.1313 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.0861
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1454 20
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
15
Upper Outlier Threshold 0.3227
Mean With No Outliers 0.0655 10
Std With No Outliers 0.1050
5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries MSRAWHITELIST
51-GC 58.01 64-GC 2.16 0.8
52-GC 4.82 65-GC 12.36
53-GC 15.43 66-GC 0.00
0.6
54-GC 0.00 67-GC 1.96
55-GC 0.16 68-GC 8.26
56-GC 0.00 69-GC 0.00 0.4
57-GC 31.49 70-GC 20.34
58-GC 1.01 71-GC 0.00 0.2
59-GC 0.00 72-GC 0.00
Difference
60-GC 0.92 73-GC 1.08 0
61-GC 32.27 74-GC 0.00
62-GC 25.00 75-GC 0.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
310
msasia 10.2415/GC-MONO-EN-CLEF2007.MSASIA.MSRAWHITELIST GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 19.20 MSRAWHITELIST
10 docs 17.60 90%
15 docs 16.00
80%
20 docs 13.60
30 docs 11.20 70%
100 docs 6.92
60%
200 docs 4.20
Precision
500 docs 1.84 50%
1000 docs 0.96 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
11.85
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.6429
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0000
Third Quartile 0.2378
Interquartile range 0.2378 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.1185
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1833 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.5333 10
Mean With No Outliers 0.0967
Std With No Outliers 0.1503 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries MSRAWHITELIST
51-GC 64.29 64-GC 11.76 0.8
52-GC 9.09 65-GC 23.66
53-GC 34.38 66-GC 0.00
0.6
54-GC 0.00 67-GC 5.88
55-GC 0.00 68-GC 8.40
56-GC 0.00 69-GC 0.00 0.4
57-GC 53.33 70-GC 24.14
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 0.00
Difference
60-GC 0.00 73-GC 0.00 0
61-GC 36.36 74-GC 0.00
62-GC 25.00 75-GC 0.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
311
valencia 10.2415/GC-MONO-EN-CLEF2007.VALENCIA.RFIAUPV01 GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 3
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language English
Relevant 650 Topic Fields title, description
Relevant retrieved 576 Pooled false
Geometric Mean Average Precision 0.0430 basic lucene, topic and description only
Binary Preference (BPREF) 0.2153
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 52.92 RFIAUPV01
10 47.90 90%
20 39.86
80%
30 31.12
40 22.31 70%
50 20.39
60%
60 18.31
Precision
70 15.29 50%
80 10.56 40%
90 4.81
30%
100 2.67
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
22.69 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.6789
Minimum 0.0000
First Quartile 0.0248
Second Quartile 0.1495
Third Quartile 0.3547
Interquartile range 0.3299 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.2269
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2237 8
Number of Topics of the Experiment
7
Lower Outlier Threshold 0.0000
6
Upper Outlier Threshold 0.6789 5
Mean With No Outliers 0.2269 4
3
Std With No Outliers 0.2237
2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries RFIAUPV01
51-GC 52.08 64-GC 0.91 0.8
52-GC 0.21 65-GC 38.14
53-GC 15.24 66-GC 33.72
0.6
54-GC 13.81 67-GC 42.46
55-GC 8.62 68-GC 63.46
56-GC 14.95 69-GC 13.26 0.4
57-GC 17.15 70-GC 2.42
58-GC 2.50 71-GC 0.00 0.2
59-GC 0.00 72-GC 67.68
Difference
60-GC 67.89 73-GC 2.71 0
61-GC 12.19 74-GC 34.59
62-GC 32.43 75-GC 30.91
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
312
valencia 10.2415/GC-MONO-EN-CLEF2007.VALENCIA.RFIAUPV01 GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 28.00 RFIAUPV01
10 docs 25.20 90%
15 docs 23.47
80%
20 docs 22.60
30 docs 19.73 70%
100 docs 12.76
60%
200 docs 8.72
Precision
500 docs 4.23 50%
1000 docs 2.30 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
23.69
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7143
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.2031
Third Quartile 0.3529
Interquartile range 0.3529 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.2369
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2281 8
Number of Topics of the Experiment
7
Lower Outlier Threshold 0.0000
6
Upper Outlier Threshold 0.7143 5
Mean With No Outliers 0.2369 4
3
Std With No Outliers 0.2281
2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries RFIAUPV01
51-GC 50.89 64-GC 0.00 0.8
52-GC 0.00 65-GC 45.16
53-GC 20.31 66-GC 33.33
0.6
54-GC 28.57 67-GC 41.18
55-GC 6.25 68-GC 64.89
56-GC 12.50 69-GC 19.05 0.4
57-GC 26.67 70-GC 3.45
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 71.43
Difference
60-GC 66.67 73-GC 0.00 0
61-GC 13.64 74-GC 33.33
62-GC 25.00 75-GC 30.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
313
valencia 10.2415/GC-MONO-EN-CLEF2007.VALENCIA.RFIAUPV02 GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 4
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language English
Relevant 650 Topic Fields title, description, narrative
Relevant retrieved 587 Pooled false
Geometric Mean Average Precision 0.0465 basic lucene, all fields
Binary Preference (BPREF) 0.2288
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 55.05 RFIAUPV02
10 46.51 90%
20 38.54
80%
30 36.57
40 27.91 70%
50 25.67
60%
60 21.50
Precision
70 16.77 50%
80 13.27 40%
90 6.65
30%
100 3.70
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
24.70 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.6967
Minimum 0.0000
First Quartile 0.0265
Second Quartile 0.1765
Third Quartile 0.4333
Interquartile range 0.4067 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.2470
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2345 8
Number of Topics of the Experiment
7
Lower Outlier Threshold 0.0000
6
Upper Outlier Threshold 0.6967 5
Mean With No Outliers 0.2470 4
3
Std With No Outliers 0.2345
2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries RFIAUPV02
51-GC 68.26 64-GC 8.80 0.8
52-GC 0.11 65-GC 37.10
53-GC 20.90 66-GC 35.24
0.6
54-GC 2.96 67-GC 45.11
55-GC 17.65 68-GC 67.10
56-GC 15.45 69-GC 19.55 0.4
57-GC 45.02 70-GC 1.37
58-GC 13.06 71-GC 0.00 0.2
59-GC 0.00 72-GC 54.56
Difference
60-GC 69.67 73-GC 1.74 0
61-GC 7.44 74-GC 42.77
62-GC 9.33 75-GC 34.37
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
314
valencia 10.2415/GC-MONO-EN-CLEF2007.VALENCIA.RFIAUPV02 GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 28.80 RFIAUPV02
10 docs 29.60 90%
15 docs 27.73
80%
20 docs 26.40
30 docs 23.60 70%
100 docs 13.72
60%
200 docs 9.04
Precision
500 docs 4.37 50%
1000 docs 2.35 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
26.76
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7667
Minimum 0.0000
First Quartile 0.0259
Second Quartile 0.2500
Third Quartile 0.4075
Interquartile range 0.3817 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.2676
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2353 8
Number of Topics of the Experiment
7
Lower Outlier Threshold 0.0000
6
Upper Outlier Threshold 0.7667 5
Mean With No Outliers 0.2676 4
3
Std With No Outliers 0.2353
2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries RFIAUPV02
51-GC 63.39 64-GC 17.65 0.8
52-GC 0.00 65-GC 43.01
53-GC 18.75 66-GC 33.33
0.6
54-GC 14.29 67-GC 47.06
55-GC 12.50 68-GC 67.94
56-GC 25.00 69-GC 38.10 0.4
57-GC 40.00 70-GC 3.45
58-GC 33.33 71-GC 0.00 0.2
59-GC 0.00 72-GC 57.14
Difference
60-GC 76.67 73-GC 0.00 0
61-GC 9.09 74-GC 33.33
62-GC 0.00 75-GC 35.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
315
valencia 10.2415/GC-MONO-EN-CLEF2007.VALENCIA.RFIAUPV03 GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 1
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language English
Relevant 650 Topic Fields title, description
Relevant retrieved 565 Pooled true
Geometric Mean Average Precision 0.0382 geoboost 0.5, no WN, title and description only
Binary Preference (BPREF) 0.2078
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 47.63 RFIAUPV03
10 43.97 90%
20 34.47
80%
30 30.58
40 23.81 70%
50 22.16
60%
60 20.09
Precision
70 17.40 50%
80 12.33 40%
90 6.63
30%
100 4.40
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
22.73 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7350
Minimum 0.0000
First Quartile 0.0262
Second Quartile 0.1219
Third Quartile 0.4277
Interquartile range 0.4015 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.2273
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2510 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 8
Upper Outlier Threshold 0.7350
6
Mean With No Outliers 0.2273
4
Std With No Outliers 0.2510
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries RFIAUPV03
51-GC 50.12 64-GC 1.80 0.8
52-GC 0.09 65-GC 34.32
53-GC 12.81 66-GC 33.72
0.6
54-GC 6.90 67-GC 42.46
55-GC 3.69 68-GC 63.46
56-GC 14.95 69-GC 10.93 0.4
57-GC 16.69 70-GC 2.35
58-GC 3.27 71-GC 0.00 0.2
59-GC 0.00 72-GC 67.68
Difference
60-GC 73.50 73-GC 2.71 0
61-GC 12.19 74-GC 66.67
62-GC 4.34 75-GC 43.68
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
316
valencia 10.2415/GC-MONO-EN-CLEF2007.VALENCIA.RFIAUPV03 GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 28.80 RFIAUPV03
10 docs 26.80 90%
15 docs 24.27
80%
20 docs 22.60
30 docs 20.00 70%
100 docs 12.56
60%
200 docs 8.34
Precision
500 docs 4.19 50%
1000 docs 2.26 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
21.86
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7143
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.1406
Third Quartile 0.4029
Interquartile range 0.4029 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.2186
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2433 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 8
Upper Outlier Threshold 0.7143
6
Mean With No Outliers 0.2186
4
Std With No Outliers 0.2433
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries RFIAUPV03
51-GC 53.57 64-GC 0.00 0.8
52-GC 0.00 65-GC 45.16
53-GC 14.06 66-GC 33.33
0.6
54-GC 14.29 67-GC 41.18
55-GC 0.00 68-GC 64.89
56-GC 12.50 69-GC 19.05 0.4
57-GC 20.00 70-GC 0.00
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 71.43
Difference
60-GC 70.00 73-GC 0.00 0
61-GC 13.64 74-GC 33.33
62-GC 0.00 75-GC 40.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
317
valencia 10.2415/GC-MONO-EN-CLEF2007.VALENCIA.RFIAUPV04 GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 2
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language English
Relevant 650 Topic Fields title, description, narrative
Relevant retrieved 595 Pooled true
Geometric Mean Average Precision 0.0415 geoboost 0.5, no WN, all fields
Binary Preference (BPREF) 0.2373
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 55.19 RFIAUPV04
10 44.97 90%
20 37.54
80%
30 33.28
40 27.45 70%
50 26.07
60%
60 23.10
Precision
70 20.04 50%
80 15.49 40%
90 8.60
30%
100 4.84
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
25.67 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7450
Minimum 0.0000
First Quartile 0.0197
Second Quartile 0.2010
Third Quartile 0.4408
Interquartile range 0.4211 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.2567
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2517 8
Number of Topics of the Experiment
7
Lower Outlier Threshold 0.0000
6
Upper Outlier Threshold 0.7450 5
Mean With No Outliers 0.2567 4
3
Std With No Outliers 0.2517
2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries RFIAUPV04
51-GC 73.05 64-GC 20.10 0.8
52-GC 0.05 65-GC 38.88
53-GC 20.90 66-GC 23.81
0.6
54-GC 0.29 67-GC 45.11
55-GC 8.41 68-GC 67.10
56-GC 15.45 69-GC 22.81 0.4
57-GC 42.17 70-GC 1.43
58-GC 15.83 71-GC 0.00 0.2
59-GC 0.00 72-GC 54.56
Difference
60-GC 74.50 73-GC 2.15 0
61-GC 7.87 74-GC 59.17
62-GC 4.27 75-GC 43.74
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
318
valencia 10.2415/GC-MONO-EN-CLEF2007.VALENCIA.RFIAUPV04 GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 32.80 RFIAUPV04
10 docs 31.20 90%
15 docs 29.33
80%
20 docs 25.80
30 docs 22.93 70%
100 docs 13.92
60%
200 docs 9.40
Precision
500 docs 4.52 50%
1000 docs 2.38 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
25.90
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7333
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.1905
Third Quartile 0.4554
Interquartile range 0.4554 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.2590
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2408 8
Number of Topics of the Experiment
7
Lower Outlier Threshold 0.0000
6
Upper Outlier Threshold 0.7333 5
Mean With No Outliers 0.2590 4
3
Std With No Outliers 0.2408
2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries RFIAUPV04
51-GC 64.29 64-GC 23.53 0.8
52-GC 0.00 65-GC 45.16
53-GC 18.75 66-GC 33.33
0.6
54-GC 0.00 67-GC 47.06
55-GC 18.75 68-GC 67.94
56-GC 25.00 69-GC 19.05 0.4
57-GC 46.67 70-GC 3.45
58-GC 16.67 71-GC 0.00 0.2
59-GC 0.00 72-GC 57.14
Difference
60-GC 73.33 73-GC 0.00 0
61-GC 9.09 74-GC 33.33
62-GC 0.00 75-GC 45.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
319
valencia 10.2415/GC-MONO-EN-CLEF2007.VALENCIA.RFIAUPV05 GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 5
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language English
Relevant 650 Topic Fields title, description
Relevant retrieved 573 Pooled false
Geometric Mean Average Precision 0.0448 geoboost 0.5, WN 0.25, title+desc
Binary Preference (BPREF) 0.2198
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 52.27 RFIAUPV05
10 47.44 90%
20 38.60
80%
30 32.19
40 24.49 70%
50 22.70
60%
60 19.70
Precision
70 17.50 50%
80 12.40 40%
90 5.74
30%
100 3.01
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
23.82 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7214
Minimum 0.0000
First Quartile 0.0290
Second Quartile 0.1303
Third Quartile 0.4328
Interquartile range 0.4039 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.2382
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2373 8
Number of Topics of the Experiment
7
Lower Outlier Threshold 0.0000
6
Upper Outlier Threshold 0.7214 5
Mean With No Outliers 0.2382 4
3
Std With No Outliers 0.2373
2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries RFIAUPV05
51-GC 52.98 64-GC 2.97 0.8
52-GC 0.14 65-GC 35.60
53-GC 13.03 66-GC 33.72
0.6
54-GC 11.90 67-GC 42.46
55-GC 7.01 68-GC 63.46
56-GC 14.95 69-GC 12.38 0.4
57-GC 17.14 70-GC 2.33
58-GC 2.96 71-GC 0.00 0.2
59-GC 0.00 72-GC 67.68
Difference
60-GC 72.14 73-GC 2.71 0
61-GC 12.19 74-GC 45.74
62-GC 30.98 75-GC 51.06
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
320
valencia 10.2415/GC-MONO-EN-CLEF2007.VALENCIA.RFIAUPV05 GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 29.60 RFIAUPV05
10 docs 27.20 90%
15 docs 25.60
80%
20 docs 23.00
30 docs 20.13 70%
100 docs 13.04
60%
200 docs 8.78
Precision
500 docs 4.24 50%
1000 docs 2.29 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
23.83
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7143
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.1429
Third Quartile 0.4217
Interquartile range 0.4217 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.2383
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2453 8
Number of Topics of the Experiment
7
Lower Outlier Threshold 0.0000
6
Upper Outlier Threshold 0.7143 5
Mean With No Outliers 0.2383 4
3
Std With No Outliers 0.2453
2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries RFIAUPV05
51-GC 56.25 64-GC 0.00 0.8
52-GC 0.00 65-GC 45.16
53-GC 12.50 66-GC 33.33
0.6
54-GC 14.29 67-GC 41.18
55-GC 6.25 68-GC 64.89
56-GC 12.50 69-GC 14.29 0.4
57-GC 26.67 70-GC 0.00
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 71.43
Difference
60-GC 70.00 73-GC 0.00 0
61-GC 13.64 74-GC 33.33
62-GC 25.00 75-GC 55.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
321
valencia 10.2415/GC-MONO-EN-CLEF2007.VALENCIA.RFIAUPV06 GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 6
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language English
Relevant 650 Topic Fields title, description, narrative
Relevant retrieved 600 Pooled false
Geometric Mean Average Precision 0.0442 geoboost 0.5, WN 0.25, all fields
Binary Preference (BPREF) 0.2467
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 52.66 RFIAUPV06
10 47.01 90%
20 38.54
80%
30 35.25
40 28.77 70%
50 27.30
60%
60 23.87
Precision
70 20.28 50%
80 16.27 40%
90 8.91
30%
100 4.83
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
26.36 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7992
Minimum 0.0000
First Quartile 0.0189
Second Quartile 0.1688
Third Quartile 0.4702
Interquartile range 0.4514 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.2636
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2550 8
Number of Topics of the Experiment
7
Lower Outlier Threshold 0.0000
6
Upper Outlier Threshold 0.7992 5
Mean With No Outliers 0.2636 4
3
Std With No Outliers 0.2550
2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries RFIAUPV06
51-GC 79.92 64-GC 15.72 0.8
52-GC 0.07 65-GC 39.16
53-GC 20.90 66-GC 22.95
0.6
54-GC 0.34 67-GC 45.11
55-GC 16.05 68-GC 67.10
56-GC 15.45 69-GC 22.11 0.4
57-GC 44.07 70-GC 1.42
58-GC 16.88 71-GC 0.00 0.2
59-GC 0.00 72-GC 54.56
Difference
60-GC 72.72 73-GC 2.04 0
61-GC 10.12 74-GC 52.78
62-GC 5.62 75-GC 53.83
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
322
valencia 10.2415/GC-MONO-EN-CLEF2007.VALENCIA.RFIAUPV06 GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 34.40 RFIAUPV06
10 docs 32.80 90%
15 docs 29.87
80%
20 docs 26.80
30 docs 23.73 70%
100 docs 14.32
60%
200 docs 9.58
Precision
500 docs 4.57 50%
1000 docs 2.40 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
27.23
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7333
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.2353
Third Quartile 0.4402
Interquartile range 0.4402 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.2723
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2442 8
Number of Topics of the Experiment
7
Lower Outlier Threshold 0.0000
6
Upper Outlier Threshold 0.7333 5
Mean With No Outliers 0.2723 4
3
Std With No Outliers 0.2442
2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries RFIAUPV06
51-GC 70.54 64-GC 23.53 0.8
52-GC 0.00 65-GC 43.01
53-GC 18.75 66-GC 33.33
0.6
54-GC 0.00 67-GC 47.06
55-GC 18.75 68-GC 67.94
56-GC 25.00 69-GC 19.05 0.4
57-GC 40.00 70-GC 3.45
58-GC 33.33 71-GC 0.00 0.2
59-GC 0.00 72-GC 57.14
Difference
60-GC 73.33 73-GC 0.00 0
61-GC 18.18 74-GC 33.33
62-GC 0.00 75-GC 55.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
323
valencia 10.2415/GC-MONO-EN-CLEF2007.VALENCIA.RFIAUPV07 GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 7
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language English
Relevant 650 Topic Fields title, description
Relevant retrieved 559 Pooled false
Geometric Mean Average Precision 0.0332 TD geoBoost .75
Binary Preference (BPREF) 0.2075
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 46.31 RFIAUPV07
10 42.11 90%
20 33.91
80%
30 30.26
40 23.75 70%
50 22.09
60%
60 19.92
Precision
70 17.16 50%
80 12.14 40%
90 6.16
30%
100 4.39
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
22.45 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7402
Minimum 0.0000
First Quartile 0.0233
Second Quartile 0.1129
Third Quartile 0.4270
Interquartile range 0.4037 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.2245
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2562 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.7402 10
Mean With No Outliers 0.2245
Std With No Outliers 0.2562 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries RFIAUPV07
51-GC 47.28 64-GC 1.85 0.8
52-GC 0.02 65-GC 32.42
53-GC 10.86 66-GC 33.72
0.6
54-GC 4.05 67-GC 42.46
55-GC 2.10 68-GC 63.46
56-GC 14.95 69-GC 11.29 0.4
57-GC 16.40 70-GC 2.41
58-GC 3.26 71-GC 0.00 0.2
59-GC 0.00 72-GC 67.68
Difference
60-GC 74.02 73-GC 2.71 0
61-GC 12.19 74-GC 72.22
62-GC 2.43 75-GC 43.41
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
324
valencia 10.2415/GC-MONO-EN-CLEF2007.VALENCIA.RFIAUPV07 GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 29.60 RFIAUPV07
10 docs 26.80 90%
15 docs 22.93
80%
20 docs 22.00
30 docs 19.60 70%
100 docs 12.36
60%
200 docs 8.10
Precision
500 docs 4.04 50%
1000 docs 2.24 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
22.33
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7143
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.1250
Third Quartile 0.4270
Interquartile range 0.4270 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.2233
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2620 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.7143 10
Mean With No Outliers 0.2233
Std With No Outliers 0.2620 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries RFIAUPV07
51-GC 50.89 64-GC 0.00 0.8
52-GC 0.00 65-GC 41.94
53-GC 12.50 66-GC 33.33
0.6
54-GC 0.00 67-GC 41.18
55-GC 0.00 68-GC 64.89
56-GC 12.50 69-GC 14.29 0.4
57-GC 20.00 70-GC 0.00
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 71.43
Difference
60-GC 70.00 73-GC 0.00 0
61-GC 13.64 74-GC 66.67
62-GC 0.00 75-GC 45.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
325
valencia 10.2415/GC-MONO-EN-CLEF2007.VALENCIA.RFIAUPV08 GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 8
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language English
Relevant 650 Topic Fields title, description
Relevant retrieved 559 Pooled false
Geometric Mean Average Precision 0.0332 TD geoBoost .75 WN .25
Binary Preference (BPREF) 0.2075
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 46.31 RFIAUPV08
10 42.11 90%
20 33.91
80%
30 30.26
40 23.75 70%
50 22.09
60%
60 19.92
Precision
70 17.16 50%
80 12.14 40%
90 6.16
30%
100 4.39
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
22.45 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7402
Minimum 0.0000
First Quartile 0.0233
Second Quartile 0.1129
Third Quartile 0.4270
Interquartile range 0.4037 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.2245
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2562 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.7402 10
Mean With No Outliers 0.2245
Std With No Outliers 0.2562 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries RFIAUPV08
51-GC 47.28 64-GC 1.85 0.8
52-GC 0.02 65-GC 32.42
53-GC 10.86 66-GC 33.72
0.6
54-GC 4.05 67-GC 42.46
55-GC 2.10 68-GC 63.46
56-GC 14.95 69-GC 11.29 0.4
57-GC 16.40 70-GC 2.41
58-GC 3.26 71-GC 0.00 0.2
59-GC 0.00 72-GC 67.68
Difference
60-GC 74.02 73-GC 2.71 0
61-GC 12.19 74-GC 72.22
62-GC 2.43 75-GC 43.41
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
326
valencia 10.2415/GC-MONO-EN-CLEF2007.VALENCIA.RFIAUPV08 GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 29.60 RFIAUPV08
10 docs 26.80 90%
15 docs 22.93
80%
20 docs 22.00
30 docs 19.60 70%
100 docs 12.36
60%
200 docs 8.10
Precision
500 docs 4.04 50%
1000 docs 2.24 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
22.33
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7143
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.1250
Third Quartile 0.4270
Interquartile range 0.4270 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.2233
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2620 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.7143 10
Mean With No Outliers 0.2233
Std With No Outliers 0.2620 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries RFIAUPV08
51-GC 50.89 64-GC 0.00 0.8
52-GC 0.00 65-GC 41.94
53-GC 12.50 66-GC 33.33
0.6
54-GC 0.00 67-GC 41.18
55-GC 0.00 68-GC 64.89
56-GC 12.50 69-GC 14.29 0.4
57-GC 20.00 70-GC 0.00
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 71.43
Difference
60-GC 70.00 73-GC 0.00 0
61-GC 13.64 74-GC 66.67
62-GC 0.00 75-GC 45.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
327
valencia 10.2415/GC-MONO-EN-CLEF2007.VALENCIA.RFIAUPV09 GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 9
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language English
Relevant 650 Topic Fields title, description
Relevant retrieved 577 Pooled false
Geometric Mean Average Precision 0.0455 TD geoBoost .25 WN .25
Binary Preference (BPREF) 0.2210
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 52.70 RFIAUPV09
10 47.69 90%
20 39.79
80%
30 32.97
40 24.71 70%
50 22.99
60%
60 19.62
Precision
70 17.48 50%
80 12.50 40%
90 5.39
30%
100 2.68
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
23.87 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7081
Minimum 0.0000
First Quartile 0.0270
Second Quartile 0.1463
Third Quartile 0.3933
Interquartile range 0.3663 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.2387
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2347 8
Number of Topics of the Experiment
7
Lower Outlier Threshold 0.0000
6
Upper Outlier Threshold 0.7081 5
Mean With No Outliers 0.2387 4
3
Std With No Outliers 0.2347
2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries RFIAUPV09
51-GC 55.10 64-GC 2.68 0.8
52-GC 0.17 65-GC 37.14
53-GC 14.63 66-GC 33.72
0.6
54-GC 12.03 67-GC 42.46
55-GC 8.76 68-GC 63.46
56-GC 14.95 69-GC 13.01 0.4
57-GC 17.15 70-GC 2.34
58-GC 2.78 71-GC 0.00 0.2
59-GC 0.00 72-GC 67.68
Difference
60-GC 70.81 73-GC 2.71 0
61-GC 12.19 74-GC 38.29
62-GC 33.91 75-GC 50.77
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
328
valencia 10.2415/GC-MONO-EN-CLEF2007.VALENCIA.RFIAUPV09 GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 28.00 RFIAUPV09
10 docs 26.80 90%
15 docs 25.87
80%
20 docs 22.60
30 docs 20.40 70%
100 docs 13.32
60%
200 docs 8.86
Precision
500 docs 4.34 50%
1000 docs 2.31 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
23.92
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7143
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.1429
Third Quartile 0.4244
Interquartile range 0.4244 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.2392
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2399 8
Number of Topics of the Experiment
7
Lower Outlier Threshold 0.0000
6
Upper Outlier Threshold 0.7143 5
Mean With No Outliers 0.2392 4
3
Std With No Outliers 0.2399
2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries RFIAUPV09
51-GC 54.46 64-GC 0.00 0.8
52-GC 0.00 65-GC 46.24
53-GC 15.62 66-GC 33.33
0.6
54-GC 14.29 67-GC 41.18
55-GC 12.50 68-GC 64.89
56-GC 12.50 69-GC 9.52 0.4
57-GC 26.67 70-GC 3.45
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 71.43
Difference
60-GC 70.00 73-GC 0.00 0
61-GC 13.64 74-GC 33.33
62-GC 25.00 75-GC 50.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
329
valencia 10.2415/GC-MONO-EN-CLEF2007.VALENCIA.RFIAUPV10 GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 10
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language English
Relevant 650 Topic Fields title, description
Relevant retrieved 579 Pooled false
Geometric Mean Average Precision 0.0435 TD geoBoost .25
Binary Preference (BPREF) 0.2179
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 54.20 RFIAUPV10
10 47.89 90%
20 39.20
80%
30 31.36
40 23.65 70%
50 22.47
60%
60 19.50
Precision
70 16.36 50%
80 11.21 40%
90 5.53
30%
100 3.07
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
23.57 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7214
Minimum 0.0000
First Quartile 0.0261
Second Quartile 0.1464
Third Quartile 0.4316
Interquartile range 0.4055 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.2357
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2357 8
Number of Topics of the Experiment
7
Lower Outlier Threshold 0.0000
6
Upper Outlier Threshold 0.7214 5
Mean With No Outliers 0.2357 4
3
Std With No Outliers 0.2357
2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries RFIAUPV10
51-GC 52.58 64-GC 1.62 0.8
52-GC 0.14 65-GC 37.34
53-GC 14.64 66-GC 33.72
0.6
54-GC 11.90 67-GC 42.46
55-GC 6.10 68-GC 63.46
56-GC 14.95 69-GC 11.07 0.4
57-GC 17.14 70-GC 2.33
58-GC 3.08 71-GC 0.00 0.2
59-GC 0.00 72-GC 67.68
Difference
60-GC 72.14 73-GC 2.71 0
61-GC 12.19 74-GC 45.74
62-GC 30.98 75-GC 45.24
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
330
valencia 10.2415/GC-MONO-EN-CLEF2007.VALENCIA.RFIAUPV10 GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 28.80 RFIAUPV10
10 docs 27.20 90%
15 docs 25.07
80%
20 docs 23.20
30 docs 20.00 70%
100 docs 12.76
60%
200 docs 8.64
Precision
500 docs 4.26 50%
1000 docs 2.32 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
23.91
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7143
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.1562
Third Quartile 0.4244
Interquartile range 0.4244 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.2391
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2412 8
Number of Topics of the Experiment
7
Lower Outlier Threshold 0.0000
6
Upper Outlier Threshold 0.7143 5
Mean With No Outliers 0.2391 4
3
Std With No Outliers 0.2412
2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries RFIAUPV10
51-GC 54.46 64-GC 0.00 0.8
52-GC 0.00 65-GC 46.24
53-GC 15.62 66-GC 33.33
0.6
54-GC 14.29 67-GC 41.18
55-GC 6.25 68-GC 64.89
56-GC 12.50 69-GC 19.05 0.4
57-GC 26.67 70-GC 0.00
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 71.43
Difference
60-GC 70.00 73-GC 0.00 0
61-GC 13.64 74-GC 33.33
62-GC 25.00 75-GC 50.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
331
valencia 10.2415/GC-MONO-EN-CLEF2007.VALENCIA.RFIAUPV11 GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 11
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language English
Relevant 650 Topic Fields title, description
Relevant retrieved 576 Pooled false
Geometric Mean Average Precision 0.0454 TD geoBoost .5 WN .5
Binary Preference (BPREF) 0.2216
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 52.75 RFIAUPV11
10 47.48 90%
20 38.46
80%
30 32.81
40 25.03 70%
50 22.79
60%
60 19.89
Precision
70 17.85 50%
80 12.81 40%
90 5.65
30%
100 3.01
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
23.93 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7214
Minimum 0.0000
First Quartile 0.0279
Second Quartile 0.1290
Third Quartile 0.4328
Interquartile range 0.4049 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.2393
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2376 8
Number of Topics of the Experiment
7
Lower Outlier Threshold 0.0000
6
Upper Outlier Threshold 0.7214 5
Mean With No Outliers 0.2393 4
3
Std With No Outliers 0.2376
2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries RFIAUPV11
51-GC 52.13 64-GC 4.05 0.8
52-GC 0.14 65-GC 35.43
53-GC 12.79 66-GC 33.72
0.6
54-GC 11.90 67-GC 42.46
55-GC 6.81 68-GC 63.46
56-GC 14.95 69-GC 12.90 0.4
57-GC 17.14 70-GC 2.33
58-GC 2.82 71-GC 0.00 0.2
59-GC 0.00 72-GC 67.68
Difference
60-GC 72.14 73-GC 2.71 0
61-GC 12.19 74-GC 45.74
62-GC 31.67 75-GC 53.09
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
332
valencia 10.2415/GC-MONO-EN-CLEF2007.VALENCIA.RFIAUPV11 GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 30.40 RFIAUPV11
10 docs 27.60 90%
15 docs 25.87
80%
20 docs 23.00
30 docs 20.13 70%
100 docs 12.92
60%
200 docs 8.72
Precision
500 docs 4.24 50%
1000 docs 2.30 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
24.06
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7143
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.1429
Third Quartile 0.4217
Interquartile range 0.4217 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.2406
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2387 8
Number of Topics of the Experiment
7
Lower Outlier Threshold 0.0000
6
Upper Outlier Threshold 0.7143 5
Mean With No Outliers 0.2406 4
3
Std With No Outliers 0.2387
2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries RFIAUPV11
51-GC 55.36 64-GC 11.76 0.8
52-GC 0.00 65-GC 45.16
53-GC 12.50 66-GC 33.33
0.6
54-GC 14.29 67-GC 41.18
55-GC 6.25 68-GC 64.89
56-GC 12.50 69-GC 14.29 0.4
57-GC 26.67 70-GC 0.00
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 71.43
Difference
60-GC 70.00 73-GC 0.00 0
61-GC 13.64 74-GC 33.33
62-GC 25.00 75-GC 50.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
333
valencia 10.2415/GC-MONO-EN-CLEF2007.VALENCIA.RFIAUPV12 GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 12
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language English
Relevant 650 Topic Fields title, description
Relevant retrieved 570 Pooled false
Geometric Mean Average Precision 0.0420 TD geoBoost .75 WN .75
Binary Preference (BPREF) 0.2163
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 49.43 RFIAUPV12
10 42.73 90%
20 34.49
80%
30 31.94
40 24.98 70%
50 22.72
60%
60 20.59
Precision
70 17.48 50%
80 13.14 40%
90 5.79
30%
100 3.49
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
23.11 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7310
Minimum 0.0000
First Quartile 0.0267
Second Quartile 0.1219
Third Quartile 0.4392
Interquartile range 0.4125 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.2311
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2444 8
Number of Topics of the Experiment
7
Lower Outlier Threshold 0.0000
6
Upper Outlier Threshold 0.7310 5
Mean With No Outliers 0.2311 4
3
Std With No Outliers 0.2444
2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries RFIAUPV12
51-GC 48.28 64-GC 5.44 0.8
52-GC 0.11 65-GC 33.62
53-GC 10.89 66-GC 33.72
0.6
54-GC 11.04 67-GC 42.46
55-GC 4.77 68-GC 63.46
56-GC 14.95 69-GC 12.88 0.4
57-GC 16.98 70-GC 2.31
58-GC 2.55 71-GC 0.00 0.2
59-GC 0.00 72-GC 67.68
Difference
60-GC 73.10 73-GC 2.71 0
61-GC 12.19 74-GC 59.09
62-GC 8.09 75-GC 51.35
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
334
valencia 10.2415/GC-MONO-EN-CLEF2007.VALENCIA.RFIAUPV12 GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 30.40 RFIAUPV12
10 docs 26.80 90%
15 docs 25.33
80%
20 docs 23.40
30 docs 20.00 70%
100 docs 12.56
60%
200 docs 8.46
Precision
500 docs 4.18 50%
1000 docs 2.28 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
23.51
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7143
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.1429
Third Quartile 0.4190
Interquartile range 0.4190 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.2351
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2458 8
Number of Topics of the Experiment
7
Lower Outlier Threshold 0.0000
6
Upper Outlier Threshold 0.7143 5
Mean With No Outliers 0.2351 4
3
Std With No Outliers 0.2458
2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries RFIAUPV12
51-GC 51.79 64-GC 17.65 0.8
52-GC 0.00 65-GC 44.09
53-GC 12.50 66-GC 33.33
0.6
54-GC 14.29 67-GC 41.18
55-GC 6.25 68-GC 64.89
56-GC 12.50 69-GC 14.29 0.4
57-GC 26.67 70-GC 0.00
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 71.43
Difference
60-GC 70.00 73-GC 0.00 0
61-GC 13.64 74-GC 33.33
62-GC 0.00 75-GC 60.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
335
xldb 10.2415/GC-MONO-EN-CLEF2007.XLDB.XLDBEN_1 GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 1
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 19,638 Source Language English
Relevant 650 Topic Fields title, description
Relevant retrieved 345 Pooled true
Geometric Mean Average Precision 0.0016 Terms only
Binary Preference (BPREF) 0.0274
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 6.95 XLDBEN_1
10 4.40 90%
20 2.43
80%
30 2.11
40 2.07 70%
50 1.92
60%
60 1.62
Precision
70 1.40 50%
80 1.19 40%
90 0.32
30%
100 0.07
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
1.67 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.0940
Minimum 0.0000
First Quartile 0.0001
Second Quartile 0.0049
Third Quartile 0.0145
Interquartile range 0.0145 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.0167
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.0273 25
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 20
Upper Outlier Threshold 0.0158
15
Mean With No Outliers 0.0043
10
Std With No Outliers 0.0050
5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries XLDBEN_1
51-GC 0.53 64-GC 0.25 0.8
52-GC 0.12 65-GC 7.25
53-GC 9.40 66-GC 0.12
0.6
54-GC 0.00 67-GC 0.00
55-GC 0.01 68-GC 3.94
56-GC 0.95 69-GC 1.41 0.4
57-GC 0.34 70-GC 0.49
58-GC 0.77 71-GC 0.00 0.2
59-GC 0.00 72-GC 1.06
Difference
60-GC 7.79 73-GC 0.00 0
61-GC 4.80 74-GC 0.20
62-GC 1.58 75-GC 0.69
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
336
xldb 10.2415/GC-MONO-EN-CLEF2007.XLDB.XLDBEN_1 GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 1.60 XLDBEN_1
10 docs 3.20 90%
15 docs 3.73
80%
20 docs 3.60
30 docs 2.40 70%
100 docs 2.16
60%
200 docs 1.84
Precision
500 docs 1.37 50%
1000 docs 1.38 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
2.02
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.1364
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0000
Third Quartile 0.0220
Interquartile range 0.0220 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.0202
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.0399 25
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 20
Upper Outlier Threshold 0.0476
15
Mean With No Outliers 0.0048
10
Std With No Outliers 0.0128
5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries XLDBEN_1
51-GC 1.79 64-GC 0.00 0.8
52-GC 0.00 65-GC 7.53
53-GC 12.50 66-GC 0.00
0.6
54-GC 0.00 67-GC 0.00
55-GC 0.00 68-GC 6.87
56-GC 0.00 69-GC 4.76 0.4
57-GC 0.00 70-GC 3.45
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 0.00
Difference
60-GC 0.00 73-GC 0.00 0
61-GC 13.64 74-GC 0.00
62-GC 0.00 75-GC 0.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
337
xldb 10.2415/GC-MONO-EN-CLEF2007.XLDB.XLDBEN_2 GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 2
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language English
Relevant 650 Topic Fields title
Relevant retrieved 291 Pooled true
Geometric Mean Average Precision 0.0010 Early GeoExpansion, GKBID, AVG
Binary Preference (BPREF) 0.0440
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 10.77 XLDBEN_2
10 9.39 90%
20 6.95
80%
30 5.61
40 4.04 70%
50 3.54
60%
60 2.65
Precision
70 2.17 50%
80 1.57 40%
90 0.65
30%
100 0.00
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
3.81 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.4023
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0015
Third Quartile 0.0305
Interquartile range 0.0305 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.0381
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.0890 20
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
15
Upper Outlier Threshold 0.0560
Mean With No Outliers 0.0098 10
Std With No Outliers 0.0175
5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries XLDBEN_2
51-GC 0.00 64-GC 0.00 0.8
52-GC 0.03 65-GC 5.60
53-GC 2.70 66-GC 0.04
0.6
54-GC 5.08 67-GC 0.00
55-GC 15.36 68-GC 40.23
56-GC 0.22 69-GC 0.00 0.4
57-GC 18.02 70-GC 0.11
58-GC 0.45 71-GC 0.00 0.2
59-GC 0.00 72-GC 1.06
Difference
60-GC 0.15 73-GC 0.00 0
61-GC 1.76 74-GC 0.08
62-GC 4.09 75-GC 0.17
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
338
xldb 10.2415/GC-MONO-EN-CLEF2007.XLDB.XLDBEN_2 GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 4.80 XLDBEN_2
10 docs 5.60 90%
15 docs 6.13
80%
20 docs 6.20
30 docs 5.33 70%
100 docs 3.84
60%
200 docs 2.82
Precision
500 docs 1.74 50%
1000 docs 1.16 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
4.95
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.4351
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0000
Third Quartile 0.0000
Interquartile range 0.0000 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.0495
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1144 20
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
15
Upper Outlier Threshold 0.0000
Mean With No Outliers 0.0000 10
Std With No Outliers 0.0000
5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries XLDBEN_2
51-GC 0.00 64-GC 0.00 0.8
52-GC 0.00 65-GC 13.98
53-GC 0.00 66-GC 0.00
0.6
54-GC 14.29 67-GC 0.00
55-GC 18.75 68-GC 43.51
56-GC 0.00 69-GC 0.00 0.4
57-GC 33.33 70-GC 0.00
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 0.00
Difference
60-GC 0.00 73-GC 0.00 0
61-GC 0.00 74-GC 0.00
62-GC 0.00 75-GC 0.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
339
xldb 10.2415/GC-MONO-EN-CLEF2007.XLDB.XLDBEN_3 GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 3
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language English
Relevant 650 Topic Fields title
Relevant retrieved 291 Pooled false
Geometric Mean Average Precision 0.0010 Early GeoExpansion, GKBID, MAX
Binary Preference (BPREF) 0.0440
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 10.77 XLDBEN_3
10 9.39 90%
20 6.95
80%
30 5.61
40 4.04 70%
50 3.54
60%
60 2.65
Precision
70 2.17 50%
80 1.57 40%
90 0.65
30%
100 0.00
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
3.81 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.4023
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0015
Third Quartile 0.0305
Interquartile range 0.0305 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.0381
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.0890 20
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
15
Upper Outlier Threshold 0.0560
Mean With No Outliers 0.0098 10
Std With No Outliers 0.0175
5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries XLDBEN_3
51-GC 0.00 64-GC 0.00 0.8
52-GC 0.03 65-GC 5.60
53-GC 2.70 66-GC 0.04
0.6
54-GC 5.08 67-GC 0.00
55-GC 15.36 68-GC 40.23
56-GC 0.22 69-GC 0.00 0.4
57-GC 18.02 70-GC 0.11
58-GC 0.45 71-GC 0.00 0.2
59-GC 0.00 72-GC 1.06
Difference
60-GC 0.15 73-GC 0.00 0
61-GC 1.76 74-GC 0.08
62-GC 4.09 75-GC 0.17
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
340
xldb 10.2415/GC-MONO-EN-CLEF2007.XLDB.XLDBEN_3 GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 4.80 XLDBEN_3
10 docs 5.60 90%
15 docs 6.13
80%
20 docs 6.20
30 docs 5.33 70%
100 docs 3.84
60%
200 docs 2.82
Precision
500 docs 1.74 50%
1000 docs 1.16 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
4.95
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.4351
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0000
Third Quartile 0.0000
Interquartile range 0.0000 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.0495
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1144 20
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
15
Upper Outlier Threshold 0.0000
Mean With No Outliers 0.0000 10
Std With No Outliers 0.0000
5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries XLDBEN_3
51-GC 0.00 64-GC 0.00 0.8
52-GC 0.00 65-GC 13.98
53-GC 0.00 66-GC 0.00
0.6
54-GC 14.29 67-GC 0.00
55-GC 18.75 68-GC 43.51
56-GC 0.00 69-GC 0.00 0.4
57-GC 33.33 70-GC 0.00
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 0.00
Difference
60-GC 0.00 73-GC 0.00 0
61-GC 0.00 74-GC 0.00
62-GC 0.00 75-GC 0.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
341
xldb 10.2415/GC-MONO-EN-CLEF2007.XLDB.XLDBEN_4 GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 4
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language English
Relevant 650 Topic Fields title
Relevant retrieved 220 Pooled false
Geometric Mean Average Precision 0.0009 Later GeoExpansion, GKBID, AVG
Binary Preference (BPREF) 0.0345
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 10.75 XLDBEN_4
10 7.27 90%
20 4.75
80%
30 3.40
40 2.26 70%
50 2.11
60%
60 1.46
Precision
70 1.19 50%
80 0.80 40%
90 0.00
30%
100 0.00
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
2.54 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.1802
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0011
Third Quartile 0.0305
Interquartile range 0.0305 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.0254
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.0484 20
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
15
Upper Outlier Threshold 0.0560
Mean With No Outliers 0.0097 10
Std With No Outliers 0.0176
5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries XLDBEN_4
51-GC 0.00 64-GC 0.00 0.8
52-GC 0.03 65-GC 5.60
53-GC 2.70 66-GC 0.04
0.6
54-GC 5.08 67-GC 0.00
55-GC 15.36 68-GC 8.80
56-GC 0.03 69-GC 0.00 0.4
57-GC 18.02 70-GC 0.11
58-GC 0.45 71-GC 0.00 0.2
59-GC 0.00 72-GC 1.06
Difference
60-GC 0.15 73-GC 0.00 0
61-GC 1.76 74-GC 0.08
62-GC 4.09 75-GC 0.17
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
342
xldb 10.2415/GC-MONO-EN-CLEF2007.XLDB.XLDBEN_4 GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 4.80 XLDBEN_4
10 docs 4.80 90%
15 docs 4.80
80%
20 docs 4.80
30 docs 4.00 70%
100 docs 2.68
60%
200 docs 1.94
Precision
500 docs 1.21 50%
1000 docs 0.88 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
3.89
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.3333
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0000
Third Quartile 0.0000
Interquartile range 0.0000 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.0389
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.0858 20
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
15
Upper Outlier Threshold 0.0000
Mean With No Outliers 0.0000 10
Std With No Outliers 0.0000
5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries XLDBEN_4
51-GC 0.00 64-GC 0.00 0.8
52-GC 0.00 65-GC 13.98
53-GC 0.00 66-GC 0.00
0.6
54-GC 14.29 67-GC 0.00
55-GC 18.75 68-GC 16.79
56-GC 0.00 69-GC 0.00 0.4
57-GC 33.33 70-GC 0.00
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 0.00
Difference
60-GC 0.00 73-GC 0.00 0
61-GC 0.00 74-GC 0.00
62-GC 0.00 75-GC 0.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
343
xldb 10.2415/GC-MONO-EN-CLEF2007.XLDB.XLDBEN_5 GC-MONO-EN-CLEF2007
Overall statistics for 25 queries : Priority 5
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language English
Relevant 650 Topic Fields title
Relevant retrieved 220 Pooled false
Geometric Mean Average Precision 0.0009 Later GeoExpansion, GKBID, MAX
Binary Preference (BPREF) 0.0345
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 10.75 XLDBEN_5
10 7.27 90%
20 4.75
80%
30 3.40
40 2.26 70%
50 2.11
60%
60 1.46
Precision
70 1.19 50%
80 0.80 40%
90 0.00
30%
100 0.00
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
2.54 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.1802
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0011
Third Quartile 0.0305
Interquartile range 0.0305 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.0254
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.0484 20
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
15
Upper Outlier Threshold 0.0560
Mean With No Outliers 0.0097 10
Std With No Outliers 0.0176
5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries XLDBEN_5
51-GC 0.00 64-GC 0.00 0.8
52-GC 0.03 65-GC 5.60
53-GC 2.70 66-GC 0.04
0.6
54-GC 5.08 67-GC 0.00
55-GC 15.36 68-GC 8.80
56-GC 0.03 69-GC 0.00 0.4
57-GC 18.02 70-GC 0.11
58-GC 0.45 71-GC 0.00 0.2
59-GC 0.00 72-GC 1.06
Difference
60-GC 0.15 73-GC 0.00 0
61-GC 1.76 74-GC 0.08
62-GC 4.09 75-GC 0.17
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
344
xldb 10.2415/GC-MONO-EN-CLEF2007.XLDB.XLDBEN_5 GC-MONO-EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 4.80 XLDBEN_5
10 docs 4.80 90%
15 docs 4.80
80%
20 docs 4.80
30 docs 4.00 70%
100 docs 2.68
60%
200 docs 1.94
Precision
500 docs 1.21 50%
1000 docs 0.88 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
3.89
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.3333
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0000
Third Quartile 0.0000
Interquartile range 0.0000 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.0389
GeoCLEF Monolingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.0858 20
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
15
Upper Outlier Threshold 0.0000
Mean With No Outliers 0.0000 10
Std With No Outliers 0.0000
5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries XLDBEN_5
51-GC 0.00 64-GC 0.00 0.8
52-GC 0.00 65-GC 13.98
53-GC 0.00 66-GC 0.00
0.6
54-GC 14.29 67-GC 0.00
55-GC 18.75 68-GC 16.79
56-GC 0.00 69-GC 0.00 0.4
57-GC 33.33 70-GC 0.00
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 0.00
Difference
60-GC 0.00 73-GC 0.00 0
61-GC 0.00 74-GC 0.00
62-GC 0.00 75-GC 0.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
345
cheshire 10.2415/GC-MONO-PT-CLEF2007.CHESHIRE.BERKMOPTBASE GC-MONO-PT-CLEF2007
Overall statistics for 25 queries : Priority 1
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language Portuguese
Relevant 762 Topic Fields title, description
Relevant retrieved 457 Pooled true
Geometric Mean Average Precision 0.0245 Baseline Portuguese monolingual searching using
Binary Preference (BPREF) 0.1594 TREC2 ranking with Blind Feedback
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual Portuguese Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 38.35 BERKMOPTBASE
10 31.32 90%
20 27.70
80%
30 26.37
40 20.01 70%
50 18.12
60%
60 16.18
Precision
70 11.78 50%
80 9.17 40%
90 7.27
30%
100 2.70
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
17.39 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual Portuguese Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7053
Minimum 0.0000
First Quartile 0.0053
Second Quartile 0.1014
Third Quartile 0.2849
Interquartile range 0.2796 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.1739
GeoCLEF Monolingual Portuguese Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2111 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.5722 10
Mean With No Outliers 0.1517
Std With No Outliers 0.1836 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual Portuguese Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries BERKMOPTBASE
51-GC 0.03 64-GC 1.67 0.8
52-GC 21.14 65-GC 0.01
53-GC 0.04 66-GC 0.00
0.6
54-GC 2.20 67-GC 47.28
55-GC 3.43 68-GC 3.16
56-GC 57.22 69-GC 55.80 0.4
57-GC 11.67 70-GC 0.02
58-GC 10.14 71-GC 27.33 0.2
59-GC 0.93 72-GC 0.51
Difference
60-GC 70.53 73-GC 30.88 0
61-GC 27.83 74-GC 19.67
62-GC 12.15 75-GC 30.47
−0.2
63-GC 0.54
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
346
cheshire 10.2415/GC-MONO-PT-CLEF2007.CHESHIRE.BERKMOPTBASE GC-MONO-PT-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual Portuguese Task − Retrieved documents vs Mean Precision
100%
5 docs 27.20 BERKMOPTBASE
10 docs 23.20 90%
15 docs 20.53
80%
20 docs 18.40
30 docs 15.73 70%
100 docs 9.20
60%
200 docs 6.00
Precision
500 docs 3.18 50%
1000 docs 1.83 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
18.05
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual Portuguese Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.6250
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0375
Third Quartile 0.3852
Interquartile range 0.3852 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.1805
GeoCLEF Monolingual Portuguese Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2226 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.6250 10
Mean With No Outliers 0.1805
Std With No Outliers 0.2226 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual Portuguese Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries BERKMOPTBASE
51-GC 0.00 64-GC 0.00 0.8
52-GC 35.29 65-GC 0.00
53-GC 0.00 66-GC 0.00
0.6
54-GC 0.00 67-GC 44.00
55-GC 0.00 68-GC 3.75
56-GC 60.00 69-GC 50.00 0.4
57-GC 0.00 70-GC 0.00
58-GC 4.76 71-GC 38.71 0.2
59-GC 0.00 72-GC 0.00
Difference
60-GC 62.50 73-GC 41.67 0
61-GC 38.46 74-GC 24.19
62-GC 10.53 75-GC 37.50
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
347
csusm 10.2415/GC-MONO-PT-CLEF2007.CSUSM.GEOBIESPT1 GC-MONO-PT-CLEF2007
Overall statistics for 25 queries : Priority 1
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language Spanish; Castilian
Relevant 762 Topic Fields title, description
Relevant retrieved 191 Pooled true
Geometric Mean Average Precision 0.0011 Spanish topics, English docs, title & description
Binary Preference (BPREF) 0.0408
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual Portuguese Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 10.74 GEOBIESPT1
10 10.02 90%
20 7.09
80%
30 6.64
40 6.49 70%
50 6.15
60%
60 4.64
Precision
70 3.85 50%
80 3.66 40%
90 3.04
30%
100 2.54
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
5.33 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual Portuguese Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.4837
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0020
Third Quartile 0.0220
Interquartile range 0.0220 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.0533
GeoCLEF Monolingual Portuguese Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1274 20
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
15
Upper Outlier Threshold 0.0523
Mean With No Outliers 0.0063 10
Std With No Outliers 0.0126
5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual Portuguese Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries GEOBIESPT1
51-GC 0.58 64-GC 0.00 0.8
52-GC 0.00 65-GC 0.03
53-GC 0.00 66-GC 6.10
0.6
54-GC 5.23 67-GC 27.99
55-GC 0.02 68-GC 0.00
56-GC 0.14 69-GC 0.00 0.4
57-GC 37.50 70-GC 2.12
58-GC 0.74 71-GC 2.43 0.2
59-GC 0.00 72-GC 0.20
Difference
60-GC 48.37 73-GC 0.18 0
61-GC 0.00 74-GC 0.22
62-GC 0.96 75-GC 0.00
−0.2
63-GC 0.35
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
348
csusm 10.2415/GC-MONO-PT-CLEF2007.CSUSM.GEOBIESPT1 GC-MONO-PT-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual Portuguese Task − Retrieved documents vs Mean Precision
100%
5 docs 3.20 GEOBIESPT1
10 docs 4.40 90%
15 docs 4.53
80%
20 docs 4.40
30 docs 4.00 70%
100 docs 3.04
60%
200 docs 2.18
Precision
500 docs 1.20 50%
1000 docs 0.76 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
6.56
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual Portuguese Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.5000
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0000
Third Quartile 0.0240
Interquartile range 0.0240 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.0656
GeoCLEF Monolingual Portuguese Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1521 20
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
15
Upper Outlier Threshold 0.0476
Mean With No Outliers 0.0032 10
Std With No Outliers 0.0111
5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual Portuguese Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries GEOBIESPT1
51-GC 0.00 64-GC 0.00 0.8
52-GC 0.00 65-GC 0.00
53-GC 0.00 66-GC 0.00
0.6
54-GC 0.00 67-GC 37.33
55-GC 0.00 68-GC 0.00
56-GC 0.00 69-GC 0.00 0.4
57-GC 50.00 70-GC 10.00
58-GC 4.76 71-GC 10.32 0.2
59-GC 0.00 72-GC 0.00
Difference
60-GC 50.00 73-GC 0.00 0
61-GC 0.00 74-GC 1.61
62-GC 0.00 75-GC 0.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
349
csusm 10.2415/GC-MONO-PT-CLEF2007.CSUSM.GEOMOPT1 GC-MONO-PT-CLEF2007
Overall statistics for 25 queries : Priority 1
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language Portuguese
Relevant 762 Topic Fields title, description
Relevant retrieved 509 Pooled true
Geometric Mean Average Precision 0.0582 Automatic processing of topic's title & description
Binary Preference (BPREF) 0.1783
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual Portuguese Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 52.94 GEOMOPT1
10 40.37 90%
20 31.26
80%
30 24.90
40 18.65 70%
50 14.56
60%
60 11.53
Precision
70 9.32 50%
80 6.96 40%
90 4.30
30%
100 2.11
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
17.83 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual Portuguese Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.6672
Minimum 0.0003
First Quartile 0.0095
Second Quartile 0.1330
Third Quartile 0.2829
Interquartile range 0.2734 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.1783
GeoCLEF Monolingual Portuguese Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1881 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0003 8
Upper Outlier Threshold 0.6672
6
Mean With No Outliers 0.1783
4
Std With No Outliers 0.1881
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual Portuguese Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries GEOMOPT1
51-GC 19.35 64-GC 0.74 0.8
52-GC 1.05 65-GC 36.58
53-GC 0.49 66-GC 66.72
0.6
54-GC 0.29 67-GC 29.35
55-GC 2.61 68-GC 27.94
56-GC 36.84 69-GC 45.99 0.4
57-GC 1.02 70-GC 0.65
58-GC 13.30 71-GC 27.68 0.2
59-GC 0.62 72-GC 10.61
Difference
60-GC 54.70 73-GC 0.03 0
61-GC 16.13 74-GC 18.76
62-GC 5.14 75-GC 10.22
−0.2
63-GC 18.89
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
350
csusm 10.2415/GC-MONO-PT-CLEF2007.CSUSM.GEOMOPT1 GC-MONO-PT-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual Portuguese Task − Retrieved documents vs Mean Precision
100%
5 docs 34.40 GEOMOPT1
10 docs 26.00 90%
15 docs 23.73
80%
20 docs 22.20
30 docs 19.47 70%
100 docs 11.04
60%
200 docs 6.90
Precision
500 docs 3.58 50%
1000 docs 2.04 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
18.45
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual Portuguese Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.5385
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.1667
Third Quartile 0.3094
Interquartile range 0.3094 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.1845
GeoCLEF Monolingual Portuguese Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1743 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 8
Upper Outlier Threshold 0.5385
6
Mean With No Outliers 0.1845
4
Std With No Outliers 0.1743
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual Portuguese Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries GEOMOPT1
51-GC 25.00 64-GC 0.00 0.8
52-GC 2.94 65-GC 42.06
53-GC 0.00 66-GC 53.85
0.6
54-GC 0.00 67-GC 36.00
55-GC 0.00 68-GC 33.75
56-GC 30.00 69-GC 30.00 0.4
57-GC 0.00 70-GC 0.00
58-GC 19.05 71-GC 36.77 0.2
59-GC 0.00 72-GC 13.64
Difference
60-GC 50.00 73-GC 0.00 0
61-GC 15.38 74-GC 29.03
62-GC 5.26 75-GC 21.88
−0.2
63-GC 16.67
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
351
csusm 10.2415/GC-MONO-PT-CLEF2007.CSUSM.GEOMOPT2 GC-MONO-PT-CLEF2007
Overall statistics for 25 queries : Priority 2
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language Portuguese
Relevant 762 Topic Fields title, description, narrative
Relevant retrieved 514 Pooled true
Geometric Mean Average Precision 0.0565 Automatic processing of topic's titlle, description
Binary Preference (BPREF) 0.1722 & narrative with relevance feedback
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual Portuguese Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 48.65 GEOMOPT2
10 37.05 90%
20 32.40
80%
30 24.48
40 19.12 70%
50 15.11
60%
60 13.55
Precision
70 9.78 50%
80 7.41 40%
90 3.86
30%
100 1.55
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
17.81 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual Portuguese Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.6672
Minimum 0.0003
First Quartile 0.0104
Second Quartile 0.1061
Third Quartile 0.2972
Interquartile range 0.2868 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.1781
GeoCLEF Monolingual Portuguese Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1975 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0003 8
Upper Outlier Threshold 0.6672
6
Mean With No Outliers 0.1781
4
Std With No Outliers 0.1975
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual Portuguese Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries GEOMOPT2
51-GC 19.35 64-GC 1.42 0.8
52-GC 1.05 65-GC 59.41
53-GC 0.49 66-GC 66.72
0.6
54-GC 0.29 67-GC 29.35
55-GC 2.61 68-GC 30.85
56-GC 36.84 69-GC 45.99 0.4
57-GC 1.02 70-GC 0.65
58-GC 14.78 71-GC 27.68 0.2
59-GC 0.62 72-GC 10.61
Difference
60-GC 42.29 73-GC 0.03 0
61-GC 16.13 74-GC 18.76
62-GC 5.14 75-GC 10.22
−0.2
63-GC 3.04
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
352
csusm 10.2415/GC-MONO-PT-CLEF2007.CSUSM.GEOMOPT2 GC-MONO-PT-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual Portuguese Task − Retrieved documents vs Mean Precision
100%
5 docs 33.60 GEOMOPT2
10 docs 26.40 90%
15 docs 24.80
80%
20 docs 23.20
30 docs 20.13 70%
100 docs 12.36
60%
200 docs 7.40
Precision
500 docs 3.70 50%
1000 docs 2.06 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
18.46
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual Portuguese Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.6429
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.1538
Third Quartile 0.3150
Interquartile range 0.3150 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.1846
GeoCLEF Monolingual Portuguese Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1898 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 8
Upper Outlier Threshold 0.6429
6
Mean With No Outliers 0.1846
4
Std With No Outliers 0.1898
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual Portuguese Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries GEOMOPT2
51-GC 25.00 64-GC 0.00 0.8
52-GC 2.94 65-GC 64.29
53-GC 0.00 66-GC 53.85
0.6
54-GC 0.00 67-GC 36.00
55-GC 0.00 68-GC 36.25
56-GC 30.00 69-GC 30.00 0.4
57-GC 0.00 70-GC 0.00
58-GC 23.81 71-GC 36.77 0.2
59-GC 0.00 72-GC 13.64
Difference
60-GC 37.50 73-GC 0.00 0
61-GC 15.38 74-GC 29.03
62-GC 5.26 75-GC 21.88
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
353
csusm 10.2415/GC-MONO-PT-CLEF2007.CSUSM.GEOMOPT3 GC-MONO-PT-CLEF2007
Overall statistics for 25 queries : Priority 3
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language Portuguese
Relevant 762 Topic Fields title, description
Relevant retrieved 509 Pooled true
Geometric Mean Average Precision 0.0582 Automatic processing of topic's title & description
Binary Preference (BPREF) 0.1783 with relevance feedback
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual Portuguese Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 52.94 GEOMOPT3
10 40.37 90%
20 31.26
80%
30 24.90
40 18.65 70%
50 14.56
60%
60 11.53
Precision
70 9.32 50%
80 6.96 40%
90 4.30
30%
100 2.11
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
17.83 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual Portuguese Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.6672
Minimum 0.0003
First Quartile 0.0095
Second Quartile 0.1330
Third Quartile 0.2829
Interquartile range 0.2734 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.1783
GeoCLEF Monolingual Portuguese Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1881 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0003 8
Upper Outlier Threshold 0.6672
6
Mean With No Outliers 0.1783
4
Std With No Outliers 0.1881
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual Portuguese Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries GEOMOPT3
51-GC 19.35 64-GC 0.74 0.8
52-GC 1.05 65-GC 36.58
53-GC 0.49 66-GC 66.72
0.6
54-GC 0.29 67-GC 29.35
55-GC 2.61 68-GC 27.94
56-GC 36.84 69-GC 45.99 0.4
57-GC 1.02 70-GC 0.65
58-GC 13.30 71-GC 27.68 0.2
59-GC 0.62 72-GC 10.61
Difference
60-GC 54.70 73-GC 0.03 0
61-GC 16.13 74-GC 18.76
62-GC 5.14 75-GC 10.22
−0.2
63-GC 18.89
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
354
csusm 10.2415/GC-MONO-PT-CLEF2007.CSUSM.GEOMOPT3 GC-MONO-PT-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual Portuguese Task − Retrieved documents vs Mean Precision
100%
5 docs 34.40 GEOMOPT3
10 docs 26.00 90%
15 docs 23.73
80%
20 docs 22.20
30 docs 19.47 70%
100 docs 11.04
60%
200 docs 6.90
Precision
500 docs 3.58 50%
1000 docs 2.04 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
18.45
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual Portuguese Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.5385
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.1667
Third Quartile 0.3094
Interquartile range 0.3094 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.1845
GeoCLEF Monolingual Portuguese Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1743 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 8
Upper Outlier Threshold 0.5385
6
Mean With No Outliers 0.1845
4
Std With No Outliers 0.1743
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual Portuguese Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries GEOMOPT3
51-GC 25.00 64-GC 0.00 0.8
52-GC 2.94 65-GC 42.06
53-GC 0.00 66-GC 53.85
0.6
54-GC 0.00 67-GC 36.00
55-GC 0.00 68-GC 33.75
56-GC 30.00 69-GC 30.00 0.4
57-GC 0.00 70-GC 0.00
58-GC 19.05 71-GC 36.77 0.2
59-GC 0.00 72-GC 13.64
Difference
60-GC 50.00 73-GC 0.00 0
61-GC 15.38 74-GC 29.03
62-GC 5.26 75-GC 21.88
−0.2
63-GC 16.67
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
355
csusm 10.2415/GC-MONO-PT-CLEF2007.CSUSM.GEOMOPT4 GC-MONO-PT-CLEF2007
Overall statistics for 25 queries : Priority 4
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language Portuguese
Relevant 762 Topic Fields title, description, narrative
Relevant retrieved 514 Pooled true
Geometric Mean Average Precision 0.0565 Automatic processing of topic's title, description,
Binary Preference (BPREF) 0.1722 & narrative with relevance feedback
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual Portuguese Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 48.65 GEOMOPT4
10 37.05 90%
20 32.40
80%
30 24.48
40 19.12 70%
50 15.11
60%
60 13.55
Precision
70 9.78 50%
80 7.41 40%
90 3.86
30%
100 1.55
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
17.81 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual Portuguese Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.6672
Minimum 0.0003
First Quartile 0.0104
Second Quartile 0.1061
Third Quartile 0.2972
Interquartile range 0.2868 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.1781
GeoCLEF Monolingual Portuguese Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1975 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0003 8
Upper Outlier Threshold 0.6672
6
Mean With No Outliers 0.1781
4
Std With No Outliers 0.1975
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual Portuguese Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries GEOMOPT4
51-GC 19.35 64-GC 1.42 0.8
52-GC 1.05 65-GC 59.41
53-GC 0.49 66-GC 66.72
0.6
54-GC 0.29 67-GC 29.35
55-GC 2.61 68-GC 30.85
56-GC 36.84 69-GC 45.99 0.4
57-GC 1.02 70-GC 0.65
58-GC 14.78 71-GC 27.68 0.2
59-GC 0.62 72-GC 10.61
Difference
60-GC 42.29 73-GC 0.03 0
61-GC 16.13 74-GC 18.76
62-GC 5.14 75-GC 10.22
−0.2
63-GC 3.04
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
356
csusm 10.2415/GC-MONO-PT-CLEF2007.CSUSM.GEOMOPT4 GC-MONO-PT-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual Portuguese Task − Retrieved documents vs Mean Precision
100%
5 docs 33.60 GEOMOPT4
10 docs 26.40 90%
15 docs 24.80
80%
20 docs 23.20
30 docs 20.13 70%
100 docs 12.36
60%
200 docs 7.40
Precision
500 docs 3.70 50%
1000 docs 2.06 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
18.46
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual Portuguese Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.6429
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.1538
Third Quartile 0.3150
Interquartile range 0.3150 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.1846
GeoCLEF Monolingual Portuguese Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1898 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 8
Upper Outlier Threshold 0.6429
6
Mean With No Outliers 0.1846
4
Std With No Outliers 0.1898
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual Portuguese Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries GEOMOPT4
51-GC 25.00 64-GC 0.00 0.8
52-GC 2.94 65-GC 64.29
53-GC 0.00 66-GC 53.85
0.6
54-GC 0.00 67-GC 36.00
55-GC 0.00 68-GC 36.25
56-GC 30.00 69-GC 30.00 0.4
57-GC 0.00 70-GC 0.00
58-GC 23.81 71-GC 36.77 0.2
59-GC 0.00 72-GC 13.64
Difference
60-GC 37.50 73-GC 0.00 0
61-GC 15.38 74-GC 29.03
62-GC 5.26 75-GC 21.88
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
357
xldb 10.2415/GC-MONO-PT-CLEF2007.XLDB.XLDBPT_1 GC-MONO-PT-CLEF2007
Overall statistics for 25 queries : Priority 1
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 20,654 Source Language Portuguese
Relevant 762 Topic Fields title, description
Relevant retrieved 411 Pooled true
Geometric Mean Average Precision 0.0067 Terms only
Binary Preference (BPREF) 0.0385
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual Portuguese Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 11.25 XLDBPT_1
10 7.87 90%
20 7.69
80%
30 6.29
40 4.54 70%
50 2.03
60%
60 1.34
Precision
70 0.89 50%
80 0.85 40%
90 0.43
30%
100 0.13
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
3.29 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual Portuguese Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.1453
Minimum 0.0000
First Quartile 0.0012
Second Quartile 0.0106
Third Quartile 0.0528
Interquartile range 0.0516 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.0329
GeoCLEF Monolingual Portuguese Task − Distribution of the Topics of the Experiment
Standard Deviation 0.0421 20
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
15
Upper Outlier Threshold 0.1159
Mean With No Outliers 0.0282 10
Std With No Outliers 0.0357
5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual Portuguese Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries XLDBPT_1
51-GC 0.11 64-GC 2.63 0.8
52-GC 11.59 65-GC 10.38
53-GC 4.30 66-GC 0.07
0.6
54-GC 0.04 67-GC 14.53
55-GC 0.12 68-GC 0.44
56-GC 0.04 69-GC 1.06 0.4
57-GC 0.28 70-GC 2.70
58-GC 0.93 71-GC 3.35 0.2
59-GC 0.64 72-GC 5.31
Difference
60-GC 0.89 73-GC 0.00 0
61-GC 6.42 74-GC 9.76
62-GC 0.00 75-GC 5.27
−0.2
63-GC 1.29
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
358
xldb 10.2415/GC-MONO-PT-CLEF2007.XLDB.XLDBPT_1 GC-MONO-PT-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual Portuguese Task − Retrieved documents vs Mean Precision
100%
5 docs 4.00 XLDBPT_1
10 docs 2.80 90%
15 docs 3.20
80%
20 docs 4.20
30 docs 4.27 70%
100 docs 6.08
60%
200 docs 3.68
Precision
500 docs 2.10 50%
1000 docs 1.64 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
5.01
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual Portuguese Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.2778
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0000
Third Quartile 0.0704
Interquartile range 0.0704 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.0501
GeoCLEF Monolingual Portuguese Task − Distribution of the Topics of the Experiment
Standard Deviation 0.0882 20
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
15
Upper Outlier Threshold 0.0839
Mean With No Outliers 0.0145 10
Std With No Outliers 0.0294
5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual Portuguese Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries XLDBPT_1
51-GC 0.00 64-GC 0.00 0.8
52-GC 23.53 65-GC 27.78
53-GC 0.00 66-GC 0.00
0.6
54-GC 0.00 67-GC 22.67
55-GC 0.00 68-GC 1.25
56-GC 0.00 69-GC 0.00 0.4
57-GC 0.00 70-GC 0.00
58-GC 0.00 71-GC 8.39 0.2
59-GC 0.00 72-GC 6.82
Difference
60-GC 0.00 73-GC 0.00 0
61-GC 7.69 74-GC 20.97
62-GC 0.00 75-GC 6.25
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
359
xldb 10.2415/GC-MONO-PT-CLEF2007.XLDB.XLDBPT_2 GC-MONO-PT-CLEF2007
Overall statistics for 25 queries : Priority 2
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 24,296 Source Language Portuguese
Relevant 762 Topic Fields title
Relevant retrieved 251 Pooled true
Geometric Mean Average Precision 0.0008 Early GeoExpansion, GKBID
Binary Preference (BPREF) 0.0308
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual Portuguese Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 14.10 XLDBPT_2
10 7.34 90%
20 5.44
80%
30 4.26
40 3.99 70%
50 2.85
60%
60 1.76
Precision
70 1.16 50%
80 0.57 40%
90 0.41
30%
100 0.32
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
3.28 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual Portuguese Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.2606
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0011
Third Quartile 0.0336
Interquartile range 0.0336 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.0328
GeoCLEF Monolingual Portuguese Task − Distribution of the Topics of the Experiment
Standard Deviation 0.0627 20
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
15
Upper Outlier Threshold 0.0662
Mean With No Outliers 0.0093 10
Std With No Outliers 0.0183
5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual Portuguese Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries XLDBPT_2
51-GC 0.00 64-GC 0.11 0.8
52-GC 2.71 65-GC 0.41
53-GC 0.00 66-GC 0.00
0.6
54-GC 0.00 67-GC 10.62
55-GC 0.71 68-GC 26.06
56-GC 0.00 69-GC 0.00 0.4
57-GC 12.33 70-GC 0.00
58-GC 0.02 71-GC 0.44 0.2
59-GC 0.00 72-GC 5.31
Difference
60-GC 0.00 73-GC 0.00 0
61-GC 13.53 74-GC 1.90
62-GC 0.08 75-GC 6.62
−0.2
63-GC 1.28
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
360
xldb 10.2415/GC-MONO-PT-CLEF2007.XLDB.XLDBPT_2 GC-MONO-PT-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual Portuguese Task − Retrieved documents vs Mean Precision
100%
5 docs 7.20 XLDBPT_2
10 docs 6.40 90%
15 docs 5.60
80%
20 docs 6.00
30 docs 6.00 70%
100 docs 3.72
60%
200 docs 2.64
Precision
500 docs 1.54 50%
1000 docs 1.00 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
4.12
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual Portuguese Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.3750
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0000
Third Quartile 0.0630
Interquartile range 0.0630 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.0412
GeoCLEF Monolingual Portuguese Task − Distribution of the Topics of the Experiment
Standard Deviation 0.0850 20
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
15
Upper Outlier Threshold 0.1538
Mean With No Outliers 0.0209 10
Std With No Outliers 0.0399
5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual Portuguese Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries XLDBPT_2
51-GC 0.00 64-GC 0.00 0.8
52-GC 8.82 65-GC 2.38
53-GC 0.00 66-GC 0.00
0.6
54-GC 0.00 67-GC 17.33
55-GC 0.00 68-GC 37.50
56-GC 0.00 69-GC 0.00 0.4
57-GC 0.00 70-GC 0.00
58-GC 0.00 71-GC 1.94 0.2
59-GC 0.00 72-GC 6.82
Difference
60-GC 0.00 73-GC 0.00 0
61-GC 15.38 74-GC 6.45
62-GC 0.00 75-GC 6.25
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
361
xldb 10.2415/GC-MONO-PT-CLEF2007.XLDB.XLDBPT_3 GC-MONO-PT-CLEF2007
Overall statistics for 25 queries : Priority 3
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 24,296 Source Language Portuguese
Relevant 762 Topic Fields title
Relevant retrieved 251 Pooled true
Geometric Mean Average Precision 0.0008 Early GeoExpansion, GKBID, MAX
Binary Preference (BPREF) 0.0308
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual Portuguese Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 14.10 XLDBPT_3
10 7.34 90%
20 5.44
80%
30 4.26
40 3.99 70%
50 2.85
60%
60 1.76
Precision
70 1.16 50%
80 0.57 40%
90 0.41
30%
100 0.32
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
3.28 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual Portuguese Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.2606
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0011
Third Quartile 0.0336
Interquartile range 0.0336 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.0328
GeoCLEF Monolingual Portuguese Task − Distribution of the Topics of the Experiment
Standard Deviation 0.0627 20
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
15
Upper Outlier Threshold 0.0662
Mean With No Outliers 0.0093 10
Std With No Outliers 0.0183
5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual Portuguese Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries XLDBPT_3
51-GC 0.00 64-GC 0.11 0.8
52-GC 2.71 65-GC 0.41
53-GC 0.00 66-GC 0.00
0.6
54-GC 0.00 67-GC 10.62
55-GC 0.71 68-GC 26.06
56-GC 0.00 69-GC 0.00 0.4
57-GC 12.33 70-GC 0.00
58-GC 0.02 71-GC 0.44 0.2
59-GC 0.00 72-GC 5.31
Difference
60-GC 0.00 73-GC 0.00 0
61-GC 13.53 74-GC 1.90
62-GC 0.08 75-GC 6.62
−0.2
63-GC 1.28
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
362
xldb 10.2415/GC-MONO-PT-CLEF2007.XLDB.XLDBPT_3 GC-MONO-PT-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual Portuguese Task − Retrieved documents vs Mean Precision
100%
5 docs 7.20 XLDBPT_3
10 docs 6.40 90%
15 docs 5.60
80%
20 docs 6.00
30 docs 6.00 70%
100 docs 3.72
60%
200 docs 2.64
Precision
500 docs 1.54 50%
1000 docs 1.00 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
4.12
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual Portuguese Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.3750
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0000
Third Quartile 0.0630
Interquartile range 0.0630 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.0412
GeoCLEF Monolingual Portuguese Task − Distribution of the Topics of the Experiment
Standard Deviation 0.0850 20
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
15
Upper Outlier Threshold 0.1538
Mean With No Outliers 0.0209 10
Std With No Outliers 0.0399
5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual Portuguese Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries XLDBPT_3
51-GC 0.00 64-GC 0.00 0.8
52-GC 8.82 65-GC 2.38
53-GC 0.00 66-GC 0.00
0.6
54-GC 0.00 67-GC 17.33
55-GC 0.00 68-GC 37.50
56-GC 0.00 69-GC 0.00 0.4
57-GC 0.00 70-GC 0.00
58-GC 0.00 71-GC 1.94 0.2
59-GC 0.00 72-GC 6.82
Difference
60-GC 0.00 73-GC 0.00 0
61-GC 15.38 74-GC 6.45
62-GC 0.00 75-GC 6.25
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
363
xldb 10.2415/GC-MONO-PT-CLEF2007.XLDB.XLDBPT_4 GC-MONO-PT-CLEF2007
Overall statistics for 25 queries : Priority 4
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 24,296 Source Language Portuguese
Relevant 762 Topic Fields title
Relevant retrieved 213 Pooled true
Geometric Mean Average Precision 0.0007 Later GeoExpansion, GKBID, AVG
Binary Preference (BPREF) 0.0242
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual Portuguese Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 14.09 XLDBPT_4
10 5.37 90%
20 4.07
80%
30 2.82
40 2.56 70%
50 2.22
60%
60 1.25
Precision
70 0.78 50%
80 0.57 40%
90 0.41
30%
100 0.32
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
2.52 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual Portuguese Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.1353
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0011
Third Quartile 0.0336
Interquartile range 0.0336 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.0252
GeoCLEF Monolingual Portuguese Task − Distribution of the Topics of the Experiment
Standard Deviation 0.0420 20
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
15
Upper Outlier Threshold 0.0701
Mean With No Outliers 0.0121 10
Std With No Outliers 0.0221
5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual Portuguese Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries XLDBPT_4
51-GC 0.00 64-GC 0.11 0.8
52-GC 2.71 65-GC 0.41
53-GC 0.00 66-GC 0.00
0.6
54-GC 0.00 67-GC 10.62
55-GC 0.71 68-GC 7.01
56-GC 0.00 69-GC 0.00 0.4
57-GC 12.33 70-GC 0.00
58-GC 0.02 71-GC 0.44 0.2
59-GC 0.00 72-GC 5.31
Difference
60-GC 0.00 73-GC 0.00 0
61-GC 13.53 74-GC 1.90
62-GC 0.08 75-GC 6.62
−0.2
63-GC 1.28
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
364
xldb 10.2415/GC-MONO-PT-CLEF2007.XLDB.XLDBPT_4 GC-MONO-PT-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual Portuguese Task − Retrieved documents vs Mean Precision
100%
5 docs 7.20 XLDBPT_4
10 docs 5.20 90%
15 docs 4.53
80%
20 docs 4.80
30 docs 4.80 70%
100 docs 3.00
60%
200 docs 2.28
Precision
500 docs 1.28 50%
1000 docs 0.85 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
3.37
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual Portuguese Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.1875
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0000
Third Quartile 0.0630
Interquartile range 0.0630 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.0337
GeoCLEF Monolingual Portuguese Task − Distribution of the Topics of the Experiment
Standard Deviation 0.0585 20
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
15
Upper Outlier Threshold 0.1538
Mean With No Outliers 0.0209 10
Std With No Outliers 0.0399
5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual Portuguese Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries XLDBPT_4
51-GC 0.00 64-GC 0.00 0.8
52-GC 8.82 65-GC 2.38
53-GC 0.00 66-GC 0.00
0.6
54-GC 0.00 67-GC 17.33
55-GC 0.00 68-GC 18.75
56-GC 0.00 69-GC 0.00 0.4
57-GC 0.00 70-GC 0.00
58-GC 0.00 71-GC 1.94 0.2
59-GC 0.00 72-GC 6.82
Difference
60-GC 0.00 73-GC 0.00 0
61-GC 15.38 74-GC 6.45
62-GC 0.00 75-GC 6.25
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
365
xldb 10.2415/GC-MONO-PT-CLEF2007.XLDB.XLDBPT_5 GC-MONO-PT-CLEF2007
Overall statistics for 25 queries : Priority 5
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 24,296 Source Language Portuguese
Relevant 762 Topic Fields title
Relevant retrieved 213 Pooled true
Geometric Mean Average Precision 0.0007 Later GeoExpansion, GKBID, MAX
Binary Preference (BPREF) 0.0242
Interploated Recall (%) Precision Averages (%)
GeoCLEF Monolingual Portuguese Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 14.09 XLDBPT_5
10 5.37 90%
20 4.07
80%
30 2.82
40 2.56 70%
50 2.22
60%
60 1.25
Precision
70 0.78 50%
80 0.57 40%
90 0.41
30%
100 0.32
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
2.52 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Monolingual Portuguese Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.1353
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0011
Third Quartile 0.0336
Interquartile range 0.0336 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.0252
GeoCLEF Monolingual Portuguese Task − Distribution of the Topics of the Experiment
Standard Deviation 0.0420 20
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
15
Upper Outlier Threshold 0.0701
Mean With No Outliers 0.0121 10
Std With No Outliers 0.0221
5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual Portuguese Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries XLDBPT_5
51-GC 0.00 64-GC 0.11 0.8
52-GC 2.71 65-GC 0.41
53-GC 0.00 66-GC 0.00
0.6
54-GC 0.00 67-GC 10.62
55-GC 0.71 68-GC 7.01
56-GC 0.00 69-GC 0.00 0.4
57-GC 12.33 70-GC 0.00
58-GC 0.02 71-GC 0.44 0.2
59-GC 0.00 72-GC 5.31
Difference
60-GC 0.00 73-GC 0.00 0
61-GC 13.53 74-GC 1.90
62-GC 0.08 75-GC 6.62
−0.2
63-GC 1.28
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
366
xldb 10.2415/GC-MONO-PT-CLEF2007.XLDB.XLDBPT_5 GC-MONO-PT-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Monolingual Portuguese Task − Retrieved documents vs Mean Precision
100%
5 docs 7.20 XLDBPT_5
10 docs 5.20 90%
15 docs 4.53
80%
20 docs 4.80
30 docs 4.80 70%
100 docs 3.00
60%
200 docs 2.28
Precision
500 docs 1.28 50%
1000 docs 0.85 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
3.37
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Monolingual Portuguese Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.1875
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0000
Third Quartile 0.0630
Interquartile range 0.0630 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.0337
GeoCLEF Monolingual Portuguese Task − Distribution of the Topics of the Experiment
Standard Deviation 0.0585 20
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
15
Upper Outlier Threshold 0.1538
Mean With No Outliers 0.0209 10
Std With No Outliers 0.0399
5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Monolingual Portuguese Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries XLDBPT_5
51-GC 0.00 64-GC 0.00 0.8
52-GC 8.82 65-GC 2.38
53-GC 0.00 66-GC 0.00
0.6
54-GC 0.00 67-GC 17.33
55-GC 0.00 68-GC 18.75
56-GC 0.00 69-GC 0.00 0.4
57-GC 0.00 70-GC 0.00
58-GC 0.00 71-GC 1.94 0.2
59-GC 0.00 72-GC 6.82
Difference
60-GC 0.00 73-GC 0.00 0
61-GC 15.38 74-GC 6.45
62-GC 0.00 75-GC 6.25
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
367
cheshire 10.2415/GC-BILI-X2DE-CLEF2007.CHESHIRE.BERKBIENDEBASE GC-BILI-X2DE-CLEF2007
Overall statistics for 25 queries : Priority 1
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language English
Relevant 904 Topic Fields title, description
Relevant retrieved 407 Pooled true
Geometric Mean Average Precision 0.0032 Baseline text retrieval with title and desc using
Binary Preference (BPREF) 0.1030 TREC2 ranking with blind feedback
Interploated Recall (%) Precision Averages (%)
GeoCLEF Bilingual German Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 28.60 BERKBIENDEBASE
10 22.81 90%
20 21.69
80%
30 14.15
40 11.52 70%
50 7.43
60%
60 4.82
Precision
70 1.10 50%
80 1.00 40%
90 0.49
30%
100 0.23
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
9.02 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Bilingual German Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.5541
Minimum 0.0000
First Quartile 0.0002
Second Quartile 0.0025
Third Quartile 0.1728
Interquartile range 0.1726 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.0902
GeoCLEF Bilingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1439 20
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
15
Upper Outlier Threshold 0.3491
Mean With No Outliers 0.0709 10
Std With No Outliers 0.1089
5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual German Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries BERKBIENDEBASE
51-GC 0.02 64-GC 0.13 0.8
52-GC 0.00 65-GC 17.25
53-GC 0.25 66-GC 0.20
0.6
54-GC 0.03 67-GC 0.00
55-GC 1.43 68-GC 29.77
56-GC 22.50 69-GC 20.62 0.4
57-GC 0.00 70-GC 0.21
58-GC 0.03 71-GC 34.91 0.2
59-GC 0.00 72-GC 0.35
Difference
60-GC 0.00 73-GC 1.52 0
61-GC 0.00 74-GC 17.35
62-GC 8.79 75-GC 55.41
−0.2
63-GC 14.71
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
368
cheshire 10.2415/GC-BILI-X2DE-CLEF2007.CHESHIRE.BERKBIENDEBASE GC-BILI-X2DE-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Bilingual German Task − Retrieved documents vs Mean Precision
100%
5 docs 17.60 BERKBIENDEBASE
10 docs 14.40 90%
15 docs 13.60
80%
20 docs 13.00
30 docs 12.80 70%
100 docs 9.00
60%
200 docs 5.66
Precision
500 docs 2.90 50%
1000 docs 1.63 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
11.75
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Bilingual German Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.6228
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0000
Third Quartile 0.2586
Interquartile range 0.2586 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.1175
GeoCLEF Bilingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1822 20
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
15
Upper Outlier Threshold 0.6228
Mean With No Outliers 0.1175 10
Std With No Outliers 0.1822
5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual German Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries BERKBIENDEBASE
51-GC 0.00 64-GC 0.00 0.8
52-GC 0.00 65-GC 28.42
53-GC 0.00 66-GC 0.00
0.6
54-GC 0.00 67-GC 0.00
55-GC 0.00 68-GC 40.15
56-GC 20.00 69-GC 35.56 0.4
57-GC 0.00 70-GC 0.00
58-GC 0.00 71-GC 42.86 0.2
59-GC 0.00 72-GC 0.00
Difference
60-GC 0.00 73-GC 0.00 0
61-GC 0.00 74-GC 25.00
62-GC 9.38 75-GC 62.28
−0.2
63-GC 30.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
369
cheshire 10.2415/GC-BILI-X2DE-CLEF2007.CHESHIRE.BERKBIESDEBASE GC-BILI-X2DE-CLEF2007
Overall statistics for 25 queries : Priority 2
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language Spanish; Castilian
Relevant 904 Topic Fields title, description
Relevant retrieved 290 Pooled true
Geometric Mean Average Precision 0.0032 (See overleaf for description)
Binary Preference (BPREF) 0.0731
Interploated Recall (%) Precision Averages (%)
GeoCLEF Bilingual German Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 24.46 BERKBIESDEBASE
10 20.21 90%
20 16.02
80%
30 9.12
40 6.96 70%
50 6.18
60%
60 4.75
Precision
70 1.16 50%
80 0.85 40%
90 0.73
30%
100 0.44
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
7.24 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Bilingual German Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.5344
Minimum 0.0000
First Quartile 0.0002
Second Quartile 0.0088
Third Quartile 0.0611
Interquartile range 0.0608 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.0724
GeoCLEF Bilingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1347 20
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
15
Upper Outlier Threshold 0.1098
Mean With No Outliers 0.0150 10
Std With No Outliers 0.0264
5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual German Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries BERKBIESDEBASE
51-GC 4.49 64-GC 0.03 0.8
52-GC 0.00 65-GC 2.44
53-GC 1.29 66-GC 0.00
0.6
54-GC 4.17 67-GC 0.88
55-GC 1.60 68-GC 0.52
56-GC 2.87 69-GC 16.72 0.4
57-GC 0.00 70-GC 0.21
58-GC 0.05 71-GC 37.52 0.2
59-GC 0.00 72-GC 0.28
Difference
60-GC 0.00 73-GC 0.15 0
61-GC 0.00 74-GC 21.50
62-GC 10.98 75-GC 53.44
−0.2
63-GC 21.93
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
370
cheshire 10.2415/GC-BILI-X2DE-CLEF2007.CHESHIRE.BERKBIESDEBASE GC-BILI-X2DE-CLEF2007
Baseline Spanish to German using Powertrans and
searching titles and desc using TREC2 with blind
feedback
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Bilingual German Task − Retrieved documents vs Mean Precision
100%
5 docs 11.20 BERKBIESDEBASE
10 docs 10.80 90%
15 docs 9.60
80%
20 docs 9.20
30 docs 8.80 70%
100 docs 6.20
60%
200 docs 3.98
Precision
500 docs 1.94 50%
1000 docs 1.16 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
8.49
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Bilingual German Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.6228
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0000
Third Quartile 0.1141
Interquartile range 0.1141 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.0849
GeoCLEF Bilingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1518 20
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
15
Upper Outlier Threshold 0.2500
Mean With No Outliers 0.0404 10
Std With No Outliers 0.0762
5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual German Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries BERKBIESDEBASE
51-GC 10.00 64-GC 0.00 0.8
52-GC 0.00 65-GC 9.47
53-GC 0.00 66-GC 0.00
0.6
54-GC 0.00 67-GC 1.64
55-GC 0.00 68-GC 4.83
56-GC 0.00 69-GC 22.22 0.4
57-GC 0.00 70-GC 0.00
58-GC 0.00 71-GC 28.57 0.2
59-GC 0.00 72-GC 0.00
Difference
60-GC 0.00 73-GC 0.00 0
61-GC 0.00 74-GC 25.00
62-GC 15.62 75-GC 62.28
−0.2
63-GC 32.50
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
371
cheshire 10.2415/GC-BILI-X2DE-CLEF2007.CHESHIRE.BERKBIPTDEBASE GC-BILI-X2DE-CLEF2007
Overall statistics for 25 queries : Priority 3
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language Portuguese
Relevant 904 Topic Fields title, description
Relevant retrieved 398 Pooled true
Geometric Mean Average Precision 0.0026 (See overleaf for description)
Binary Preference (BPREF) 0.1163
Interploated Recall (%) Precision Averages (%)
GeoCLEF Bilingual German Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 37.50 BERKBIPTDEBASE
10 28.42 90%
20 22.76
80%
30 16.65
40 13.59 70%
50 9.92
60%
60 7.33
Precision
70 2.97 50%
80 1.32 40%
90 1.13
30%
100 0.90
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
11.09 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Bilingual German Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.5474
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0081
Third Quartile 0.1963
Interquartile range 0.1963 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.1109
GeoCLEF Bilingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1700 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.3742 10
Mean With No Outliers 0.0735
Std With No Outliers 0.1153 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual German Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries BERKBIPTDEBASE
51-GC 6.23 64-GC 0.01 0.8
52-GC 0.00 65-GC 4.03
53-GC 0.56 66-GC 0.00
0.6
54-GC 0.00 67-GC 0.00
55-GC 1.36 68-GC 26.91
56-GC 26.67 69-GC 37.42 0.4
57-GC 0.00 70-GC 0.81
58-GC 0.01 71-GC 54.74 0.2
59-GC 0.00 72-GC 17.28
Difference
60-GC 0.02 73-GC 0.00 0
61-GC 0.02 74-GC 27.69
62-GC 8.12 75-GC 53.38
−0.2
63-GC 12.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
372
cheshire 10.2415/GC-BILI-X2DE-CLEF2007.CHESHIRE.BERKBIPTDEBASE GC-BILI-X2DE-CLEF2007
Baseline Portuguese to German using Powertrans and
searching using TREC2 ranking with Blind Feedback
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Bilingual German Task − Retrieved documents vs Mean Precision
100%
5 docs 17.60 BERKBIPTDEBASE
10 docs 15.60 90%
15 docs 13.87
80%
20 docs 13.60
30 docs 12.13 70%
100 docs 8.64
60%
200 docs 5.70
Precision
500 docs 2.78 50%
1000 docs 1.59 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
12.83
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Bilingual German Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.6140
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0000
Third Quartile 0.2125
Interquartile range 0.2125 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.1283
GeoCLEF Bilingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1936 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.4286 10
Mean With No Outliers 0.0867
Std With No Outliers 0.1351 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual German Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries BERKBIPTDEBASE
51-GC 6.67 64-GC 0.00 0.8
52-GC 0.00 65-GC 11.58
53-GC 0.00 66-GC 0.00
0.6
54-GC 0.00 67-GC 0.00
55-GC 0.00 68-GC 38.29
56-GC 20.00 69-GC 60.00 0.4
57-GC 0.00 70-GC 4.35
58-GC 0.00 71-GC 42.86 0.2
59-GC 0.00 72-GC 30.00
Difference
60-GC 0.00 73-GC 0.00 0
61-GC 0.00 74-GC 25.00
62-GC 3.12 75-GC 61.40
−0.2
63-GC 17.50
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
373
hagen 10.2415/GC-BILI-X2DE-CLEF2007.HAGEN.FUHTD1EN GC-BILI-X2DE-CLEF2007
Overall statistics for 25 queries : Priority 5
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language English
Relevant 904 Topic Fields title, description
Relevant retrieved 490 Pooled true
Geometric Mean Average Precision 0.0176 FUHtd1en
Binary Preference (BPREF) 0.1014
Interploated Recall (%) Precision Averages (%)
GeoCLEF Bilingual German Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 32.86 FUHTD1EN
10 28.81 90%
20 22.78
80%
30 16.43
40 11.07 70%
50 8.59
60%
60 5.79
Precision
70 4.08 50%
80 3.33 40%
90 2.38
30%
100 2.09
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
11.36 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Bilingual German Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.5335
Minimum 0.0000
First Quartile 0.0093
Second Quartile 0.0354
Third Quartile 0.2196
Interquartile range 0.2103 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.1136
GeoCLEF Bilingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1444 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.5335 10
Mean With No Outliers 0.1136
Std With No Outliers 0.1444 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual German Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries FUHTD1EN
51-GC 1.09 64-GC 1.34 0.8
52-GC 0.00 65-GC 13.01
53-GC 8.19 66-GC 1.61
0.6
54-GC 8.37 67-GC 3.08
55-GC 0.19 68-GC 25.30
56-GC 25.49 69-GC 21.52 0.4
57-GC 33.33 70-GC 1.67
58-GC 0.10 71-GC 2.70 0.2
59-GC 0.00 72-GC 0.47
Difference
60-GC 0.00 73-GC 23.28 0
61-GC 14.20 74-GC 4.64
62-GC 3.54 75-GC 53.35
−0.2
63-GC 37.56
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
374
hagen 10.2415/GC-BILI-X2DE-CLEF2007.HAGEN.FUHTD1EN GC-BILI-X2DE-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Bilingual German Task − Retrieved documents vs Mean Precision
100%
5 docs 21.60 FUHTD1EN
10 docs 18.80 90%
15 docs 17.07
80%
20 docs 16.20
30 docs 14.67 70%
100 docs 10.12
60%
200 docs 6.34
Precision
500 docs 3.07 50%
1000 docs 1.96 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
11.70
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Bilingual German Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.5702
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0333
Third Quartile 0.2098
Interquartile range 0.2098 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.1170
GeoCLEF Bilingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1522 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.3500 10
Mean With No Outliers 0.0981
Std With No Outliers 0.1219 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual German Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries FUHTD1EN
51-GC 3.33 64-GC 7.69 0.8
52-GC 0.00 65-GC 25.26
53-GC 20.00 66-GC 0.00
0.6
54-GC 0.00 67-GC 11.48
55-GC 0.00 68-GC 33.09
56-GC 20.00 69-GC 28.89 0.4
57-GC 0.00 70-GC 0.00
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 0.00
Difference
60-GC 0.00 73-GC 14.29 0
61-GC 23.91 74-GC 12.50
62-GC 0.00 75-GC 57.02
−0.2
63-GC 35.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
375
hagen 10.2415/GC-BILI-X2DE-CLEF2007.HAGEN.FUHTD2EN GC-BILI-X2DE-CLEF2007
Overall statistics for 25 queries : Priority 4
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language English
Relevant 904 Topic Fields title, description
Relevant retrieved 588 Pooled true
Geometric Mean Average Precision 0.0278 FUHtd2en
Binary Preference (BPREF) 0.1416
Interploated Recall (%) Precision Averages (%)
GeoCLEF Bilingual German Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 42.25 FUHTD2EN
10 34.13 90%
20 28.10
80%
30 19.56
40 16.30 70%
50 12.44
60%
60 9.05
Precision
70 5.72 50%
80 3.74 40%
90 2.37
30%
100 1.78
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
14.64 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Bilingual German Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.6507
Minimum 0.0000
First Quartile 0.0179
Second Quartile 0.1189
Third Quartile 0.2481
Interquartile range 0.2302 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.1464
GeoCLEF Bilingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1627 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.4591 10
Mean With No Outliers 0.1254
Std With No Outliers 0.1269 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual German Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries FUHTD2EN
51-GC 0.91 64-GC 2.84 0.8
52-GC 0.00 65-GC 28.65
53-GC 11.89 66-GC 2.50
0.6
54-GC 25.94 67-GC 7.80
55-GC 0.00 68-GC 24.75
56-GC 27.71 69-GC 19.58 0.4
57-GC 25.00 70-GC 2.12
58-GC 0.61 71-GC 2.09 0.2
59-GC 0.00 72-GC 0.52
Difference
60-GC 14.08 73-GC 21.03 0
61-GC 14.68 74-GC 19.97
62-GC 2.43 75-GC 65.07
−0.2
63-GC 45.91
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
376
hagen 10.2415/GC-BILI-X2DE-CLEF2007.HAGEN.FUHTD2EN GC-BILI-X2DE-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Bilingual German Task − Retrieved documents vs Mean Precision
100%
5 docs 27.20 FUHTD2EN
10 docs 22.00 90%
15 docs 20.80
80%
20 docs 19.60
30 docs 17.33 70%
100 docs 12.24
60%
200 docs 7.46
Precision
500 docs 3.81 50%
1000 docs 2.35 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
16.26
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Bilingual German Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.6491
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.1429
Third Quartile 0.2646
Interquartile range 0.2646 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.1626
GeoCLEF Bilingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1864 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.6491 10
Mean With No Outliers 0.1626
Std With No Outliers 0.1864 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual German Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries FUHTD2EN
51-GC 0.00 64-GC 0.00 0.8
52-GC 0.00 65-GC 42.11
53-GC 20.00 66-GC 0.00
0.6
54-GC 25.00 67-GC 14.75
55-GC 0.00 68-GC 30.86
56-GC 40.00 69-GC 33.33 0.4
57-GC 0.00 70-GC 0.00
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 0.00
Difference
60-GC 25.00 73-GC 14.29 0
61-GC 17.39 74-GC 25.00
62-GC 6.25 75-GC 64.91
−0.2
63-GC 47.50
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
377
hagen 10.2415/GC-BILI-X2DE-CLEF2007.HAGEN.FUHTD3EN GC-BILI-X2DE-CLEF2007
Overall statistics for 25 queries : Priority 3
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language English
Relevant 904 Topic Fields title, description
Relevant retrieved 580 Pooled true
Geometric Mean Average Precision 0.0255 FUHtd3en
Binary Preference (BPREF) 0.1399
Interploated Recall (%) Precision Averages (%)
GeoCLEF Bilingual German Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 44.85 FUHTD3EN
10 31.72 90%
20 26.42
80%
30 20.79
40 17.52 70%
50 16.09
60%
60 9.27
Precision
70 4.07 50%
80 2.92 40%
90 2.19
30%
100 2.19
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
14.49 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Bilingual German Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.5126
Minimum 0.0000
First Quartile 0.0063
Second Quartile 0.0895
Third Quartile 0.2721
Interquartile range 0.2658 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.1449
GeoCLEF Bilingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1665 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.5126 10
Mean With No Outliers 0.1449
Std With No Outliers 0.1665 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual German Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries FUHTD3EN
51-GC 0.09 64-GC 4.60 0.8
52-GC 0.00 65-GC 33.10
53-GC 10.59 66-GC 1.67
0.6
54-GC 51.14 67-GC 3.69
55-GC 0.02 68-GC 13.45
56-GC 12.40 69-GC 5.58 0.4
57-GC 33.33 70-GC 10.99
58-GC 0.37 71-GC 3.15 0.2
59-GC 0.00 72-GC 0.20
Difference
60-GC 8.95 73-GC 26.86 0
61-GC 18.75 74-GC 28.28
62-GC 0.72 75-GC 51.26
−0.2
63-GC 42.99
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
378
hagen 10.2415/GC-BILI-X2DE-CLEF2007.HAGEN.FUHTD3EN GC-BILI-X2DE-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Bilingual German Task − Retrieved documents vs Mean Precision
100%
5 docs 22.40 FUHTD3EN
10 docs 18.00 90%
15 docs 16.27
80%
20 docs 15.60
30 docs 13.87 70%
100 docs 9.76
60%
200 docs 6.52
Precision
500 docs 3.44 50%
1000 docs 2.32 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
15.51
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Bilingual German Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.6228
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0769
Third Quartile 0.2527
Interquartile range 0.2527 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.1551
GeoCLEF Bilingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1888 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.6228 10
Mean With No Outliers 0.1551
Std With No Outliers 0.1888 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual German Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries FUHTD3EN
51-GC 0.00 64-GC 7.69 0.8
52-GC 0.00 65-GC 46.32
53-GC 30.00 66-GC 0.00
0.6
54-GC 50.00 67-GC 9.84
55-GC 0.00 68-GC 22.30
56-GC 0.00 69-GC 6.67 0.4
57-GC 0.00 70-GC 17.39
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 0.00
Difference
60-GC 19.23 73-GC 14.29 0
61-GC 26.09 74-GC 25.00
62-GC 3.12 75-GC 62.28
−0.2
63-GC 47.50
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
379
hagen 10.2415/GC-BILI-X2DE-CLEF2007.HAGEN.FUHTDN4EN GC-BILI-X2DE-CLEF2007
Overall statistics for 25 queries : Priority 2
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language English
Relevant 904 Topic Fields title, description, narrative
Relevant retrieved 622 Pooled true
Geometric Mean Average Precision 0.0564 FUHtdn4en
Binary Preference (BPREF) 0.1899
Interploated Recall (%) Precision Averages (%)
GeoCLEF Bilingual German Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 49.95 FUHTDN4EN
10 41.59 90%
20 34.64
80%
30 30.03
40 24.16 70%
50 19.54
60%
60 14.82
Precision
70 11.33 50%
80 9.24 40%
90 6.38
30%
100 4.50
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
20.92 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Bilingual German Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7892
Minimum 0.0000
First Quartile 0.0221
Second Quartile 0.1434
Third Quartile 0.3381
Interquartile range 0.3159 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.2092
GeoCLEF Bilingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2149 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 8
Upper Outlier Threshold 0.7892
6
Mean With No Outliers 0.2092
4
Std With No Outliers 0.2149
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual German Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries FUHTDN4EN
51-GC 6.71 64-GC 1.98 0.8
52-GC 0.00 65-GC 28.65
53-GC 23.12 66-GC 3.00
0.6
54-GC 2.41 67-GC 7.80
55-GC 0.02 68-GC 24.75
56-GC 27.71 69-GC 35.23 0.4
57-GC 33.33 70-GC 2.29
58-GC 10.71 71-GC 14.34 0.2
59-GC 1.93 72-GC 0.52
Difference
60-GC 54.72 73-GC 54.88 0
61-GC 24.83 74-GC 38.94
62-GC 0.18 75-GC 78.92
−0.2
63-GC 45.91
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
380
hagen 10.2415/GC-BILI-X2DE-CLEF2007.HAGEN.FUHTDN4EN GC-BILI-X2DE-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Bilingual German Task − Retrieved documents vs Mean Precision
100%
5 docs 35.20 FUHTDN4EN
10 docs 28.40 90%
15 docs 25.87
80%
20 docs 24.60
30 docs 21.87 70%
100 docs 14.48
60%
200 docs 8.96
Precision
500 docs 4.33 50%
1000 docs 2.49 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
21.25
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Bilingual German Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.6579
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.1475
Third Quartile 0.3833
Interquartile range 0.3833 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.2125
GeoCLEF Bilingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2120 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 8
Upper Outlier Threshold 0.6579
6
Mean With No Outliers 0.2125
4
Std With No Outliers 0.2120
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual German Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries FUHTDN4EN
51-GC 10.00 64-GC 7.69 0.8
52-GC 0.00 65-GC 42.11
53-GC 30.00 66-GC 0.00
0.6
54-GC 0.00 67-GC 14.75
55-GC 0.00 68-GC 30.86
56-GC 40.00 69-GC 37.78 0.4
57-GC 0.00 70-GC 0.00
58-GC 15.79 71-GC 14.29 0.2
59-GC 0.00 72-GC 0.00
Difference
60-GC 59.62 73-GC 42.86 0
61-GC 34.78 74-GC 37.50
62-GC 0.00 75-GC 65.79
−0.2
63-GC 47.50
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
381
hagen 10.2415/GC-BILI-X2DE-CLEF2007.HAGEN.FUHTDN5EN GC-BILI-X2DE-CLEF2007
Overall statistics for 25 queries : Priority 1
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language English
Relevant 904 Topic Fields title, description, narrative
Relevant retrieved 619 Pooled true
Geometric Mean Average Precision 0.0516 FUHtdn5en
Binary Preference (BPREF) 0.1700
Interploated Recall (%) Precision Averages (%)
GeoCLEF Bilingual German Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 46.61 FUHTDN5EN
10 35.98 90%
20 31.33
80%
30 27.06
40 23.62 70%
50 20.49
60%
60 15.28
Precision
70 10.31 50%
80 6.15 40%
90 4.55
30%
100 4.01
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
18.87 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Bilingual German Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.5942
Minimum 0.0000
First Quartile 0.0210
Second Quartile 0.1240
Third Quartile 0.3526
Interquartile range 0.3316 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.1887
GeoCLEF Bilingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1951 8
Number of Topics of the Experiment
7
Lower Outlier Threshold 0.0000
6
Upper Outlier Threshold 0.5942 5
Mean With No Outliers 0.1887 4
3
Std With No Outliers 0.1951
2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual German Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries FUHTDN5EN
51-GC 1.40 64-GC 2.33 0.8
52-GC 0.00 65-GC 33.10
53-GC 18.31 66-GC 6.80
0.6
54-GC 7.98 67-GC 3.69
55-GC 0.05 68-GC 13.45
56-GC 12.40 69-GC 11.95 0.4
57-GC 50.00 70-GC 12.43
58-GC 14.86 71-GC 7.87 0.2
59-GC 0.89 72-GC 0.20
Difference
60-GC 50.77 73-GC 50.47 0
61-GC 28.51 74-GC 41.75
62-GC 0.16 75-GC 59.42
−0.2
63-GC 42.99
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
382
hagen 10.2415/GC-BILI-X2DE-CLEF2007.HAGEN.FUHTDN5EN GC-BILI-X2DE-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Bilingual German Task − Retrieved documents vs Mean Precision
100%
5 docs 27.20 FUHTDN5EN
10 docs 25.60 90%
15 docs 21.60
80%
20 docs 20.80
30 docs 19.87 70%
100 docs 11.92
60%
200 docs 7.56
Precision
500 docs 3.87 50%
1000 docs 2.48 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
18.81
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Bilingual German Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.6491
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0984
Third Quartile 0.3935
Interquartile range 0.3935 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.1881
GeoCLEF Bilingual German Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2142 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.6491 10
Mean With No Outliers 0.1881
Std With No Outliers 0.2142 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual German Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries FUHTDN5EN
51-GC 6.67 64-GC 0.00 0.8
52-GC 0.00 65-GC 46.32
53-GC 40.00 66-GC 0.00
0.6
54-GC 0.00 67-GC 9.84
55-GC 0.00 68-GC 22.30
56-GC 0.00 69-GC 20.00 0.4
57-GC 0.00 70-GC 21.74
58-GC 15.79 71-GC 0.00 0.2
59-GC 0.00 72-GC 0.00
Difference
60-GC 55.77 73-GC 42.86 0
61-GC 39.13 74-GC 37.50
62-GC 0.00 75-GC 64.91
−0.2
63-GC 47.50
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
383
cheshire 10.2415/GC-BILI-X2EN-CLEF2007.CHESHIRE.BERKBIDEENBASE GC-BILI-X2EN-CLEF2007
Overall statistics for 25 queries : Priority 1
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language German
Relevant 650 Topic Fields title, description
Relevant retrieved 472 Pooled true
Geometric Mean Average Precision 0.0296 Baseline German to English using Powertrans and
Binary Preference (BPREF) 0.2033 searching using TREC2 ranking with Blind Feedback
Interploated Recall (%) Precision Averages (%)
GeoCLEF Bilingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 48.69 BERKBIDEENBASE
10 39.31 90%
20 35.54
80%
30 29.71
40 24.63 70%
50 22.62
60%
60 20.92
Precision
70 16.29 50%
80 11.86 40%
90 7.43
30%
100 1.93
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
22.08 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Bilingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7619
Minimum 0.0000
First Quartile 0.0075
Second Quartile 0.1765
Third Quartile 0.3275
Interquartile range 0.3200 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.2208
GeoCLEF Bilingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2421 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 8
Upper Outlier Threshold 0.7619
6
Mean With No Outliers 0.2208
4
Std With No Outliers 0.2421
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries BERKBIDEENBASE
51-GC 0.96 64-GC 0.87 0.8
52-GC 0.44 65-GC 31.82
53-GC 17.65 66-GC 5.23
0.6
54-GC 0.08 67-GC 51.26
55-GC 18.30 68-GC 31.14
56-GC 24.69 69-GC 25.45 0.4
57-GC 9.68 70-GC 0.29
58-GC 9.20 71-GC 0.00 0.2
59-GC 0.00 72-GC 35.53
Difference
60-GC 76.19 73-GC 0.85 0
61-GC 67.65 74-GC 46.82
62-GC 27.74 75-GC 70.23
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
384
cheshire 10.2415/GC-BILI-X2EN-CLEF2007.CHESHIRE.BERKBIDEENBASE GC-BILI-X2EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Bilingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 28.00 BERKBIDEENBASE
10 docs 25.60 90%
15 docs 21.87
80%
20 docs 20.60
30 docs 18.27 70%
100 docs 10.44
60%
200 docs 6.64
Precision
500 docs 3.46 50%
1000 docs 1.89 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
21.97
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Bilingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7000
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.2000
Third Quartile 0.3576
Interquartile range 0.3576 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.2197
GeoCLEF Bilingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2271 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 8
Upper Outlier Threshold 0.7000
6
Mean With No Outliers 0.2197
4
Std With No Outliers 0.2271
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries BERKBIDEENBASE
51-GC 1.79 64-GC 0.00 0.8
52-GC 0.00 65-GC 38.71
53-GC 25.00 66-GC 0.00
0.6
54-GC 0.00 67-GC 41.18
55-GC 18.75 68-GC 35.88
56-GC 25.00 69-GC 28.57 0.4
57-GC 20.00 70-GC 0.00
58-GC 16.67 71-GC 0.00 0.2
59-GC 0.00 72-GC 35.71
Difference
60-GC 70.00 73-GC 0.00 0
61-GC 63.64 74-GC 33.33
62-GC 25.00 75-GC 70.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
385
cheshire 10.2415/GC-BILI-X2EN-CLEF2007.CHESHIRE.BERKBIESENBASE GC-BILI-X2EN-CLEF2007
Overall statistics for 25 queries : Priority 2
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language Spanish; Castilian
Relevant 650 Topic Fields title, description
Relevant retrieved 491 Pooled true
Geometric Mean Average Precision 0.0294 Baseline Spanish to English using Powertrans and
Binary Preference (BPREF) 0.2148 searching using TREC2 ranking with Blind Feedback
Interploated Recall (%) Precision Averages (%)
GeoCLEF Bilingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 52.57 BERKBIESENBASE
10 39.66 90%
20 36.92
80%
30 29.52
40 23.15 70%
50 22.61
60%
60 21.30
Precision
70 14.53 50%
80 10.45 40%
90 6.40
30%
100 3.93
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
21.95 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Bilingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7832
Minimum 0.0000
First Quartile 0.0036
Second Quartile 0.1204
Third Quartile 0.3474
Interquartile range 0.3439 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.2195
GeoCLEF Bilingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2453 8
Number of Topics of the Experiment
7
Lower Outlier Threshold 0.0000
6
Upper Outlier Threshold 0.7832 5
Mean With No Outliers 0.2195 4
3
Std With No Outliers 0.2453
2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries BERKBIESENBASE
51-GC 12.04 64-GC 0.37 0.8
52-GC 0.20 65-GC 5.29
53-GC 11.03 66-GC 33.53
0.6
54-GC 0.06 67-GC 50.75
55-GC 13.69 68-GC 28.72
56-GC 38.39 69-GC 29.57 0.4
57-GC 14.15 70-GC 1.80
58-GC 7.02 71-GC 0.00 0.2
59-GC 0.00 72-GC 58.15
Difference
60-GC 78.32 73-GC 0.31 0
61-GC 6.84 74-GC 67.12
62-GC 27.95 75-GC 63.46
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
386
cheshire 10.2415/GC-BILI-X2EN-CLEF2007.CHESHIRE.BERKBIESENBASE GC-BILI-X2EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Bilingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 26.40 BERKBIESENBASE
10 docs 21.20 90%
15 docs 18.67
80%
20 docs 17.60
30 docs 15.73 70%
100 docs 8.72
60%
200 docs 6.04
Precision
500 docs 3.34 50%
1000 docs 1.96 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
23.08
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Bilingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7000
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.2031
Third Quartile 0.3544
Interquartile range 0.3544 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.2308
GeoCLEF Bilingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2415 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 8
Upper Outlier Threshold 0.7000
6
Mean With No Outliers 0.2308
4
Std With No Outliers 0.2415
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries BERKBIESENBASE
51-GC 21.43 64-GC 0.00 0.8
52-GC 0.00 65-GC 4.30
53-GC 20.31 66-GC 33.33
0.6
54-GC 0.00 67-GC 35.29
55-GC 18.75 68-GC 35.88
56-GC 50.00 69-GC 28.57 0.4
57-GC 26.67 70-GC 6.90
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 64.29
Difference
60-GC 70.00 73-GC 0.00 0
61-GC 4.55 74-GC 66.67
62-GC 25.00 75-GC 65.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
387
cheshire 10.2415/GC-BILI-X2EN-CLEF2007.CHESHIRE.BERKBIPTENBASE GC-BILI-X2EN-CLEF2007
Overall statistics for 25 queries : Priority 3
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language Portuguese
Relevant 650 Topic Fields title, description
Relevant retrieved 578 Pooled false
Geometric Mean Average Precision 0.0277 (See overleaf for description)
Binary Preference (BPREF) 0.2070
Interploated Recall (%) Precision Averages (%)
GeoCLEF Bilingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 44.07 BERKBIPTENBASE
10 36.63 90%
20 32.16
80%
30 28.23
40 23.51 70%
50 20.71
60%
60 19.65
Precision
70 16.87 50%
80 13.62 40%
90 9.08
30%
100 4.67
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
21.12 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Bilingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7675
Minimum 0.0000
First Quartile 0.0065
Second Quartile 0.1447
Third Quartile 0.3330
Interquartile range 0.3265 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.2112
GeoCLEF Bilingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2334 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 8
Upper Outlier Threshold 0.7675
6
Mean With No Outliers 0.2112
4
Std With No Outliers 0.2334
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries BERKBIPTENBASE
51-GC 24.90 64-GC 0.64 0.8
52-GC 0.04 65-GC 30.53
53-GC 23.46 66-GC 0.04
0.6
54-GC 9.78 67-GC 55.48
55-GC 10.99 68-GC 67.97
56-GC 41.61 69-GC 24.04 0.4
57-GC 19.42 70-GC 2.55
58-GC 5.96 71-GC 0.00 0.2
59-GC 0.00 72-GC 43.75
Difference
60-GC 76.75 73-GC 0.65 0
61-GC 1.51 74-GC 17.02
62-GC 14.47 75-GC 56.32
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
388
cheshire 10.2415/GC-BILI-X2EN-CLEF2007.CHESHIRE.BERKBIPTENBASE GC-BILI-X2EN-CLEF2007
Baseline Portuguese to English using Powertrans and
searching using TREC2 ranking with Blind Feedback
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Bilingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 28.80 BERKBIPTENBASE
10 docs 24.00 90%
15 docs 21.07
80%
20 docs 21.20
30 docs 19.47 70%
100 docs 11.64
60%
200 docs 8.36
Precision
500 docs 4.29 50%
1000 docs 2.31 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
23.18
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Bilingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7000
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.2500
Third Quartile 0.3733
Interquartile range 0.3733 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.2318
GeoCLEF Bilingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2309 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 8
Upper Outlier Threshold 0.7000
6
Mean With No Outliers 0.2318
4
Std With No Outliers 0.2309
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries BERKBIPTENBASE
51-GC 30.36 64-GC 0.00 0.8
52-GC 0.00 65-GC 35.48
53-GC 29.69 66-GC 0.00
0.6
54-GC 14.29 67-GC 47.06
55-GC 12.50 68-GC 61.83
56-GC 50.00 69-GC 28.57 0.4
57-GC 26.67 70-GC 6.90
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 42.86
Difference
60-GC 70.00 73-GC 0.00 0
61-GC 0.00 74-GC 33.33
62-GC 25.00 75-GC 65.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
389
csusm 10.2415/GC-BILI-X2EN-CLEF2007.CSUSM.GEOBIESEN1 GC-BILI-X2EN-CLEF2007
Overall statistics for 25 queries : Priority 1
Total number of documents over all queries Query Construction MANUAL
Retrieved 25,000 Source Language Spanish; Castilian
Relevant 650 Topic Fields title, description, narrative
Relevant retrieved 436 Pooled true
Geometric Mean Average Precision 0.0028 Spanish topic's title, description, & narrative
Binary Preference (BPREF) 0.1524 using language models
Interploated Recall (%) Precision Averages (%)
GeoCLEF Bilingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 39.55 GEOBIESEN1
10 29.02 90%
20 22.66
80%
30 21.13
40 18.17 70%
50 16.27
60%
60 13.42
Precision
70 11.21 50%
80 8.54 40%
90 4.56
30%
100 1.43
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
15.94 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Bilingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7773
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0240
Third Quartile 0.2747
Interquartile range 0.2747 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.1594
GeoCLEF Bilingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2321 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.4457 10
Mean With No Outliers 0.1093
Std With No Outliers 0.1605 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries GEOBIESEN1
51-GC 69.48 64-GC 18.81 0.8
52-GC 0.16 65-GC 2.40
53-GC 7.36 66-GC 4.67
0.6
54-GC 0.00 67-GC 44.57
55-GC 0.00 68-GC 44.53
56-GC 1.39 69-GC 25.45 0.4
57-GC 0.00 70-GC 0.00
58-GC 11.71 71-GC 0.00 0.2
59-GC 0.00 72-GC 33.54
Difference
60-GC 77.73 73-GC 0.00 0
61-GC 12.75 74-GC 0.00
62-GC 0.00 75-GC 43.97
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
390
csusm 10.2415/GC-BILI-X2EN-CLEF2007.CSUSM.GEOBIESEN1 GC-BILI-X2EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Bilingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 24.00 GEOBIESEN1
10 docs 21.20 90%
15 docs 18.67
80%
20 docs 18.60
30 docs 17.20 70%
100 docs 10.12
60%
200 docs 6.42
Precision
500 docs 3.10 50%
1000 docs 1.74 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
16.38
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Bilingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.8000
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0000
Third Quartile 0.2598
Interquartile range 0.2598 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.1638
GeoCLEF Bilingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2321 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.6339 10
Mean With No Outliers 0.1373
Std With No Outliers 0.1946 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries GEOBIESEN1
51-GC 63.39 64-GC 23.53 0.8
52-GC 0.00 65-GC 7.53
53-GC 14.06 66-GC 0.00
0.6
54-GC 0.00 67-GC 35.29
55-GC 0.00 68-GC 55.73
56-GC 0.00 69-GC 33.33 0.4
57-GC 0.00 70-GC 0.00
58-GC 16.67 71-GC 0.00 0.2
59-GC 0.00 72-GC 21.43
Difference
60-GC 80.00 73-GC 0.00 0
61-GC 13.64 74-GC 0.00
62-GC 0.00 75-GC 45.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
391
csusm 10.2415/GC-BILI-X2EN-CLEF2007.CSUSM.GEOBIESEN2 GC-BILI-X2EN-CLEF2007
Overall statistics for 25 queries : Priority 2
Total number of documents over all queries Query Construction MANUAL
Retrieved 25,000 Source Language Spanish; Castilian
Relevant 650 Topic Fields title, description
Relevant retrieved 523 Pooled true
Geometric Mean Average Precision 0.0261 Spanish topic's title & description with relevance
Binary Preference (BPREF) 0.1873 feedback
Interploated Recall (%) Precision Averages (%)
GeoCLEF Bilingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 42.12 GEOBIESEN2
10 38.65 90%
20 29.41
80%
30 27.55
40 22.67 70%
50 20.85
60%
60 18.67
Precision
70 12.82 50%
80 9.01 40%
90 6.78
30%
100 4.62
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
19.62 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Bilingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7716
Minimum 0.0000
First Quartile 0.0113
Second Quartile 0.0858
Third Quartile 0.3863
Interquartile range 0.3750 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.1962
GeoCLEF Bilingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2316 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 8
Upper Outlier Threshold 0.7716
6
Mean With No Outliers 0.1962
4
Std With No Outliers 0.2316
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries GEOBIESEN2
51-GC 44.79 64-GC 1.38 0.8
52-GC 0.08 65-GC 8.74
53-GC 8.58 66-GC 11.75
0.6
54-GC 2.44 67-GC 39.18
55-GC 38.45 68-GC 58.49
56-GC 6.11 69-GC 16.62 0.4
57-GC 7.79 70-GC 0.38
58-GC 24.42 71-GC 0.00 0.2
59-GC 0.00 72-GC 42.80
Difference
60-GC 77.16 73-GC 0.15 0
61-GC 1.53 74-GC 59.90
62-GC 2.18 75-GC 37.56
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
392
csusm 10.2415/GC-BILI-X2EN-CLEF2007.CSUSM.GEOBIESEN2 GC-BILI-X2EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Bilingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 22.40 GEOBIESEN2
10 docs 22.00 90%
15 docs 21.07
80%
20 docs 20.00
30 docs 17.87 70%
100 docs 11.12
60%
200 docs 7.40
Precision
500 docs 3.60 50%
1000 docs 2.09 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
20.81
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Bilingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.6667
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.1333
Third Quartile 0.4085
Interquartile range 0.4085 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.2081
GeoCLEF Bilingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2529 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.6667 10
Mean With No Outliers 0.2081
Std With No Outliers 0.2529 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries GEOBIESEN2
51-GC 50.89 64-GC 0.00 0.8
52-GC 0.00 65-GC 15.05
53-GC 14.06 66-GC 0.00
0.6
54-GC 0.00 67-GC 29.41
55-GC 37.50 68-GC 57.25
56-GC 0.00 69-GC 33.33 0.4
57-GC 13.33 70-GC 0.00
58-GC 16.67 71-GC 0.00 0.2
59-GC 0.00 72-GC 64.29
Difference
60-GC 66.67 73-GC 0.00 0
61-GC 0.00 74-GC 66.67
62-GC 0.00 75-GC 55.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
393
csusm 10.2415/GC-BILI-X2EN-CLEF2007.CSUSM.GEOBIESEN3 GC-BILI-X2EN-CLEF2007
Overall statistics for 25 queries : Priority 3
Total number of documents over all queries Query Construction MANUAL
Retrieved 25,000 Source Language Spanish; Castilian
Relevant 650 Topic Fields title, description
Relevant retrieved 475 Pooled false
Geometric Mean Average Precision 0.0294 Spanish topics, English docs, title & description
Binary Preference (BPREF) 0.1851
Interploated Recall (%) Precision Averages (%)
GeoCLEF Bilingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 48.53 GEOBIESEN3
10 37.67 90%
20 28.99
80%
30 25.96
40 21.12 70%
50 18.88
60%
60 16.51
Precision
70 12.47 50%
80 7.37 40%
90 4.86
30%
100 1.80
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
18.66 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Bilingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7731
Minimum 0.0000
First Quartile 0.0178
Second Quartile 0.0858
Third Quartile 0.3304
Interquartile range 0.3126 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.1866
GeoCLEF Bilingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2204 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 8
Upper Outlier Threshold 0.7731
6
Mean With No Outliers 0.1866
4
Std With No Outliers 0.2204
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries GEOBIESEN3
51-GC 45.81 64-GC 3.20 0.8
52-GC 0.29 65-GC 5.23
53-GC 8.58 66-GC 14.45
0.6
54-GC 2.44 67-GC 38.68
55-GC 26.44 68-GC 50.14
56-GC 15.43 69-GC 16.62 0.4
57-GC 7.79 70-GC 0.58
58-GC 9.61 71-GC 0.00 0.2
59-GC 0.00 72-GC 44.50
Difference
60-GC 77.31 73-GC 0.15 0
61-GC 6.01 74-GC 59.90
62-GC 2.18 75-GC 31.16
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
394
csusm 10.2415/GC-BILI-X2EN-CLEF2007.CSUSM.GEOBIESEN3 GC-BILI-X2EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Bilingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 26.40 GEOBIESEN3
10 docs 23.60 90%
15 docs 19.20
80%
20 docs 18.20
30 docs 17.33 70%
100 docs 11.12
60%
200 docs 7.08
Precision
500 docs 3.39 50%
1000 docs 1.90 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
21.32
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Bilingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7667
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.1333
Third Quartile 0.3375
Interquartile range 0.3375 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.2132
GeoCLEF Bilingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2376 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 8
Upper Outlier Threshold 0.7667
6
Mean With No Outliers 0.2132
4
Std With No Outliers 0.2376
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries GEOBIESEN3
51-GC 56.25 64-GC 0.00 0.8
52-GC 0.00 65-GC 11.83
53-GC 14.06 66-GC 33.33
0.6
54-GC 0.00 67-GC 29.41
55-GC 18.75 68-GC 57.25
56-GC 12.50 69-GC 33.33 0.4
57-GC 13.33 70-GC 3.45
58-GC 16.67 71-GC 0.00 0.2
59-GC 0.00 72-GC 50.00
Difference
60-GC 76.67 73-GC 0.00 0
61-GC 4.55 74-GC 66.67
62-GC 0.00 75-GC 35.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
395
csusm 10.2415/GC-BILI-X2EN-CLEF2007.CSUSM.GEOBIESEN4 GC-BILI-X2EN-CLEF2007
Overall statistics for 25 queries : Priority 4
Total number of documents over all queries Query Construction MANUAL
Retrieved 25,000 Source Language Spanish; Castilian
Relevant 650 Topic Fields title, description
Relevant retrieved 436 Pooled false
Geometric Mean Average Precision 0.0028 Spanish topic's title, description, & narrative
Binary Preference (BPREF) 0.1524 using language models
Interploated Recall (%) Precision Averages (%)
GeoCLEF Bilingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 39.55 GEOBIESEN4
10 29.02 90%
20 22.66
80%
30 21.13
40 18.17 70%
50 16.27
60%
60 13.42
Precision
70 11.21 50%
80 8.54 40%
90 4.56
30%
100 1.43
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
15.94 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Bilingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7773
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0240
Third Quartile 0.2747
Interquartile range 0.2747 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.1594
GeoCLEF Bilingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2321 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.4457 10
Mean With No Outliers 0.1093
Std With No Outliers 0.1605 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries GEOBIESEN4
51-GC 69.48 64-GC 18.81 0.8
52-GC 0.16 65-GC 2.40
53-GC 7.36 66-GC 4.67
0.6
54-GC 0.00 67-GC 44.57
55-GC 0.00 68-GC 44.53
56-GC 1.39 69-GC 25.45 0.4
57-GC 0.00 70-GC 0.00
58-GC 11.71 71-GC 0.00 0.2
59-GC 0.00 72-GC 33.54
Difference
60-GC 77.73 73-GC 0.00 0
61-GC 12.75 74-GC 0.00
62-GC 0.00 75-GC 43.97
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
396
csusm 10.2415/GC-BILI-X2EN-CLEF2007.CSUSM.GEOBIESEN4 GC-BILI-X2EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Bilingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 24.00 GEOBIESEN4
10 docs 21.20 90%
15 docs 18.67
80%
20 docs 18.60
30 docs 17.20 70%
100 docs 10.12
60%
200 docs 6.42
Precision
500 docs 3.10 50%
1000 docs 1.74 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
16.38
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Bilingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.8000
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0000
Third Quartile 0.2598
Interquartile range 0.2598 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.1638
GeoCLEF Bilingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2321 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.6339 10
Mean With No Outliers 0.1373
Std With No Outliers 0.1946 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries GEOBIESEN4
51-GC 63.39 64-GC 23.53 0.8
52-GC 0.00 65-GC 7.53
53-GC 14.06 66-GC 0.00
0.6
54-GC 0.00 67-GC 35.29
55-GC 0.00 68-GC 55.73
56-GC 0.00 69-GC 33.33 0.4
57-GC 0.00 70-GC 0.00
58-GC 16.67 71-GC 0.00 0.2
59-GC 0.00 72-GC 21.43
Difference
60-GC 80.00 73-GC 0.00 0
61-GC 13.64 74-GC 0.00
62-GC 0.00 75-GC 45.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
397
depok 10.2415/GC-BILI-X2EN-CLEF2007.DEPOK.UIBITDGP GC-BILI-X2EN-CLEF2007
Overall statistics for 25 queries : Priority 1
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 24,999 Source Language Indonesian
Relevant 650 Topic Fields title, description
Relevant retrieved 544 Pooled true
Geometric Mean Average Precision 0.0269 Query translation using machine translation. query
Binary Preference (BPREF) 0.1921 expansion is done by georeference processing
Interploated Recall (%) Precision Averages (%)
GeoCLEF Bilingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 57.82 UIBITDGP
10 47.95 90%
20 37.80
80%
30 27.11
40 18.35 70%
50 15.93
60%
60 13.60
Precision
70 11.51 50%
80 9.31 40%
90 5.86
30%
100 2.50
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
20.96 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Bilingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7372
Minimum 0.0000
First Quartile 0.0102
Second Quartile 0.1904
Third Quartile 0.3584
Interquartile range 0.3482 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.2096
GeoCLEF Bilingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1997 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 8
Upper Outlier Threshold 0.7372
6
Mean With No Outliers 0.2096
4
Std With No Outliers 0.1997
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries UIBITDGP
51-GC 24.05 64-GC 0.12 0.8
52-GC 0.28 65-GC 39.64
53-GC 12.04 66-GC 19.04
0.6
54-GC 40.50 67-GC 34.58
55-GC 31.69 68-GC 73.72
56-GC 0.00 69-GC 23.50 0.4
57-GC 12.81 70-GC 22.96
58-GC 2.81 71-GC 0.00 0.2
59-GC 0.00 72-GC 49.29
Difference
60-GC 17.03 73-GC 1.26 0
61-GC 1.86 74-GC 41.92
62-GC 30.81 75-GC 43.97
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
398
depok 10.2415/GC-BILI-X2EN-CLEF2007.DEPOK.UIBITDGP GC-BILI-X2EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Bilingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 30.40 UIBITDGP
10 docs 25.60 90%
15 docs 22.67
80%
20 docs 20.60
30 docs 17.73 70%
100 docs 11.56
60%
200 docs 7.64
Precision
500 docs 3.96 50%
1000 docs 2.18 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
21.11
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Bilingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.6718
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.2031
Third Quartile 0.3371
Interquartile range 0.3371 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.2111
GeoCLEF Bilingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1889 8
Number of Topics of the Experiment
7
Lower Outlier Threshold 0.0000
6
Upper Outlier Threshold 0.6718 5
Mean With No Outliers 0.2111 4
3
Std With No Outliers 0.1889
2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries UIBITDGP
51-GC 34.82 64-GC 0.00 0.8
52-GC 0.00 65-GC 41.94
53-GC 20.31 66-GC 33.33
0.6
54-GC 42.86 67-GC 23.53
55-GC 31.25 68-GC 67.18
56-GC 0.00 69-GC 19.05 0.4
57-GC 13.33 70-GC 31.03
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 50.00
Difference
60-GC 16.67 73-GC 0.00 0
61-GC 9.09 74-GC 33.33
62-GC 25.00 75-GC 35.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
399
depok 10.2415/GC-BILI-X2EN-CLEF2007.DEPOK.UIBITDGPGEOFB GC-BILI-X2EN-CLEF2007
Overall statistics for 25 queries : Priority 3
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 24,999 Source Language Indonesian
Relevant 650 Topic Fields title, description
Relevant retrieved 556 Pooled false
Geometric Mean Average Precision 0.0287 (See overleaf for description)
Binary Preference (BPREF) 0.2009
Interploated Recall (%) Precision Averages (%)
GeoCLEF Bilingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 54.38 UIBITDGPGEOFB
10 47.73 90%
20 37.58
80%
30 28.54
40 19.12 70%
50 16.58
60%
60 14.08
Precision
70 11.88 50%
80 9.35 40%
90 6.17
30%
100 3.19
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
20.91 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Bilingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.6248
Minimum 0.0000
First Quartile 0.0076
Second Quartile 0.1700
Third Quartile 0.3288
Interquartile range 0.3212 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.2091
GeoCLEF Bilingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1954 8
Number of Topics of the Experiment
7
Lower Outlier Threshold 0.0000
6
Upper Outlier Threshold 0.6248 5
Mean With No Outliers 0.2091 4
3
Std With No Outliers 0.1954
2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries UIBITDGPGEOFB
51-GC 17.06 64-GC 0.72 0.8
52-GC 0.28 65-GC 31.42
53-GC 15.85 66-GC 36.51
0.6
54-GC 29.45 67-GC 41.67
55-GC 31.05 68-GC 56.65
56-GC 0.00 69-GC 17.00 0.4
57-GC 15.49 70-GC 31.67
58-GC 5.07 71-GC 0.00 0.2
59-GC 0.00 72-GC 62.48
Difference
60-GC 8.89 73-GC 1.93 0
61-GC 0.78 74-GC 50.69
62-GC 30.15 75-GC 37.82
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
400
depok 10.2415/GC-BILI-X2EN-CLEF2007.DEPOK.UIBITDGPGEOFB GC-BILI-X2EN-CLEF2007
Query translation using machine translation. query
expansion is done by georeference processing and
pseudo relevance feeddback on geo terms
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Bilingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 30.40 UIBITDGPGEOFB
10 docs 24.80 90%
15 docs 21.87
80%
20 docs 20.00
30 docs 16.40 70%
100 docs 10.80
60%
200 docs 7.28
Precision
500 docs 3.96 50%
1000 docs 2.22 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
20.75
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Bilingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.6429
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.2000
Third Quartile 0.3360
Interquartile range 0.3360 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.2075
GeoCLEF Bilingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1947 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 8
Upper Outlier Threshold 0.6429
6
Mean With No Outliers 0.2075
4
Std With No Outliers 0.1947
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries UIBITDGPGEOFB
51-GC 25.89 64-GC 0.00 0.8
52-GC 0.00 65-GC 34.41
53-GC 21.88 66-GC 33.33
0.6
54-GC 42.86 67-GC 41.18
55-GC 18.75 68-GC 59.54
56-GC 0.00 69-GC 19.05 0.4
57-GC 20.00 70-GC 31.03
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 64.29
Difference
60-GC 13.33 73-GC 0.00 0
61-GC 0.00 74-GC 33.33
62-GC 25.00 75-GC 35.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
401
depok 10.2415/GC-BILI-X2EN-CLEF2007.DEPOK.UIBITDGPPF5 GC-BILI-X2EN-CLEF2007
Overall statistics for 25 queries : Priority 2
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 24,999 Source Language Indonesian
Relevant 650 Topic Fields title, description
Relevant retrieved 541 Pooled true
Geometric Mean Average Precision 0.0201 (See overleaf for description)
Binary Preference (BPREF) 0.1780
Interploated Recall (%) Precision Averages (%)
GeoCLEF Bilingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 45.22 UIBITDGPPF5
10 37.44 90%
20 29.36
80%
30 24.54
40 21.10 70%
50 18.84
60%
60 17.04
Precision
70 13.38 50%
80 10.34 40%
90 6.73
30%
100 4.03
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
19.39 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Bilingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7773
Minimum 0.0000
First Quartile 0.0034
Second Quartile 0.1082
Third Quartile 0.3299
Interquartile range 0.3266 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.1939
GeoCLEF Bilingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2211 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 8
Upper Outlier Threshold 0.7773
6
Mean With No Outliers 0.1939
4
Std With No Outliers 0.2211
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries UIBITDGPPF5
51-GC 8.32 64-GC 1.00 0.8
52-GC 0.13 65-GC 33.70
53-GC 20.97 66-GC 9.85
0.6
54-GC 18.69 67-GC 37.87
55-GC 23.45 68-GC 69.82
56-GC 0.00 69-GC 32.76 0.4
57-GC 23.71 70-GC 15.73
58-GC 10.82 71-GC 0.00 0.2
59-GC 0.00 72-GC 49.10
Difference
60-GC 77.73 73-GC 0.03 0
61-GC 0.41 74-GC 7.20
62-GC 2.56 75-GC 40.80
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
402
depok 10.2415/GC-BILI-X2EN-CLEF2007.DEPOK.UIBITDGPPF5 GC-BILI-X2EN-CLEF2007
Query translation using machine translation. query
expansion is done by georeference processing and
common pseudo relevance Feedback
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Bilingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 27.20 UIBITDGPPF5
10 docs 25.60 90%
15 docs 24.53
80%
20 docs 22.40
30 docs 19.87 70%
100 docs 11.40
60%
200 docs 7.12
Precision
500 docs 3.78 50%
1000 docs 2.16 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
20.09
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Bilingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.6667
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.1667
Third Quartile 0.3177
Interquartile range 0.3177 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.2009
GeoCLEF Bilingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2206 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 8
Upper Outlier Threshold 0.6667
6
Mean With No Outliers 0.2009
4
Std With No Outliers 0.2206
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries UIBITDGPPF5
51-GC 9.82 64-GC 5.88 0.8
52-GC 0.00 65-GC 34.41
53-GC 29.69 66-GC 0.00
0.6
54-GC 28.57 67-GC 29.41
55-GC 31.25 68-GC 64.89
56-GC 0.00 69-GC 33.33 0.4
57-GC 26.67 70-GC 20.69
58-GC 16.67 71-GC 0.00 0.2
59-GC 0.00 72-GC 64.29
Difference
60-GC 66.67 73-GC 0.00 0
61-GC 0.00 74-GC 0.00
62-GC 0.00 75-GC 40.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
403
depok 10.2415/GC-BILI-X2EN-CLEF2007.DEPOK.UIBITGP GC-BILI-X2EN-CLEF2007
Overall statistics for 25 queries : Priority 4
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 24,999 Source Language Indonesian
Relevant 650 Topic Fields title
Relevant retrieved 539 Pooled false
Geometric Mean Average Precision 0.0198 Query translation using machine translation. query
Binary Preference (BPREF) 0.1716 expansion is done by georeference processing
Interploated Recall (%) Precision Averages (%)
GeoCLEF Bilingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 45.95 UIBITGP
10 36.94 90%
20 31.75
80%
30 22.62
40 18.78 70%
50 14.70
60%
60 12.92
Precision
70 10.15 50%
80 7.54 40%
90 5.96
30%
100 2.94
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
17.36 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Bilingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7626
Minimum 0.0000
First Quartile 0.0052
Second Quartile 0.1020
Third Quartile 0.3360
Interquartile range 0.3307 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.1736
GeoCLEF Bilingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2044 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.7626 10
Mean With No Outliers 0.1736
Std With No Outliers 0.2044 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries UIBITGP
51-GC 14.97 64-GC 0.54 0.8
52-GC 0.49 65-GC 43.25
53-GC 10.20 66-GC 1.35
0.6
54-GC 34.29 67-GC 26.56
55-GC 33.37 68-GC 76.26
56-GC 0.02 69-GC 0.88 0.4
57-GC 18.98 70-GC 34.80
58-GC 1.75 71-GC 0.00 0.2
59-GC 0.00 72-GC 30.50
Difference
60-GC 45.44 73-GC 0.07 0
61-GC 2.75 74-GC 1.85
62-GC 13.35 75-GC 42.29
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
404
depok 10.2415/GC-BILI-X2EN-CLEF2007.DEPOK.UIBITGP GC-BILI-X2EN-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Bilingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 28.80 UIBITGP
10 docs 22.00 90%
15 docs 20.53
80%
20 docs 19.20
30 docs 18.00 70%
100 docs 11.28
60%
200 docs 7.32
Precision
500 docs 3.80 50%
1000 docs 2.16 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
18.77
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Bilingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.6870
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.1875
Third Quartile 0.3206
Interquartile range 0.3206 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.1877
GeoCLEF Bilingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1964 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.6870 10
Mean With No Outliers 0.1877
Std With No Outliers 0.1964 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries UIBITGP
51-GC 23.21 64-GC 0.00 0.8
52-GC 0.00 65-GC 41.94
53-GC 18.75 66-GC 0.00
0.6
54-GC 42.86 67-GC 29.41
55-GC 31.25 68-GC 68.70
56-GC 0.00 69-GC 4.76 0.4
57-GC 20.00 70-GC 34.48
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 28.57
Difference
60-GC 46.67 73-GC 0.00 0
61-GC 13.64 74-GC 0.00
62-GC 25.00 75-GC 40.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
405
depok 10.2415/GC-BILI-X2EN-CLEF2007.DEPOK.UIBITGPGEOFB GC-BILI-X2EN-CLEF2007
Overall statistics for 25 queries : Priority 6
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language Indonesian
Relevant 650 Topic Fields title
Relevant retrieved 503 Pooled false
Geometric Mean Average Precision 0.0123 (See overleaf for description)
Binary Preference (BPREF) 0.1726
Interploated Recall (%) Precision Averages (%)
GeoCLEF Bilingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 43.35 UIBITGPGEOFB
10 33.67 90%
20 27.66
80%
30 16.62
40 13.43 70%
50 9.95
60%
60 7.59
Precision
70 6.40 50%
80 5.78 40%
90 3.58
30%
100 1.37
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
13.89 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Bilingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.4893
Minimum 0.0000
First Quartile 0.0052
Second Quartile 0.0585
Third Quartile 0.2823
Interquartile range 0.2771 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.1389
GeoCLEF Bilingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1574 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.4893 10
Mean With No Outliers 0.1389
Std With No Outliers 0.1574 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries UIBITGPGEOFB
51-GC 9.12 64-GC 1.38 0.8
52-GC 0.65 65-GC 23.27
53-GC 5.85 66-GC 0.55
0.6
54-GC 25.61 67-GC 30.37
55-GC 37.55 68-GC 34.70
56-GC 0.00 69-GC 0.51 0.4
57-GC 7.75 70-GC 34.54
58-GC 1.52 71-GC 0.00 0.2
59-GC 0.00 72-GC 30.92
Difference
60-GC 23.33 73-GC 0.00 0
61-GC 0.52 74-GC 2.76
62-GC 27.51 75-GC 48.93
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
406
depok 10.2415/GC-BILI-X2EN-CLEF2007.DEPOK.UIBITGPGEOFB GC-BILI-X2EN-CLEF2007
Query translation using machine translation. query
expansion is done by georeference processing and
pseudo relevance feeddback on geo terms
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Bilingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 26.40 UIBITGPGEOFB
10 docs 18.80 90%
15 docs 14.93
80%
20 docs 13.40
30 docs 12.00 70%
100 docs 7.32
60%
200 docs 5.76
Precision
500 docs 3.40 50%
1000 docs 2.01 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
14.83
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Bilingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.4500
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.1250
Third Quartile 0.2878
Interquartile range 0.2878 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.1483
GeoCLEF Bilingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1614 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.4500 10
Mean With No Outliers 0.1483
Std With No Outliers 0.1614 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries UIBITGPGEOFB
51-GC 18.75 64-GC 0.00 0.8
52-GC 0.00 65-GC 27.96
53-GC 12.50 66-GC 0.00
0.6
54-GC 42.86 67-GC 29.41
55-GC 31.25 68-GC 28.24
56-GC 0.00 69-GC 0.00 0.4
57-GC 13.33 70-GC 37.93
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 28.57
Difference
60-GC 30.00 73-GC 0.00 0
61-GC 0.00 74-GC 0.00
62-GC 25.00 75-GC 45.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
407
depok 10.2415/GC-BILI-X2EN-CLEF2007.DEPOK.UIBITGPPF5 GC-BILI-X2EN-CLEF2007
Overall statistics for 25 queries : Priority 5
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 24,999 Source Language Indonesian
Relevant 650 Topic Fields title
Relevant retrieved 581 Pooled false
Geometric Mean Average Precision 0.0201 (See overleaf for description)
Binary Preference (BPREF) 0.1896
Interploated Recall (%) Precision Averages (%)
GeoCLEF Bilingual English Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 41.55 UIBITGPPF5
10 34.89 90%
20 30.38
80%
30 24.57
40 20.28 70%
50 18.67
60%
60 16.97
Precision
70 14.29 50%
80 11.32 40%
90 7.30
30%
100 3.67
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
19.36 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Bilingual English Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.8046
Minimum 0.0000
First Quartile 0.0038
Second Quartile 0.0338
Third Quartile 0.3425
Interquartile range 0.3387 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.1936
GeoCLEF Bilingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2365 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.8046 10
Mean With No Outliers 0.1936
Std With No Outliers 0.2365 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual English Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries UIBITGPPF5
51-GC 37.05 64-GC 0.90 0.8
52-GC 0.16 65-GC 39.66
53-GC 21.68 66-GC 1.32
0.6
54-GC 22.02 67-GC 20.95
55-GC 27.80 68-GC 73.20
56-GC 0.04 69-GC 0.20 0.4
57-GC 27.11 70-GC 33.32
58-GC 2.60 71-GC 0.00 0.2
59-GC 0.00 72-GC 43.00
Difference
60-GC 80.46 73-GC 0.45 0
61-GC 1.49 74-GC 0.97
62-GC 3.38 75-GC 46.13
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
408
depok 10.2415/GC-BILI-X2EN-CLEF2007.DEPOK.UIBITGPPF5 GC-BILI-X2EN-CLEF2007
Query translation using machine translation. query
expansion is done by georeference processing and
common pseudo relevance Feedback
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Bilingual English Task − Retrieved documents vs Mean Precision
100%
5 docs 28.80 UIBITGPPF5
10 docs 26.00 90%
15 docs 23.20
80%
20 docs 22.40
30 docs 20.13 70%
100 docs 12.32
60%
200 docs 8.32
Precision
500 docs 4.09 50%
1000 docs 2.32 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
19.07
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Bilingual English Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7000
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0000
Third Quartile 0.3500
Interquartile range 0.3500 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.1907
GeoCLEF Bilingual English Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2315 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.7000 10
Mean With No Outliers 0.1907
Std With No Outliers 0.2315 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual English Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries UIBITGPPF5
51-GC 42.86 64-GC 0.00 0.8
52-GC 0.00 65-GC 36.56
53-GC 31.25 66-GC 0.00
0.6
54-GC 28.57 67-GC 17.65
55-GC 25.00 68-GC 68.70
56-GC 0.00 69-GC 0.00 0.4
57-GC 26.67 70-GC 34.48
58-GC 0.00 71-GC 0.00 0.2
59-GC 0.00 72-GC 50.00
Difference
60-GC 70.00 73-GC 0.00 0
61-GC 0.00 74-GC 0.00
62-GC 0.00 75-GC 45.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
409
cheshire 10.2415/GC-BILI-X2PT-CLEF2007.CHESHIRE.BERKBIDEPTBASE GC-BILI-X2PT-CLEF2007
Overall statistics for 25 queries : Priority 1
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language German
Relevant 762 Topic Fields title, description
Relevant retrieved 352 Pooled true
Geometric Mean Average Precision 0.0028 (See overleaf for description)
Binary Preference (BPREF) 0.0879
Interploated Recall (%) Precision Averages (%)
GeoCLEF Bilingual Portuguese Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 28.36 BERKBIDEPTBASE
10 20.71 90%
20 14.26
80%
30 11.76
40 11.03 70%
50 10.20
60%
60 8.46
Precision
70 6.63 50%
80 3.77 40%
90 1.66
30%
100 0.17
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
9.15 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Bilingual Portuguese Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.4039
Minimum 0.0000
First Quartile 0.0001
Second Quartile 0.0052
Third Quartile 0.1534
Interquartile range 0.1533 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.0915
GeoCLEF Bilingual Portuguese Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1450 20
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
15
Upper Outlier Threshold 0.3781
Mean With No Outliers 0.0647 10
Std With No Outliers 0.1166
5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual Portuguese Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries BERKBIDEPTBASE
51-GC 0.00 64-GC 0.00 0.8
52-GC 0.13 65-GC 0.00
53-GC 0.02 66-GC 0.00
0.6
54-GC 1.71 67-GC 25.81
55-GC 2.72 68-GC 0.52
56-GC 39.41 69-GC 29.36 0.4
57-GC 0.98 70-GC 0.01
58-GC 40.39 71-GC 11.85 0.2
59-GC 0.00 72-GC 0.20
Difference
60-GC 6.66 73-GC 0.01 0
61-GC 0.42 74-GC 28.15
62-GC 2.51 75-GC 37.81
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
410
cheshire 10.2415/GC-BILI-X2PT-CLEF2007.CHESHIRE.BERKBIDEPTBASE GC-BILI-X2PT-CLEF2007
Baseline German to Portuguese using Powertrans and
searching using TREC2 ranking with Blind Feedback
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Bilingual Portuguese Task − Retrieved documents vs Mean Precision
100%
5 docs 16.00 BERKBIDEPTBASE
10 docs 13.20 90%
15 docs 12.27
80%
20 docs 11.80
30 docs 10.67 70%
100 docs 5.80
60%
200 docs 3.96
Precision
500 docs 2.26 50%
1000 docs 1.41 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
10.79
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Bilingual Portuguese Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.6190
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0000
Third Quartile 0.2032
Interquartile range 0.2032 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.1079
GeoCLEF Bilingual Portuguese Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1805 20
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
15
Upper Outlier Threshold 0.5000
Mean With No Outliers 0.0866 10
Std With No Outliers 0.1489
5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual Portuguese Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries BERKBIDEPTBASE
51-GC 0.00 64-GC 0.00 0.8
52-GC 0.00 65-GC 0.00
53-GC 0.00 66-GC 0.00
0.6
54-GC 0.00 67-GC 21.33
55-GC 0.00 68-GC 1.25
56-GC 50.00 69-GC 20.00 0.4
57-GC 0.00 70-GC 0.00
58-GC 61.90 71-GC 21.29 0.2
59-GC 0.00 72-GC 0.00
Difference
60-GC 12.50 73-GC 0.00 0
61-GC 0.00 74-GC 38.71
62-GC 5.26 75-GC 37.50
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
411
cheshire 10.2415/GC-BILI-X2PT-CLEF2007.CHESHIRE.BERKBIENPTBASE GC-BILI-X2PT-CLEF2007
Overall statistics for 25 queries : Priority 2
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language English
Relevant 762 Topic Fields title, description
Relevant retrieved 402 Pooled true
Geometric Mean Average Precision 0.0275 (See overleaf for description)
Binary Preference (BPREF) 0.1844
Interploated Recall (%) Precision Averages (%)
GeoCLEF Bilingual Portuguese Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 48.81 BERKBIENPTBASE
10 35.23 90%
20 30.12
80%
30 27.62
40 23.92 70%
50 19.77
60%
60 18.12
Precision
70 13.94 50%
80 10.26 40%
90 7.34
30%
100 3.77
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
20.12 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Bilingual Portuguese Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7929
Minimum 0.0000
First Quartile 0.0047
Second Quartile 0.1039
Third Quartile 0.3878
Interquartile range 0.3831 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.2012
GeoCLEF Bilingual Portuguese Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2383 8
Number of Topics of the Experiment
7
Lower Outlier Threshold 0.0000
6
Upper Outlier Threshold 0.7929 5
Mean With No Outliers 0.2012 4
3
Std With No Outliers 0.2383
2
1
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual Portuguese Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries BERKBIENPTBASE
51-GC 0.00 64-GC 0.34 0.8
52-GC 0.04 65-GC 0.00
53-GC 4.58 66-GC 7.69
0.6
54-GC 17.59 67-GC 42.73
55-GC 9.44 68-GC 5.43
56-GC 57.59 69-GC 45.54 0.4
57-GC 13.39 70-GC 0.00
58-GC 37.47 71-GC 10.39 0.2
59-GC 6.67 72-GC 66.66
Difference
60-GC 79.29 73-GC 11.19 0
61-GC 0.52 74-GC 15.35
62-GC 17.20 75-GC 53.88
−0.2
63-GC 0.12
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
412
cheshire 10.2415/GC-BILI-X2PT-CLEF2007.CHESHIRE.BERKBIENPTBASE GC-BILI-X2PT-CLEF2007
Baseline English to Portuguese using Powertrans and
searching using TREC2 ranking with Blind Feedback
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Bilingual Portuguese Task − Retrieved documents vs Mean Precision
100%
5 docs 32.80 BERKBIENPTBASE
10 docs 25.60 90%
15 docs 22.67
80%
20 docs 21.60
30 docs 16.80 70%
100 docs 9.32
60%
200 docs 5.64
Precision
500 docs 2.85 50%
1000 docs 1.61 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
21.25
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Bilingual Portuguese Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7000
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.1667
Third Quartile 0.4172
Interquartile range 0.4172 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.2125
GeoCLEF Bilingual Portuguese Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2385 10
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000 8
Upper Outlier Threshold 0.7000
6
Mean With No Outliers 0.2125
4
Std With No Outliers 0.2385
2
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual Portuguese Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries BERKBIENPTBASE
51-GC 0.00 64-GC 0.00 0.8
52-GC 0.00 65-GC 0.00
53-GC 16.67 66-GC 7.69
0.6
54-GC 33.33 67-GC 49.33
55-GC 0.00 68-GC 8.75
56-GC 70.00 69-GC 40.00 0.4
57-GC 0.00 70-GC 0.00
58-GC 47.62 71-GC 21.94 0.2
59-GC 0.00 72-GC 65.91
Difference
60-GC 62.50 73-GC 16.67 0
61-GC 0.00 74-GC 17.74
62-GC 26.32 75-GC 46.88
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
413
cheshire 10.2415/GC-BILI-X2PT-CLEF2007.CHESHIRE.BERKBIESPTBASE GC-BILI-X2PT-CLEF2007
Overall statistics for 25 queries : Priority 3
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language Spanish; Castilian
Relevant 762 Topic Fields title, description
Relevant retrieved 465 Pooled true
Geometric Mean Average Precision 0.0214 (See overleaf for description)
Binary Preference (BPREF) 0.1866
Interploated Recall (%) Precision Averages (%)
GeoCLEF Bilingual Portuguese Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 46.74 BERKBIESPTBASE
10 33.40 90%
20 28.97
80%
30 27.20
40 25.39 70%
50 21.15
60%
60 17.12
Precision
70 12.18 50%
80 9.14 40%
90 5.09
30%
100 2.03
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
19.24 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Bilingual Portuguese Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.7575
Minimum 0.0000
First Quartile 0.0048
Second Quartile 0.0769
Third Quartile 0.3742
Interquartile range 0.3693 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.1924
GeoCLEF Bilingual Portuguese Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2373 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.7575 10
Mean With No Outliers 0.1924
Std With No Outliers 0.2373 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual Portuguese Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries BERKBIESPTBASE
51-GC 0.00 64-GC 0.08 0.8
52-GC 0.06 65-GC 0.00
53-GC 2.12 66-GC 7.69
0.6
54-GC 1.54 67-GC 45.43
55-GC 13.58 68-GC 38.55
56-GC 56.28 69-GC 36.95 0.4
57-GC 4.11 70-GC 0.00
58-GC 37.04 71-GC 62.72 0.2
59-GC 0.60 72-GC 2.81
Difference
60-GC 75.75 73-GC 1.71 0
61-GC 9.35 74-GC 15.36
62-GC 16.70 75-GC 52.59
−0.2
63-GC 0.12
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
414
cheshire 10.2415/GC-BILI-X2PT-CLEF2007.CHESHIRE.BERKBIESPTBASE GC-BILI-X2PT-CLEF2007
Baseline Spanish to Portuguese using Powertrans and
searching using TREC2 ranking with Blind Feedback
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Bilingual Portuguese Task − Retrieved documents vs Mean Precision
100%
5 docs 32.80 BERKBIESPTBASE
10 docs 28.00 90%
15 docs 24.27
80%
20 docs 21.60
30 docs 18.27 70%
100 docs 11.20
60%
200 docs 6.98
Precision
500 docs 3.32 50%
1000 docs 1.86 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
21.20
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Bilingual Portuguese Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.7000
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0833
Third Quartile 0.4547
Interquartile range 0.4547 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.2120
GeoCLEF Bilingual Portuguese Task − Distribution of the Topics of the Experiment
Standard Deviation 0.2404 15
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
Upper Outlier Threshold 0.7000 10
Mean With No Outliers 0.2120
Std With No Outliers 0.2404 5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual Portuguese Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries BERKBIESPTBASE
51-GC 0.00 64-GC 0.00 0.8
52-GC 0.00 65-GC 0.00
53-GC 0.00 66-GC 7.69
0.6
54-GC 0.00 67-GC 50.67
55-GC 20.00 68-GC 45.00
56-GC 70.00 69-GC 40.00 0.4
57-GC 0.00 70-GC 0.00
58-GC 47.62 71-GC 58.71 0.2
59-GC 0.00 72-GC 2.27
Difference
60-GC 62.50 73-GC 8.33 0
61-GC 23.08 74-GC 20.97
62-GC 26.32 75-GC 46.88
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
415
csusm 10.2415/GC-BILI-X2PT-CLEF2007.CSUSM.GEOBIESPT1 GC-BILI-X2PT-CLEF2007
Overall statistics for 25 queries : Priority 1
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language Spanish; Castilian
Relevant 762 Topic Fields title, description
Relevant retrieved 191 Pooled true
Geometric Mean Average Precision 0.0011 Spanish topics, English docs, title & description
Binary Preference (BPREF) 0.0408
Interploated Recall (%) Precision Averages (%)
GeoCLEF Bilingual Portuguese Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 10.74 GEOBIESPT1
10 10.02 90%
20 7.09
80%
30 6.64
40 6.49 70%
50 6.15
60%
60 4.64
Precision
70 3.85 50%
80 3.66 40%
90 3.04
30%
100 2.54
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
5.33 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Bilingual Portuguese Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.4837
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0020
Third Quartile 0.0220
Interquartile range 0.0220 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.0533
GeoCLEF Bilingual Portuguese Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1274 20
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
15
Upper Outlier Threshold 0.0523
Mean With No Outliers 0.0063 10
Std With No Outliers 0.0126
5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual Portuguese Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries GEOBIESPT1
51-GC 0.58 64-GC 0.00 0.8
52-GC 0.00 65-GC 0.03
53-GC 0.00 66-GC 6.10
0.6
54-GC 5.23 67-GC 27.99
55-GC 0.02 68-GC 0.00
56-GC 0.14 69-GC 0.00 0.4
57-GC 37.50 70-GC 2.12
58-GC 0.74 71-GC 2.43 0.2
59-GC 0.00 72-GC 0.20
Difference
60-GC 48.37 73-GC 0.18 0
61-GC 0.00 74-GC 0.22
62-GC 0.96 75-GC 0.00
−0.2
63-GC 0.35
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
416
csusm 10.2415/GC-BILI-X2PT-CLEF2007.CSUSM.GEOBIESPT1 GC-BILI-X2PT-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Bilingual Portuguese Task − Retrieved documents vs Mean Precision
100%
5 docs 3.20 GEOBIESPT1
10 docs 4.40 90%
15 docs 4.53
80%
20 docs 4.40
30 docs 4.00 70%
100 docs 3.04
60%
200 docs 2.18
Precision
500 docs 1.20 50%
1000 docs 0.76 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
6.56
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Bilingual Portuguese Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.5000
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0000
Third Quartile 0.0240
Interquartile range 0.0240 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.0656
GeoCLEF Bilingual Portuguese Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1521 20
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
15
Upper Outlier Threshold 0.0476
Mean With No Outliers 0.0032 10
Std With No Outliers 0.0111
5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual Portuguese Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries GEOBIESPT1
51-GC 0.00 64-GC 0.00 0.8
52-GC 0.00 65-GC 0.00
53-GC 0.00 66-GC 0.00
0.6
54-GC 0.00 67-GC 37.33
55-GC 0.00 68-GC 0.00
56-GC 0.00 69-GC 0.00 0.4
57-GC 50.00 70-GC 10.00
58-GC 4.76 71-GC 10.32 0.2
59-GC 0.00 72-GC 0.00
Difference
60-GC 50.00 73-GC 0.00 0
61-GC 0.00 74-GC 1.61
62-GC 0.00 75-GC 0.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
417
csusm 10.2415/GC-BILI-X2PT-CLEF2007.CSUSM.GEOBIESPT2 GC-BILI-X2PT-CLEF2007
Overall statistics for 25 queries : Priority 2
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language Spanish; Castilian
Relevant 762 Topic Fields title, description
Relevant retrieved 186 Pooled true
Geometric Mean Average Precision 0.0010 Spanish topic's title & description with relevance
Binary Preference (BPREF) 0.0407 feedback
Interploated Recall (%) Precision Averages (%)
GeoCLEF Bilingual Portuguese Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 10.70 GEOBIESPT2
10 10.02 90%
20 7.09
80%
30 6.64
40 6.49 70%
50 6.15
60%
60 4.64
Precision
70 3.85 50%
80 3.66 40%
90 3.04
30%
100 2.54
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
5.33 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Bilingual Portuguese Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.4837
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0020
Third Quartile 0.0220
Interquartile range 0.0220 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.0533
GeoCLEF Bilingual Portuguese Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1274 20
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
15
Upper Outlier Threshold 0.0523
Mean With No Outliers 0.0063 10
Std With No Outliers 0.0126
5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual Portuguese Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries GEOBIESPT2
51-GC 0.58 64-GC 0.00 0.8
52-GC 0.00 65-GC 0.00
53-GC 0.00 66-GC 6.10
0.6
54-GC 5.23 67-GC 27.99
55-GC 0.02 68-GC 0.00
56-GC 0.14 69-GC 0.00 0.4
57-GC 37.50 70-GC 2.12
58-GC 0.74 71-GC 2.43 0.2
59-GC 0.00 72-GC 0.20
Difference
60-GC 48.37 73-GC 0.18 0
61-GC 0.00 74-GC 0.22
62-GC 0.96 75-GC 0.00
−0.2
63-GC 0.35
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
418
csusm 10.2415/GC-BILI-X2PT-CLEF2007.CSUSM.GEOBIESPT2 GC-BILI-X2PT-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Bilingual Portuguese Task − Retrieved documents vs Mean Precision
100%
5 docs 3.20 GEOBIESPT2
10 docs 4.40 90%
15 docs 4.53
80%
20 docs 4.40
30 docs 4.00 70%
100 docs 3.04
60%
200 docs 2.16
Precision
500 docs 1.18 50%
1000 docs 0.74 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
6.56
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Bilingual Portuguese Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.5000
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0000
Third Quartile 0.0240
Interquartile range 0.0240 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.0656
GeoCLEF Bilingual Portuguese Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1521 20
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
15
Upper Outlier Threshold 0.0476
Mean With No Outliers 0.0032 10
Std With No Outliers 0.0111
5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual Portuguese Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries GEOBIESPT2
51-GC 0.00 64-GC 0.00 0.8
52-GC 0.00 65-GC 0.00
53-GC 0.00 66-GC 0.00
0.6
54-GC 0.00 67-GC 37.33
55-GC 0.00 68-GC 0.00
56-GC 0.00 69-GC 0.00 0.4
57-GC 50.00 70-GC 10.00
58-GC 4.76 71-GC 10.32 0.2
59-GC 0.00 72-GC 0.00
Difference
60-GC 50.00 73-GC 0.00 0
61-GC 0.00 74-GC 1.61
62-GC 0.00 75-GC 0.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
419
csusm 10.2415/GC-BILI-X2PT-CLEF2007.CSUSM.GEOBIESPT3 GC-BILI-X2PT-CLEF2007
Overall statistics for 25 queries : Priority 3
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language Spanish; Castilian
Relevant 762 Topic Fields title, description, narrative
Relevant retrieved 186 Pooled true
Geometric Mean Average Precision 0.0010 Spanish topic's title, description, & narrative
Binary Preference (BPREF) 0.0407
Interploated Recall (%) Precision Averages (%)
GeoCLEF Bilingual Portuguese Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 10.70 GEOBIESPT3
10 10.02 90%
20 7.09
80%
30 6.64
40 6.49 70%
50 6.15
60%
60 4.64
Precision
70 3.85 50%
80 3.66 40%
90 3.04
30%
100 2.54
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
5.33 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Bilingual Portuguese Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.4837
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0020
Third Quartile 0.0220
Interquartile range 0.0220 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.0533
GeoCLEF Bilingual Portuguese Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1274 20
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
15
Upper Outlier Threshold 0.0523
Mean With No Outliers 0.0063 10
Std With No Outliers 0.0126
5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual Portuguese Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries GEOBIESPT3
51-GC 0.58 64-GC 0.00 0.8
52-GC 0.00 65-GC 0.00
53-GC 0.00 66-GC 6.10
0.6
54-GC 5.23 67-GC 27.99
55-GC 0.02 68-GC 0.00
56-GC 0.14 69-GC 0.00 0.4
57-GC 37.50 70-GC 2.12
58-GC 0.74 71-GC 2.43 0.2
59-GC 0.00 72-GC 0.20
Difference
60-GC 48.37 73-GC 0.18 0
61-GC 0.00 74-GC 0.22
62-GC 0.96 75-GC 0.00
−0.2
63-GC 0.35
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
420
csusm 10.2415/GC-BILI-X2PT-CLEF2007.CSUSM.GEOBIESPT3 GC-BILI-X2PT-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Bilingual Portuguese Task − Retrieved documents vs Mean Precision
100%
5 docs 3.20 GEOBIESPT3
10 docs 4.40 90%
15 docs 4.53
80%
20 docs 4.40
30 docs 4.00 70%
100 docs 3.04
60%
200 docs 2.16
Precision
500 docs 1.18 50%
1000 docs 0.74 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
6.56
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Bilingual Portuguese Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.5000
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0000
Third Quartile 0.0240
Interquartile range 0.0240 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.0656
GeoCLEF Bilingual Portuguese Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1521 20
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
15
Upper Outlier Threshold 0.0476
Mean With No Outliers 0.0032 10
Std With No Outliers 0.0111
5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual Portuguese Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries GEOBIESPT3
51-GC 0.00 64-GC 0.00 0.8
52-GC 0.00 65-GC 0.00
53-GC 0.00 66-GC 0.00
0.6
54-GC 0.00 67-GC 37.33
55-GC 0.00 68-GC 0.00
56-GC 0.00 69-GC 0.00 0.4
57-GC 50.00 70-GC 10.00
58-GC 4.76 71-GC 10.32 0.2
59-GC 0.00 72-GC 0.00
Difference
60-GC 50.00 73-GC 0.00 0
61-GC 0.00 74-GC 1.61
62-GC 0.00 75-GC 0.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
421
csusm 10.2415/GC-BILI-X2PT-CLEF2007.CSUSM.GEOBIESPT4 GC-BILI-X2PT-CLEF2007
Overall statistics for 25 queries : Priority 4
Total number of documents over all queries Query Construction AUTOMATIC
Retrieved 25,000 Source Language Spanish; Castilian
Relevant 762 Topic Fields title, description, narrative
Relevant retrieved 191 Pooled true
Geometric Mean Average Precision 0.0011 Spanish topic's title, description, & narrative
Binary Preference (BPREF) 0.0408 with relevance feedback
Interploated Recall (%) Precision Averages (%)
GeoCLEF Bilingual Portuguese Task − Standard Recall Levels vs Mean Interpolated Precision
100%
0 10.74 GEOBIESPT4
10 10.02 90%
20 7.09
80%
30 6.64
40 6.49 70%
50 6.15
60%
60 4.64
Precision
70 3.85 50%
80 3.66 40%
90 3.04
30%
100 2.54
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
5.33 10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Recall
GeoCLEF Bilingual Portuguese Task − Box plot of the Topics of the Experiment
AVERAGE_PRECISION
Maximum 0.4837
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0020
Third Quartile 0.0220
Interquartile range 0.0220 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Mean 0.0533
GeoCLEF Bilingual Portuguese Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1274 20
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
15
Upper Outlier Threshold 0.0523
Mean With No Outliers 0.0063 10
Std With No Outliers 0.0126
5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Average Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual Portuguese Task − Comparison to Median Average Precision by Topic (Topics 51−GC to 75−GC)
queries GEOBIESPT4
51-GC 0.58 64-GC 0.00 0.8
52-GC 0.00 65-GC 0.03
53-GC 0.00 66-GC 6.10
0.6
54-GC 5.23 67-GC 27.99
55-GC 0.02 68-GC 0.00
56-GC 0.14 69-GC 0.00 0.4
57-GC 37.50 70-GC 2.12
58-GC 0.74 71-GC 2.43 0.2
59-GC 0.00 72-GC 0.20
Difference
60-GC 48.37 73-GC 0.18 0
61-GC 0.00 74-GC 0.22
62-GC 0.96 75-GC 0.00
−0.2
63-GC 0.35
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
422
csusm 10.2415/GC-BILI-X2PT-CLEF2007.CSUSM.GEOBIESPT4 GC-BILI-X2PT-CLEF2007
Docs Cutoff Levels Precision at DCL (%)
GeoCLEF Bilingual Portuguese Task − Retrieved documents vs Mean Precision
100%
5 docs 3.20 GEOBIESPT4
10 docs 4.40 90%
15 docs 4.53
80%
20 docs 4.40
30 docs 4.00 70%
100 docs 3.04
60%
200 docs 2.18
Precision
500 docs 1.20 50%
1000 docs 0.76 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
6.56
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
GeoCLEF Bilingual Portuguese Task − Box plot of the Topics of the Experiment
R_PRECISION
Maximum 0.5000
Minimum 0.0000
First Quartile 0.0000
Second Quartile 0.0000
Third Quartile 0.0240
Interquartile range 0.0240 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Mean 0.0656
GeoCLEF Bilingual Portuguese Task − Distribution of the Topics of the Experiment
Standard Deviation 0.1521 20
Number of Topics of the Experiment
Lower Outlier Threshold 0.0000
15
Upper Outlier Threshold 0.0476
Mean With No Outliers 0.0032 10
Std With No Outliers 0.0111
5
0
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
R−Precision
Precision averages (%) for individual 1
GeoCLEF Bilingual Portuguese Task − Comparison to Median R−Precision by Topic (Topics 51−GC to 75−GC)
queries GEOBIESPT4
51-GC 0.00 64-GC 0.00 0.8
52-GC 0.00 65-GC 0.00
53-GC 0.00 66-GC 0.00
0.6
54-GC 0.00 67-GC 37.33
55-GC 0.00 68-GC 0.00
56-GC 0.00 69-GC 0.00 0.4
57-GC 50.00 70-GC 10.00
58-GC 4.76 71-GC 10.32 0.2
59-GC 0.00 72-GC 0.00
Difference
60-GC 50.00 73-GC 0.00 0
61-GC 0.00 74-GC 1.61
62-GC 0.00 75-GC 0.00
−0.2
63-GC 0.00
−0.4
−0.6
−0.8
−1
51−GC 52−GC 53−GC 54−GC 55−GC 56−GC 57−GC 58−GC 59−GC 60−GC 61−GC 62−GC 63−GC 64−GC 65−GC 66−GC 67−GC 68−GC 69−GC 70−GC 71−GC 72−GC 73−GC 74−GC 75−GC
Topic Identifier
423