Appendix A
Results of the Core Tracks
and Domain-Specific Tracks
Prepared by:
Giorgio Maria Di Nunzio and Nicola Ferro
Department of Information Engineering
University of Padua
A.1
A.2
Introduction
A.3
A.4
Results for CLEF 2005 Core Tracks and Domain-Spicific Tracks
The following pages contain the results for all valid experiments for the Ad-hoc and Domain-specific tasks that were officially
submitted to the organizers of the CLEF 2005 campaign.
This document is divided in three main parts:
1. List of submitted runs
2. Overview graphs
3. Individual results
1. List of submitted runs
This section gives a listing of all runs and their characteristics:
Participant: the name of the participant responsible for run.
Country: country of participant.
Run Tag unique identifier for each experiment.
Task: track/task to which the experiment belongs.
Topic language: language of the topics used to create the experiment (ISO identifiers for language).
Query type: identifies the parts of the topics used to create the experiment (T = title, D = Description, N = Narrative).
Run Type: type of experiment (automatic/manual).
Pool: specifies if experiment was used for relevance assessment pooling.
2. Overview Graphs
For each track/task two front-back pages are produced to compare the top experiments. The first page shows the best entries
only for the mandatory title + description (TD) automatic run of at most top five paricipant. The second page shows the best
entries among all runs (T/TD/TDN, automatic/manual) submitted of at most top five participants.
The two pages contain the following information:
- Front
- Average precision vs Recall plot
- R-Precision vs number of retrieved documents plot
- Back
- Comparison to median plot
- A table with best/median/worst performance figures for each topic
3. Individual Results
This section provides the individual results for each official experiments. Each experiment is presented in one page containing a
set of tables and graphs:
- Overall statistics and info
- Interpolated recall vs Precision averages
- Document cutoff levels vs Precision at DCL
- Individual topic results
A.5
A.6
List of Submitted Runs
A.7
A.8
Participant Country Run Tag Task Topic Query Run Type Pool
Lang. Type
u.budapest Hungary qalltall AH-Monolingual-HU HU TD automatic yes
u.budapest Hungary qfirststemtall AH-Monolingual-HU HU TD automatic yes
u.budapest Hungary qfstfs AH-Monolingual-HU HU TD automatic yes
u.budapest Hungary qnostemtall AH-Monolingual-HU HU TD automatic no
u.budapest Hungary qnostemtfirsstem AH-Monolingual-HU HU TD automatic no
u.budapest Hungary qnostemtnostem AH-Monolingual-HU HU TD automatic yes
clips France CLIPS05DEFR AH-Bilingual-X2FR DE TDN automatic yes
clips France CLIPS05DEFR0 AH-Bilingual-X2FR DE TD automatic no
clips France CLIPS05EFR AH-Bilingual-X2FR ES TDN automatic no
clips France CLIPS05ESFR0 AH-Bilingual-X2FR ES TD automatic no
clips France CLIPS05FR0 AH-Monolingual-FR FR TD automatic no
clips France CLIPS05FR1 AH-Monolingual-FR FR TDN automatic yes
clips France CLIPS05FR2 AH-Monolingual-FR FR TDN automatic no
cmu USA HBC1000test AH-Merging EN TD automatic no
cmu USA HBC150test AH-Merging EN TD automatic no
cmu USA HBT150w05test AH-Merging EN TD automatic no
cmu USA HBT15w05test AH-Merging EN TD automatic no
cmu USA UNEC1000test AH-Merging EN TD automatic no
cmu USA UNEC150test AH-Merging EN TD automatic no
cmu USA UNET150w05test AH-Merging EN TD automatic no
cmu USA UNET15w05test AH-Merging EN TD automatic no
cmu USA adhocM3Trntest AH-2-years-on EN TD automatic no
cmu USA adhocM4Trntest AH-2-years-on EN TD automatic no
cmu USA adhocM5Trntest AH-2-years-on EN TD automatic no
cmu USA adhocM5w1test AH-2-years-on EN TD automatic no
miracle Spain BGHT AH-Monolingual-BG BG TD automatic no
miracle Spain ENMST AH-Bilingual-X2HU EN TD automatic no
miracle Spain ENMxNP01ST1 AH-Bilingual-X2HU EN TD automatic yes
miracle Spain ENSSR AH-Bilingual-X2PT EN TDN automatic no
miracle Spain ENSST AH-Bilingual-X2FR EN TD automatic no
miracle Spain ENSST AH-Bilingual-X2PT EN TD automatic no
miracle Spain ENSxNP01HR1 AH-Bilingual-X2FR EN TDN automatic no
miracle Spain ENSxNP01SR1 AH-Bilingual-X2FR EN TDN automatic no
miracle Spain ENSxNP01SR1 AH-Bilingual-X2PT EN TDN automatic yes
miracle Spain ENXHT AH-Bilingual-X2BG EN TD automatic yes
miracle Spain ENXST AH-Bilingual-X2BG EN TD automatic yes
miracle Spain ESASR AH-Bilingual-X2PT ES TDN automatic no
miracle Spain ESAST AH-Bilingual-X2PT ES TD automatic no
miracle Spain ESAxNP01SR1 AH-Bilingual-X2PT ES TDN automatic yes
miracle Spain ESSST AH-Bilingual-X2FR ES TD automatic no
miracle Spain ESSxNP01HR1 AH-Bilingual-X2FR ES TDN automatic no
miracle Spain ESSxNP01SR1 AH-Bilingual-X2FR ES TDN automatic yes
miracle Spain HUHT AH-Monolingual-HU HU TD automatic no
miracle Spain SR AH-Monolingual-PT PT TDN automatic yes
miracle Spain ST AH-Monolingual-BG BG TD automatic yes
miracle Spain ST AH-Monolingual-PT PT TD automatic no
miracle Spain aHRSR AH-Monolingual-FR FR TDN automatic no
miracle Spain aHRSRxNP01HR1 AH-Monolingual-FR FR TDN automatic yes
miracle Spain aHTST AH-Monolingual-FR FR TD automatic no
miracle Spain aHTSTxNP01ST1 AH-Monolingual-HU HU TD automatic yes
miracle Spain aSRr1SR AH-Monolingual-PT PT TDN automatic no
miracle Spain enml0XSRpHL AH-2-years-on EN TDN automatic no
miracle Spain enmlSTpH AH-2-years-on EN TD automatic no
miracle Spain enmlSTpHL AH-2-years-on EN TD automatic no
miracle Spain enmlXSRpA AH-2-years-on EN TDN automatic no
miracle Spain esml9XnteSRp AH-2-years-on ES TDN automatic no
A.9
Participant Country Run Tag Task Topic Query Run Type Pool
Lang. Type
miracle Spain esml9XstiSTp AH-2-years-on ES TD automatic no
miracle Spain frml9XntfSRp AH-2-years-on FR TDN automatic no
miracle Spain r1SR AH-Monolingual-BG BG TDN automatic yes
miracle Spain xNP01SR1 AH-Monolingual-PT PT TDN automatic no
miracle Spain xNP01ST1 AH-Monolingual-HU HU TD automatic yes
miracle Spain xNP01r1SR1 AH-Monolingual-FR FR TDN automatic no
dcu Ireland dcu.Prositqgm1 AH-Merging EN TD automatic no
dcu Ireland dcu.Prositqgm2 AH-Merging EN TD automatic no
dcu Ireland dcu.Prositqgp AH-Merging EN TD automatic no
dcu Ireland dcu.Prositqgt AH-Merging EN TD automatic no
dcu Ireland dcu.humm1 AH-Merging EN TD automatic no
dcu Ireland dcu.humm2 AH-Merging EN TD automatic no
dcu Ireland dcu.hump AH-Merging EN TD automatic no
dcu Ireland dcu.humt AH-Merging EN TD automatic no
cocri France RIMfuzzET020 AH-Monolingual-FR FR T manual no
cocri France RIMfuzzET050 AH-Monolingual-FR FR T manual no
cocri France RIMfuzzLemme050 AH-Monolingual-FR FR T manual yes
cocri France RIMfuzzLemme080 AH-Monolingual-FR FR T manual no
cocri France RIMfuzzTD050 AH-Monolingual-FR FR TD manual no
hummingbird Canada humBG05t AH-Monolingual-BG BG T automatic yes
hummingbird Canada humBG05td AH-Monolingual-BG BG TD automatic yes
hummingbird Canada humBG05tde AH-Monolingual-BG BG TD automatic yes
hummingbird Canada humFR05t AH-Monolingual-FR FR T automatic yes
hummingbird Canada humFR05td AH-Monolingual-FR FR TD automatic no
hummingbird Canada humFR05tde AH-Monolingual-FR FR TD automatic no
hummingbird Canada humHU05t AH-Monolingual-HU HU T automatic yes
hummingbird Canada humHU05td AH-Monolingual-HU HU TD automatic yes
hummingbird Canada humHU05tde AH-Monolingual-HU HU TD automatic yes
hummingbird Canada humPT05t AH-Monolingual-PT PT T automatic yes
hummingbird Canada humPT05td AH-Monolingual-PT PT TD automatic no
hummingbird Canada humPT05tde AH-Monolingual-PT PT TD automatic no
irit France CWNSE_T DS-Monolingual-EN EN T automatic yes
irit France CWNSE_TD DS-Monolingual-EN EN TD automatic yes
irit France CWN_T DS-Monolingual-EN EN T automatic yes
irit France CWN_TD DS-Monolingual-EN EN TD automatic yes
irit France C_T DS-Monolingual-EN EN T automatic yes
jhu/apl USA aplbienbga AH-Bilingual-X2BG EN TD automatic yes
jhu/apl USA aplbienbge AH-Bilingual-X2BG EN TD automatic yes
jhu/apl USA aplbienfrc AH-Bilingual-X2FR EN TD automatic yes
jhu/apl USA aplbienhua AH-Bilingual-X2HU EN TD automatic yes
jhu/apl USA aplbienhue AH-Bilingual-X2HU EN TD automatic no
jhu/apl USA aplbienptb AH-Bilingual-X2PT EN TD automatic yes
jhu/apl USA aplbiesptb AH-Bilingual-X2PT ES TD automatic no
jhu/apl USA aplbigrena AH-Bilingual-X2EN GR TD automatic yes
jhu/apl USA aplbihuena AH-Bilingual-X2EN HU TD automatic yes
jhu/apl USA aplbiidena AH-Bilingual-X2EN ID TD automatic yes
jhu/apl USA aplbiidend AH-Bilingual-X2EN ID TDN automatic no
jhu/apl USA aplmobgc AH-Monolingual-BG BG TD automatic yes
jhu/apl USA aplmobgd AH-Monolingual-BG BG TD automatic yes
jhu/apl USA aplmobge AH-Monolingual-BG BG TD automatic no
jhu/apl USA aplmofra AH-Monolingual-FR FR TD automatic yes
jhu/apl USA aplmofrb AH-Monolingual-FR FR TD automatic no
jhu/apl USA aplmofrc AH-Monolingual-FR FR TD automatic no
jhu/apl USA aplmofre AH-Monolingual-FR FR TD automatic no
jhu/apl USA aplmohuc AH-Monolingual-HU HU TD automatic yes
jhu/apl USA aplmohud AH-Monolingual-HU HU TD automatic yes
A.10
Participant Country Run Tag Task Topic Query Run Type Pool
Lang. Type
jhu/apl USA aplmohue AH-Monolingual-HU HU TD automatic no
jhu/apl USA aplmopta AH-Monolingual-PT PT TD automatic no
jhu/apl USA aplmoptc AH-Monolingual-PT PT TD automatic yes
jhu/apl USA aplmoptd AH-Monolingual-PT PT TD automatic no
jhu/apl USA aplmopte AH-Monolingual-PT PT TD automatic no
msu-nivc Russia cirGHLAru2en AH-Bilingual-X2EN RU TDN automatic yes
msu-nivc Russia cirGIRTen2en DS-Monolingual-EN EN TDN automatic yes
msu-nivc Russia cirGIRTru2en DS-Bilingual-X2EN RU TDN automatic yes
msu-nivc Russia cirRSSCen2ru DS-Bilingual-X2RU EN TDN automatic yes
msu-nivc Russia cirRSSCru2ru DS-Monolingual-RU RU TDN automatic yes
sics Sweden sics-fr-b AH-Monolingual-FR FR TD automatic yes
sics Sweden sics-fr-k AH-Monolingual-FR FR TD automatic no
sics Sweden sics-fr-van AH-Monolingual-FR FR TD automatic no
tlr USA tlrTDfr2pt3 AH-Bilingual-X2PT FR TD automatic no
tlr USA tlrTDfr2ptRFS1 AH-Bilingual-X2PT FR TD automatic yes
tlr USA tlrTDfr3 AH-Monolingual-FR FR TD automatic no
tlr USA tlrTDfrRFS1 AH-Monolingual-FR FR TD automatic yes
tlr USA tlrTDhuE AH-Monolingual-HU HU TD automatic yes
tlr USA tlrTDhuSC AH-Monolingual-HU HU TD automatic yes
tlr USA tlrTDpt3 AH-Monolingual-PT PT TD automatic no
tlr USA tlrTDptRF2 AH-Monolingual-PT PT TD automatic no
tlr USA tlrTDptRFS1 AH-Monolingual-PT PT TD automatic yes
alicante Spain IRn-bu-fexp AH-Monolingual-BG BG TD automatic yes
alicante Spain IRn-bu-vexp AH-Monolingual-BG BG TD automatic yes
alicante Spain IRn-bu-vnexp AH-Monolingual-BG BG TD automatic no
alicante Spain IRn-enfr-fexp AH-Bilingual-X2FR EN TD automatic no
alicante Spain IRn-enfr-vexp AH-Bilingual-X2FR EN TD automatic no
alicante Spain IRn-enfr-vnexp AH-Bilingual-X2FR EN TD automatic no
alicante Spain IRn-enpt-fexp AH-Bilingual-X2PT EN TD automatic no
alicante Spain IRn-enpt-fexpfl AH-Bilingual-X2PT EN TD automatic yes
alicante Spain IRn-enpt-vexp AH-Bilingual-X2PT EN TD automatic no
alicante Spain IRn-enpt-vnexp AH-Bilingual-X2PT EN TD automatic no
alicante Spain IRn-fr-fexp AH-Monolingual-FR FR TD automatic no
alicante Spain IRn-fr-vexp AH-Monolingual-FR FR TD automatic yes
alicante Spain IRn-fr-vnexp AH-Monolingual-FR FR TD automatic no
alicante Spain IRn-hu-fexp AH-Monolingual-HU HU TD automatic yes
alicante Spain IRn-hu-vexp AH-Monolingual-HU HU TD automatic yes
alicante Spain IRn-hu-vnexp AH-Monolingual-HU HU TD automatic no
alicante Spain IRn-pt-fexp AH-Monolingual-PT PT TD automatic no
alicante Spain IRn-pt-vexp AH-Monolingual-PT PT TD automatic yes
alicante Spain IRn-pt-vnexp AH-Monolingual-PT PT TD automatic no
ilps Netherlands UAmsMoHu1AnH AH-Monolingual-HU HU TD automatic yes
ilps Netherlands UAmsMoHu2AnG AH-Monolingual-HU HU TD automatic yes
ilps Netherlands UAmsMoHu3AnL AH-Monolingual-HU HU TD automatic no
ilps Netherlands UAmsMoHu4AnV AH-Monolingual-HU HU TD automatic no
berkeley USA BERK1BLDEEN01 DS-Bilingual-X2EN DE TD automatic yes
berkeley USA BERK1BLDERU01 DS-Bilingual-X2RU DE TD automatic yes
berkeley USA BERK1BLENDE01 DS-Bilingual-X2DE EN TD automatic yes
berkeley USA BERK1BLENRU01 DS-Bilingual-X2RU EN TD automatic yes
berkeley USA BERK1BLRUDE01 DS-Bilingual-X2DE RU TD automatic yes
berkeley USA BERK1BLRUEN01 DS-Bilingual-X2EN RU TD automatic yes
berkeley USA BERK1MLDE01 DS-Monolingual-DE DE TD automatic yes
berkeley USA BERK1MLEN01 DS-Monolingual-EN EN TD automatic yes
berkeley USA BERK1MLRU01 DS-Monolingual-RU RU TD automatic yes
berkeley USA BERK1MUDEALL01 DS-Multi DE TD automatic no
berkeley USA BERK1MUENALL01 DS-Multi EN TD automatic no
A.11
Participant Country Run Tag Task Topic Query Run Type Pool
Lang. Type
berkeley USA BERK1MURUALL01 DS-Multi RU TD automatic no
berkeley-2 USA BK2GBLEG1 DS-Bilingual-X2DE EN TD automatic yes
berkeley-2 USA BK2GBLEG2 DS-Bilingual-X2DE EN TD automatic yes
berkeley-2 USA BK2GBLEG3 DS-Bilingual-X2DE EN TD automatic yes
berkeley-2 USA BK2GBLEG4 DS-Bilingual-X2DE EN TD automatic yes
berkeley-2 USA BK2GBLER1 DS-Bilingual-X2RU EN TD automatic yes
berkeley-2 USA BK2GBLGE1 DS-Bilingual-X2EN DE TD automatic yes
berkeley-2 USA BK2GBLGE2 DS-Bilingual-X2EN DE TD automatic yes
berkeley-2 USA BK2GBLGE3 DS-Bilingual-X2EN DE TD automatic yes
berkeley-2 USA BK2GBLGR1 DS-Bilingual-X2RU DE TD automatic yes
berkeley-2 USA BK2GMLEE1 DS-Monolingual-EN EN TD automatic yes
berkeley-2 USA BK2GMLEE2 DS-Monolingual-EN EN TD automatic yes
berkeley-2 USA BK2GMLEE3 DS-Monolingual-EN EN TD automatic yes
berkeley-2 USA BK2GMLGG1 DS-Monolingual-DE DE TD automatic yes
berkeley-2 USA BK2GMLGG2 DS-Monolingual-DE DE TD automatic yes
berkeley-2 USA BK2GMLGG3 DS-Monolingual-DE DE TD automatic yes
berkeley-2 USA BK2GMLGG4 DS-Monolingual-DE DE TD automatic yes
berkeley-2 USA BK2GMLRU1 DS-Monolingual-RU RU TD automatic yes
berkeley-2 USA BK2GMLRU2 DS-Monolingual-RU RU TDN automatic yes
buffalo USA UBbi-en-pt-comb1 AH-Bilingual-X2PT EN TD automatic yes
buffalo USA UBbi-en-pt-comb2 AH-Bilingual-X2PT EN TD automatic no
buffalo USA UBbi-en-pt-t1 AH-Bilingual-X2PT EN TD automatic no
buffalo USA UBbi-en-pt-t2 AH-Bilingual-X2PT EN TD automatic no
buffalo USA UBmono-pt-comb1 AH-Monolingual-PT PT TD automatic no
buffalo USA UBmono-pt-rf1 AH-Monolingual-PT PT TD automatic yes
buffalo USA UBmono-pt-rf2 AH-Monolingual-PT PT TD automatic no
buffalo USA UBmono-pt-rf3 AH-Monolingual-PT PT TD automatic no
isi-unige Switzerland ADJUSTDU AH-2-years-on NL TDN manual no
isi-unige Switzerland ADJUSTEN AH-2-years-on EN TDN manual no
isi-unige Switzerland ADJUSTFR AH-2-years-on FR TDN manual no
isi-unige Switzerland ADJUSTSP AH-2-years-on ES TDN manual no
isi-unige Switzerland AUTOEN AH-2-years-on EN TD automatic no
isi-unige Switzerland FEEDBCKEN AH-2-years-on EN TDN manual no
u.glasgow UK glabgtdn AH-Monolingual-BG BG TDN automatic yes
u.glasgow UK glabgtdnqe AH-Monolingual-BG BG TDN automatic yes
u.glasgow UK glabgtdqe AH-Monolingual-BG BG TD automatic no
u.glasgow UK gladeentdn DS-Bilingual-X2EN DE TDN automatic yes
u.glasgow UK gladeentdnqe DS-Bilingual-X2EN DE TDN automatic yes
u.glasgow UK gladeentdqe DS-Bilingual-X2EN DE TD automatic yes
u.glasgow UK gladetdn DS-Monolingual-DE DE TDN automatic yes
u.glasgow UK gladetdqe DS-Monolingual-DE DE TD automatic yes
u.glasgow UK glaenbgtd AH-Bilingual-X2BG EN TD automatic yes
u.glasgow UK glaenbgtdn1 AH-Bilingual-X2BG EN TDN automatic yes
u.glasgow UK glaenbgtdn2 AH-Bilingual-X2BG EN TDN automatic yes
u.glasgow UK glaenbgtdnqe1 AH-Bilingual-X2BG EN TDN automatic no
u.glasgow UK glaenbgtdnqe2 AH-Bilingual-X2BG EN TDN automatic no
u.glasgow UK glaendetdn DS-Bilingual-X2DE EN TDN automatic yes
u.glasgow UK glaendetdnqe DS-Bilingual-X2DE EN TDN automatic yes
u.glasgow UK glaendetdqe DS-Bilingual-X2DE EN TD automatic yes
u.glasgow UK glaentd DS-Monolingual-EN EN TD automatic yes
u.glasgow UK glaentdnqe DS-Monolingual-EN EN TDN automatic yes
u.glasgow UK glaespttd AH-Bilingual-X2PT ES TD automatic yes
u.glasgow UK glaespttdn AH-Bilingual-X2PT ES TDN automatic yes
u.glasgow UK glaespttdnqe AH-Bilingual-X2PT ES TDN automatic no
u.glasgow UK glafrtdn AH-Monolingual-FR FR TDN automatic no
u.glasgow UK glafrtdqe1 AH-Monolingual-FR FR TD automatic yes
A.12
Participant Country Run Tag Task Topic Query Run Type Pool
Lang. Type
u.glasgow UK glafrtdqe2 AH-Monolingual-FR FR TD automatic no
u.glasgow UK glagrentdn AH-Bilingual-X2EN GR TDN automatic yes
u.glasgow UK glagrentdqe AH-Bilingual-X2EN GR TD automatic yes
u.glasgow UK glahutdn AH-Monolingual-HU HU TDN automatic yes
u.glasgow UK glahutdnqe AH-Monolingual-HU HU TDN automatic no
u.glasgow UK glahutdqe AH-Monolingual-HU HU TD automatic yes
u.glasgow UK glaitfrtd AH-Bilingual-X2FR IT TD automatic no
u.glasgow UK glaitfrtdn AH-Bilingual-X2FR IT TDN automatic yes
u.glasgow UK glaitfrtdnqe AH-Bilingual-X2FR IT TDN automatic no
u.glasgow UK glapttdn AH-Monolingual-PT PT TDN automatic yes
u.glasgow UK glapttdnqe AH-Monolingual-PT PT TDN automatic no
u.glasgow UK glapttdqe AH-Monolingual-PT PT TD automatic no
u.glasgow UK glaruentdn DS-Bilingual-X2EN RU TDN automatic yes
u.glasgow UK glaruentdnqe DS-Bilingual-X2EN RU TDN automatic yes
u.glasgow UK glaruentdqe DS-Bilingual-X2EN RU TD automatic yes
u.glasgow UK glaruentdqeD DS-Bilingual-X2EN RU TD automatic yes
u.glasgow UK glarutdqe DS-Monolingual-RU RU TD automatic yes
hagen Germany FUHegfyyn DS-Bilingual-X2DE EN TD automatic yes
hagen Germany FUHegpyyd DS-Bilingual-X2DE EN TD automatic yes
hagen Germany FUHegpyyn DS-Bilingual-X2DE EN TD automatic yes
hagen Germany FUHegsyyn DS-Bilingual-X2DE EN TD automatic yes
hagen Germany FUHegwyyn DS-Bilingual-X2DE EN TD automatic yes
hagen Germany FUHggynd DS-Monolingual-DE DE TD automatic yes
hagen Germany FUHggynn DS-Monolingual-DE DE TD automatic yes
hagen Germany FUHggyyd DS-Monolingual-DE DE TD automatic yes
hagen Germany FUHggyydbf DS-Monolingual-DE DE TD automatic yes
hagen Germany FUHggyyn DS-Monolingual-DE DE TD automatic yes
hildesheim Germany UHIBG1 AH-Monolingual-BG BG TD automatic yes
hildesheim Germany UHIBG2 AH-Monolingual-BG BG TD automatic yes
hildesheim Germany UHIENFR1 AH-Bilingual-X2FR EN TD automatic no
hildesheim Germany UHIENFR2 AH-Bilingual-X2FR EN TD automatic no
hildesheim Germany UHIFR1 AH-Monolingual-FR FR TD automatic yes
hildesheim Germany UHIFR2 AH-Monolingual-FR FR TD automatic no
hildesheim Germany UHIFR3 AH-Monolingual-FR FR TD automatic no
hildesheim Germany UHIFR4 AH-Monolingual-FR FR TD automatic no
hildesheim Germany UHIGIRT1 DS-Monolingual-DE DE TD automatic yes
hildesheim Germany UHIGIRT2 DS-Monolingual-DE DE TD automatic yes
hildesheim Germany UHIGIRT3 DS-Bilingual-X2DE EN TD automatic yes
hildesheim Germany UHIHU1 AH-Monolingual-HU HU TD automatic yes
hildesheim Germany UHIHU2 AH-Monolingual-HU HU TD automatic yes
hildesheim Germany UHIRUFR1 AH-Bilingual-X2FR RU TD automatic yes
depok Indonesia UI-DESC10 AH-Bilingual-X2EN ID D automatic yes
depok Indonesia UI-DESC20 AH-Bilingual-X2EN ID D automatic no
depok Indonesia UI-TD10 AH-Bilingual-X2EN ID TD automatic yes
depok Indonesia UI-TD20 AH-Bilingual-X2EN ID TD automatic no
depok Indonesia UI-TITLE10 AH-Bilingual-X2EN ID T automatic no
depok Indonesia UI-TITLE20 AH-Bilingual-X2EN ID T automatic yes
jaen Spain UJAMENEDF AH-Merging EN TD automatic no
jaen Spain UJAMENEDFRR AH-Merging EN TD automatic no
jaen Spain UJAMENEOK AH-Merging EN TD automatic no
jaen Spain UJAMENEOKRR AH-Merging EN TD automatic no
jaen Spain UJAPRFRSV2RR AH-2-years-on EN TD automatic no
jaen Spain UJARSV2 AH-2-years-on EN TD automatic no
jaen Spain UJARSV2RR AH-2-years-on EN TD automatic no
jaen Spain UJAUARSV2RR AH-2-years-on EN TD automatic no
xldb Portugal XLDBTumba01 AH-Monolingual-PT PT TDN manual yes
A.13
Participant Country Run Tag Task Topic Query Run Type Pool
Lang. Type
xldb Portugal XLDBTumba02 AH-Monolingual-PT PT TDN automatic no
xldb Portugal XLDBTumba03 AH-Bilingual-X2PT EN TDN automatic yes
xldb Portugal XLDBTumba04 AH-Bilingual-X2PT EN TDN automatic no
xldb Portugal XLDBTumba05 AH-Monolingual-PT PT TDN manual yes
xldb Portugal XLDBTumba06 AH-Monolingual-PT PT TDN automatic no
xldb Portugal XLDBTumba07 AH-Bilingual-X2PT EN TDN automatic no
xldb Portugal XLDBTumba08 AH-Bilingual-X2PT EN TDN automatic no
xldb Portugal XLDBTumba09 AH-Monolingual-PT PT TD automatic no
unine Switzerland UniNEbg1 AH-Monolingual-BG BG TD automatic yes
unine Switzerland UniNEbg2 AH-Monolingual-BG BG TD automatic yes
unine Switzerland UniNEbg3 AH-Monolingual-BG BG TD automatic no
unine Switzerland UniNEbibg1 AH-Bilingual-X2BG EN TD automatic yes
unine Switzerland UniNEbibg2 AH-Bilingual-X2BG EN TD automatic yes
unine Switzerland UniNEbibg3 AH-Bilingual-X2BG EN TD automatic no
unine Switzerland UniNEbifr1 AH-Bilingual-X2FR EN TD automatic yes
unine Switzerland UniNEbifr2 AH-Bilingual-X2FR EN TD automatic no
unine Switzerland UniNEbifr3 AH-Bilingual-X2FR EN TD automatic no
unine Switzerland UniNEbihu1 AH-Bilingual-X2HU EN TD automatic yes
unine Switzerland UniNEbihu2 AH-Bilingual-X2HU EN TD automatic no
unine Switzerland UniNEbihu3 AH-Bilingual-X2HU EN TD automatic no
unine Switzerland UniNEbipt1 AH-Bilingual-X2PT EN TD automatic yes
unine Switzerland UniNEbipt2 AH-Bilingual-X2PT EN TD automatic no
unine Switzerland UniNEbipt3 AH-Bilingual-X2PT EN TD automatic no
unine Switzerland UniNEfr1 AH-Monolingual-FR FR TD automatic yes
unine Switzerland UniNEfr2 AH-Monolingual-FR FR TD automatic no
unine Switzerland UniNEfr3 AH-Monolingual-FR FR TD automatic no
unine Switzerland UniNEgde1 DS-Monolingual-DE DE TD automatic yes
unine Switzerland UniNEgde2 DS-Monolingual-DE DE TD automatic yes
unine Switzerland UniNEgde3 DS-Monolingual-DE DE TD automatic yes
unine Switzerland UniNEgen1 DS-Monolingual-EN EN TD automatic yes
unine Switzerland UniNEgen2 DS-Monolingual-EN EN TD automatic yes
unine Switzerland UniNEgen3 DS-Monolingual-EN EN TD automatic yes
unine Switzerland UniNEgru1 DS-Monolingual-RU RU TD automatic yes
unine Switzerland UniNEgru2 DS-Monolingual-RU RU TD automatic yes
unine Switzerland UniNEgru3 DS-Monolingual-RU RU TD automatic yes
unine Switzerland UniNEhu1 AH-Monolingual-HU HU TD automatic yes
unine Switzerland UniNEhu2 AH-Monolingual-HU HU TD automatic yes
unine Switzerland UniNEhu3 AH-Monolingual-HU HU TD automatic no
unine Switzerland UniNEpt1 AH-Monolingual-PT PT TD automatic yes
unine Switzerland UniNEpt2 AH-Monolingual-PT PT TD automatic no
unine Switzerland UniNEpt3 AH-Monolingual-PT PT TD automatic no
dsv-stockholm Sweden ds-am-fr-da-l AH-Bilingual-X2FR AM TD automatic yes
dsv-stockholm Sweden ds-am-fr-da-s AH-Bilingual-X2FR AM TD automatic yes
dsv-stockholm Sweden ds-am-fr-nonda-l AH-Bilingual-X2FR AM TD automatic no
dsv-stockholm Sweden ds-am-fr-nonda-s AH-Bilingual-X2FR AM TD automatic no
u.surugadai Japan SrgdDT05 AH-Bilingual-X2FR DE TD automatic no
u.surugadai Japan SrgdMgE03 AH-Bilingual-X2FR DE TD automatic no
u.surugadai Japan SrgdMgG02 AH-Bilingual-X2FR DE TD automatic yes
u.surugadai Japan SrgdMono01 AH-Monolingual-FR FR TD automatic yes
u.surugadai Japan SrgdQT04 AH-Bilingual-X2FR DE TD automatic no
A.14
Overview Graphs
A.15
A.16
Ad-Hoc Overview Graphs AH-2-years-on
CLEF 2005 − Top 4 participants of Ad−Hoc Multilingual Multi−8 2−years−on − Interpolated Recall vs Average Precision
100%
cmu [Avg. Prec. 44.93%; Run adhocM5Trntest, TD Auto, Not Pooled]
jaen [Avg. Prec. 29.57%; Run UJAPRFRSV2RR, TD Auto, Not Pooled]
90% miracle [Avg. Prec. 26.06%; Run esml9XstiSTp, TD Auto, Not Pooled]
isi−unige [Avg. Prec. 10.33%; Run AUTOEN, TD Auto, Not Pooled]
80%
70%
Average Precision
60%
50%
40%
30%
20%
10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 − Top 4 participants of Ad−Hoc Multilingual Multi−8 2−years−on − Retrieved documents vs Precision
100%
cmu [Exact Prec. 46.55%, Run adhocM5Trntest, TD Auto, Not Pooled]
jaen [Exact Prec. 33.85%, Run UJAPRFRSV2RR, TD Auto, Not Pooled]
90% miracle [Exact Prec. 30.50%, Run esml9XstiSTp, TD Auto, Not Pooled]
isi−unige [Exact Prec. 16.29%, Run AUTOEN, TD Auto, Not Pooled]
80%
70%
60%
R−Precision
50%
40%
30%
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
A.17
Ad-Hoc Overview Graphs AH-2-years-on
CLEF 2005 − Top 4 participants of Ad−Hoc Multilingual Multi−8 2−years−on − Comparison to median by topic (topics 161 to 180)
1
cmu [Run adhocM5Trntest, TD Auto, Not Pooled]
jaen [Run UJAPRFRSV2RR, TD Auto, Not Pooled]
Difference (average precision)
miracle [Run esml9XstiSTp, TD Auto, Not Pooled]
0.5 isi−unige [Run AUTOEN, TD Auto, Not Pooled]
0
−0.5
−1
161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180
Topic Number
CLEF 2005 − Top 4 participants of Ad−Hoc Multilingual Multi−8 2−years−on − Comparison to median by topic (topics 181 to 200)
1
cmu [Run adhocM5Trntest, TD Auto, Not Pooled]
jaen [Run UJAPRFRSV2RR, TD Auto, Not Pooled]
Difference (average precision)
miracle [Run esml9XstiSTp, TD Auto, Not Pooled]
0.5 isi−unige [Run AUTOEN, TD Auto, Not Pooled]
0
−0.5
−1
181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200
Topic Number
# of Relevant Retrieved Docs @ 100 # of Relevant Retrieved Docs @ 1000 Average Precision %
Topic ID Best Median Worst Best Median Worst Best Median Worst
161 9 5 0 13 7 1 45.11 24.04 00.01
162 97 66 2 243 196 4 85.84 45.85 00.78
163 88 68 11 258 204 106 75.30 40.13 09.04
164 41 13 2 123 53 3 10.08 01.58 00.02
165 18 13 3 22 15 7 43.67 33.45 03.20
166 3 0 0 13 6 0 01.02 00.23 00.00
167 21 17 7 24 21 18 55.20 35.84 12.02
168 48 26 5 156 110 37 25.61 13.32 01.11
169 4 2 0 20 10 0 02.77 00.73 00.00
170 23 14 0 25 23 1 67.67 21.45 00.01
171 23 10 1 61 34 1 14.97 03.72 01.01
172 13 6 2 29 17 8 13.08 04.86 00.28
173 25 22 3 28 23 3 67.98 56.13 02.89
174 79 62 17 91 79 17 85.74 66.60 14.79
175 19 13 3 23 18 4 66.86 26.56 05.48
176 99 93 47 259 256 47 92.21 82.72 16.29
177 36 19 3 75 53 3 35.71 16.21 00.50
178 46 15 0 75 37 1 22.23 04.00 00.00
179 75 39 5 320 159 19 61.63 13.79 04.54
180 78 49 8 312 218 15 54.46 26.26 00.65
181 93 84 7 667 541 13 39.02 30.00 00.24
182 49 35 2 74 68 2 59.60 40.85 00.20
183 33 25 2 69 54 2 36.71 20.06 00.48
184 63 42 3 124 81 3 45.23 24.93 01.21
185 19 11 0 36 27 0 25.76 13.75 00.00
186 74 32 0 235 116 0 52.09 11.86 00.00
187 72 30 18 130 79 19 66.21 19.98 08.88
188 36 30 0 54 43 0 56.81 36.23 00.00
189 30 27 2 30 28 2 75.91 60.57 05.78
190 49 22 0 132 66 3 25.72 07.41 00.01
191 1 1 0 1 1 0 100.00 25.00 00.00
192 90 50 6 163 98 41 78.95 29.55 08.10
193 49 31 4 147 118 31 29.56 16.57 03.01
194 24 11 0 24 15 0 64.67 22.58 00.00
195 38 19 0 65 39 3 38.74 14.67 00.08
196 33 30 2 40 33 2 73.78 57.55 03.75
197 94 90 27 681 539 27 59.71 42.87 02.84
198 13 8 1 26 15 1 22.09 09.06 01.43
199 84 78 32 297 280 32 74.95 65.58 05.70
200 70 47 1 196 106 19 44.49 17.45 00.15
A.18
Ad-Hoc Overview Graphs AH-2-years-on
CLEF 2005 − Top 4 participants of Ad−Hoc Multilingual Multi−8 2−years−on − Interpolated Recall vs Average Precision
100%
cmu [Avg. Prec. 44.93%; Run adhocM5Trntest, TD Auto, Not Pooled]
miracle [Avg. Prec. 33.32%; Run frml9XntfSRp, TDN Auto, Not Pooled]
90% jaen [Avg. Prec. 29.57%; Run UJAPRFRSV2RR, TD Auto, Not Pooled]
isi−unige [Avg. Prec. 21.02%; Run FEEDBCKEN, TDN Manual, Not Pooled]
80%
70%
Average Precision
60%
50%
40%
30%
20%
10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 − Top 4 participants of Ad−Hoc Multilingual Multi−8 2−years−on − Retrieved documents vs Precision
100%
cmu [Exact Prec. 46.55%, Run adhocM5Trntest, TD Auto, Not Pooled]
miracle [Exact Prec. 37.99%, Run frml9XntfSRp, TDN Auto, Not Pooled]
90% jaen [Exact Prec. 33.85%, Run UJAPRFRSV2RR, TD Auto, Not Pooled]
isi−unige [Exact Prec. 27.41%, Run FEEDBCKEN, TDN Manual, Not Pooled]
80%
70%
60%
R−Precision
50%
40%
30%
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
A.19
Ad-Hoc Overview Graphs AH-2-years-on
CLEF 2005 − Top 4 participants of Ad−Hoc Multilingual Multi−8 2−years−on − Comparison to median by topic (topics 161 to 180)
1
cmu [Run adhocM5Trntest, TD Auto, Not Pooled]
miracle [Run frml9XntfSRp, TDN Auto, Not Pooled]
Difference (average precision)
jaen [Run UJAPRFRSV2RR, TD Auto, Not Pooled]
0.5 isi−unige [Run FEEDBCKEN, TDN Manual, Not Pooled]
0
−0.5
−1
161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180
Topic Number
CLEF 2005 − Top 4 participants of Ad−Hoc Multilingual Multi−8 2−years−on − Comparison to median by topic (topics 181 to 200)
1
cmu [Run adhocM5Trntest, TD Auto, Not Pooled]
miracle [Run frml9XntfSRp, TDN Auto, Not Pooled]
Difference (average precision)
jaen [Run UJAPRFRSV2RR, TD Auto, Not Pooled]
0.5 isi−unige [Run FEEDBCKEN, TDN Manual, Not Pooled]
0
−0.5
−1
181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200
Topic Number
A.20
Ad-Hoc Overview Graphs AH-Merging
CLEF 2005 − Top 3 participants of Ad−Hoc Multilingual Multi−8 Merging − Interpolated Recall vs Average Precision
100%
cmu [Avg. Prec. 41.19%; Run UNET150w05test, TD Auto]
dcu [Avg. Prec. 32.86%; Run dcu.Prositqgm2, TD Auto]
90% jaen [Avg. Prec. 30.37%; Run UJAMENEDFRR, TD Auto]
80%
70%
Average Precision
60%
50%
40%
30%
20%
10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 − Top 3 participants of Ad−Hoc Multilingual Multi−8 Merging − Retrieved documents vs Precision
100%
cmu [Exact Prec. 43.32%, Run UNET150w05test, TD Auto]
dcu [Exact Prec. 36.25%, Run dcu.Prositqgm2, TD Auto]
90% jaen [Exact Prec. 35.24%, Run UJAMENEDFRR, TD Auto]
80%
70%
60%
R−Precision
50%
40%
30%
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
A.21
Ad-Hoc Overview Graphs AH-Merging
CLEF 2005 − Top 3 participants of Ad−Hoc Multilingual Multi−8 Merging − Comparison to median by topic (topics 161 to 180)
1
cmu [Run UNET150w05test, TD Auto]
dcu [Run dcu.Prositqgm2, TD Auto]
Difference (average precision)
jaen [Run UJAMENEDFRR, TD Auto]
0.5
0
−0.5
−1
161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180
Topic Number
CLEF 2005 − Top 3 participants of Ad−Hoc Multilingual Multi−8 Merging − Comparison to median by topic (topics 181 to 200)
1
cmu [Run UNET150w05test, TD Auto]
dcu [Run dcu.Prositqgm2, TD Auto]
Difference (average precision)
jaen [Run UJAMENEDFRR, TD Auto]
0.5
0
−0.5
−1
181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200
Topic Number
# of Relevant Retrieved Docs @ 100 # of Relevant Retrieved Docs @ 1000 Average Precision %
Topic ID Best Median Worst Best Median Worst Best Median Worst
161 1 0 0 6 1 1 05.79 00.03 00.01
162 91 67 38 243 198 148 73.28 46.09 18.40
163 86 80 52 249 226 183 67.77 58.10 38.42
164 19 15 2 78 39 13 02.19 01.40 00.06
165 17 14 11 20 15 14 30.96 22.90 13.10
166 5 0 0 11 8 5 02.70 00.32 00.12
167 21 17 11 24 21 17 53.64 33.86 17.70
168 38 23 2 151 107 29 22.97 11.78 03.62
169 5 2 0 22 12 5 02.65 01.25 00.24
170 24 19 3 25 24 17 65.80 35.46 06.53
171 16 11 6 68 57 37 07.66 06.20 03.43
172 14 6 4 30 20 12 10.18 03.50 00.98
173 26 23 21 27 24 23 73.76 63.40 50.35
174 80 62 31 94 80 69 88.99 65.50 29.52
175 20 10 7 23 12 10 66.79 32.82 16.46
176 98 93 86 259 257 251 86.01 82.96 63.96
177 26 19 10 62 57 23 22.71 17.10 06.11
178 16 4 0 56 18 5 05.20 00.83 00.10
179 72 46 18 282 146 81 52.42 20.14 05.16
180 74 28 14 290 78 43 53.76 05.62 02.26
181 89 81 43 691 526 417 39.87 27.24 15.80
182 47 40 29 74 70 68 59.77 50.32 29.31
183 28 22 17 70 57 43 29.74 18.51 08.07
184 58 41 25 133 86 52 43.81 23.61 10.91
185 21 11 3 35 26 21 29.70 12.80 03.30
186 71 34 2 233 154 35 40.96 21.58 00.57
187 64 44 14 123 85 31 55.65 28.62 04.99
188 46 27 12 56 41 23 69.81 35.82 10.01
189 30 25 20 30 26 24 74.24 59.18 43.53
190 69 27 9 151 98 28 42.83 11.67 02.30
191 1 1 1 1 1 1 100.00 100.00 12.50
192 78 53 14 137 108 50 58.51 32.82 04.81
193 54 47 19 150 129 101 32.94 27.24 09.04
194 22 11 5 23 14 10 60.39 28.32 09.14
195 36 21 3 64 36 10 37.75 15.01 00.42
196 33 29 16 37 33 21 76.04 56.64 23.99
197 96 87 48 645 517 180 56.57 36.06 07.93
198 14 10 2 28 20 9 22.96 07.56 05.33
199 88 77 67 297 292 209 74.43 67.26 44.50
200 68 59 24 183 117 73 40.61 26.86 08.28
A.22
Ad-Hoc Overview Graphs AH-Merging
CLEF 2005 − Top 3 participants of Ad−Hoc Multilingual Multi−8 Merging − Interpolated Recall vs Average Precision
100%
cmu [Avg. Prec. 41.19%; Run UNET150w05test, TD Auto]
dcu [Avg. Prec. 32.86%; Run dcu.Prositqgm2, TD Auto]
90% jaen [Avg. Prec. 30.37%; Run UJAMENEDFRR, TD Auto]
80%
70%
Average Precision
60%
50%
40%
30%
20%
10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 − Top 3 participants of Ad−Hoc Multilingual Multi−8 Merging − Retrieved documents vs Precision
100%
cmu [Exact Prec. 43.32%, Run UNET150w05test, TD Auto]
dcu [Exact Prec. 36.25%, Run dcu.Prositqgm2, TD Auto]
90% jaen [Exact Prec. 35.24%, Run UJAMENEDFRR, TD Auto]
80%
70%
60%
R−Precision
50%
40%
30%
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
A.23
Ad-Hoc Overview Graphs AH-Merging
CLEF 2005 − Top 3 participants of Ad−Hoc Multilingual Multi−8 Merging − Comparison to median by topic (topics 161 to 180)
1
cmu [Run UNET150w05test, TD Auto]
dcu [Run dcu.Prositqgm2, TD Auto]
Difference (average precision)
jaen [Run UJAMENEDFRR, TD Auto]
0.5
0
−0.5
−1
161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180
Topic Number
CLEF 2005 − Top 3 participants of Ad−Hoc Multilingual Multi−8 Merging − Comparison to median by topic (topics 181 to 200)
1
cmu [Run UNET150w05test, TD Auto]
dcu [Run dcu.Prositqgm2, TD Auto]
Difference (average precision)
jaen [Run UJAMENEDFRR, TD Auto]
0.5
0
−0.5
−1
181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200
Topic Number
A.24
Ad-Hoc Overview Graphs AH-Bilingual-X2BG
CLEF 2005 − Top 4 participants of Ad−Hoc Bilingual X2BG − Interpolated Recall vs Average Precision
100%
miracle [Avg. Prec. 23.55%; Run ENXST, TD Auto, Pooled]
unine [Avg. Prec. 13.99%; Run UniNEbibg3, TD Auto, Not Pooled]
90% u.glasgow [Avg. Prec. 12.04%; Run glaenbgtd, TD Auto, Pooled]
jhu−apl [Avg. Prec. 9.59%; Run aplbienbge, TD Auto, Pooled]
80%
70%
Average Precision
60%
50%
40%
30%
20%
10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 − Top 4 participants of Ad−Hoc Bilingual X2BG − Retrieved documents vs Precision
100%
miracle [Exact Prec. 23.38%, Run ENXST, TD Auto, Pooled]
unine [Exact Prec. 14.30%, Run UniNEbibg3, TD Auto, Not Pooled]
90% u.glasgow [Exact Prec. 13.36%, Run glaenbgtd, TD Auto, Pooled]
jhu−apl [Exact Prec. 9.93%, Run aplbienbge, TD Auto, Pooled]
80%
70%
60%
R−Precision
50%
40%
30%
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
A.25
Ad-Hoc Overview Graphs AH-Bilingual-X2BG
CLEF 2005 − Top 4 participants of Ad−Hoc Bilingual X2BG − Comparison to median by topic (topics 251 to 275)
1
miracle [Run ENXST, TD Auto, Pooled]
unine [Run UniNEbibg3, TD Auto, Not Pooled]
Difference (average precision)
u.glasgow [Run glaenbgtd, TD Auto, Pooled]
0.5 jhu−apl [Run aplbienbge, TD Auto, Pooled]
0
−0.5
−1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic Number
CLEF 2005 − Top 4 participants of Ad−Hoc Bilingual X2BG − Comparison to median by topic (topics 276 to 300)
1
miracle [Run ENXST, TD Auto, Pooled]
unine [Run UniNEbibg3, TD Auto, Not Pooled]
Difference (average precision)
u.glasgow [Run glaenbgtd, TD Auto, Pooled]
0.5 jhu−apl [Run aplbienbge, TD Auto, Pooled]
0
−0.5
−1
276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
# of Relevant Retrieved Docs @ 100 # of Relevant Retrieved Docs @ 1000 Average Precision %
Topic ID Best Median Worst Best Median Worst Best Median Worst
251 23 6 4 37 16 11 32.28 09.13 02.09
252 7 4 1 9 8 4 17.68 05.78 00.48
253 17 13 4 23 18 16 31.45 19.00 07.16
254 38 31 14 50 47 37 44.95 30.31 11.89
255 2 1 0 3 2 1 33.51 01.46 00.17
256 2 1 1 2 2 2 51.59 04.07 00.79
257 8 5 0 12 10 6 32.41 18.68 00.38
258 1 0 0 1 0 0 20.00 00.06 00.00
259 7 6 0 7 6 2 80.75 69.08 00.13
260 11 5 0 13 11 0 29.61 08.21 00.00
261 12 9 0 18 14 9 31.83 19.18 00.41
262 29 3 0 35 12 5 49.01 04.78 00.09
263 31 5 0 44 31 8 40.93 02.10 00.89
264 8 7 4 10 8 7 21.09 11.04 04.12
265 7 2 0 13 5 1 16.61 00.80 00.02
266 8 6 0 13 7 0 20.80 05.56 00.00
267 13 7 0 21 20 0 13.63 07.03 00.00
268 14 9 0 14 11 4 51.38 37.58 00.27
269 4 0 0 4 2 0 31.68 00.46 00.00
270 4 2 1 5 3 2 36.28 10.88 00.74
271 2 0 0 2 1 0 06.97 00.22 00.00
272 1 0 0 1 0 0 03.23 00.00 00.00
273 19 10 0 39 34 1 22.81 11.69 00.01
274 3 3 1 4 4 3 25.94 04.71 01.84
275 9 5 1 10 7 4 29.38 12.61 00.89
276 6 2 1 8 7 4 10.02 01.90 00.46
277 10 5 0 10 6 1 53.63 06.50 00.01
278 5 2 0 9 5 0 13.69 01.03 00.00
279 6 6 0 6 6 6 94.44 37.54 02.05
280 5 2 0 8 8 0 14.37 03.46 00.00
281 7 6 1 7 7 4 40.41 23.06 01.42
282 5 3 0 7 5 1 18.09 03.02 00.01
283 18 16 0 18 17 0 76.27 60.68 00.00
284 3 3 1 3 3 3 20.48 05.73 02.47
285 3 0 0 3 0 0 43.06 00.00 00.00
286 3 1 0 16 12 9 01.60 00.92 00.52
287 21 19 11 35 33 28 26.77 19.99 10.23
288 4 2 0 13 8 1 03.04 01.29 00.01
289 2 2 0 2 2 0 56.67 20.02 00.00
290 22 2 0 23 9 0 77.11 02.34 00.00
291 38 27 16 54 48 39 43.03 26.31 15.40
292 0 0 0 0 0 0 00.00 00.00 00.00
293 4 4 1 4 4 4 63.84 32.30 01.99
294 40 32 23 47 43 33 72.61 52.16 33.32
295 51 37 2 63 47 15 57.30 35.36 00.83
296 1 0 0 1 0 0 01.61 00.00 00.00
297 5 3 0 5 5 2 41.44 06.24 00.10
298 2 0 0 2 1 0 51.47 00.11 00.00
299 3 2 0 5 4 0 18.89 01.93 00.00
300 6 4 2 7 5 3 52.98 05.38 02.21
A.26
Ad-Hoc Overview Graphs AH-Bilingual-X2BG
CLEF 2005 − Top 4 participants of Ad−Hoc Bilingual X2BG − Interpolated Recall vs Average Precision
100%
miracle [Avg. Prec. 23.55%; Run ENXST, TD Auto, Pooled]
u.glasgow [Avg. Prec. 17.99%; Run glaenbgtdnqe1, TDN Auto, Not Pooled]
90% unine [Avg. Prec. 13.99%; Run UniNEbibg3, TD Auto, Not Pooled]
jhu−apl [Avg. Prec. 9.59%; Run aplbienbge, TD Auto, Pooled]
80%
70%
Average Precision
60%
50%
40%
30%
20%
10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 − Top 4 participants of Ad−Hoc Bilingual X2BG − Retrieved documents vs Precision
100%
miracle [Exact Prec. 23.38%, Run ENXST, TD Auto, Pooled]
u.glasgow [Exact Prec. 17.10%, Run glaenbgtdnqe1, TDN Auto, Not Pooled]
90% unine [Exact Prec. 14.30%, Run UniNEbibg3, TD Auto, Not Pooled]
jhu−apl [Exact Prec. 9.93%, Run aplbienbge, TD Auto, Pooled]
80%
70%
60%
R−Precision
50%
40%
30%
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
A.27
Ad-Hoc Overview Graphs AH-Bilingual-X2BG
CLEF 2005 − Top 4 participants of Ad−Hoc Bilingual X2BG − Comparison to median by topic (topics 251 to 275)
1
miracle [Run ENXST, TD Auto, Pooled]
u.glasgow [Run glaenbgtdnqe1, TDN Auto, Not Pooled]
Difference (average precision)
unine [Run UniNEbibg3, TD Auto, Not Pooled]
0.5 jhu−apl [Run aplbienbge, TD Auto, Pooled]
0
−0.5
−1
251252253254255256257258259260261262263264265266267268269270271272273274275
Topic Number
CLEF 2005 − Top 4 participants of Ad−Hoc Bilingual X2BG − Comparison to median by topic (topics 276 to 300)
1
miracle [Run ENXST, TD Auto, Pooled]
u.glasgow [Run glaenbgtdnqe1, TDN Auto, Not Pooled]
Difference (average precision)
unine [Run UniNEbibg3, TD Auto, Not Pooled]
0.5 jhu−apl [Run aplbienbge, TD Auto, Pooled]
0
−0.5
−1
276277278279280281282283284285286287288289290291292293294295296297298299300
Topic Number
A.28
Ad-Hoc Overview Graphs AH-Bilingual-X2EN
CLEF 2005 − Top 3 participants of Ad−Hoc Bilingual X2EN (only newcomers) − Interpolated Recall vs Average Precision
100%
jhu−apl [Avg. Prec. 33.13%; Run aplbiidena, TD Auto, Pooled]
u.glasgow [Avg. Prec. 29.35%; Run glagrentdqe, TD Auto, Pooled]
90% depok [Avg. Prec. 12.85%; Run UI−TD10, TD Auto, Pooled]
80%
70%
Average Precision
60%
50%
40%
30%
20%
10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 − Top 3 participants of Ad−Hoc Bilingual X2EN (only newcomers) − Retrieved documents vs Precision
100%
jhu−apl [Exact Prec. 34.15%, Run aplbiidena, TD Auto, Pooled]
u.glasgow [Exact Prec. 30.66%, Run glagrentdqe, TD Auto, Pooled]
90% depok [Exact Prec. 14.43%, Run UI−TD10, TD Auto, Pooled]
80%
70%
60%
R−Precision
50%
40%
30%
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
A.29
Ad-Hoc Overview Graphs AH-Bilingual-X2EN
CLEF 2005 − Top 3 participants of Ad−Hoc Bilingual X2EN (only newcomers) − Comparison to median by topic (topics 251 to 275)
1
jhu−apl [Run aplbiidena, TD Auto, Pooled]
u.glasgow [Run glagrentdqe, TD Auto, Pooled]
Difference (average precision)
depok [Run UI−TD10, TD Auto, Pooled]
0.5
0
−0.5
−1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic Number
CLEF 2005 − Top 3 participants of Ad−Hoc Bilingual X2EN (only newcomers) − Comparison to median by topic (topics 276 to 300)
1
jhu−apl [Run aplbiidena, TD Auto, Pooled]
u.glasgow [Run glagrentdqe, TD Auto, Pooled]
Difference (average precision)
depok [Run UI−TD10, TD Auto, Pooled]
0.5
0
−0.5
−1
276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
# of Relevant Retrieved Docs @ 100 # of Relevant Retrieved Docs @ 1000 Average Precision %
Topic ID Best Median Worst Best Median Worst Best Median Worst
251 41 21 1 55 36 6 56.83 24.19 00.43
252 22 5 0 29 19 2 54.12 04.08 00.01
253 65 22 13 165 66 46 38.12 08.20 02.76
254 63 37 13 192 148 73 36.90 18.97 07.25
255 4 4 1 4 4 4 60.71 13.21 01.07
256 34 32 18 34 34 19 93.62 85.93 47.07
257 37 15 0 63 55 17 37.57 11.23 00.37
258 4 0 0 4 1 0 14.37 00.23 00.00
259 2 0 0 3 2 0 41.93 00.74 00.00
260 54 15 0 62 45 6 68.59 12.06 00.05
261 23 0 0 30 7 1 27.92 00.43 00.00
262 35 5 0 50 36 9 14.08 03.20 00.12
263 24 0 0 46 12 0 20.62 00.27 00.00
264 19 11 2 22 21 10 70.55 12.19 01.16
265 6 6 0 6 6 4 51.16 22.58 00.44
266 3 0 0 4 0 0 05.69 00.00 00.00
267 13 9 5 21 16 12 33.20 21.20 05.33
268 3 3 2 3 3 2 71.93 57.09 25.08
269 8 3 0 9 7 0 26.70 04.73 00.00
270 49 37 21 57 54 47 70.00 48.45 19.62
271 19 15 0 24 22 1 57.91 27.56 00.01
272 14 9 0 14 13 3 34.35 11.26 00.06
273 71 25 0 83 69 18 87.75 19.92 00.69
274 14 1 0 16 8 0 46.56 00.44 00.00
275 41 30 8 65 63 39 44.88 30.34 08.32
276 47 16 0 59 44 4 59.67 10.95 00.02
277 24 12 0 24 19 2 36.78 13.90 00.03
278 14 2 0 20 11 1 24.26 02.08 00.01
279 4 2 0 4 4 2 43.41 05.04 00.15
280 8 4 0 20 9 1 10.88 01.18 00.00
281 30 15 8 42 40 29 40.01 15.73 09.15
282 25 3 0 31 14 1 38.99 01.92 00.03
283 36 6 0 38 21 10 63.65 10.61 00.31
284 35 12 0 38 30 1 51.52 08.02 00.00
285 62 35 3 69 68 8 85.64 38.92 00.42
286 2 0 0 7 3 0 01.03 00.15 00.00
287 36 9 1 49 20 10 47.31 10.04 00.37
288 40 28 18 72 60 40 51.24 24.72 11.27
289 18 17 0 18 17 5 78.82 41.29 00.69
290 29 11 1 49 36 26 35.51 07.56 01.65
291 24 4 1 29 21 7 55.89 02.08 00.27
292 4 4 0 4 4 0 88.75 16.89 00.00
293 32 21 0 34 33 0 69.85 27.79 00.00
294 25 20 1 27 24 8 66.90 30.72 00.38
295 26 0 0 50 7 0 26.50 00.11 00.00
296 24 9 0 24 15 0 62.00 10.37 00.00
297 11 5 0 12 8 4 65.02 03.72 00.46
298 20 15 0 30 27 9 27.66 18.50 00.33
299 32 20 1 76 68 13 38.58 21.09 00.24
300 21 1 0 42 1 0 17.45 00.03 00.00
A.30
Ad-Hoc Overview Graphs AH-Bilingual-X2EN
CLEF 2005 − Top 4 participants of Ad−Hoc Bilingual X2EN (only newcomers) − Interpolated Recall vs Average Precision
100%
jhu−apl [Avg. Prec. 37.28%; Run aplbiidend, TDN Auto, Not Pooled]
u.glasgow [Avg. Prec. 29.35%; Run glagrentdqe, TD Auto, Pooled]
90% msu−nivc [Avg. Prec. 22.82%; Run cirGHLAru2en, TDN Auto, Pooled]
depok [Avg. Prec. 12.85%; Run UI−TD10, TD Auto, Pooled]
80%
70%
Average Precision
60%
50%
40%
30%
20%
10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 − Top 4 participants of Ad−Hoc Bilingual X2EN (only newcomers) − Retrieved documents vs Precision
100%
jhu−apl [Exact Prec. 35.47%, Run aplbiidend, TDN Auto, Not Pooled]
u.glasgow [Exact Prec. 30.66%, Run glagrentdqe, TD Auto, Pooled]
90% msu−nivc [Exact Prec. 26.05%, Run cirGHLAru2en, TDN Auto, Pooled]
depok [Exact Prec. 14.43%, Run UI−TD10, TD Auto, Pooled]
80%
70%
60%
R−Precision
50%
40%
30%
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
A.31
Ad-Hoc Overview Graphs AH-Bilingual-X2EN
CLEF 2005 − Top 4 participants of Ad−Hoc Bilingual X2EN (only newcomers) − Comparison to median by topic (topics 251 to 275)
1
jhu−apl [Run aplbiidend, TDN Auto, Not Pooled]
u.glasgow [Run glagrentdqe, TD Auto, Pooled]
Difference (average precision)
msu−nivc [Run cirGHLAru2en, TDN Auto, Pooled]
0.5 depok [Run UI−TD10, TD Auto, Pooled]
0
−0.5
−1
251252253254255256257258259260261262263264265266267268269270271272273274275
Topic Number
CLEF 2005 − Top 4 participants of Ad−Hoc Bilingual X2EN (only newcomers) − Comparison to median by topic (topics 276 to 300)
1
jhu−apl [Run aplbiidend, TDN Auto, Not Pooled]
u.glasgow [Run glagrentdqe, TD Auto, Pooled]
Difference (average precision)
msu−nivc [Run cirGHLAru2en, TDN Auto, Pooled]
0.5 depok [Run UI−TD10, TD Auto, Pooled]
0
−0.5
−1
276277278279280281282283284285286287288289290291292293294295296297298299300
Topic Number
A.32
Ad-Hoc Overview Graphs AH-Bilingual-X2FR
CLEF 2005 − Top 5 participants of Ad−Hoc Bilingual X2FR − Interpolated Recall vs Average Precision
100%
alicante [Avg. Prec. 35.90%; Run IRn−enfr−vexp, TD Auto, Not Pooled]
unine [Avg. Prec. 34.67%; Run UniNEbifr2, TD Auto, Not Pooled]
90% hildesheim [Avg. Prec. 34.65%; Run UHIENFR2, TD Auto, Not Pooled]
jhu−apl [Avg. Prec. 34.42%; Run aplbienfrc, TD Auto, Pooled]
miracle [Avg. Prec. 30.76%; Run ENSST, TD Auto, Not Pooled]
80%
70%
Average Precision
60%
50%
40%
30%
20%
10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 − Top 5 participants of Ad−Hoc Bilingual X2FR − Retrieved documents vs Precision
100%
alicante [Exact Prec. 36.15%, Run IRn−enfr−vexp, TD Auto, Not Pooled]
unine [Exact Prec. 36.02%, Run UniNEbifr2, TD Auto, Not Pooled]
90% hildesheim [Exact Prec. 36.54%, Run UHIENFR2, TD Auto, Not Pooled]
jhu−apl [Exact Prec. 33.75%, Run aplbienfrc, TD Auto, Pooled]
miracle [Exact Prec. 31.86%, Run ENSST, TD Auto, Not Pooled]
80%
70%
60%
R−Precision
50%
40%
30%
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
A.33
Ad-Hoc Overview Graphs AH-Bilingual-X2FR
CLEF 2005 − Top 5 participants of Ad−Hoc Bilingual X2FR − Comparison to median by topic (topics 251 to 275)
1
alicante [Run IRn−enfr−vexp, TD Auto, Not Pooled]
unine [Run UniNEbifr2, TD Auto, Not Pooled]
Difference (average precision)
hildesheim [Run UHIENFR2, TD Auto, Not Pooled]
0.5 jhu−apl [Run aplbienfrc, TD Auto, Pooled]
miracle [Run ENSST, TD Auto, Not Pooled]
0
−0.5
−1
251252253254255256257258259260261262263264265266267268269270271272273274275
Topic Number
CLEF 2005 − Top 5 participants of Ad−Hoc Bilingual X2FR − Comparison to median by topic (topics 276 to 300)
1
alicante [Run IRn−enfr−vexp, TD Auto, Not Pooled]
unine [Run UniNEbifr2, TD Auto, Not Pooled]
Difference (average precision)
hildesheim [Run UHIENFR2, TD Auto, Not Pooled]
0.5 jhu−apl [Run aplbienfrc, TD Auto, Pooled]
miracle [Run ENSST, TD Auto, Not Pooled]
0
−0.5
−1
276277278279280281282283284285286287288289290291292293294295296297298299300
Topic Number
# of Relevant Retrieved Docs @ 100 # of Relevant Retrieved Docs @ 1000 Average Precision %
Topic ID Best Median Worst Best Median Worst Best Median Worst
251 23 12 2 35 23 8 38.68 13.10 01.20
252 19 9 0 24 18 0 27.61 06.94 00.00
253 81 18 0 163 74 0 63.83 12.58 00.00
254 77 61 8 176 168 35 69.75 52.91 02.04
255 1 1 0 1 1 0 50.00 01.22 00.00
256 9 9 0 9 9 2 91.65 77.13 00.11
257 27 12 0 71 55 0 18.75 08.49 00.00
258 2 0 0 2 1 0 25.98 00.06 00.00
259 11 9 0 11 11 0 51.97 25.60 00.00
260 54 13 0 71 31 0 58.46 13.95 00.00
261 5 0 0 5 2 0 56.02 00.08 00.00
262 3 0 0 6 5 0 23.02 00.68 00.00
263 18 10 0 21 20 2 44.21 18.03 00.02
264 74 54 1 95 92 1 80.28 58.70 00.04
265 26 21 0 33 33 5 43.47 21.28 00.09
266 15 2 0 20 6 1 15.50 00.78 00.00
267 24 16 0 25 25 0 47.03 20.54 00.00
268 6 6 0 6 6 1 67.23 22.68 00.07
269 36 22 0 83 66 7 38.05 18.73 00.06
270 53 44 1 62 60 5 66.92 56.32 00.07
271 33 30 0 34 34 5 88.21 70.14 00.07
272 12 9 0 13 13 2 26.26 12.02 00.06
273 66 49 0 116 105 4 65.32 43.70 00.02
274 20 17 1 21 20 3 80.96 61.14 00.23
275 55 30 0 73 53 3 69.32 30.80 00.03
276 20 13 0 29 23 0 28.88 13.89 00.00
277 18 15 0 18 18 1 67.29 43.04 00.01
278 16 3 0 18 10 0 66.66 04.24 00.00
279 13 9 0 43 35 0 10.39 06.31 00.00
280 26 16 0 43 39 1 37.61 18.04 00.01
281 36 28 0 43 43 7 58.77 32.67 00.10
282 10 3 0 17 10 0 11.54 02.64 00.00
283 37 27 0 40 37 0 77.11 45.91 00.00
284 56 39 0 67 67 0 70.49 38.73 00.00
285 66 49 0 99 90 0 65.43 44.52 00.00
286 5 1 0 8 6 0 28.10 01.53 00.00
287 68 37 4 149 128 9 57.18 27.31 00.15
288 16 7 0 27 20 1 20.34 06.06 00.05
289 24 6 0 24 7 0 75.87 17.83 00.00
290 34 9 0 39 31 3 53.72 09.56 00.03
291 43 15 0 71 50 4 37.93 07.05 00.04
292 10 3 0 10 8 0 32.16 04.47 00.00
293 81 73 0 121 120 0 78.54 69.43 00.00
294 29 22 0 32 28 3 69.20 62.81 00.05
295 51 28 0 75 61 5 52.79 26.35 00.09
296 27 22 0 27 27 1 43.35 24.41 00.01
297 40 30 0 50 40 0 64.42 43.61 00.00
298 59 38 0 135 123 1 50.53 28.95 00.00
299 16 5 0 53 23 1 15.83 01.78 00.00
300 16 13 0 23 18 0 20.72 09.55 00.00
A.34
Ad-Hoc Overview Graphs AH-Bilingual-X2FR
CLEF 2005 − Top 5 participants of Ad−Hoc Bilingual X2FR − Interpolated Recall vs Average Precision
100%
alicante [Avg. Prec. 35.90%; Run IRn−enfr−vexp, TD Auto, Not Pooled]
unine [Avg. Prec. 34.67%; Run UniNEbifr2, TD Auto, Not Pooled]
90% hildesheim [Avg. Prec. 34.65%; Run UHIENFR2, TD Auto, Not Pooled]
jhu−apl [Avg. Prec. 34.42%; Run aplbienfrc, TD Auto, Pooled]
miracle [Avg. Prec. 31.34%; Run ESSxNP01SR1, TDN Auto, Pooled]
80%
70%
Average Precision
60%
50%
40%
30%
20%
10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 − Top 5 participants of Ad−Hoc Bilingual X2FR − Retrieved documents vs Precision
100%
alicante [Exact Prec. 36.15%, Run IRn−enfr−vexp, TD Auto, Not Pooled]
unine [Exact Prec. 36.02%, Run UniNEbifr2, TD Auto, Not Pooled]
90% hildesheim [Exact Prec. 36.54%, Run UHIENFR2, TD Auto, Not Pooled]
jhu−apl [Exact Prec. 33.75%, Run aplbienfrc, TD Auto, Pooled]
miracle [Exact Prec. 32.66%, Run ESSxNP01SR1, TDN Auto, Pooled]
80%
70%
60%
R−Precision
50%
40%
30%
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
A.35
Ad-Hoc Overview Graphs AH-Bilingual-X2FR
CLEF 2005 − Top 5 participants of Ad−Hoc Bilingual X2FR − Comparison to median by topic (topics 251 to 275)
1
alicante [Run IRn−enfr−vexp, TD Auto, Not Pooled]
unine [Run UniNEbifr2, TD Auto, Not Pooled]
Difference (average precision)
hildesheim [Run UHIENFR2, TD Auto, Not Pooled]
0.5 jhu−apl [Run aplbienfrc, TD Auto, Pooled]
miracle [Run ESSxNP01SR1, TDN Auto, Pooled]
0
−0.5
−1
251252253254255256257258259260261262263264265266267268269270271272273274275
Topic Number
CLEF 2005 − Top 5 participants of Ad−Hoc Bilingual X2FR − Comparison to median by topic (topics 276 to 300)
1
alicante [Run IRn−enfr−vexp, TD Auto, Not Pooled]
unine [Run UniNEbifr2, TD Auto, Not Pooled]
Difference (average precision)
hildesheim [Run UHIENFR2, TD Auto, Not Pooled]
0.5 jhu−apl [Run aplbienfrc, TD Auto, Pooled]
miracle [Run ESSxNP01SR1, TDN Auto, Pooled]
0
−0.5
−1
276277278279280281282283284285286287288289290291292293294295296297298299300
Topic Number
A.36
Ad-Hoc Overview Graphs AH-Bilingual-X2HU
CLEF 2005 − Top 3 participants of Ad−Hoc Bilingual X2HU − Interpolated Recall vs Average Precision
100%
miracle [Avg. Prec. 30.16%; Run ENMST, TD Auto, Not Pooled]
unine [Avg. Prec. 28.82%; Run UniNEbihu3, TD Auto, Not Pooled]
90% jhu−apl [Avg. Prec. 24.58%; Run aplbienhue, TD Auto, Not Pooled]
80%
70%
Average Precision
60%
50%
40%
30%
20%
10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 − Top 3 participants of Ad−Hoc Bilingual X2HU − Retrieved documents vs Precision
100%
miracle [Exact Prec. 28.61%, Run ENMST, TD Auto, Not Pooled]
unine [Exact Prec. 27.89%, Run UniNEbihu3, TD Auto, Not Pooled]
90% jhu−apl [Exact Prec. 24.37%, Run aplbienhue, TD Auto, Not Pooled]
80%
70%
60%
R−Precision
50%
40%
30%
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
A.37
Ad-Hoc Overview Graphs AH-Bilingual-X2HU
CLEF 2005 − Top 3 participants of Ad−Hoc Bilingual X2HU − Comparison to median by topic (topics 251 to 275)
1
miracle [Run ENMST, TD Auto, Not Pooled]
unine [Run UniNEbihu3, TD Auto, Not Pooled]
Difference (average precision)
jhu−apl [Run aplbienhue, TD Auto, Not Pooled]
0.5
0
−0.5
−1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic Number
CLEF 2005 − Top 3 participants of Ad−Hoc Bilingual X2HU − Comparison to median by topic (topics 276 to 300)
1
miracle [Run ENMST, TD Auto, Not Pooled]
unine [Run UniNEbihu3, TD Auto, Not Pooled]
Difference (average precision)
jhu−apl [Run aplbienhue, TD Auto, Not Pooled]
0.5
0
−0.5
−1
276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
# of Relevant Retrieved Docs @ 100 # of Relevant Retrieved Docs @ 1000 Average Precision %
Topic ID Best Median Worst Best Median Worst Best Median Worst
251 20 10 7 27 22 16 38.21 12.20 05.16
252 17 15 8 20 20 18 38.29 18.75 12.72
253 34 32 26 38 37 35 46.60 43.75 36.26
254 24 24 23 24 24 24 67.45 47.52 44.98
255 6 3 2 6 6 4 51.81 34.26 10.79
256 9 9 9 10 10 9 83.96 81.04 73.46
257 12 8 4 13 13 6 25.88 11.56 06.87
258 0 0 0 2 1 0 00.29 00.04 00.00
259 3 1 0 4 4 4 42.52 03.27 00.65
260 5 0 0 5 1 0 10.85 00.02 00.00
261 2 0 0 3 2 0 40.74 00.57 00.00
262 6 3 0 11 9 0 06.30 03.01 00.00
263 13 1 0 20 11 3 23.48 00.66 00.04
264 3 2 2 5 3 3 40.36 12.58 06.53
265 11 5 2 13 13 13 39.55 12.41 03.03
266 18 12 7 30 28 25 24.21 17.41 05.05
267 7 6 3 7 7 7 57.53 41.96 03.80
268 15 12 4 15 14 9 52.79 25.91 03.69
269 4 2 1 8 7 3 04.40 00.85 00.26
270 16 9 0 21 21 0 36.66 27.51 00.00
271 9 8 6 9 9 9 32.06 25.34 14.84
272 1 1 1 1 1 1 33.33 14.29 07.69
273 12 8 2 26 24 8 20.24 08.10 00.48
274 20 9 6 20 15 9 71.50 18.36 07.67
275 2 1 1 2 2 1 83.33 17.50 00.64
276 25 19 13 41 40 37 26.39 18.00 09.75
277 13 7 4 13 13 9 53.46 16.68 07.37
278 8 0 0 10 1 0 38.81 00.01 00.00
279 9 8 4 9 9 8 78.56 30.30 06.54
280 12 6 4 17 17 15 33.75 06.29 05.15
281 26 26 26 26 26 26 96.72 95.60 85.13
282 8 3 2 11 10 4 21.91 06.52 01.48
283 9 9 0 9 9 1 57.76 33.44 00.02
284 8 0 0 9 8 0 23.11 00.68 00.00
285 10 0 0 10 2 0 50.70 00.11 00.00
286 12 5 2 41 38 34 04.36 02.59 02.06
287 52 48 35 66 61 57 74.38 67.19 42.97
288 13 11 0 27 18 3 09.77 05.70 00.04
289 8 8 8 8 8 8 100.00 98.61 94.72
290 67 60 33 87 84 63 69.49 61.46 32.27
291 41 39 34 47 45 43 67.58 57.75 55.18
292 2 2 1 2 2 2 51.85 51.01 50.21
293 35 31 17 37 36 36 84.17 60.59 13.92
294 4 4 3 4 4 4 95.00 43.94 07.52
295 8 8 0 8 8 2 15.07 12.15 00.05
296 22 12 4 25 25 18 33.79 11.57 02.62
297 7 6 5 8 8 7 65.58 59.58 22.26
298 9 3 0 19 8 5 12.99 01.33 00.25
299 2 0 0 3 0 0 30.23 00.00 00.00
300 5 3 1 9 8 7 09.99 03.66 01.88
A.38
Ad-Hoc Overview Graphs AH-Bilingual-X2HU
CLEF 2005 − Top 3 participants of Ad−Hoc Bilingual X2HU − Interpolated Recall vs Average Precision
100%
miracle [Avg. Prec. 30.16%; Run ENMST, TD Auto, Not Pooled]
unine [Avg. Prec. 28.82%; Run UniNEbihu3, TD Auto, Not Pooled]
90% jhu−apl [Avg. Prec. 24.58%; Run aplbienhue, TD Auto, Not Pooled]
80%
70%
Average Precision
60%
50%
40%
30%
20%
10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 − Top 3 participants of Ad−Hoc Bilingual X2HU − Retrieved documents vs Precision
100%
miracle [Exact Prec. 28.61%, Run ENMST, TD Auto, Not Pooled]
unine [Exact Prec. 27.89%, Run UniNEbihu3, TD Auto, Not Pooled]
90% jhu−apl [Exact Prec. 24.37%, Run aplbienhue, TD Auto, Not Pooled]
80%
70%
60%
R−Precision
50%
40%
30%
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
A.39
Ad-Hoc Overview Graphs AH-Bilingual-X2HU
CLEF 2005 − Top 3 participants of Ad−Hoc Bilingual X2HU − Comparison to median by topic (topics 251 to 275)
1
miracle [Run ENMST, TD Auto, Not Pooled]
unine [Run UniNEbihu3, TD Auto, Not Pooled]
Difference (average precision)
jhu−apl [Run aplbienhue, TD Auto, Not Pooled]
0.5
0
−0.5
−1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic Number
CLEF 2005 − Top 3 participants of Ad−Hoc Bilingual X2HU − Comparison to median by topic (topics 276 to 300)
1
miracle [Run ENMST, TD Auto, Not Pooled]
unine [Run UniNEbihu3, TD Auto, Not Pooled]
Difference (average precision)
jhu−apl [Run aplbienhue, TD Auto, Not Pooled]
0.5
0
−0.5
−1
276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.40
Ad-Hoc Overview Graphs AH-Bilingual-X2PT
CLEF 2005 − Top 5 participants of Ad−Hoc Bilingual X2PT − Interpolated Recall vs Average Precision
100%
unine [Avg. Prec. 34.04%; Run UniNEbipt1, TD Auto, Pooled]
jhu−apl [Avg. Prec. 31.85%; Run aplbiesptb, TD Auto, Not Pooled]
90% miracle [Avg. Prec. 31.06%; Run ESAST, TD Auto, Not Pooled]
alicante [Avg. Prec. 29.18%; Run IRn−enpt−vexp, TD Auto, Not Pooled]
tlr [Avg. Prec. 23.58%; Run tlrTDfr2ptRFS1, TD Auto, Pooled]
80%
70%
Average Precision
60%
50%
40%
30%
20%
10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 − Top 5 participants of Ad−Hoc Bilingual X2PT − Retrieved documents vs Precision
100%
unine [Exact Prec. 34.26%, Run UniNEbipt1, TD Auto, Pooled]
jhu−apl [Exact Prec. 34.11%, Run aplbiesptb, TD Auto, Not Pooled]
90% miracle [Exact Prec. 33.53%, Run ESAST, TD Auto, Not Pooled]
alicante [Exact Prec. 31.38%, Run IRn−enpt−vexp, TD Auto, Not Pooled]
tlr [Exact Prec. 26.89%, Run tlrTDfr2ptRFS1, TD Auto, Pooled]
80%
70%
60%
R−Precision
50%
40%
30%
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
A.41
Ad-Hoc Overview Graphs AH-Bilingual-X2PT
CLEF 2005 − Top 5 participants of Ad−Hoc Bilingual X2PT − Comparison to median by topic (topics 251 to 275)
1
unine [Run UniNEbipt1, TD Auto, Pooled]
jhu−apl [Run aplbiesptb, TD Auto, Not Pooled]
Difference (average precision)
miracle [Run ESAST, TD Auto, Not Pooled]
0.5 alicante [Run IRn−enpt−vexp, TD Auto, Not Pooled]
tlr [Run tlrTDfr2ptRFS1, TD Auto, Pooled]
0
−0.5
−1
251252253254255256257258259260261262263264265266267268269270271272273274275
Topic Number
CLEF 2005 − Top 5 participants of Ad−Hoc Bilingual X2PT − Comparison to median by topic (topics 276 to 300)
1
unine [Run UniNEbipt1, TD Auto, Pooled]
jhu−apl [Run aplbiesptb, TD Auto, Not Pooled]
Difference (average precision)
miracle [Run ESAST, TD Auto, Not Pooled]
0.5 alicante [Run IRn−enpt−vexp, TD Auto, Not Pooled]
tlr [Run tlrTDfr2ptRFS1, TD Auto, Pooled]
0
−0.5
−1
276277278279280281282283284285286287288289290291292293294295296297298299300
Topic Number
# of Relevant Retrieved Docs @ 100 # of Relevant Retrieved Docs @ 1000 Average Precision %
Topic ID Best Median Worst Best Median Worst Best Median Worst
251 43 27 18 64 51 19 58.50 29.53 15.86
252 28 4 0 40 26 0 47.99 03.25 00.00
253 50 15 1 122 49 2 35.99 03.92 00.01
254 68 56 14 125 79 14 66.46 41.86 05.76
255 5 3 0 6 6 0 45.63 23.47 00.00
256 12 12 0 12 12 0 100.00 94.06 00.00
257 27 19 0 55 45 0 25.88 14.42 00.00
258 1 0 0 1 1 0 16.67 00.33 00.00
259 17 15 0 17 17 0 53.47 35.32 00.00
260 55 41 0 88 78 0 56.75 40.75 00.00
261 17 0 0 22 1 0 27.72 00.04 00.00
262 9 1 0 18 5 0 12.14 00.49 00.00
263 22 5 0 59 17 0 21.16 02.86 00.00
264 34 20 0 43 34 0 63.54 23.64 00.00
265 23 15 0 26 24 0 31.48 20.96 00.00
266 52 25 0 87 73 0 52.12 27.49 00.00
267 29 9 0 59 34 0 28.01 13.35 00.00
268 7 4 0 7 7 0 55.94 19.01 00.00
269 19 10 0 39 29 0 13.94 05.78 00.00
270 25 20 0 41 41 0 35.54 22.40 00.00
271 35 15 0 40 29 0 73.59 33.83 00.00
272 17 14 0 17 16 0 36.56 26.52 00.00
273 48 34 9 73 57 9 55.57 30.51 08.62
274 6 3 0 6 6 0 29.67 09.76 00.00
275 40 26 0 57 47 0 48.33 30.62 00.00
276 28 15 0 38 30 0 41.49 14.16 00.00
277 18 2 0 20 7 0 29.47 01.80 00.00
278 18 2 0 19 9 0 57.64 01.43 00.00
279 22 10 0 23 17 0 63.32 26.60 00.00
280 19 11 2 29 24 2 25.93 10.45 00.53
281 51 45 27 67 67 65 74.15 60.46 28.74
282 31 24 0 74 65 0 22.11 17.02 00.00
283 37 26 0 44 41 0 70.64 47.16 00.00
284 29 10 0 40 27 0 38.16 06.10 00.00
285 35 11 0 59 27 0 42.37 11.18 00.00
286 52 10 0 174 61 1 26.96 02.24 00.01
287 49 26 0 94 74 0 43.51 17.90 00.00
288 6 1 0 8 7 0 16.26 01.46 00.00
289 9 4 1 9 7 1 50.15 29.72 02.78
290 49 6 0 66 26 0 60.89 05.64 00.00
291 48 28 3 88 65 3 45.33 19.74 00.48
292 7 3 0 8 6 0 36.67 08.44 00.00
293 66 42 14 98 84 26 73.48 41.46 09.44
294 28 26 0 33 30 0 69.06 57.56 00.00
295 76 47 3 149 95 15 54.59 24.80 00.23
296 46 38 0 49 49 0 56.26 43.07 00.00
297 29 15 0 39 24 0 55.44 37.11 00.00
298 51 23 4 74 63 4 66.14 20.27 00.26
299 67 32 0 163 108 0 51.34 22.13 00.00
300 40 4 0 56 19 0 43.35 03.45 00.00
A.42
Ad-Hoc Overview Graphs AH-Bilingual-X2PT
CLEF 2005 − Top 5 participants of Ad−Hoc Bilingual X2PT − Interpolated Recall vs Average Precision
100%
unine [Avg. Prec. 34.04%; Run UniNEbipt1, TD Auto, Pooled]
miracle [Avg. Prec. 32.87%; Run ESASR, TDN Auto, Not Pooled]
90% jhu−apl [Avg. Prec. 31.85%; Run aplbiesptb, TD Auto, Not Pooled]
alicante [Avg. Prec. 29.18%; Run IRn−enpt−vexp, TD Auto, Not Pooled]
tlr [Avg. Prec. 23.58%; Run tlrTDfr2ptRFS1, TD Auto, Pooled]
80%
70%
Average Precision
60%
50%
40%
30%
20%
10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 − Top 5 participants of Ad−Hoc Bilingual X2PT − Retrieved documents vs Precision
100%
unine [Exact Prec. 34.26%, Run UniNEbipt1, TD Auto, Pooled]
miracle [Exact Prec. 34.74%, Run ESASR, TDN Auto, Not Pooled]
90% jhu−apl [Exact Prec. 34.11%, Run aplbiesptb, TD Auto, Not Pooled]
alicante [Exact Prec. 31.38%, Run IRn−enpt−vexp, TD Auto, Not Pooled]
tlr [Exact Prec. 26.89%, Run tlrTDfr2ptRFS1, TD Auto, Pooled]
80%
70%
60%
R−Precision
50%
40%
30%
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
A.43
Ad-Hoc Overview Graphs AH-Bilingual-X2PT
CLEF 2005 − Top 5 participants of Ad−Hoc Bilingual X2PT − Comparison to median by topic (topics 251 to 275)
1
unine [Run UniNEbipt1, TD Auto, Pooled]
miracle [Run ESASR, TDN Auto, Not Pooled]
Difference (average precision)
jhu−apl [Run aplbiesptb, TD Auto, Not Pooled]
0.5 alicante [Run IRn−enpt−vexp, TD Auto, Not Pooled]
tlr [Run tlrTDfr2ptRFS1, TD Auto, Pooled]
0
−0.5
−1
251252253254255256257258259260261262263264265266267268269270271272273274275
Topic Number
CLEF 2005 − Top 5 participants of Ad−Hoc Bilingual X2PT − Comparison to median by topic (topics 276 to 300)
1
unine [Run UniNEbipt1, TD Auto, Pooled]
miracle [Run ESASR, TDN Auto, Not Pooled]
Difference (average precision)
jhu−apl [Run aplbiesptb, TD Auto, Not Pooled]
0.5 alicante [Run IRn−enpt−vexp, TD Auto, Not Pooled]
tlr [Run tlrTDfr2ptRFS1, TD Auto, Pooled]
0
−0.5
−1
276277278279280281282283284285286287288289290291292293294295296297298299300
Topic Number
A.44
Ad-Hoc Overview Graphs AH-Monolingual-BG
CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual BG − Interpolated Recall vs Average Precision
100%
jhu−apl [Avg. Prec. 32.03%; Run aplmobgd, TD Auto, Pooled]
hummingbird [Avg. Prec. 29.18%; Run humBG05tde, TD Auto, Pooled]
90% unine [Avg. Prec. 28.39%; Run UniNEbg3, TD Auto, Not Pooled]
miracle [Avg. Prec. 26.76%; Run ST, TD Auto, Pooled]
u.glasgow [Avg. Prec. 25.14%; Run glabgtdqe, TD Auto, Not Pooled]
80%
70%
Average Precision
60%
50%
40%
30%
20%
10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual BG − Retrieved documents vs Precision
100%
jhu−apl [Exact Prec. 30.38%, Run aplmobgd, TD Auto, Pooled]
hummingbird [Exact Prec. 27.45%, Run humBG05tde, TD Auto, Pooled]
90% unine [Exact Prec. 25.93%, Run UniNEbg3, TD Auto, Not Pooled]
miracle [Exact Prec. 26.27%, Run ST, TD Auto, Pooled]
u.glasgow [Exact Prec. 24.33%, Run glabgtdqe, TD Auto, Not Pooled]
80%
70%
60%
R−Precision
50%
40%
30%
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
A.45
Ad-Hoc Overview Graphs AH-Monolingual-BG
CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual BG − Comparison to median by topic (topics 251 to 275)
1
jhu−apl [Run aplmobgd, TD Auto, Pooled]
hummingbird [Run humBG05tde, TD Auto, Pooled]
Difference (average precision)
unine [Run UniNEbg3, TD Auto, Not Pooled]
0.5 miracle [Run ST, TD Auto, Pooled]
u.glasgow [Run glabgtdqe, TD Auto, Not Pooled]
0
−0.5
−1
251252253254255256257258259260261262263264265266267268269270271272273274275
Topic Number
CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual BG − Comparison to median by topic (topics 276 to 300)
1
jhu−apl [Run aplmobgd, TD Auto, Pooled]
hummingbird [Run humBG05tde, TD Auto, Pooled]
Difference (average precision)
unine [Run UniNEbg3, TD Auto, Not Pooled]
0.5 miracle [Run ST, TD Auto, Pooled]
u.glasgow [Run glabgtdqe, TD Auto, Not Pooled]
0
−0.5
−1
276277278279280281282283284285286287288289290291292293294295296297298299300
Topic Number
# of Relevant Retrieved Docs @ 100 # of Relevant Retrieved Docs @ 1000 Average Precision %
Topic ID Best Median Worst Best Median Worst Best Median Worst
251 26 17 8 38 33 21 47.86 31.02 17.47
252 6 3 0 9 7 3 11.64 03.78 00.10
253 18 15 9 23 21 16 29.31 22.86 09.95
254 38 30 9 50 49 22 42.42 29.92 05.52
255 2 2 1 2 2 2 55.56 23.33 02.34
256 2 2 1 2 2 2 75.00 62.70 17.60
257 11 5 2 12 10 4 31.12 18.76 03.01
258 1 1 0 1 1 0 100.00 29.16 00.00
259 7 6 3 7 7 5 96.17 60.74 02.99
260 12 11 3 13 12 7 44.37 30.23 09.90
261 16 11 4 21 14 4 45.19 18.92 03.99
262 33 28 4 36 35 5 68.82 51.37 02.73
263 9 6 2 30 22 6 04.69 02.64 00.70
264 8 8 1 10 8 2 29.04 16.71 00.57
265 13 11 6 13 13 8 40.20 27.00 16.88
266 9 6 0 14 10 0 17.02 07.56 00.00
267 17 11 1 21 21 3 39.42 10.72 00.43
268 14 14 13 14 14 13 71.83 44.22 19.32
269 3 1 0 4 3 1 25.91 04.76 00.03
270 4 2 1 5 4 2 04.30 02.07 00.81
271 2 2 0 2 2 0 100.00 13.76 00.00
272 1 1 1 1 1 1 100.00 15.48 01.32
273 30 21 7 39 36 33 41.26 27.24 05.77
274 4 3 1 4 4 1 34.81 07.26 00.38
275 8 5 2 10 8 7 29.62 16.42 05.15
276 7 6 4 9 9 6 13.16 10.28 04.64
277 11 6 0 11 9 1 60.29 30.24 00.02
278 11 7 0 11 9 3 49.72 15.72 00.10
279 6 6 5 6 6 6 93.33 63.46 12.27
280 6 4 0 8 8 1 38.87 05.74 00.02
281 7 7 5 7 7 7 49.06 40.04 16.59
282 5 3 2 6 6 3 36.78 18.86 07.38
283 18 18 8 18 18 17 72.35 52.54 12.07
284 4 3 1 4 3 1 19.42 11.57 00.26
285 3 3 3 3 3 3 68.06 35.21 25.96
286 13 7 0 20 19 0 16.18 06.42 00.00
287 22 18 14 35 34 27 27.60 21.66 13.47
288 7 2 0 13 9 4 14.18 02.37 00.15
289 2 2 2 2 2 2 64.29 55.72 11.86
290 23 21 15 23 23 20 73.10 43.37 30.71
291 40 36 32 54 53 45 53.11 42.55 36.54
292 0 0 0 0 0 0 00.00 00.00 00.00
293 4 4 0 4 4 1 70.22 40.24 00.05
294 43 30 16 47 45 25 79.76 57.94 21.86
295 51 38 2 67 59 16 68.11 39.40 00.83
296 1 1 0 1 1 1 50.00 02.99 00.17
297 5 3 0 5 5 0 24.51 04.19 00.00
298 2 2 0 2 2 1 11.92 02.53 00.06
299 5 1 0 6 4 1 09.58 01.04 00.09
300 6 4 2 7 6 2 32.35 15.11 03.71
A.46
Ad-Hoc Overview Graphs AH-Monolingual-BG
CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual BG − Interpolated Recall vs Average Precision
100%
jhu−apl [Avg. Prec. 32.03%; Run aplmobgd, TD Auto, Pooled]
hummingbird [Avg. Prec. 29.18%; Run humBG05tde, TD Auto, Pooled]
90% unine [Avg. Prec. 28.39%; Run UniNEbg3, TD Auto, Not Pooled]
miracle [Avg. Prec. 26.76%; Run ST, TD Auto, Pooled]
u.glasgow [Avg. Prec. 25.14%; Run glabgtdqe, TD Auto, Not Pooled]
80%
70%
Average Precision
60%
50%
40%
30%
20%
10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual BG − Retrieved documents vs Precision
100%
jhu−apl [Exact Prec. 30.38%, Run aplmobgd, TD Auto, Pooled]
hummingbird [Exact Prec. 27.45%, Run humBG05tde, TD Auto, Pooled]
90% unine [Exact Prec. 25.93%, Run UniNEbg3, TD Auto, Not Pooled]
miracle [Exact Prec. 26.27%, Run ST, TD Auto, Pooled]
u.glasgow [Exact Prec. 24.33%, Run glabgtdqe, TD Auto, Not Pooled]
80%
70%
60%
R−Precision
50%
40%
30%
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
A.47
Ad-Hoc Overview Graphs AH-Monolingual-BG
CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual BG − Comparison to median by topic (topics 251 to 275)
1
jhu−apl [Run aplmobgd, TD Auto, Pooled]
hummingbird [Run humBG05tde, TD Auto, Pooled]
Difference (average precision)
unine [Run UniNEbg3, TD Auto, Not Pooled]
0.5 miracle [Run ST, TD Auto, Pooled]
u.glasgow [Run glabgtdqe, TD Auto, Not Pooled]
0
−0.5
−1
251252253254255256257258259260261262263264265266267268269270271272273274275
Topic Number
CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual BG − Comparison to median by topic (topics 276 to 300)
1
jhu−apl [Run aplmobgd, TD Auto, Pooled]
hummingbird [Run humBG05tde, TD Auto, Pooled]
Difference (average precision)
unine [Run UniNEbg3, TD Auto, Not Pooled]
0.5 miracle [Run ST, TD Auto, Pooled]
u.glasgow [Run glabgtdqe, TD Auto, Not Pooled]
0
−0.5
−1
276277278279280281282283284285286287288289290291292293294295296297298299300
Topic Number
A.48
Ad-Hoc Overview Graphs AH-Monolingual-FR
CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual FR − Interpolated Recall vs Average Precision
100%
jhu−apl [Avg. Prec. 42.14%; Run aplmofra, TD Auto, Pooled]
unine [Avg. Prec. 42.07%; Run UniNEfr1, TD Auto, Pooled]
90% u.glasgow [Avg. Prec. 40.17%; Run glafrtdqe1, TD Auto, Pooled]
hummingbird [Avg. Prec. 40.06%; Run humFR05tde, TD Auto, Not Pooled]
tlr [Avg. Prec. 40.00%; Run tlrTDfrRFS1, TD Auto, Pooled]
80%
70%
Average Precision
60%
50%
40%
30%
20%
10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual FR − Retrieved documents vs Precision
100%
jhu−apl [Exact Prec. 40.47%, Run aplmofra, TD Auto, Pooled]
unine [Exact Prec. 42.81%, Run UniNEfr1, TD Auto, Pooled]
90% u.glasgow [Exact Prec. 39.69%, Run glafrtdqe1, TD Auto, Pooled]
hummingbird [Exact Prec. 40.87%, Run humFR05tde, TD Auto, Not Pooled]
tlr [Exact Prec. 39.90%, Run tlrTDfrRFS1, TD Auto, Pooled]
80%
70%
60%
R−Precision
50%
40%
30%
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
A.49
Ad-Hoc Overview Graphs AH-Monolingual-FR
CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual FR − Comparison to median by topic (topics 251 to 275)
1
jhu−apl [Run aplmofra, TD Auto, Pooled]
unine [Run UniNEfr1, TD Auto, Pooled]
Difference (average precision)
u.glasgow [Run glafrtdqe1, TD Auto, Pooled]
0.5 hummingbird [Run humFR05tde, TD Auto, Not Pooled]
tlr [Run tlrTDfrRFS1, TD Auto, Pooled]
0
−0.5
−1
251252253254255256257258259260261262263264265266267268269270271272273274275
Topic Number
CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual FR − Comparison to median by topic (topics 276 to 300)
1
jhu−apl [Run aplmofra, TD Auto, Pooled]
unine [Run UniNEfr1, TD Auto, Pooled]
Difference (average precision)
u.glasgow [Run glafrtdqe1, TD Auto, Pooled]
0.5 hummingbird [Run humFR05tde, TD Auto, Not Pooled]
tlr [Run tlrTDfrRFS1, TD Auto, Pooled]
0
−0.5
−1
276277278279280281282283284285286287288289290291292293294295296297298299300
Topic Number
# of Relevant Retrieved Docs @ 100 # of Relevant Retrieved Docs @ 1000 Average Precision %
Topic ID Best Median Worst Best Median Worst Best Median Worst
251 26 16 6 35 31 12 41.93 24.64 04.96
252 18 9 1 24 19 8 47.88 09.00 00.83
253 85 51 13 172 132 26 66.77 33.78 02.47
254 73 63 26 176 169 84 66.87 53.60 14.46
255 1 1 0 1 1 0 05.88 01.20 00.00
256 9 9 4 9 9 5 97.65 80.04 02.62
257 34 24 1 78 66 12 27.03 17.32 00.19
258 2 1 0 2 2 0 57.14 02.70 00.00
259 9 4 0 11 10 1 12.85 03.64 00.01
260 57 39 16 72 58 29 64.16 45.02 08.56
261 3 0 0 4 1 0 29.07 00.06 00.00
262 5 3 0 6 5 3 39.59 28.32 00.11
263 16 10 3 21 18 4 45.68 30.72 00.48
264 78 65 28 96 93 44 85.20 71.37 21.29
265 26 21 8 33 33 24 44.38 27.72 09.89
266 29 21 0 33 30 3 39.50 24.55 00.06
267 24 22 4 25 25 13 58.25 40.19 03.14
268 6 6 1 6 6 4 81.07 58.38 10.35
269 40 24 1 83 67 25 39.46 19.54 00.91
270 55 46 11 62 62 26 76.68 59.89 03.31
271 33 32 9 34 34 21 90.94 86.48 08.49
272 13 11 3 13 13 6 46.47 12.99 01.98
273 75 53 6 117 107 17 73.24 49.08 01.25
274 21 19 2 21 20 4 92.19 70.84 02.25
275 57 42 18 74 57 35 68.57 47.75 19.96
276 19 15 2 30 27 11 30.64 17.72 01.78
277 18 17 0 18 18 1 62.65 40.05 00.01
278 16 12 5 19 17 10 60.91 38.18 05.16
279 16 9 2 44 37 3 13.04 07.32 00.31
280 30 20 1 43 41 6 46.68 29.37 00.14
281 38 28 9 43 43 42 50.38 35.66 10.68
282 6 2 0 17 9 1 05.12 01.60 00.03
283 39 34 10 40 39 34 79.94 69.06 18.93
284 56 49 3 67 67 17 74.45 59.15 00.92
285 65 57 15 99 96 21 70.52 59.86 07.03
286 7 5 1 8 8 5 28.10 07.07 01.58
287 68 51 5 148 137 30 54.58 41.08 00.90
288 16 9 3 28 24 16 21.43 08.18 02.96
289 23 22 1 24 23 6 76.50 66.98 02.34
290 33 25 1 40 37 4 56.13 25.77 00.22
291 50 43 3 81 77 11 61.46 42.53 00.55
292 8 5 0 10 9 3 22.68 07.80 00.30
293 81 71 7 121 118 34 77.78 64.94 02.02
294 28 22 6 32 28 8 74.56 60.79 14.61
295 50 46 13 76 72 26 51.34 44.52 07.62
296 27 21 0 27 26 1 61.25 25.67 00.02
297 46 34 10 50 43 21 74.64 49.94 07.24
298 73 56 9 137 130 28 72.39 45.97 01.47
299 18 8 0 50 34 2 12.94 04.94 00.02
300 20 14 0 24 22 6 32.91 12.10 00.16
A.50
Ad-Hoc Overview Graphs AH-Monolingual-FR
CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual FR − Interpolated Recall vs Average Precision
100%
jhu−apl [Avg. Prec. 42.14%; Run aplmofra, TD Auto, Pooled]
unine [Avg. Prec. 42.07%; Run UniNEfr1, TD Auto, Pooled]
90% u.glasgow [Avg. Prec. 40.17%; Run glafrtdqe1, TD Auto, Pooled]
hummingbird [Avg. Prec. 40.06%; Run humFR05tde, TD Auto, Not Pooled]
tlr [Avg. Prec. 40.00%; Run tlrTDfrRFS1, TD Auto, Pooled]
80%
70%
Average Precision
60%
50%
40%
30%
20%
10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual FR − Retrieved documents vs Precision
100%
jhu−apl [Exact Prec. 40.47%, Run aplmofra, TD Auto, Pooled]
unine [Exact Prec. 42.81%, Run UniNEfr1, TD Auto, Pooled]
90% u.glasgow [Exact Prec. 39.69%, Run glafrtdqe1, TD Auto, Pooled]
hummingbird [Exact Prec. 40.87%, Run humFR05tde, TD Auto, Not Pooled]
tlr [Exact Prec. 39.90%, Run tlrTDfrRFS1, TD Auto, Pooled]
80%
70%
60%
R−Precision
50%
40%
30%
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
A.51
Ad-Hoc Overview Graphs AH-Monolingual-FR
CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual FR − Comparison to median by topic (topics 251 to 275)
1
jhu−apl [Run aplmofra, TD Auto, Pooled]
unine [Run UniNEfr1, TD Auto, Pooled]
Difference (average precision)
u.glasgow [Run glafrtdqe1, TD Auto, Pooled]
0.5 hummingbird [Run humFR05tde, TD Auto, Not Pooled]
tlr [Run tlrTDfrRFS1, TD Auto, Pooled]
0
−0.5
−1
251252253254255256257258259260261262263264265266267268269270271272273274275
Topic Number
CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual FR − Comparison to median by topic (topics 276 to 300)
1
jhu−apl [Run aplmofra, TD Auto, Pooled]
unine [Run UniNEfr1, TD Auto, Pooled]
Difference (average precision)
u.glasgow [Run glafrtdqe1, TD Auto, Pooled]
0.5 hummingbird [Run humFR05tde, TD Auto, Not Pooled]
tlr [Run tlrTDfrRFS1, TD Auto, Pooled]
0
−0.5
−1
276277278279280281282283284285286287288289290291292293294295296297298299300
Topic Number
A.52
Ad-Hoc Overview Graphs AH-Monolingual-HU
CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual HU − Interpolated Recall vs Average Precision
100%
jhu−apl [Avg. Prec. 41.12%; Run aplmohud, TD Auto, Pooled]
unine [Avg. Prec. 38.89%; Run UniNEhu3, TD Auto, Not Pooled]
90% miracle [Avg. Prec. 35.20%; Run xNP01ST1, TD Auto, Pooled]
hummingbird [Avg. Prec. 33.09%; Run humHU05tde, TD Auto, Pooled]
hildesheim [Avg. Prec. 32.64%; Run UHIHU2, TD Auto, Pooled]
80%
70%
Average Precision
60%
50%
40%
30%
20%
10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual HU − Retrieved documents vs Precision
100%
jhu−apl [Exact Prec. 40.92%, Run aplmohud, TD Auto, Pooled]
unine [Exact Prec. 38.64%, Run UniNEhu3, TD Auto, Not Pooled]
90% miracle [Exact Prec. 34.24%, Run xNP01ST1, TD Auto, Pooled]
hummingbird [Exact Prec. 34.00%, Run humHU05tde, TD Auto, Pooled]
hildesheim [Exact Prec. 32.91%, Run UHIHU2, TD Auto, Pooled]
80%
70%
60%
R−Precision
50%
40%
30%
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
A.53
Ad-Hoc Overview Graphs AH-Monolingual-HU
CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual HU − Comparison to median by topic (topics 251 to 275)
1
jhu−apl [Run aplmohud, TD Auto, Pooled]
unine [Run UniNEhu3, TD Auto, Not Pooled]
Difference (average precision)
miracle [Run xNP01ST1, TD Auto, Pooled]
0.5 hummingbird [Run humHU05tde, TD Auto, Pooled]
hildesheim [Run UHIHU2, TD Auto, Pooled]
0
−0.5
−1
251252253254255256257258259260261262263264265266267268269270271272273274275
Topic Number
CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual HU − Comparison to median by topic (topics 276 to 300)
1
jhu−apl [Run aplmohud, TD Auto, Pooled]
unine [Run UniNEhu3, TD Auto, Not Pooled]
Difference (average precision)
miracle [Run xNP01ST1, TD Auto, Pooled]
0.5 hummingbird [Run humHU05tde, TD Auto, Pooled]
hildesheim [Run UHIHU2, TD Auto, Pooled]
0
−0.5
−1
276277278279280281282283284285286287288289290291292293294295296297298299300
Topic Number
# of Relevant Retrieved Docs @ 100 # of Relevant Retrieved Docs @ 1000 Average Precision %
Topic ID Best Median Worst Best Median Worst Best Median Worst
251 18 8 0 27 21 5 30.07 07.69 00.49
252 15 5 0 20 10 0 20.95 04.55 00.00
253 35 31 0 38 35 1 47.95 34.29 00.02
254 24 20 5 24 23 13 64.27 33.54 03.24
255 6 3 0 6 4 2 100.00 46.51 00.09
256 10 9 4 10 10 5 87.24 72.05 24.19
257 13 8 0 13 12 1 36.13 15.63 00.02
258 3 2 0 3 2 0 33.46 13.50 00.00
259 4 3 0 4 4 2 59.65 22.93 00.46
260 6 4 0 6 5 1 42.19 15.48 00.14
261 3 1 0 3 2 0 48.89 16.72 00.00
262 11 8 0 12 12 6 57.69 20.98 02.19
263 14 8 0 20 18 1 14.43 09.10 00.05
264 5 3 1 5 4 2 40.63 31.66 00.32
265 11 6 3 13 13 3 37.51 24.81 09.39
266 20 13 6 29 26 12 26.99 13.76 02.92
267 7 6 4 7 7 5 71.65 45.25 05.77
268 15 14 5 15 14 5 70.25 54.08 24.07
269 14 4 0 17 9 0 20.58 02.92 00.00
270 19 13 7 22 22 13 31.29 18.70 08.30
271 9 7 1 9 9 1 74.87 29.00 05.00
272 1 1 0 1 1 0 20.00 01.51 00.00
273 19 15 4 26 25 12 39.28 20.96 02.19
274 20 18 10 21 20 14 87.26 45.02 21.56
275 2 2 0 2 2 1 83.33 43.34 00.12
276 26 19 6 41 41 23 33.39 19.83 04.15
277 5 1 0 7 3 0 06.48 00.66 00.00
278 12 8 0 14 12 0 42.35 27.20 00.00
279 9 8 0 9 9 1 90.53 49.56 00.01
280 11 7 3 17 17 6 17.33 08.58 01.51
281 26 26 14 26 26 16 97.50 92.38 41.29
282 7 2 0 11 8 1 14.76 01.96 00.11
283 9 9 0 9 9 0 67.87 56.79 00.00
284 13 8 0 13 8 1 38.06 18.48 00.02
285 11 2 0 11 6 2 73.03 11.64 00.13
286 29 13 0 58 42 0 37.09 09.52 00.00
287 52 20 8 67 50 21 72.46 17.95 02.37
288 20 8 2 28 23 10 34.95 08.67 00.95
289 8 8 3 8 8 4 100.00 88.16 01.50
290 71 47 6 87 76 36 74.67 43.01 02.95
291 44 38 10 47 46 16 71.04 58.96 07.66
292 2 1 0 2 2 0 52.00 21.55 00.00
293 37 32 1 37 35 16 96.66 83.58 00.67
294 4 4 2 4 4 2 100.00 82.71 31.25
295 8 8 4 8 8 4 30.98 21.75 08.90
296 22 12 1 25 24 5 27.15 17.88 00.33
297 8 7 0 8 8 0 70.96 50.84 00.00
298 18 6 0 19 10 0 37.32 05.39 00.00
299 4 2 1 4 3 1 27.41 06.88 02.23
300 9 7 0 9 7 0 46.19 19.66 00.00
A.54
Ad-Hoc Overview Graphs AH-Monolingual-HU
CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual HU − Interpolated Recall vs Average Precision
100%
jhu−apl [Avg. Prec. 41.12%; Run aplmohud, TD Auto, Pooled]
unine [Avg. Prec. 38.89%; Run UniNEhu3, TD Auto, Not Pooled]
90% miracle [Avg. Prec. 35.20%; Run xNP01ST1, TD Auto, Pooled]
hummingbird [Avg. Prec. 33.09%; Run humHU05tde, TD Auto, Pooled]
hildesheim [Avg. Prec. 32.64%; Run UHIHU2, TD Auto, Pooled]
80%
70%
Average Precision
60%
50%
40%
30%
20%
10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual HU − Retrieved documents vs Precision
100%
jhu−apl [Exact Prec. 40.92%, Run aplmohud, TD Auto, Pooled]
unine [Exact Prec. 38.64%, Run UniNEhu3, TD Auto, Not Pooled]
90% miracle [Exact Prec. 34.24%, Run xNP01ST1, TD Auto, Pooled]
hummingbird [Exact Prec. 34.00%, Run humHU05tde, TD Auto, Pooled]
hildesheim [Exact Prec. 32.91%, Run UHIHU2, TD Auto, Pooled]
80%
70%
60%
R−Precision
50%
40%
30%
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
A.55
Ad-Hoc Overview Graphs AH-Monolingual-HU
CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual HU − Comparison to median by topic (topics 251 to 275)
1
jhu−apl [Run aplmohud, TD Auto, Pooled]
unine [Run UniNEhu3, TD Auto, Not Pooled]
Difference (average precision)
miracle [Run xNP01ST1, TD Auto, Pooled]
0.5 hummingbird [Run humHU05tde, TD Auto, Pooled]
hildesheim [Run UHIHU2, TD Auto, Pooled]
0
−0.5
−1
251252253254255256257258259260261262263264265266267268269270271272273274275
Topic Number
CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual HU − Comparison to median by topic (topics 276 to 300)
1
jhu−apl [Run aplmohud, TD Auto, Pooled]
unine [Run UniNEhu3, TD Auto, Not Pooled]
Difference (average precision)
miracle [Run xNP01ST1, TD Auto, Pooled]
0.5 hummingbird [Run humHU05tde, TD Auto, Pooled]
hildesheim [Run UHIHU2, TD Auto, Pooled]
0
−0.5
−1
276277278279280281282283284285286287288289290291292293294295296297298299300
Topic Number
A.56
Ad-Hoc Overview Graphs AH-Monolingual-PT
CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual PT − Interpolated Recall vs Average Precision
100%
unine [Avg. Prec. 38.75%; Run UniNEpt2, TD Auto, Not Pooled]
hummingbird [Avg. Prec. 38.64%; Run humPT05tde, TD Auto, Not Pooled]
90% tlr [Avg. Prec. 37.42%; Run tlrTDptRF2, TD Auto, Not Pooled]
jhu−apl [Avg. Prec. 36.54%; Run aplmopte, TD Auto, Not Pooled]
alicante [Avg. Prec. 36.03%; Run IRn−pt−vexp, TD Auto, Pooled]
80%
70%
Average Precision
60%
50%
40%
30%
20%
10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual PT − Retrieved documents vs Precision
100%
unine [Exact Prec. 39.17%, Run UniNEpt2, TD Auto, Not Pooled]
hummingbird [Exact Prec. 40.55%, Run humPT05tde, TD Auto, Not Pooled]
90% tlr [Exact Prec. 39.04%, Run tlrTDptRF2, TD Auto, Not Pooled]
jhu−apl [Exact Prec. 37.00%, Run aplmopte, TD Auto, Not Pooled]
alicante [Exact Prec. 37.59%, Run IRn−pt−vexp, TD Auto, Pooled]
80%
70%
60%
R−Precision
50%
40%
30%
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
A.57
Ad-Hoc Overview Graphs AH-Monolingual-PT
CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual PT − Comparison to median by topic (topics 251 to 275)
1
unine [Run UniNEpt2, TD Auto, Not Pooled]
hummingbird [Run humPT05tde, TD Auto, Not Pooled]
Difference (average precision)
tlr [Run tlrTDptRF2, TD Auto, Not Pooled]
0.5 jhu−apl [Run aplmopte, TD Auto, Not Pooled]
alicante [Run IRn−pt−vexp, TD Auto, Pooled]
0
−0.5
−1
251252253254255256257258259260261262263264265266267268269270271272273274275
Topic Number
CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual PT − Comparison to median by topic (topics 276 to 300)
1
unine [Run UniNEpt2, TD Auto, Not Pooled]
hummingbird [Run humPT05tde, TD Auto, Not Pooled]
Difference (average precision)
tlr [Run tlrTDptRF2, TD Auto, Not Pooled]
0.5 jhu−apl [Run aplmopte, TD Auto, Not Pooled]
alicante [Run IRn−pt−vexp, TD Auto, Pooled]
0
−0.5
−1
276277278279280281282283284285286287288289290291292293294295296297298299300
Topic Number
# of Relevant Retrieved Docs @ 100 # of Relevant Retrieved Docs @ 1000 Average Precision %
Topic ID Best Median Worst Best Median Worst Best Median Worst
251 53 38 18 70 60 19 72.62 51.20 16.62
252 34 20 0 43 38 7 64.14 22.26 00.19
253 56 43 24 132 117 52 39.50 28.96 12.29
254 73 58 10 126 98 10 68.82 47.82 06.06
255 6 4 1 6 6 4 68.06 30.74 02.69
256 12 12 9 12 12 9 100.00 94.88 58.21
257 28 20 1 56 50 10 29.64 17.38 00.72
258 2 1 0 2 2 0 100.00 05.57 00.00
259 17 17 8 17 17 9 53.31 36.99 12.94
260 33 20 0 78 55 0 27.19 12.30 00.00
261 14 9 4 19 14 5 24.02 12.12 03.40
262 17 9 0 26 20 0 16.88 07.44 00.00
263 28 13 4 57 49 4 24.66 09.98 01.31
264 37 27 13 43 43 13 71.52 50.35 15.81
265 25 22 6 26 26 6 32.83 25.53 07.18
266 56 46 6 87 86 6 58.89 50.04 04.65
267 43 34 11 59 58 18 51.54 32.52 11.72
268 7 6 3 7 7 3 56.28 42.87 12.44
269 23 11 6 41 30 14 17.76 08.68 02.77
270 29 21 10 41 41 21 38.07 23.49 07.93
271 35 30 1 40 38 4 70.52 54.19 02.79
272 17 13 1 17 16 9 37.53 24.84 00.85
273 49 35 9 74 67 9 56.70 39.47 07.76
274 6 4 0 6 6 1 38.87 16.67 00.26
275 43 30 3 56 52 3 54.32 36.53 03.80
276 29 20 0 38 37 1 43.26 22.99 00.01
277 14 9 0 20 18 0 15.61 08.84 00.00
278 16 13 2 19 18 2 60.36 36.97 06.14
279 21 17 0 23 20 3 59.80 46.84 00.07
280 22 7 1 34 23 9 39.16 07.00 00.74
281 52 40 26 67 67 62 72.85 49.09 23.93
282 43 28 16 73 67 23 29.94 19.44 03.84
283 42 37 24 44 43 24 80.96 71.28 30.91
284 32 28 10 40 40 22 49.22 30.75 06.85
285 38 31 7 58 56 7 48.92 39.26 09.32
286 84 65 0 210 179 24 61.54 43.68 00.15
287 45 27 1 93 77 10 35.25 14.96 00.28
288 5 2 0 8 7 1 19.17 02.23 00.12
289 9 9 8 9 9 8 84.15 64.45 40.51
290 55 42 0 66 65 0 74.23 45.54 00.00
291 40 35 7 86 79 7 33.94 25.69 04.82
292 7 4 3 8 7 4 42.15 20.54 05.66
293 75 52 24 98 94 24 80.15 56.49 16.61
294 33 31 5 33 33 13 81.57 68.14 03.34
295 84 70 50 169 142 105 69.23 46.82 24.33
296 46 33 2 49 49 2 71.37 43.68 01.70
297 29 21 2 38 30 2 59.07 35.11 04.88
298 45 33 11 76 67 39 57.96 32.83 06.29
299 75 62 11 174 163 11 61.51 47.25 04.54
300 17 7 3 32 15 5 09.53 01.86 00.35
A.58
Ad-Hoc Overview Graphs AH-Monolingual-PT
CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual PT − Interpolated Recall vs Average Precision
100%
unine [Avg. Prec. 38.75%; Run UniNEpt2, TD Auto, Not Pooled]
hummingbird [Avg. Prec. 38.64%; Run humPT05tde, TD Auto, Not Pooled]
90% tlr [Avg. Prec. 37.42%; Run tlrTDptRF2, TD Auto, Not Pooled]
miracle [Avg. Prec. 36.98%; Run SR, TDN Auto, Pooled]
jhu−apl [Avg. Prec. 36.54%; Run aplmopte, TD Auto, Not Pooled]
80%
70%
Average Precision
60%
50%
40%
30%
20%
10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual PT − Retrieved documents vs Precision
100%
unine [Exact Prec. 39.17%, Run UniNEpt2, TD Auto, Not Pooled]
hummingbird [Exact Prec. 40.55%, Run humPT05tde, TD Auto, Not Pooled]
90% tlr [Exact Prec. 39.04%, Run tlrTDptRF2, TD Auto, Not Pooled]
miracle [Exact Prec. 37.71%, Run SR, TDN Auto, Pooled]
jhu−apl [Exact Prec. 37.00%, Run aplmopte, TD Auto, Not Pooled]
80%
70%
60%
R−Precision
50%
40%
30%
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
A.59
Ad-Hoc Overview Graphs AH-Monolingual-PT
CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual PT − Comparison to median by topic (topics 251 to 275)
1
unine [Run UniNEpt2, TD Auto, Not Pooled]
hummingbird [Run humPT05tde, TD Auto, Not Pooled]
Difference (average precision)
tlr [Run tlrTDptRF2, TD Auto, Not Pooled]
0.5 miracle [Run SR, TDN Auto, Pooled]
jhu−apl [Run aplmopte, TD Auto, Not Pooled]
0
−0.5
−1
251252253254255256257258259260261262263264265266267268269270271272273274275
Topic Number
CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual PT − Comparison to median by topic (topics 276 to 300)
1
unine [Run UniNEpt2, TD Auto, Not Pooled]
hummingbird [Run humPT05tde, TD Auto, Not Pooled]
Difference (average precision)
tlr [Run tlrTDptRF2, TD Auto, Not Pooled]
0.5 miracle [Run SR, TDN Auto, Pooled]
jhu−apl [Run aplmopte, TD Auto, Not Pooled]
0
−0.5
−1
276277278279280281282283284285286287288289290291292293294295296297298299300
Topic Number
A.60
Domain-Specific Overview Graphs DS-Multi
CLEF 2005 − Top 1 participants of Domain Specific Multilingual − Interpolated Recall vs Average Precision
100%
berkeley [Avg. Prec. 5.32%; Run BERK1MURUALL01, TD Auto, Not Pooled]
90%
80%
70%
Average Precision
60%
50%
40%
30%
20%
10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 − Top 1 participants of Domain Specific Multilingual − Retrieved documents vs Precision
100%
berkeley [Exact Prec. 12.12%, Run BERK1MURUALL01, TD Auto, Not Pooled]
90%
80%
70%
60%
R−Precision
50%
40%
30%
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
A.61
Domain-Specific Overview Graphs DS-Multi
CLEF 2005 − Top 1 participants of Domain Specific Multilingual − Comparison to median by topic (topics 126 to 138)
1
berkeley [Run BERK1MURUALL01, TD Auto, Not Pooled]
Difference (average precision)
0.5
0
−0.5
−1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic Number
CLEF 2005 − Top 1 participants of Domain Specific Multilingual − Comparison to median by topic (topics 139 to 150)
1
berkeley [Run BERK1MURUALL01, TD Auto, Not Pooled]
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
# of Relevant Retrieved Docs @ 100 # of Relevant Retrieved Docs @ 1000 Average Precision %
Topic ID Best Median Worst Best Median Worst Best Median Worst
126 51 28 4 100 87 65 13.05 06.78 01.31
127 29 26 16 101 59 44 03.87 02.29 01.71
128 21 17 8 187 104 38 06.46 03.34 01.24
129 0 0 0 1 1 0 00.01 00.01 00.00
130 9 7 4 41 25 23 02.33 01.07 01.03
131 15 9 5 35 25 8 02.09 00.78 00.19
132 54 6 4 142 115 52 21.26 03.55 01.23
133 3 0 0 15 9 5 00.56 00.53 00.04
134 15 11 7 42 41 37 09.78 08.57 03.58
135 4 3 2 7 5 4 00.56 00.23 00.15
136 3 2 2 14 6 6 00.20 00.10 00.03
137 8 7 5 24 18 12 01.32 01.30 00.38
138 18 16 16 35 31 21 05.98 05.37 03.02
139 18 12 5 51 50 13 01.61 01.32 00.35
140 9 4 3 38 8 8 01.66 00.45 00.14
141 19 2 1 46 25 11 05.12 01.82 00.12
142 23 3 1 47 15 9 05.00 00.64 00.14
143 14 1 0 27 7 4 09.19 00.21 00.09
144 27 27 24 56 54 51 21.49 16.62 16.03
145 36 28 16 137 68 50 11.33 05.25 02.04
146 27 21 15 45 43 22 30.28 20.99 13.63
147 7 2 2 27 7 5 00.80 00.29 00.13
148 6 6 1 15 11 4 01.82 01.05 00.57
149 6 4 3 18 14 14 01.39 00.75 00.46
150 19 11 4 156 41 35 03.62 01.06 00.26
A.62
Domain-Specific Overview Graphs DS-Multi
CLEF 2005 − Top 1 participants of Domain Specific Multilingual − Interpolated Recall vs Average Precision
100%
berkeley [Avg. Prec. 5.32%; Run BERK1MURUALL01, TD Auto, Not Pooled]
90%
80%
70%
Average Precision
60%
50%
40%
30%
20%
10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 − Top 1 participants of Domain Specific Multilingual − Retrieved documents vs Precision
100%
berkeley [Exact Prec. 12.12%, Run BERK1MURUALL01, TD Auto, Not Pooled]
90%
80%
70%
60%
R−Precision
50%
40%
30%
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
A.63
Domain-Specific Overview Graphs DS-Multi
CLEF 2005 − Top 1 participants of Domain Specific Multilingual − Comparison to median by topic (topics 126 to 138)
1
berkeley [Run BERK1MURUALL01, TD Auto, Not Pooled]
Difference (average precision)
0.5
0
−0.5
−1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic Number
CLEF 2005 − Top 1 participants of Domain Specific Multilingual − Comparison to median by topic (topics 139 to 150)
1
berkeley [Run BERK1MURUALL01, TD Auto, Not Pooled]
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.64
Domain-Specific Overview Graphs DS-Bilingual-X2DE
CLEF 2005 − Top 5 participants of Domain Specific Bilingual X2DE − Interpolated Recall vs Average Precision
100%
berkeley−2 [Avg. Prec. 42.01%; Run BK2GBLEG1, TD Auto, Pooled]
hagen [Avg. Prec. 23.99%; Run FUHegpyyd, TD Auto, Pooled]
90% u.glasgow [Avg. Prec. 19.46%; Run glaendetdqe, TD Auto, Pooled]
hildesheim [Avg. Prec. 17.79%; Run UHIGIRT3, TD Auto, Pooled]
berkeley [Avg. Prec. 16.87%; Run BERK1BLRUDE01, TD Auto, Pooled]
80%
70%
Average Precision
60%
50%
40%
30%
20%
10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 − Top 5 participants of Domain Specific Bilingual X2DE − Retrieved documents vs Precision
100%
berkeley−2 [Exact Prec. 41.92%, Run BK2GBLEG1, TD Auto, Pooled]
hagen [Exact Prec. 27.14%, Run FUHegpyyd, TD Auto, Pooled]
90% u.glasgow [Exact Prec. 22.43%, Run glaendetdqe, TD Auto, Pooled]
hildesheim [Exact Prec. 21.35%, Run UHIGIRT3, TD Auto, Pooled]
berkeley [Exact Prec. 19.73%, Run BERK1BLRUDE01, TD Auto, Pooled]
80%
70%
60%
R−Precision
50%
40%
30%
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
A.65
Domain-Specific Overview Graphs DS-Bilingual-X2DE
CLEF 2005 − Top 5 participants of Domain Specific Bilingual X2DE − Comparison to median by topic (topics 126 to 138)
1
berkeley−2 [Run BK2GBLEG1, TD Auto, Pooled]
hagen [Run FUHegpyyd, TD Auto, Pooled]
Difference (average precision)
u.glasgow [Run glaendetdqe, TD Auto, Pooled]
0.5 hildesheim [Run UHIGIRT3, TD Auto, Pooled]
berkeley [Run BERK1BLRUDE01, TD Auto, Pooled]
0
−0.5
−1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic Number
CLEF 2005 − Top 5 participants of Domain Specific Bilingual X2DE − Comparison to median by topic (topics 139 to 150)
1
berkeley−2 [Run BK2GBLEG1, TD Auto, Pooled]
hagen [Run FUHegpyyd, TD Auto, Pooled]
Difference (average precision)
u.glasgow [Run glaendetdqe, TD Auto, Pooled]
0.5 hildesheim [Run UHIGIRT3, TD Auto, Pooled]
berkeley [Run BERK1BLRUDE01, TD Auto, Pooled]
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
# of Relevant Retrieved Docs @ 100 # of Relevant Retrieved Docs @ 1000 Average Precision %
Topic ID Best Median Worst Best Median Worst Best Median Worst
126 53 46 12 154 125 106 35.45 24.61 07.66
127 87 84 10 271 262 53 62.47 59.40 01.76
128 89 8 0 255 45 12 66.96 01.43 00.06
129 7 1 0 7 2 0 44.57 00.23 00.00
130 54 31 4 75 63 14 73.77 33.98 00.79
131 60 17 3 97 38 13 55.04 08.43 00.69
132 95 93 83 151 151 116 91.29 86.87 67.52
133 11 6 0 27 21 0 12.39 05.22 00.00
134 17 12 0 24 22 4 45.15 17.79 00.06
135 3 0 0 11 4 0 05.28 00.16 00.00
136 28 7 0 85 48 2 13.60 02.48 00.01
137 70 45 9 91 73 24 65.75 36.34 04.90
138 11 2 0 19 4 0 03.25 01.42 00.00
139 63 26 2 172 87 21 44.17 07.49 00.40
140 59 19 1 86 36 5 56.75 10.92 00.04
141 59 43 0 70 66 0 80.17 48.37 00.00
142 45 22 2 60 44 11 58.67 20.32 00.34
143 18 11 5 18 17 7 32.83 22.10 06.97
144 11 8 1 15 13 10 42.06 16.80 03.25
145 78 66 23 143 137 74 63.44 53.42 11.07
146 28 21 9 32 29 11 64.53 48.74 12.20
147 54 31 1 104 65 8 55.44 22.73 00.12
148 34 9 3 40 22 15 46.66 07.98 00.97
149 21 16 1 46 38 11 30.75 17.81 00.31
150 90 77 14 278 212 28 58.76 43.62 01.10
A.66
Domain-Specific Overview Graphs DS-Bilingual-X2DE
CLEF 2005 − Top 5 participants of Domain Specific Bilingual X2DE − Interpolated Recall vs Average Precision
100%
berkeley−2 [Avg. Prec. 42.01%; Run BK2GBLEG1, TD Auto, Pooled]
hagen [Avg. Prec. 23.99%; Run FUHegpyyd, TD Auto, Pooled]
90% u.glasgow [Avg. Prec. 19.46%; Run glaendetdnqe, TDN Auto, Pooled]
hildesheim [Avg. Prec. 17.79%; Run UHIGIRT3, TD Auto, Pooled]
berkeley [Avg. Prec. 16.87%; Run BERK1BLRUDE01, TD Auto, Pooled]
80%
70%
Average Precision
60%
50%
40%
30%
20%
10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 − Top 5 participants of Domain Specific Bilingual X2DE − Retrieved documents vs Precision
100%
berkeley−2 [Exact Prec. 41.92%, Run BK2GBLEG1, TD Auto, Pooled]
hagen [Exact Prec. 27.14%, Run FUHegpyyd, TD Auto, Pooled]
90% u.glasgow [Exact Prec. 22.43%, Run glaendetdnqe, TDN Auto, Pooled]
hildesheim [Exact Prec. 21.35%, Run UHIGIRT3, TD Auto, Pooled]
berkeley [Exact Prec. 19.73%, Run BERK1BLRUDE01, TD Auto, Pooled]
80%
70%
60%
R−Precision
50%
40%
30%
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
A.67
Domain-Specific Overview Graphs DS-Bilingual-X2DE
CLEF 2005 − Top 5 participants of Domain Specific Bilingual X2DE − Comparison to median by topic (topics 126 to 138)
1
berkeley−2 [Run BK2GBLEG1, TD Auto, Pooled]
hagen [Run FUHegpyyd, TD Auto, Pooled]
Difference (average precision)
u.glasgow [Run glaendetdnqe, TDN Auto, Pooled]
0.5 hildesheim [Run UHIGIRT3, TD Auto, Pooled]
berkeley [Run BERK1BLRUDE01, TD Auto, Pooled]
0
−0.5
−1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic Number
CLEF 2005 − Top 5 participants of Domain Specific Bilingual X2DE − Comparison to median by topic (topics 139 to 150)
1
berkeley−2 [Run BK2GBLEG1, TD Auto, Pooled]
hagen [Run FUHegpyyd, TD Auto, Pooled]
Difference (average precision)
u.glasgow [Run glaendetdnqe, TDN Auto, Pooled]
0.5 hildesheim [Run UHIGIRT3, TD Auto, Pooled]
berkeley [Run BERK1BLRUDE01, TD Auto, Pooled]
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.68
Domain-Specific Overview Graphs DS-Bilingual-X2EN
CLEF 2005 − Top 3 participants of Domain Specific Bilingual X2EN − Interpolated Recall vs Average Precision
100%
berkeley−2 [Avg. Prec. 47.43%; Run BK2GBLGE2, TD Auto, Pooled]
u.glasgow [Avg. Prec. 38.99%; Run glaruentdqeD, TD Auto, Pooled]
90% berkeley [Avg. Prec. 23.98%; Run BERK1BLDEEN01, TD Auto, Pooled]
80%
70%
Average Precision
60%
50%
40%
30%
20%
10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 − Top 3 participants of Domain Specific Bilingual X2EN − Retrieved documents vs Precision
100%
berkeley−2 [Exact Prec. 46.82%, Run BK2GBLGE2, TD Auto, Pooled]
u.glasgow [Exact Prec. 41.56%, Run glaruentdqeD, TD Auto, Pooled]
90% berkeley [Exact Prec. 27.57%, Run BERK1BLDEEN01, TD Auto, Pooled]
80%
70%
60%
R−Precision
50%
40%
30%
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
A.69
Domain-Specific Overview Graphs DS-Bilingual-X2EN
CLEF 2005 − Top 3 participants of Domain Specific Bilingual X2EN − Comparison to median by topic (topics 126 to 138)
1
berkeley−2 [Run BK2GBLGE2, TD Auto, Pooled]
u.glasgow [Run glaruentdqeD, TD Auto, Pooled]
Difference (average precision)
berkeley [Run BERK1BLDEEN01, TD Auto, Pooled]
0.5
0
−0.5
−1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic Number
CLEF 2005 − Top 3 participants of Domain Specific Bilingual X2EN − Comparison to median by topic (topics 139 to 150)
1
berkeley−2 [Run BK2GBLGE2, TD Auto, Pooled]
u.glasgow [Run glaruentdqeD, TD Auto, Pooled]
Difference (average precision)
berkeley [Run BERK1BLDEEN01, TD Auto, Pooled]
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
# of Relevant Retrieved Docs @ 100 # of Relevant Retrieved Docs @ 1000 Average Precision %
Topic ID Best Median Worst Best Median Worst Best Median Worst
126 48 33 12 92 87 58 54.93 29.29 05.03
127 80 69 19 217 214 84 65.91 57.19 05.73
128 94 85 3 213 195 7 75.85 68.97 00.13
129 5 1 0 6 4 2 27.66 01.67 00.19
130 36 31 18 48 46 40 59.30 37.42 18.47
131 65 32 1 87 48 2 71.22 29.81 00.04
132 97 93 35 148 147 89 91.81 90.08 18.14
133 8 3 1 9 8 6 35.41 10.46 01.72
134 19 14 11 24 24 19 45.26 28.66 07.17
135 5 4 1 10 8 5 12.04 08.16 00.68
136 54 48 9 103 101 27 57.60 46.50 02.93
137 27 15 1 44 21 4 37.27 21.93 00.22
138 32 21 13 43 34 21 45.66 28.31 14.27
139 52 23 14 139 98 74 41.39 12.35 08.21
140 53 50 6 65 64 9 65.18 51.89 01.34
141 55 42 0 58 56 0 90.72 63.11 00.00
142 36 25 16 44 44 39 66.62 38.90 15.46
143 30 26 19 32 27 27 41.66 36.33 23.25
144 42 32 28 50 49 40 67.65 50.86 29.19
145 71 55 20 130 121 67 60.12 40.07 07.26
146 28 26 21 28 28 21 92.70 85.35 62.86
147 56 51 4 100 84 19 49.51 43.94 02.04
148 32 12 8 37 20 15 45.89 09.05 04.44
149 32 10 5 42 33 10 69.91 09.86 01.31
150 89 60 5 211 157 36 64.53 34.23 00.79
A.70
Domain-Specific Overview Graphs DS-Bilingual-X2EN
CLEF 2005 − Top 4 participants of Domain Specific Bilingual X2EN − Interpolated Recall vs Average Precision
100%
berkeley−2 [Avg. Prec. 47.43%; Run BK2GBLGE2, TD Auto, Pooled]
u.glasgow [Avg. Prec. 38.99%; Run glaruentdqeD, TD Auto, Pooled]
90% msu−nivc [Avg. Prec. 24.03%; Run cirGIRTru2en, TDN Auto, Pooled]
berkeley [Avg. Prec. 23.98%; Run BERK1BLDEEN01, TD Auto, Pooled]
80%
70%
Average Precision
60%
50%
40%
30%
20%
10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 − Top 4 participants of Domain Specific Bilingual X2EN − Retrieved documents vs Precision
100%
berkeley−2 [Exact Prec. 46.82%, Run BK2GBLGE2, TD Auto, Pooled]
u.glasgow [Exact Prec. 41.56%, Run glaruentdqeD, TD Auto, Pooled]
90% msu−nivc [Exact Prec. 27.37%, Run cirGIRTru2en, TDN Auto, Pooled]
berkeley [Exact Prec. 27.57%, Run BERK1BLDEEN01, TD Auto, Pooled]
80%
70%
60%
R−Precision
50%
40%
30%
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
A.71
Domain-Specific Overview Graphs DS-Bilingual-X2EN
CLEF 2005 − Top 4 participants of Domain Specific Bilingual X2EN − Comparison to median by topic (topics 126 to 138)
1
berkeley−2 [Run BK2GBLGE2, TD Auto, Pooled]
u.glasgow [Run glaruentdqeD, TD Auto, Pooled]
Difference (average precision)
msu−nivc [Run cirGIRTru2en, TDN Auto, Pooled]
0.5 berkeley [Run BERK1BLDEEN01, TD Auto, Pooled]
0
−0.5
−1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic Number
CLEF 2005 − Top 4 participants of Domain Specific Bilingual X2EN − Comparison to median by topic (topics 139 to 150)
1
berkeley−2 [Run BK2GBLGE2, TD Auto, Pooled]
u.glasgow [Run glaruentdqeD, TD Auto, Pooled]
Difference (average precision)
msu−nivc [Run cirGIRTru2en, TDN Auto, Pooled]
0.5 berkeley [Run BERK1BLDEEN01, TD Auto, Pooled]
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.72
Domain-Specific Overview Graphs DS-Bilingual-X2RU
CLEF 2005 − Top 2 participants of Domain Specific Bilingual X2RU − Interpolated Recall vs Average Precision
100%
berkeley−2 [Avg. Prec. 23.31%; Run BK2GBLGR1, TD Auto, Pooled]
berkeley [Avg. Prec. 17.17%; Run BERK1BLDERU01, TD Auto, Pooled]
90%
80%
70%
Average Precision
60%
50%
40%
30%
20%
10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 − Top 2 participants of Domain Specific Bilingual X2RU − Retrieved documents vs Precision
100%
berkeley−2 [Exact Prec. 25.01%, Run BK2GBLGR1, TD Auto, Pooled]
berkeley [Exact Prec. 18.64%, Run BERK1BLDERU01, TD Auto, Pooled]
90%
80%
70%
60%
R−Precision
50%
40%
30%
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
A.73
Domain-Specific Overview Graphs DS-Bilingual-X2RU
CLEF 2005 − Top 2 participants of Domain Specific Bilingual X2RU − Comparison to median by topic (topics 126 to 138)
1
berkeley−2 [Run BK2GBLGR1, TD Auto, Pooled]
berkeley [Run BERK1BLDERU01, TD Auto, Pooled]
Difference (average precision)
0.5
0
−0.5
−1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic Number
CLEF 2005 − Top 2 participants of Domain Specific Bilingual X2RU − Comparison to median by topic (topics 139 to 150)
1
berkeley−2 [Run BK2GBLGR1, TD Auto, Pooled]
berkeley [Run BERK1BLDERU01, TD Auto, Pooled]
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
# of Relevant Retrieved Docs @ 100 # of Relevant Retrieved Docs @ 1000 Average Precision %
Topic ID Best Median Worst Best Median Worst Best Median Worst
126 26 18 3 30 27 3 51.82 41.19 00.26
127 83 71 17 112 105 17 86.91 68.72 11.62
128 28 21 0 44 41 2 37.93 23.74 00.02
129 0 0 0 1 0 0 00.21 00.00 00.00
130 3 1 0 4 3 3 05.97 00.61 00.25
131 2 2 0 2 2 0 52.94 09.76 00.00
132 4 1 0 4 1 0 30.40 12.50 00.00
133 6 4 0 7 5 0 46.43 10.71 00.00
134 4 3 1 11 9 1 09.13 02.00 00.72
135 19 11 2 54 40 2 18.76 08.01 00.55
136 22 7 2 33 26 7 11.09 02.20 00.22
137 15 8 0 20 17 0 19.10 11.14 00.00
138 12 3 0 26 7 0 17.70 04.32 00.00
139 61 39 13 112 74 13 51.45 22.41 07.76
140 5 3 2 10 9 2 03.58 02.71 02.55
141 11 10 0 14 14 0 20.86 19.33 00.00
142 25 12 1 79 16 13 28.86 06.78 00.50
143 2 2 0 2 2 0 100.00 73.81 00.00
144 3 0 0 4 4 3 02.70 01.37 00.65
145 78 66 22 100 99 24 68.21 59.49 14.75
146 0 0 0 0 0 0 00.00 00.00 00.00
147 0 0 0 1 0 0 00.16 00.00 00.00
148 5 3 0 6 5 0 16.18 06.39 00.00
149 4 2 0 5 5 0 08.80 02.57 00.00
150 1 1 0 2 1 0 01.78 01.39 00.00
A.74
Domain-Specific Overview Graphs DS-Bilingual-X2RU
CLEF 2005 − Top 3 participants of Domain Specific Bilingual X2RU − Interpolated Recall vs Average Precision
100%
berkeley−2 [Avg. Prec. 23.31%; Run BK2GBLGR1, TD Auto, Pooled]
berkeley [Avg. Prec. 17.17%; Run BERK1BLDERU01, TD Auto, Pooled]
90% msu−nivc [Avg. Prec. 2.16%; Run cirRSSCen2ru, TDN Auto, Pooled]
80%
70%
Average Precision
60%
50%
40%
30%
20%
10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 − Top 3 participants of Domain Specific Bilingual X2RU − Retrieved documents vs Precision
100%
berkeley−2 [Exact Prec. 25.01%, Run BK2GBLGR1, TD Auto, Pooled]
berkeley [Exact Prec. 18.64%, Run BERK1BLDERU01, TD Auto, Pooled]
90% msu−nivc [Exact Prec. 3.43%, Run cirRSSCen2ru, TDN Auto, Pooled]
80%
70%
60%
R−Precision
50%
40%
30%
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
A.75
Domain-Specific Overview Graphs DS-Bilingual-X2RU
CLEF 2005 − Top 3 participants of Domain Specific Bilingual X2RU − Comparison to median by topic (topics 126 to 138)
1
berkeley−2 [Run BK2GBLGR1, TD Auto, Pooled]
berkeley [Run BERK1BLDERU01, TD Auto, Pooled]
Difference (average precision)
msu−nivc [Run cirRSSCen2ru, TDN Auto, Pooled]
0.5
0
−0.5
−1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic Number
CLEF 2005 − Top 3 participants of Domain Specific Bilingual X2RU − Comparison to median by topic (topics 139 to 150)
1
berkeley−2 [Run BK2GBLGR1, TD Auto, Pooled]
berkeley [Run BERK1BLDERU01, TD Auto, Pooled]
Difference (average precision)
msu−nivc [Run cirRSSCen2ru, TDN Auto, Pooled]
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.76
Domain-Specific Overview Graphs DS-Monolingual-DE
CLEF 2005 − Top 5 participants of Domain Specific Monolingual DE − Interpolated Recall vs Average Precision
100%
berkeley−2 [Avg. Prec. 49.36%; Run BK2GMLGG3, TD Auto, Pooled]
unine [Avg. Prec. 49.21%; Run UniNEgde1, TD Auto, Pooled]
90% hagen [Avg. Prec. 30.31%; Run FUHggyydbf, TD Auto, Pooled]
u.glasgow [Avg. Prec. 30.29%; Run gladetdqe, TD Auto, Pooled]
berkeley [Avg. Prec. 23.14%; Run BERK1MLDE01, TD Auto, Pooled]
80%
70%
Average Precision
60%
50%
40%
30%
20%
10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 − Top 5 participants of Domain Specific Monolingual DE − Retrieved documents vs Precision
100%
berkeley−2 [Exact Prec. 48.89%, Run BK2GMLGG3, TD Auto, Pooled]
unine [Exact Prec. 49.02%, Run UniNEgde1, TD Auto, Pooled]
90% hagen [Exact Prec. 32.71%, Run FUHggyydbf, TD Auto, Pooled]
u.glasgow [Exact Prec. 32.44%, Run gladetdqe, TD Auto, Pooled]
berkeley [Exact Prec. 26.87%, Run BERK1MLDE01, TD Auto, Pooled]
80%
70%
60%
R−Precision
50%
40%
30%
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
A.77
Domain-Specific Overview Graphs DS-Monolingual-DE
CLEF 2005 − Top 5 participants of Domain Specific Monolingual DE − Comparison to median by topic (topics 126 to 138)
1
berkeley−2 [Run BK2GMLGG3, TD Auto, Pooled]
unine [Run UniNEgde1, TD Auto, Pooled]
Difference (average precision)
hagen [Run FUHggyydbf, TD Auto, Pooled]
0.5 u.glasgow [Run gladetdqe, TD Auto, Pooled]
berkeley [Run BERK1MLDE01, TD Auto, Pooled]
0
−0.5
−1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic Number
CLEF 2005 − Top 5 participants of Domain Specific Monolingual DE − Comparison to median by topic (topics 139 to 150)
1
berkeley−2 [Run BK2GMLGG3, TD Auto, Pooled]
unine [Run UniNEgde1, TD Auto, Pooled]
Difference (average precision)
hagen [Run FUHggyydbf, TD Auto, Pooled]
0.5 u.glasgow [Run gladetdqe, TD Auto, Pooled]
berkeley [Run BERK1MLDE01, TD Auto, Pooled]
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
# of Relevant Retrieved Docs @ 100 # of Relevant Retrieved Docs @ 1000 Average Precision %
Topic ID Best Median Worst Best Median Worst Best Median Worst
126 64 49 29 162 135 101 44.02 28.15 14.52
127 93 80 6 290 265 48 70.02 61.75 01.39
128 91 83 64 250 203 159 66.53 53.38 34.83
129 7 4 2 8 7 4 51.79 20.62 04.07
130 55 12 1 75 31 8 74.01 05.20 00.12
131 73 35 12 106 62 32 70.00 27.14 03.33
132 95 90 54 152 149 117 90.23 80.31 47.85
133 14 8 5 27 22 10 16.03 07.96 03.46
134 20 15 10 24 23 20 45.08 34.53 15.33
135 9 3 0 13 7 3 09.35 01.76 00.11
136 81 57 36 151 127 85 72.65 43.74 15.82
137 75 52 24 101 82 42 75.42 48.01 10.57
138 29 6 0 44 11 2 42.19 05.89 00.01
139 84 44 15 180 134 86 63.13 23.99 06.50
140 64 20 0 92 39 3 57.68 11.84 00.02
141 61 47 0 70 68 0 83.59 67.92 00.00
142 41 25 14 64 55 43 56.70 22.68 09.00
143 17 12 9 18 17 11 37.88 24.66 09.90
144 9 8 0 15 13 10 24.56 09.62 01.37
145 87 72 38 156 151 87 76.68 63.72 23.43
146 31 25 14 32 31 21 87.72 70.41 31.57
147 65 45 0 99 63 0 66.16 30.54 00.00
148 31 20 9 42 35 22 57.13 32.47 07.94
149 34 22 10 47 45 28 49.23 29.57 12.62
150 94 85 4 290 234 47 65.09 52.01 00.80
A.78
Domain-Specific Overview Graphs DS-Monolingual-DE
CLEF 2005 − Top 5 participants of Domain Specific Monolingual DE − Interpolated Recall vs Average Precision
100%
berkeley−2 [Avg. Prec. 49.36%; Run BK2GMLGG3, TD Auto, Pooled]
unine [Avg. Prec. 49.21%; Run UniNEgde1, TD Auto, Pooled]
90% hagen [Avg. Prec. 30.31%; Run FUHggyydbf, TD Auto, Pooled]
u.glasgow [Avg. Prec. 30.29%; Run gladetdqe, TD Auto, Pooled]
berkeley [Avg. Prec. 23.14%; Run BERK1MLDE01, TD Auto, Pooled]
80%
70%
Average Precision
60%
50%
40%
30%
20%
10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 − Top 5 participants of Domain Specific Monolingual DE − Retrieved documents vs Precision
100%
berkeley−2 [Exact Prec. 48.89%, Run BK2GMLGG3, TD Auto, Pooled]
unine [Exact Prec. 49.02%, Run UniNEgde1, TD Auto, Pooled]
90% hagen [Exact Prec. 32.71%, Run FUHggyydbf, TD Auto, Pooled]
u.glasgow [Exact Prec. 32.44%, Run gladetdqe, TD Auto, Pooled]
berkeley [Exact Prec. 26.87%, Run BERK1MLDE01, TD Auto, Pooled]
80%
70%
60%
R−Precision
50%
40%
30%
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
A.79
Domain-Specific Overview Graphs DS-Monolingual-DE
CLEF 2005 − Top 5 participants of Domain Specific Monolingual DE − Comparison to median by topic (topics 126 to 138)
1
berkeley−2 [Run BK2GMLGG3, TD Auto, Pooled]
unine [Run UniNEgde1, TD Auto, Pooled]
Difference (average precision)
hagen [Run FUHggyydbf, TD Auto, Pooled]
0.5 u.glasgow [Run gladetdqe, TD Auto, Pooled]
berkeley [Run BERK1MLDE01, TD Auto, Pooled]
0
−0.5
−1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic Number
CLEF 2005 − Top 5 participants of Domain Specific Monolingual DE − Comparison to median by topic (topics 139 to 150)
1
berkeley−2 [Run BK2GMLGG3, TD Auto, Pooled]
unine [Run UniNEgde1, TD Auto, Pooled]
Difference (average precision)
hagen [Run FUHggyydbf, TD Auto, Pooled]
0.5 u.glasgow [Run gladetdqe, TD Auto, Pooled]
berkeley [Run BERK1MLDE01, TD Auto, Pooled]
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.80
Domain-Specific Overview Graphs DS-Monolingual-EN
CLEF 2005 − Top 5 participants of Domain Specific Monolingual EN − Interpolated Recall vs Average Precision
100%
unine [Avg. Prec. 50.65%; Run UniNEgen1, TD Auto, Pooled]
berkeley−2 [Avg. Prec. 46.97%; Run BK2GMLEE3, TD Auto, Pooled]
90% u.glasgow [Avg. Prec. 34.84%; Run glaentd, TD Auto, Pooled]
berkeley [Avg. Prec. 32.91%; Run BERK1MLEN01, TD Auto, Pooled]
irit [Avg. Prec. 32.35%; Run CWNSETD, TD Auto, Pooled]
80%
70%
Average Precision
60%
50%
40%
30%
20%
10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 − Top 5 participants of Domain Specific Monolingual EN − Retrieved documents vs Precision
100%
unine [Exact Prec. 49.15%, Run UniNEgen1, TD Auto, Pooled]
berkeley−2 [Exact Prec. 46.33%, Run BK2GMLEE3, TD Auto, Pooled]
90% u.glasgow [Exact Prec. 36.98%, Run glaentd, TD Auto, Pooled]
berkeley [Exact Prec. 36.46%, Run BERK1MLEN01, TD Auto, Pooled]
irit [Exact Prec. 34.03%, Run CWNSETD, TD Auto, Pooled]
80%
70%
60%
R−Precision
50%
40%
30%
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
A.81
Domain-Specific Overview Graphs DS-Monolingual-EN
CLEF 2005 − Top 5 participants of Domain Specific Monolingual EN − Comparison to median by topic (topics 126 to 138)
1
unine [Run UniNEgen1, TD Auto, Pooled]
berkeley−2 [Run BK2GMLEE3, TD Auto, Pooled]
Difference (average precision)
u.glasgow [Run glaentd, TD Auto, Pooled]
0.5 berkeley [Run BERK1MLEN01, TD Auto, Pooled]
irit [Run CWNSETD, TD Auto, Pooled]
0
−0.5
−1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic Number
CLEF 2005 − Top 5 participants of Domain Specific Monolingual EN − Comparison to median by topic (topics 139 to 150)
1
unine [Run UniNEgen1, TD Auto, Pooled]
berkeley−2 [Run BK2GMLEE3, TD Auto, Pooled]
Difference (average precision)
u.glasgow [Run glaentd, TD Auto, Pooled]
0.5 berkeley [Run BERK1MLEN01, TD Auto, Pooled]
irit [Run CWNSETD, TD Auto, Pooled]
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
# of Relevant Retrieved Docs @ 100 # of Relevant Retrieved Docs @ 1000 Average Precision %
Topic ID Best Median Worst Best Median Worst Best Median Worst
126 51 46 2 91 83 18 48.01 41.73 00.43
127 78 59 30 218 189 88 57.43 40.59 14.17
128 97 85 1 217 213 12 81.44 69.28 00.16
129 5 1 0 6 5 1 08.14 01.02 00.13
130 39 30 25 48 48 41 66.75 52.93 37.38
131 65 36 2 89 54 2 76.00 38.59 02.20
132 98 92 0 149 144 0 93.40 87.84 00.00
133 8 2 0 10 7 4 25.19 02.58 00.36
134 19 14 4 24 23 11 49.03 32.19 04.28
135 9 5 1 11 10 7 48.13 15.38 03.94
136 65 51 22 105 102 45 69.99 54.33 12.06
137 45 15 1 54 17 4 74.42 21.91 00.22
138 29 17 4 41 20 8 32.01 12.56 04.01
139 69 38 20 148 115 56 56.83 19.80 09.60
140 58 54 34 65 64 54 68.20 54.40 37.17
141 54 50 35 58 55 52 86.29 79.91 40.93
142 43 36 5 46 44 40 79.79 60.35 06.42
143 30 25 19 32 27 27 41.28 32.80 19.39
144 39 32 9 50 47 38 56.25 38.69 08.98
145 75 61 15 134 122 51 63.20 50.67 03.96
146 28 26 21 28 28 21 92.89 87.75 69.34
147 68 56 36 103 102 76 76.03 60.58 35.68
148 15 9 5 24 22 9 20.47 09.87 03.49
149 32 8 4 42 18 11 69.91 05.20 01.47
150 92 72 15 225 182 27 71.08 45.05 02.72
A.82
Domain-Specific Overview Graphs DS-Monolingual-EN
CLEF 2005 − Top 5 participants of Domain Specific Monolingual EN − Interpolated Recall vs Average Precision
100%
unine [Avg. Prec. 50.65%; Run UniNEgen1, TD Auto, Pooled]
berkeley−2 [Avg. Prec. 46.97%; Run BK2GMLEE3, TD Auto, Pooled]
90% u.glasgow [Avg. Prec. 41.71%; Run glaentdnqe, TDN Auto, Pooled]
irit [Avg. Prec. 34.11%; Run CWNT, T Auto, Pooled]
80% berkeley [Avg. Prec. 32.91%; Run BERK1MLEN01, TD Auto, Pooled]
70%
Average Precision
60%
50%
40%
30%
20%
10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 − Top 5 participants of Domain Specific Monolingual EN − Retrieved documents vs Precision
100%
unine [Exact Prec. 49.15%, Run UniNEgen1, TD Auto, Pooled]
berkeley−2 [Exact Prec. 46.33%, Run BK2GMLEE3, TD Auto, Pooled]
90% u.glasgow [Exact Prec. 42.11%, Run glaentdnqe, TDN Auto, Pooled]
irit [Exact Prec. 35.06%, Run CWNT, T Auto, Pooled]
80% berkeley [Exact Prec. 36.46%, Run BERK1MLEN01, TD Auto, Pooled]
70%
60%
R−Precision
50%
40%
30%
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
A.83
Domain-Specific Overview Graphs DS-Monolingual-EN
CLEF 2005 − Top 5 participants of Domain Specific Monolingual EN − Comparison to median by topic (topics 126 to 138)
1
unine [Run UniNEgen1, TD Auto, Pooled]
berkeley−2 [Run BK2GMLEE3, TD Auto, Pooled]
Difference (average precision)
u.glasgow [Run glaentdnqe, TDN Auto, Pooled]
0.5 irit [Run CWNT, T Auto, Pooled]
berkeley [Run BERK1MLEN01, TD Auto, Pooled]
0
−0.5
−1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic Number
CLEF 2005 − Top 5 participants of Domain Specific Monolingual EN − Comparison to median by topic (topics 139 to 150)
1
unine [Run UniNEgen1, TD Auto, Pooled]
berkeley−2 [Run BK2GMLEE3, TD Auto, Pooled]
Difference (average precision)
u.glasgow [Run glaentdnqe, TDN Auto, Pooled]
0.5 irit [Run CWNT, T Auto, Pooled]
berkeley [Run BERK1MLEN01, TD Auto, Pooled]
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.84
Domain-Specific Overview Graphs DS-Monolingual-RU
CLEF 2005 − Top 4 participants of Domain Specific Monolingual RU − Interpolated Recall vs Average Precision
100%
berkeley−2 [Avg. Prec. 30.38%; Run BK2GMLRU1, TD Auto, Pooled]
unine [Avg. Prec. 27.74%; Run UniNEgru2, TD Auto, Pooled]
90% berkeley [Avg. Prec. 24.09%; Run BERK1MLRU01, TD Auto, Pooled]
u.glasgow [Avg. Prec. 5.53%; Run glarutdqe, TD Auto, Pooled]
80%
70%
Average Precision
60%
50%
40%
30%
20%
10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 − Top 4 participants of Domain Specific Monolingual RU − Retrieved documents vs Precision
100%
berkeley−2 [Exact Prec. 29.42%, Run BK2GMLRU1, TD Auto, Pooled]
unine [Exact Prec. 28.32%, Run UniNEgru2, TD Auto, Pooled]
90% berkeley [Exact Prec. 24.71%, Run BERK1MLRU01, TD Auto, Pooled]
u.glasgow [Exact Prec. 6.89%, Run glarutdqe, TD Auto, Pooled]
80%
70%
60%
R−Precision
50%
40%
30%
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
A.85
Domain-Specific Overview Graphs DS-Monolingual-RU
CLEF 2005 − Top 4 participants of Domain Specific Monolingual RU − Comparison to median by topic (topics 126 to 138)
1
berkeley−2 [Run BK2GMLRU1, TD Auto, Pooled]
unine [Run UniNEgru2, TD Auto, Pooled]
Difference (average precision)
berkeley [Run BERK1MLRU01, TD Auto, Pooled]
0.5 u.glasgow [Run glarutdqe, TD Auto, Pooled]
0
−0.5
−1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic Number
CLEF 2005 − Top 4 participants of Domain Specific Monolingual RU − Comparison to median by topic (topics 139 to 150)
1
berkeley−2 [Run BK2GMLRU1, TD Auto, Pooled]
unine [Run UniNEgru2, TD Auto, Pooled]
Difference (average precision)
berkeley [Run BERK1MLRU01, TD Auto, Pooled]
0.5 u.glasgow [Run glarutdqe, TD Auto, Pooled]
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
# of Relevant Retrieved Docs @ 100 # of Relevant Retrieved Docs @ 1000 Average Precision %
Topic ID Best Median Worst Best Median Worst Best Median Worst
126 27 15 3 30 26 3 54.37 20.04 00.75
127 88 84 15 113 110 19 90.36 82.95 10.38
128 38 23 3 46 44 7 70.85 26.12 00.59
129 3 3 0 3 3 0 05.96 02.79 00.00
130 4 1 0 6 2 1 12.27 01.43 00.01
131 2 0 0 2 0 0 100.00 00.05 00.00
132 1 1 0 3 1 0 12.50 02.70 00.00
133 7 2 0 7 6 0 17.91 06.06 00.00
134 23 6 0 25 12 1 39.17 09.92 00.18
135 45 18 0 56 48 2 53.40 14.63 00.01
136 62 37 5 85 76 7 69.05 50.87 00.50
137 15 8 0 20 17 0 28.70 17.96 00.00
138 27 21 2 28 28 2 53.13 47.02 02.41
139 71 51 13 124 115 14 61.60 42.82 02.54
140 7 4 1 10 9 2 05.03 03.68 00.72
141 15 1 0 19 3 0 28.47 04.54 00.00
142 62 29 12 81 80 13 76.98 30.85 06.80
143 2 2 0 2 2 0 100.00 26.66 00.00
144 4 0 0 6 4 3 04.02 00.89 00.43
145 75 64 2 108 98 22 65.53 58.08 00.87
146 1 0 0 1 1 0 04.35 01.97 00.00
147 1 0 0 1 0 0 12.50 00.00 00.00
148 7 5 0 8 6 0 39.39 24.92 00.00
149 3 1 0 5 4 0 20.66 01.10 00.00
150 0 0 0 0 0 0 00.00 00.00 00.00
A.86
Domain-Specific Overview Graphs DS-Monolingual-RU
CLEF 2005 − Top 5 participants of Domain Specific Monolingual RU − Interpolated Recall vs Average Precision
100%
berkeley−2 [Avg. Prec. 30.38%; Run BK2GMLRU1, TD Auto, Pooled]
unine [Avg. Prec. 27.74%; Run UniNEgru2, TD Auto, Pooled]
90% berkeley [Avg. Prec. 24.09%; Run BERK1MLRU01, TD Auto, Pooled]
u.glasgow [Avg. Prec. 5.53%; Run glarutdqe, TD Auto, Pooled]
msu−nivc [Avg. Prec. 2.09%; Run cirRSSCru2ru, TDN Auto, Pooled]
80%
70%
Average Precision
60%
50%
40%
30%
20%
10%
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 − Top 5 participants of Domain Specific Monolingual RU − Retrieved documents vs Precision
100%
berkeley−2 [Exact Prec. 29.42%, Run BK2GMLRU1, TD Auto, Pooled]
unine [Exact Prec. 28.32%, Run UniNEgru2, TD Auto, Pooled]
90% berkeley [Exact Prec. 24.71%, Run BERK1MLRU01, TD Auto, Pooled]
u.glasgow [Exact Prec. 6.89%, Run glarutdqe, TD Auto, Pooled]
msu−nivc [Exact Prec. 3.74%, Run cirRSSCru2ru, TDN Auto, Pooled]
80%
70%
60%
R−Precision
50%
40%
30%
20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
A.87
Domain-Specific Overview Graphs DS-Monolingual-RU
CLEF 2005 − Top 5 participants of Domain Specific Monolingual RU − Comparison to median by topic (topics 126 to 138)
1
berkeley−2 [Run BK2GMLRU1, TD Auto, Pooled]
unine [Run UniNEgru2, TD Auto, Pooled]
Difference (average precision)
berkeley [Run BERK1MLRU01, TD Auto, Pooled]
0.5 u.glasgow [Run glarutdqe, TD Auto, Pooled]
msu−nivc [Run cirRSSCru2ru, TDN Auto, Pooled]
0
−0.5
−1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic Number
CLEF 2005 − Top 5 participants of Domain Specific Monolingual RU − Comparison to median by topic (topics 139 to 150)
1
berkeley−2 [Run BK2GMLRU1, TD Auto, Pooled]
unine [Run UniNEgru2, TD Auto, Pooled]
Difference (average precision)
berkeley [Run BERK1MLRU01, TD Auto, Pooled]
0.5 u.glasgow [Run glarutdqe, TD Auto, Pooled]
msu−nivc [Run cirRSSCru2ru, TDN Auto, Pooled]
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.88
Individual Results
A.89
A.90
cmu adhocM3Trntest AH-2-years-on
Overall statistics for 40 queries : General info:
Total number of documents over all queries Track= Ad Hoc Multilingual 2-years-on
Retrieved 40,000 RunType= automatic
Relevant 7,153 QueryType= TD
Relevant retrieved 4,807 Pooled= false
CLEF 2005 AH−2−years−on − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 86.49 adhocM3Trntest
90%
10 72.16
20 64.25 80%
30 58.40
70%
40 51.33
50 44.30
Average Precision
60%
60 38.43
50%
70 29.43
80 21.68 40%
90 14.40
30%
100 4.15
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
43.06
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−2−years−on − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 72.50 adhocM3Trntest
90%
10 docs 67.00
15 docs 61.83 80%
20 docs 59.25
70%
30 docs 55.42
100 docs 39.75 60%
R−Precision
200 docs 30.92
50%
500 docs 19.54
1000 docs 12.02 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
44.99 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 161 to 180)
queries 1
adhocM3Trntest
Topic 161 31.30 Topic 181 33.06
Difference (average precision)
Topic 162 81.42 Topic 182 53.13 0.5
Topic 163 72.17 Topic 183 36.71
Topic 164 2.93 Topic 184 28.88
Topic 165 33.45 Topic 185 25.76 0
Topic 166 0.54 Topic 186 50.95
Topic 167 51.20 Topic 187 66.21
−0.5
Topic 168 19.61 Topic 188 36.59
Topic 169 1.94 Topic 189 66.48
Topic 170 67.67 Topic 190 7.41 −1
161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180
Topic 171 1.86 Topic 191 100.00 Topic Number
Topic 172 6.18 Topic 192 62.18
Topic 173 62.01 Topic 193 29.56
CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 181 to 200)
Topic 174 66.66 Topic 194 62.79 1
Topic 175 66.66 Topic 195 36.42 adhocM3Trntest
Difference (average precision)
Topic 176 86.76 Topic 196 72.22
0.5
Topic 177 31.09 Topic 197 49.49
Topic 178 5.12 Topic 198 21.43
Topic 179 49.60 Topic 199 72.29 0
Topic 180 36.54 Topic 200 35.95
−0.5
−1
181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200
Topic Number
A.91
cmu adhocM4Trntest AH-2-years-on
Overall statistics for 40 queries : General info:
Total number of documents over all queries Track= Ad Hoc Multilingual 2-years-on
Retrieved 40,000 RunType= automatic
Relevant 7,153 QueryType= TD
Relevant retrieved 4,927 Pooled= false
CLEF 2005 AH−2−years−on − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 88.36 adhocM4Trntest
90%
10 71.76
20 64.78 80%
30 56.37
70%
40 51.20
50 44.28
Average Precision
60%
60 39.36
50%
70 30.10
80 22.45 40%
90 15.14
30%
100 4.29
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
43.42
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−2−years−on − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 70.00 adhocM4Trntest
90%
10 docs 65.25
15 docs 62.50 80%
20 docs 59.25
70%
30 docs 55.75
100 docs 40.45 60%
R−Precision
200 docs 31.61
50%
500 docs 19.93
1000 docs 12.32 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
44.80 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 161 to 180)
queries 1
adhocM4Trntest
Topic 161 29.47 Topic 181 32.81
Difference (average precision)
Topic 162 85.84 Topic 182 50.17 0.5
Topic 163 74.57 Topic 183 36.12
Topic 164 4.05 Topic 184 31.57
Topic 165 34.81 Topic 185 17.15 0
Topic 166 0.74 Topic 186 51.45
Topic 167 51.07 Topic 187 60.46
−0.5
Topic 168 21.41 Topic 188 34.87
Topic 169 2.15 Topic 189 67.67
Topic 170 58.68 Topic 190 7.87 −1
161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180
Topic 171 1.89 Topic 191 100.00 Topic Number
Topic 172 6.15 Topic 192 77.60
Topic 173 56.47 Topic 193 27.91
CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 181 to 200)
Topic 174 67.87 Topic 194 64.67 1
Topic 175 64.77 Topic 195 38.74 adhocM4Trntest
Difference (average precision)
Topic 176 88.19 Topic 196 73.08
0.5
Topic 177 35.06 Topic 197 53.64
Topic 178 6.03 Topic 198 18.91
Topic 179 52.79 Topic 199 71.29 0
Topic 180 39.61 Topic 200 39.07
−0.5
−1
181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200
Topic Number
A.92
cmu adhocM5Trntest AH-2-years-on
Overall statistics for 40 queries : General info:
Total number of documents over all queries Track= Ad Hoc Multilingual 2-years-on
Retrieved 40,000 RunType= automatic
Relevant 7,153 QueryType= TD
Relevant retrieved 5,204 Pooled= false
CLEF 2005 AH−2−years−on − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 86.68 adhocM5Trntest
90%
10 72.51
20 64.83 80%
30 57.88
70%
40 52.86
50 47.37
Average Precision
60%
60 42.06
50%
70 33.86
80 24.89 40%
90 17.35
30%
100 5.49
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
44.93
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−2−years−on − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 64.50 adhocM5Trntest
90%
10 docs 64.00
15 docs 61.00 80%
20 docs 59.37
70%
30 docs 56.92
100 docs 41.52 60%
R−Precision
200 docs 33.16
50%
500 docs 21.07
1000 docs 13.01 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
46.55 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 161 to 180)
queries 1
adhocM5Trntest
Topic 161 24.04 Topic 181 39.02
Difference (average precision)
Topic 162 83.46 Topic 182 58.72 0.5
Topic 163 72.56 Topic 183 25.74
Topic 164 3.96 Topic 184 38.88
Topic 165 43.67 Topic 185 17.48 0
Topic 166 0.80 Topic 186 52.09
Topic 167 55.20 Topic 187 53.08
−0.5
Topic 168 24.65 Topic 188 35.92
Topic 169 2.05 Topic 189 72.52
Topic 170 48.02 Topic 190 12.56 −1
161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180
Topic 171 4.49 Topic 191 100.00 Topic Number
Topic 172 13.08 Topic 192 78.95
Topic 173 62.55 Topic 193 27.32
CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 181 to 200)
Topic 174 77.85 Topic 194 58.41 1
Topic 175 66.86 Topic 195 31.50 adhocM5Trntest
Difference (average precision)
Topic 176 92.21 Topic 196 73.78
0.5
Topic 177 32.21 Topic 197 59.71
Topic 178 8.24 Topic 198 22.09
Topic 179 61.63 Topic 199 74.95 0
Topic 180 43.34 Topic 200 43.72
−0.5
−1
181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200
Topic Number
A.93
cmu adhocM5w1test AH-2-years-on
Overall statistics for 40 queries : General info:
Total number of documents over all queries Track= Ad Hoc Multilingual 2-years-on
Retrieved 40,000 RunType= automatic
Relevant 7,153 QueryType= TD
Relevant retrieved 5,084 Pooled= false
CLEF 2005 AH−2−years−on − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 87.57 adhocM5w1test
90%
10 71.94
20 65.70 80%
30 57.45
70%
40 53.15
50 45.75
Average Precision
60%
60 41.25
50%
70 32.01
80 23.60 40%
90 16.11
30%
100 3.88
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
44.56
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−2−years−on − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 66.50 adhocM5w1test
90%
10 docs 65.25
15 docs 62.67 80%
20 docs 59.62
70%
30 docs 56.33
100 docs 41.22 60%
R−Precision
200 docs 32.40
50%
500 docs 20.59
1000 docs 12.71 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
46.21 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 161 to 180)
queries 1
adhocM5w1test
Topic 161 28.61 Topic 181 35.17
Difference (average precision)
Topic 162 84.36 Topic 182 54.35 0.5
Topic 163 75.30 Topic 183 30.27
Topic 164 3.70 Topic 184 38.79
Topic 165 36.85 Topic 185 13.75 0
Topic 166 0.56 Topic 186 51.36
Topic 167 53.79 Topic 187 50.54
−0.5
Topic 168 25.61 Topic 188 45.52
Topic 169 2.77 Topic 189 65.79
Topic 170 57.45 Topic 190 10.68 −1
161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180
Topic 171 2.43 Topic 191 100.00 Topic Number
Topic 172 9.69 Topic 192 74.00
Topic 173 67.98 Topic 193 25.68
CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 181 to 200)
Topic 174 75.69 Topic 194 57.76 1
Topic 175 65.92 Topic 195 37.17 adhocM5w1test
Difference (average precision)
Topic 176 91.87 Topic 196 71.77
0.5
Topic 177 35.71 Topic 197 58.10
Topic 178 7.14 Topic 198 19.73
Topic 179 57.92 Topic 199 73.34 0
Topic 180 40.70 Topic 200 44.49
−0.5
−1
181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200
Topic Number
A.94
isi-unige ADJUSTEN AH-2-years-on
Overall statistics for 40 queries : General info:
Total number of documents over all queries Track= Ad Hoc Multilingual 2-years-on
Retrieved 22,858 RunType= manual
Relevant 7,153 QueryType= TDN
Relevant retrieved 2,245 Pooled= false
CLEF 2005 AH−2−years−on − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 60.08 ADJUSTEN
90%
10 37.68
20 28.84 80%
30 23.90
70%
40 19.77
50 16.74
Average Precision
60%
60 13.02
50%
70 9.17
80 4.82 40%
90 2.02
30%
100 0.04
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
16.85
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−2−years−on − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 38.00 ADJUSTEN
90%
10 docs 36.00
15 docs 33.50 80%
20 docs 33.25
70%
30 docs 31.25
100 docs 22.40 60%
R−Precision
200 docs 16.46
50%
500 docs 9.48
1000 docs 5.61 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
24.26 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 161 to 180)
queries 1
ADJUSTEN
Topic 161 43.33 Topic 181 11.00
Difference (average precision)
Topic 162 7.05 Topic 182 26.47 0.5
Topic 163 37.73 Topic 183 19.59
Topic 164 0.99 Topic 184 2.90
Topic 165 6.81 Topic 185 13.43 0
Topic 166 0.05 Topic 186 8.53
Topic 167 18.92 Topic 187 19.75
−0.5
Topic 168 7.04 Topic 188 56.81
Topic 169 0.56 Topic 189 75.91
Topic 170 1.34 Topic 190 0.01 −1
161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180
Topic 171 3.26 Topic 191 1.52 Topic Number
Topic 172 1.06 Topic 192 19.76
Topic 173 29.27 Topic 193 4.36
CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 181 to 200)
Topic 174 37.53 Topic 194 1.84 1
Topic 175 12.43 Topic 195 4.56 ADJUSTEN
Difference (average precision)
Topic 176 68.27 Topic 196 57.15
0.5
Topic 177 2.38 Topic 197 7.06
Topic 178 2.11 Topic 198 2.86
Topic 179 4.56 Topic 199 43.36 0
Topic 180 2.16 Topic 200 10.32
−0.5
−1
181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200
Topic Number
A.95
isi-unige AUTOEN AH-2-years-on
Overall statistics for 40 queries : General info:
Total number of documents over all queries Track= Ad Hoc Multilingual 2-years-on
Retrieved 20,405 RunType= automatic
Relevant 7,153 QueryType= TD
Relevant retrieved 1,544 Pooled= false
CLEF 2005 AH−2−years−on − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 51.00 AUTOEN
90%
10 26.63
20 15.92 80%
30 13.05
70%
40 11.43
50 8.26
Average Precision
60%
60 7.69
50%
70 2.35
80 2.07 40%
90 2.07
30%
100 0.08
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
10.33
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−2−years−on − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 27.50 AUTOEN
90%
10 docs 28.50
15 docs 27.83 80%
20 docs 27.75
70%
30 docs 26.08
100 docs 16.23 60%
R−Precision
200 docs 11.49
50%
500 docs 6.55
1000 docs 3.86 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
16.29 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 161 to 180)
queries 1
AUTOEN
Topic 161 5.56 Topic 181 7.30
Difference (average precision)
Topic 162 4.19 Topic 182 0.20 0.5
Topic 163 15.71 Topic 183 4.34
Topic 164 0.02 Topic 184 4.01
Topic 165 3.20 Topic 185 13.10 0
Topic 166 0.32 Topic 186 7.51
Topic 167 22.12 Topic 187 8.88
−0.5
Topic 168 8.31 Topic 188 56.13
Topic 169 0.00 Topic 189 75.91
Topic 170 0.01 Topic 190 0.02 −1
161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180
Topic 171 1.26 Topic 191 3.33 Topic Number
Topic 172 1.13 Topic 192 20.58
Topic 173 2.89 Topic 193 3.57
CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 181 to 200)
Topic 174 14.79 Topic 194 1.26 1
Topic 175 5.51 Topic 195 0.08 AUTOEN
Difference (average precision)
Topic 176 16.29 Topic 196 47.29
0.5
Topic 177 0.83 Topic 197 7.17
Topic 178 0.28 Topic 198 2.86
Topic 179 4.54 Topic 199 33.30 0
Topic 180 0.65 Topic 200 8.65
−0.5
−1
181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200
Topic Number
A.96
isi-unige FEEDBCKEN AH-2-years-on
Overall statistics for 40 queries : General info:
Total number of documents over all queries Track= Ad Hoc Multilingual 2-years-on
Retrieved 23,075 RunType= manual
Relevant 7,153 QueryType= TDN
Relevant retrieved 2,221 Pooled= false
CLEF 2005 AH−2−years−on − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 90.21 FEEDBCKEN
90%
10 44.45
20 35.10 80%
30 29.46
70%
40 24.17
50 18.30
Average Precision
60%
60 14.57
50%
70 10.06
80 4.83 40%
90 1.61
30%
100 0.04
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
21.02
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−2−years−on − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 54.00 FEEDBCKEN
90%
10 docs 50.00
15 docs 46.33 80%
20 docs 43.50
70%
30 docs 39.58
100 docs 24.88 60%
R−Precision
200 docs 18.05
50%
500 docs 9.59
1000 docs 5.55 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
27.41 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 161 to 180)
queries 1
FEEDBCKEN
Topic 161 39.87 Topic 181 10.55
Difference (average precision)
Topic 162 8.83 Topic 182 19.94 0.5
Topic 163 38.30 Topic 183 31.80
Topic 164 1.33 Topic 184 1.89
Topic 165 43.19 Topic 185 14.25 0
Topic 166 0.05 Topic 186 13.76
Topic 167 21.26 Topic 187 16.99
−0.5
Topic 168 25.54 Topic 188 51.29
Topic 169 0.56 Topic 189 71.95
Topic 170 5.15 Topic 190 0.01 −1
161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180
Topic 171 9.16 Topic 191 1.52 Topic Number
Topic 172 3.99 Topic 192 35.43
Topic 173 36.69 Topic 193 3.01
CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 181 to 200)
Topic 174 62.31 Topic 194 6.07 1
Topic 175 19.41 Topic 195 32.20 FEEDBCKEN
Difference (average precision)
Topic 176 68.20 Topic 196 60.02
0.5
Topic 177 3.14 Topic 197 7.92
Topic 178 2.57 Topic 198 2.86
Topic 179 5.20 Topic 199 45.16 0
Topic 180 3.41 Topic 200 16.20
−0.5
−1
181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200
Topic Number
A.97
isi-unige ADJUSTSP AH-2-years-on
Overall statistics for 40 queries : General info:
Total number of documents over all queries Track= Ad Hoc Multilingual 2-years-on
Retrieved 23,075 RunType= manual
Relevant 7,153 QueryType= TDN
Relevant retrieved 2,312 Pooled= false
CLEF 2005 AH−2−years−on − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 51.33 ADJUSTSP
90%
10 36.76
20 25.04 80%
30 18.34
70%
40 14.45
50 10.25
Average Precision
60%
60 7.66
50%
70 5.84
80 4.02 40%
90 0.03
30%
100 0.03
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
13.80
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−2−years−on − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 34.50 ADJUSTSP
90%
10 docs 34.25
15 docs 32.50 80%
20 docs 32.62
70%
30 docs 29.83
100 docs 20.78 60%
R−Precision
200 docs 16.10
50%
500 docs 9.41
1000 docs 5.78 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
20.97 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 161 to 180)
queries 1
ADJUSTSP
Topic 161 45.11 Topic 181 9.07
Difference (average precision)
Topic 162 0.78 Topic 182 23.41 0.5
Topic 163 9.04 Topic 183 5.71
Topic 164 1.58 Topic 184 2.32
Topic 165 6.00 Topic 185 0.33 0
Topic 166 0.12 Topic 186 10.23
Topic 167 12.02 Topic 187 19.30
−0.5
Topic 168 7.59 Topic 188 0.00
Topic 169 0.14 Topic 189 5.78
Topic 170 3.46 Topic 190 0.01 −1
161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180
Topic 171 2.95 Topic 191 1.28 Topic Number
Topic 172 0.64 Topic 192 26.21
Topic 173 36.78 Topic 193 7.29
CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 181 to 200)
Topic 174 41.10 Topic 194 15.99 1
Topic 175 13.40 Topic 195 0.43 ADJUSTSP
Difference (average precision)
Topic 176 68.28 Topic 196 51.12
0.5
Topic 177 1.09 Topic 197 13.66
Topic 178 18.74 Topic 198 9.06
Topic 179 13.79 Topic 199 25.51 0
Topic 180 34.04 Topic 200 8.46
−0.5
−1
181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200
Topic Number
A.98
isi-unige ADJUSTFR AH-2-years-on
Overall statistics for 40 queries : General info:
Total number of documents over all queries Track= Ad Hoc Multilingual 2-years-on
Retrieved 21,875 RunType= manual
Relevant 7,153 QueryType= TDN
Relevant retrieved 2,134 Pooled= false
CLEF 2005 AH−2−years−on − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 60.91 ADJUSTFR
90%
10 31.51
20 23.28 80%
30 18.13
70%
40 14.64
50 12.14
Average Precision
60%
60 8.67
50%
70 5.80
80 3.27 40%
90 0.22
30%
100 0.07
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
13.47
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−2−years−on − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 36.50 ADJUSTFR
90%
10 docs 33.25
15 docs 31.50 80%
20 docs 30.37
70%
30 docs 29.17
100 docs 19.85 60%
R−Precision
200 docs 15.25
50%
500 docs 8.89
1000 docs 5.33 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
19.44 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 161 to 180)
queries 1
ADJUSTFR
Topic 161 26.42 Topic 181 7.57
Difference (average precision)
Topic 162 41.96 Topic 182 5.31 0.5
Topic 163 10.97 Topic 183 27.02
Topic 164 8.95 Topic 184 2.99
Topic 165 11.22 Topic 185 0.00 0
Topic 166 0.01 Topic 186 0.88
Topic 167 22.53 Topic 187 18.50
−0.5
Topic 168 6.79 Topic 188 52.45
Topic 169 0.50 Topic 189 6.67
Topic 170 0.51 Topic 190 0.15 −1
161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180
Topic 171 1.01 Topic 191 2.78 Topic Number
Topic 172 1.42 Topic 192 23.89
Topic 173 51.19 Topic 193 6.69
CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 181 to 200)
Topic 174 38.06 Topic 194 1.02 1
Topic 175 24.85 Topic 195 2.90 ADJUSTFR
Difference (average precision)
Topic 176 66.24 Topic 196 3.75
0.5
Topic 177 4.50 Topic 197 16.32
Topic 178 1.26 Topic 198 1.43
Topic 179 8.03 Topic 199 5.70 0
Topic 180 26.26 Topic 200 0.15
−0.5
−1
181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200
Topic Number
A.99
isi-unige ADJUSTDU AH-2-years-on
Overall statistics for 40 queries : General info:
Total number of documents over all queries Track= Ad Hoc Multilingual 2-years-on
Retrieved 15,366 RunType= manual
Relevant 7,153 QueryType= TDN
Relevant retrieved 1,445 Pooled= false
CLEF 2005 AH−2−years−on − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 62.54 ADJUSTDU
90%
10 32.85
20 23.20 80%
30 14.95
70%
40 13.15
50 11.80
Average Precision
60%
60 10.77
50%
70 8.26
80 5.40 40%
90 3.54
30%
100 0.00
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
13.90
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−2−years−on − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 39.00 ADJUSTDU
90%
10 docs 36.25
15 docs 32.83 80%
20 docs 30.13
70%
30 docs 28.25
100 docs 17.88 60%
R−Precision
200 docs 11.70
50%
500 docs 6.30
1000 docs 3.61 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
18.36 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 161 to 180)
queries 1
ADJUSTDU
Topic 161 27.57 Topic 181 0.24
Difference (average precision)
Topic 162 30.08 Topic 182 8.97 0.5
Topic 163 16.02 Topic 183 0.48
Topic 164 1.64 Topic 184 1.21
Topic 165 6.91 Topic 185 25.61 0
Topic 166 0.00 Topic 186 0.00
Topic 167 18.72 Topic 187 12.60
−0.5
Topic 168 7.30 Topic 188 36.23
Topic 169 0.01 Topic 189 66.39
Topic 170 16.89 Topic 190 4.03 −1
161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180
Topic 171 4.94 Topic 191 0.00 Topic Number
Topic 172 0.28 Topic 192 17.56
Topic 173 29.67 Topic 193 16.57
CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 181 to 200)
Topic 174 42.99 Topic 194 0.00 1
Topic 175 10.86 Topic 195 1.35 ADJUSTDU
Difference (average precision)
Topic 176 65.24 Topic 196 57.50
0.5
Topic 177 0.50 Topic 197 2.84
Topic 178 0.00 Topic 198 1.43
Topic 179 6.44 Topic 199 11.56 0
Topic 180 2.98 Topic 200 2.56
−0.5
−1
181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200
Topic Number
A.100
jaen UJAPRFRSV2RR AH-2-years-on
Overall statistics for 40 queries : General info:
Total number of documents over all queries Track= Ad Hoc Multilingual 2-years-on
Retrieved 40,000 RunType= automatic
Relevant 7,153 QueryType= TD
Relevant retrieved 4,108 Pooled= false
CLEF 2005 AH−2−years−on − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 75.73 UJAPRFRSV2RR
90%
10 59.59
20 52.08 80%
30 41.98
70%
40 33.33
50 27.92
Average Precision
60%
60 19.99
50%
70 15.24
80 9.66 40%
90 5.58
30%
100 1.63
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
29.57
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−2−years−on − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 59.50 UJAPRFRSV2RR
90%
10 docs 54.25
15 docs 53.67 80%
20 docs 50.88
70%
30 docs 47.75
100 docs 34.38 60%
R−Precision
200 docs 26.39
50%
500 docs 16.42
1000 docs 10.27 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
33.85 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 161 to 180)
queries 1
UJAPRFRSV2RR
Topic 161 0.02 Topic 181 30.04
Difference (average precision)
Topic 162 51.29 Topic 182 42.30 0.5
Topic 163 59.92 Topic 183 23.98
Topic 164 0.93 Topic 184 23.64
Topic 165 36.09 Topic 185 9.15 0
Topic 166 0.03 Topic 186 28.68
Topic 167 47.57 Topic 187 19.98
−0.5
Topic 168 19.87 Topic 188 37.00
Topic 169 0.73 Topic 189 35.86
Topic 170 31.60 Topic 190 23.22 −1
161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180
Topic 171 7.55 Topic 191 25.00 Topic Number
Topic 172 7.54 Topic 192 55.21
Topic 173 60.32 Topic 193 20.45
CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 181 to 200)
Topic 174 82.44 Topic 194 27.11 1
Topic 175 16.16 Topic 195 17.98 UJAPRFRSV2RR
Difference (average precision)
Topic 176 91.16 Topic 196 49.35
0.5
Topic 177 16.66 Topic 197 44.15
Topic 178 7.60 Topic 198 2.67
Topic 179 21.91 Topic 199 73.00 0
Topic 180 4.57 Topic 200 29.97
−0.5
−1
181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200
Topic Number
A.101
jaen UJARSV2 AH-2-years-on
Overall statistics for 40 queries : General info:
Total number of documents over all queries Track= Ad Hoc Multilingual 2-years-on
Retrieved 40,000 RunType= automatic
Relevant 7,153 QueryType= TD
Relevant retrieved 3,774 Pooled= false
CLEF 2005 AH−2−years−on − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 76.45 UJARSV2
90%
10 57.83
20 49.79 80%
30 41.08
70%
40 31.36
50 26.12
Average Precision
60%
60 19.21
50%
70 14.17
80 9.56 40%
90 5.88
30%
100 2.50
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
28.78
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−2−years−on − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 60.50 UJARSV2
90%
10 docs 56.00
15 docs 51.83 80%
20 docs 49.38
70%
30 docs 45.08
100 docs 30.42 60%
R−Precision
200 docs 23.80
50%
500 docs 15.07
1000 docs 9.44 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
33.22 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 161 to 180)
queries 1
UJARSV2
Topic 161 0.01 Topic 181 29.19
Difference (average precision)
Topic 162 45.85 Topic 182 43.64 0.5
Topic 163 60.40 Topic 183 19.31
Topic 164 1.27 Topic 184 25.78
Topic 165 22.72 Topic 185 14.01 0
Topic 166 0.16 Topic 186 16.81
Topic 167 35.84 Topic 187 17.34
−0.5
Topic 168 12.40 Topic 188 42.44
Topic 169 0.96 Topic 189 48.53
Topic 170 21.45 Topic 190 18.93 −1
161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180
Topic 171 5.39 Topic 191 100.00 Topic Number
Topic 172 7.07 Topic 192 29.55
Topic 173 66.72 Topic 193 15.33
CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 181 to 200)
Topic 174 66.41 Topic 194 26.55 1
Topic 175 27.98 Topic 195 14.67 UJARSV2
Difference (average precision)
Topic 176 84.31 Topic 196 57.55
0.5
Topic 177 23.72 Topic 197 46.06
Topic 178 0.54 Topic 198 7.48
Topic 179 10.37 Topic 199 66.93 0
Topic 180 2.13 Topic 200 15.40
−0.5
−1
181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200
Topic Number
A.102
jaen UJARSV2RR AH-2-years-on
Overall statistics for 40 queries : General info:
Total number of documents over all queries Track= Ad Hoc Multilingual 2-years-on
Retrieved 40,000 RunType= automatic
Relevant 7,153 QueryType= TD
Relevant retrieved 3,884 Pooled= false
CLEF 2005 AH−2−years−on − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 75.82 UJARSV2RR
90%
10 56.71
20 50.47 80%
30 41.76
70%
40 33.19
50 27.73
Average Precision
60%
60 21.04
50%
70 14.41
80 9.84 40%
90 5.98
30%
100 2.50
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
29.19
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−2−years−on − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 58.50 UJARSV2RR
90%
10 docs 54.00
15 docs 50.67 80%
20 docs 49.12
70%
30 docs 44.83
100 docs 31.00 60%
R−Precision
200 docs 24.45
50%
500 docs 15.56
1000 docs 9.71 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
34.15 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 161 to 180)
queries 1
UJARSV2RR
Topic 161 0.02 Topic 181 30.00
Difference (average precision)
Topic 162 45.72 Topic 182 40.85 0.5
Topic 163 62.88 Topic 183 20.06
Topic 164 1.03 Topic 184 25.64
Topic 165 23.05 Topic 185 14.18 0
Topic 166 0.23 Topic 186 20.34
Topic 167 40.39 Topic 187 20.77
−0.5
Topic 168 13.17 Topic 188 48.55
Topic 169 0.77 Topic 189 49.70
Topic 170 20.44 Topic 190 19.07 −1
161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180
Topic 171 5.98 Topic 191 100.00 Topic Number
Topic 172 7.10 Topic 192 28.72
Topic 173 63.57 Topic 193 17.38
CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 181 to 200)
Topic 174 66.79 Topic 194 27.74 1
Topic 175 26.56 Topic 195 14.83 UJARSV2RR
Difference (average precision)
Topic 176 85.12 Topic 196 50.78
0.5
Topic 177 20.41 Topic 197 50.31
Topic 178 0.53 Topic 198 4.63
Topic 179 11.75 Topic 199 68.67 0
Topic 180 2.48 Topic 200 17.35
−0.5
−1
181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200
Topic Number
A.103
jaen UJAUARSV2RR AH-2-years-on
Overall statistics for 40 queries : General info:
Total number of documents over all queries Track= Ad Hoc Multilingual 2-years-on
Retrieved 40,000 RunType= automatic
Relevant 7,153 QueryType= TD
Relevant retrieved 3,884 Pooled= false
CLEF 2005 AH−2−years−on − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 75.88 UJAUARSV2RR
90%
10 56.69
20 50.67 80%
30 41.89
70%
40 33.06
50 27.32
Average Precision
60%
60 20.90
50%
70 14.41
80 9.83 40%
90 5.98
30%
100 2.50
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
29.18
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−2−years−on − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 58.50 UJAUARSV2RR
90%
10 docs 53.50
15 docs 51.17 80%
20 docs 49.00
70%
30 docs 45.00
100 docs 31.08 60%
R−Precision
200 docs 24.51
50%
500 docs 15.65
1000 docs 9.71 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
34.26 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 161 to 180)
queries 1
UJAUARSV2RR
Topic 161 0.02 Topic 181 30.01
Difference (average precision)
Topic 162 45.28 Topic 182 40.80 0.5
Topic 163 62.58 Topic 183 20.04
Topic 164 1.06 Topic 184 25.63
Topic 165 23.08 Topic 185 14.23 0
Topic 166 0.23 Topic 186 20.34
Topic 167 40.52 Topic 187 20.36
−0.5
Topic 168 13.32 Topic 188 48.68
Topic 169 0.84 Topic 189 49.27
Topic 170 20.48 Topic 190 18.16 −1
161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180
Topic 171 5.99 Topic 191 100.00 Topic Number
Topic 172 6.96 Topic 192 28.79
Topic 173 63.68 Topic 193 17.38
CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 181 to 200)
Topic 174 66.60 Topic 194 27.99 1
Topic 175 26.65 Topic 195 14.72 UJAUARSV2RR
Difference (average precision)
Topic 176 85.08 Topic 196 50.85
0.5
Topic 177 20.40 Topic 197 50.19
Topic 178 0.53 Topic 198 4.81
Topic 179 13.02 Topic 199 68.66 0
Topic 180 2.49 Topic 200 17.45
−0.5
−1
181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200
Topic Number
A.104
miracle enml0XSRpHL AH-2-years-on
Overall statistics for 40 queries : General info:
Total number of documents over all queries Track= Ad Hoc Multilingual 2-years-on
Retrieved 40,000 RunType= automatic
Relevant 7,153 QueryType= TDN
Relevant retrieved 4,373 Pooled= false
CLEF 2005 AH−2−years−on − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 75.43 enml0XSRpHL
90%
10 57.91
20 48.62 80%
30 43.19
70%
40 38.41
50 31.91
Average Precision
60%
60 25.04
50%
70 18.07
80 12.63 40%
90 7.26
30%
100 1.86
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
30.78
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−2−years−on − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 57.50 enml0XSRpHL
90%
10 docs 51.25
15 docs 51.17 80%
20 docs 50.13
70%
30 docs 47.50
100 docs 36.17 60%
R−Precision
200 docs 27.70
50%
500 docs 17.45
1000 docs 10.93 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
36.60 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 161 to 180)
queries 1
enml0XSRpHL
Topic 161 3.08 Topic 181 35.00
Difference (average precision)
Topic 162 53.98 Topic 182 54.80 0.5
Topic 163 37.32 Topic 183 27.84
Topic 164 0.54 Topic 184 32.68
Topic 165 35.41 Topic 185 20.82 0
Topic 166 0.82 Topic 186 9.06
Topic 167 31.69 Topic 187 36.73
−0.5
Topic 168 15.99 Topic 188 36.14
Topic 169 1.19 Topic 189 66.24
Topic 170 39.66 Topic 190 25.72 −1
161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180
Topic 171 11.75 Topic 191 9.09 Topic Number
Topic 172 2.81 Topic 192 45.88
Topic 173 40.04 Topic 193 25.04
CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 181 to 200)
Topic 174 85.74 Topic 194 15.33 1
Topic 175 22.70 Topic 195 22.37 enml0XSRpHL
Difference (average precision)
Topic 176 84.13 Topic 196 65.36
0.5
Topic 177 15.37 Topic 197 43.64
Topic 178 4.22 Topic 198 10.26
Topic 179 19.75 Topic 199 71.21 0
Topic 180 45.55 Topic 200 26.17
−0.5
−1
181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200
Topic Number
A.105
miracle enmlSTpH AH-2-years-on
Overall statistics for 40 queries : General info:
Total number of documents over all queries Track= Ad Hoc Multilingual 2-years-on
Retrieved 40,000 RunType= automatic
Relevant 7,153 QueryType= TD
Relevant retrieved 2,896 Pooled= false
CLEF 2005 AH−2−years−on − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 79.78 enmlSTpH
90%
10 52.73
20 40.67 80%
30 30.05
70%
40 23.50
50 16.06
Average Precision
60%
60 9.96
50%
70 7.18
80 4.19 40%
90 3.47
30%
100 2.50
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
21.97
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−2−years−on − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 55.50 enmlSTpH
90%
10 docs 51.75
15 docs 47.50 80%
20 docs 44.12
70%
30 docs 39.92
100 docs 26.82 60%
R−Precision
200 docs 19.90
50%
500 docs 11.54
1000 docs 7.24 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
27.83 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 161 to 180)
queries 1
enmlSTpH
Topic 161 0.07 Topic 181 15.50
Difference (average precision)
Topic 162 45.77 Topic 182 34.71 0.5
Topic 163 17.01 Topic 183 9.21
Topic 164 0.16 Topic 184 30.95
Topic 165 35.63 Topic 185 9.33 0
Topic 166 0.18 Topic 186 4.50
Topic 167 24.53 Topic 187 11.19
−0.5
Topic 168 1.11 Topic 188 29.45
Topic 169 0.70 Topic 189 36.28
Topic 170 13.01 Topic 190 5.33 −1
161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180
Topic 171 2.58 Topic 191 100.00 Topic Number
Topic 172 4.59 Topic 192 8.10
Topic 173 47.91 Topic 193 13.45
CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 181 to 200)
Topic 174 53.12 Topic 194 14.35 1
Topic 175 27.10 Topic 195 7.04 enmlSTpH
Difference (average precision)
Topic 176 74.77 Topic 196 44.47
0.5
Topic 177 12.15 Topic 197 32.25
Topic 178 4.00 Topic 198 12.27
Topic 179 5.15 Topic 199 52.38 0
Topic 180 23.81 Topic 200 14.73
−0.5
−1
181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200
Topic Number
A.106
miracle enmlSTpHL AH-2-years-on
Overall statistics for 40 queries : General info:
Total number of documents over all queries Track= Ad Hoc Multilingual 2-years-on
Retrieved 40,000 RunType= automatic
Relevant 7,153 QueryType= TD
Relevant retrieved 4,106 Pooled= false
CLEF 2005 AH−2−years−on − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 73.07 enmlSTpHL
90%
10 49.81
20 38.98 80%
30 32.44
70%
40 27.25
50 23.05
Average Precision
60%
60 19.92
50%
70 14.91
80 10.53 40%
90 5.53
30%
100 1.72
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
24.83
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−2−years−on − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 54.50 enmlSTpHL
90%
10 docs 48.00
15 docs 44.33 80%
20 docs 42.50
70%
30 docs 39.58
100 docs 30.30 60%
R−Precision
200 docs 23.80
50%
500 docs 15.77
1000 docs 10.26 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
29.97 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 161 to 180)
queries 1
enmlSTpHL
Topic 161 0.07 Topic 181 24.20
Difference (average precision)
Topic 162 49.26 Topic 182 38.49 0.5
Topic 163 50.88 Topic 183 10.54
Topic 164 0.50 Topic 184 24.69
Topic 165 17.96 Topic 185 15.82 0
Topic 166 0.77 Topic 186 9.72
Topic 167 32.55 Topic 187 9.82
−0.5
Topic 168 13.33 Topic 188 18.81
Topic 169 0.91 Topic 189 60.60
Topic 170 32.88 Topic 190 12.62 −1
161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180
Topic 171 14.97 Topic 191 16.67 Topic Number
Topic 172 3.40 Topic 192 16.25
Topic 173 21.95 Topic 193 25.64
CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 181 to 200)
Topic 174 77.79 Topic 194 8.58 1
Topic 175 18.88 Topic 195 16.03 enmlSTpHL
Difference (average precision)
Topic 176 82.72 Topic 196 62.37
0.5
Topic 177 17.51 Topic 197 51.64
Topic 178 2.62 Topic 198 7.98
Topic 179 14.52 Topic 199 65.58 0
Topic 180 30.90 Topic 200 12.63
−0.5
−1
181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200
Topic Number
A.107
miracle enmlXSRpA AH-2-years-on
Overall statistics for 40 queries : General info:
Total number of documents over all queries Track= Ad Hoc Multilingual 2-years-on
Retrieved 40,000 RunType= automatic
Relevant 7,153 QueryType= TDN
Relevant retrieved 4,208 Pooled= false
CLEF 2005 AH−2−years−on − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 84.87 enmlXSRpA
90%
10 54.60
20 43.48 80%
30 33.85
70%
40 29.44
50 22.15
Average Precision
60%
60 17.06
50%
70 12.09
80 6.41 40%
90 3.63
30%
100 1.33
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
25.53
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−2−years−on − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 58.50 enmlXSRpA
90%
10 docs 56.25
15 docs 53.50 80%
20 docs 49.50
70%
30 docs 44.08
100 docs 29.55 60%
R−Precision
200 docs 22.50
50%
500 docs 13.84
1000 docs 10.52 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
28.75 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 161 to 180)
queries 1
enmlXSRpA
Topic 161 5.68 Topic 181 30.35
Difference (average precision)
Topic 162 51.36 Topic 182 59.60 0.5
Topic 163 24.40 Topic 183 23.25
Topic 164 1.71 Topic 184 24.93
Topic 165 37.38 Topic 185 8.54 0
Topic 166 1.02 Topic 186 6.50
Topic 167 21.33 Topic 187 27.00
−0.5
Topic 168 8.33 Topic 188 32.44
Topic 169 0.15 Topic 189 29.35
Topic 170 21.15 Topic 190 10.16 −1
161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180
Topic 171 3.38 Topic 191 50.00 Topic Number
Topic 172 4.86 Topic 192 31.02
Topic 173 57.22 Topic 193 13.20
CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 181 to 200)
Topic 174 68.92 Topic 194 22.58 1
Topic 175 5.48 Topic 195 11.04 enmlXSRpA
Difference (average precision)
Topic 176 76.21 Topic 196 42.69
0.5
Topic 177 12.39 Topic 197 41.74
Topic 178 3.49 Topic 198 18.14
Topic 179 14.59 Topic 199 61.34 0
Topic 180 36.34 Topic 200 21.93
−0.5
−1
181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200
Topic Number
A.108
miracle esml9XnteSRp AH-2-years-on
Overall statistics for 40 queries : General info:
Total number of documents over all queries Track= Ad Hoc Multilingual 2-years-on
Retrieved 40,000 RunType= automatic
Relevant 7,153 QueryType= TDN
Relevant retrieved 4,101 Pooled= false
CLEF 2005 AH−2−years−on − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 82.32 esml9XnteSRp
90%
10 59.63
20 48.38 80%
30 38.83
70%
40 33.13
50 25.98
Average Precision
60%
60 18.77
50%
70 13.99
80 8.97 40%
90 4.57
30%
100 0.94
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
28.28
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−2−years−on − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 66.00 esml9XnteSRp
90%
10 docs 59.50
15 docs 54.00 80%
20 docs 49.75
70%
30 docs 44.58
100 docs 29.98 60%
R−Precision
200 docs 23.71
50%
500 docs 15.71
1000 docs 10.25 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
32.08 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 161 to 180)
queries 1
esml9XnteSRp
Topic 161 27.90 Topic 181 33.00
Difference (average precision)
Topic 162 59.63 Topic 182 58.40 0.5
Topic 163 39.76 Topic 183 15.74
Topic 164 9.38 Topic 184 16.76
Topic 165 33.69 Topic 185 8.33 0
Topic 166 0.13 Topic 186 11.86
Topic 167 44.85 Topic 187 29.21
−0.5
Topic 168 13.50 Topic 188 24.85
Topic 169 0.72 Topic 189 55.15
Topic 170 63.54 Topic 190 0.86 −1
161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180
Topic 171 3.72 Topic 191 14.29 Topic Number
Topic 172 5.19 Topic 192 12.03
Topic 173 55.86 Topic 193 9.19
CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 181 to 200)
Topic 174 31.58 Topic 194 20.17 1
Topic 175 42.41 Topic 195 3.76 esml9XnteSRp
Difference (average precision)
Topic 176 80.41 Topic 196 66.13
0.5
Topic 177 16.58 Topic 197 36.21
Topic 178 8.18 Topic 198 13.74
Topic 179 21.22 Topic 199 67.44 0
Topic 180 40.20 Topic 200 35.48
−0.5
−1
181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200
Topic Number
A.109
miracle esml9XstiSTp AH-2-years-on
Overall statistics for 40 queries : General info:
Total number of documents over all queries Track= Ad Hoc Multilingual 2-years-on
Retrieved 40,000 RunType= automatic
Relevant 7,153 QueryType= TD
Relevant retrieved 3,679 Pooled= false
CLEF 2005 AH−2−years−on − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 84.08 esml9XstiSTp
90%
10 56.43
20 46.95 80%
30 37.15
70%
40 27.12
50 21.71
Average Precision
60%
60 15.98
50%
70 12.20
80 7.54 40%
90 4.63
30%
100 1.25
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
26.06
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−2−years−on − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 63.00 esml9XstiSTp
90%
10 docs 56.25
15 docs 51.00 80%
20 docs 46.75
70%
30 docs 43.17
100 docs 28.77 60%
R−Precision
200 docs 21.76
50%
500 docs 14.32
1000 docs 9.20 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
30.50 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 161 to 180)
queries 1
esml9XstiSTp
Topic 161 30.93 Topic 181 26.25
Difference (average precision)
Topic 162 42.27 Topic 182 37.61 0.5
Topic 163 40.57 Topic 183 9.38
Topic 164 5.61 Topic 184 20.52
Topic 165 33.55 Topic 185 5.51 0
Topic 166 0.07 Topic 186 13.24
Topic 167 44.22 Topic 187 13.56
−0.5
Topic 168 10.54 Topic 188 28.30
Topic 169 0.10 Topic 189 60.57
Topic 170 28.70 Topic 190 1.13 −1
161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180
Topic 171 3.28 Topic 191 12.50 Topic Number
Topic 172 6.10 Topic 192 42.13
Topic 173 56.13 Topic 193 9.08
CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 181 to 200)
Topic 174 20.23 Topic 194 47.88 1
Topic 175 48.75 Topic 195 8.47 esml9XstiSTp
Difference (average precision)
Topic 176 75.86 Topic 196 73.70
0.5
Topic 177 13.41 Topic 197 42.87
Topic 178 22.23 Topic 198 9.41
Topic 179 4.69 Topic 199 63.20 0
Topic 180 9.02 Topic 200 20.91
−0.5
−1
181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200
Topic Number
A.110
miracle frml9XntfSRp AH-2-years-on
Overall statistics for 40 queries : General info:
Total number of documents over all queries Track= Ad Hoc Multilingual 2-years-on
Retrieved 40,000 RunType= automatic
Relevant 7,153 QueryType= TDN
Relevant retrieved 4,136 Pooled= false
CLEF 2005 AH−2−years−on − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 78.28 frml9XntfSRp
90%
10 63.31
20 54.96 80%
30 47.30
70%
40 40.26
50 33.88
Average Precision
60%
60 25.51
50%
70 17.92
80 11.38 40%
90 6.49
30%
100 2.50
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
33.32
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−2−years−on − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 65.00 frml9XntfSRp
90%
10 docs 61.50
15 docs 58.67 80%
20 docs 56.50
70%
30 docs 51.50
100 docs 34.55 60%
R−Precision
200 docs 26.36
50%
500 docs 16.38
1000 docs 10.34 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
37.99 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 161 to 180)
queries 1
frml9XntfSRp
Topic 161 0.08 Topic 181 34.78
Difference (average precision)
Topic 162 59.63 Topic 182 42.20 0.5
Topic 163 40.13 Topic 183 24.67
Topic 164 10.08 Topic 184 45.23
Topic 165 33.45 Topic 185 6.93 0
Topic 166 0.79 Topic 186 3.30
Topic 167 47.05 Topic 187 24.34
−0.5
Topic 168 13.32 Topic 188 34.38
Topic 169 0.96 Topic 189 55.00
Topic 170 60.15 Topic 190 5.56 −1
161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180
Topic 171 5.79 Topic 191 100.00 Topic Number
Topic 172 0.81 Topic 192 40.45
Topic 173 58.93 Topic 193 24.97
CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 181 to 200)
Topic 174 67.94 Topic 194 46.13 1
Topic 175 45.51 Topic 195 7.94 frml9XntfSRp
Difference (average precision)
Topic 176 89.51 Topic 196 64.44
0.5
Topic 177 16.21 Topic 197 42.64
Topic 178 4.64 Topic 198 9.61
Topic 179 23.70 Topic 199 61.71 0
Topic 180 54.46 Topic 200 25.41
−0.5
−1
181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200
Topic Number
A.111
cmu HBC1000test AH-Merging
Overall statistics for 40 queries : General info:
Total number of documents over all queries Track= Ad Hoc Multilingual Merging
Retrieved 39,759 RunType= automatic
Relevant 7,153 QueryType= TD
Relevant retrieved 3,905 Pooled= false
CLEF 2005 AH−Merging − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 86.90 HBC1000test
90%
10 63.34
20 54.68 80%
30 49.49
70%
40 42.89
50 30.92
Average Precision
60%
60 24.72
50%
70 19.66
80 13.74 40%
90 8.06
30%
100 2.50
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
34.27
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Merging − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 65.50 HBC1000test
90%
10 docs 58.50
15 docs 56.67 80%
20 docs 54.25
70%
30 docs 50.50
100 docs 34.75 60%
R−Precision
200 docs 26.55
50%
500 docs 16.48
1000 docs 9.76 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
39.06 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Merging − Comparison to median by topic (topics 161 to 180)
queries 1
HBC1000test
Topic 161 5.57 Topic 181 29.03
Difference (average precision)
Topic 162 72.41 Topic 182 50.37 0.5
Topic 163 59.04 Topic 183 23.35
Topic 164 2.19 Topic 184 22.84
Topic 165 25.59 Topic 185 29.69 0
Topic 166 0.56 Topic 186 28.34
Topic 167 29.26 Topic 187 42.86
−0.5
Topic 168 15.24 Topic 188 25.59
Topic 169 1.55 Topic 189 68.25
Topic 170 61.94 Topic 190 6.55 −1
161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180
Topic 171 3.43 Topic 191 100.00 Topic Number
Topic 172 5.10 Topic 192 38.58
Topic 173 64.21 Topic 193 32.37
CLEF 2005 AH−Merging − Comparison to median by topic (topics 181 to 200)
Topic 174 53.87 Topic 194 47.53 1
Topic 175 37.53 Topic 195 24.15 HBC1000test
Difference (average precision)
Topic 176 82.14 Topic 196 73.48
0.5
Topic 177 14.68 Topic 197 37.86
Topic 178 1.48 Topic 198 22.96
Topic 179 27.14 Topic 199 73.28 0
Topic 180 4.80 Topic 200 26.07
−0.5
−1
181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200
Topic Number
A.112
cmu HBC150test AH-Merging
Overall statistics for 40 queries : General info:
Total number of documents over all queries Track= Ad Hoc Multilingual Merging
Retrieved 24,108 RunType= automatic
Relevant 7,153 QueryType= TD
Relevant retrieved 3,078 Pooled= false
CLEF 2005 AH−Merging − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 85.30 HBC150test
90%
10 62.03
20 52.93 80%
30 42.48
70%
40 32.59
50 24.40
Average Precision
60%
60 21.47
50%
70 15.50
80 8.83 40%
90 5.95
30%
100 2.50
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
30.16
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Merging − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 63.00 HBC150test
90%
10 docs 56.75
15 docs 55.17 80%
20 docs 53.13
70%
30 docs 49.75
100 docs 32.95 60%
R−Precision
200 docs 24.35
50%
500 docs 14.10
1000 docs 7.69 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
36.18 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Merging − Comparison to median by topic (topics 161 to 180)
queries 1
HBC150test
Topic 161 5.59 Topic 181 27.84
Difference (average precision)
Topic 162 56.44 Topic 182 50.27 0.5
Topic 163 55.63 Topic 183 25.29
Topic 164 0.96 Topic 184 23.20
Topic 165 23.67 Topic 185 21.38 0
Topic 166 0.44 Topic 186 8.93
Topic 167 26.04 Topic 187 31.04
−0.5
Topic 168 7.70 Topic 188 28.17
Topic 169 1.69 Topic 189 66.08
Topic 170 50.68 Topic 190 8.22 −1
161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180
Topic 171 5.88 Topic 191 100.00 Topic Number
Topic 172 3.88 Topic 192 30.04
Topic 173 60.67 Topic 193 29.21
CLEF 2005 AH−Merging − Comparison to median by topic (topics 181 to 200)
Topic 174 60.32 Topic 194 27.89 1
Topic 175 32.15 Topic 195 14.87 HBC150test
Difference (average precision)
Topic 176 82.27 Topic 196 69.20
0.5
Topic 177 11.30 Topic 197 20.36
Topic 178 0.50 Topic 198 22.25
Topic 179 19.85 Topic 199 72.78 0
Topic 180 2.56 Topic 200 21.02
−0.5
−1
181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200
Topic Number
A.113
cmu HBT150w05test AH-Merging
Overall statistics for 40 queries : General info:
Total number of documents over all queries Track= Ad Hoc Multilingual Merging
Retrieved 40,000 RunType= automatic
Relevant 7,153 QueryType= TD
Relevant retrieved 3,172 Pooled= false
CLEF 2005 AH−Merging − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 85.46 HBT150w05test
90%
10 59.31
20 50.32 80%
30 41.13
70%
40 31.63
50 25.70
Average Precision
60%
60 21.64
50%
70 16.69
80 9.09 40%
90 5.83
30%
100 2.50
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
29.66
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Merging − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 61.00 HBT150w05test
90%
10 docs 57.25
15 docs 55.00 80%
20 docs 52.63
70%
30 docs 48.83
100 docs 32.68 60%
R−Precision
200 docs 24.01
50%
500 docs 14.11
1000 docs 7.93 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
35.36 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Merging − Comparison to median by topic (topics 161 to 180)
queries 1
HBT150w05test
Topic 161 5.58 Topic 181 26.63
Difference (average precision)
Topic 162 50.93 Topic 182 54.71 0.5
Topic 163 58.26 Topic 183 21.55
Topic 164 1.27 Topic 184 26.01
Topic 165 21.27 Topic 185 17.50 0
Topic 166 0.36 Topic 186 7.58
Topic 167 24.73 Topic 187 26.21
−0.5
Topic 168 7.86 Topic 188 27.72
Topic 169 1.88 Topic 189 69.58
Topic 170 53.44 Topic 190 10.17 −1
161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180
Topic 171 6.25 Topic 191 100.00 Topic Number
Topic 172 3.12 Topic 192 27.61
Topic 173 65.58 Topic 193 28.63
CLEF 2005 AH−Merging − Comparison to median by topic (topics 181 to 200)
Topic 174 63.90 Topic 194 23.92 1
Topic 175 33.50 Topic 195 14.39 HBT150w05test
Difference (average precision)
Topic 176 80.85 Topic 196 64.69
0.5
Topic 177 10.39 Topic 197 21.12
Topic 178 0.75 Topic 198 15.25
Topic 179 20.43 Topic 199 68.46 0
Topic 180 3.70 Topic 200 20.75
−0.5
−1
181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200
Topic Number
A.114
cmu HBT15w05test AH-Merging
Overall statistics for 40 queries : General info:
Total number of documents over all queries Track= Ad Hoc Multilingual Merging
Retrieved 40,000 RunType= automatic
Relevant 7,153 QueryType= TD
Relevant retrieved 3,031 Pooled= false
CLEF 2005 AH−Merging − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 82.74 HBT15w05test
90%
10 55.87
20 42.18 80%
30 34.36
70%
40 26.41
50 21.83
Average Precision
60%
60 17.92
50%
70 10.57
80 5.74 40%
90 4.51
30%
100 2.50
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
25.32
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Merging − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 62.00 HBT15w05test
90%
10 docs 56.75
15 docs 54.83 80%
20 docs 51.13
70%
30 docs 46.25
100 docs 27.92 60%
R−Precision
200 docs 19.19
50%
500 docs 11.73
1000 docs 7.58 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
30.46 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Merging − Comparison to median by topic (topics 161 to 180)
queries 1
HBT15w05test
Topic 161 0.03 Topic 181 23.82
Difference (average precision)
Topic 162 27.84 Topic 182 48.56 0.5
Topic 163 38.90 Topic 183 13.16
Topic 164 1.57 Topic 184 19.68
Topic 165 23.61 Topic 185 10.33 0
Topic 166 0.34 Topic 186 4.70
Topic 167 26.53 Topic 187 20.33
−0.5
Topic 168 4.62 Topic 188 32.15
Topic 169 2.65 Topic 189 69.30
Topic 170 47.14 Topic 190 8.86 −1
161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180
Topic 171 7.49 Topic 191 100.00 Topic Number
Topic 172 3.07 Topic 192 14.48
Topic 173 65.43 Topic 193 20.16
CLEF 2005 AH−Merging − Comparison to median by topic (topics 181 to 200)
Topic 174 62.43 Topic 194 24.88 1
Topic 175 27.21 Topic 195 8.24 HBT15w05test
Difference (average precision)
Topic 176 63.96 Topic 196 55.71
0.5
Topic 177 8.80 Topic 197 18.45
Topic 178 0.42 Topic 198 8.00
Topic 179 16.46 Topic 199 63.19 0
Topic 180 2.88 Topic 200 17.39
−0.5
−1
181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200
Topic Number
A.115
cmu UNEC1000test AH-Merging
Overall statistics for 40 queries : General info:
Total number of documents over all queries Track= Ad Hoc Multilingual Merging
Retrieved 39,938 RunType= automatic
Relevant 7,153 QueryType= TD
Relevant retrieved 4,671 Pooled= false
CLEF 2005 AH−Merging − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 86.36 UNEC1000test
90%
10 65.21
20 56.53 80%
30 51.19
70%
40 46.15
50 39.29
Average Precision
60%
60 34.10
50%
70 25.52
80 17.94 40%
90 12.23
30%
100 3.88
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
38.16
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Merging − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 64.50 UNEC1000test
90%
10 docs 60.00
15 docs 58.00 80%
20 docs 55.25
70%
30 docs 51.08
100 docs 36.27 60%
R−Precision
200 docs 28.25
50%
500 docs 18.68
1000 docs 11.68 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
41.73 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Merging − Comparison to median by topic (topics 161 to 180)
queries 1
UNEC1000test
Topic 161 5.79 Topic 181 31.34
Difference (average precision)
Topic 162 73.28 Topic 182 50.60 0.5
Topic 163 60.14 Topic 183 27.41
Topic 164 2.01 Topic 184 20.04
Topic 165 28.17 Topic 185 29.70 0
Topic 166 0.52 Topic 186 40.96
Topic 167 48.79 Topic 187 55.65
−0.5
Topic 168 18.65 Topic 188 26.04
Topic 169 2.13 Topic 189 73.84
Topic 170 65.45 Topic 190 6.61 −1
161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180
Topic 171 3.43 Topic 191 100.00 Topic Number
Topic 172 7.02 Topic 192 49.71
Topic 173 50.35 Topic 193 32.94
CLEF 2005 AH−Merging − Comparison to median by topic (topics 181 to 200)
Topic 174 43.15 Topic 194 60.29 1
Topic 175 59.89 Topic 195 29.73 UNEC1000test
Difference (average precision)
Topic 176 82.06 Topic 196 72.60
0.5
Topic 177 20.03 Topic 197 49.67
Topic 178 3.16 Topic 198 22.82
Topic 179 44.69 Topic 199 73.41 0
Topic 180 25.82 Topic 200 28.37
−0.5
−1
181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200
Topic Number
A.116
cmu UNEC150test AH-Merging
Overall statistics for 40 queries : General info:
Total number of documents over all queries Track= Ad Hoc Multilingual Merging
Retrieved 30,384 RunType= automatic
Relevant 7,153 QueryType= TD
Relevant retrieved 4,644 Pooled= false
CLEF 2005 AH−Merging − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 86.52 UNEC150test
90%
10 67.49
20 58.34 80%
30 53.79
70%
40 48.14
50 41.14
Average Precision
60%
60 34.35
50%
70 24.67
80 17.65 40%
90 9.86
30%
100 4.17
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
39.08
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Merging − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 65.50 UNEC150test
90%
10 docs 61.50
15 docs 58.67 80%
20 docs 56.88
70%
30 docs 52.67
100 docs 37.17 60%
R−Precision
200 docs 29.10
50%
500 docs 19.14
1000 docs 11.61 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
42.65 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Merging − Comparison to median by topic (topics 161 to 180)
queries 1
UNEC150test
Topic 161 5.59 Topic 181 38.97
Difference (average precision)
Topic 162 68.91 Topic 182 51.12 0.5
Topic 163 62.73 Topic 183 29.74
Topic 164 1.11 Topic 184 23.97
Topic 165 29.35 Topic 185 23.99 0
Topic 166 0.30 Topic 186 38.98
Topic 167 48.58 Topic 187 50.00
−0.5
Topic 168 20.10 Topic 188 29.64
Topic 169 1.28 Topic 189 73.86
Topic 170 65.80 Topic 190 8.30 −1
161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180
Topic 171 5.16 Topic 191 100.00 Topic Number
Topic 172 10.18 Topic 192 49.67
Topic 173 51.67 Topic 193 30.66
CLEF 2005 AH−Merging − Comparison to median by topic (topics 181 to 200)
Topic 174 53.07 Topic 194 60.39 1
Topic 175 60.96 Topic 195 29.12 UNEC150test
Difference (average precision)
Topic 176 82.63 Topic 196 72.96
0.5
Topic 177 21.56 Topic 197 55.96
Topic 178 4.49 Topic 198 21.63
Topic 179 49.49 Topic 199 73.69 0
Topic 180 25.99 Topic 200 31.59
−0.5
−1
181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200
Topic Number
A.117
cmu UNET150w05test AH-Merging
Overall statistics for 40 queries : General info:
Total number of documents over all queries Track= Ad Hoc Multilingual Merging
Retrieved 40,000 RunType= automatic
Relevant 7,153 QueryType= TD
Relevant retrieved 4,914 Pooled= false
CLEF 2005 AH−Merging − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 85.78 UNET150w05test
90%
10 67.22
20 60.71 80%
30 56.28
70%
40 51.13
50 43.76
Average Precision
60%
60 37.56
50%
70 27.87
80 20.89 40%
90 11.37
30%
100 4.26
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
41.19
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Merging − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 66.00 UNET150w05test
90%
10 docs 62.75
15 docs 60.00 80%
20 docs 58.00
70%
30 docs 53.00
100 docs 39.40 60%
R−Precision
200 docs 30.41
50%
500 docs 19.62
1000 docs 12.28 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
43.32 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Merging − Comparison to median by topic (topics 161 to 180)
queries 1
UNET150w05test
Topic 161 5.58 Topic 181 39.87
Difference (average precision)
Topic 162 72.06 Topic 182 59.77 0.5
Topic 163 67.77 Topic 183 23.99
Topic 164 1.37 Topic 184 34.15
Topic 165 30.96 Topic 185 15.67 0
Topic 166 0.28 Topic 186 40.04
Topic 167 48.19 Topic 187 47.61
−0.5
Topic 168 22.24 Topic 188 39.49
Topic 169 1.68 Topic 189 74.24
Topic 170 61.07 Topic 190 14.90 −1
161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180
Topic 171 6.70 Topic 191 100.00 Topic Number
Topic 172 8.63 Topic 192 52.24
Topic 173 61.88 Topic 193 29.17
CLEF 2005 AH−Merging − Comparison to median by topic (topics 181 to 200)
Topic 174 74.22 Topic 194 54.39 1
Topic 175 64.48 Topic 195 31.38 UNET150w05test
Difference (average precision)
Topic 176 84.19 Topic 196 75.31
0.5
Topic 177 22.71 Topic 197 56.57
Topic 178 5.20 Topic 198 20.61
Topic 179 52.42 Topic 199 74.43 0
Topic 180 31.66 Topic 200 40.61
−0.5
−1
181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200
Topic Number
A.118
cmu UNET15w05test AH-Merging
Overall statistics for 40 queries : General info:
Total number of documents over all queries Track= Ad Hoc Multilingual Merging
Retrieved 40,000 RunType= automatic
Relevant 7,153 QueryType= TD
Relevant retrieved 4,820 Pooled= false
CLEF 2005 AH−Merging − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 82.61 UNET15w05test
90%
10 66.14
20 60.56 80%
30 55.39
70%
40 49.72
50 44.16
Average Precision
60%
60 36.61
50%
70 27.43
80 19.43 40%
90 11.18
30%
100 3.40
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
40.19
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Merging − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 65.00 UNET15w05test
90%
10 docs 61.25
15 docs 59.17 80%
20 docs 56.75
70%
30 docs 53.50
100 docs 39.27 60%
R−Precision
200 docs 29.70
50%
500 docs 18.33
1000 docs 12.05 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
43.03 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Merging − Comparison to median by topic (topics 161 to 180)
queries 1
UNET15w05test
Topic 161 0.04 Topic 181 38.55
Difference (average precision)
Topic 162 68.88 Topic 182 56.61 0.5
Topic 163 63.53 Topic 183 18.45
Topic 164 1.67 Topic 184 43.81
Topic 165 30.36 Topic 185 11.34 0
Topic 166 0.19 Topic 186 38.14
Topic 167 53.64 Topic 187 49.03
−0.5
Topic 168 22.97 Topic 188 56.72
Topic 169 1.85 Topic 189 72.59
Topic 170 62.75 Topic 190 10.59 −1
161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180
Topic 171 7.13 Topic 191 100.00 Topic Number
Topic 172 4.81 Topic 192 37.41
Topic 173 59.77 Topic 193 27.62
CLEF 2005 AH−Merging − Comparison to median by topic (topics 181 to 200)
Topic 174 88.99 Topic 194 45.61 1
Topic 175 66.79 Topic 195 33.44 UNET15w05test
Difference (average precision)
Topic 176 77.85 Topic 196 76.04
0.5
Topic 177 19.43 Topic 197 52.37
Topic 178 2.41 Topic 198 18.11
Topic 179 45.56 Topic 199 73.36 0
Topic 180 29.56 Topic 200 39.77
−0.5
−1
181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200
Topic Number
A.119
dcu dcu.Prositqgm1 AH-Merging
Overall statistics for 40 queries : General info:
Total number of documents over all queries Track= Ad Hoc Multilingual Merging
Retrieved 40,000 RunType= automatic
Relevant 7,153 QueryType= TD
Relevant retrieved 4,486 Pooled= false
CLEF 2005 AH−Merging − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 68.77 dcu.Prositqgm1
90%
10 54.97
20 49.60 80%
30 45.46
70%
40 39.61
50 36.02
Average Precision
60%
60 29.13
50%
70 22.59
80 15.03 40%
90 8.56
30%
100 1.90
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
32.41
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Merging − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 46.50 dcu.Prositqgm1
90%
10 docs 47.50
15 docs 47.50 80%
20 docs 47.00
70%
30 docs 45.92
100 docs 34.10 60%
R−Precision
200 docs 26.84
50%
500 docs 17.71
1000 docs 11.21 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
35.87 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Merging − Comparison to median by topic (topics 161 to 180)
queries 1
dcu.Prositqgm1
Topic 161 0.03 Topic 181 20.38
Difference (average precision)
Topic 162 43.82 Topic 182 54.29 0.5
Topic 163 38.42 Topic 183 13.33
Topic 164 0.33 Topic 184 42.24
Topic 165 17.26 Topic 185 3.68 0
Topic 166 0.17 Topic 186 27.13
Topic 167 32.93 Topic 187 48.15
−0.5
Topic 168 9.50 Topic 188 69.81
Topic 169 1.22 Topic 189 57.29
Topic 170 35.03 Topic 190 42.83 −1
161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180
Topic 171 6.43 Topic 191 14.29 Topic Number
Topic 172 1.47 Topic 192 58.51
Topic 173 72.76 Topic 193 30.12
CLEF 2005 AH−Merging − Comparison to median by topic (topics 181 to 200)
Topic 174 81.53 Topic 194 30.17 1
Topic 175 38.93 Topic 195 37.75 dcu.Prositqgm1
Difference (average precision)
Topic 176 83.69 Topic 196 50.84
0.5
Topic 177 16.59 Topic 197 30.32
Topic 178 1.34 Topic 198 6.57
Topic 179 27.56 Topic 199 66.50 0
Topic 180 53.70 Topic 200 29.46
−0.5
−1
181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200
Topic Number
A.120
dcu dcu.Prositqgm2 AH-Merging
Overall statistics for 40 queries : General info:
Total number of documents over all queries Track= Ad Hoc Multilingual Merging
Retrieved 40,000 RunType= automatic
Relevant 7,153 QueryType= TD
Relevant retrieved 4,512 Pooled= false
CLEF 2005 AH−Merging − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 69.75 dcu.Prositqgm2
90%
10 55.59
20 50.02 80%
30 46.58
70%
40 39.91
50 36.79
Average Precision
60%
60 29.39
50%
70 22.96
80 15.38 40%
90 8.57
30%
100 1.80
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
32.86
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Merging − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 48.00 dcu.Prositqgm2
90%
10 docs 47.00
15 docs 47.33 80%
20 docs 47.25
70%
30 docs 46.08
100 docs 34.80 60%
R−Precision
200 docs 27.21
50%
500 docs 17.77
1000 docs 11.28 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
36.25 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Merging − Comparison to median by topic (topics 161 to 180)
queries 1
dcu.Prositqgm2
Topic 161 0.03 Topic 181 22.64
Difference (average precision)
Topic 162 43.89 Topic 182 57.63 0.5
Topic 163 43.04 Topic 183 13.56
Topic 164 0.42 Topic 184 43.77
Topic 165 17.10 Topic 185 3.30 0
Topic 166 0.12 Topic 186 25.68
Topic 167 34.19 Topic 187 44.48
−0.5
Topic 168 8.71 Topic 188 67.84
Topic 169 1.20 Topic 189 62.97
Topic 170 37.44 Topic 190 42.51 −1
161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180
Topic 171 6.15 Topic 191 14.29 Topic Number
Topic 172 1.56 Topic 192 58.25
Topic 173 73.64 Topic 193 27.44
CLEF 2005 AH−Merging − Comparison to median by topic (topics 181 to 200)
Topic 174 80.46 Topic 194 31.72 1
Topic 175 39.68 Topic 195 35.94 dcu.Prositqgm2
Difference (average precision)
Topic 176 86.01 Topic 196 51.67
0.5
Topic 177 17.04 Topic 197 30.16
Topic 178 1.50 Topic 198 6.38
Topic 179 30.06 Topic 199 67.06 0
Topic 180 53.76 Topic 200 30.88
−0.5
−1
181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200
Topic Number
A.121
dcu dcu.Prositqgp AH-Merging
Overall statistics for 40 queries : General info:
Total number of documents over all queries Track= Ad Hoc Multilingual Merging
Retrieved 40,000 RunType= automatic
Relevant 7,153 QueryType= TD
Relevant retrieved 4,404 Pooled= false
CLEF 2005 AH−Merging − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 67.33 dcu.Prositqgp
90%
10 54.51
20 48.79 80%
30 44.33
70%
40 37.69
50 33.18
Average Precision
60%
60 26.87
50%
70 20.56
80 14.70 40%
90 7.91
30%
100 1.68
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
31.03
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Merging − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 45.50 dcu.Prositqgp
90%
10 docs 45.00
15 docs 46.17 80%
20 docs 46.37
70%
30 docs 44.58
100 docs 33.00 60%
R−Precision
200 docs 26.09
50%
500 docs 17.27
1000 docs 11.01 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
35.05 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Merging − Comparison to median by topic (topics 161 to 180)
queries 1
dcu.Prositqgp
Topic 161 0.03 Topic 181 15.80
Difference (average precision)
Topic 162 45.76 Topic 182 51.91 0.5
Topic 163 39.15 Topic 183 13.33
Topic 164 0.06 Topic 184 23.02
Topic 165 16.65 Topic 185 4.86 0
Topic 166 0.29 Topic 186 33.84
Topic 167 33.54 Topic 187 48.90
−0.5
Topic 168 12.37 Topic 188 56.79
Topic 169 0.84 Topic 189 55.38
Topic 170 33.53 Topic 190 29.61 −1
161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180
Topic 171 6.63 Topic 191 12.50 Topic Number
Topic 172 1.81 Topic 192 47.26
Topic 173 72.23 Topic 193 29.12
CLEF 2005 AH−Merging − Comparison to median by topic (topics 181 to 200)
Topic 174 83.10 Topic 194 29.45 1
Topic 175 33.76 Topic 195 35.64 dcu.Prositqgp
Difference (average precision)
Topic 176 83.28 Topic 196 53.04
0.5
Topic 177 17.17 Topic 197 34.69
Topic 178 0.99 Topic 198 7.57
Topic 179 27.53 Topic 199 68.10 0
Topic 180 53.13 Topic 200 28.60
−0.5
−1
181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200
Topic Number
A.122
dcu dcu.Prositqgt AH-Merging
Overall statistics for 40 queries : General info:
Total number of documents over all queries Track= Ad Hoc Multilingual Merging
Retrieved 40,000 RunType= automatic
Relevant 7,153 QueryType= TD
Relevant retrieved 4,477 Pooled= false
CLEF 2005 AH−Merging − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 69.00 dcu.Prositqgt
90%
10 55.00
20 49.99 80%
30 46.31
70%
40 39.00
50 34.67
Average Precision
60%
60 27.50
50%
70 22.22
80 14.54 40%
90 7.86
30%
100 1.63
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
32.01
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Merging − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 46.50 dcu.Prositqgt
90%
10 docs 46.00
15 docs 46.83 80%
20 docs 46.50
70%
30 docs 44.58
100 docs 33.98 60%
R−Precision
200 docs 27.07
50%
500 docs 17.67
1000 docs 11.19 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
35.86 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Merging − Comparison to median by topic (topics 161 to 180)
queries 1
dcu.Prositqgt
Topic 161 0.04 Topic 181 20.17
Difference (average precision)
Topic 162 47.23 Topic 182 56.46 0.5
Topic 163 46.40 Topic 183 13.48
Topic 164 0.14 Topic 184 26.11
Topic 165 16.38 Topic 185 4.25 0
Topic 166 0.14 Topic 186 32.17
Topic 167 34.41 Topic 187 44.58
−0.5
Topic 168 12.04 Topic 188 56.21
Topic 169 0.79 Topic 189 61.06
Topic 170 35.88 Topic 190 29.76 −1
161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180
Topic 171 6.31 Topic 191 14.29 Topic Number
Topic 172 2.06 Topic 192 49.60
Topic 173 73.76 Topic 193 27.04
CLEF 2005 AH−Merging − Comparison to median by topic (topics 181 to 200)
Topic 174 81.79 Topic 194 31.15 1
Topic 175 36.48 Topic 195 32.99 dcu.Prositqgt
Difference (average precision)
Topic 176 85.79 Topic 196 54.05
0.5
Topic 177 17.58 Topic 197 37.42
Topic 178 1.38 Topic 198 6.91
Topic 179 31.93 Topic 199 69.13 0
Topic 180 52.88 Topic 200 30.23
−0.5
−1
181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200
Topic Number
A.123
dcu dcu.humm1 AH-Merging
Overall statistics for 40 queries : General info:
Total number of documents over all queries Track= Ad Hoc Multilingual Merging
Retrieved 40,000 RunType= automatic
Relevant 7,153 QueryType= TD
Relevant retrieved 2,873 Pooled= false
CLEF 2005 AH−Merging − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 76.90 dcu.humm1
90%
10 45.67
20 32.68 80%
30 24.69
70%
40 20.37
50 16.42
Average Precision
60%
60 11.94
50%
70 8.38
80 4.61 40%
90 3.64
30%
100 0.83
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
19.88
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Merging − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 55.00 dcu.humm1
90%
10 docs 48.00
15 docs 44.33 80%
20 docs 42.62
70%
30 docs 38.17
100 docs 25.85 60%
R−Precision
200 docs 18.60
50%
500 docs 11.10
1000 docs 7.18 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
23.80 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Merging − Comparison to median by topic (topics 161 to 180)
queries 1
dcu.humm1
Topic 161 0.02 Topic 181 18.05
Difference (average precision)
Topic 162 18.41 Topic 182 40.40 0.5
Topic 163 51.35 Topic 183 12.76
Topic 164 1.39 Topic 184 20.97
Topic 165 19.08 Topic 185 8.10 0
Topic 166 2.70 Topic 186 1.99
Topic 167 19.26 Topic 187 10.37
−0.5
Topic 168 3.74 Topic 188 20.75
Topic 169 0.24 Topic 189 55.03
Topic 170 28.69 Topic 190 12.74 −1
161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180
Topic 171 6.44 Topic 191 33.33 Topic Number
Topic 172 1.38 Topic 192 16.52
Topic 173 56.64 Topic 193 20.04
CLEF 2005 AH−Merging − Comparison to median by topic (topics 181 to 200)
Topic 174 46.08 Topic 194 9.14 1
Topic 175 24.02 Topic 195 3.55 dcu.humm1
Difference (average precision)
Topic 176 81.80 Topic 196 42.85
0.5
Topic 177 6.11 Topic 197 16.01
Topic 178 0.10 Topic 198 7.21
Topic 179 9.36 Topic 199 54.84 0
Topic 180 2.50 Topic 200 11.14
−0.5
−1
181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200
Topic Number
A.124
dcu dcu.humm2 AH-Merging
Overall statistics for 40 queries : General info:
Total number of documents over all queries Track= Ad Hoc Multilingual Merging
Retrieved 40,000 RunType= automatic
Relevant 7,153 QueryType= TD
Relevant retrieved 2,846 Pooled= false
CLEF 2005 AH−Merging − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 77.14 dcu.humm2
90%
10 41.42
20 30.08 80%
30 23.21
70%
40 19.56
50 15.11
Average Precision
60%
60 10.98
50%
70 8.34
80 4.55 40%
90 3.56
30%
100 0.83
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
18.46
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Merging − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 48.50 dcu.humm2
90%
10 docs 46.50
15 docs 43.00 80%
20 docs 41.00
70%
30 docs 36.25
100 docs 24.35 60%
R−Precision
200 docs 17.94
50%
500 docs 11.00
1000 docs 7.12 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
21.72 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Merging − Comparison to median by topic (topics 161 to 180)
queries 1
dcu.humm2
Topic 161 0.02 Topic 181 17.45
Difference (average precision)
Topic 162 18.40 Topic 182 35.00 0.5
Topic 163 54.39 Topic 183 12.75
Topic 164 1.70 Topic 184 20.34
Topic 165 17.26 Topic 185 8.04 0
Topic 166 1.45 Topic 186 1.70
Topic 167 17.70 Topic 187 8.60
−0.5
Topic 168 3.69 Topic 188 19.00
Topic 169 0.27 Topic 189 53.31
Topic 170 21.20 Topic 190 10.31 −1
161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180
Topic 171 5.91 Topic 191 33.33 Topic Number
Topic 172 1.64 Topic 192 15.29
Topic 173 53.19 Topic 193 17.17
CLEF 2005 AH−Merging − Comparison to median by topic (topics 181 to 200)
Topic 174 29.52 Topic 194 11.57 1
Topic 175 25.36 Topic 195 2.42 dcu.humm2
Difference (average precision)
Topic 176 79.35 Topic 196 37.08
0.5
Topic 177 6.95 Topic 197 13.44
Topic 178 0.16 Topic 198 6.87
Topic 179 7.67 Topic 199 53.44 0
Topic 180 5.71 Topic 200 9.93
−0.5
−1
181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200
Topic Number
A.125
dcu dcu.hump AH-Merging
Overall statistics for 40 queries : General info:
Total number of documents over all queries Track= Ad Hoc Multilingual Merging
Retrieved 40,000 RunType= automatic
Relevant 7,153 QueryType= TD
Relevant retrieved 2,892 Pooled= false
CLEF 2005 AH−Merging − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 82.31 dcu.hump
90%
10 46.94
20 33.49 80%
30 26.59
70%
40 21.02
50 17.18
Average Precision
60%
60 13.31
50%
70 8.76
80 4.49 40%
90 2.99
30%
100 1.25
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
20.86
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Merging − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 57.00 dcu.hump
90%
10 docs 51.75
15 docs 47.33 80%
20 docs 44.62
70%
30 docs 39.58
100 docs 25.98 60%
R−Precision
200 docs 19.24
50%
500 docs 11.68
1000 docs 7.23 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
23.93 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Merging − Comparison to median by topic (topics 161 to 180)
queries 1
dcu.hump
Topic 161 0.03 Topic 181 21.22
Difference (average precision)
Topic 162 25.85 Topic 182 38.27 0.5
Topic 163 57.94 Topic 183 15.61
Topic 164 1.83 Topic 184 20.55
Topic 165 19.83 Topic 185 8.51 0
Topic 166 2.40 Topic 186 3.15
Topic 167 21.78 Topic 187 8.58
−0.5
Topic 168 3.77 Topic 188 19.88
Topic 169 0.34 Topic 189 55.83
Topic 170 22.61 Topic 190 4.48 −1
161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180
Topic 171 7.66 Topic 191 50.00 Topic Number
Topic 172 0.98 Topic 192 16.56
Topic 173 65.73 Topic 193 17.23
CLEF 2005 AH−Merging − Comparison to median by topic (topics 181 to 200)
Topic 174 49.54 Topic 194 17.29 1
Topic 175 16.46 Topic 195 4.46 dcu.hump
Difference (average precision)
Topic 176 83.91 Topic 196 39.62
0.5
Topic 177 6.16 Topic 197 16.11
Topic 178 0.20 Topic 198 7.08
Topic 179 11.72 Topic 199 50.98 0
Topic 180 5.53 Topic 200 14.93
−0.5
−1
181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200
Topic Number
A.126
dcu dcu.humt AH-Merging
Overall statistics for 40 queries : General info:
Total number of documents over all queries Track= Ad Hoc Multilingual Merging
Retrieved 40,000 RunType= automatic
Relevant 7,153 QueryType= TD
Relevant retrieved 2,442 Pooled= false
CLEF 2005 AH−Merging − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 74.87 dcu.humt
90%
10 37.31
20 27.79 80%
30 20.95
70%
40 16.75
50 14.03
Average Precision
60%
60 11.53
50%
70 7.67
80 5.78 40%
90 3.75
30%
100 2.50
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
17.34
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Merging − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 44.50 dcu.humt
90%
10 docs 40.75
15 docs 38.17 80%
20 docs 36.38
70%
30 docs 32.75
100 docs 21.10 60%
R−Precision
200 docs 15.60
50%
500 docs 9.61
1000 docs 6.11 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
22.38 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Merging − Comparison to median by topic (topics 161 to 180)
queries 1
dcu.humt
Topic 161 0.02 Topic 181 18.43
Difference (average precision)
Topic 162 20.26 Topic 182 29.31 0.5
Topic 163 51.86 Topic 183 8.07
Topic 164 1.57 Topic 184 10.91
Topic 165 13.10 Topic 185 4.89 0
Topic 166 0.37 Topic 186 0.57
Topic 167 20.68 Topic 187 4.99
−0.5
Topic 168 3.62 Topic 188 10.01
Topic 169 0.34 Topic 189 43.53
Topic 170 6.53 Topic 190 2.30 −1
161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180
Topic 171 4.60 Topic 191 100.00 Topic Number
Topic 172 1.61 Topic 192 4.81
Topic 173 62.23 Topic 193 9.04
CLEF 2005 AH−Merging − Comparison to median by topic (topics 181 to 200)
Topic 174 38.42 Topic 194 10.56 1
Topic 175 20.87 Topic 195 0.42 dcu.humt
Difference (average precision)
Topic 176 78.28 Topic 196 23.99
0.5
Topic 177 7.05 Topic 197 7.93
Topic 178 0.18 Topic 198 6.08
Topic 179 5.16 Topic 199 44.50 0
Topic 180 8.26 Topic 200 8.28
−0.5
−1
181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200
Topic Number
A.127
jaen UJAMENEDF AH-Merging
Overall statistics for 40 queries : General info:
Total number of documents over all queries Track= Ad Hoc Multilingual Merging
Retrieved 40,000 RunType= automatic
Relevant 7,153 QueryType= TD
Relevant retrieved 3,862 Pooled= false
CLEF 2005 AH−Merging − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 76.50 UJAMENEDF
90%
10 58.65
20 51.03 80%
30 42.58
70%
40 32.39
50 26.96
Average Precision
60%
60 19.71
50%
70 14.46
80 9.16 40%
90 5.91
30%
100 3.37
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
29.42
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Merging − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 60.00 UJAMENEDF
90%
10 docs 56.25
15 docs 52.17 80%
20 docs 49.88
70%
30 docs 45.58
100 docs 31.72 60%
R−Precision
200 docs 24.51
50%
500 docs 15.34
1000 docs 9.66 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
33.82 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Merging − Comparison to median by topic (topics 161 to 180)
queries 1
UJAMENEDF
Topic 161 0.02 Topic 181 29.32
Difference (average precision)
Topic 162 46.09 Topic 182 43.77 0.5
Topic 163 61.88 Topic 183 19.34
Topic 164 1.41 Topic 184 26.32
Topic 165 22.92 Topic 185 14.42 0
Topic 166 0.20 Topic 186 18.53
Topic 167 36.08 Topic 187 17.37
−0.5
Topic 168 12.41 Topic 188 43.86
Topic 169 1.52 Topic 189 49.44
Topic 170 21.62 Topic 190 20.93 −1
161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180
Topic 171 5.39 Topic 191 100.00 Topic Number
Topic 172 7.21 Topic 192 33.27
Topic 173 63.58 Topic 193 15.20
CLEF 2005 AH−Merging − Comparison to median by topic (topics 181 to 200)
Topic 174 67.44 Topic 194 26.99 1
Topic 175 28.75 Topic 195 14.82 UJAMENEDF
Difference (average precision)
Topic 176 85.52 Topic 196 57.58
0.5
Topic 177 20.96 Topic 197 46.27
Topic 178 0.57 Topic 198 7.82
Topic 179 10.67 Topic 199 66.93 0
Topic 180 2.52 Topic 200 27.73
−0.5
−1
181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200
Topic Number
A.128
jaen UJAMENEDFRR AH-Merging
Overall statistics for 40 queries : General info:
Total number of documents over all queries Track= Ad Hoc Multilingual Merging
Retrieved 40,000 RunType= automatic
Relevant 7,153 QueryType= TD
Relevant retrieved 4,071 Pooled= false
CLEF 2005 AH−Merging − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 75.60 UJAMENEDFRR
90%
10 58.47
20 52.00 80%
30 43.55
70%
40 34.21
50 28.39
Average Precision
60%
60 22.35
50%
70 15.41
80 10.63 40%
90 6.09
30%
100 3.64
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
30.37
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Merging − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 58.50 UJAMENEDFRR
90%
10 docs 54.50
15 docs 51.67 80%
20 docs 50.00
70%
30 docs 46.17
100 docs 32.57 60%
R−Precision
200 docs 25.34
50%
500 docs 16.10
1000 docs 10.18 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
35.24 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Merging − Comparison to median by topic (topics 161 to 180)
queries 1
UJAMENEDFRR
Topic 161 0.02 Topic 181 30.22
Difference (average precision)
Topic 162 47.21 Topic 182 41.26 0.5
Topic 163 63.65 Topic 183 20.22
Topic 164 1.05 Topic 184 25.24
Topic 165 22.88 Topic 185 14.39 0
Topic 166 0.40 Topic 186 24.62
Topic 167 40.79 Topic 187 24.29
−0.5
Topic 168 11.53 Topic 188 54.85
Topic 169 1.53 Topic 189 50.60
Topic 170 20.51 Topic 190 24.93 −1
161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180
Topic 171 6.27 Topic 191 100.00 Topic Number
Topic 172 6.90 Topic 192 32.36
Topic 173 63.52 Topic 193 18.39
CLEF 2005 AH−Merging − Comparison to median by topic (topics 181 to 200)
Topic 174 69.31 Topic 194 28.76 1
Topic 175 25.74 Topic 195 15.14 UJAMENEDFRR
Difference (average precision)
Topic 176 85.55 Topic 196 51.38
0.5
Topic 177 20.34 Topic 197 53.52
Topic 178 0.91 Topic 198 5.33
Topic 179 12.55 Topic 199 67.45 0
Topic 180 3.65 Topic 200 27.65
−0.5
−1
181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200
Topic Number
A.129
jaen UJAMENEOK AH-Merging
Overall statistics for 40 queries : General info:
Total number of documents over all queries Track= Ad Hoc Multilingual Merging
Retrieved 40,000 RunType= automatic
Relevant 7,153 QueryType= TD
Relevant retrieved 3,764 Pooled= false
CLEF 2005 AH−Merging − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 76.57 UJAMENEOK
90%
10 57.73
20 50.78 80%
30 40.92
70%
40 30.94
50 26.10
Average Precision
60%
60 19.05
50%
70 14.01
80 8.95 40%
90 5.92
30%
100 3.32
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
28.87
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Merging − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 60.50 UJAMENEOK
90%
10 docs 56.00
15 docs 51.83 80%
20 docs 49.50
70%
30 docs 45.33
100 docs 31.28 60%
R−Precision
200 docs 24.04
50%
500 docs 15.02
1000 docs 9.41 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
33.13 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Merging − Comparison to median by topic (topics 161 to 180)
queries 1
UJAMENEOK
Topic 161 0.01 Topic 181 29.20
Difference (average precision)
Topic 162 46.09 Topic 182 43.77 0.5
Topic 163 61.49 Topic 183 18.58
Topic 164 1.41 Topic 184 23.61
Topic 165 23.15 Topic 185 14.26 0
Topic 166 0.18 Topic 186 17.37
Topic 167 36.83 Topic 187 17.25
−0.5
Topic 168 12.40 Topic 188 42.96
Topic 169 1.12 Topic 189 48.93
Topic 170 21.71 Topic 190 17.60 −1
161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180
Topic 171 5.30 Topic 191 100.00 Topic Number
Topic 172 7.48 Topic 192 29.14
Topic 173 63.27 Topic 193 15.20
CLEF 2005 AH−Merging − Comparison to median by topic (topics 181 to 200)
Topic 174 67.10 Topic 194 27.50 1
Topic 175 29.56 Topic 195 14.81 UJAMENEOK
Difference (average precision)
Topic 176 85.54 Topic 196 57.57
0.5
Topic 177 18.13 Topic 197 46.04
Topic 178 0.55 Topic 198 7.54
Topic 179 10.37 Topic 199 66.93 0
Topic 180 2.26 Topic 200 22.68
−0.5
−1
181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200
Topic Number
A.130
jaen UJAMENEOKRR AH-Merging
Overall statistics for 40 queries : General info:
Total number of documents over all queries Track= Ad Hoc Multilingual Merging
Retrieved 40,000 RunType= automatic
Relevant 7,153 QueryType= TD
Relevant retrieved 3,764 Pooled= false
CLEF 2005 AH−Merging − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 76.57 UJAMENEOKRR
90%
10 57.73
20 50.78 80%
30 40.92
70%
40 30.94
50 26.10
Average Precision
60%
60 19.05
50%
70 14.01
80 8.95 40%
90 5.92
30%
100 3.32
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
28.87
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Merging − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 60.50 UJAMENEOKRR
90%
10 docs 56.00
15 docs 51.83 80%
20 docs 49.50
70%
30 docs 45.33
100 docs 31.28 60%
R−Precision
200 docs 24.04
50%
500 docs 15.02
1000 docs 9.41 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
33.13 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Merging − Comparison to median by topic (topics 161 to 180)
queries 1
UJAMENEOKRR
Topic 161 0.01 Topic 181 29.20
Difference (average precision)
Topic 162 46.09 Topic 182 43.77 0.5
Topic 163 61.49 Topic 183 18.58
Topic 164 1.41 Topic 184 23.61
Topic 165 23.15 Topic 185 14.26 0
Topic 166 0.18 Topic 186 17.37
Topic 167 36.83 Topic 187 17.25
−0.5
Topic 168 12.40 Topic 188 42.96
Topic 169 1.12 Topic 189 48.93
Topic 170 21.71 Topic 190 17.60 −1
161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180
Topic 171 5.30 Topic 191 100.00 Topic Number
Topic 172 7.48 Topic 192 29.14
Topic 173 63.27 Topic 193 15.20
CLEF 2005 AH−Merging − Comparison to median by topic (topics 181 to 200)
Topic 174 67.10 Topic 194 27.50 1
Topic 175 29.56 Topic 195 14.81 UJAMENEOKRR
Difference (average precision)
Topic 176 85.54 Topic 196 57.57
0.5
Topic 177 18.13 Topic 197 46.04
Topic 178 0.55 Topic 198 7.54
Topic 179 10.37 Topic 199 66.93 0
Topic 180 2.26 Topic 200 22.68
−0.5
−1
181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200
Topic Number
A.131
jhu-apl aplbienbga AH-Bilingual-X2BG
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to Bulgarian
Retrieved 50,000 RunType= automatic
Relevant 778 QueryType= TD
Relevant retrieved 438 Pooled= true
CLEF 2005 AH−Bilingual−X2BG − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 22.23 aplbienbga
90%
10 17.07
20 14.73 80%
30 10.54
70%
40 9.24
50 7.77
Average Precision
60%
60 6.07
50%
70 4.98
80 4.14 40%
90 1.96
30%
100 1.65
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
8.33
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2BG − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 10.80 aplbienbga
90%
10 docs 9.60
15 docs 8.40 80%
20 docs 7.70
70%
30 docs 6.73
100 docs 4.44 60%
R−Precision
200 docs 2.97
50%
500 docs 1.50
1000 docs 0.88 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
7.56 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 251 to 275)
queries 1
aplbienbga
Topic 251 12.71 Topic 276 0.47
Difference (average precision)
Topic 252 2.31 Topic 277 0.02 0.5
Topic 253 7.16 Topic 278 0.01
Topic 254 31.98 Topic 279 66.50
Topic 255 0.18 Topic 280 0.00 0
Topic 256 3.79 Topic 281 1.42
Topic 257 3.06 Topic 282 0.45
−0.5
Topic 258 0.00 Topic 283 0.00
Topic 259 0.13 Topic 284 15.42
Topic 260 0.00 Topic 285 0.00 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.41 Topic 286 1.11 Topic Number
Topic 262 6.69 Topic 287 24.88
Topic 263 23.42 Topic 288 0.01
CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 276 to 300)
Topic 264 10.49 Topic 289 4.78 1
Topic 265 0.02 Topic 290 0.10 aplbienbga
Difference (average precision)
Topic 266 0.17 Topic 291 15.40
0.5
Topic 267 13.63 Topic 292 0.00
Topic 268 0.38 Topic 293 6.21
Topic 269 31.68 Topic 294 70.15 0
Topic 270 36.28 Topic 295 0.83
Topic 271 0.00 Topic 296 0.00
Topic 272 0.00 Topic 297 0.10 −0.5
Topic 273 0.01 Topic 298 0.00
Topic 274 1.84 Topic 299 0.00
−1
Topic 275 0.89 Topic 300 21.22 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.132
jhu-apl aplbienbge AH-Bilingual-X2BG
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to Bulgarian
Retrieved 50,000 RunType= automatic
Relevant 778 QueryType= TD
Relevant retrieved 423 Pooled= true
CLEF 2005 AH−Bilingual−X2BG − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 21.86 aplbienbge
90%
10 18.27
20 16.13 80%
30 11.90
70%
40 11.02
50 9.23
Average Precision
60%
60 7.16
50%
70 6.54
80 5.33 40%
90 3.29
30%
100 2.67
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
9.59
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2BG − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 12.40 aplbienbge
90%
10 docs 10.80
15 docs 9.33 80%
20 docs 8.60
70%
30 docs 7.53
100 docs 4.62 60%
R−Precision
200 docs 3.09
50%
500 docs 1.46
1000 docs 0.85 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
9.93 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 251 to 275)
queries 1
aplbienbge
Topic 251 11.29 Topic 276 0.46
Difference (average precision)
Topic 252 1.76 Topic 277 0.18 0.5
Topic 253 28.52 Topic 278 0.00
Topic 254 33.78 Topic 279 94.44
Topic 255 0.17 Topic 280 0.03 0
Topic 256 12.84 Topic 281 1.51
Topic 257 3.50 Topic 282 0.01
−0.5
Topic 258 0.00 Topic 283 0.07
Topic 259 0.33 Topic 284 18.59
Topic 260 0.00 Topic 285 0.00 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.60 Topic 286 1.53 Topic Number
Topic 262 0.24 Topic 287 14.47
Topic 263 26.07 Topic 288 0.01
CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 276 to 300)
Topic 264 11.59 Topic 289 0.06 1
Topic 265 0.09 Topic 290 0.00 aplbienbge
Difference (average precision)
Topic 266 0.00 Topic 291 23.85
0.5
Topic 267 11.69 Topic 292 0.00
Topic 268 0.27 Topic 293 4.43
Topic 269 9.69 Topic 294 72.61 0
Topic 270 34.97 Topic 295 1.96
Topic 271 0.00 Topic 296 0.00
Topic 272 0.00 Topic 297 0.18 −0.5
Topic 273 0.09 Topic 298 0.00
Topic 274 25.94 Topic 299 0.00
−1
Topic 275 3.52 Topic 300 28.08 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.133
miracle ENXHT AH-Bilingual-X2BG
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to Bulgarian
Retrieved 50,000 RunType= automatic
Relevant 778 QueryType= TD
Relevant retrieved 650 Pooled= true
CLEF 2005 AH−Bilingual−X2BG − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 42.92 ENXHT
90%
10 33.41
20 29.71 80%
30 24.73
70%
40 20.12
50 16.76
Average Precision
60%
60 9.46
50%
70 7.98
80 5.66 40%
90 3.63
30%
100 2.08
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
16.35
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2BG − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 18.00 ENXHT
90%
10 docs 17.20
15 docs 16.00 80%
20 docs 14.30
70%
30 docs 12.40
100 docs 7.00 60%
R−Precision
200 docs 4.41
50%
500 docs 2.20
1000 docs 1.30 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
17.25 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 251 to 275)
queries 1
ENXHT
Topic 251 23.49 Topic 276 9.87
Difference (average precision)
Topic 252 2.13 Topic 277 4.66 0.5
Topic 253 7.98 Topic 278 1.06
Topic 254 28.64 Topic 279 12.39
Topic 255 0.95 Topic 280 3.01 0
Topic 256 50.72 Topic 281 11.33
Topic 257 14.70 Topic 282 3.92
−0.5
Topic 258 1.92 Topic 283 62.84
Topic 259 66.66 Topic 284 2.47
Topic 260 18.01 Topic 285 36.59 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 30.94 Topic 286 0.52 Topic Number
Topic 262 25.13 Topic 287 21.59
Topic 263 1.51 Topic 288 0.79
CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 276 to 300)
Topic 264 15.33 Topic 289 56.67 1
Topic 265 7.99 Topic 290 6.19 ENXHT
Difference (average precision)
Topic 266 7.34 Topic 291 20.31
0.5
Topic 267 9.71 Topic 292 0.00
Topic 268 48.65 Topic 293 63.84
Topic 269 0.84 Topic 294 33.32 0
Topic 270 20.69 Topic 295 48.40
Topic 271 1.58 Topic 296 0.00
Topic 272 0.00 Topic 297 3.52 −0.5
Topic 273 4.19 Topic 298 7.05
Topic 274 7.36 Topic 299 0.75
−1
Topic 275 6.04 Topic 300 4.07 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.134
miracle ENXST AH-Bilingual-X2BG
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to Bulgarian
Retrieved 50,000 RunType= automatic
Relevant 778 QueryType= TD
Relevant retrieved 694 Pooled= true
CLEF 2005 AH−Bilingual−X2BG − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 58.01 ENXST
90%
10 48.81
20 39.28 80%
30 32.85
70%
40 25.92
50 23.41
Average Precision
60%
60 15.71
50%
70 14.07
80 10.88 40%
90 6.82
30%
100 4.32
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
23.55
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2BG − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 27.20 ENXST
90%
10 docs 22.00
15 docs 18.53 80%
20 docs 17.50
70%
30 docs 15.73
100 docs 8.72 60%
R−Precision
200 docs 5.12
50%
500 docs 2.42
1000 docs 1.39 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
23.38 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 251 to 275)
queries 1
ENXST
Topic 251 32.28 Topic 276 10.02
Difference (average precision)
Topic 252 6.34 Topic 277 8.33 0.5
Topic 253 13.00 Topic 278 13.69
Topic 254 34.00 Topic 279 90.48
Topic 255 33.51 Topic 280 14.37 0
Topic 256 51.59 Topic 281 28.58
Topic 257 32.41 Topic 282 3.05
−0.5
Topic 258 20.00 Topic 283 71.72
Topic 259 65.12 Topic 284 4.27
Topic 260 27.51 Topic 285 43.06 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 24.77 Topic 286 0.95 Topic Number
Topic 262 49.01 Topic 287 22.75
Topic 263 2.68 Topic 288 2.04
CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 276 to 300)
Topic 264 17.30 Topic 289 53.85 1
Topic 265 16.61 Topic 290 7.03 ENXST
Difference (average precision)
Topic 266 20.80 Topic 291 29.37
0.5
Topic 267 11.62 Topic 292 0.00
Topic 268 44.63 Topic 293 49.16
Topic 269 0.99 Topic 294 50.73 0
Topic 270 10.95 Topic 295 54.76
Topic 271 6.12 Topic 296 0.00
Topic 272 3.23 Topic 297 2.19 −0.5
Topic 273 6.99 Topic 298 51.47
Topic 274 9.55 Topic 299 3.58
−1
Topic 275 16.01 Topic 300 5.17 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.135
u.glasgow glaenbgtd AH-Bilingual-X2BG
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to Bulgarian
Retrieved 50,000 RunType= automatic
Relevant 778 QueryType= TD
Relevant retrieved 475 Pooled= true
CLEF 2005 AH−Bilingual−X2BG − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 33.90 glaenbgtd
90%
10 25.62
20 20.45 80%
30 17.09
70%
40 13.78
50 10.13
Average Precision
60%
60 7.26
50%
70 6.18
80 4.07 40%
90 2.12
30%
100 1.60
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
12.04
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2BG − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 18.80 glaenbgtd
90%
10 docs 17.00
15 docs 14.40 80%
20 docs 12.60
70%
30 docs 10.47
100 docs 5.42 60%
R−Precision
200 docs 3.36
50%
500 docs 1.68
1000 docs 0.95 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
13.36 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 251 to 275)
queries 1
glaenbgtd
Topic 251 6.97 Topic 276 2.14
Difference (average precision)
Topic 252 0.48 Topic 277 36.38 0.5
Topic 253 15.54 Topic 278 5.43
Topic 254 11.89 Topic 279 7.70
Topic 255 0.95 Topic 280 4.96 0
Topic 256 0.79 Topic 281 23.61
Topic 257 23.44 Topic 282 1.56
−0.5
Topic 258 16.67 Topic 283 65.60
Topic 259 68.45 Topic 284 3.05
Topic 260 7.38 Topic 285 0.00 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 20.18 Topic 286 0.53 Topic Number
Topic 262 5.69 Topic 287 10.23
Topic 263 1.47 Topic 288 0.85
CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 276 to 300)
Topic 264 7.86 Topic 289 25.76 1
Topic 265 0.93 Topic 290 0.45 glaenbgtd
Difference (average precision)
Topic 266 5.00 Topic 291 20.41
0.5
Topic 267 5.20 Topic 292 0.00
Topic 268 39.44 Topic 293 49.83
Topic 269 0.00 Topic 294 35.31 0
Topic 270 0.85 Topic 295 36.64
Topic 271 1.64 Topic 296 0.00
Topic 272 0.00 Topic 297 12.40 −0.5
Topic 273 3.85 Topic 298 0.00
Topic 274 4.39 Topic 299 3.11
−1
Topic 275 1.15 Topic 300 5.60 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.136
u.glasgow glaenbgtdn1 AH-Bilingual-X2BG
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to Bulgarian
Retrieved 50,000 RunType= automatic
Relevant 778 QueryType= TDN
Relevant retrieved 505 Pooled= true
CLEF 2005 AH−Bilingual−X2BG − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 38.11 glaenbgtdn1
90%
10 32.66
20 23.95 80%
30 18.68
70%
40 15.27
50 11.90
Average Precision
60%
60 8.03
50%
70 6.02
80 3.84 40%
90 1.60
30%
100 1.25
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
13.44
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2BG − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 23.20 glaenbgtdn1
90%
10 docs 18.60
15 docs 15.60 80%
20 docs 14.30
70%
30 docs 11.73
100 docs 5.88 60%
R−Precision
200 docs 3.51
50%
500 docs 1.74
1000 docs 1.01 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
14.51 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 251 to 275)
queries 1
glaenbgtdn1
Topic 251 2.56 Topic 276 2.14
Difference (average precision)
Topic 252 9.05 Topic 277 45.68 0.5
Topic 253 18.97 Topic 278 3.15
Topic 254 18.97 Topic 279 43.88
Topic 255 2.16 Topic 280 4.79 0
Topic 256 1.87 Topic 281 19.84
Topic 257 28.22 Topic 282 2.18
−0.5
Topic 258 0.78 Topic 283 62.36
Topic 259 68.98 Topic 284 4.09
Topic 260 9.04 Topic 285 0.00 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 12.04 Topic 286 1.60 Topic Number
Topic 262 4.17 Topic 287 19.86
Topic 263 1.37 Topic 288 0.99
CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 276 to 300)
Topic 264 4.77 Topic 289 14.29 1
Topic 265 0.51 Topic 290 2.19 glaenbgtdn1
Difference (average precision)
Topic 266 6.12 Topic 291 20.32
0.5
Topic 267 6.53 Topic 292 0.00
Topic 268 38.47 Topic 293 41.00
Topic 269 0.18 Topic 294 39.41 0
Topic 270 0.74 Topic 295 39.83
Topic 271 0.37 Topic 296 0.00
Topic 272 0.00 Topic 297 28.23 −0.5
Topic 273 12.96 Topic 298 0.16
Topic 274 4.25 Topic 299 6.66
−1
Topic 275 13.50 Topic 300 2.73 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.137
u.glasgow glaenbgtdn2 AH-Bilingual-X2BG
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to Bulgarian
Retrieved 50,000 RunType= automatic
Relevant 778 QueryType= TDN
Relevant retrieved 491 Pooled= true
CLEF 2005 AH−Bilingual−X2BG − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 37.70 glaenbgtdn2
90%
10 32.02
20 22.27 80%
30 17.98
70%
40 14.84
50 11.39
Average Precision
60%
60 7.51
50%
70 5.56
80 3.69 40%
90 1.61
30%
100 1.27
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
12.90
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2BG − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 20.40 glaenbgtdn2
90%
10 docs 19.20
15 docs 15.87 80%
20 docs 14.00
70%
30 docs 11.00
100 docs 5.74 60%
R−Precision
200 docs 3.51
50%
500 docs 1.72
1000 docs 0.98 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
14.22 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 251 to 275)
queries 1
glaenbgtdn2
Topic 251 3.24 Topic 276 2.95
Difference (average precision)
Topic 252 7.15 Topic 277 36.18 0.5
Topic 253 14.93 Topic 278 2.36
Topic 254 18.82 Topic 279 33.17
Topic 255 2.72 Topic 280 4.43 0
Topic 256 1.42 Topic 281 19.98
Topic 257 25.59 Topic 282 1.49
−0.5
Topic 258 0.40 Topic 283 58.99
Topic 259 69.84 Topic 284 3.57
Topic 260 6.96 Topic 285 0.00 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 26.60 Topic 286 0.94 Topic Number
Topic 262 5.40 Topic 287 17.67
Topic 263 1.46 Topic 288 1.41
CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 276 to 300)
Topic 264 4.12 Topic 289 26.67 1
Topic 265 0.68 Topic 290 1.59 glaenbgtdn2
Difference (average precision)
Topic 266 6.33 Topic 291 16.59
0.5
Topic 267 5.64 Topic 292 0.00
Topic 268 36.68 Topic 293 45.37
Topic 269 0.08 Topic 294 39.25 0
Topic 270 1.11 Topic 295 34.09
Topic 271 0.14 Topic 296 0.00
Topic 272 0.00 Topic 297 22.89 −0.5
Topic 273 10.42 Topic 298 0.12
Topic 274 4.32 Topic 299 6.51
−1
Topic 275 12.32 Topic 300 2.21 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.138
u.glasgow glaenbgtdnqe1 AH-Bilingual-X2BG
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to Bulgarian
Retrieved 50,000 RunType= automatic
Relevant 778 QueryType= TDN
Relevant retrieved 583 Pooled= false
CLEF 2005 AH−Bilingual−X2BG − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 43.14 glaenbgtdnqe1
90%
10 36.76
20 30.09 80%
30 24.15
70%
40 21.04
50 18.47
Average Precision
60%
60 13.23
50%
70 11.11
80 7.80 40%
90 4.00
30%
100 2.25
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
17.99
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2BG − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 24.00 glaenbgtdnqe1
90%
10 docs 21.20
15 docs 18.27 80%
20 docs 16.10
70%
30 docs 13.73
100 docs 7.38 60%
R−Precision
200 docs 4.46
50%
500 docs 2.11
1000 docs 1.17 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
17.10 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 251 to 275)
queries 1
glaenbgtdnqe1
Topic 251 4.47 Topic 276 1.66
Difference (average precision)
Topic 252 8.94 Topic 277 53.63 0.5
Topic 253 27.74 Topic 278 1.20
Topic 254 28.05 Topic 279 64.55
Topic 255 1.29 Topic 280 5.16 0
Topic 256 4.35 Topic 281 31.89
Topic 257 28.67 Topic 282 3.01
−0.5
Topic 258 0.13 Topic 283 76.27
Topic 259 69.84 Topic 284 5.57
Topic 260 28.96 Topic 285 0.38 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 24.89 Topic 286 0.61 Topic Number
Topic 262 2.73 Topic 287 20.12
Topic 263 0.89 Topic 288 1.20
CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 276 to 300)
Topic 264 7.86 Topic 289 26.67 1
Topic 265 0.52 Topic 290 2.48 glaenbgtdnqe1
Difference (average precision)
Topic 266 7.27 Topic 291 37.31
0.5
Topic 267 7.53 Topic 292 0.00
Topic 268 51.38 Topic 293 40.03
Topic 269 0.16 Topic 294 54.94 0
Topic 270 1.22 Topic 295 57.30
Topic 271 0.19 Topic 296 0.00
Topic 272 0.00 Topic 297 39.65 −0.5
Topic 273 22.81 Topic 298 0.11
Topic 274 6.94 Topic 299 18.76
−1
Topic 275 15.43 Topic 300 4.60 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.139
u.glasgow glaenbgtdnqe2 AH-Bilingual-X2BG
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to Bulgarian
Retrieved 50,000 RunType= automatic
Relevant 778 QueryType= TDN
Relevant retrieved 588 Pooled= false
CLEF 2005 AH−Bilingual−X2BG − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 37.67 glaenbgtdnqe2
90%
10 32.34
20 27.06 80%
30 23.32
70%
40 20.25
50 17.42
Average Precision
60%
60 13.07
50%
70 10.88
80 7.98 40%
90 4.60
30%
100 2.39
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
16.68
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2BG − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 23.20 glaenbgtdnqe2
90%
10 docs 21.20
15 docs 17.87 80%
20 docs 15.90
70%
30 docs 14.27
100 docs 7.22 60%
R−Precision
200 docs 4.50
50%
500 docs 2.14
1000 docs 1.18 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
16.76 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 251 to 275)
queries 1
glaenbgtdnqe2
Topic 251 4.25 Topic 276 1.61
Difference (average precision)
Topic 252 17.68 Topic 277 44.00 0.5
Topic 253 24.64 Topic 278 1.00
Topic 254 27.70 Topic 279 41.92
Topic 255 1.62 Topic 280 3.91 0
Topic 256 2.45 Topic 281 30.87
Topic 257 22.66 Topic 282 3.04
−0.5
Topic 258 0.00 Topic 283 73.01
Topic 259 71.20 Topic 284 5.89
Topic 260 29.61 Topic 285 0.08 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 31.83 Topic 286 0.89 Topic Number
Topic 262 3.86 Topic 287 18.75
Topic 263 1.07 Topic 288 1.46
CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 276 to 300)
Topic 264 7.92 Topic 289 32.50 1
Topic 265 0.92 Topic 290 2.20 glaenbgtdnqe2
Difference (average precision)
Topic 266 6.92 Topic 291 33.82
0.5
Topic 267 8.07 Topic 292 0.00
Topic 268 44.56 Topic 293 24.58
Topic 269 0.18 Topic 294 53.60 0
Topic 270 1.84 Topic 295 52.96
Topic 271 0.05 Topic 296 0.00
Topic 272 0.00 Topic 297 41.44 −0.5
Topic 273 15.83 Topic 298 0.11
Topic 274 6.22 Topic 299 18.89
−1
Topic 275 12.90 Topic 300 3.35 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.140
unine UniNEbibg1 AH-Bilingual-X2BG
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to Bulgarian
Retrieved 50,000 RunType= automatic
Relevant 778 QueryType= TD
Relevant retrieved 536 Pooled= true
CLEF 2005 AH−Bilingual−X2BG − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 29.36 UniNEbibg1
90%
10 24.46
20 16.87 80%
30 14.98
70%
40 13.64
50 12.22
Average Precision
60%
60 7.52
50%
70 5.77
80 3.74 40%
90 1.99
30%
100 0.84
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
10.62
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2BG − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 16.40 UniNEbibg1
90%
10 docs 14.20
15 docs 12.53 80%
20 docs 11.50
70%
30 docs 10.47
100 docs 6.06 60%
R−Precision
200 docs 3.68
50%
500 docs 1.88
1000 docs 1.07 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
9.95 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 251 to 275)
queries 1
UniNEbibg1
Topic 251 19.04 Topic 276 3.63
Difference (average precision)
Topic 252 16.95 Topic 277 0.22 0.5
Topic 253 19.03 Topic 278 0.03
Topic 254 44.95 Topic 279 9.49
Topic 255 0.29 Topic 280 0.14 0
Topic 256 17.30 Topic 281 22.50
Topic 257 0.38 Topic 282 18.09
−0.5
Topic 258 0.00 Topic 283 0.53
Topic 259 69.19 Topic 284 10.06
Topic 260 3.37 Topic 285 0.00 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 13.20 Topic 286 0.81 Topic Number
Topic 262 12.19 Topic 287 26.77
Topic 263 29.43 Topic 288 3.04
CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 276 to 300)
Topic 264 14.72 Topic 289 11.36 1
Topic 265 0.08 Topic 290 26.18 UniNEbibg1
Difference (average precision)
Topic 266 0.15 Topic 291 28.77
0.5
Topic 267 0.19 Topic 292 0.00
Topic 268 0.34 Topic 293 2.36
Topic 269 1.93 Topic 294 49.74 0
Topic 270 10.81 Topic 295 0.97
Topic 271 0.15 Topic 296 0.35
Topic 272 2.17 Topic 297 3.75 −0.5
Topic 273 13.70 Topic 298 0.12
Topic 274 2.16 Topic 299 0.00
−1
Topic 275 9.06 Topic 300 11.15 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.141
unine UniNEbibg2 AH-Bilingual-X2BG
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to Bulgarian
Retrieved 50,000 RunType= automatic
Relevant 778 QueryType= TD
Relevant retrieved 549 Pooled= true
CLEF 2005 AH−Bilingual−X2BG − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 26.66 UniNEbibg2
90%
10 22.44
20 18.58 80%
30 16.34
70%
40 14.78
50 13.56
Average Precision
60%
60 9.39
50%
70 7.88
80 5.23 40%
90 3.04
30%
100 2.14
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
12.00
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2BG − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 16.80 UniNEbibg2
90%
10 docs 12.80
15 docs 10.93 80%
20 docs 10.40
70%
30 docs 9.60
100 docs 5.74 60%
R−Precision
200 docs 3.79
50%
500 docs 1.95
1000 docs 1.10 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
11.97 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 251 to 275)
queries 1
UniNEbibg2
Topic 251 2.09 Topic 276 1.45
Difference (average precision)
Topic 252 5.22 Topic 277 0.02 0.5
Topic 253 31.45 Topic 278 0.02
Topic 254 41.97 Topic 279 8.94
Topic 255 4.84 Topic 280 0.16 0
Topic 256 10.40 Topic 281 40.41
Topic 257 0.47 Topic 282 17.96
−0.5
Topic 258 0.00 Topic 283 0.32
Topic 259 80.75 Topic 284 20.48
Topic 260 5.77 Topic 285 0.00 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 16.86 Topic 286 0.59 Topic Number
Topic 262 0.31 Topic 287 21.56
Topic 263 32.34 Topic 288 1.37
CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 276 to 300)
Topic 264 15.64 Topic 289 2.66 1
Topic 265 1.83 Topic 290 2.55 UniNEbibg2
Difference (average precision)
Topic 266 1.30 Topic 291 38.25
0.5
Topic 267 0.05 Topic 292 0.00
Topic 268 1.33 Topic 293 1.99
Topic 269 0.56 Topic 294 63.97 0
Topic 270 20.69 Topic 295 1.39
Topic 271 0.25 Topic 296 1.61
Topic 272 2.44 Topic 297 6.58 −0.5
Topic 273 20.74 Topic 298 0.06
Topic 274 3.35 Topic 299 0.00
−1
Topic 275 14.27 Topic 300 52.98 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.142
unine UniNEbibg3 AH-Bilingual-X2BG
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to Bulgarian
Retrieved 50,000 RunType= automatic
Relevant 778 QueryType= TD
Relevant retrieved 574 Pooled= false
CLEF 2005 AH−Bilingual−X2BG − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 30.44 UniNEbibg3
90%
10 26.17
20 21.62 80%
30 18.57
70%
40 16.91
50 14.56
Average Precision
60%
60 12.46
50%
70 10.17
80 7.90 40%
90 4.51
30%
100 2.72
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
13.99
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2BG − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 20.00 UniNEbibg3
90%
10 docs 17.00
15 docs 14.53 80%
20 docs 13.30
70%
30 docs 11.60
100 docs 6.52 60%
R−Precision
200 docs 4.30
50%
500 docs 2.08
1000 docs 1.15 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
14.30 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 251 to 275)
queries 1
UniNEbibg3
Topic 251 20.53 Topic 276 0.70
Difference (average precision)
Topic 252 4.35 Topic 277 0.01 0.5
Topic 253 31.12 Topic 278 0.00
Topic 254 32.90 Topic 279 2.05
Topic 255 4.29 Topic 280 0.22 0
Topic 256 1.81 Topic 281 34.06
Topic 257 1.30 Topic 282 3.19
−0.5
Topic 258 0.00 Topic 283 0.55
Topic 259 73.59 Topic 284 19.79
Topic 260 24.87 Topic 285 0.00 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 18.18 Topic 286 0.98 Topic Number
Topic 262 0.09 Topic 287 19.18
Topic 263 40.93 Topic 288 1.86
CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 276 to 300)
Topic 264 21.09 Topic 289 0.00 1
Topic 265 6.64 Topic 290 77.11 UniNEbibg3
Difference (average precision)
Topic 266 3.23 Topic 291 43.03
0.5
Topic 267 0.00 Topic 292 0.00
Topic 268 0.59 Topic 293 2.04
Topic 269 0.35 Topic 294 60.28 0
Topic 270 27.43 Topic 295 3.37
Topic 271 6.97 Topic 296 0.30
Topic 272 1.20 Topic 297 5.91 −0.5
Topic 273 19.56 Topic 298 0.05
Topic 274 5.03 Topic 299 0.00
−1
Topic 275 29.38 Topic 300 49.63 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.143
depok UI-DESC10 AH-Bilingual-X2EN
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual Indonesian to English
Retrieved 50,000 RunType= automatic
Relevant 2,063 QueryType= D
Relevant retrieved 1,030 Pooled= true
CLEF 2005 AH−Bilingual−X2EN − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 34.50 UI−DESC10
90%
10 18.41
20 14.91 80%
30 11.56
70%
40 9.85
50 8.56
Average Precision
60%
60 6.63
50%
70 4.95
80 3.42 40%
90 2.58
30%
100 0.76
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
9.36
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2EN − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 19.60 UI−DESC10
90%
10 docs 17.40
15 docs 15.87 80%
20 docs 14.40
70%
30 docs 12.47
100 docs 7.64 60%
R−Precision
200 docs 5.45
50%
500 docs 3.20
1000 docs 2.06 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
10.94 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 251 to 275)
queries 1
UI−DESC10
Topic 251 21.70 Topic 276 4.95
Difference (average precision)
Topic 252 0.37 Topic 277 0.18 0.5
Topic 253 8.20 Topic 278 0.05
Topic 254 13.34 Topic 279 0.34
Topic 255 17.61 Topic 280 0.02 0
Topic 256 85.93 Topic 281 10.70
Topic 257 3.24 Topic 282 1.30
−0.5
Topic 258 0.00 Topic 283 15.49
Topic 259 0.14 Topic 284 0.04
Topic 260 2.41 Topic 285 36.56 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.01 Topic 286 0.33 Topic Number
Topic 262 5.81 Topic 287 0.50
Topic 263 0.49 Topic 288 11.27
CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 276 to 300)
Topic 264 1.38 Topic 289 1.09 1
Topic 265 1.73 Topic 290 7.17 UI−DESC10
Difference (average precision)
Topic 266 0.00 Topic 291 2.08
0.5
Topic 267 24.83 Topic 292 3.15
Topic 268 27.49 Topic 293 27.79
Topic 269 0.02 Topic 294 0.38 0
Topic 270 48.45 Topic 295 0.13
Topic 271 8.43 Topic 296 10.98
Topic 272 34.35 Topic 297 0.51 −0.5
Topic 273 16.13 Topic 298 1.98
Topic 274 0.31 Topic 299 0.24
−1
Topic 275 8.32 Topic 300 0.00 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.144
depok UI-DESC20 AH-Bilingual-X2EN
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual Indonesian to English
Retrieved 50,000 RunType= automatic
Relevant 2,063 QueryType= D
Relevant retrieved 1,036 Pooled= false
CLEF 2005 AH−Bilingual−X2EN − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 34.30 UI−DESC20
90%
10 19.31
20 15.10 80%
30 11.71
70%
40 9.68
50 7.89
Average Precision
60%
60 6.05
50%
70 4.33
80 3.42 40%
90 1.69
30%
100 0.47
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
9.07
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2EN − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 18.80 UI−DESC20
90%
10 docs 16.60
15 docs 15.33 80%
20 docs 14.10
70%
30 docs 12.60
100 docs 7.90 60%
R−Precision
200 docs 5.65
50%
500 docs 3.38
1000 docs 2.07 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
11.38 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 251 to 275)
queries 1
UI−DESC20
Topic 251 20.82 Topic 276 10.95
Difference (average precision)
Topic 252 0.85 Topic 277 0.03 0.5
Topic 253 3.70 Topic 278 0.04
Topic 254 8.72 Topic 279 0.64
Topic 255 13.21 Topic 280 0.05 0
Topic 256 80.34 Topic 281 9.15
Topic 257 3.13 Topic 282 0.63
−0.5
Topic 258 0.00 Topic 283 10.61
Topic 259 0.05 Topic 284 0.03
Topic 260 1.26 Topic 285 38.92 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.00 Topic 286 0.21 Topic Number
Topic 262 5.31 Topic 287 0.37
Topic 263 0.09 Topic 288 14.63
CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 276 to 300)
Topic 264 1.16 Topic 289 0.69 1
Topic 265 0.44 Topic 290 10.90 UI−DESC20
Difference (average precision)
Topic 266 0.00 Topic 291 1.58
0.5
Topic 267 21.42 Topic 292 2.50
Topic 268 25.08 Topic 293 20.38
Topic 269 0.07 Topic 294 0.97 0
Topic 270 39.94 Topic 295 0.08
Topic 271 7.97 Topic 296 5.01
Topic 272 18.83 Topic 297 0.46 −0.5
Topic 273 17.51 Topic 298 1.64
Topic 274 0.01 Topic 299 22.67
−1
Topic 275 30.34 Topic 300 0.00 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.145
depok UI-TD10 AH-Bilingual-X2EN
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual Indonesian to English
Retrieved 50,000 RunType= automatic
Relevant 2,063 QueryType= TD
Relevant retrieved 1,254 Pooled= true
CLEF 2005 AH−Bilingual−X2EN − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 39.89 UI−TD10
90%
10 24.19
20 21.62 80%
30 17.77
70%
40 14.08
50 12.48
Average Precision
60%
60 10.34
50%
70 7.49
80 5.70 40%
90 3.68
30%
100 1.02
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
12.85
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2EN − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 22.40 UI−TD10
90%
10 docs 20.60
15 docs 18.67 80%
20 docs 17.70
70%
30 docs 15.80
100 docs 9.64 60%
R−Precision
200 docs 6.75
50%
500 docs 3.96
1000 docs 2.51 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
14.43 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 251 to 275)
queries 1
UI−TD10
Topic 251 21.93 Topic 276 3.34
Difference (average precision)
Topic 252 2.82 Topic 277 21.62 0.5
Topic 253 5.33 Topic 278 2.30
Topic 254 18.76 Topic 279 5.26
Topic 255 8.64 Topic 280 0.00 0
Topic 256 86.12 Topic 281 13.66
Topic 257 1.18 Topic 282 1.92
−0.5
Topic 258 0.09 Topic 283 27.21
Topic 259 1.94 Topic 284 0.41
Topic 260 0.54 Topic 285 32.96 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.00 Topic 286 0.12 Topic Number
Topic 262 6.26 Topic 287 1.69
Topic 263 0.46 Topic 288 28.97
CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 276 to 300)
Topic 264 12.19 Topic 289 39.80 1
Topic 265 3.32 Topic 290 9.34 UI−TD10
Difference (average precision)
Topic 266 0.00 Topic 291 0.73
0.5
Topic 267 23.76 Topic 292 2.16
Topic 268 54.55 Topic 293 26.30
Topic 269 0.04 Topic 294 12.06 0
Topic 270 48.45 Topic 295 0.08
Topic 271 25.81 Topic 296 23.28
Topic 272 18.42 Topic 297 3.72 −0.5
Topic 273 8.50 Topic 298 2.10
Topic 274 0.44 Topic 299 12.46
−1
Topic 275 21.29 Topic 300 0.00 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.146
depok UI-TD20 AH-Bilingual-X2EN
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual Indonesian to English
Retrieved 50,000 RunType= automatic
Relevant 2,063 QueryType= TD
Relevant retrieved 1,180 Pooled= false
CLEF 2005 AH−Bilingual−X2EN − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 34.50 UI−TD20
90%
10 23.06
20 20.12 80%
30 16.19
70%
40 13.16
50 11.07
Average Precision
60%
60 9.19
50%
70 6.79
80 5.07 40%
90 3.07
30%
100 0.75
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
11.90
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2EN − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 22.80 UI−TD20
90%
10 docs 18.00
15 docs 18.00 80%
20 docs 16.90
70%
30 docs 14.40
100 docs 9.02 60%
R−Precision
200 docs 6.24
50%
500 docs 3.71
1000 docs 2.36 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
13.10 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 251 to 275)
queries 1
UI−TD20
Topic 251 24.19 Topic 276 6.47
Difference (average precision)
Topic 252 4.08 Topic 277 19.16 0.5
Topic 253 2.76 Topic 278 2.04
Topic 254 19.66 Topic 279 5.04
Topic 255 4.29 Topic 280 0.01 0
Topic 256 83.51 Topic 281 11.85
Topic 257 0.37 Topic 282 1.43
−0.5
Topic 258 0.00 Topic 283 16.95
Topic 259 0.74 Topic 284 0.00
Topic 260 0.15 Topic 285 41.44 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.00 Topic 286 0.15 Topic Number
Topic 262 2.60 Topic 287 0.99
Topic 263 0.27 Topic 288 32.49
CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 276 to 300)
Topic 264 10.66 Topic 289 49.94 1
Topic 265 0.95 Topic 290 5.99 UI−TD20
Difference (average precision)
Topic 266 0.00 Topic 291 0.98
0.5
Topic 267 24.73 Topic 292 1.13
Topic 268 56.67 Topic 293 21.34
Topic 269 0.01 Topic 294 3.45 0
Topic 270 39.94 Topic 295 0.08
Topic 271 28.56 Topic 296 14.94
Topic 272 11.26 Topic 297 1.71 −0.5
Topic 273 7.10 Topic 298 2.14
Topic 274 0.21 Topic 299 13.79
−1
Topic 275 18.90 Topic 300 0.00 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.147
depok UI-TITLE10 AH-Bilingual-X2EN
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual Indonesian to English
Retrieved 50,000 RunType= automatic
Relevant 2,063 QueryType= T
Relevant retrieved 972 Pooled= false
CLEF 2005 AH−Bilingual−X2EN − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 33.78 UI−TITLE10
90%
10 22.88
20 18.10 80%
30 15.32
70%
40 12.92
50 10.20
Average Precision
60%
60 8.75
50%
70 5.27
80 3.78 40%
90 2.54
30%
100 0.44
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
11.35
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2EN − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 23.60 UI−TITLE10
90%
10 docs 18.00
15 docs 17.33 80%
20 docs 15.70
70%
30 docs 13.87
100 docs 7.52 60%
R−Precision
200 docs 5.12
50%
500 docs 3.01
1000 docs 1.94 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
13.58 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 251 to 275)
queries 1
UI−TITLE10
Topic 251 0.61 Topic 276 4.85
Difference (average precision)
Topic 252 1.94 Topic 277 19.95 0.5
Topic 253 8.25 Topic 278 21.06
Topic 254 8.72 Topic 279 3.00
Topic 255 1.08 Topic 280 0.02 0
Topic 256 87.94 Topic 281 15.73
Topic 257 11.12 Topic 282 0.03
−0.5
Topic 258 0.00 Topic 283 9.17
Topic 259 0.00 Topic 284 0.03
Topic 260 26.35 Topic 285 31.79 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.01 Topic 286 0.00 Topic Number
Topic 262 0.13 Topic 287 0.99
Topic 263 0.00 Topic 288 20.14
CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 276 to 300)
Topic 264 35.14 Topic 289 33.25 1
Topic 265 23.82 Topic 290 3.18 UI−TITLE10
Difference (average precision)
Topic 266 0.00 Topic 291 0.70
0.5
Topic 267 15.27 Topic 292 0.00
Topic 268 71.93 Topic 293 0.00
Topic 269 0.00 Topic 294 32.12 0
Topic 270 26.98 Topic 295 0.00
Topic 271 22.14 Topic 296 10.37
Topic 272 2.95 Topic 297 0.97 −0.5
Topic 273 0.69 Topic 298 0.33
Topic 274 0.09 Topic 299 5.83
−1
Topic 275 8.73 Topic 300 0.00 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.148
depok UI-TITLE20 AH-Bilingual-X2EN
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual Indonesian to English
Retrieved 50,000 RunType= automatic
Relevant 2,063 QueryType= T
Relevant retrieved 1,002 Pooled= true
CLEF 2005 AH−Bilingual−X2EN − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 38.83 UI−TITLE20
90%
10 26.16
20 20.65 80%
30 17.35
70%
40 14.58
50 11.61
Average Precision
60%
60 9.08
50%
70 5.30
80 3.99 40%
90 2.04
30%
100 0.27
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
12.48
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2EN − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 23.20 UI−TITLE20
90%
10 docs 19.60
15 docs 19.47 80%
20 docs 18.50
70%
30 docs 15.53
100 docs 8.42 60%
R−Precision
200 docs 5.49
50%
500 docs 3.10
1000 docs 2.00 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
15.47 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 251 to 275)
queries 1
UI−TITLE20
Topic 251 0.43 Topic 276 1.21
Difference (average precision)
Topic 252 3.54 Topic 277 7.65 0.5
Topic 253 6.48 Topic 278 24.26
Topic 254 18.97 Topic 279 1.20
Topic 255 1.07 Topic 280 0.09 0
Topic 256 84.22 Topic 281 15.59
Topic 257 11.69 Topic 282 0.12
−0.5
Topic 258 0.00 Topic 283 9.40
Topic 259 0.00 Topic 284 0.01
Topic 260 5.65 Topic 285 48.58 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.02 Topic 286 0.00 Topic Number
Topic 262 0.12 Topic 287 10.04
Topic 263 0.00 Topic 288 35.97
CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 276 to 300)
Topic 264 37.29 Topic 289 45.57 1
Topic 265 14.60 Topic 290 7.56 UI−TITLE20
Difference (average precision)
Topic 266 0.00 Topic 291 0.27
0.5
Topic 267 21.20 Topic 292 0.04
Topic 268 71.01 Topic 293 0.05
Topic 269 0.02 Topic 294 26.28 0
Topic 270 39.17 Topic 295 0.00
Topic 271 35.17 Topic 296 13.71
Topic 272 0.66 Topic 297 1.90 −0.5
Topic 273 3.16 Topic 298 0.44
Topic 274 0.05 Topic 299 9.71
−1
Topic 275 9.65 Topic 300 0.00 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.149
jhu-apl aplbigrena AH-Bilingual-X2EN
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual Greek to English
Retrieved 50,000 RunType= automatic
Relevant 2,063 QueryType= TD
Relevant retrieved 1,388 Pooled= true
CLEF 2005 AH−Bilingual−X2EN − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 54.83 aplbigrena
90%
10 46.13
20 38.88 80%
30 33.76
70%
40 26.92
50 24.20
Average Precision
60%
60 19.56
50%
70 14.61
80 11.13 40%
90 7.87
30%
100 4.51
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
24.18
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2EN − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 34.80 aplbigrena
90%
10 docs 32.40
15 docs 29.87 80%
20 docs 28.10
70%
30 docs 24.67
100 docs 14.88 60%
R−Precision
200 docs 9.55
50%
500 docs 4.80
1000 docs 2.78 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
25.78 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 251 to 275)
queries 1
aplbigrena
Topic 251 56.83 Topic 276 40.15
Difference (average precision)
Topic 252 6.75 Topic 277 12.06 0.5
Topic 253 8.47 Topic 278 2.46
Topic 254 34.74 Topic 279 4.14
Topic 255 42.20 Topic 280 3.75 0
Topic 256 47.07 Topic 281 24.01
Topic 257 12.34 Topic 282 33.47
−0.5
Topic 258 5.88 Topic 283 0.45
Topic 259 34.29 Topic 284 25.89
Topic 260 60.16 Topic 285 0.42 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 9.37 Topic 286 0.83 Topic Number
Topic 262 0.31 Topic 287 46.41
Topic 263 0.05 Topic 288 24.72
CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 276 to 300)
Topic 264 12.72 Topic 289 1.52 1
Topic 265 38.99 Topic 290 3.31 aplbigrena
Difference (average precision)
Topic 266 0.00 Topic 291 6.25
0.5
Topic 267 12.46 Topic 292 88.75
Topic 268 67.10 Topic 293 66.72
Topic 269 10.58 Topic 294 53.70 0
Topic 270 70.00 Topic 295 0.00
Topic 271 27.56 Topic 296 0.00
Topic 272 1.51 Topic 297 27.81 −0.5
Topic 273 70.84 Topic 298 25.27
Topic 274 25.02 Topic 299 28.33
−1
Topic 275 33.32 Topic 300 0.03 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.150
jhu-apl aplbihuena AH-Bilingual-X2EN
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual Hungarian to English
Retrieved 50,000 RunType= automatic
Relevant 2,063 QueryType= TD
Relevant retrieved 1,363 Pooled= true
CLEF 2005 AH−Bilingual−X2EN − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 43.53 aplbihuena
90%
10 30.46
20 28.51 80%
30 25.94
70%
40 23.58
50 21.59
Average Precision
60%
60 17.86
50%
70 14.63
80 12.13 40%
90 9.29
30%
100 6.52
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
19.44
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2EN − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 24.00 aplbihuena
90%
10 docs 21.80
15 docs 21.47 80%
20 docs 21.20
70%
30 docs 19.73
100 docs 11.56 60%
R−Precision
200 docs 7.73
50%
500 docs 4.33
1000 docs 2.73 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
19.86 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 251 to 275)
queries 1
aplbihuena
Topic 251 6.56 Topic 276 0.02
Difference (average precision)
Topic 252 0.01 Topic 277 7.34 0.5
Topic 253 30.33 Topic 278 0.01
Topic 254 8.66 Topic 279 0.15
Topic 255 18.98 Topic 280 6.59 0
Topic 256 93.62 Topic 281 17.77
Topic 257 14.89 Topic 282 2.03
−0.5
Topic 258 9.76 Topic 283 1.71
Topic 259 0.00 Topic 284 23.84
Topic 260 0.05 Topic 285 4.98 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 27.92 Topic 286 0.00 Topic Number
Topic 262 1.83 Topic 287 0.74
Topic 263 15.84 Topic 288 23.09
CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 276 to 300)
Topic 264 10.31 Topic 289 53.05 1
Topic 265 48.88 Topic 290 1.65 aplbihuena
Difference (average precision)
Topic 266 2.64 Topic 291 1.84
0.5
Topic 267 5.33 Topic 292 64.88
Topic 268 57.09 Topic 293 1.82
Topic 269 14.35 Topic 294 66.90 0
Topic 270 62.40 Topic 295 26.50
Topic 271 0.01 Topic 296 2.51
Topic 272 29.07 Topic 297 57.94 −0.5
Topic 273 72.00 Topic 298 24.46
Topic 274 0.00 Topic 299 6.19
−1
Topic 275 44.88 Topic 300 0.60 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.151
jhu-apl aplbiidena AH-Bilingual-X2EN
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual Indonesian to English
Retrieved 50,000 RunType= automatic
Relevant 2,063 QueryType= TD
Relevant retrieved 1,698 Pooled= true
CLEF 2005 AH−Bilingual−X2EN − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 68.33 aplbiidena
90%
10 58.55
20 51.53 80%
30 46.42
70%
40 37.90
50 32.62
Average Precision
60%
60 27.52
50%
70 22.42
80 18.58 40%
90 13.56
30%
100 7.03
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
33.13
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2EN − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 43.20 aplbiidena
90%
10 docs 41.80
15 docs 39.47 80%
20 docs 36.70
70%
30 docs 32.53
100 docs 19.50 60%
R−Precision
200 docs 12.25
50%
500 docs 6.12
1000 docs 3.40 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
34.15 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 251 to 275)
queries 1
aplbiidena
Topic 251 54.68 Topic 276 47.11
Difference (average precision)
Topic 252 15.74 Topic 277 23.86 0.5
Topic 253 32.47 Topic 278 2.08
Topic 254 29.38 Topic 279 10.88
Topic 255 60.71 Topic 280 10.88 0
Topic 256 78.26 Topic 281 27.09
Topic 257 14.13 Topic 282 38.99
−0.5
Topic 258 0.23 Topic 283 63.65
Topic 259 36.36 Topic 284 51.09
Topic 260 12.06 Topic 285 65.35 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.82 Topic 286 0.91 Topic Number
Topic 262 0.15 Topic 287 45.61
Topic 263 19.99 Topic 288 26.83
CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 276 to 300)
Topic 264 29.07 Topic 289 72.52 1
Topic 265 43.84 Topic 290 4.22 aplbiidena
Difference (average precision)
Topic 266 0.00 Topic 291 45.92
0.5
Topic 267 33.20 Topic 292 51.63
Topic 268 68.28 Topic 293 67.99
Topic 269 5.37 Topic 294 44.05 0
Topic 270 65.27 Topic 295 0.11
Topic 271 35.03 Topic 296 43.40
Topic 272 28.81 Topic 297 38.60 −0.5
Topic 273 79.66 Topic 298 18.50
Topic 274 24.74 Topic 299 36.30
−1
Topic 275 33.74 Topic 300 16.99 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.152
jhu-apl aplbiidend AH-Bilingual-X2EN
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual Indonesian to English
Retrieved 50,000 RunType= automatic
Relevant 2,063 QueryType= TDN
Relevant retrieved 1,796 Pooled= false
CLEF 2005 AH−Bilingual−X2EN − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 75.49 aplbiidend
90%
10 63.36
20 56.45 80%
30 49.84
70%
40 42.66
50 38.29
Average Precision
60%
60 32.27
50%
70 24.87
80 20.94 40%
90 15.61
30%
100 9.37
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
37.28
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2EN − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 50.40 aplbiidend
90%
10 docs 46.00
15 docs 43.33 80%
20 docs 41.70
70%
30 docs 36.60
100 docs 21.50 60%
R−Precision
200 docs 13.74
50%
500 docs 6.61
1000 docs 3.59 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
35.47 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 251 to 275)
queries 1
aplbiidend
Topic 251 54.36 Topic 276 59.67
Difference (average precision)
Topic 252 21.57 Topic 277 27.29 0.5
Topic 253 38.12 Topic 278 2.20
Topic 254 36.13 Topic 279 35.59
Topic 255 40.10 Topic 280 1.77 0
Topic 256 90.82 Topic 281 40.01
Topic 257 15.69 Topic 282 23.69
−0.5
Topic 258 3.12 Topic 283 55.93
Topic 259 41.93 Topic 284 51.52
Topic 260 17.78 Topic 285 77.70 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 21.49 Topic 286 0.42 Topic Number
Topic 262 4.07 Topic 287 47.31
Topic 263 20.62 Topic 288 51.24
CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 276 to 300)
Topic 264 42.06 Topic 289 74.82 1
Topic 265 50.31 Topic 290 25.71 aplbiidend
Difference (average precision)
Topic 266 5.69 Topic 291 55.89
0.5
Topic 267 27.63 Topic 292 27.25
Topic 268 68.84 Topic 293 69.85
Topic 269 9.60 Topic 294 47.14 0
Topic 270 69.66 Topic 295 0.68
Topic 271 42.44 Topic 296 62.00
Topic 272 26.11 Topic 297 65.02 −0.5
Topic 273 87.75 Topic 298 26.16
Topic 274 5.08 Topic 299 38.58
−1
Topic 275 38.20 Topic 300 17.45 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.153
msu-nivc cirGHLAru2en AH-Bilingual-X2EN
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual Russian to English
Retrieved 49,370 RunType= automatic
Relevant 2,063 QueryType= TDN
Relevant retrieved 1,441 Pooled= true
CLEF 2005 AH−Bilingual−X2EN − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 59.86 cirGHLAru2en
90%
10 46.02
20 39.95 80%
30 31.24
70%
40 27.43
50 24.64
Average Precision
60%
60 19.34
50%
70 12.94
80 8.05 40%
90 5.11
30%
100 2.48
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
22.82
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2EN − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 34.00 cirGHLAru2en
90%
10 docs 32.80
15 docs 29.60 80%
20 docs 28.40
70%
30 docs 25.20
100 docs 15.60 60%
R−Precision
200 docs 10.22
50%
500 docs 5.13
1000 docs 2.88 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
26.05 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 251 to 275)
queries 1
cirGHLAru2en
Topic 251 37.36 Topic 276 29.71
Difference (average precision)
Topic 252 15.53 Topic 277 36.78 0.5
Topic 253 33.98 Topic 278 15.44
Topic 254 7.25 Topic 279 43.41
Topic 255 9.00 Topic 280 8.05 0
Topic 256 53.21 Topic 281 16.07
Topic 257 37.57 Topic 282 0.34
−0.5
Topic 258 14.37 Topic 283 23.62
Topic 259 0.00 Topic 284 12.99
Topic 260 28.13 Topic 285 41.50 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.98 Topic 286 1.03 Topic Number
Topic 262 14.08 Topic 287 12.56
Topic 263 5.21 Topic 288 13.41
CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 276 to 300)
Topic 264 70.55 Topic 289 41.29 1
Topic 265 51.16 Topic 290 29.68 cirGHLAru2en
Difference (average precision)
Topic 266 0.00 Topic 291 48.53
0.5
Topic 267 17.87 Topic 292 36.91
Topic 268 66.67 Topic 293 49.88
Topic 269 4.73 Topic 294 25.77 0
Topic 270 19.62 Topic 295 10.34
Topic 271 36.78 Topic 296 0.29
Topic 272 0.06 Topic 297 0.62 −0.5
Topic 273 19.92 Topic 298 26.31
Topic 274 4.77 Topic 299 21.09
−1
Topic 275 33.39 Topic 300 13.35 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.154
u.glasgow glagrentdn AH-Bilingual-X2EN
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual Greek to English
Retrieved 50,000 RunType= automatic
Relevant 2,063 QueryType= TDN
Relevant retrieved 1,409 Pooled= true
CLEF 2005 AH−Bilingual−X2EN − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 62.32 glagrentdn
90%
10 48.73
20 39.57 80%
30 31.54
70%
40 23.58
50 19.18
Average Precision
60%
60 16.38
50%
70 12.28
80 9.24 40%
90 5.65
30%
100 2.30
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
22.95
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2EN − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 40.00 glagrentdn
90%
10 docs 35.00
15 docs 31.07 80%
20 docs 29.10
70%
30 docs 25.20
100 docs 15.38 60%
R−Precision
200 docs 9.67
50%
500 docs 4.91
1000 docs 2.82 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
25.98 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 251 to 275)
queries 1
glagrentdn
Topic 251 40.44 Topic 276 30.11
Difference (average precision)
Topic 252 46.63 Topic 277 12.28 0.5
Topic 253 7.27 Topic 278 0.51
Topic 254 28.50 Topic 279 19.83
Topic 255 34.39 Topic 280 5.27 0
Topic 256 87.81 Topic 281 12.31
Topic 257 11.16 Topic 282 16.29
−0.5
Topic 258 0.77 Topic 283 0.48
Topic 259 34.37 Topic 284 12.51
Topic 260 63.32 Topic 285 22.33 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 9.50 Topic 286 0.03 Topic Number
Topic 262 4.60 Topic 287 25.93
Topic 263 0.09 Topic 288 15.21
CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 276 to 300)
Topic 264 10.16 Topic 289 7.07 1
Topic 265 22.58 Topic 290 33.14 glagrentdn
Difference (average precision)
Topic 266 0.00 Topic 291 35.10
0.5
Topic 267 9.97 Topic 292 16.89
Topic 268 55.68 Topic 293 63.06
Topic 269 22.14 Topic 294 30.72 0
Topic 270 65.73 Topic 295 0.51
Topic 271 12.05 Topic 296 0.00
Topic 272 0.74 Topic 297 32.64 −0.5
Topic 273 63.51 Topic 298 27.66
Topic 274 42.12 Topic 299 24.19
−1
Topic 275 29.95 Topic 300 0.05 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.155
u.glasgow glagrentdqe AH-Bilingual-X2EN
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual Greek to English
Retrieved 50,000 RunType= automatic
Relevant 2,063 QueryType= TD
Relevant retrieved 1,543 Pooled= true
CLEF 2005 AH−Bilingual−X2EN − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 56.19 glagrentdqe
90%
10 49.74
20 45.44 80%
30 41.15
70%
40 34.27
50 29.34
Average Precision
60%
60 25.71
50%
70 21.21
80 16.13 40%
90 10.36
30%
100 3.39
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
29.35
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2EN − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 40.40 glagrentdqe
90%
10 docs 40.40
15 docs 37.33 80%
20 docs 34.70
70%
30 docs 30.87
100 docs 18.10 60%
R−Precision
200 docs 10.92
50%
500 docs 5.40
1000 docs 3.09 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
30.66 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 251 to 275)
queries 1
glagrentdqe
Topic 251 47.02 Topic 276 54.01
Difference (average precision)
Topic 252 54.12 Topic 277 13.90 0.5
Topic 253 6.86 Topic 278 1.59
Topic 254 36.90 Topic 279 11.46
Topic 255 10.00 Topic 280 1.18 0
Topic 256 92.02 Topic 281 39.18
Topic 257 11.23 Topic 282 38.51
−0.5
Topic 258 0.52 Topic 283 0.31
Topic 259 17.62 Topic 284 8.02
Topic 260 68.59 Topic 285 85.64 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.43 Topic 286 0.00 Topic Number
Topic 262 3.20 Topic 287 40.37
Topic 263 0.04 Topic 288 39.38
CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 276 to 300)
Topic 264 7.30 Topic 289 78.82 1
Topic 265 17.42 Topic 290 35.51 glagrentdqe
Difference (average precision)
Topic 266 0.00 Topic 291 11.20
0.5
Topic 267 12.61 Topic 292 37.08
Topic 268 51.54 Topic 293 67.43
Topic 269 26.70 Topic 294 53.18 0
Topic 270 66.59 Topic 295 0.51
Topic 271 57.91 Topic 296 0.00
Topic 272 1.39 Topic 297 46.86 −0.5
Topic 273 77.57 Topic 298 24.30
Topic 274 46.56 Topic 299 31.86
−1
Topic 275 32.83 Topic 300 0.04 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.156
alicante IRn-enfr-fexp AH-Bilingual-X2FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 2,071 Pooled= false
CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 65.13 IRn−enfr−fexp
90%
10 48.62
20 43.51 80%
30 39.01
70%
40 34.28
50 30.64
Average Precision
60%
60 25.09
50%
70 19.92
80 14.97 40%
90 9.72
30%
100 3.84
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
29.12
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 45.20 IRn−enfr−fexp
90%
10 docs 41.40
15 docs 39.47 80%
20 docs 37.80
70%
30 docs 34.80
100 docs 21.72 60%
R−Precision
200 docs 14.52
50%
500 docs 7.44
1000 docs 4.14 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
31.12 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275)
queries 1
IRn−enfr−fexp
Topic 251 20.74 Topic 276 24.42
Difference (average precision)
Topic 252 14.94 Topic 277 41.74 0.5
Topic 253 42.65 Topic 278 14.09
Topic 254 52.82 Topic 279 5.36
Topic 255 1.56 Topic 280 9.71 0
Topic 256 75.95 Topic 281 45.63
Topic 257 8.49 Topic 282 3.42
−0.5
Topic 258 1.48 Topic 283 15.43
Topic 259 36.32 Topic 284 66.96
Topic 260 0.90 Topic 285 65.43 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.11 Topic 286 1.65 Topic Number
Topic 262 0.75 Topic 287 36.55
Topic 263 27.48 Topic 288 6.71
CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300)
Topic 264 63.28 Topic 289 71.82 1
Topic 265 36.79 Topic 290 37.92 IRn−enfr−fexp
Difference (average precision)
Topic 266 1.19 Topic 291 3.30
0.5
Topic 267 29.72 Topic 292 2.82
Topic 268 53.90 Topic 293 78.54
Topic 269 21.61 Topic 294 60.62 0
Topic 270 47.26 Topic 295 26.35
Topic 271 73.88 Topic 296 23.78
Topic 272 16.70 Topic 297 44.18 −0.5
Topic 273 36.72 Topic 298 33.83
Topic 274 48.36 Topic 299 5.97
−1
Topic 275 4.34 Topic 300 11.86 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.157
alicante IRn-enfr-vexp AH-Bilingual-X2FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 2,145 Pooled= false
CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 70.85 IRn−enfr−vexp
90%
10 56.44
20 49.43 80%
30 45.96
70%
40 41.29
50 38.74
Average Precision
60%
60 33.54
50%
70 27.75
80 22.10 40%
90 14.04
30%
100 3.29
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
35.90
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 53.20 IRn−enfr−vexp
90%
10 docs 45.80
15 docs 45.33 80%
20 docs 42.70
70%
30 docs 38.73
100 docs 25.26 60%
R−Precision
200 docs 16.10
50%
500 docs 7.90
1000 docs 4.29 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
36.15 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275)
queries 1
IRn−enfr−vexp
Topic 251 11.18 Topic 276 19.41
Difference (average precision)
Topic 252 11.86 Topic 277 0.17 0.5
Topic 253 53.85 Topic 278 47.90
Topic 254 63.31 Topic 279 9.60
Topic 255 2.63 Topic 280 35.71 0
Topic 256 79.74 Topic 281 50.38
Topic 257 14.37 Topic 282 0.95
−0.5
Topic 258 12.14 Topic 283 77.11
Topic 259 1.91 Topic 284 70.49
Topic 260 58.46 Topic 285 58.09 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.00 Topic 286 28.10 Topic Number
Topic 262 14.43 Topic 287 9.10
Topic 263 3.41 Topic 288 8.28
CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300)
Topic 264 80.28 Topic 289 75.87 1
Topic 265 42.40 Topic 290 53.72 IRn−enfr−vexp
Difference (average precision)
Topic 266 0.33 Topic 291 37.93
0.5
Topic 267 26.20 Topic 292 4.89
Topic 268 62.44 Topic 293 75.99
Topic 269 22.69 Topic 294 61.45 0
Topic 270 66.92 Topic 295 43.57
Topic 271 87.57 Topic 296 24.41
Topic 272 19.42 Topic 297 45.22 −0.5
Topic 273 14.32 Topic 298 50.53
Topic 274 80.96 Topic 299 0.21
−1
Topic 275 60.18 Topic 300 15.08 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.158
alicante IRn-enfr-vnexp AH-Bilingual-X2FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 2,080 Pooled= false
CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 69.46 IRn−enfr−vnexp
90%
10 50.36
20 43.30 80%
30 38.24
70%
40 34.02
50 29.43
Average Precision
60%
60 24.81
50%
70 19.81
80 15.17 40%
90 9.65
30%
100 4.21
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
29.13
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 46.40 IRn−enfr−vnexp
90%
10 docs 43.00
15 docs 39.87 80%
20 docs 37.20
70%
30 docs 34.53
100 docs 21.68 60%
R−Precision
200 docs 14.41
50%
500 docs 7.29
1000 docs 4.16 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
31.40 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275)
queries 1
IRn−enfr−vnexp
Topic 251 24.39 Topic 276 23.99
Difference (average precision)
Topic 252 7.40 Topic 277 49.97 0.5
Topic 253 35.09 Topic 278 14.13
Topic 254 49.81 Topic 279 7.09
Topic 255 1.39 Topic 280 11.77 0
Topic 256 79.73 Topic 281 40.60
Topic 257 8.35 Topic 282 4.19
−0.5
Topic 258 0.96 Topic 283 16.54
Topic 259 50.06 Topic 284 65.23
Topic 260 4.49 Topic 285 64.71 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.11 Topic 286 2.33 Topic Number
Topic 262 7.02 Topic 287 38.71
Topic 263 31.48 Topic 288 7.05
CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300)
Topic 264 62.68 Topic 289 74.27 1
Topic 265 31.97 Topic 290 32.51 IRn−enfr−vnexp
Difference (average precision)
Topic 266 3.91 Topic 291 4.67
0.5
Topic 267 26.76 Topic 292 2.60
Topic 268 51.28 Topic 293 72.84
Topic 269 16.90 Topic 294 63.86 0
Topic 270 38.24 Topic 295 27.41
Topic 271 76.47 Topic 296 24.41
Topic 272 13.23 Topic 297 43.72 −0.5
Topic 273 33.06 Topic 298 29.36
Topic 274 46.39 Topic 299 7.77
−1
Topic 275 10.50 Topic 300 15.06 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.159
clips CLIPS05DEFR AH-Bilingual-X2FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual German to French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TDN
Relevant retrieved 758 Pooled= true
CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 21.35 CLIPS05DEFR
90%
10 12.24
20 8.81 80%
30 6.81
70%
40 4.42
50 3.55
Average Precision
60%
60 2.50
50%
70 1.71
80 0.78 40%
90 0.14
30%
100 0.00
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
4.98
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 12.80 CLIPS05DEFR
90%
10 docs 13.60
15 docs 12.53 80%
20 docs 11.30
70%
30 docs 10.07
100 docs 6.14 60%
R−Precision
200 docs 4.33
50%
500 docs 2.46
1000 docs 1.52 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
6.46 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275)
queries 1
CLIPS05DEFR
Topic 251 2.26 Topic 276 0.00
Difference (average precision)
Topic 252 0.00 Topic 277 4.07 0.5
Topic 253 0.02 Topic 278 0.70
Topic 254 49.55 Topic 279 0.14
Topic 255 0.00 Topic 280 0.01 0
Topic 256 0.11 Topic 281 21.33
Topic 257 1.89 Topic 282 0.00
−0.5
Topic 258 0.00 Topic 283 0.01
Topic 259 0.36 Topic 284 0.00
Topic 260 0.00 Topic 285 31.86 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.43 Topic 286 0.04 Topic Number
Topic 262 0.00 Topic 287 6.86
Topic 263 0.02 Topic 288 0.05
CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300)
Topic 264 39.02 Topic 289 0.00 1
Topic 265 12.87 Topic 290 0.14 CLIPS05DEFR
Difference (average precision)
Topic 266 0.00 Topic 291 2.62
0.5
Topic 267 0.22 Topic 292 0.78
Topic 268 1.47 Topic 293 2.07
Topic 269 2.08 Topic 294 9.51 0
Topic 270 45.15 Topic 295 0.52
Topic 271 0.07 Topic 296 0.11
Topic 272 1.77 Topic 297 5.54 −0.5
Topic 273 4.09 Topic 298 0.03
Topic 274 1.10 Topic 299 0.00
−1
Topic 275 0.03 Topic 300 0.01 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.160
clips CLIPS05DEFR0 AH-Bilingual-X2FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual German to French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 846 Pooled= false
CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 29.22 CLIPS05DEFR0
90%
10 16.74
20 11.03 80%
30 9.03
70%
40 6.84
50 5.36
Average Precision
60%
60 3.96
50%
70 3.12
80 2.20 40%
90 1.18
30%
100 0.09
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
6.88
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 17.20 CLIPS05DEFR0
90%
10 docs 16.00
15 docs 14.67 80%
20 docs 13.40
70%
30 docs 11.67
100 docs 7.22 60%
R−Precision
200 docs 4.98
50%
500 docs 2.80
1000 docs 1.69 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
8.67 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275)
queries 1
CLIPS05DEFR0
Topic 251 13.01 Topic 276 0.00
Difference (average precision)
Topic 252 0.00 Topic 277 8.73 0.5
Topic 253 0.01 Topic 278 4.24
Topic 254 65.43 Topic 279 0.10
Topic 255 0.00 Topic 280 0.01 0
Topic 256 0.17 Topic 281 21.19
Topic 257 3.06 Topic 282 0.02
−0.5
Topic 258 0.00 Topic 283 0.01
Topic 259 0.06 Topic 284 0.26
Topic 260 0.00 Topic 285 17.88 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.00 Topic 286 0.02 Topic Number
Topic 262 0.00 Topic 287 9.99
Topic 263 0.02 Topic 288 1.79
CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300)
Topic 264 46.98 Topic 289 0.00 1
Topic 265 14.98 Topic 290 11.25 CLIPS05DEFR0
Difference (average precision)
Topic 266 0.14 Topic 291 2.99
0.5
Topic 267 0.25 Topic 292 0.64
Topic 268 2.70 Topic 293 1.80
Topic 269 1.95 Topic 294 38.06 0
Topic 270 52.23 Topic 295 0.09
Topic 271 1.55 Topic 296 0.27
Topic 272 9.67 Topic 297 10.21 −0.5
Topic 273 0.02 Topic 298 0.15
Topic 274 1.91 Topic 299 0.04
−1
Topic 275 0.32 Topic 300 0.02 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.161
clips CLIPS05EFR AH-Bilingual-X2FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual Spanish to French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TDN
Relevant retrieved 627 Pooled= false
CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 23.26 CLIPS05EFR
90%
10 8.96
20 5.93 80%
30 4.35
70%
40 3.21
50 2.37
Average Precision
60%
60 1.73
50%
70 1.02
80 0.63 40%
90 0.20
30%
100 0.10
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
3.69
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 11.60 CLIPS05EFR
90%
10 docs 9.80
15 docs 8.13 80%
20 docs 7.80
70%
30 docs 6.93
100 docs 4.28 60%
R−Precision
200 docs 3.11
50%
500 docs 1.92
1000 docs 1.25 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
5.50 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275)
queries 1
CLIPS05EFR
Topic 251 1.20 Topic 276 2.96
Difference (average precision)
Topic 252 1.06 Topic 277 4.34 0.5
Topic 253 0.22 Topic 278 0.75
Topic 254 10.71 Topic 279 0.00
Topic 255 0.65 Topic 280 0.26 0
Topic 256 29.94 Topic 281 13.00
Topic 257 0.47 Topic 282 0.23
−0.5
Topic 258 0.00 Topic 283 0.00
Topic 259 1.69 Topic 284 0.10
Topic 260 0.00 Topic 285 2.15 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.21 Topic 286 0.10 Topic Number
Topic 262 0.15 Topic 287 3.49
Topic 263 5.12 Topic 288 8.07
CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300)
Topic 264 3.82 Topic 289 0.01 1
Topic 265 1.31 Topic 290 0.04 CLIPS05EFR
Difference (average precision)
Topic 266 0.12 Topic 291 0.06
0.5
Topic 267 0.00 Topic 292 0.25
Topic 268 0.56 Topic 293 0.02
Topic 269 0.47 Topic 294 0.33 0
Topic 270 48.01 Topic 295 4.58
Topic 271 0.09 Topic 296 0.06
Topic 272 0.19 Topic 297 0.00 −0.5
Topic 273 8.93 Topic 298 0.00
Topic 274 20.19 Topic 299 0.95
−1
Topic 275 7.78 Topic 300 0.00 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.162
clips CLIPS05ESFR0 AH-Bilingual-X2FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual Spanish to French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 696 Pooled= false
CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 21.70 CLIPS05ESFR0
90%
10 10.03
20 6.71 80%
30 4.65
70%
40 3.90
50 3.25
Average Precision
60%
60 2.93
50%
70 2.10
80 1.27 40%
90 0.50
30%
100 0.12
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
4.23
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 10.80 CLIPS05ESFR0
90%
10 docs 9.40
15 docs 8.80 80%
20 docs 7.90
70%
30 docs 6.73
100 docs 4.70 60%
R−Precision
200 docs 3.43
50%
500 docs 2.08
1000 docs 1.39 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
5.75 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275)
queries 1
CLIPS05ESFR0
Topic 251 1.47 Topic 276 4.15
Difference (average precision)
Topic 252 0.33 Topic 277 1.82 0.5
Topic 253 0.95 Topic 278 5.27
Topic 254 2.04 Topic 279 0.00
Topic 255 0.33 Topic 280 0.05 0
Topic 256 16.62 Topic 281 8.35
Topic 257 0.47 Topic 282 0.65
−0.5
Topic 258 0.00 Topic 283 0.00
Topic 259 1.61 Topic 284 0.64
Topic 260 0.02 Topic 285 1.01 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.00 Topic 286 0.65 Topic Number
Topic 262 0.13 Topic 287 1.36
Topic 263 0.65 Topic 288 3.65
CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300)
Topic 264 39.91 Topic 289 0.06 1
Topic 265 4.09 Topic 290 0.23 CLIPS05ESFR0
Difference (average precision)
Topic 266 0.60 Topic 291 0.04
0.5
Topic 267 0.11 Topic 292 0.25
Topic 268 0.07 Topic 293 0.00
Topic 269 0.43 Topic 294 2.35 0
Topic 270 56.34 Topic 295 3.11
Topic 271 2.77 Topic 296 0.09
Topic 272 0.45 Topic 297 0.00 −0.5
Topic 273 9.97 Topic 298 0.01
Topic 274 32.63 Topic 299 1.54
−1
Topic 275 4.03 Topic 300 0.00 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.163
dsv-stockholm ds-am-fr-da-l AH-Bilingual-X2FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual Amharic to French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 479 Pooled= true
CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 16.71 ds−am−fr−da−l
90%
10 6.20
20 4.23 80%
30 2.34
70%
40 1.43
50 1.13
Average Precision
60%
60 0.87
50%
70 0.29
80 0.15 40%
90 0.05
30%
100 0.05
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
2.22
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 7.20 ds−am−fr−da−l
90%
10 docs 6.80
15 docs 5.87 80%
20 docs 5.00
70%
30 docs 4.60
100 docs 2.62 60%
R−Precision
200 docs 2.11
50%
500 docs 1.36
1000 docs 0.96 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
3.84 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275)
queries 1
ds−am−fr−da−l
Topic 251 10.27 Topic 276 13.71
Difference (average precision)
Topic 252 0.18 Topic 277 0.83 0.5
Topic 253 2.17 Topic 278 0.00
Topic 254 17.86 Topic 279 0.01
Topic 255 0.00 Topic 280 0.47 0
Topic 256 37.70 Topic 281 0.29
Topic 257 0.01 Topic 282 1.04
−0.5
Topic 258 0.00 Topic 283 0.03
Topic 259 0.00 Topic 284 0.01
Topic 260 1.28 Topic 285 0.00 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.00 Topic 286 0.69 Topic Number
Topic 262 0.02 Topic 287 0.71
Topic 263 0.13 Topic 288 6.22
CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300)
Topic 264 0.19 Topic 289 0.22 1
Topic 265 0.19 Topic 290 0.12 ds−am−fr−da−l
Difference (average precision)
Topic 266 0.02 Topic 291 0.12
0.5
Topic 267 0.02 Topic 292 0.00
Topic 268 1.27 Topic 293 1.36
Topic 269 1.61 Topic 294 0.05 0
Topic 270 0.10 Topic 295 1.83
Topic 271 0.20 Topic 296 0.19
Topic 272 0.08 Topic 297 2.01 −0.5
Topic 273 0.46 Topic 298 0.02
Topic 274 1.99 Topic 299 0.08
−1
Topic 275 0.18 Topic 300 4.79 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.164
dsv-stockholm ds-am-fr-da-s AH-Bilingual-X2FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual Amharic to French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 535 Pooled= true
CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 24.55 ds−am−fr−da−s
90%
10 9.12
20 5.13 80%
30 3.75
70%
40 2.83
50 2.02
Average Precision
60%
60 1.36
50%
70 0.76
80 0.57 40%
90 0.39
30%
100 0.27
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
3.43
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 12.80 ds−am−fr−da−s
90%
10 docs 9.60
15 docs 7.87 80%
20 docs 7.50
70%
30 docs 6.13
100 docs 3.54 60%
R−Precision
200 docs 2.48
50%
500 docs 1.56
1000 docs 1.07 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
5.16 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275)
queries 1
ds−am−fr−da−s
Topic 251 18.28 Topic 276 5.63
Difference (average precision)
Topic 252 0.87 Topic 277 5.59 0.5
Topic 253 1.91 Topic 278 0.00
Topic 254 23.31 Topic 279 0.01
Topic 255 1.23 Topic 280 0.06 0
Topic 256 39.85 Topic 281 7.28
Topic 257 0.03 Topic 282 2.23
−0.5
Topic 258 0.00 Topic 283 7.71
Topic 259 0.89 Topic 284 0.00
Topic 260 4.43 Topic 285 0.00 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.00 Topic 286 0.64 Topic Number
Topic 262 0.68 Topic 287 0.15
Topic 263 0.29 Topic 288 5.90
CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300)
Topic 264 0.06 Topic 289 0.09 1
Topic 265 1.30 Topic 290 0.11 ds−am−fr−da−s
Difference (average precision)
Topic 266 0.04 Topic 291 0.11
0.5
Topic 267 0.00 Topic 292 0.02
Topic 268 1.63 Topic 293 2.31
Topic 269 1.78 Topic 294 0.07 0
Topic 270 0.26 Topic 295 1.97
Topic 271 0.12 Topic 296 0.10
Topic 272 26.26 Topic 297 4.44 −0.5
Topic 273 0.38 Topic 298 0.03
Topic 274 0.33 Topic 299 0.14
−1
Topic 275 0.34 Topic 300 2.79 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.165
dsv-stockholm ds-am-fr-nonda-l AH-Bilingual-X2FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual Amharic to French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 558 Pooled= false
CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 18.67 ds−am−fr−nonda−l
90%
10 6.93
20 4.70 80%
30 3.76
70%
40 1.76
50 0.79
Average Precision
60%
60 0.57
50%
70 0.32
80 0.08 40%
90 0.04
30%
100 0.04
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
2.51
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 7.60 ds−am−fr−nonda−l
90%
10 docs 6.40
15 docs 5.73 80%
20 docs 5.50
70%
30 docs 5.00
100 docs 3.22 60%
R−Precision
200 docs 2.38
50%
500 docs 1.61
1000 docs 1.12 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
4.38 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275)
queries 1
ds−am−fr−nonda−l
Topic 251 7.69 Topic 276 12.07
Difference (average precision)
Topic 252 0.19 Topic 277 0.73 0.5
Topic 253 0.99 Topic 278 0.00
Topic 254 11.24 Topic 279 0.01
Topic 255 0.00 Topic 280 0.18 0
Topic 256 42.70 Topic 281 0.10
Topic 257 0.05 Topic 282 2.02
−0.5
Topic 258 0.00 Topic 283 0.04
Topic 259 0.00 Topic 284 0.10
Topic 260 3.05 Topic 285 7.70 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.00 Topic 286 1.24 Topic Number
Topic 262 0.02 Topic 287 1.62
Topic 263 5.05 Topic 288 2.96
CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300)
Topic 264 0.06 Topic 289 0.22 1
Topic 265 0.09 Topic 290 0.12 ds−am−fr−nonda−l
Difference (average precision)
Topic 266 0.12 Topic 291 0.31
0.5
Topic 267 0.01 Topic 292 0.08
Topic 268 0.34 Topic 293 3.98
Topic 269 10.48 Topic 294 0.05 0
Topic 270 0.07 Topic 295 0.58
Topic 271 0.51 Topic 296 0.06
Topic 272 0.06 Topic 297 2.01 −0.5
Topic 273 0.32 Topic 298 0.02
Topic 274 1.31 Topic 299 0.01
−1
Topic 275 0.13 Topic 300 4.79 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.166
dsv-stockholm ds-am-fr-nonda-s AH-Bilingual-X2FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual Amharic to French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 579 Pooled= false
CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 23.84 ds−am−fr−nonda−s
90%
10 9.18
20 4.71 80%
30 3.36
70%
40 2.71
50 1.85
Average Precision
60%
60 1.45
50%
70 0.60
80 0.37 40%
90 0.23
30%
100 0.17
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
3.31
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 10.80 ds−am−fr−nonda−s
90%
10 docs 9.00
15 docs 7.73 80%
20 docs 6.90
70%
30 docs 6.00
100 docs 3.60 60%
R−Precision
200 docs 2.62
50%
500 docs 1.66
1000 docs 1.16 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
4.88 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275)
queries 1
ds−am−fr−nonda−s
Topic 251 17.17 Topic 276 5.56
Difference (average precision)
Topic 252 0.86 Topic 277 5.61 0.5
Topic 253 1.17 Topic 278 0.00
Topic 254 23.26 Topic 279 0.01
Topic 255 0.00 Topic 280 0.06 0
Topic 256 41.50 Topic 281 4.13
Topic 257 0.02 Topic 282 4.33
−0.5
Topic 258 0.00 Topic 283 4.24
Topic 259 0.89 Topic 284 0.00
Topic 260 4.68 Topic 285 1.54 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.00 Topic 286 0.76 Topic Number
Topic 262 0.68 Topic 287 0.83
Topic 263 8.82 Topic 288 10.97
CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300)
Topic 264 0.04 Topic 289 0.09 1
Topic 265 1.26 Topic 290 0.11 ds−am−fr−nonda−s
Difference (average precision)
Topic 266 0.02 Topic 291 0.11
0.5
Topic 267 0.00 Topic 292 0.05
Topic 268 0.64 Topic 293 1.80
Topic 269 2.20 Topic 294 0.07 0
Topic 270 0.20 Topic 295 0.83
Topic 271 0.17 Topic 296 0.07
Topic 272 12.70 Topic 297 4.44 −0.5
Topic 273 0.26 Topic 298 0.03
Topic 274 0.23 Topic 299 0.07
−1
Topic 275 0.34 Topic 300 2.79 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.167
hildesheim UHIENFR1 AH-Bilingual-X2FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 2,269 Pooled= false
CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 67.52 UHIENFR1
90%
10 55.66
20 48.33 80%
30 42.99
70%
40 39.37
50 34.91
Average Precision
60%
60 30.31
50%
70 25.61
80 19.08 40%
90 12.41
30%
100 5.23
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
33.37
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 48.80 UHIENFR1
90%
10 docs 49.20
15 docs 46.67 80%
20 docs 44.20
70%
30 docs 40.20
100 docs 24.82 60%
R−Precision
200 docs 16.50
50%
500 docs 8.28
1000 docs 4.54 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
34.72 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275)
queries 1
UHIENFR1
Topic 251 26.86 Topic 276 18.38
Difference (average precision)
Topic 252 12.91 Topic 277 53.12 0.5
Topic 253 34.50 Topic 278 1.88
Topic 254 52.71 Topic 279 10.39
Topic 255 5.00 Topic 280 21.68 0
Topic 256 83.31 Topic 281 51.16
Topic 257 15.68 Topic 282 0.91
−0.5
Topic 258 3.40 Topic 283 63.22
Topic 259 41.17 Topic 284 56.52
Topic 260 26.49 Topic 285 32.80 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.08 Topic 286 4.38 Topic Number
Topic 262 2.02 Topic 287 57.18
Topic 263 7.94 Topic 288 6.06
CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300)
Topic 264 68.76 Topic 289 64.71 1
Topic 265 35.87 Topic 290 41.42 UHIENFR1
Difference (average precision)
Topic 266 2.71 Topic 291 15.03
0.5
Topic 267 20.53 Topic 292 6.98
Topic 268 8.89 Topic 293 75.84
Topic 269 35.98 Topic 294 64.32 0
Topic 270 64.14 Topic 295 49.01
Topic 271 54.55 Topic 296 30.48
Topic 272 8.37 Topic 297 62.87 −0.5
Topic 273 59.08 Topic 298 40.37
Topic 274 79.58 Topic 299 15.83
−1
Topic 275 63.75 Topic 300 9.55 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.168
hildesheim UHIENFR2 AH-Bilingual-X2FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 2,307 Pooled= false
CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 70.23 UHIENFR2
90%
10 57.26
20 50.29 80%
30 45.45
70%
40 41.05
50 36.87
Average Precision
60%
60 31.28
50%
70 26.62
80 20.04 40%
90 12.86
30%
100 5.22
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
34.65
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 49.60 UHIENFR2
90%
10 docs 50.20
15 docs 47.20 80%
20 docs 44.20
70%
30 docs 40.33
100 docs 25.06 60%
R−Precision
200 docs 16.94
50%
500 docs 8.44
1000 docs 4.61 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
36.54 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275)
queries 1
UHIENFR2
Topic 251 27.74 Topic 276 18.38
Difference (average precision)
Topic 252 12.97 Topic 277 53.12 0.5
Topic 253 46.38 Topic 278 1.88
Topic 254 58.82 Topic 279 10.39
Topic 255 5.00 Topic 280 21.68 0
Topic 256 83.31 Topic 281 51.16
Topic 257 18.75 Topic 282 0.91
−0.5
Topic 258 25.98 Topic 283 63.22
Topic 259 41.17 Topic 284 56.16
Topic 260 26.49 Topic 285 32.80 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.08 Topic 286 4.38 Topic Number
Topic 262 2.02 Topic 287 57.18
Topic 263 7.94 Topic 288 6.06
CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300)
Topic 264 59.14 Topic 289 64.71 1
Topic 265 35.87 Topic 290 41.42 UHIENFR2
Difference (average precision)
Topic 266 2.71 Topic 291 15.03
0.5
Topic 267 20.53 Topic 292 6.98
Topic 268 30.78 Topic 293 75.84
Topic 269 38.05 Topic 294 64.32 0
Topic 270 64.14 Topic 295 49.01
Topic 271 54.55 Topic 296 30.48
Topic 272 8.37 Topic 297 62.87 −0.5
Topic 273 59.08 Topic 298 40.37
Topic 274 79.58 Topic 299 15.83
−1
Topic 275 69.32 Topic 300 9.55 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.169
hildesheim UHIRUFR1 AH-Bilingual-X2FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual Russian to French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 1,974 Pooled= true
CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 57.41 UHIRUFR1
90%
10 46.91
20 40.50 80%
30 36.24
70%
40 32.07
50 28.71
Average Precision
60%
60 23.34
50%
70 18.64
80 13.59 40%
90 9.53
30%
100 4.00
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
26.93
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 38.00 UHIRUFR1
90%
10 docs 37.80
15 docs 36.80 80%
20 docs 34.60
70%
30 docs 31.87
100 docs 20.20 60%
R−Precision
200 docs 13.64
50%
500 docs 7.01
1000 docs 3.95 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
29.23 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275)
queries 1
UHIRUFR1
Topic 251 27.10 Topic 276 21.90
Difference (average precision)
Topic 252 24.76 Topic 277 53.28 0.5
Topic 253 30.50 Topic 278 15.15
Topic 254 59.26 Topic 279 7.79
Topic 255 1.69 Topic 280 34.63 0
Topic 256 43.49 Topic 281 21.59
Topic 257 15.74 Topic 282 2.64
−0.5
Topic 258 1.11 Topic 283 59.33
Topic 259 35.77 Topic 284 43.05
Topic 260 30.03 Topic 285 0.47 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.00 Topic 286 1.31 Topic Number
Topic 262 0.12 Topic 287 42.73
Topic 263 8.48 Topic 288 11.07
CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300)
Topic 264 61.91 Topic 289 58.57 1
Topic 265 0.14 Topic 290 53.07 UHIRUFR1
Difference (average precision)
Topic 266 0.69 Topic 291 12.12
0.5
Topic 267 20.02 Topic 292 17.22
Topic 268 56.83 Topic 293 72.28
Topic 269 10.44 Topic 294 64.32 0
Topic 270 0.43 Topic 295 9.31
Topic 271 81.84 Topic 296 0.01
Topic 272 1.33 Topic 297 0.19 −0.5
Topic 273 63.75 Topic 298 42.26
Topic 274 68.02 Topic 299 10.14
−1
Topic 275 37.64 Topic 300 11.16 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.170
jhu-apl aplbienfrc AH-Bilingual-X2FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 2,108 Pooled= true
CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 69.69 aplbienfrc
90%
10 56.49
20 53.08 80%
30 47.20
70%
40 39.97
50 35.85
Average Precision
60%
60 31.32
50%
70 24.07
80 18.56 40%
90 11.85
30%
100 5.22
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
34.42
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 50.00 aplbienfrc
90%
10 docs 45.80
15 docs 43.20 80%
20 docs 40.70
70%
30 docs 36.87
100 docs 23.62 60%
R−Precision
200 docs 15.30
50%
500 docs 7.62
1000 docs 4.22 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
33.75 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275)
queries 1
aplbienfrc
Topic 251 38.68 Topic 276 13.89
Difference (average precision)
Topic 252 8.63 Topic 277 67.29 0.5
Topic 253 52.97 Topic 278 66.66
Topic 254 59.10 Topic 279 7.75
Topic 255 50.00 Topic 280 3.12 0
Topic 256 91.65 Topic 281 58.77
Topic 257 4.18 Topic 282 7.48
−0.5
Topic 258 0.61 Topic 283 70.72
Topic 259 9.53 Topic 284 38.53
Topic 260 51.33 Topic 285 53.33 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.04 Topic 286 0.83 Topic Number
Topic 262 0.06 Topic 287 27.31
Topic 263 5.73 Topic 288 20.34
CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300)
Topic 264 75.70 Topic 289 57.56 1
Topic 265 43.47 Topic 290 41.27 aplbienfrc
Difference (average precision)
Topic 266 0.62 Topic 291 11.79
0.5
Topic 267 18.36 Topic 292 32.16
Topic 268 44.87 Topic 293 75.46
Topic 269 19.55 Topic 294 49.33 0
Topic 270 63.25 Topic 295 47.75
Topic 271 56.37 Topic 296 31.41
Topic 272 10.36 Topic 297 1.87 −0.5
Topic 273 60.14 Topic 298 43.27
Topic 274 65.26 Topic 299 0.17
−1
Topic 275 56.77 Topic 300 5.82 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.171
miracle ENSST AH-Bilingual-X2FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 2,072 Pooled= false
CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 68.10 ENSST
90%
10 52.52
20 44.76 80%
30 40.51
70%
40 35.36
50 31.37
Average Precision
60%
60 26.83
50%
70 22.73
80 17.62 40%
90 10.17
30%
100 4.34
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
30.76
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 46.00 ENSST
90%
10 docs 43.80
15 docs 41.47 80%
20 docs 38.50
70%
30 docs 35.27
100 docs 22.00 60%
R−Precision
200 docs 14.79
50%
500 docs 7.55
1000 docs 4.14 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
31.86 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275)
queries 1
ENSST
Topic 251 13.10 Topic 276 20.32
Difference (average precision)
Topic 252 7.06 Topic 277 53.54 0.5
Topic 253 0.94 Topic 278 59.85
Topic 254 59.48 Topic 279 6.94
Topic 255 1.11 Topic 280 18.29 0
Topic 256 77.20 Topic 281 45.23
Topic 257 12.82 Topic 282 2.61
−0.5
Topic 258 0.08 Topic 283 8.91
Topic 259 41.84 Topic 284 66.07
Topic 260 8.93 Topic 285 59.63 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.07 Topic 286 2.40 Topic Number
Topic 262 5.50 Topic 287 49.99
Topic 263 35.86 Topic 288 12.51
CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300)
Topic 264 61.84 Topic 289 63.69 1
Topic 265 24.74 Topic 290 19.20 ENSST
Difference (average precision)
Topic 266 0.61 Topic 291 9.86
0.5
Topic 267 25.89 Topic 292 5.83
Topic 268 67.23 Topic 293 71.43
Topic 269 18.73 Topic 294 65.50 0
Topic 270 63.16 Topic 295 43.99
Topic 271 64.42 Topic 296 20.28
Topic 272 15.54 Topic 297 55.67 −0.5
Topic 273 43.70 Topic 298 31.10
Topic 274 35.79 Topic 299 12.66
−1
Topic 275 36.67 Topic 300 10.10 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.172
miracle ENSxNP01HR1 AH-Bilingual-X2FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TDN
Relevant retrieved 2,023 Pooled= false
CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 68.64 ENSxNP01HR1
90%
10 50.70
20 39.08 80%
30 34.61
70%
40 29.54
50 26.97
Average Precision
60%
60 22.79
50%
70 17.74
80 12.96 40%
90 7.21
30%
100 1.94
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
26.45
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 43.20 ENSxNP01HR1
90%
10 docs 39.20
15 docs 36.53 80%
20 docs 34.60
70%
30 docs 31.87
100 docs 20.60 60%
R−Precision
200 docs 13.87
50%
500 docs 7.20
1000 docs 4.05 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
28.90 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275)
queries 1
ENSxNP01HR1
Topic 251 7.10 Topic 276 14.98
Difference (average precision)
Topic 252 14.99 Topic 277 35.99 0.5
Topic 253 13.59 Topic 278 22.90
Topic 254 52.91 Topic 279 6.49
Topic 255 2.08 Topic 280 20.50 0
Topic 256 45.33 Topic 281 37.62
Topic 257 14.99 Topic 282 1.03
−0.5
Topic 258 0.06 Topic 283 6.55
Topic 259 15.82 Topic 284 56.69
Topic 260 2.42 Topic 285 55.57 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 5.93 Topic 286 12.59 Topic Number
Topic 262 8.15 Topic 287 40.60
Topic 263 25.14 Topic 288 10.58
CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300)
Topic 264 40.33 Topic 289 69.31 1
Topic 265 22.82 Topic 290 4.61 ENSxNP01HR1
Difference (average precision)
Topic 266 1.46 Topic 291 8.80
0.5
Topic 267 24.51 Topic 292 4.50
Topic 268 51.20 Topic 293 59.78
Topic 269 19.93 Topic 294 57.66 0
Topic 270 55.37 Topic 295 52.65
Topic 271 48.69 Topic 296 7.24
Topic 272 14.44 Topic 297 60.67 −0.5
Topic 273 48.90 Topic 298 27.70
Topic 274 61.88 Topic 299 1.74
−1
Topic 275 36.79 Topic 300 10.88 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.173
miracle ENSxNP01SR1 AH-Bilingual-X2FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TDN
Relevant retrieved 2,119 Pooled= false
CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 74.36 ENSxNP01SR1
90%
10 54.50
20 45.77 80%
30 40.80
70%
40 35.70
50 31.87
Average Precision
60%
60 26.20
50%
70 21.74
80 17.11 40%
90 11.10
30%
100 3.67
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
30.73
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 50.00 ENSxNP01SR1
90%
10 docs 42.40
15 docs 40.40 80%
20 docs 38.80
70%
30 docs 34.93
100 docs 22.38 60%
R−Precision
200 docs 15.16
50%
500 docs 7.69
1000 docs 4.24 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
32.88 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275)
queries 1
ENSxNP01SR1
Topic 251 10.82 Topic 276 19.43
Difference (average precision)
Topic 252 18.17 Topic 277 35.67 0.5
Topic 253 3.29 Topic 278 33.11
Topic 254 62.80 Topic 279 7.20
Topic 255 2.33 Topic 280 15.50 0
Topic 256 58.78 Topic 281 47.97
Topic 257 16.07 Topic 282 4.08
−0.5
Topic 258 0.06 Topic 283 6.33
Topic 259 36.29 Topic 284 66.96
Topic 260 6.27 Topic 285 63.56 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 16.76 Topic 286 13.03 Topic Number
Topic 262 8.48 Topic 287 52.43
Topic 263 36.85 Topic 288 18.56
CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300)
Topic 264 49.91 Topic 289 60.18 1
Topic 265 24.89 Topic 290 9.56 ENSxNP01SR1
Difference (average precision)
Topic 266 0.83 Topic 291 9.14
0.5
Topic 267 25.96 Topic 292 13.08
Topic 268 58.73 Topic 293 69.33
Topic 269 27.21 Topic 294 62.81 0
Topic 270 65.00 Topic 295 44.99
Topic 271 64.40 Topic 296 17.12
Topic 272 18.58 Topic 297 53.75 −0.5
Topic 273 49.99 Topic 298 28.41
Topic 274 42.61 Topic 299 4.76
−1
Topic 275 57.66 Topic 300 16.87 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.174
miracle ESSST AH-Bilingual-X2FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual Spanish to French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 1,921 Pooled= false
CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 63.59 ESSST
90%
10 50.62
20 44.13 80%
30 38.89
70%
40 34.55
50 30.92
Average Precision
60%
60 26.06
50%
70 20.98
80 16.10 40%
90 9.50
30%
100 3.78
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
29.60
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 47.20 ESSST
90%
10 docs 41.40
15 docs 38.27 80%
20 docs 36.40
70%
30 docs 33.80
100 docs 20.48 60%
R−Precision
200 docs 13.59
50%
500 docs 6.93
1000 docs 3.84 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
31.66 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275)
queries 1
ESSST
Topic 251 13.93 Topic 276 19.26
Difference (average precision)
Topic 252 4.57 Topic 277 51.22 0.5
Topic 253 0.00 Topic 278 53.05
Topic 254 49.43 Topic 279 6.16
Topic 255 1.09 Topic 280 31.08 0
Topic 256 84.58 Topic 281 42.38
Topic 257 6.22 Topic 282 5.30
−0.5
Topic 258 0.00 Topic 283 63.81
Topic 259 35.37 Topic 284 24.58
Topic 260 13.95 Topic 285 33.98 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.03 Topic 286 1.05 Topic Number
Topic 262 0.34 Topic 287 2.36
Topic 263 27.90 Topic 288 3.13
CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300)
Topic 264 60.43 Topic 289 17.83 1
Topic 265 24.27 Topic 290 34.79 ESSST
Difference (average precision)
Topic 266 11.99 Topic 291 8.53
0.5
Topic 267 20.54 Topic 292 4.30
Topic 268 44.56 Topic 293 69.59
Topic 269 18.73 Topic 294 65.31 0
Topic 270 61.66 Topic 295 45.28
Topic 271 80.77 Topic 296 30.92
Topic 272 14.37 Topic 297 55.67 −0.5
Topic 273 50.27 Topic 298 31.11
Topic 274 73.88 Topic 299 2.28
−1
Topic 275 59.80 Topic 300 18.18 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.175
miracle ESSxNP01HR1 AH-Bilingual-X2FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual Spanish to French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TDN
Relevant retrieved 1,811 Pooled= false
CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 63.35 ESSxNP01HR1
90%
10 50.15
20 43.38 80%
30 37.58
70%
40 32.86
50 27.98
Average Precision
60%
60 23.32
50%
70 19.09
80 13.17 40%
90 5.71
30%
100 1.49
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
27.49
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 45.20 ESSxNP01HR1
90%
10 docs 39.00
15 docs 36.53 80%
20 docs 35.10
70%
30 docs 32.73
100 docs 19.04 60%
R−Precision
200 docs 12.61
50%
500 docs 6.50
1000 docs 3.62 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
28.92 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275)
queries 1
ESSxNP01HR1
Topic 251 7.59 Topic 276 15.15
Difference (average precision)
Topic 252 7.10 Topic 277 43.04 0.5
Topic 253 0.01 Topic 278 30.55
Topic 254 50.66 Topic 279 6.31
Topic 255 1.85 Topic 280 26.87 0
Topic 256 68.25 Topic 281 36.21
Topic 257 6.68 Topic 282 4.93
−0.5
Topic 258 0.07 Topic 283 55.58
Topic 259 16.36 Topic 284 15.54
Topic 260 5.25 Topic 285 38.75 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 38.44 Topic 286 1.53 Topic Number
Topic 262 0.38 Topic 287 1.59
Topic 263 24.53 Topic 288 1.98
CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300)
Topic 264 51.05 Topic 289 26.58 1
Topic 265 21.28 Topic 290 27.47 ESSxNP01HR1
Difference (average precision)
Topic 266 14.46 Topic 291 6.00
0.5
Topic 267 19.55 Topic 292 3.17
Topic 268 46.68 Topic 293 59.28
Topic 269 11.43 Topic 294 63.63 0
Topic 270 56.32 Topic 295 52.79
Topic 271 74.66 Topic 296 40.79
Topic 272 12.02 Topic 297 60.80 −0.5
Topic 273 51.98 Topic 298 27.23
Topic 274 72.33 Topic 299 1.78
−1
Topic 275 49.97 Topic 300 18.10 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.176
miracle ESSxNP01SR1 AH-Bilingual-X2FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual Spanish to French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TDN
Relevant retrieved 1,935 Pooled= true
CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 67.91 ESSxNP01SR1
90%
10 53.33
20 47.25 80%
30 42.13
70%
40 37.06
50 33.03
Average Precision
60%
60 27.17
50%
70 22.06
80 17.82 40%
90 9.92
30%
100 3.80
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
31.34
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 48.00 ESSxNP01SR1
90%
10 docs 41.80
15 docs 39.20 80%
20 docs 37.30
70%
30 docs 33.67
100 docs 21.56 60%
R−Precision
200 docs 13.85
50%
500 docs 6.98
1000 docs 3.87 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
32.66 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275)
queries 1
ESSxNP01SR1
Topic 251 12.28 Topic 276 20.03
Difference (average precision)
Topic 252 10.71 Topic 277 43.26 0.5
Topic 253 0.00 Topic 278 39.24
Topic 254 55.15 Topic 279 6.30
Topic 255 1.72 Topic 280 25.36 0
Topic 256 83.95 Topic 281 46.41
Topic 257 9.90 Topic 282 11.54
−0.5
Topic 258 0.00 Topic 283 54.74
Topic 259 25.60 Topic 284 35.64
Topic 260 6.32 Topic 285 44.52 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 56.02 Topic 286 5.21 Topic Number
Topic 262 0.50 Topic 287 2.36
Topic 263 30.15 Topic 288 3.37
CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300)
Topic 264 59.03 Topic 289 30.83 1
Topic 265 22.23 Topic 290 27.31 ESSxNP01SR1
Difference (average precision)
Topic 266 15.50 Topic 291 7.38
0.5
Topic 267 20.50 Topic 292 11.04
Topic 268 67.07 Topic 293 67.74
Topic 269 19.51 Topic 294 69.20 0
Topic 270 66.43 Topic 295 45.61
Topic 271 70.14 Topic 296 41.25
Topic 272 14.66 Topic 297 54.18 −0.5
Topic 273 53.94 Topic 298 28.95
Topic 274 64.25 Topic 299 2.18
−1
Topic 275 60.49 Topic 300 17.40 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.177
u.glasgow glaitfrtd AH-Bilingual-X2FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual Italian to French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 1,732 Pooled= false
CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 49.94 glaitfrtd
90%
10 38.65
20 31.72 80%
30 26.48
70%
40 22.99
50 20.72
Average Precision
60%
60 17.64
50%
70 13.22
80 10.94 40%
90 6.73
30%
100 2.52
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
20.66
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 33.20 glaitfrtd
90%
10 docs 33.00
15 docs 30.00 80%
20 docs 27.80
70%
30 docs 25.53
100 docs 16.60 60%
R−Precision
200 docs 11.37
50%
500 docs 6.09
1000 docs 3.46 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
23.14 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275)
queries 1
glaitfrtd
Topic 251 8.32 Topic 276 0.70
Difference (average precision)
Topic 252 6.94 Topic 277 0.07 0.5
Topic 253 6.02 Topic 278 0.69
Topic 254 50.34 Topic 279 0.04
Topic 255 0.44 Topic 280 5.90 0
Topic 256 76.65 Topic 281 22.68
Topic 257 3.98 Topic 282 2.60
−0.5
Topic 258 6.67 Topic 283 70.71
Topic 259 26.25 Topic 284 55.69
Topic 260 26.06 Topic 285 59.26 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 9.28 Topic 286 0.69 Topic Number
Topic 262 0.44 Topic 287 41.68
Topic 263 32.00 Topic 288 1.39
CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300)
Topic 264 42.67 Topic 289 16.29 1
Topic 265 22.64 Topic 290 0.51 glaitfrtd
Difference (average precision)
Topic 266 2.29 Topic 291 6.47
0.5
Topic 267 30.94 Topic 292 5.13
Topic 268 18.71 Topic 293 29.31
Topic 269 9.63 Topic 294 60.52 0
Topic 270 46.74 Topic 295 15.50
Topic 271 63.71 Topic 296 22.92
Topic 272 8.62 Topic 297 3.36 −0.5
Topic 273 46.27 Topic 298 10.87
Topic 274 48.89 Topic 299 1.03
−1
Topic 275 4.34 Topic 300 0.06 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.178
u.glasgow glaitfrtdn AH-Bilingual-X2FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual Italian to French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TDN
Relevant retrieved 1,799 Pooled= true
CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 57.69 glaitfrtdn
90%
10 43.84
20 34.87 80%
30 31.05
70%
40 25.72
50 22.38
Average Precision
60%
60 18.57
50%
70 14.24
80 11.41 40%
90 6.25
30%
100 2.16
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
22.91
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 38.40 glaitfrtdn
90%
10 docs 35.40
15 docs 34.00 80%
20 docs 32.90
70%
30 docs 28.33
100 docs 17.80 60%
R−Precision
200 docs 11.82
50%
500 docs 6.29
1000 docs 3.60 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
25.18 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275)
queries 1
glaitfrtdn
Topic 251 2.41 Topic 276 0.57
Difference (average precision)
Topic 252 22.75 Topic 277 0.03 0.5
Topic 253 12.58 Topic 278 1.58
Topic 254 48.76 Topic 279 0.40
Topic 255 2.94 Topic 280 23.71 0
Topic 256 75.64 Topic 281 32.67
Topic 257 14.59 Topic 282 1.95
−0.5
Topic 258 0.61 Topic 283 61.30
Topic 259 33.30 Topic 284 51.28
Topic 260 14.91 Topic 285 63.12 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 33.28 Topic 286 0.00 Topic Number
Topic 262 0.47 Topic 287 48.59
Topic 263 27.37 Topic 288 3.78
CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300)
Topic 264 39.98 Topic 289 11.79 1
Topic 265 19.96 Topic 290 0.16 glaitfrtdn
Difference (average precision)
Topic 266 1.03 Topic 291 7.05
0.5
Topic 267 34.52 Topic 292 7.61
Topic 268 21.49 Topic 293 29.38
Topic 269 7.41 Topic 294 65.05 0
Topic 270 46.02 Topic 295 18.62
Topic 271 72.97 Topic 296 26.12
Topic 272 9.77 Topic 297 4.19 −0.5
Topic 273 56.05 Topic 298 19.87
Topic 274 51.06 Topic 299 0.48
−1
Topic 275 16.60 Topic 300 0.00 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.179
u.glasgow glaitfrtdnqe AH-Bilingual-X2FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual Italian to French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TDN
Relevant retrieved 2,010 Pooled= false
CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 56.65 glaitfrtdnqe
90%
10 48.90
20 41.14 80%
30 37.38
70%
40 33.88
50 31.05
Average Precision
60%
60 25.66
50%
70 21.03
80 16.72 40%
90 10.15
30%
100 3.92
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
28.83
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 42.00 glaitfrtdnqe
90%
10 docs 39.80
15 docs 37.73 80%
20 docs 35.30
70%
30 docs 32.20
100 docs 21.38 60%
R−Precision
200 docs 14.32
50%
500 docs 7.25
1000 docs 4.02 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
29.43 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275)
queries 1
glaitfrtdnqe
Topic 251 1.61 Topic 276 0.52
Difference (average precision)
Topic 252 27.61 Topic 277 0.01 0.5
Topic 253 28.52 Topic 278 3.36
Topic 254 53.10 Topic 279 0.43
Topic 255 2.94 Topic 280 37.61 0
Topic 256 84.01 Topic 281 31.11
Topic 257 9.00 Topic 282 2.28
−0.5
Topic 258 0.38 Topic 283 67.43
Topic 259 24.37 Topic 284 62.51
Topic 260 51.15 Topic 285 65.20 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 47.54 Topic 286 0.00 Topic Number
Topic 262 0.46 Topic 287 50.62
Topic 263 37.07 Topic 288 4.23
CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300)
Topic 264 65.27 Topic 289 15.24 1
Topic 265 19.22 Topic 290 0.10 glaitfrtdnqe
Difference (average precision)
Topic 266 0.25 Topic 291 12.57
0.5
Topic 267 35.78 Topic 292 8.29
Topic 268 22.68 Topic 293 30.93
Topic 269 23.80 Topic 294 64.45 0
Topic 270 61.70 Topic 295 31.32
Topic 271 76.80 Topic 296 30.68
Topic 272 17.77 Topic 297 2.76 −0.5
Topic 273 65.32 Topic 298 40.17
Topic 274 70.66 Topic 299 0.36
−1
Topic 275 52.54 Topic 300 0.00 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.180
u.surugadai SrgdDT05 AH-Bilingual-X2FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual German to French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 1,394 Pooled= false
CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 39.45 SrgdDT05
90%
10 26.10
20 21.41 80%
30 18.50
70%
40 17.08
50 14.70
Average Precision
60%
60 12.43
50%
70 11.36
80 9.37 40%
90 3.90
30%
100 1.44
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
14.94
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 22.40 SrgdDT05
90%
10 docs 20.40
15 docs 19.33 80%
20 docs 19.00
70%
30 docs 17.33
100 docs 11.38 60%
R−Precision
200 docs 8.05
50%
500 docs 4.74
1000 docs 2.79 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
16.05 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275)
queries 1
SrgdDT05
Topic 251 4.10 Topic 276 10.52
Difference (average precision)
Topic 252 0.06 Topic 277 60.46 0.5
Topic 253 0.00 Topic 278 0.01
Topic 254 41.64 Topic 279 0.21
Topic 255 0.00 Topic 280 18.04 0
Topic 256 77.49 Topic 281 1.65
Topic 257 0.00 Topic 282 8.53
−0.5
Topic 258 0.00 Topic 283 1.31
Topic 259 2.85 Topic 284 19.13
Topic 260 32.13 Topic 285 57.29 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.43 Topic 286 0.00 Topic Number
Topic 262 0.21 Topic 287 16.40
Topic 263 20.56 Topic 288 2.64
CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300)
Topic 264 18.20 Topic 289 0.00 1
Topic 265 9.38 Topic 290 0.03 SrgdDT05
Difference (average precision)
Topic 266 13.68 Topic 291 7.93
0.5
Topic 267 4.64 Topic 292 5.56
Topic 268 0.44 Topic 293 70.04
Topic 269 0.06 Topic 294 32.61 0
Topic 270 0.72 Topic 295 15.02
Topic 271 88.21 Topic 296 43.35
Topic 272 17.36 Topic 297 0.00 −0.5
Topic 273 2.15 Topic 298 0.28
Topic 274 7.77 Topic 299 0.82
−1
Topic 275 23.87 Topic 300 9.04 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.181
u.surugadai SrgdMgE03 AH-Bilingual-X2FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual German to French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 2,015 Pooled= false
CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 59.08 SrgdMgE03
90%
10 44.92
20 38.62 80%
30 32.42
70%
40 29.53
50 26.77
Average Precision
60%
60 23.98
50%
70 19.72
80 14.70 40%
90 8.52
30%
100 3.81
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
26.05
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 38.00 SrgdMgE03
90%
10 docs 36.20
15 docs 34.27 80%
20 docs 32.40
70%
30 docs 29.33
100 docs 19.20 60%
R−Precision
200 docs 13.62
50%
500 docs 7.18
1000 docs 4.03 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
26.69 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275)
queries 1
SrgdMgE03
Topic 251 30.04 Topic 276 7.43
Difference (average precision)
Topic 252 3.85 Topic 277 57.11 0.5
Topic 253 59.02 Topic 278 1.75
Topic 254 56.25 Topic 279 7.97
Topic 255 0.48 Topic 280 25.65 0
Topic 256 81.11 Topic 281 12.87
Topic 257 9.41 Topic 282 2.88
−0.5
Topic 258 0.00 Topic 283 45.91
Topic 259 25.62 Topic 284 35.80
Topic 260 15.64 Topic 285 55.75 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.00 Topic 286 26.13 Topic Number
Topic 262 17.94 Topic 287 18.49
Topic 263 0.23 Topic 288 3.63
CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300)
Topic 264 58.70 Topic 289 0.00 1
Topic 265 9.22 Topic 290 4.84 SrgdMgE03
Difference (average precision)
Topic 266 3.09 Topic 291 15.00
0.5
Topic 267 45.02 Topic 292 2.74
Topic 268 2.15 Topic 293 70.04
Topic 269 32.51 Topic 294 64.44 0
Topic 270 60.21 Topic 295 1.18
Topic 271 84.08 Topic 296 29.90
Topic 272 8.36 Topic 297 64.38 −0.5
Topic 273 2.20 Topic 298 36.18
Topic 274 73.77 Topic 299 6.13
−1
Topic 275 18.82 Topic 300 8.73 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.182
u.surugadai SrgdMgG02 AH-Bilingual-X2FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual German to French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 2,018 Pooled= true
CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 59.31 SrgdMgG02
90%
10 44.34
20 36.21 80%
30 32.70
70%
40 28.56
50 26.03
Average Precision
60%
60 22.26
50%
70 16.95
80 13.13 40%
90 7.66
30%
100 3.35
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
24.92
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 40.00 SrgdMgG02
90%
10 docs 36.00
15 docs 32.53 80%
20 docs 30.90
70%
30 docs 28.53
100 docs 18.10 60%
R−Precision
200 docs 12.79
50%
500 docs 7.06
1000 docs 4.04 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
25.79 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275)
queries 1
SrgdMgG02
Topic 251 19.76 Topic 276 6.22
Difference (average precision)
Topic 252 2.45 Topic 277 61.17 0.5
Topic 253 14.75 Topic 278 0.24
Topic 254 59.14 Topic 279 9.06
Topic 255 0.47 Topic 280 27.47 0
Topic 256 77.59 Topic 281 15.09
Topic 257 3.52 Topic 282 5.08
−0.5
Topic 258 0.00 Topic 283 41.13
Topic 259 23.72 Topic 284 34.72
Topic 260 39.90 Topic 285 55.97 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.39 Topic 286 6.82 Topic Number
Topic 262 18.62 Topic 287 29.66
Topic 263 18.03 Topic 288 4.16
CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300)
Topic 264 50.38 Topic 289 0.00 1
Topic 265 10.48 Topic 290 0.06 SrgdMgG02
Difference (average precision)
Topic 266 3.32 Topic 291 12.60
0.5
Topic 267 41.08 Topic 292 2.63
Topic 268 2.59 Topic 293 70.14
Topic 269 19.23 Topic 294 62.64 0
Topic 270 45.80 Topic 295 6.75
Topic 271 86.05 Topic 296 34.27
Topic 272 10.95 Topic 297 60.64 −0.5
Topic 273 1.73 Topic 298 35.49
Topic 274 67.50 Topic 299 3.85
−1
Topic 275 35.89 Topic 300 6.71 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.183
u.surugadai SrgdQT04 AH-Bilingual-X2FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual German to French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 1,998 Pooled= false
CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 54.57 SrgdQT04
90%
10 43.69
20 38.05 80%
30 34.63
70%
40 30.79
50 28.44
Average Precision
60%
60 24.96
50%
70 21.04
80 16.29 40%
90 9.12
30%
100 2.72
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
26.58
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 38.00 SrgdQT04
90%
10 docs 33.80
15 docs 32.80 80%
20 docs 32.30
70%
30 docs 29.53
100 docs 19.62 60%
R−Precision
200 docs 13.67
50%
500 docs 7.15
1000 docs 4.00 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
26.42 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275)
queries 1
SrgdQT04
Topic 251 26.03 Topic 276 0.91
Difference (average precision)
Topic 252 4.95 Topic 277 57.51 0.5
Topic 253 63.83 Topic 278 0.57
Topic 254 53.30 Topic 279 10.30
Topic 255 0.82 Topic 280 20.89 0
Topic 256 77.13 Topic 281 14.30
Topic 257 14.08 Topic 282 2.85
−0.5
Topic 258 0.00 Topic 283 64.24
Topic 259 25.78 Topic 284 38.73
Topic 260 45.80 Topic 285 54.29 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.00 Topic 286 15.71 Topic Number
Topic 262 23.02 Topic 287 4.05
Topic 263 2.44 Topic 288 0.89
CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300)
Topic 264 59.50 Topic 289 0.00 1
Topic 265 7.19 Topic 290 0.07 SrgdQT04
Difference (average precision)
Topic 266 0.19 Topic 291 14.38
0.5
Topic 267 39.92 Topic 292 2.45
Topic 268 3.22 Topic 293 69.43
Topic 269 30.15 Topic 294 66.40 0
Topic 270 60.12 Topic 295 4.94
Topic 271 81.58 Topic 296 30.52
Topic 272 8.11 Topic 297 64.42 −0.5
Topic 273 0.47 Topic 298 37.71
Topic 274 75.96 Topic 299 3.74
−1
Topic 275 36.30 Topic 300 9.93 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.184
unine UniNEbifr1 AH-Bilingual-X2FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 2,165 Pooled= true
CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 72.24 UniNEbifr1
90%
10 60.14
20 51.67 80%
30 43.08
70%
40 38.08
50 34.11
Average Precision
60%
60 29.16
50%
70 23.98
80 18.14 40%
90 12.03
30%
100 4.30
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
33.57
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 50.40 UniNEbifr1
90%
10 docs 49.20
15 docs 45.47 80%
20 docs 43.40
70%
30 docs 38.60
100 docs 23.88 60%
R−Precision
200 docs 15.74
50%
500 docs 7.81
1000 docs 4.33 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
35.19 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275)
queries 1
UniNEbifr1
Topic 251 16.04 Topic 276 28.88
Difference (average precision)
Topic 252 6.22 Topic 277 48.82 0.5
Topic 253 30.00 Topic 278 21.85
Topic 254 66.97 Topic 279 7.98
Topic 255 0.96 Topic 280 15.85 0
Topic 256 83.20 Topic 281 45.82
Topic 257 11.98 Topic 282 3.23
−0.5
Topic 258 3.58 Topic 283 47.43
Topic 259 50.49 Topic 284 66.25
Topic 260 23.10 Topic 285 41.29 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.18 Topic 286 8.03 Topic Number
Topic 262 10.15 Topic 287 51.46
Topic 263 37.87 Topic 288 10.13
CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300)
Topic 264 69.11 Topic 289 71.60 1
Topic 265 38.56 Topic 290 17.59 UniNEbifr1
Difference (average precision)
Topic 266 0.78 Topic 291 6.99
0.5
Topic 267 44.93 Topic 292 5.18
Topic 268 55.81 Topic 293 75.37
Topic 269 19.88 Topic 294 67.37 0
Topic 270 58.50 Topic 295 51.77
Topic 271 72.44 Topic 296 25.24
Topic 272 15.46 Topic 297 43.61 −0.5
Topic 273 47.14 Topic 298 27.80
Topic 274 63.71 Topic 299 11.40
−1
Topic 275 30.80 Topic 300 19.56 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.185
unine UniNEbifr2 AH-Bilingual-X2FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 2,212 Pooled= false
CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 74.52 UniNEbifr2
90%
10 58.70
20 51.50 80%
30 45.02
70%
40 38.32
50 35.57
Average Precision
60%
60 30.68
50%
70 25.35
80 19.39 40%
90 12.89
30%
100 4.17
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
34.67
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 53.20 UniNEbifr2
90%
10 docs 49.00
15 docs 44.00 80%
20 docs 42.40
70%
30 docs 39.73
100 docs 24.56 60%
R−Precision
200 docs 16.32
50%
500 docs 8.02
1000 docs 4.42 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
36.02 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275)
queries 1
UniNEbifr2
Topic 251 23.98 Topic 276 23.62
Difference (average precision)
Topic 252 7.30 Topic 277 49.61 0.5
Topic 253 39.06 Topic 278 5.67
Topic 254 69.75 Topic 279 9.71
Topic 255 1.49 Topic 280 19.58 0
Topic 256 85.58 Topic 281 47.76
Topic 257 15.14 Topic 282 4.84
−0.5
Topic 258 2.66 Topic 283 46.76
Topic 259 51.97 Topic 284 64.85
Topic 260 22.69 Topic 285 57.34 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.07 Topic 286 7.47 Topic Number
Topic 262 4.25 Topic 287 52.60
Topic 263 44.21 Topic 288 11.20
CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300)
Topic 264 73.25 Topic 289 69.29 1
Topic 265 39.67 Topic 290 24.80 UniNEbifr2
Difference (average precision)
Topic 266 1.24 Topic 291 4.54
0.5
Topic 267 43.03 Topic 292 4.47
Topic 268 55.44 Topic 293 76.66
Topic 269 21.88 Topic 294 68.53 0
Topic 270 63.37 Topic 295 43.28
Topic 271 75.20 Topic 296 24.81
Topic 272 20.25 Topic 297 47.98 −0.5
Topic 273 59.21 Topic 298 30.09
Topic 274 61.14 Topic 299 10.80
−1
Topic 275 24.47 Topic 300 20.72 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.186
unine UniNEbifr3 AH-Bilingual-X2FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 2,194 Pooled= false
CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 72.72 UniNEbifr3
90%
10 60.95
20 52.26 80%
30 44.30
70%
40 38.56
50 35.24
Average Precision
60%
60 30.80
50%
70 24.88
80 18.84 40%
90 12.41
30%
100 4.22
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
34.44
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 51.20 UniNEbifr3
90%
10 docs 48.60
15 docs 46.27 80%
20 docs 44.60
70%
30 docs 39.67
100 docs 24.48 60%
R−Precision
200 docs 16.07
50%
500 docs 7.98
1000 docs 4.39 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
35.85 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275)
queries 1
UniNEbifr3
Topic 251 15.53 Topic 276 26.30
Difference (average precision)
Topic 252 6.77 Topic 277 48.59 0.5
Topic 253 33.11 Topic 278 23.32
Topic 254 68.12 Topic 279 8.41
Topic 255 1.22 Topic 280 14.85 0
Topic 256 83.23 Topic 281 48.85
Topic 257 14.70 Topic 282 3.24
−0.5
Topic 258 4.47 Topic 283 48.42
Topic 259 50.30 Topic 284 64.87
Topic 260 25.91 Topic 285 43.87 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.15 Topic 286 10.70 Topic Number
Topic 262 4.84 Topic 287 53.46
Topic 263 40.96 Topic 288 10.13
CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300)
Topic 264 69.37 Topic 289 73.97 1
Topic 265 41.79 Topic 290 20.45 UniNEbifr3
Difference (average precision)
Topic 266 0.66 Topic 291 6.62
0.5
Topic 267 47.03 Topic 292 5.54
Topic 268 54.49 Topic 293 76.59
Topic 269 20.60 Topic 294 68.42 0
Topic 270 62.02 Topic 295 50.97
Topic 271 70.71 Topic 296 25.27
Topic 272 18.01 Topic 297 41.95 −0.5
Topic 273 55.38 Topic 298 29.74
Topic 274 65.43 Topic 299 9.50
−1
Topic 275 33.54 Topic 300 19.68 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.187
jhu-apl aplbienhua AH-Bilingual-X2HU
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to Hungarian
Retrieved 50,000 RunType= automatic
Relevant 939 QueryType= TD
Relevant retrieved 718 Pooled= true
CLEF 2005 AH−Bilingual−X2HU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 41.51 aplbienhua
90%
10 38.64
20 33.54 80%
30 29.86
70%
40 25.45
50 23.27
Average Precision
60%
60 19.43
50%
70 17.12
80 13.84 40%
90 11.13
30%
100 6.42
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
22.35
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2HU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 25.60 aplbienhua
90%
10 docs 22.60
15 docs 21.33 80%
20 docs 20.10
70%
30 docs 17.60
100 docs 9.02 60%
R−Precision
200 docs 5.41
50%
500 docs 2.51
1000 docs 1.44 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
22.78 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2HU − Comparison to median by topic (topics 251 to 275)
queries 1
aplbienhua
Topic 251 38.21 Topic 276 9.75
Difference (average precision)
Topic 252 12.72 Topic 277 9.33 0.5
Topic 253 40.16 Topic 278 0.00
Topic 254 67.45 Topic 279 30.30
Topic 255 38.30 Topic 280 19.82 0
Topic 256 83.96 Topic 281 85.13
Topic 257 11.56 Topic 282 6.52
−0.5
Topic 258 0.00 Topic 283 0.06
Topic 259 31.13 Topic 284 0.15
Topic 260 0.00 Topic 285 0.00 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.00 Topic 286 2.59 Topic Number
Topic 262 0.00 Topic 287 42.97
Topic 263 0.04 Topic 288 0.19
CLEF 2005 AH−Bilingual−X2HU − Comparison to median by topic (topics 276 to 300)
Topic 264 11.52 Topic 289 100.00 1
Topic 265 3.03 Topic 290 65.51 aplbienhua
Difference (average precision)
Topic 266 5.05 Topic 291 55.29
0.5
Topic 267 3.80 Topic 292 50.21
Topic 268 5.40 Topic 293 60.59
Topic 269 0.27 Topic 294 7.52 0
Topic 270 0.01 Topic 295 12.77
Topic 271 30.05 Topic 296 11.57
Topic 272 7.69 Topic 297 64.40 −0.5
Topic 273 4.29 Topic 298 11.40
Topic 274 71.50 Topic 299 0.00
−1
Topic 275 1.56 Topic 300 3.66 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.188
jhu-apl aplbienhue AH-Bilingual-X2HU
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to Hungarian
Retrieved 50,000 RunType= automatic
Relevant 939 QueryType= TD
Relevant retrieved 729 Pooled= false
CLEF 2005 AH−Bilingual−X2HU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 43.91 aplbienhue
90%
10 38.97
20 36.87 80%
30 32.23
70%
40 30.02
50 26.98
Average Precision
60%
60 20.98
50%
70 18.77
80 15.58 40%
90 11.52
30%
100 6.49
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
24.58
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2HU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 30.80 aplbienhue
90%
10 docs 26.20
15 docs 22.53 80%
20 docs 20.50
70%
30 docs 18.13
100 docs 9.44 60%
R−Precision
200 docs 5.50
50%
500 docs 2.67
1000 docs 1.46 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
24.37 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2HU − Comparison to median by topic (topics 251 to 275)
queries 1
aplbienhue
Topic 251 29.07 Topic 276 14.57
Difference (average precision)
Topic 252 38.29 Topic 277 17.19 0.5
Topic 253 45.22 Topic 278 0.00
Topic 254 65.21 Topic 279 78.56
Topic 255 10.79 Topic 280 33.75 0
Topic 256 83.34 Topic 281 93.57
Topic 257 6.87 Topic 282 21.91
−0.5
Topic 258 0.00 Topic 283 0.02
Topic 259 42.52 Topic 284 0.09
Topic 260 0.02 Topic 285 0.00 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.00 Topic 286 2.31 Topic Number
Topic 262 3.72 Topic 287 57.52
Topic 263 0.59 Topic 288 0.04
CLEF 2005 AH−Bilingual−X2HU − Comparison to median by topic (topics 276 to 300)
Topic 264 21.52 Topic 289 98.61 1
Topic 265 6.15 Topic 290 68.09 aplbienhue
Difference (average precision)
Topic 266 7.00 Topic 291 57.75
0.5
Topic 267 7.89 Topic 292 50.33
Topic 268 3.69 Topic 293 76.75
Topic 269 0.26 Topic 294 7.85 0
Topic 270 0.00 Topic 295 12.15
Topic 271 14.84 Topic 296 2.62
Topic 272 7.69 Topic 297 65.58 −0.5
Topic 273 0.48 Topic 298 12.99
Topic 274 57.32 Topic 299 0.00
−1
Topic 275 0.64 Topic 300 3.59 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.189
miracle ENMST AH-Bilingual-X2HU
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to Hungarian
Retrieved 50,000 RunType= automatic
Relevant 939 QueryType= TD
Relevant retrieved 752 Pooled= false
CLEF 2005 AH−Bilingual−X2HU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 64.23 ENMST
90%
10 55.76
20 48.18 80%
30 40.29
70%
40 32.54
50 28.90
Average Precision
60%
60 23.66
50%
70 20.37
80 17.22 40%
90 12.91
30%
100 8.67
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
30.16
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2HU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 36.80 ENMST
90%
10 docs 30.20
15 docs 27.33 80%
20 docs 25.20
70%
30 docs 20.47
100 docs 9.84 60%
R−Precision
200 docs 5.87
50%
500 docs 2.74
1000 docs 1.50 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
28.61 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2HU − Comparison to median by topic (topics 251 to 275)
queries 1
ENMST
Topic 251 5.16 Topic 276 17.78
Difference (average precision)
Topic 252 23.18 Topic 277 7.37 0.5
Topic 253 43.75 Topic 278 36.80
Topic 254 44.98 Topic 279 6.55
Topic 255 29.38 Topic 280 5.15 0
Topic 256 73.46 Topic 281 96.45
Topic 257 7.72 Topic 282 9.02
−0.5
Topic 258 0.29 Topic 283 53.57
Topic 259 25.49 Topic 284 23.11
Topic 260 0.00 Topic 285 46.73 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 40.74 Topic 286 4.36 Topic Number
Topic 262 3.05 Topic 287 67.19
Topic 263 0.66 Topic 288 9.63
CLEF 2005 AH−Bilingual−X2HU − Comparison to median by topic (topics 276 to 300)
Topic 264 40.36 Topic 289 94.72 1
Topic 265 12.41 Topic 290 32.28 ENMST
Difference (average precision)
Topic 266 16.76 Topic 291 57.25
0.5
Topic 267 41.96 Topic 292 51.82
Topic 268 25.91 Topic 293 84.17
Topic 269 4.40 Topic 294 95.00 0
Topic 270 26.33 Topic 295 14.64
Topic 271 31.35 Topic 296 6.55
Topic 272 33.33 Topic 297 22.27 −0.5
Topic 273 18.85 Topic 298 1.33
Topic 274 7.67 Topic 299 30.23
−1
Topic 275 75.00 Topic 300 1.89 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.190
miracle ENMxNP01ST1 AH-Bilingual-X2HU
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to Hungarian
Retrieved 50,000 RunType= automatic
Relevant 939 QueryType= TD
Relevant retrieved 752 Pooled= true
CLEF 2005 AH−Bilingual−X2HU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 61.04 ENMxNP01ST1
90%
10 53.05
20 45.47 80%
30 40.97
70%
40 32.50
50 29.09
Average Precision
60%
60 24.13
50%
70 20.66
80 17.69 40%
90 13.39
30%
100 9.08
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
29.77
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2HU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 37.20 ENMxNP01ST1
90%
10 docs 30.80
15 docs 27.73 80%
20 docs 25.30
70%
30 docs 20.53
100 docs 9.86 60%
R−Precision
200 docs 5.88
50%
500 docs 2.74
1000 docs 1.50 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
28.12 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2HU − Comparison to median by topic (topics 251 to 275)
queries 1
ENMxNP01ST1
Topic 251 5.16 Topic 276 18.00
Difference (average precision)
Topic 252 23.18 Topic 277 7.80 0.5
Topic 253 44.49 Topic 278 38.81
Topic 254 47.52 Topic 279 6.54
Topic 255 29.38 Topic 280 5.15 0
Topic 256 73.46 Topic 281 96.11
Topic 257 7.72 Topic 282 9.02
−0.5
Topic 258 0.29 Topic 283 53.57
Topic 259 3.27 Topic 284 23.11
Topic 260 0.00 Topic 285 50.70 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 40.74 Topic 286 4.36 Topic Number
Topic 262 3.01 Topic 287 66.25
Topic 263 0.66 Topic 288 9.77
CLEF 2005 AH−Bilingual−X2HU − Comparison to median by topic (topics 276 to 300)
Topic 264 40.36 Topic 289 94.72 1
Topic 265 14.14 Topic 290 32.27 ENMxNP01ST1
Difference (average precision)
Topic 266 17.41 Topic 291 55.18
0.5
Topic 267 45.94 Topic 292 51.85
Topic 268 25.91 Topic 293 84.17
Topic 269 4.31 Topic 294 95.00 0
Topic 270 27.51 Topic 295 15.07
Topic 271 32.06 Topic 296 6.68
Topic 272 33.33 Topic 297 22.26 −0.5
Topic 273 20.24 Topic 298 1.33
Topic 274 7.67 Topic 299 8.01
−1
Topic 275 83.33 Topic 300 1.88 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.191
unine UniNEbihu1 AH-Bilingual-X2HU
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to Hungarian
Retrieved 50,000 RunType= automatic
Relevant 939 QueryType= TD
Relevant retrieved 807 Pooled= true
CLEF 2005 AH−Bilingual−X2HU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 53.91 UniNEbihu1
90%
10 46.67
20 42.09 80%
30 37.43
70%
40 31.94
50 29.52
Average Precision
60%
60 24.41
50%
70 21.44
80 16.19 40%
90 11.93
30%
100 7.22
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
27.86
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2HU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 30.00 UniNEbihu1
90%
10 docs 29.40
15 docs 24.40 80%
20 docs 22.60
70%
30 docs 20.40
100 docs 10.64 60%
R−Precision
200 docs 6.37
50%
500 docs 2.98
1000 docs 1.61 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
26.79 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2HU − Comparison to median by topic (topics 251 to 275)
queries 1
UniNEbihu1
Topic 251 12.20 Topic 276 26.39
Difference (average precision)
Topic 252 17.25 Topic 277 44.92 0.5
Topic 253 36.26 Topic 278 0.01
Topic 254 45.67 Topic 279 73.27
Topic 255 39.24 Topic 280 5.62 0
Topic 256 81.37 Topic 281 95.60
Topic 257 21.98 Topic 282 2.10
−0.5
Topic 258 0.04 Topic 283 28.89
Topic 259 1.19 Topic 284 0.68
Topic 260 7.89 Topic 285 0.12 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.57 Topic 286 2.39 Topic Number
Topic 262 0.50 Topic 287 73.23
Topic 263 18.94 Topic 288 5.70
CLEF 2005 AH−Bilingual−X2HU − Comparison to median by topic (topics 276 to 300)
Topic 264 12.54 Topic 289 100.00 1
Topic 265 39.02 Topic 290 61.46 UniNEbihu1
Difference (average precision)
Topic 266 19.21 Topic 291 66.81
0.5
Topic 267 57.53 Topic 292 51.01
Topic 268 51.79 Topic 293 23.65
Topic 269 0.85 Topic 294 43.94 0
Topic 270 33.53 Topic 295 0.61
Topic 271 25.34 Topic 296 33.79
Topic 272 16.67 Topic 297 59.58 −0.5
Topic 273 7.34 Topic 298 0.37
Topic 274 18.36 Topic 299 0.00
−1
Topic 275 17.50 Topic 300 9.99 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.192
unine UniNEbihu2 AH-Bilingual-X2HU
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to Hungarian
Retrieved 50,000 RunType= automatic
Relevant 939 QueryType= TD
Relevant retrieved 793 Pooled= false
CLEF 2005 AH−Bilingual−X2HU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 45.47 UniNEbihu2
90%
10 40.71
20 33.60 80%
30 32.47
70%
40 25.28
50 23.78
Average Precision
60%
60 20.09
50%
70 17.49
80 14.00 40%
90 10.82
30%
100 7.23
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
23.15
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2HU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 28.80 UniNEbihu2
90%
10 docs 24.20
15 docs 22.00 80%
20 docs 20.80
70%
30 docs 17.07
100 docs 10.26 60%
R−Precision
200 docs 6.23
50%
500 docs 2.95
1000 docs 1.59 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
22.01 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2HU − Comparison to median by topic (topics 251 to 275)
queries 1
UniNEbihu2
Topic 251 9.77 Topic 276 25.48
Difference (average precision)
Topic 252 16.75 Topic 277 16.68 0.5
Topic 253 46.60 Topic 278 0.07
Topic 254 56.19 Topic 279 8.07
Topic 255 34.26 Topic 280 7.46 0
Topic 256 81.04 Topic 281 93.40
Topic 257 25.88 Topic 282 1.91
−0.5
Topic 258 0.09 Topic 283 57.76
Topic 259 0.65 Topic 284 0.00
Topic 260 2.16 Topic 285 0.00 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 1.04 Topic 286 2.06 Topic Number
Topic 262 6.30 Topic 287 74.38
Topic 263 16.09 Topic 288 9.02
CLEF 2005 AH−Bilingual−X2HU − Comparison to median by topic (topics 276 to 300)
Topic 264 6.53 Topic 289 97.05 1
Topic 265 3.56 Topic 290 48.23 UniNEbihu2
Difference (average precision)
Topic 266 24.21 Topic 291 67.58
0.5
Topic 267 34.17 Topic 292 51.01
Topic 268 19.59 Topic 293 13.92
Topic 269 1.74 Topic 294 11.63 0
Topic 270 36.66 Topic 295 0.05
Topic 271 20.65 Topic 296 29.94
Topic 272 14.29 Topic 297 49.82 −0.5
Topic 273 12.01 Topic 298 0.25
Topic 274 10.02 Topic 299 0.00
−1
Topic 275 5.22 Topic 300 6.32 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.193
unine UniNEbihu3 AH-Bilingual-X2HU
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to Hungarian
Retrieved 50,000 RunType= automatic
Relevant 939 QueryType= TD
Relevant retrieved 811 Pooled= false
CLEF 2005 AH−Bilingual−X2HU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 53.81 UniNEbihu3
90%
10 48.01
20 42.83 80%
30 38.11
70%
40 34.08
50 31.16
Average Precision
60%
60 25.54
50%
70 22.66
80 17.86 40%
90 13.20
30%
100 8.53
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
28.82
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2HU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 31.20 UniNEbihu3
90%
10 docs 29.60
15 docs 26.40 80%
20 docs 24.10
70%
30 docs 21.20
100 docs 10.90 60%
R−Precision
200 docs 6.48
50%
500 docs 3.01
1000 docs 1.62 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
27.89 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2HU − Comparison to median by topic (topics 251 to 275)
queries 1
UniNEbihu3
Topic 251 12.86 Topic 276 22.81
Difference (average precision)
Topic 252 18.75 Topic 277 53.46 0.5
Topic 253 42.02 Topic 278 0.01
Topic 254 47.28 Topic 279 63.86
Topic 255 51.81 Topic 280 6.29 0
Topic 256 80.68 Topic 281 96.72
Topic 257 21.77 Topic 282 1.48
−0.5
Topic 258 0.03 Topic 283 33.44
Topic 259 1.31 Topic 284 1.47
Topic 260 10.85 Topic 285 0.11 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.35 Topic 286 2.88 Topic Number
Topic 262 0.24 Topic 287 72.02
Topic 263 23.48 Topic 288 0.98
CLEF 2005 AH−Bilingual−X2HU − Comparison to median by topic (topics 276 to 300)
Topic 264 12.58 Topic 289 100.00 1
Topic 265 39.55 Topic 290 69.49 UniNEbihu3
Difference (average precision)
Topic 266 19.23 Topic 291 66.29
0.5
Topic 267 55.17 Topic 292 51.22
Topic 268 52.79 Topic 293 49.14
Topic 269 0.73 Topic 294 44.28 0
Topic 270 29.57 Topic 295 1.55
Topic 271 20.72 Topic 296 29.88
Topic 272 14.29 Topic 297 59.87 −0.5
Topic 273 8.10 Topic 298 0.28
Topic 274 23.98 Topic 299 0.03
−1
Topic 275 17.83 Topic 300 7.54 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.194
alicante IRn-enpt-fexp AH-Bilingual-X2PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TD
Relevant retrieved 2,264 Pooled= false
CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 67.10 IRn−enpt−fexp
90%
10 54.43
20 46.33 80%
30 40.30
70%
40 33.39
50 28.47
Average Precision
60%
60 22.38
50%
70 17.55
80 13.32 40%
90 7.59
30%
100 3.91
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
28.94
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 49.20 IRn−enpt−fexp
90%
10 docs 47.60
15 docs 45.07 80%
20 docs 41.30
70%
30 docs 37.20
100 docs 22.54 60%
R−Precision
200 docs 15.23
50%
500 docs 8.01
1000 docs 4.53 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
31.08 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275)
queries 1
IRn−enpt−fexp
Topic 251 48.15 Topic 276 28.73
Difference (average precision)
Topic 252 1.55 Topic 277 3.94 0.5
Topic 253 29.99 Topic 278 7.73
Topic 254 61.30 Topic 279 44.05
Topic 255 39.23 Topic 280 4.90 0
Topic 256 95.33 Topic 281 64.96
Topic 257 13.22 Topic 282 14.84
−0.5
Topic 258 1.04 Topic 283 29.67
Topic 259 53.47 Topic 284 15.37
Topic 260 47.51 Topic 285 30.86 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.02 Topic 286 2.62 Topic Number
Topic 262 0.96 Topic 287 42.49
Topic 263 10.71 Topic 288 1.25
CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300)
Topic 264 45.63 Topic 289 38.85 1
Topic 265 14.68 Topic 290 13.47 IRn−enpt−fexp
Difference (average precision)
Topic 266 26.53 Topic 291 25.41
0.5
Topic 267 14.84 Topic 292 8.95
Topic 268 22.27 Topic 293 70.70
Topic 269 11.64 Topic 294 63.41 0
Topic 270 32.66 Topic 295 31.39
Topic 271 53.08 Topic 296 39.32
Topic 272 21.62 Topic 297 41.50 −0.5
Topic 273 44.66 Topic 298 59.17
Topic 274 4.17 Topic 299 36.33
−1
Topic 275 15.47 Topic 300 17.30 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.195
alicante IRn-enpt-fexpfl AH-Bilingual-X2PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TD
Relevant retrieved 2,196 Pooled= true
CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 64.06 IRn−enpt−fexpfl
90%
10 51.36
20 43.33 80%
30 36.86
70%
40 31.16
50 26.86
Average Precision
60%
60 22.21
50%
70 16.82
80 12.82 40%
90 7.74
30%
100 3.60
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
27.27
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 46.80 IRn−enpt−fexpfl
90%
10 docs 45.20
15 docs 41.87 80%
20 docs 39.40
70%
30 docs 35.20
100 docs 21.82 60%
R−Precision
200 docs 14.64
50%
500 docs 7.74
1000 docs 4.39 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
30.25 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275)
queries 1
IRn−enpt−fexpfl
Topic 251 40.53 Topic 276 28.46
Difference (average precision)
Topic 252 0.99 Topic 277 1.57 0.5
Topic 253 19.54 Topic 278 3.40
Topic 254 65.06 Topic 279 44.45
Topic 255 2.65 Topic 280 7.85 0
Topic 256 96.63 Topic 281 60.52
Topic 257 10.12 Topic 282 13.63
−0.5
Topic 258 0.43 Topic 283 29.63
Topic 259 49.32 Topic 284 13.73
Topic 260 56.75 Topic 285 31.43 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.01 Topic 286 1.58 Topic Number
Topic 262 0.64 Topic 287 43.51
Topic 263 7.31 Topic 288 1.26
CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300)
Topic 264 46.59 Topic 289 40.83 1
Topic 265 8.51 Topic 290 9.42 IRn−enpt−fexpfl
Difference (average precision)
Topic 266 18.47 Topic 291 22.22
0.5
Topic 267 14.89 Topic 292 11.57
Topic 268 13.59 Topic 293 73.15
Topic 269 13.94 Topic 294 57.11 0
Topic 270 30.81 Topic 295 28.29
Topic 271 51.44 Topic 296 41.93
Topic 272 18.29 Topic 297 44.42 −0.5
Topic 273 52.59 Topic 298 55.63
Topic 274 3.38 Topic 299 30.46
−1
Topic 275 16.74 Topic 300 28.44 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.196
alicante IRn-enpt-vexp AH-Bilingual-X2PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TD
Relevant retrieved 2,303 Pooled= false
CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 67.68 IRn−enpt−vexp
90%
10 54.14
20 46.62 80%
30 39.60
70%
40 33.26
50 28.92
Average Precision
60%
60 23.65
50%
70 18.50
80 14.48 40%
90 8.52
30%
100 3.48
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
29.18
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 46.80 IRn−enpt−vexp
90%
10 docs 46.80
15 docs 44.27 80%
20 docs 42.10
70%
30 docs 37.80
100 docs 22.80 60%
R−Precision
200 docs 15.46
50%
500 docs 7.93
1000 docs 4.61 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
31.38 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275)
queries 1
IRn−enpt−vexp
Topic 251 53.04 Topic 276 27.14
Difference (average precision)
Topic 252 1.68 Topic 277 3.48 0.5
Topic 253 35.99 Topic 278 13.03
Topic 254 60.65 Topic 279 44.30
Topic 255 25.74 Topic 280 3.74 0
Topic 256 94.44 Topic 281 62.38
Topic 257 14.49 Topic 282 14.93
−0.5
Topic 258 1.56 Topic 283 32.12
Topic 259 49.67 Topic 284 16.57
Topic 260 43.77 Topic 285 33.55 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.02 Topic 286 2.02 Topic Number
Topic 262 0.83 Topic 287 35.41
Topic 263 9.86 Topic 288 1.54
CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300)
Topic 264 48.65 Topic 289 40.74 1
Topic 265 17.74 Topic 290 14.24 IRn−enpt−vexp
Difference (average precision)
Topic 266 28.23 Topic 291 25.59
0.5
Topic 267 18.04 Topic 292 7.10
Topic 268 20.74 Topic 293 71.27
Topic 269 11.63 Topic 294 64.72 0
Topic 270 35.54 Topic 295 33.73
Topic 271 54.32 Topic 296 41.65
Topic 272 21.03 Topic 297 45.51 −0.5
Topic 273 39.19 Topic 298 62.38
Topic 274 5.49 Topic 299 36.21
−1
Topic 275 19.84 Topic 300 13.57 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.197
alicante IRn-enpt-vnexp AH-Bilingual-X2PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TD
Relevant retrieved 2,083 Pooled= false
CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 72.14 IRn−enpt−vnexp
90%
10 54.19
20 40.73 80%
30 33.01
70%
40 27.63
50 22.89
Average Precision
60%
60 17.69
50%
70 14.13
80 9.79 40%
90 6.15
30%
100 3.46
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
25.22
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 48.40 IRn−enpt−vnexp
90%
10 docs 45.40
15 docs 40.40 80%
20 docs 38.00
70%
30 docs 33.20
100 docs 19.78 60%
R−Precision
200 docs 13.34
50%
500 docs 7.12
1000 docs 4.17 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
27.58 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275)
queries 1
IRn−enpt−vnexp
Topic 251 48.71 Topic 276 19.89
Difference (average precision)
Topic 252 1.76 Topic 277 2.02 0.5
Topic 253 23.53 Topic 278 12.34
Topic 254 30.97 Topic 279 30.66
Topic 255 45.63 Topic 280 4.82 0
Topic 256 93.69 Topic 281 60.40
Topic 257 14.18 Topic 282 16.40
−0.5
Topic 258 2.38 Topic 283 28.81
Topic 259 41.22 Topic 284 7.24
Topic 260 17.67 Topic 285 28.04 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.06 Topic 286 1.43 Topic Number
Topic 262 4.56 Topic 287 27.54
Topic 263 8.43 Topic 288 2.12
CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300)
Topic 264 35.82 Topic 289 38.84 1
Topic 265 11.67 Topic 290 11.75 IRn−enpt−vnexp
Difference (average precision)
Topic 266 26.74 Topic 291 23.34
0.5
Topic 267 17.31 Topic 292 7.94
Topic 268 11.66 Topic 293 68.44
Topic 269 10.10 Topic 294 68.18 0
Topic 270 26.54 Topic 295 25.52
Topic 271 48.53 Topic 296 38.82
Topic 272 32.70 Topic 297 38.73 −0.5
Topic 273 29.08 Topic 298 43.44
Topic 274 28.21 Topic 299 26.89
−1
Topic 275 9.47 Topic 300 6.58 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.198
buffalo UBbi-en-pt-comb1 AH-Bilingual-X2PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TD
Relevant retrieved 1,526 Pooled= true
CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 43.19 UBbi−en−pt−comb1
90%
10 33.71
20 27.23 80%
30 21.37
70%
40 18.29
50 14.90
Average Precision
60%
60 11.17
50%
70 8.37
80 5.61 40%
90 3.10
30%
100 0.09
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
15.72
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 30.40 UBbi−en−pt−comb1
90%
10 docs 29.20
15 docs 27.07 80%
20 docs 26.00
70%
30 docs 23.60
100 docs 14.78 60%
R−Precision
200 docs 9.94
50%
500 docs 5.15
1000 docs 3.05 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
20.24 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275)
queries 1
UBbi−en−pt−comb1
Topic 251 21.65 Topic 276 14.47
Difference (average precision)
Topic 252 3.03 Topic 277 0.03 0.5
Topic 253 1.59 Topic 278 0.20
Topic 254 39.53 Topic 279 3.89
Topic 255 1.71 Topic 280 12.48 0
Topic 256 82.57 Topic 281 46.95
Topic 257 14.16 Topic 282 18.91
−0.5
Topic 258 0.23 Topic 283 45.20
Topic 259 25.97 Topic 284 2.86
Topic 260 46.27 Topic 285 0.64 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.00 Topic 286 0.03 Topic Number
Topic 262 0.04 Topic 287 15.26
Topic 263 1.32 Topic 288 1.46
CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300)
Topic 264 11.82 Topic 289 2.78 1
Topic 265 17.84 Topic 290 0.52 UBbi−en−pt−comb1
Difference (average precision)
Topic 266 44.96 Topic 291 5.96
0.5
Topic 267 1.97 Topic 292 4.09
Topic 268 12.92 Topic 293 36.81
Topic 269 1.12 Topic 294 53.81 0
Topic 270 23.70 Topic 295 11.04
Topic 271 10.57 Topic 296 27.48
Topic 272 26.91 Topic 297 4.99 −0.5
Topic 273 23.49 Topic 298 22.57
Topic 274 9.39 Topic 299 0.40
−1
Topic 275 26.84 Topic 300 3.54 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.199
buffalo UBbi-en-pt-comb2 AH-Bilingual-X2PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TD
Relevant retrieved 1,546 Pooled= false
CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 53.09 UBbi−en−pt−comb2
90%
10 38.34
20 29.56 80%
30 23.40
70%
40 19.66
50 15.80
Average Precision
60%
60 11.78
50%
70 9.66
80 6.89 40%
90 4.03
30%
100 2.31
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
17.87
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 35.60 UBbi−en−pt−comb2
90%
10 docs 33.00
15 docs 29.60 80%
20 docs 27.80
70%
30 docs 24.33
100 docs 15.12 60%
R−Precision
200 docs 10.10
50%
500 docs 5.17
1000 docs 3.09 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
21.88 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275)
queries 1
UBbi−en−pt−comb2
Topic 251 24.94 Topic 276 12.42
Difference (average precision)
Topic 252 3.55 Topic 277 0.02 0.5
Topic 253 1.76 Topic 278 0.18
Topic 254 42.27 Topic 279 3.75
Topic 255 19.06 Topic 280 10.54 0
Topic 256 94.68 Topic 281 52.22
Topic 257 14.65 Topic 282 17.83
−0.5
Topic 258 0.22 Topic 283 52.84
Topic 259 39.15 Topic 284 2.47
Topic 260 46.10 Topic 285 0.79 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.00 Topic 286 0.05 Topic Number
Topic 262 0.05 Topic 287 16.11
Topic 263 1.07 Topic 288 1.39
CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300)
Topic 264 11.00 Topic 289 11.11 1
Topic 265 22.00 Topic 290 0.45 UBbi−en−pt−comb2
Difference (average precision)
Topic 266 48.36 Topic 291 6.79
0.5
Topic 267 1.49 Topic 292 5.93
Topic 268 8.94 Topic 293 40.72
Topic 269 1.32 Topic 294 57.46 0
Topic 270 21.79 Topic 295 12.51
Topic 271 16.26 Topic 296 36.67
Topic 272 24.86 Topic 297 5.12 −0.5
Topic 273 31.94 Topic 298 21.71
Topic 274 9.85 Topic 299 0.31
−1
Topic 275 33.83 Topic 300 5.03 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.200
buffalo UBbi-en-pt-t1 AH-Bilingual-X2PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TD
Relevant retrieved 1,545 Pooled= false
CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 54.96 UBbi−en−pt−t1
90%
10 40.33
20 29.37 80%
30 22.73
70%
40 19.18
50 15.44
Average Precision
60%
60 11.75
50%
70 9.29
80 6.27 40%
90 3.67
30%
100 1.90
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
17.86
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 35.20 UBbi−en−pt−t1
90%
10 docs 32.20
15 docs 29.60 80%
20 docs 27.70
70%
30 docs 24.73
100 docs 15.14 60%
R−Precision
200 docs 10.12
50%
500 docs 5.23
1000 docs 3.09 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
21.13 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275)
queries 1
UBbi−en−pt−t1
Topic 251 24.33 Topic 276 13.84
Difference (average precision)
Topic 252 3.03 Topic 277 0.03 0.5
Topic 253 1.56 Topic 278 0.20
Topic 254 42.36 Topic 279 3.89
Topic 255 19.36 Topic 280 12.48 0
Topic 256 92.52 Topic 281 52.58
Topic 257 14.18 Topic 282 22.02
−0.5
Topic 258 0.23 Topic 283 50.95
Topic 259 35.32 Topic 284 2.43
Topic 260 48.41 Topic 285 0.64 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.00 Topic 286 0.03 Topic Number
Topic 262 0.04 Topic 287 17.91
Topic 263 1.32 Topic 288 1.44
CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300)
Topic 264 11.82 Topic 289 16.67 1
Topic 265 17.94 Topic 290 0.51 UBbi−en−pt−t1
Difference (average precision)
Topic 266 47.40 Topic 291 5.95
0.5
Topic 267 1.96 Topic 292 4.09
Topic 268 12.92 Topic 293 41.10
Topic 269 1.12 Topic 294 59.68 0
Topic 270 22.40 Topic 295 12.65
Topic 271 16.41 Topic 296 32.36
Topic 272 27.45 Topic 297 4.99 −0.5
Topic 273 28.80 Topic 298 20.99
Topic 274 6.46 Topic 299 0.40
−1
Topic 275 32.16 Topic 300 5.66 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.201
buffalo UBbi-en-pt-t2 AH-Bilingual-X2PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TD
Relevant retrieved 1,545 Pooled= false
CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 54.80 UBbi−en−pt−t2
90%
10 40.22
20 29.54 80%
30 22.73
70%
40 19.38
50 15.62
Average Precision
60%
60 11.68
50%
70 9.31
80 6.29 40%
90 3.76
30%
100 1.94
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
17.91
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 35.60 UBbi−en−pt−t2
90%
10 docs 32.60
15 docs 29.47 80%
20 docs 27.80
70%
30 docs 24.87
100 docs 15.16 60%
R−Precision
200 docs 10.13
50%
500 docs 5.22
1000 docs 3.09 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
21.49 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275)
queries 1
UBbi−en−pt−t2
Topic 251 24.34 Topic 276 13.76
Difference (average precision)
Topic 252 3.03 Topic 277 0.03 0.5
Topic 253 1.59 Topic 278 0.20
Topic 254 42.37 Topic 279 3.89
Topic 255 19.45 Topic 280 12.48 0
Topic 256 92.52 Topic 281 52.60
Topic 257 14.16 Topic 282 22.02
−0.5
Topic 258 0.23 Topic 283 50.95
Topic 259 35.32 Topic 284 2.43
Topic 260 48.38 Topic 285 0.64 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.00 Topic 286 0.03 Topic Number
Topic 262 0.04 Topic 287 17.90
Topic 263 1.32 Topic 288 1.45
CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300)
Topic 264 11.82 Topic 289 16.67 1
Topic 265 17.84 Topic 290 0.51 UBbi−en−pt−t2
Difference (average precision)
Topic 266 47.36 Topic 291 5.96
0.5
Topic 267 1.97 Topic 292 4.09
Topic 268 12.92 Topic 293 41.10
Topic 269 1.12 Topic 294 59.66 0
Topic 270 22.41 Topic 295 12.66
Topic 271 16.41 Topic 296 32.32
Topic 272 26.91 Topic 297 4.99 −0.5
Topic 273 28.88 Topic 298 20.99
Topic 274 9.63 Topic 299 0.40
−1
Topic 275 32.17 Topic 300 5.66 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.202
jhu-apl aplbienptb AH-Bilingual-X2PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TD
Relevant retrieved 2,053 Pooled= true
CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 70.23 aplbienptb
90%
10 57.23
20 50.10 80%
30 43.10
70%
40 36.90
50 30.78
Average Precision
60%
60 24.67
50%
70 18.93
80 14.19 40%
90 8.64
30%
100 4.57
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
31.20
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 53.20 aplbienptb
90%
10 docs 50.00
15 docs 45.60 80%
20 docs 42.30
70%
30 docs 38.33
100 docs 23.18 60%
R−Precision
200 docs 14.87
50%
500 docs 7.18
1000 docs 4.11 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
33.96 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275)
queries 1
aplbienptb
Topic 251 57.92 Topic 276 19.31
Difference (average precision)
Topic 252 47.99 Topic 277 21.69 0.5
Topic 253 6.05 Topic 278 57.64
Topic 254 31.56 Topic 279 38.85
Topic 255 3.46 Topic 280 0.53 0
Topic 256 100.00 Topic 281 57.02
Topic 257 25.03 Topic 282 18.18
−0.5
Topic 258 1.92 Topic 283 67.58
Topic 259 5.08 Topic 284 26.50
Topic 260 47.43 Topic 285 42.37 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.00 Topic 286 0.92 Topic Number
Topic 262 10.21 Topic 287 41.70
Topic 263 1.44 Topic 288 0.86
CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300)
Topic 264 61.04 Topic 289 47.24 1
Topic 265 31.48 Topic 290 56.91 aplbienptb
Difference (average precision)
Topic 266 11.00 Topic 291 37.96
0.5
Topic 267 13.13 Topic 292 12.27
Topic 268 55.48 Topic 293 62.58
Topic 269 10.32 Topic 294 34.89 0
Topic 270 26.89 Topic 295 26.75
Topic 271 48.59 Topic 296 43.77
Topic 272 13.38 Topic 297 35.49 −0.5
Topic 273 55.57 Topic 298 66.14
Topic 274 8.43 Topic 299 22.43
−1
Topic 275 46.44 Topic 300 0.73 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.203
jhu-apl aplbiesptb AH-Bilingual-X2PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual Spanish to Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TD
Relevant retrieved 2,268 Pooled= false
CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 75.96 aplbiesptb
90%
10 59.86
20 49.77 80%
30 43.06
70%
40 36.85
50 30.50
Average Precision
60%
60 25.01
50%
70 20.10
80 15.45 40%
90 9.47
30%
100 4.55
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
31.85
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 52.80 aplbiesptb
90%
10 docs 49.60
15 docs 46.27 80%
20 docs 42.90
70%
30 docs 37.93
100 docs 24.18 60%
R−Precision
200 docs 16.02
50%
500 docs 8.10
1000 docs 4.54 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
34.11 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275)
queries 1
aplbiesptb
Topic 251 44.36 Topic 276 7.34
Difference (average precision)
Topic 252 29.91 Topic 277 29.47 0.5
Topic 253 3.86 Topic 278 29.56
Topic 254 50.79 Topic 279 43.51
Topic 255 1.45 Topic 280 12.92 0
Topic 256 100.00 Topic 281 68.55
Topic 257 25.88 Topic 282 22.11
−0.5
Topic 258 16.67 Topic 283 70.64
Topic 259 16.49 Topic 284 38.16
Topic 260 32.21 Topic 285 26.76 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 2.20 Topic 286 4.14 Topic Number
Topic 262 12.14 Topic 287 34.12
Topic 263 10.49 Topic 288 0.95
CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300)
Topic 264 49.76 Topic 289 43.05 1
Topic 265 30.77 Topic 290 60.89 aplbiesptb
Difference (average precision)
Topic 266 13.42 Topic 291 24.49
0.5
Topic 267 23.35 Topic 292 20.03
Topic 268 49.39 Topic 293 60.02
Topic 269 10.32 Topic 294 50.50 0
Topic 270 20.44 Topic 295 45.37
Topic 271 46.87 Topic 296 41.56
Topic 272 11.36 Topic 297 55.44 −0.5
Topic 273 46.00 Topic 298 38.55
Topic 274 29.67 Topic 299 44.06
−1
Topic 275 31.20 Topic 300 11.50 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.204
miracle ENSSR AH-Bilingual-X2PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TDN
Relevant retrieved 1,660 Pooled= false
CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 58.12 ENSSR
90%
10 45.62
20 34.94 80%
30 26.54
70%
40 20.85
50 17.06
Average Precision
60%
60 14.05
50%
70 11.61
80 8.24 40%
90 5.30
30%
100 2.47
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
20.62
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 39.60 ENSSR
90%
10 docs 35.40
15 docs 31.73 80%
20 docs 30.10
70%
30 docs 27.07
100 docs 16.74 60%
R−Precision
200 docs 10.94
50%
500 docs 5.82
1000 docs 3.32 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
23.31 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275)
queries 1
ENSSR
Topic 251 24.52 Topic 276 22.02
Difference (average precision)
Topic 252 2.33 Topic 277 0.03 0.5
Topic 253 3.16 Topic 278 1.52
Topic 254 42.34 Topic 279 0.05
Topic 255 34.85 Topic 280 17.28 0
Topic 256 93.06 Topic 281 71.56
Topic 257 19.49 Topic 282 15.29
−0.5
Topic 258 0.16 Topic 283 49.05
Topic 259 36.42 Topic 284 4.89
Topic 260 29.50 Topic 285 1.67 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.01 Topic 286 0.01 Topic Number
Topic 262 0.41 Topic 287 27.50
Topic 263 0.79 Topic 288 5.88
CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300)
Topic 264 13.19 Topic 289 22.22 1
Topic 265 23.67 Topic 290 0.94 ENSSR
Difference (average precision)
Topic 266 50.11 Topic 291 5.76
0.5
Topic 267 2.96 Topic 292 5.58
Topic 268 17.25 Topic 293 40.69
Topic 269 5.28 Topic 294 68.72 0
Topic 270 29.32 Topic 295 24.09
Topic 271 16.77 Topic 296 48.05
Topic 272 33.48 Topic 297 2.63 −0.5
Topic 273 28.77 Topic 298 15.94
Topic 274 9.65 Topic 299 14.66
−1
Topic 275 45.41 Topic 300 2.00 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.205
miracle ENSST AH-Bilingual-X2PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TD
Relevant retrieved 1,505 Pooled= false
CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 55.21 ENSST
90%
10 43.85
20 33.42 80%
30 26.75
70%
40 20.57
50 17.45
Average Precision
60%
60 14.34
50%
70 12.27
80 9.32 40%
90 6.28
30%
100 3.29
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
20.36
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 37.20 ENSST
90%
10 docs 33.60
15 docs 30.40 80%
20 docs 28.90
70%
30 docs 26.07
100 docs 15.94 60%
R−Precision
200 docs 10.42
50%
500 docs 5.30
1000 docs 3.01 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
23.16 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275)
queries 1
ENSST
Topic 251 28.86 Topic 276 19.92
Difference (average precision)
Topic 252 3.77 Topic 277 0.01 0.5
Topic 253 1.02 Topic 278 1.34
Topic 254 38.89 Topic 279 1.07
Topic 255 36.13 Topic 280 25.02 0
Topic 256 97.55 Topic 281 67.15
Topic 257 14.07 Topic 282 13.72
−0.5
Topic 258 0.22 Topic 283 58.05
Topic 259 38.43 Topic 284 2.60
Topic 260 54.26 Topic 285 0.81 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.00 Topic 286 0.03 Topic Number
Topic 262 0.13 Topic 287 20.22
Topic 263 0.36 Topic 288 2.76
CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300)
Topic 264 11.67 Topic 289 18.52 1
Topic 265 25.76 Topic 290 0.62 ENSST
Difference (average precision)
Topic 266 47.84 Topic 291 6.22
0.5
Topic 267 2.46 Topic 292 5.12
Topic 268 16.08 Topic 293 38.96
Topic 269 0.77 Topic 294 69.06 0
Topic 270 27.96 Topic 295 13.84
Topic 271 17.93 Topic 296 45.71
Topic 272 36.56 Topic 297 3.26 −0.5
Topic 273 33.31 Topic 298 13.62
Topic 274 14.52 Topic 299 0.40
−1
Topic 275 39.43 Topic 300 1.95 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.206
miracle ENSxNP01SR1 AH-Bilingual-X2PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TDN
Relevant retrieved 1,660 Pooled= true
CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 59.00 ENSxNP01SR1
90%
10 44.39
20 34.59 80%
30 26.45
70%
40 20.71
50 17.00
Average Precision
60%
60 13.79
50%
70 11.57
80 8.24 40%
90 5.18
30%
100 2.24
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
20.39
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 39.60 ENSxNP01SR1
90%
10 docs 35.00
15 docs 31.47 80%
20 docs 29.90
70%
30 docs 27.07
100 docs 16.68 60%
R−Precision
200 docs 10.89
50%
500 docs 5.81
1000 docs 3.32 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
23.11 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275)
queries 1
ENSxNP01SR1
Topic 251 24.52 Topic 276 22.02
Difference (average precision)
Topic 252 2.34 Topic 277 0.03 0.5
Topic 253 3.16 Topic 278 1.52
Topic 254 41.46 Topic 279 0.05
Topic 255 34.85 Topic 280 17.35 0
Topic 256 93.06 Topic 281 71.57
Topic 257 19.75 Topic 282 15.32
−0.5
Topic 258 0.16 Topic 283 47.13
Topic 259 28.06 Topic 284 4.97
Topic 260 29.15 Topic 285 1.68 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.01 Topic 286 0.01 Topic Number
Topic 262 0.42 Topic 287 27.59
Topic 263 0.79 Topic 288 5.89
CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300)
Topic 264 13.19 Topic 289 22.22 1
Topic 265 23.67 Topic 290 1.20 ENSxNP01SR1
Difference (average precision)
Topic 266 50.13 Topic 291 5.80
0.5
Topic 267 2.98 Topic 292 5.89
Topic 268 17.28 Topic 293 40.69
Topic 269 5.33 Topic 294 68.84 0
Topic 270 33.03 Topic 295 23.88
Topic 271 13.54 Topic 296 46.48
Topic 272 34.16 Topic 297 2.63 −0.5
Topic 273 27.91 Topic 298 15.94
Topic 274 9.67 Topic 299 14.66
−1
Topic 275 45.41 Topic 300 2.00 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.207
miracle ESASR AH-Bilingual-X2PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual Spanish to Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TDN
Relevant retrieved 2,367 Pooled= false
CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 78.59 ESASR
90%
10 63.77
20 54.32 80%
30 45.07
70%
40 36.65
50 31.44
Average Precision
60%
60 25.62
50%
70 20.54
80 14.36 40%
90 7.94
30%
100 3.90
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
32.87
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 54.40 ESASR
90%
10 docs 50.40
15 docs 47.47 80%
20 docs 45.50
70%
30 docs 40.93
100 docs 25.44 60%
R−Precision
200 docs 16.67
50%
500 docs 8.54
1000 docs 4.73 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
34.74 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275)
queries 1
ESASR
Topic 251 46.84 Topic 276 8.92
Difference (average precision)
Topic 252 4.62 Topic 277 19.57 0.5
Topic 253 32.16 Topic 278 1.34
Topic 254 43.41 Topic 279 25.21
Topic 255 35.70 Topic 280 16.45 0
Topic 256 92.28 Topic 281 71.36
Topic 257 20.13 Topic 282 19.57
−0.5
Topic 258 3.85 Topic 283 58.68
Topic 259 41.70 Topic 284 14.02
Topic 260 10.19 Topic 285 35.99 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 27.72 Topic 286 26.93 Topic Number
Topic 262 0.56 Topic 287 34.56
Topic 263 20.78 Topic 288 16.25
CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300)
Topic 264 32.36 Topic 289 36.56 1
Topic 265 26.98 Topic 290 38.03 ESASR
Difference (average precision)
Topic 266 49.65 Topic 291 24.86
0.5
Topic 267 26.55 Topic 292 31.23
Topic 268 49.02 Topic 293 62.60
Topic 269 13.43 Topic 294 57.65 0
Topic 270 27.81 Topic 295 54.59
Topic 271 60.24 Topic 296 56.26
Topic 272 30.20 Topic 297 42.78 −0.5
Topic 273 34.31 Topic 298 17.33
Topic 274 21.11 Topic 299 31.86
−1
Topic 275 48.33 Topic 300 41.14 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.208
miracle ESAST AH-Bilingual-X2PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual Spanish to Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TD
Relevant retrieved 2,329 Pooled= false
CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 73.65 ESAST
90%
10 60.89
20 50.23 80%
30 40.65
70%
40 35.88
50 29.71
Average Precision
60%
60 23.67
50%
70 18.83
80 13.86 40%
90 7.63
30%
100 3.33
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
31.06
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 52.00 ESAST
90%
10 docs 48.00
15 docs 44.67 80%
20 docs 42.90
70%
30 docs 39.40
100 docs 24.86 60%
R−Precision
200 docs 16.61
50%
500 docs 8.36
1000 docs 4.66 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
33.53 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275)
queries 1
ESAST
Topic 251 58.50 Topic 276 6.81
Difference (average precision)
Topic 252 7.23 Topic 277 18.07 0.5
Topic 253 27.09 Topic 278 0.58
Topic 254 38.12 Topic 279 15.83
Topic 255 25.97 Topic 280 22.34 0
Topic 256 94.64 Topic 281 63.57
Topic 257 11.15 Topic 282 18.97
−0.5
Topic 258 8.33 Topic 283 64.82
Topic 259 34.14 Topic 284 9.95
Topic 260 28.46 Topic 285 37.77 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 8.91 Topic 286 18.94 Topic Number
Topic 262 0.36 Topic 287 40.59
Topic 263 20.06 Topic 288 9.22
CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300)
Topic 264 19.58 Topic 289 24.60 1
Topic 265 26.49 Topic 290 44.45 ESAST
Difference (average precision)
Topic 266 42.27 Topic 291 28.02
0.5
Topic 267 28.01 Topic 292 25.59
Topic 268 55.94 Topic 293 57.19
Topic 269 8.60 Topic 294 55.88 0
Topic 270 26.80 Topic 295 49.31
Topic 271 73.59 Topic 296 51.15
Topic 272 30.94 Topic 297 33.04 −0.5
Topic 273 37.35 Topic 298 19.52
Topic 274 21.53 Topic 299 35.20
−1
Topic 275 30.03 Topic 300 37.67 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.209
miracle ESAxNP01SR1 AH-Bilingual-X2PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual Spanish to Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TDN
Relevant retrieved 2,367 Pooled= true
CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 77.78 ESAxNP01SR1
90%
10 62.95
20 52.94 80%
30 44.32
70%
40 36.45
50 30.96
Average Precision
60%
60 24.93
50%
70 19.85
80 13.85 40%
90 7.82
30%
100 3.81
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
32.18
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 54.00 ESAxNP01SR1
90%
10 docs 51.00
15 docs 47.20 80%
20 docs 45.40
70%
30 docs 40.60
100 docs 25.32 60%
R−Precision
200 docs 16.57
50%
500 docs 8.49
1000 docs 4.73 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
34.26 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275)
queries 1
ESAxNP01SR1
Topic 251 46.84 Topic 276 9.06
Difference (average precision)
Topic 252 4.64 Topic 277 21.53 0.5
Topic 253 31.31 Topic 278 1.34
Topic 254 42.54 Topic 279 27.99
Topic 255 27.37 Topic 280 16.88 0
Topic 256 92.28 Topic 281 71.57
Topic 257 20.24 Topic 282 19.61
−0.5
Topic 258 0.05 Topic 283 57.97
Topic 259 35.79 Topic 284 12.66
Topic 260 10.19 Topic 285 35.99 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 27.72 Topic 286 26.96 Topic Number
Topic 262 0.56 Topic 287 34.94
Topic 263 21.16 Topic 288 16.26
CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300)
Topic 264 33.10 Topic 289 36.56 1
Topic 265 28.91 Topic 290 35.38 ESAxNP01SR1
Difference (average precision)
Topic 266 52.12 Topic 291 24.86
0.5
Topic 267 27.51 Topic 292 31.50
Topic 268 28.77 Topic 293 62.53
Topic 269 13.57 Topic 294 59.84 0
Topic 270 30.66 Topic 295 54.03
Topic 271 57.03 Topic 296 55.36
Topic 272 27.26 Topic 297 44.41 −0.5
Topic 273 33.98 Topic 298 15.86
Topic 274 21.28 Topic 299 31.31
−1
Topic 275 46.58 Topic 300 43.35 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.210
tlr tlrTDfr2pt3 AH-Bilingual-X2PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual French to Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TD
Relevant retrieved 1,920 Pooled= false
CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 74.21 tlrTDfr2pt3
90%
10 46.51
20 35.17 80%
30 29.57
70%
40 24.28
50 19.29
Average Precision
60%
60 14.61
50%
70 10.72
80 7.81 40%
90 4.62
30%
100 2.77
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
22.09
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 44.00 tlrTDfr2pt3
90%
10 docs 39.00
15 docs 36.40 80%
20 docs 32.50
70%
30 docs 28.33
100 docs 16.94 60%
R−Precision
200 docs 11.80
50%
500 docs 6.58
1000 docs 3.84 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
25.25 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275)
queries 1
tlrTDfr2pt3
Topic 251 31.84 Topic 276 8.36
Difference (average precision)
Topic 252 4.95 Topic 277 1.01 0.5
Topic 253 8.41 Topic 278 24.08
Topic 254 12.91 Topic 279 44.39
Topic 255 44.27 Topic 280 1.87 0
Topic 256 97.53 Topic 281 65.89
Topic 257 14.35 Topic 282 12.30
−0.5
Topic 258 0.16 Topic 283 10.63
Topic 259 15.94 Topic 284 17.30
Topic 260 37.73 Topic 285 10.78 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.41 Topic 286 22.01 Topic Number
Topic 262 0.09 Topic 287 8.79
Topic 263 4.29 Topic 288 3.48
CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300)
Topic 264 23.79 Topic 289 25.20 1
Topic 265 7.47 Topic 290 22.30 tlrTDfr2pt3
Difference (average precision)
Topic 266 3.57 Topic 291 31.37
0.5
Topic 267 21.36 Topic 292 16.94
Topic 268 51.22 Topic 293 41.81
Topic 269 5.59 Topic 294 56.09 0
Topic 270 16.35 Topic 295 14.29
Topic 271 37.32 Topic 296 43.22
Topic 272 30.86 Topic 297 44.21 −0.5
Topic 273 24.68 Topic 298 19.55
Topic 274 20.43 Topic 299 29.02
−1
Topic 275 13.92 Topic 300 0.03 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.211
tlr tlrTDfr2ptRFS1 AH-Bilingual-X2PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual French to Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TD
Relevant retrieved 2,009 Pooled= true
CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 60.81 tlrTDfr2ptRFS1
90%
10 45.82
20 38.58 80%
30 30.58
70%
40 26.93
50 21.79
Average Precision
60%
60 17.24
50%
70 13.67
80 10.76 40%
90 6.37
30%
100 3.70
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
23.58
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 42.80 tlrTDfr2ptRFS1
90%
10 docs 40.20
15 docs 37.87 80%
20 docs 35.60
70%
30 docs 31.20
100 docs 19.68 60%
R−Precision
200 docs 13.07
50%
500 docs 6.91
1000 docs 4.02 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
26.89 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275)
queries 1
tlrTDfr2ptRFS1
Topic 251 29.57 Topic 276 15.72
Difference (average precision)
Topic 252 4.95 Topic 277 3.56 0.5
Topic 253 23.48 Topic 278 10.18
Topic 254 12.91 Topic 279 45.78
Topic 255 9.18 Topic 280 1.05 0
Topic 256 97.53 Topic 281 57.81
Topic 257 24.20 Topic 282 20.59
−0.5
Topic 258 0.45 Topic 283 5.20
Topic 259 16.47 Topic 284 20.50
Topic 260 37.73 Topic 285 11.59 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.41 Topic 286 16.49 Topic Number
Topic 262 0.62 Topic 287 7.05
Topic 263 1.20 Topic 288 0.60
CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300)
Topic 264 23.50 Topic 289 47.68 1
Topic 265 28.30 Topic 290 22.30 tlrTDfr2ptRFS1
Difference (average precision)
Topic 266 1.26 Topic 291 45.33
0.5
Topic 267 13.57 Topic 292 14.88
Topic 268 48.70 Topic 293 61.94
Topic 269 4.61 Topic 294 44.77 0
Topic 270 15.54 Topic 295 19.79
Topic 271 30.34 Topic 296 42.93
Topic 272 30.86 Topic 297 44.05 −0.5
Topic 273 37.85 Topic 298 50.77
Topic 274 4.52 Topic 299 51.34
−1
Topic 275 19.58 Topic 300 0.00 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.212
u.glasgow glaespttd AH-Bilingual-X2PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual Spanish to Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TD
Relevant retrieved 869 Pooled= true
CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 33.98 glaespttd
90%
10 22.46
20 14.49 80%
30 11.19
70%
40 8.84
50 7.07
Average Precision
60%
60 4.79
50%
70 4.37
80 3.36 40%
90 2.71
30%
100 2.07
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
9.28
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 20.40 glaespttd
90%
10 docs 18.40
15 docs 16.67 80%
20 docs 15.30
70%
30 docs 12.73
100 docs 7.78 60%
R−Precision
200 docs 5.14
50%
500 docs 2.77
1000 docs 1.74 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
11.69 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275)
queries 1
glaespttd
Topic 251 29.48 Topic 276 0.18
Difference (average precision)
Topic 252 0.00 Topic 277 0.00 0.5
Topic 253 0.18 Topic 278 0.00
Topic 254 38.83 Topic 279 0.00
Topic 255 33.83 Topic 280 1.29 0
Topic 256 89.97 Topic 281 28.74
Topic 257 0.14 Topic 282 3.18
−0.5
Topic 258 0.00 Topic 283 5.33
Topic 259 0.22 Topic 284 0.00
Topic 260 14.16 Topic 285 0.15 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 6.31 Topic 286 3.62 Topic Number
Topic 262 0.00 Topic 287 0.00
Topic 263 0.31 Topic 288 3.24
CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300)
Topic 264 1.05 Topic 289 8.02 1
Topic 265 24.43 Topic 290 0.00 glaespttd
Difference (average precision)
Topic 266 0.02 Topic 291 1.93
0.5
Topic 267 0.13 Topic 292 4.58
Topic 268 1.76 Topic 293 30.19
Topic 269 1.69 Topic 294 6.61 0
Topic 270 18.86 Topic 295 0.23
Topic 271 0.04 Topic 296 44.61
Topic 272 19.59 Topic 297 5.56 −0.5
Topic 273 12.26 Topic 298 3.35
Topic 274 18.69 Topic 299 0.01
−1
Topic 275 0.79 Topic 300 0.59 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.213
u.glasgow glaespttdn AH-Bilingual-X2PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual Spanish to Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TDN
Relevant retrieved 924 Pooled= true
CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 39.96 glaespttdn
90%
10 28.46
20 16.87 80%
30 11.48
70%
40 9.32
50 7.38
Average Precision
60%
60 5.14
50%
70 4.73
80 3.16 40%
90 2.56
30%
100 1.13
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
10.55
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 24.00 glaespttdn
90%
10 docs 21.60
15 docs 18.40 80%
20 docs 16.50
70%
30 docs 14.33
100 docs 8.36 60%
R−Precision
200 docs 5.49
50%
500 docs 2.98
1000 docs 1.85 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
12.47 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275)
queries 1
glaespttdn
Topic 251 16.47 Topic 276 0.23
Difference (average precision)
Topic 252 0.00 Topic 277 0.00 0.5
Topic 253 0.06 Topic 278 0.02
Topic 254 41.04 Topic 279 0.00
Topic 255 21.20 Topic 280 10.36 0
Topic 256 89.54 Topic 281 46.55
Topic 257 1.41 Topic 282 6.38
−0.5
Topic 258 0.00 Topic 283 3.41
Topic 259 27.22 Topic 284 0.00
Topic 260 6.47 Topic 285 0.01 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 11.18 Topic 286 0.40 Topic Number
Topic 262 0.00 Topic 287 0.00
Topic 263 0.09 Topic 288 5.94
CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300)
Topic 264 1.44 Topic 289 16.67 1
Topic 265 19.92 Topic 290 0.00 glaespttdn
Difference (average precision)
Topic 266 0.01 Topic 291 1.99
0.5
Topic 267 0.12 Topic 292 4.18
Topic 268 1.32 Topic 293 27.43
Topic 269 1.06 Topic 294 12.97 0
Topic 270 14.99 Topic 295 8.61
Topic 271 0.03 Topic 296 47.65
Topic 272 8.02 Topic 297 3.54 −0.5
Topic 273 13.70 Topic 298 4.17
Topic 274 18.35 Topic 299 0.05
−1
Topic 275 33.03 Topic 300 0.13 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.214
u.glasgow glaespttdnqe AH-Bilingual-X2PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual Spanish to Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TDN
Relevant retrieved 1,286 Pooled= false
CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 40.18 glaespttdnqe
90%
10 35.44
20 23.81 80%
30 20.07
70%
40 16.63
50 13.56
Average Precision
60%
60 9.99
50%
70 8.89
80 6.62 40%
90 4.50
30%
100 3.13
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
15.65
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 26.80 glaespttdnqe
90%
10 docs 25.20
15 docs 23.07 80%
20 docs 21.90
70%
30 docs 19.73
100 docs 11.38 60%
R−Precision
200 docs 7.97
50%
500 docs 4.26
1000 docs 2.57 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
16.39 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275)
queries 1
glaespttdnqe
Topic 251 27.73 Topic 276 0.17
Difference (average precision)
Topic 252 0.00 Topic 277 0.00 0.5
Topic 253 0.01 Topic 278 0.03
Topic 254 51.02 Topic 279 0.00
Topic 255 18.36 Topic 280 25.93 0
Topic 256 91.83 Topic 281 48.80
Topic 257 15.72 Topic 282 18.35
−0.5
Topic 258 0.00 Topic 283 53.75
Topic 259 40.97 Topic 284 0.00
Topic 260 7.24 Topic 285 0.00 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 9.34 Topic 286 2.46 Topic Number
Topic 262 0.01 Topic 287 0.00
Topic 263 0.02 Topic 288 4.49
CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300)
Topic 264 2.62 Topic 289 50.15 1
Topic 265 27.61 Topic 290 0.00 glaespttdnqe
Difference (average precision)
Topic 266 0.00 Topic 291 17.26
0.5
Topic 267 0.01 Topic 292 0.90
Topic 268 0.64 Topic 293 36.63
Topic 269 0.17 Topic 294 41.57 0
Topic 270 17.66 Topic 295 23.98
Topic 271 0.01 Topic 296 51.21
Topic 272 1.26 Topic 297 5.13 −0.5
Topic 273 20.46 Topic 298 8.51
Topic 274 17.84 Topic 299 0.03
−1
Topic 275 42.56 Topic 300 0.12 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.215
unine UniNEbipt1 AH-Bilingual-X2PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TD
Relevant retrieved 2,385 Pooled= true
CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 74.85 UniNEbipt1
90%
10 59.44
20 52.68 80%
30 44.96
70%
40 37.67
50 32.19
Average Precision
60%
60 27.95
50%
70 23.79
80 19.04 40%
90 12.15
30%
100 5.73
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
34.04
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 55.60 UniNEbipt1
90%
10 docs 49.80
15 docs 45.20 80%
20 docs 43.60
70%
30 docs 39.40
100 docs 24.00 60%
R−Precision
200 docs 16.10
50%
500 docs 8.42
1000 docs 4.77 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
34.26 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275)
queries 1
UniNEbipt1
Topic 251 46.45 Topic 276 41.49
Difference (average precision)
Topic 252 9.28 Topic 277 10.64 0.5
Topic 253 12.75 Topic 278 51.89
Topic 254 66.46 Topic 279 63.32
Topic 255 36.48 Topic 280 20.06 0
Topic 256 95.97 Topic 281 74.15
Topic 257 23.46 Topic 282 20.09
−0.5
Topic 258 0.45 Topic 283 63.85
Topic 259 42.75 Topic 284 20.55
Topic 260 56.30 Topic 285 40.65 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 11.03 Topic 286 7.32 Topic Number
Topic 262 2.69 Topic 287 4.39
Topic 263 16.33 Topic 288 1.11
CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300)
Topic 264 63.54 Topic 289 40.01 1
Topic 265 0.12 Topic 290 9.95 UniNEbipt1
Difference (average precision)
Topic 266 30.72 Topic 291 30.82
0.5
Topic 267 19.50 Topic 292 36.67
Topic 268 55.87 Topic 293 73.48
Topic 269 11.65 Topic 294 65.83 0
Topic 270 21.00 Topic 295 50.64
Topic 271 61.11 Topic 296 49.55
Topic 272 26.14 Topic 297 48.60 −0.5
Topic 273 48.35 Topic 298 39.73
Topic 274 7.86 Topic 299 31.15
−1
Topic 275 33.40 Topic 300 6.34 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.216
unine UniNEbipt2 AH-Bilingual-X2PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TD
Relevant retrieved 2,231 Pooled= false
CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 77.59 UniNEbipt2
90%
10 59.06
20 49.30 80%
30 40.55
70%
40 34.49
50 28.96
Average Precision
60%
60 22.85
50%
70 19.08
80 14.48 40%
90 9.56
30%
100 4.86
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
30.94
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 52.80 UniNEbipt2
90%
10 docs 48.00
15 docs 43.87 80%
20 docs 41.60
70%
30 docs 36.87
100 docs 22.76 60%
R−Precision
200 docs 14.95
50%
500 docs 7.87
1000 docs 4.46 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
32.32 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275)
queries 1
UniNEbipt2
Topic 251 45.83 Topic 276 30.84
Difference (average precision)
Topic 252 8.30 Topic 277 8.75 0.5
Topic 253 17.42 Topic 278 36.20
Topic 254 63.33 Topic 279 57.62
Topic 255 35.45 Topic 280 7.54 0
Topic 256 96.93 Topic 281 71.07
Topic 257 22.98 Topic 282 17.63
−0.5
Topic 258 0.63 Topic 283 37.21
Topic 259 45.15 Topic 284 18.09
Topic 260 46.22 Topic 285 40.63 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 6.20 Topic 286 4.53 Topic Number
Topic 262 5.50 Topic 287 4.74
Topic 263 14.49 Topic 288 1.74
CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300)
Topic 264 50.26 Topic 289 48.48 1
Topic 265 5.59 Topic 290 4.57 UniNEbipt2
Difference (average precision)
Topic 266 29.95 Topic 291 29.34
0.5
Topic 267 22.91 Topic 292 35.33
Topic 268 41.52 Topic 293 68.45
Topic 269 12.71 Topic 294 68.42 0
Topic 270 19.59 Topic 295 37.67
Topic 271 60.07 Topic 296 46.48
Topic 272 28.73 Topic 297 42.56 −0.5
Topic 273 41.99 Topic 298 40.74
Topic 274 9.91 Topic 299 25.34
−1
Topic 275 28.11 Topic 300 3.37 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.217
unine UniNEbipt3 AH-Bilingual-X2PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TD
Relevant retrieved 2,199 Pooled= false
CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 76.01 UniNEbipt3
90%
10 60.01
20 49.93 80%
30 41.40
70%
40 34.34
50 29.34
Average Precision
60%
60 23.37
50%
70 19.24
80 14.88 40%
90 9.28
30%
100 4.90
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
31.17
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 54.00 UniNEbipt3
90%
10 docs 48.40
15 docs 45.33 80%
20 docs 41.70
70%
30 docs 37.27
100 docs 22.52 60%
R−Precision
200 docs 14.70
50%
500 docs 7.78
1000 docs 4.40 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
32.57 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275)
queries 1
UniNEbipt3
Topic 251 43.32 Topic 276 33.27
Difference (average precision)
Topic 252 11.38 Topic 277 7.54 0.5
Topic 253 12.73 Topic 278 47.78
Topic 254 55.22 Topic 279 57.85
Topic 255 35.05 Topic 280 22.53 0
Topic 256 96.24 Topic 281 71.32
Topic 257 21.99 Topic 282 18.15
−0.5
Topic 258 0.63 Topic 283 47.19
Topic 259 45.21 Topic 284 19.28
Topic 260 45.58 Topic 285 39.49 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 8.48 Topic 286 5.42 Topic Number
Topic 262 3.23 Topic 287 4.30
Topic 263 14.93 Topic 288 1.32
CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300)
Topic 264 55.71 Topic 289 46.20 1
Topic 265 0.20 Topic 290 6.70 UniNEbipt3
Difference (average precision)
Topic 266 25.52 Topic 291 30.95
0.5
Topic 267 21.01 Topic 292 34.50
Topic 268 49.38 Topic 293 69.54
Topic 269 12.76 Topic 294 67.95 0
Topic 270 20.12 Topic 295 43.14
Topic 271 58.26 Topic 296 46.50
Topic 272 25.50 Topic 297 42.48 −0.5
Topic 273 39.85 Topic 298 36.14
Topic 274 8.92 Topic 299 21.84
−1
Topic 275 23.45 Topic 300 2.65 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.218
xldb XLDBTumba03 AH-Bilingual-X2PT
Overall statistics for 29 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to Portuguese
Retrieved 4,875 RunType= automatic
Relevant 1,991 QueryType= TDN
Relevant retrieved 605 Pooled= true
CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 29.69 XLDBTumba03
90%
10 18.14
20 11.87 80%
30 6.64
70%
40 4.71
50 2.99
Average Precision
60%
60 1.45
50%
70 0.84
80 0.53 40%
90 0.37
30%
100 0.00
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
5.75
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 17.20 XLDBTumba03
90%
10 docs 15.60
15 docs 14.13 80%
20 docs 12.70
70%
30 docs 11.40
100 docs 7.14 60%
R−Precision
200 docs 4.47
50%
500 docs 2.15
1000 docs 1.21 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
8.05 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275)
queries 1
XLDBTumba03
Topic 251 20.53 Topic 276 0.00
Difference (average precision)
Topic 252 5.23 Topic 277 7.92 0.5
Topic 253 3.97 Topic 278 0.00
Topic 254 6.82 Topic 279 0.00
Topic 255 0.00 Topic 280 3.92 0
Topic 256 0.00 Topic 281 33.01
Topic 257 0.58 Topic 282 0.00
−0.5
Topic 258 0.00 Topic 283 0.00
Topic 259 0.00 Topic 284 0.21
Topic 260 0.00 Topic 285 0.00 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.00 Topic 286 17.83 Topic Number
Topic 262 0.00 Topic 287 0.00
Topic 263 0.00 Topic 288 0.00
CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300)
Topic 264 0.00 Topic 289 26.98 1
Topic 265 0.00 Topic 290 0.00 XLDBTumba03
Difference (average precision)
Topic 266 0.00 Topic 291 1.05
0.5
Topic 267 0.00 Topic 292 0.00
Topic 268 25.95 Topic 293 36.62
Topic 269 5.97 Topic 294 0.00 0
Topic 270 0.00 Topic 295 47.70
Topic 271 0.00 Topic 296 2.04
Topic 272 0.06 Topic 297 0.00 −0.5
Topic 273 15.08 Topic 298 19.15
Topic 274 0.00 Topic 299 6.72
−1
Topic 275 0.00 Topic 300 0.00 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.219
xldb XLDBTumba04 AH-Bilingual-X2PT
Overall statistics for 33 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to Portuguese
Retrieved 6,774 RunType= automatic
Relevant 2,156 QueryType= TDN
Relevant retrieved 299 Pooled= false
CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 31.82 XLDBTumba04
90%
10 16.17
20 10.25 80%
30 6.08
70%
40 3.36
50 2.98
Average Precision
60%
60 2.50
50%
70 2.49
80 0.43 40%
90 0.38
30%
100 0.00
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
5.53
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 21.60 XLDBTumba04
90%
10 docs 17.20
15 docs 14.53 80%
20 docs 12.80
70%
30 docs 10.20
100 docs 4.22 60%
R−Precision
200 docs 2.51
50%
500 docs 1.14
1000 docs 0.60 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
7.40 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275)
queries 1
XLDBTumba04
Topic 251 18.92 Topic 276 0.02
Difference (average precision)
Topic 252 0.94 Topic 277 0.00 0.5
Topic 253 1.59 Topic 278 0.00
Topic 254 18.91 Topic 279 0.00
Topic 255 0.00 Topic 280 2.90 0
Topic 256 75.00 Topic 281 32.69
Topic 257 0.00 Topic 282 0.49
−0.5
Topic 258 0.00 Topic 283 0.00
Topic 259 5.00 Topic 284 0.00
Topic 260 0.00 Topic 285 0.00 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.00 Topic 286 0.08 Topic Number
Topic 262 4.55 Topic 287 1.07
Topic 263 0.00 Topic 288 0.12
CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300)
Topic 264 0.00 Topic 289 28.89 1
Topic 265 0.00 Topic 290 0.00 XLDBTumba04
Difference (average precision)
Topic 266 3.45 Topic 291 0.48
0.5
Topic 267 0.83 Topic 292 0.00
Topic 268 0.00 Topic 293 12.55
Topic 269 0.00 Topic 294 26.59 0
Topic 270 20.17 Topic 295 5.68
Topic 271 1.54 Topic 296 0.00
Topic 272 0.00 Topic 297 0.00 −0.5
Topic 273 9.87 Topic 298 0.26
Topic 274 0.00 Topic 299 0.00
−1
Topic 275 4.17 Topic 300 0.00 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.220
xldb XLDBTumba07 AH-Bilingual-X2PT
Overall statistics for 29 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to Portuguese
Retrieved 4,875 RunType= automatic
Relevant 1,991 QueryType= TDN
Relevant retrieved 617 Pooled= false
CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 22.13 XLDBTumba07
90%
10 13.90
20 9.22 80%
30 5.79
70%
40 4.17
50 3.20
Average Precision
60%
60 1.88
50%
70 1.52
80 0.72 40%
90 0.41
30%
100 0.00
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
4.71
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 13.60 XLDBTumba07
90%
10 docs 11.60
15 docs 11.33 80%
20 docs 11.10
70%
30 docs 9.73
100 docs 6.68 60%
R−Precision
200 docs 4.58
50%
500 docs 2.24
1000 docs 1.23 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
7.24 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275)
queries 1
XLDBTumba07
Topic 251 18.40 Topic 276 0.00
Difference (average precision)
Topic 252 3.47 Topic 277 5.94 0.5
Topic 253 2.52 Topic 278 0.00
Topic 254 5.76 Topic 279 0.00
Topic 255 0.00 Topic 280 1.60 0
Topic 256 0.00 Topic 281 30.29
Topic 257 0.58 Topic 282 0.00
−0.5
Topic 258 0.00 Topic 283 0.00
Topic 259 0.00 Topic 284 0.21
Topic 260 0.00 Topic 285 0.00 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.00 Topic 286 20.61 Topic Number
Topic 262 0.00 Topic 287 0.00
Topic 263 0.00 Topic 288 0.00
CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300)
Topic 264 0.00 Topic 289 28.89 1
Topic 265 0.00 Topic 290 0.00 XLDBTumba07
Difference (average precision)
Topic 266 0.00 Topic 291 0.64
0.5
Topic 267 0.00 Topic 292 0.00
Topic 268 11.54 Topic 293 26.33
Topic 269 4.89 Topic 294 0.00 0
Topic 270 0.00 Topic 295 38.90
Topic 271 0.00 Topic 296 2.04
Topic 272 0.30 Topic 297 0.00 −0.5
Topic 273 10.83 Topic 298 16.84
Topic 274 0.00 Topic 299 5.01
−1
Topic 275 0.00 Topic 300 0.00 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.221
xldb XLDBTumba08 AH-Bilingual-X2PT
Overall statistics for 33 queries : General info:
Total number of documents over all queries Track= Ad Hoc Bilingual English to Portuguese
Retrieved 6,774 RunType= automatic
Relevant 2,156 QueryType= TDN
Relevant retrieved 301 Pooled= false
CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 30.70 XLDBTumba08
90%
10 13.68
20 9.85 80%
30 5.85
70%
40 3.22
50 3.10
Average Precision
60%
60 2.72
50%
70 2.70
80 0.67 40%
90 0.45
30%
100 0.00
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
5.32
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 19.60 XLDBTumba08
90%
10 docs 14.80
15 docs 12.27 80%
20 docs 11.50
70%
30 docs 9.47
100 docs 4.52 60%
R−Precision
200 docs 2.73
50%
500 docs 1.16
1000 docs 0.60 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
7.43 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275)
queries 1
XLDBTumba08
Topic 251 15.86 Topic 276 0.07
Difference (average precision)
Topic 252 0.90 Topic 277 0.00 0.5
Topic 253 1.05 Topic 278 0.00
Topic 254 19.41 Topic 279 0.00
Topic 255 0.00 Topic 280 2.95 0
Topic 256 75.00 Topic 281 35.64
Topic 257 0.00 Topic 282 0.71
−0.5
Topic 258 0.00 Topic 283 0.00
Topic 259 7.46 Topic 284 0.00
Topic 260 0.00 Topic 285 0.00 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.00 Topic 286 0.10 Topic Number
Topic 262 1.09 Topic 287 1.07
Topic 263 0.00 Topic 288 0.15
CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300)
Topic 264 0.00 Topic 289 30.56 1
Topic 265 0.00 Topic 290 0.00 XLDBTumba08
Difference (average precision)
Topic 266 3.45 Topic 291 0.56
0.5
Topic 267 0.83 Topic 292 0.00
Topic 268 0.00 Topic 293 9.44
Topic 269 0.00 Topic 294 20.61 0
Topic 270 16.81 Topic 295 4.45
Topic 271 4.42 Topic 296 0.00
Topic 272 0.00 Topic 297 0.00 −0.5
Topic 273 8.62 Topic 298 0.27
Topic 274 0.00 Topic 299 0.00
−1
Topic 275 4.39 Topic 300 0.00 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.222
alicante IRn-bu-fexp AH-Monolingual-BG
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Bulgarian
Retrieved 50,000 RunType= automatic
Relevant 778 QueryType= TD
Relevant retrieved 596 Pooled= true
CLEF 2005 AH−Monolingual−BG − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 45.55 IRn−bu−fexp
90%
10 36.86
20 27.63 80%
30 21.48
70%
40 19.63
50 17.85
Average Precision
60%
60 11.51
50%
70 10.04
80 8.12 40%
90 6.37
30%
100 4.89
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
17.58
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−BG − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 21.20 IRn−bu−fexp
90%
10 docs 18.80
15 docs 16.40 80%
20 docs 13.80
70%
30 docs 12.13
100 docs 6.68 60%
R−Precision
200 docs 4.14
50%
500 docs 2.12
1000 docs 1.19 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
17.54 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 251 to 275)
queries 1
IRn−bu−fexp
Topic 251 22.96 Topic 276 13.16
Difference (average precision)
Topic 252 3.85 Topic 277 0.05 0.5
Topic 253 29.31 Topic 278 18.33
Topic 254 5.67 Topic 279 17.12
Topic 255 2.97 Topic 280 6.60 0
Topic 256 64.29 Topic 281 45.65
Topic 257 9.44 Topic 282 7.38
−0.5
Topic 258 9.09 Topic 283 45.08
Topic 259 60.74 Topic 284 13.15
Topic 260 10.75 Topic 285 34.72 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 17.20 Topic 286 6.36 Topic Number
Topic 262 7.10 Topic 287 27.60
Topic 263 3.02 Topic 288 2.42
CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 276 to 300)
Topic 264 0.57 Topic 289 61.11 1
Topic 265 16.88 Topic 290 32.79 IRn−bu−fexp
Difference (average precision)
Topic 266 17.02 Topic 291 40.31
0.5
Topic 267 10.65 Topic 292 0.00
Topic 268 45.24 Topic 293 52.68
Topic 269 0.13 Topic 294 23.18 0
Topic 270 3.94 Topic 295 3.83
Topic 271 0.00 Topic 296 2.94
Topic 272 14.29 Topic 297 2.86 −0.5
Topic 273 18.18 Topic 298 0.06
Topic 274 2.49 Topic 299 0.11
−1
Topic 275 13.34 Topic 300 32.35 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.223
alicante IRn-bu-vexp AH-Monolingual-BG
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Bulgarian
Retrieved 50,000 RunType= automatic
Relevant 778 QueryType= TD
Relevant retrieved 597 Pooled= true
CLEF 2005 AH−Monolingual−BG − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 44.97 IRn−bu−vexp
90%
10 35.95
20 28.22 80%
30 21.44
70%
40 19.72
50 17.87
Average Precision
60%
60 11.48
50%
70 10.18
80 8.16 40%
90 6.39
30%
100 4.87
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
17.46
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−BG − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 20.00 IRn−bu−vexp
90%
10 docs 18.80
15 docs 16.27 80%
20 docs 13.80
70%
30 docs 12.33
100 docs 6.74 60%
R−Precision
200 docs 4.16
50%
500 docs 2.12
1000 docs 1.19 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
17.17 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 251 to 275)
queries 1
IRn−bu−vexp
Topic 251 25.64 Topic 276 13.16
Difference (average precision)
Topic 252 3.83 Topic 277 0.05 0.5
Topic 253 29.13 Topic 278 16.65
Topic 254 5.57 Topic 279 17.12
Topic 255 2.97 Topic 280 5.59 0
Topic 256 64.29 Topic 281 45.65
Topic 257 9.44 Topic 282 7.38
−0.5
Topic 258 8.33 Topic 283 45.08
Topic 259 60.74 Topic 284 13.15
Topic 260 10.74 Topic 285 34.72 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 15.39 Topic 286 6.37 Topic Number
Topic 262 6.83 Topic 287 27.60
Topic 263 3.02 Topic 288 2.35
CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 276 to 300)
Topic 264 0.57 Topic 289 61.11 1
Topic 265 17.97 Topic 290 30.71 IRn−bu−vexp
Difference (average precision)
Topic 266 16.90 Topic 291 40.32
0.5
Topic 267 10.48 Topic 292 0.00
Topic 268 45.20 Topic 293 52.68
Topic 269 0.10 Topic 294 23.06 0
Topic 270 3.92 Topic 295 3.80
Topic 271 0.00 Topic 296 2.94
Topic 272 14.29 Topic 297 2.86 −0.5
Topic 273 18.17 Topic 298 0.06
Topic 274 2.49 Topic 299 0.11
−1
Topic 275 12.29 Topic 300 32.35 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.224
alicante IRn-bu-vnexp AH-Monolingual-BG
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Bulgarian
Retrieved 50,000 RunType= automatic
Relevant 778 QueryType= TD
Relevant retrieved 603 Pooled= false
CLEF 2005 AH−Monolingual−BG − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 43.79 IRn−bu−vnexp
90%
10 37.31
20 28.46 80%
30 23.64
70%
40 21.33
50 19.22
Average Precision
60%
60 11.70
50%
70 9.99
80 8.73 40%
90 6.71
30%
100 5.39
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
17.87
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−BG − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 21.60 IRn−bu−vnexp
90%
10 docs 18.00
15 docs 16.13 80%
20 docs 15.00
70%
30 docs 13.07
100 docs 6.98 60%
R−Precision
200 docs 4.25
50%
500 docs 2.11
1000 docs 1.21 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
19.65 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 251 to 275)
queries 1
IRn−bu−vnexp
Topic 251 17.72 Topic 276 6.98
Difference (average precision)
Topic 252 5.57 Topic 277 0.44 0.5
Topic 253 28.43 Topic 278 33.51
Topic 254 7.07 Topic 279 23.04
Topic 255 2.34 Topic 280 1.17 0
Topic 256 45.00 Topic 281 40.99
Topic 257 5.75 Topic 282 19.89
−0.5
Topic 258 10.00 Topic 283 39.51
Topic 259 53.35 Topic 284 13.05
Topic 260 12.01 Topic 285 51.39 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 13.27 Topic 286 5.00 Topic Number
Topic 262 8.82 Topic 287 21.59
Topic 263 3.54 Topic 288 0.61
CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 276 to 300)
Topic 264 1.74 Topic 289 64.29 1
Topic 265 25.30 Topic 290 40.41 IRn−bu−vnexp
Difference (average precision)
Topic 266 12.37 Topic 291 40.69
0.5
Topic 267 14.93 Topic 292 0.00
Topic 268 46.19 Topic 293 58.13
Topic 269 1.09 Topic 294 21.86 0
Topic 270 2.23 Topic 295 8.11
Topic 271 0.00 Topic 296 16.67
Topic 272 2.38 Topic 297 7.09 −0.5
Topic 273 14.42 Topic 298 0.73
Topic 274 2.80 Topic 299 0.53
−1
Topic 275 26.67 Topic 300 15.06 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.225
hildesheim UHIBG1 AH-Monolingual-BG
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Bulgarian
Retrieved 50,000 RunType= automatic
Relevant 778 QueryType= TD
Relevant retrieved 587 Pooled= true
CLEF 2005 AH−Monolingual−BG − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 49.97 UHIBG1
90%
10 41.48
20 31.25 80%
30 24.09
70%
40 19.97
50 17.68
Average Precision
60%
60 13.53
50%
70 10.69
80 8.02 40%
90 6.13
30%
100 4.58
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
18.87
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−BG − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 23.60 UHIBG1
90%
10 docs 22.60
15 docs 19.07 80%
20 docs 16.60
70%
30 docs 13.53
100 docs 7.46 60%
R−Precision
200 docs 4.64
50%
500 docs 2.17
1000 docs 1.17 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
19.96 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 251 to 275)
queries 1
UHIBG1
Topic 251 19.57 Topic 276 10.03
Difference (average precision)
Topic 252 2.36 Topic 277 24.44 0.5
Topic 253 13.02 Topic 278 24.57
Topic 254 28.66 Topic 279 64.06
Topic 255 20.83 Topic 280 0.02 0
Topic 256 41.67 Topic 281 30.54
Topic 257 7.33 Topic 282 23.24
−0.5
Topic 258 2.38 Topic 283 55.45
Topic 259 2.99 Topic 284 1.24
Topic 260 19.47 Topic 285 31.67 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 38.03 Topic 286 6.03 Topic Number
Topic 262 30.88 Topic 287 16.41
Topic 263 2.31 Topic 288 4.80
CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 276 to 300)
Topic 264 26.45 Topic 289 39.29 1
Topic 265 18.23 Topic 290 41.04 UHIBG1
Difference (average precision)
Topic 266 2.15 Topic 291 42.83
0.5
Topic 267 15.11 Topic 292 0.00
Topic 268 45.10 Topic 293 0.05
Topic 269 10.95 Topic 294 45.26 0
Topic 270 1.78 Topic 295 0.83
Topic 271 36.11 Topic 296 0.25
Topic 272 1.32 Topic 297 1.38 −0.5
Topic 273 21.87 Topic 298 2.72
Topic 274 3.00 Topic 299 9.58
−1
Topic 275 24.33 Topic 300 31.89 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.226
hildesheim UHIBG2 AH-Monolingual-BG
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Bulgarian
Retrieved 50,000 RunType= automatic
Relevant 778 QueryType= TD
Relevant retrieved 597 Pooled= true
CLEF 2005 AH−Monolingual−BG − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 48.12 UHIBG2
90%
10 40.31
20 33.38 80%
30 26.23
70%
40 20.89
50 17.42
Average Precision
60%
60 13.95
50%
70 11.26
80 9.22 40%
90 6.89
30%
100 4.78
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
19.46
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−BG − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 23.60 UHIBG2
90%
10 docs 22.20
15 docs 19.20 80%
20 docs 17.30
70%
30 docs 15.27
100 docs 7.62 60%
R−Precision
200 docs 4.75
50%
500 docs 2.19
1000 docs 1.19 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
19.77 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 251 to 275)
queries 1
UHIBG2
Topic 251 23.50 Topic 276 12.45
Difference (average precision)
Topic 252 3.73 Topic 277 27.00 0.5
Topic 253 9.95 Topic 278 14.80
Topic 254 31.28 Topic 279 62.21
Topic 255 38.89 Topic 280 0.02 0
Topic 256 36.67 Topic 281 34.11
Topic 257 9.30 Topic 282 23.00
−0.5
Topic 258 14.29 Topic 283 12.07
Topic 259 38.35 Topic 284 1.49
Topic 260 17.67 Topic 285 25.96 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 44.12 Topic 286 5.31 Topic Number
Topic 262 47.50 Topic 287 13.47
Topic 263 2.71 Topic 288 0.15
CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 276 to 300)
Topic 264 20.77 Topic 289 39.29 1
Topic 265 17.15 Topic 290 41.11 UHIBG2
Difference (average precision)
Topic 266 1.38 Topic 291 40.89
0.5
Topic 267 18.49 Topic 292 0.00
Topic 268 41.43 Topic 293 1.87
Topic 269 18.54 Topic 294 60.01 0
Topic 270 1.85 Topic 295 1.09
Topic 271 36.11 Topic 296 0.17
Topic 272 9.09 Topic 297 3.42 −0.5
Topic 273 23.33 Topic 298 2.88
Topic 274 2.92 Topic 299 8.33
−1
Topic 275 25.65 Topic 300 7.16 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.227
hummingbird humBG05t AH-Monolingual-BG
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Bulgarian
Retrieved 42,603 RunType= automatic
Relevant 778 QueryType= T
Relevant retrieved 582 Pooled= true
CLEF 2005 AH−Monolingual−BG − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 50.90 humBG05t
90%
10 45.38
20 37.35 80%
30 33.52
70%
40 29.37
50 25.50
Average Precision
60%
60 19.21
50%
70 17.97
80 16.36 40%
90 12.38
30%
100 10.73
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
25.36
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−BG − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 30.40 humBG05t
90%
10 docs 22.00
15 docs 18.93 80%
20 docs 17.30
70%
30 docs 15.20
100 docs 7.72 60%
R−Precision
200 docs 4.65
50%
500 docs 2.16
1000 docs 1.16 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
25.40 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 251 to 275)
queries 1
humBG05t
Topic 251 19.60 Topic 276 8.66
Difference (average precision)
Topic 252 6.63 Topic 277 49.65 0.5
Topic 253 24.01 Topic 278 42.67
Topic 254 5.52 Topic 279 82.38
Topic 255 33.93 Topic 280 8.26 0
Topic 256 39.29 Topic 281 33.28
Topic 257 4.75 Topic 282 16.46
−0.5
Topic 258 50.00 Topic 283 32.42
Topic 259 96.17 Topic 284 13.93
Topic 260 16.56 Topic 285 58.89 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 3.99 Topic 286 3.01 Topic Number
Topic 262 58.96 Topic 287 24.05
Topic 263 2.37 Topic 288 1.98
CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 276 to 300)
Topic 264 11.56 Topic 289 55.88 1
Topic 265 27.16 Topic 290 41.45 humBG05t
Difference (average precision)
Topic 266 7.91 Topic 291 42.56
0.5
Topic 267 0.43 Topic 292 0.00
Topic 268 58.45 Topic 293 25.38
Topic 269 8.41 Topic 294 28.36 0
Topic 270 0.86 Topic 295 38.75
Topic 271 100.00 Topic 296 6.25
Topic 272 25.00 Topic 297 5.69 −0.5
Topic 273 5.77 Topic 298 3.96
Topic 274 14.08 Topic 299 0.26
−1
Topic 275 18.58 Topic 300 3.85 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.228
hummingbird humBG05td AH-Monolingual-BG
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Bulgarian
Retrieved 50,000 RunType= automatic
Relevant 778 QueryType= TD
Relevant retrieved 685 Pooled= true
CLEF 2005 AH−Monolingual−BG − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 57.74 humBG05td
90%
10 52.88
20 45.30 80%
30 36.26
70%
40 30.39
50 27.05
Average Precision
60%
60 18.79
50%
70 16.25
80 14.11 40%
90 9.36
30%
100 8.07
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
26.95
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−BG − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 30.00 humBG05td
90%
10 docs 26.00
15 docs 24.13 80%
20 docs 21.90
70%
30 docs 17.80
100 docs 9.00 60%
R−Precision
200 docs 5.37
50%
500 docs 2.47
1000 docs 1.37 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
25.78 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 251 to 275)
queries 1
humBG05td
Topic 251 27.18 Topic 276 10.76
Difference (average precision)
Topic 252 7.61 Topic 277 11.54 0.5
Topic 253 22.98 Topic 278 7.13
Topic 254 18.35 Topic 279 80.24
Topic 255 38.10 Topic 280 5.92 0
Topic 256 66.67 Topic 281 39.90
Topic 257 20.17 Topic 282 34.94
−0.5
Topic 258 25.00 Topic 283 40.24
Topic 259 70.51 Topic 284 13.59
Topic 260 31.34 Topic 285 68.06 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 17.71 Topic 286 16.09 Topic Number
Topic 262 55.25 Topic 287 24.35
Topic 263 2.37 Topic 288 2.84
CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 276 to 300)
Topic 264 16.67 Topic 289 55.56 1
Topic 265 26.38 Topic 290 41.02 humBG05td
Difference (average precision)
Topic 266 13.65 Topic 291 37.77
0.5
Topic 267 8.01 Topic 292 0.00
Topic 268 43.34 Topic 293 53.69
Topic 269 3.46 Topic 294 58.33 0
Topic 270 1.74 Topic 295 42.19
Topic 271 32.50 Topic 296 4.76
Topic 272 50.00 Topic 297 3.36 −0.5
Topic 273 18.80 Topic 298 11.92
Topic 274 32.33 Topic 299 3.91
−1
Topic 275 14.40 Topic 300 14.77 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.229
hummingbird humBG05tde AH-Monolingual-BG
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Bulgarian
Retrieved 50,000 RunType= automatic
Relevant 778 QueryType= TD
Relevant retrieved 690 Pooled= true
CLEF 2005 AH−Monolingual−BG − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 57.51 humBG05tde
90%
10 49.98
20 45.39 80%
30 40.19
70%
40 34.99
50 30.25
Average Precision
60%
60 22.69
50%
70 20.62
80 16.69 40%
90 12.03
30%
100 9.73
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
29.18
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−BG − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 29.20 humBG05tde
90%
10 docs 26.60
15 docs 23.87 80%
20 docs 21.50
70%
30 docs 18.40
100 docs 9.48 60%
R−Precision
200 docs 5.63
50%
500 docs 2.60
1000 docs 1.38 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
27.45 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 251 to 275)
queries 1
humBG05tde
Topic 251 34.46 Topic 276 10.25
Difference (average precision)
Topic 252 9.09 Topic 277 1.42 0.5
Topic 253 22.73 Topic 278 1.98
Topic 254 32.36 Topic 279 86.26
Topic 255 39.39 Topic 280 6.30 0
Topic 256 66.67 Topic 281 41.19
Topic 257 26.40 Topic 282 36.78
−0.5
Topic 258 16.67 Topic 283 42.10
Topic 259 68.52 Topic 284 12.40
Topic 260 44.37 Topic 285 66.67 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 20.35 Topic 286 16.18 Topic Number
Topic 262 60.87 Topic 287 22.40
Topic 263 1.53 Topic 288 2.61
CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 276 to 300)
Topic 264 17.46 Topic 289 61.11 1
Topic 265 40.20 Topic 290 43.20 humBG05tde
Difference (average precision)
Topic 266 5.53 Topic 291 38.44
0.5
Topic 267 10.15 Topic 292 0.00
Topic 268 39.97 Topic 293 61.01
Topic 269 2.37 Topic 294 64.46 0
Topic 270 2.72 Topic 295 40.40
Topic 271 32.50 Topic 296 6.67
Topic 272 100.00 Topic 297 1.87 −0.5
Topic 273 27.48 Topic 298 5.16
Topic 274 34.81 Topic 299 1.76
−1
Topic 275 16.51 Topic 300 15.15 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.230
jhu-apl aplmobgc AH-Monolingual-BG
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Bulgarian
Retrieved 50,000 RunType= automatic
Relevant 778 QueryType= TD
Relevant retrieved 706 Pooled= true
CLEF 2005 AH−Monolingual−BG − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 62.03 aplmobgc
90%
10 54.20
20 45.14 80%
30 38.54
70%
40 33.58
50 30.96
Average Precision
60%
60 25.67
50%
70 22.18
80 18.44 40%
90 14.81
30%
100 11.68
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
30.58
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−BG − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 33.60 aplmobgc
90%
10 docs 30.80
15 docs 28.13 80%
20 docs 24.70
70%
30 docs 20.20
100 docs 9.78 60%
R−Precision
200 docs 5.76
50%
500 docs 2.65
1000 docs 1.41 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
30.05 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 251 to 275)
queries 1
aplmobgc
Topic 251 34.82 Topic 276 11.17
Difference (average precision)
Topic 252 10.07 Topic 277 36.14 0.5
Topic 253 24.02 Topic 278 42.77
Topic 254 42.42 Topic 279 62.87
Topic 255 42.86 Topic 280 1.36 0
Topic 256 45.00 Topic 281 44.10
Topic 257 21.39 Topic 282 14.63
−0.5
Topic 258 100.00 Topic 283 72.13
Topic 259 54.10 Topic 284 9.56
Topic 260 37.89 Topic 285 31.67 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 41.47 Topic 286 13.01 Topic Number
Topic 262 66.62 Topic 287 17.02
Topic 263 4.15 Topic 288 0.53
CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 276 to 300)
Topic 264 27.35 Topic 289 64.29 1
Topic 265 33.01 Topic 290 67.68 aplmobgc
Difference (average precision)
Topic 266 7.73 Topic 291 52.75
0.5
Topic 267 38.24 Topic 292 0.00
Topic 268 39.03 Topic 293 35.98
Topic 269 11.10 Topic 294 79.76 0
Topic 270 3.17 Topic 295 13.80
Topic 271 33.33 Topic 296 2.00
Topic 272 20.00 Topic 297 14.97 −0.5
Topic 273 31.80 Topic 298 2.12
Topic 274 20.23 Topic 299 4.95
−1
Topic 275 20.40 Topic 300 23.38 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.231
jhu-apl aplmobgd AH-Monolingual-BG
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Bulgarian
Retrieved 50,000 RunType= automatic
Relevant 778 QueryType= TD
Relevant retrieved 678 Pooled= true
CLEF 2005 AH−Monolingual−BG − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 61.64 aplmobgd
90%
10 56.97
20 47.43 80%
30 42.35
70%
40 37.63
50 34.34
Average Precision
60%
60 25.90
50%
70 22.13
80 18.46 40%
90 14.32
30%
100 10.91
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
32.03
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−BG − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 36.40 aplmobgd
90%
10 docs 30.80
15 docs 27.87 80%
20 docs 24.70
70%
30 docs 20.07
100 docs 9.54 60%
R−Precision
200 docs 5.72
50%
500 docs 2.54
1000 docs 1.36 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
30.38 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 251 to 275)
queries 1
aplmobgd
Topic 251 36.19 Topic 276 11.79
Difference (average precision)
Topic 252 11.64 Topic 277 41.07 0.5
Topic 253 26.97 Topic 278 49.72
Topic 254 40.93 Topic 279 69.09
Topic 255 33.33 Topic 280 2.23 0
Topic 256 66.67 Topic 281 49.06
Topic 257 21.99 Topic 282 13.26
−0.5
Topic 258 100.00 Topic 283 71.14
Topic 259 56.66 Topic 284 9.20
Topic 260 35.19 Topic 285 47.09 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 45.19 Topic 286 13.52 Topic Number
Topic 262 68.82 Topic 287 16.61
Topic 263 4.69 Topic 288 0.26
CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 276 to 300)
Topic 264 29.04 Topic 289 64.29 1
Topic 265 25.81 Topic 290 70.26 aplmobgd
Difference (average precision)
Topic 266 8.89 Topic 291 53.11
0.5
Topic 267 39.42 Topic 292 0.00
Topic 268 38.10 Topic 293 37.44
Topic 269 8.65 Topic 294 78.85 0
Topic 270 3.22 Topic 295 0.98
Topic 271 58.33 Topic 296 1.72
Topic 272 16.67 Topic 297 11.34 −0.5
Topic 273 31.47 Topic 298 2.33
Topic 274 15.08 Topic 299 6.82
−1
Topic 275 29.62 Topic 300 27.98 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.232
jhu-apl aplmobge AH-Monolingual-BG
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Bulgarian
Retrieved 50,000 RunType= automatic
Relevant 778 QueryType= TD
Relevant retrieved 699 Pooled= false
CLEF 2005 AH−Monolingual−BG − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 56.43 aplmobge
90%
10 49.95
20 41.45 80%
30 34.68
70%
40 30.09
50 28.26
Average Precision
60%
60 23.20
50%
70 20.62
80 16.99 40%
90 13.06
30%
100 10.17
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
27.68
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−BG − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 35.20 aplmobge
90%
10 docs 30.40
15 docs 27.07 80%
20 docs 24.20
70%
30 docs 20.40
100 docs 9.82 60%
R−Precision
200 docs 5.86
50%
500 docs 2.62
1000 docs 1.40 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
26.86 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 251 to 275)
queries 1
aplmobge
Topic 251 34.28 Topic 276 10.48
Difference (average precision)
Topic 252 8.40 Topic 277 32.86 0.5
Topic 253 21.54 Topic 278 27.15
Topic 254 41.24 Topic 279 64.96
Topic 255 20.00 Topic 280 0.53 0
Topic 256 45.00 Topic 281 42.01
Topic 257 18.27 Topic 282 10.83
−0.5
Topic 258 33.33 Topic 283 72.35
Topic 259 54.82 Topic 284 9.92
Topic 260 42.49 Topic 285 32.42 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 41.35 Topic 286 12.63 Topic Number
Topic 262 63.55 Topic 287 16.77
Topic 263 3.32 Topic 288 0.86
CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 276 to 300)
Topic 264 26.25 Topic 289 39.29 1
Topic 265 38.67 Topic 290 65.75 aplmobge
Difference (average precision)
Topic 266 7.38 Topic 291 52.20
0.5
Topic 267 36.17 Topic 292 0.00
Topic 268 39.01 Topic 293 35.34
Topic 269 14.73 Topic 294 79.63 0
Topic 270 3.07 Topic 295 28.94
Topic 271 35.00 Topic 296 2.38
Topic 272 20.00 Topic 297 15.84 −0.5
Topic 273 31.09 Topic 298 1.94
Topic 274 21.69 Topic 299 3.57
−1
Topic 275 10.15 Topic 300 14.45 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.233
miracle BGHT AH-Monolingual-BG
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Bulgarian
Retrieved 50,000 RunType= automatic
Relevant 778 QueryType= TD
Relevant retrieved 652 Pooled= false
CLEF 2005 AH−Monolingual−BG − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 44.53 BGHT
90%
10 37.54
20 32.65 80%
30 26.51
70%
40 22.21
50 16.72
Average Precision
60%
60 10.92
50%
70 9.46
80 7.18 40%
90 4.52
30%
100 2.91
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
18.04
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−BG − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 20.40 BGHT
90%
10 docs 19.60
15 docs 17.33 80%
20 docs 16.90
70%
30 docs 15.40
100 docs 8.06 60%
R−Precision
200 docs 5.00
50%
500 docs 2.37
1000 docs 1.30 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
18.39 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 251 to 275)
queries 1
BGHT
Topic 251 27.76 Topic 276 4.64
Difference (average precision)
Topic 252 1.96 Topic 277 36.77 0.5
Topic 253 14.34 Topic 278 1.77
Topic 254 9.17 Topic 279 12.27
Topic 255 17.31 Topic 280 3.61 0
Topic 256 17.60 Topic 281 27.43
Topic 257 4.95 Topic 282 31.63
−0.5
Topic 258 3.12 Topic 283 43.72
Topic 259 57.49 Topic 284 13.81
Topic 260 27.30 Topic 285 35.71 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 22.72 Topic 286 4.12 Topic Number
Topic 262 40.39 Topic 287 19.86
Topic 263 0.70 Topic 288 1.12
CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 276 to 300)
Topic 264 15.52 Topic 289 55.56 1
Topic 265 20.59 Topic 290 32.40 BGHT
Difference (average precision)
Topic 266 6.01 Topic 291 36.54
0.5
Topic 267 14.16 Topic 292 0.00
Topic 268 47.57 Topic 293 43.03
Topic 269 2.62 Topic 294 33.29 0
Topic 270 1.39 Topic 295 49.94
Topic 271 3.88 Topic 296 3.85
Topic 272 5.26 Topic 297 7.80 −0.5
Topic 273 15.25 Topic 298 3.32
Topic 274 12.66 Topic 299 0.94
−1
Topic 275 5.36 Topic 300 3.71 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.234
miracle ST AH-Monolingual-BG
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Bulgarian
Retrieved 50,000 RunType= automatic
Relevant 778 QueryType= TD
Relevant retrieved 696 Pooled= true
CLEF 2005 AH−Monolingual−BG − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 59.24 ST
90%
10 52.88
20 44.35 80%
30 36.89
70%
40 32.24
50 27.09
Average Precision
60%
60 18.67
50%
70 16.04
80 12.95 40%
90 8.78
30%
100 6.59
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
26.76
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−BG − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 32.80 ST
90%
10 docs 27.00
15 docs 23.60 80%
20 docs 22.20
70%
30 docs 19.20
100 docs 9.70 60%
R−Precision
200 docs 5.70
50%
500 docs 2.57
1000 docs 1.39 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
26.27 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 251 to 275)
queries 1
ST
Topic 251 37.57 Topic 276 9.41
Difference (average precision)
Topic 252 6.35 Topic 277 35.30 0.5
Topic 253 27.15 Topic 278 10.03
Topic 254 18.29 Topic 279 79.01
Topic 255 22.22 Topic 280 10.69 0
Topic 256 61.11 Topic 281 40.19
Topic 257 21.79 Topic 282 35.60
−0.5
Topic 258 25.00 Topic 283 50.76
Topic 259 66.17 Topic 284 13.33
Topic 260 36.63 Topic 285 40.55 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 13.71 Topic 286 9.01 Topic Number
Topic 262 55.92 Topic 287 24.33
Topic 263 2.69 Topic 288 3.36
CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 276 to 300)
Topic 264 22.84 Topic 289 55.26 1
Topic 265 35.31 Topic 290 43.54 ST
Difference (average precision)
Topic 266 9.01 Topic 291 43.31
0.5
Topic 267 19.22 Topic 292 0.00
Topic 268 46.11 Topic 293 45.12
Topic 269 6.14 Topic 294 57.56 0
Topic 270 1.90 Topic 295 56.29
Topic 271 14.83 Topic 296 6.25
Topic 272 33.33 Topic 297 6.03 −0.5
Topic 273 28.78 Topic 298 6.85
Topic 274 9.13 Topic 299 4.92
−1
Topic 275 16.32 Topic 300 13.90 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.235
miracle r1SR AH-Monolingual-BG
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Bulgarian
Retrieved 50,000 RunType= automatic
Relevant 778 QueryType= TDN
Relevant retrieved 606 Pooled= true
CLEF 2005 AH−Monolingual−BG − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 54.45 r1SR
90%
10 46.78
20 37.69 80%
30 29.79
70%
40 25.28
50 22.00
Average Precision
60%
60 13.59
50%
70 11.11
80 7.25 40%
90 5.84
30%
100 3.93
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
21.91
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−BG − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 26.00 r1SR
90%
10 docs 22.60
15 docs 19.33 80%
20 docs 17.10
70%
30 docs 15.27
100 docs 7.84 60%
R−Precision
200 docs 4.65
50%
500 docs 2.21
1000 docs 1.21 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
21.53 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 251 to 275)
queries 1
r1SR
Topic 251 24.45 Topic 276 9.37
Difference (average precision)
Topic 252 1.47 Topic 277 0.02 0.5
Topic 253 16.46 Topic 278 0.10
Topic 254 40.68 Topic 279 60.17
Topic 255 34.02 Topic 280 38.87 0
Topic 256 75.00 Topic 281 16.59
Topic 257 24.92 Topic 282 15.45
−0.5
Topic 258 0.00 Topic 283 55.18
Topic 259 44.78 Topic 284 19.42
Topic 260 29.68 Topic 285 36.85 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 18.56 Topic 286 0.00 Topic Number
Topic 262 31.97 Topic 287 22.21
Topic 263 1.69 Topic 288 14.18
CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 276 to 300)
Topic 264 7.93 Topic 289 57.14 1
Topic 265 22.52 Topic 290 63.01 r1SR
Difference (average precision)
Topic 266 0.00 Topic 291 38.73
0.5
Topic 267 5.68 Topic 292 0.00
Topic 268 19.32 Topic 293 70.22
Topic 269 25.91 Topic 294 51.81 0
Topic 270 1.01 Topic 295 35.80
Topic 271 0.00 Topic 296 0.29
Topic 272 14.29 Topic 297 0.00 −0.5
Topic 273 23.89 Topic 298 0.36
Topic 274 0.38 Topic 299 0.09
−1
Topic 275 20.48 Topic 300 4.42 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.236
u.glasgow glabgtdn AH-Monolingual-BG
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Bulgarian
Retrieved 50,000 RunType= automatic
Relevant 778 QueryType= TDN
Relevant retrieved 565 Pooled= true
CLEF 2005 AH−Monolingual−BG − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 50.97 glabgtdn
90%
10 45.22
20 37.37 80%
30 30.17
70%
40 22.55
50 20.49
Average Precision
60%
60 14.87
50%
70 11.13
80 8.87 40%
90 6.84
30%
100 6.31
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
21.59
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−BG − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 26.80 glabgtdn
90%
10 docs 23.80
15 docs 20.80 80%
20 docs 18.20
70%
30 docs 14.60
100 docs 7.36 60%
R−Precision
200 docs 4.18
50%
500 docs 2.02
1000 docs 1.13 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
19.71 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 251 to 275)
queries 1
glabgtdn
Topic 251 17.47 Topic 276 7.26
Difference (average precision)
Topic 252 0.21 Topic 277 41.81 0.5
Topic 253 18.14 Topic 278 1.19
Topic 254 19.12 Topic 279 62.45
Topic 255 46.67 Topic 280 3.50 0
Topic 256 66.67 Topic 281 40.38
Topic 257 21.56 Topic 282 22.47
−0.5
Topic 258 50.00 Topic 283 40.64
Topic 259 53.02 Topic 284 0.26
Topic 260 9.90 Topic 285 58.73 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 14.23 Topic 286 5.00 Topic Number
Topic 262 2.73 Topic 287 21.28
Topic 263 1.49 Topic 288 3.39
CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 276 to 300)
Topic 264 12.96 Topic 289 11.86 1
Topic 265 26.83 Topic 290 38.56 glabgtdn
Difference (average precision)
Topic 266 5.97 Topic 291 38.72
0.5
Topic 267 7.32 Topic 292 0.00
Topic 268 71.83 Topic 293 44.77
Topic 269 0.80 Topic 294 34.37 0
Topic 270 0.81 Topic 295 40.06
Topic 271 8.12 Topic 296 50.00
Topic 272 8.33 Topic 297 6.02 −0.5
Topic 273 26.99 Topic 298 0.44
Topic 274 4.01 Topic 299 1.13
−1
Topic 275 5.15 Topic 300 4.71 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.237
u.glasgow glabgtdnqe AH-Monolingual-BG
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Bulgarian
Retrieved 50,000 RunType= automatic
Relevant 778 QueryType= TDN
Relevant retrieved 643 Pooled= true
CLEF 2005 AH−Monolingual−BG − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 48.27 glabgtdnqe
90%
10 43.01
20 38.83 80%
30 33.24
70%
40 28.87
50 25.71
Average Precision
60%
60 19.73
50%
70 14.81
80 11.50 40%
90 8.73
30%
100 6.80
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
24.12
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−BG − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 30.40 glabgtdnqe
90%
10 docs 25.80
15 docs 22.00 80%
20 docs 20.40
70%
30 docs 17.07
100 docs 8.94 60%
R−Precision
200 docs 5.29
50%
500 docs 2.42
1000 docs 1.29 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
22.13 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 251 to 275)
queries 1
glabgtdnqe
Topic 251 47.47 Topic 276 8.46
Difference (average precision)
Topic 252 1.26 Topic 277 59.26 0.5
Topic 253 19.14 Topic 278 0.98
Topic 254 31.18 Topic 279 43.71
Topic 255 55.56 Topic 280 5.90 0
Topic 256 70.00 Topic 281 30.36
Topic 257 31.12 Topic 282 30.22
−0.5
Topic 258 33.33 Topic 283 64.06
Topic 259 62.33 Topic 284 2.49
Topic 260 13.14 Topic 285 26.67 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 28.94 Topic 286 6.46 Topic Number
Topic 262 3.91 Topic 287 19.15
Topic 263 2.60 Topic 288 2.39
CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 276 to 300)
Topic 264 12.80 Topic 289 15.26 1
Topic 265 27.88 Topic 290 55.21 glabgtdnqe
Difference (average precision)
Topic 266 12.62 Topic 291 43.77
0.5
Topic 267 9.31 Topic 292 0.00
Topic 268 68.16 Topic 293 30.65
Topic 269 0.47 Topic 294 58.40 0
Topic 270 1.34 Topic 295 61.95
Topic 271 8.52 Topic 296 33.33
Topic 272 11.11 Topic 297 4.96 −0.5
Topic 273 32.38 Topic 298 0.80
Topic 274 5.38 Topic 299 0.44
−1
Topic 275 5.74 Topic 300 5.54 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.238
u.glasgow glabgtdqe AH-Monolingual-BG
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Bulgarian
Retrieved 50,000 RunType= automatic
Relevant 778 QueryType= TD
Relevant retrieved 627 Pooled= false
CLEF 2005 AH−Monolingual−BG − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 51.91 glabgtdqe
90%
10 48.03
20 37.53 80%
30 32.19
70%
40 29.97
50 26.91
Average Precision
60%
60 19.78
50%
70 16.48
80 13.92 40%
90 9.75
30%
100 7.95
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
25.14
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−BG − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 31.20 glabgtdqe
90%
10 docs 26.60
15 docs 22.93 80%
20 docs 20.30
70%
30 docs 17.40
100 docs 8.80 60%
R−Precision
200 docs 5.17
50%
500 docs 2.31
1000 docs 1.25 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
24.33 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 251 to 275)
queries 1
glabgtdqe
Topic 251 46.38 Topic 276 10.36
Difference (average precision)
Topic 252 0.10 Topic 277 27.62 0.5
Topic 253 13.34 Topic 278 1.26
Topic 254 23.24 Topic 279 56.40
Topic 255 24.44 Topic 280 4.74 0
Topic 256 70.00 Topic 281 45.11
Topic 257 3.01 Topic 282 23.81
−0.5
Topic 258 100.00 Topic 283 61.35
Topic 259 61.13 Topic 284 0.46
Topic 260 41.30 Topic 285 33.13 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 23.95 Topic 286 5.36 Topic Number
Topic 262 4.43 Topic 287 19.30
Topic 263 3.47 Topic 288 1.45
CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 276 to 300)
Topic 264 20.99 Topic 289 26.67 1
Topic 265 31.75 Topic 290 58.16 glabgtdqe
Difference (average precision)
Topic 266 15.97 Topic 291 47.15
0.5
Topic 267 10.44 Topic 292 0.00
Topic 268 61.57 Topic 293 43.45
Topic 269 0.03 Topic 294 57.43 0
Topic 270 1.55 Topic 295 58.04
Topic 271 10.05 Topic 296 8.33
Topic 272 14.29 Topic 297 24.51 −0.5
Topic 273 30.76 Topic 298 0.17
Topic 274 5.28 Topic 299 0.17
−1
Topic 275 5.30 Topic 300 20.03 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.239
unine UniNEbg1 AH-Monolingual-BG
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Bulgarian
Retrieved 50,000 RunType= automatic
Relevant 778 QueryType= TD
Relevant retrieved 718 Pooled= true
CLEF 2005 AH−Monolingual−BG − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 51.86 UniNEbg1
90%
10 46.98
20 41.41 80%
30 35.52
70%
40 33.37
50 30.04
Average Precision
60%
60 23.11
50%
70 21.03
80 17.43 40%
90 13.41
30%
100 9.08
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
27.82
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−BG − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 32.00 UniNEbg1
90%
10 docs 27.60
15 docs 24.40 80%
20 docs 21.90
70%
30 docs 19.00
100 docs 10.16 60%
R−Precision
200 docs 6.17
50%
500 docs 2.77
1000 docs 1.44 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
25.49 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 251 to 275)
queries 1
UniNEbg1
Topic 251 43.14 Topic 276 10.32
Difference (average precision)
Topic 252 3.16 Topic 277 44.97 0.5
Topic 253 20.83 Topic 278 24.97
Topic 254 33.12 Topic 279 93.33
Topic 255 13.26 Topic 280 10.46 0
Topic 256 61.11 Topic 281 36.53
Topic 257 13.59 Topic 282 17.83
−0.5
Topic 258 50.00 Topic 283 54.31
Topic 259 83.57 Topic 284 10.74
Topic 260 36.02 Topic 285 40.28 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 14.38 Topic 286 8.67 Topic Number
Topic 262 67.13 Topic 287 21.81
Topic 263 1.73 Topic 288 2.58
CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 276 to 300)
Topic 264 17.15 Topic 289 57.14 1
Topic 265 35.10 Topic 290 55.25 UniNEbg1
Difference (average precision)
Topic 266 5.97 Topic 291 43.01
0.5
Topic 267 10.79 Topic 292 0.00
Topic 268 37.69 Topic 293 27.81
Topic 269 5.75 Topic 294 63.67 0
Topic 270 3.13 Topic 295 62.69
Topic 271 15.26 Topic 296 3.03
Topic 272 33.33 Topic 297 0.82 −0.5
Topic 273 38.98 Topic 298 4.27
Topic 274 13.29 Topic 299 0.83
−1
Topic 275 21.80 Topic 300 16.58 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.240
unine UniNEbg2 AH-Monolingual-BG
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Bulgarian
Retrieved 50,000 RunType= automatic
Relevant 778 QueryType= TD
Relevant retrieved 718 Pooled= true
CLEF 2005 AH−Monolingual−BG − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 46.98 UniNEbg2
90%
10 44.10
20 39.20 80%
30 34.92
70%
40 31.69
50 28.51
Average Precision
60%
60 21.42
50%
70 20.12
80 16.13 40%
90 11.66
30%
100 8.38
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
26.22
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−BG − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 29.20 UniNEbg2
90%
10 docs 26.40
15 docs 23.87 80%
20 docs 22.40
70%
30 docs 19.60
100 docs 9.78 60%
R−Precision
200 docs 5.83
50%
500 docs 2.68
1000 docs 1.44 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
25.63 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 251 to 275)
queries 1
UniNEbg2
Topic 251 37.28 Topic 276 10.08
Difference (average precision)
Topic 252 1.83 Topic 277 23.98 0.5
Topic 253 23.19 Topic 278 5.18
Topic 254 33.20 Topic 279 92.42
Topic 255 9.57 Topic 280 6.85 0
Topic 256 66.67 Topic 281 34.40
Topic 257 19.25 Topic 282 13.36
−0.5
Topic 258 50.00 Topic 283 55.01
Topic 259 70.42 Topic 284 8.43
Topic 260 40.58 Topic 285 29.44 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 19.29 Topic 286 9.38 Topic Number
Topic 262 67.19 Topic 287 22.01
Topic 263 2.88 Topic 288 3.00
CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 276 to 300)
Topic 264 13.74 Topic 289 56.25 1
Topic 265 28.25 Topic 290 73.10 UniNEbg2
Difference (average precision)
Topic 266 4.12 Topic 291 43.81
0.5
Topic 267 9.53 Topic 292 0.00
Topic 268 35.86 Topic 293 35.60
Topic 269 3.76 Topic 294 70.72 0
Topic 270 2.98 Topic 295 49.78
Topic 271 11.81 Topic 296 1.35
Topic 272 33.33 Topic 297 0.47 −0.5
Topic 273 37.48 Topic 298 5.11
Topic 274 4.22 Topic 299 1.76
−1
Topic 275 12.29 Topic 300 20.77 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.241
unine UniNEbg3 AH-Monolingual-BG
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Bulgarian
Retrieved 50,000 RunType= automatic
Relevant 778 QueryType= TD
Relevant retrieved 720 Pooled= false
CLEF 2005 AH−Monolingual−BG − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 54.85 UniNEbg3
90%
10 47.38
20 42.16 80%
30 37.17
70%
40 33.64
50 31.22
Average Precision
60%
60 24.31
50%
70 21.07
80 16.27 40%
90 13.06
30%
100 8.84
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
28.39
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−BG − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 33.20 UniNEbg3
90%
10 docs 28.40
15 docs 25.07 80%
20 docs 23.30
70%
30 docs 19.87
100 docs 10.26 60%
R−Precision
200 docs 6.22
50%
500 docs 2.74
1000 docs 1.44 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
25.93 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 251 to 275)
queries 1
UniNEbg3
Topic 251 47.86 Topic 276 10.31
Difference (average precision)
Topic 252 2.76 Topic 277 60.29 0.5
Topic 253 25.09 Topic 278 36.80
Topic 254 38.19 Topic 279 91.07
Topic 255 6.92 Topic 280 8.26 0
Topic 256 61.11 Topic 281 30.55
Topic 257 20.23 Topic 282 13.43
−0.5
Topic 258 50.00 Topic 283 65.58
Topic 259 83.39 Topic 284 13.30
Topic 260 30.78 Topic 285 30.69 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 13.70 Topic 286 8.03 Topic Number
Topic 262 67.25 Topic 287 21.74
Topic 263 1.58 Topic 288 1.85
CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 276 to 300)
Topic 264 16.75 Topic 289 53.45 1
Topic 265 32.32 Topic 290 55.51 UniNEbg3
Difference (average precision)
Topic 266 6.74 Topic 291 42.54
0.5
Topic 267 11.76 Topic 292 0.00
Topic 268 37.20 Topic 293 19.82
Topic 269 6.80 Topic 294 63.31 0
Topic 270 4.30 Topic 295 68.11
Topic 271 12.69 Topic 296 1.03
Topic 272 25.00 Topic 297 0.94 −0.5
Topic 273 41.26 Topic 298 4.24
Topic 274 15.48 Topic 299 0.24
−1
Topic 275 28.38 Topic 300 30.88 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.242
alicante IRn-fr-fexp AH-Monolingual-FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 2,119 Pooled= false
CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 66.81 IRn−fr−fexp
90%
10 54.19
20 49.21 80%
30 44.35
70%
40 41.44
50 38.13
Average Precision
60%
60 33.35
50%
70 26.61
80 21.33 40%
90 13.88
30%
100 3.45
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
34.85
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 51.60 IRn−fr−fexp
90%
10 docs 46.60
15 docs 44.80 80%
20 docs 42.30
70%
30 docs 37.93
100 docs 24.38 60%
R−Precision
200 docs 15.93
50%
500 docs 7.77
1000 docs 4.24 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
35.14 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275)
queries 1
IRn−fr−fexp
Topic 251 10.52 Topic 276 25.29
Difference (average precision)
Topic 252 12.10 Topic 277 0.28 0.5
Topic 253 48.37 Topic 278 52.45
Topic 254 58.39 Topic 279 11.89
Topic 255 0.85 Topic 280 33.59 0
Topic 256 75.92 Topic 281 46.87
Topic 257 13.01 Topic 282 1.07
−0.5
Topic 258 17.42 Topic 283 77.42
Topic 259 2.84 Topic 284 64.52
Topic 260 54.69 Topic 285 62.07 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.00 Topic 286 8.28 Topic Number
Topic 262 15.17 Topic 287 5.40
Topic 263 3.21 Topic 288 6.36
CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300)
Topic 264 73.67 Topic 289 73.46 1
Topic 265 33.75 Topic 290 55.37 IRn−fr−fexp
Difference (average precision)
Topic 266 0.32 Topic 291 37.06
0.5
Topic 267 25.85 Topic 292 2.37
Topic 268 68.97 Topic 293 72.91
Topic 269 26.04 Topic 294 58.86 0
Topic 270 67.77 Topic 295 38.92
Topic 271 90.13 Topic 296 27.04
Topic 272 15.23 Topic 297 44.11 −0.5
Topic 273 12.74 Topic 298 56.23
Topic 274 76.84 Topic 299 0.22
−1
Topic 275 58.44 Topic 300 18.22 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.243
alicante IRn-fr-vexp AH-Monolingual-FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 2,145 Pooled= true
CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 70.85 IRn−fr−vexp
90%
10 56.44
20 49.43 80%
30 45.96
70%
40 41.29
50 38.74
Average Precision
60%
60 33.54
50%
70 27.75
80 22.10 40%
90 14.04
30%
100 3.29
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
35.90
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 53.20 IRn−fr−vexp
90%
10 docs 45.80
15 docs 45.33 80%
20 docs 42.70
70%
30 docs 38.73
100 docs 25.26 60%
R−Precision
200 docs 16.10
50%
500 docs 7.90
1000 docs 4.29 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
36.15 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275)
queries 1
IRn−fr−vexp
Topic 251 11.18 Topic 276 19.41
Difference (average precision)
Topic 252 11.86 Topic 277 0.17 0.5
Topic 253 53.85 Topic 278 47.90
Topic 254 63.31 Topic 279 9.60
Topic 255 2.63 Topic 280 35.71 0
Topic 256 79.74 Topic 281 50.38
Topic 257 14.37 Topic 282 0.95
−0.5
Topic 258 12.14 Topic 283 77.11
Topic 259 1.91 Topic 284 70.49
Topic 260 58.46 Topic 285 58.09 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.00 Topic 286 28.10 Topic Number
Topic 262 14.43 Topic 287 9.10
Topic 263 3.41 Topic 288 8.28
CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300)
Topic 264 80.28 Topic 289 75.87 1
Topic 265 42.40 Topic 290 53.72 IRn−fr−vexp
Difference (average precision)
Topic 266 0.33 Topic 291 37.93
0.5
Topic 267 26.20 Topic 292 4.89
Topic 268 62.44 Topic 293 75.99
Topic 269 22.69 Topic 294 61.45 0
Topic 270 66.92 Topic 295 43.57
Topic 271 87.57 Topic 296 24.41
Topic 272 19.42 Topic 297 45.22 −0.5
Topic 273 14.32 Topic 298 50.53
Topic 274 80.96 Topic 299 0.21
−1
Topic 275 60.18 Topic 300 15.08 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.244
alicante IRn-fr-vnexp AH-Monolingual-FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 2,022 Pooled= false
CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 63.64 IRn−fr−vnexp
90%
10 51.89
20 45.07 80%
30 41.56
70%
40 37.25
50 32.57
Average Precision
60%
60 27.41
50%
70 21.13
80 15.83 40%
90 11.97
30%
100 3.15
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
30.71
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 48.00 IRn−fr−vnexp
90%
10 docs 42.20
15 docs 41.20 80%
20 docs 38.50
70%
30 docs 34.80
100 docs 21.84 60%
R−Precision
200 docs 14.38
50%
500 docs 7.23
1000 docs 4.04 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
32.88 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275)
queries 1
IRn−fr−vnexp
Topic 251 7.28 Topic 276 18.39
Difference (average precision)
Topic 252 7.71 Topic 277 0.01 0.5
Topic 253 38.15 Topic 278 43.73
Topic 254 53.47 Topic 279 8.81
Topic 255 1.11 Topic 280 31.94 0
Topic 256 77.68 Topic 281 32.34
Topic 257 13.31 Topic 282 2.27
−0.5
Topic 258 9.11 Topic 283 77.34
Topic 259 1.02 Topic 284 61.87
Topic 260 36.05 Topic 285 60.17 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.04 Topic 286 18.42 Topic Number
Topic 262 21.64 Topic 287 4.46
Topic 263 4.03 Topic 288 4.95
CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300)
Topic 264 75.30 Topic 289 67.25 1
Topic 265 31.02 Topic 290 32.74 IRn−fr−vnexp
Difference (average precision)
Topic 266 1.71 Topic 291 28.89
0.5
Topic 267 26.89 Topic 292 3.43
Topic 268 70.35 Topic 293 71.36
Topic 269 16.30 Topic 294 63.45 0
Topic 270 33.74 Topic 295 36.38
Topic 271 90.59 Topic 296 24.82
Topic 272 12.77 Topic 297 44.95 −0.5
Topic 273 6.11 Topic 298 38.20
Topic 274 65.95 Topic 299 0.43
−1
Topic 275 42.60 Topic 300 14.95 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.245
clips CLIPS05FR0 AH-Monolingual-FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 1,649 Pooled= false
CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 63.29 CLIPS05FR0
90%
10 43.77
20 33.77 80%
30 30.20
70%
40 25.46
50 19.76
Average Precision
60%
60 14.11
50%
70 11.90
80 8.60 40%
90 4.77
30%
100 2.10
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
21.56
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 38.00 CLIPS05FR0
90%
10 docs 35.20
15 docs 34.13 80%
20 docs 32.10
70%
30 docs 28.07
100 docs 16.10 60%
R−Precision
200 docs 10.92
50%
500 docs 5.74
1000 docs 3.30 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
23.28 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275)
queries 1
CLIPS05FR0
Topic 251 5.44 Topic 276 12.18
Difference (average precision)
Topic 252 1.26 Topic 277 0.46 0.5
Topic 253 29.23 Topic 278 27.03
Topic 254 32.15 Topic 279 6.71
Topic 255 0.69 Topic 280 0.97 0
Topic 256 52.93 Topic 281 36.11
Topic 257 21.37 Topic 282 0.73
−0.5
Topic 258 26.79 Topic 283 73.20
Topic 259 1.00 Topic 284 46.56
Topic 260 41.36 Topic 285 23.18 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.00 Topic 286 6.67 Topic Number
Topic 262 35.03 Topic 287 0.90
Topic 263 9.87 Topic 288 9.57
CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300)
Topic 264 66.47 Topic 289 16.99 1
Topic 265 27.07 Topic 290 20.60 CLIPS05FR0
Difference (average precision)
Topic 266 3.62 Topic 291 7.59
0.5
Topic 267 3.14 Topic 292 7.45
Topic 268 48.37 Topic 293 30.56
Topic 269 8.92 Topic 294 60.76 0
Topic 270 32.97 Topic 295 7.62
Topic 271 79.60 Topic 296 7.50
Topic 272 26.17 Topic 297 37.86 −0.5
Topic 273 2.20 Topic 298 29.72
Topic 274 14.01 Topic 299 0.12
−1
Topic 275 27.81 Topic 300 9.61 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.246
clips CLIPS05FR1 AH-Monolingual-FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TDN
Relevant retrieved 1,235 Pooled= true
CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 57.90 CLIPS05FR1
90%
10 40.74
20 26.09 80%
30 18.35
70%
40 14.23
50 10.45
Average Precision
60%
60 5.04
50%
70 2.45
80 1.36 40%
90 0.52
30%
100 0.24
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
14.11
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 36.40 CLIPS05FR1
90%
10 docs 32.40
15 docs 29.33 80%
20 docs 27.80
70%
30 docs 24.47
100 docs 13.68 60%
R−Precision
200 docs 8.54
50%
500 docs 4.43
1000 docs 2.47 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
19.38 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275)
queries 1
CLIPS05FR1
Topic 251 10.53 Topic 276 8.64
Difference (average precision)
Topic 252 9.46 Topic 277 5.63 0.5
Topic 253 27.45 Topic 278 13.79
Topic 254 29.43 Topic 279 6.26
Topic 255 0.00 Topic 280 0.98 0
Topic 256 35.98 Topic 281 41.02
Topic 257 6.98 Topic 282 0.76
−0.5
Topic 258 0.37 Topic 283 52.43
Topic 259 0.50 Topic 284 26.37
Topic 260 8.56 Topic 285 20.32 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.42 Topic 286 18.80 Topic Number
Topic 262 31.31 Topic 287 9.91
Topic 263 6.87 Topic 288 21.43
CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300)
Topic 264 21.29 Topic 289 2.34 1
Topic 265 24.75 Topic 290 5.93 CLIPS05FR1
Difference (average precision)
Topic 266 0.06 Topic 291 2.98
0.5
Topic 267 3.34 Topic 292 7.82
Topic 268 17.20 Topic 293 23.91
Topic 269 9.55 Topic 294 51.80 0
Topic 270 15.26 Topic 295 9.68
Topic 271 43.78 Topic 296 2.95
Topic 272 8.72 Topic 297 7.24 −0.5
Topic 273 4.56 Topic 298 19.83
Topic 274 2.25 Topic 299 0.72
−1
Topic 275 19.96 Topic 300 5.39 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.247
clips CLIPS05FR2 AH-Monolingual-FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TDN
Relevant retrieved 1,425 Pooled= false
CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 54.45 CLIPS05FR2
90%
10 34.04
20 22.57 80%
30 16.47
70%
40 12.11
50 9.44
Average Precision
60%
60 6.53
50%
70 4.72
80 2.70 40%
90 1.23
30%
100 1.07
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
13.07
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 30.40 CLIPS05FR2
90%
10 docs 26.80
15 docs 25.20 80%
20 docs 23.40
70%
30 docs 20.33
100 docs 11.96 60%
R−Precision
200 docs 8.32
50%
500 docs 4.66
1000 docs 2.85 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
17.06 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275)
queries 1
CLIPS05FR2
Topic 251 7.20 Topic 276 1.78
Difference (average precision)
Topic 252 24.24 Topic 277 3.78 0.5
Topic 253 20.73 Topic 278 5.16
Topic 254 17.59 Topic 279 0.65
Topic 255 0.23 Topic 280 2.73 0
Topic 256 57.94 Topic 281 23.05
Topic 257 19.89 Topic 282 0.65
−0.5
Topic 258 0.00 Topic 283 18.93
Topic 259 1.14 Topic 284 40.76
Topic 260 25.06 Topic 285 9.24 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 18.33 Topic 286 5.27 Topic Number
Topic 262 0.11 Topic 287 12.65
Topic 263 0.48 Topic 288 3.99
CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300)
Topic 264 28.45 Topic 289 22.80 1
Topic 265 19.73 Topic 290 0.59 CLIPS05FR2
Difference (average precision)
Topic 266 0.12 Topic 291 0.55
0.5
Topic 267 15.95 Topic 292 8.69
Topic 268 35.61 Topic 293 2.02
Topic 269 22.50 Topic 294 23.27 0
Topic 270 3.31 Topic 295 10.17
Topic 271 8.49 Topic 296 19.91
Topic 272 14.25 Topic 297 13.50 −0.5
Topic 273 6.99 Topic 298 8.36
Topic 274 22.82 Topic 299 1.97
−1
Topic 275 41.50 Topic 300 0.16 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.248
cocri RIMfuzzET020 AH-Monolingual-FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual French
Retrieved 47,850 RunType= manual
Relevant 2,537 QueryType= T
Relevant retrieved 1,533 Pooled= false
CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 57.33 RIMfuzzET020
90%
10 44.20
20 32.69 80%
30 25.57
70%
40 21.36
50 18.87
Average Precision
60%
60 14.59
50%
70 11.31
80 7.79 40%
90 4.42
30%
100 1.21
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
19.60
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 35.20 RIMfuzzET020
90%
10 docs 31.40
15 docs 30.13 80%
20 docs 29.50
70%
30 docs 28.07
100 docs 16.60 60%
R−Precision
200 docs 10.89
50%
500 docs 5.58
1000 docs 3.07 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
23.64 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275)
queries 1
RIMfuzzET020
Topic 251 10.66 Topic 276 5.56
Difference (average precision)
Topic 252 9.00 Topic 277 12.23 0.5
Topic 253 37.39 Topic 278 18.84
Topic 254 14.46 Topic 279 4.97
Topic 255 1.39 Topic 280 0.44 0
Topic 256 2.62 Topic 281 14.48
Topic 257 19.65 Topic 282 0.03
−0.5
Topic 258 8.85 Topic 283 64.94
Topic 259 0.01 Topic 284 0.92
Topic 260 30.23 Topic 285 7.03 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.00 Topic 286 3.85 Topic Number
Topic 262 28.85 Topic 287 16.09
Topic 263 7.14 Topic 288 6.55
CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300)
Topic 264 43.82 Topic 289 67.61 1
Topic 265 28.94 Topic 290 25.81 RIMfuzzET020
Difference (average precision)
Topic 266 22.89 Topic 291 21.09
0.5
Topic 267 44.55 Topic 292 2.81
Topic 268 22.05 Topic 293 62.48
Topic 269 7.47 Topic 294 14.72 0
Topic 270 52.52 Topic 295 46.18
Topic 271 54.37 Topic 296 25.66
Topic 272 4.79 Topic 297 15.67 −0.5
Topic 273 1.25 Topic 298 1.47
Topic 274 33.01 Topic 299 0.04
−1
Topic 275 44.37 Topic 300 10.07 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.249
cocri RIMfuzzET050 AH-Monolingual-FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual French
Retrieved 47,850 RunType= manual
Relevant 2,537 QueryType= T
Relevant retrieved 1,533 Pooled= false
CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 59.27 RIMfuzzET050
90%
10 43.96
20 32.48 80%
30 25.71
70%
40 21.19
50 18.65
Average Precision
60%
60 14.40
50%
70 11.19
80 7.91 40%
90 4.42
30%
100 1.21
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
19.62
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 36.40 RIMfuzzET050
90%
10 docs 32.80
15 docs 30.40 80%
20 docs 29.20
70%
30 docs 27.73
100 docs 16.62 60%
R−Precision
200 docs 10.89
50%
500 docs 5.58
1000 docs 3.07 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
23.40 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275)
queries 1
RIMfuzzET050
Topic 251 12.01 Topic 276 5.56
Difference (average precision)
Topic 252 9.00 Topic 277 12.23 0.5
Topic 253 37.39 Topic 278 18.84
Topic 254 14.46 Topic 279 3.59
Topic 255 1.37 Topic 280 0.63 0
Topic 256 2.62 Topic 281 13.22
Topic 257 19.65 Topic 282 0.03
−0.5
Topic 258 8.85 Topic 283 64.28
Topic 259 0.01 Topic 284 0.92
Topic 260 30.56 Topic 285 7.03 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.00 Topic 286 3.48 Topic Number
Topic 262 28.85 Topic 287 16.09
Topic 263 7.14 Topic 288 6.55
CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300)
Topic 264 45.44 Topic 289 68.61 1
Topic 265 27.93 Topic 290 25.81 RIMfuzzET050
Difference (average precision)
Topic 266 22.89 Topic 291 21.09
0.5
Topic 267 44.55 Topic 292 2.48
Topic 268 22.05 Topic 293 62.53
Topic 269 7.45 Topic 294 14.72 0
Topic 270 53.64 Topic 295 46.39
Topic 271 54.58 Topic 296 25.66
Topic 272 4.32 Topic 297 15.67 −0.5
Topic 273 2.07 Topic 298 1.53
Topic 274 33.01 Topic 299 0.04
−1
Topic 275 44.37 Topic 300 10.03 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.250
cocri RIMfuzzLemme050 AH-Monolingual-FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual French
Retrieved 48,829 RunType= manual
Relevant 2,537 QueryType= T
Relevant retrieved 1,907 Pooled= true
CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 68.19 RIMfuzzLemme050
90%
10 48.47
20 40.92 80%
30 32.93
70%
40 27.89
50 21.48
Average Precision
60%
60 18.20
50%
70 14.47
80 10.18 40%
90 6.01
30%
100 1.31
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
24.35
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 40.00 RIMfuzzLemme050
90%
10 docs 37.60
15 docs 35.07 80%
20 docs 34.50
70%
30 docs 30.13
100 docs 18.84 60%
R−Precision
200 docs 12.74
50%
500 docs 6.78
1000 docs 3.81 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
27.14 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275)
queries 1
RIMfuzzLemme050
Topic 251 11.88 Topic 276 6.75
Difference (average precision)
Topic 252 9.61 Topic 277 11.83 0.5
Topic 253 22.51 Topic 278 24.12
Topic 254 44.62 Topic 279 7.73
Topic 255 1.20 Topic 280 8.89 0
Topic 256 40.67 Topic 281 13.22
Topic 257 14.31 Topic 282 0.29
−0.5
Topic 258 1.60 Topic 283 66.17
Topic 259 0.06 Topic 284 41.34
Topic 260 27.39 Topic 285 36.28 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.00 Topic 286 7.02 Topic Number
Topic 262 39.59 Topic 287 24.44
Topic 263 7.96 Topic 288 2.96
CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300)
Topic 264 56.92 Topic 289 73.37 1
Topic 265 22.60 Topic 290 12.38 RIMfuzzLemme050
Difference (average precision)
Topic 266 24.55 Topic 291 23.86
0.5
Topic 267 24.64 Topic 292 3.82
Topic 268 29.57 Topic 293 64.07
Topic 269 14.47 Topic 294 20.44 0
Topic 270 53.86 Topic 295 46.39
Topic 271 86.45 Topic 296 11.89
Topic 272 2.03 Topic 297 42.25 −0.5
Topic 273 1.86 Topic 298 22.63
Topic 274 47.33 Topic 299 0.03
−1
Topic 275 27.49 Topic 300 32.15 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.251
cocri RIMfuzzLemme080 AH-Monolingual-FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual French
Retrieved 48,829 RunType= manual
Relevant 2,537 QueryType= T
Relevant retrieved 1,908 Pooled= false
CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 70.44 RIMfuzzLemme080
90%
10 48.51
20 41.18 80%
30 32.79
70%
40 27.51
50 21.65
Average Precision
60%
60 18.38
50%
70 14.47
80 10.18 40%
90 6.23
30%
100 1.30
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
24.68
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 42.80 RIMfuzzLemme080
90%
10 docs 38.60
15 docs 35.73 80%
20 docs 34.80
70%
30 docs 30.93
100 docs 19.02 60%
R−Precision
200 docs 12.67
50%
500 docs 6.79
1000 docs 3.82 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
27.20 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275)
queries 1
RIMfuzzLemme080
Topic 251 11.74 Topic 276 10.18
Difference (average precision)
Topic 252 9.40 Topic 277 11.83 0.5
Topic 253 22.51 Topic 278 23.20
Topic 254 44.40 Topic 279 8.33
Topic 255 1.20 Topic 280 8.76 0
Topic 256 40.67 Topic 281 13.37
Topic 257 14.31 Topic 282 0.28
−0.5
Topic 258 1.60 Topic 283 68.80
Topic 259 0.06 Topic 284 40.53
Topic 260 29.64 Topic 285 37.02 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.00 Topic 286 7.11 Topic Number
Topic 262 37.45 Topic 287 25.46
Topic 263 7.96 Topic 288 4.34
CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300)
Topic 264 57.04 Topic 289 74.08 1
Topic 265 22.60 Topic 290 12.29 RIMfuzzLemme080
Difference (average precision)
Topic 266 24.55 Topic 291 25.53
0.5
Topic 267 24.64 Topic 292 5.51
Topic 268 29.57 Topic 293 63.97
Topic 269 13.77 Topic 294 18.49 0
Topic 270 53.86 Topic 295 47.58
Topic 271 88.68 Topic 296 11.89
Topic 272 1.98 Topic 297 44.31 −0.5
Topic 273 1.86 Topic 298 23.45
Topic 274 47.33 Topic 299 0.03
−1
Topic 275 27.78 Topic 300 32.91 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.252
cocri RIMfuzzTD050 AH-Monolingual-FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual French
Retrieved 50,000 RunType= manual
Relevant 2,537 QueryType= TD
Relevant retrieved 1,897 Pooled= false
CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 62.16 RIMfuzzTD050
90%
10 46.49
20 37.60 80%
30 31.81
70%
40 26.15
50 22.82
Average Precision
60%
60 19.18
50%
70 14.89
80 9.84 40%
90 5.54
30%
100 1.69
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
23.70
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 44.80 RIMfuzzTD050
90%
10 docs 39.00
15 docs 35.60 80%
20 docs 34.30
70%
30 docs 30.00
100 docs 18.74 60%
R−Precision
200 docs 12.82
50%
500 docs 6.48
1000 docs 3.79 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
26.19 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275)
queries 1
RIMfuzzTD050
Topic 251 18.96 Topic 276 14.58
Difference (average precision)
Topic 252 4.83 Topic 277 12.44 0.5
Topic 253 27.57 Topic 278 14.55
Topic 254 16.92 Topic 279 5.08
Topic 255 1.23 Topic 280 0.14 0
Topic 256 75.78 Topic 281 28.94
Topic 257 22.91 Topic 282 5.12
−0.5
Topic 258 13.89 Topic 283 40.88
Topic 259 12.38 Topic 284 47.43
Topic 260 46.30 Topic 285 28.49 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.10 Topic 286 7.59 Topic Number
Topic 262 1.54 Topic 287 27.29
Topic 263 8.90 Topic 288 5.79
CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300)
Topic 264 49.58 Topic 289 73.95 1
Topic 265 28.87 Topic 290 11.96 RIMfuzzTD050
Difference (average precision)
Topic 266 7.19 Topic 291 48.10
0.5
Topic 267 40.69 Topic 292 2.30
Topic 268 10.35 Topic 293 63.99
Topic 269 0.91 Topic 294 14.61 0
Topic 270 38.65 Topic 295 35.18
Topic 271 49.33 Topic 296 61.25
Topic 272 16.94 Topic 297 31.57 −0.5
Topic 273 5.36 Topic 298 20.70
Topic 274 33.57 Topic 299 2.65
−1
Topic 275 25.08 Topic 300 22.35 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.253
hildesheim UHIFR1 AH-Monolingual-FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 2,346 Pooled= true
CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 71.18 UHIFR1
90%
10 59.24
20 53.82 80%
30 49.43
70%
40 46.27
50 42.59
Average Precision
60%
60 35.92
50%
70 30.49
80 22.82 40%
90 14.84
30%
100 4.76
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
38.07
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 53.60 UHIFR1
90%
10 docs 51.40
15 docs 47.60 80%
20 docs 44.30
70%
30 docs 41.07
100 docs 27.44 60%
R−Precision
200 docs 17.93
50%
500 docs 8.76
1000 docs 4.69 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
38.49 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275)
queries 1
UHIFR1
Topic 251 27.92 Topic 276 12.07
Difference (average precision)
Topic 252 18.91 Topic 277 45.60 0.5
Topic 253 53.37 Topic 278 45.64
Topic 254 60.26 Topic 279 9.74
Topic 255 1.56 Topic 280 46.41 0
Topic 256 80.04 Topic 281 32.42
Topic 257 14.82 Topic 282 0.50
−0.5
Topic 258 1.11 Topic 283 66.62
Topic 259 2.65 Topic 284 66.94
Topic 260 50.70 Topic 285 61.66 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.07 Topic 286 4.96 Topic Number
Topic 262 25.21 Topic 287 42.13
Topic 263 36.49 Topic 288 13.69
CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300)
Topic 264 82.44 Topic 289 64.42 1
Topic 265 30.52 Topic 290 19.23 UHIFR1
Difference (average precision)
Topic 266 3.34 Topic 291 61.46
0.5
Topic 267 35.11 Topic 292 10.28
Topic 268 49.98 Topic 293 76.71
Topic 269 36.03 Topic 294 59.12 0
Topic 270 60.88 Topic 295 49.14
Topic 271 83.93 Topic 296 27.92
Topic 272 7.53 Topic 297 63.01 −0.5
Topic 273 55.81 Topic 298 52.57
Topic 274 85.12 Topic 299 6.51
−1
Topic 275 48.05 Topic 300 12.67 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.254
hildesheim UHIFR2 AH-Monolingual-FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 2,364 Pooled= false
CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 69.73 UHIFR2
90%
10 59.10
20 53.83 80%
30 49.67
70%
40 46.44
50 42.60
Average Precision
60%
60 36.77
50%
70 31.07
80 23.43 40%
90 15.77
30%
100 5.22
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
38.32
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 52.80 UHIFR2
90%
10 docs 51.20
15 docs 47.73 80%
20 docs 44.80
70%
30 docs 41.27
100 docs 27.68 60%
R−Precision
200 docs 18.36
50%
500 docs 8.86
1000 docs 4.73 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
38.18 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275)
queries 1
UHIFR2
Topic 251 27.78 Topic 276 12.07
Difference (average precision)
Topic 252 11.46 Topic 277 45.60 0.5
Topic 253 62.21 Topic 278 45.64
Topic 254 62.03 Topic 279 9.74
Topic 255 2.27 Topic 280 46.41 0
Topic 256 80.04 Topic 281 32.42
Topic 257 18.54 Topic 282 0.50
−0.5
Topic 258 2.05 Topic 283 66.62
Topic 259 2.65 Topic 284 66.61
Topic 260 50.70 Topic 285 61.66 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.07 Topic 286 4.96 Topic Number
Topic 262 25.21 Topic 287 42.13
Topic 263 36.49 Topic 288 13.69
CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300)
Topic 264 79.52 Topic 289 64.42 1
Topic 265 30.52 Topic 290 19.23 UHIFR2
Difference (average precision)
Topic 266 3.34 Topic 291 61.46
0.5
Topic 267 35.11 Topic 292 10.28
Topic 268 51.61 Topic 293 76.71
Topic 269 37.99 Topic 294 59.12 0
Topic 270 60.88 Topic 295 49.14
Topic 271 83.93 Topic 296 27.92
Topic 272 7.53 Topic 297 63.01 −0.5
Topic 273 55.81 Topic 298 52.57
Topic 274 85.12 Topic 299 6.51
−1
Topic 275 52.31 Topic 300 12.67 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.255
hildesheim UHIFR3 AH-Monolingual-FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 1,816 Pooled= false
CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 58.44 UHIFR3
90%
10 47.32
20 41.56 80%
30 36.97
70%
40 32.76
50 27.28
Average Precision
60%
60 23.03
50%
70 18.27
80 13.97 40%
90 10.15
30%
100 3.46
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
27.04
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 41.20 UHIFR3
90%
10 docs 39.40
15 docs 36.53 80%
20 docs 34.20
70%
30 docs 31.20
100 docs 18.94 60%
R−Precision
200 docs 12.68
50%
500 docs 6.52
1000 docs 3.63 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
29.55 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275)
queries 1
UHIFR3
Topic 251 41.93 Topic 276 19.83
Difference (average precision)
Topic 252 3.61 Topic 277 48.93 0.5
Topic 253 2.47 Topic 278 57.63
Topic 254 61.51 Topic 279 7.96
Topic 255 0.00 Topic 280 3.38 0
Topic 256 97.65 Topic 281 20.72
Topic 257 22.50 Topic 282 0.72
−0.5
Topic 258 2.88 Topic 283 69.25
Topic 259 2.67 Topic 284 23.00
Topic 260 31.28 Topic 285 34.39 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.00 Topic 286 4.26 Topic Number
Topic 262 28.58 Topic 287 2.27
Topic 263 24.94 Topic 288 4.05
CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300)
Topic 264 45.34 Topic 289 60.09 1
Topic 265 9.89 Topic 290 6.92 UHIFR3
Difference (average precision)
Topic 266 1.51 Topic 291 50.31
0.5
Topic 267 39.69 Topic 292 22.68
Topic 268 36.40 Topic 293 51.23
Topic 269 12.74 Topic 294 37.20 0
Topic 270 54.36 Topic 295 39.00
Topic 271 72.15 Topic 296 0.02
Topic 272 4.46 Topic 297 50.20 −0.5
Topic 273 5.20 Topic 298 20.98
Topic 274 58.36 Topic 299 0.02
−1
Topic 275 47.64 Topic 300 9.41 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.256
hildesheim UHIFR4 AH-Monolingual-FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 1,851 Pooled= false
CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 59.61 UHIFR4
90%
10 47.64
20 42.35 80%
30 37.46
70%
40 33.12
50 27.89
Average Precision
60%
60 23.54
50%
70 18.62
80 14.15 40%
90 10.37
30%
100 3.71
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
27.36
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 40.40 UHIFR4
90%
10 docs 40.60
15 docs 37.47 80%
20 docs 34.90
70%
30 docs 31.40
100 docs 19.20 60%
R−Precision
200 docs 12.80
50%
500 docs 6.66
1000 docs 3.70 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
29.98 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275)
queries 1
UHIFR4
Topic 251 40.36 Topic 276 19.83
Difference (average precision)
Topic 252 10.16 Topic 277 48.93 0.5
Topic 253 6.89 Topic 278 57.63
Topic 254 59.36 Topic 279 7.96
Topic 255 0.00 Topic 280 3.38 0
Topic 256 97.65 Topic 281 20.72
Topic 257 25.07 Topic 282 0.72
−0.5
Topic 258 3.72 Topic 283 69.25
Topic 259 2.67 Topic 284 22.76
Topic 260 31.28 Topic 285 37.97 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.00 Topic 286 4.26 Topic Number
Topic 262 28.58 Topic 287 2.27
Topic 263 24.94 Topic 288 4.05
CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300)
Topic 264 41.15 Topic 289 60.09 1
Topic 265 9.89 Topic 290 6.92 UHIFR4
Difference (average precision)
Topic 266 1.51 Topic 291 50.31
0.5
Topic 267 39.69 Topic 292 22.68
Topic 268 41.79 Topic 293 51.23
Topic 269 13.18 Topic 294 37.20 0
Topic 270 54.36 Topic 295 39.00
Topic 271 72.15 Topic 296 0.02
Topic 272 4.46 Topic 297 50.20 −0.5
Topic 273 5.20 Topic 298 20.98
Topic 274 58.36 Topic 299 0.02
−1
Topic 275 47.86 Topic 300 9.41 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.257
hummingbird humFR05t AH-Monolingual-FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual French
Retrieved 49,041 RunType= automatic
Relevant 2,537 QueryType= T
Relevant retrieved 2,091 Pooled= true
CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 68.04 humFR05t
90%
10 53.79
20 45.23 80%
30 40.84
70%
40 35.46
50 30.44
Average Precision
60%
60 26.12
50%
70 21.33
80 16.42 40%
90 9.78
30%
100 2.06
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
30.17
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 45.60 humFR05t
90%
10 docs 43.60
15 docs 41.60 80%
20 docs 40.70
70%
30 docs 36.80
100 docs 21.94 60%
R−Precision
200 docs 14.64
50%
500 docs 7.57
1000 docs 4.18 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
32.87 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275)
queries 1
humFR05t
Topic 251 4.96 Topic 276 12.76
Difference (average precision)
Topic 252 4.00 Topic 277 51.08 0.5
Topic 253 30.81 Topic 278 53.92
Topic 254 53.55 Topic 279 7.35
Topic 255 2.00 Topic 280 15.41 0
Topic 256 23.84 Topic 281 10.68
Topic 257 27.03 Topic 282 0.03
−0.5
Topic 258 3.51 Topic 283 71.54
Topic 259 0.92 Topic 284 46.13
Topic 260 37.48 Topic 285 59.84 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.00 Topic 286 8.31 Topic Number
Topic 262 30.60 Topic 287 26.13
Topic 263 16.65 Topic 288 3.14
CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300)
Topic 264 67.56 Topic 289 61.44 1
Topic 265 34.64 Topic 290 19.33 humFR05t
Difference (average precision)
Topic 266 17.85 Topic 291 27.54
0.5
Topic 267 36.85 Topic 292 21.05
Topic 268 63.05 Topic 293 69.49
Topic 269 14.87 Topic 294 50.59 0
Topic 270 60.15 Topic 295 42.72
Topic 271 90.28 Topic 296 26.20
Topic 272 3.79 Topic 297 65.70 −0.5
Topic 273 21.61 Topic 298 27.15
Topic 274 39.10 Topic 299 0.46
−1
Topic 275 30.56 Topic 300 14.77 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.258
hummingbird humFR05td AH-Monolingual-FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 2,266 Pooled= false
CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 72.44 humFR05td
90%
10 59.55
20 55.40 80%
30 50.31
70%
40 43.85
50 39.47
Average Precision
60%
60 33.06
50%
70 27.92
80 21.25 40%
90 12.23
30%
100 3.59
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
36.94
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 54.80 humFR05td
90%
10 docs 49.60
15 docs 47.07 80%
20 docs 45.80
70%
30 docs 41.93
100 docs 26.36 60%
R−Precision
200 docs 17.04
50%
500 docs 8.26
1000 docs 4.53 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
37.86 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275)
queries 1
humFR05td
Topic 251 30.18 Topic 276 21.21
Difference (average precision)
Topic 252 3.32 Topic 277 33.34 0.5
Topic 253 29.33 Topic 278 39.81
Topic 254 58.08 Topic 279 6.96
Topic 255 2.44 Topic 280 27.56 0
Topic 256 84.90 Topic 281 43.98
Topic 257 20.72 Topic 282 2.35
−0.5
Topic 258 2.19 Topic 283 72.68
Topic 259 7.87 Topic 284 61.70
Topic 260 49.69 Topic 285 65.02 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.23 Topic 286 7.33 Topic Number
Topic 262 36.27 Topic 287 47.82
Topic 263 29.38 Topic 288 9.63
CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300)
Topic 264 70.13 Topic 289 60.68 1
Topic 265 32.84 Topic 290 30.05 humFR05td
Difference (average precision)
Topic 266 32.86 Topic 291 42.60
0.5
Topic 267 45.59 Topic 292 6.46
Topic 268 72.55 Topic 293 72.44
Topic 269 15.18 Topic 294 67.63 0
Topic 270 61.27 Topic 295 45.95
Topic 271 87.38 Topic 296 21.64
Topic 272 13.41 Topic 297 58.76 −0.5
Topic 273 39.29 Topic 298 46.99
Topic 274 70.50 Topic 299 9.01
−1
Topic 275 35.09 Topic 300 14.77 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.259
hummingbird humFR05tde AH-Monolingual-FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 2,271 Pooled= false
CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 73.01 humFR05tde
90%
10 62.78
20 58.96 80%
30 52.36
70%
40 49.09
50 43.02
Average Precision
60%
60 38.53
50%
70 32.10
80 24.44 40%
90 13.45
30%
100 4.27
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
40.06
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 57.60 humFR05tde
90%
10 docs 52.20
15 docs 49.73 80%
20 docs 47.00
70%
30 docs 43.80
100 docs 28.14 60%
R−Precision
200 docs 18.16
50%
500 docs 8.67
1000 docs 4.54 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
40.87 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275)
queries 1
humFR05tde
Topic 251 29.01 Topic 276 19.08
Difference (average precision)
Topic 252 5.41 Topic 277 29.97 0.5
Topic 253 39.79 Topic 278 46.21
Topic 254 63.67 Topic 279 9.93
Topic 255 2.86 Topic 280 31.71 0
Topic 256 86.37 Topic 281 47.99
Topic 257 22.21 Topic 282 1.59
−0.5
Topic 258 1.37 Topic 283 78.74
Topic 259 6.07 Topic 284 62.05
Topic 260 54.54 Topic 285 60.28 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.42 Topic 286 5.59 Topic Number
Topic 262 39.41 Topic 287 53.19
Topic 263 41.64 Topic 288 13.63
CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300)
Topic 264 75.20 Topic 289 73.38 1
Topic 265 31.23 Topic 290 46.52 humFR05tde
Difference (average precision)
Topic 266 36.17 Topic 291 41.33
0.5
Topic 267 48.69 Topic 292 9.26
Topic 268 65.40 Topic 293 69.47
Topic 269 24.06 Topic 294 69.43 0
Topic 270 70.89 Topic 295 47.36
Topic 271 87.74 Topic 296 28.69
Topic 272 11.63 Topic 297 63.56 −0.5
Topic 273 56.54 Topic 298 44.78
Topic 274 78.02 Topic 299 5.92
−1
Topic 275 50.55 Topic 300 14.52 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.260
jhu-apl aplmofra AH-Monolingual-FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 2,422 Pooled= true
CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 69.77 aplmofra
90%
10 62.68
20 56.52 80%
30 51.45
70%
40 48.55
50 44.32
Average Precision
60%
60 40.20
50%
70 35.84
80 30.95 40%
90 22.27
30%
100 9.89
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
42.14
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 54.40 aplmofra
90%
10 docs 51.00
15 docs 48.53 80%
20 docs 46.60
70%
30 docs 44.00
100 docs 29.48 60%
R−Precision
200 docs 19.20
50%
500 docs 9.02
1000 docs 4.84 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
40.47 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275)
queries 1
aplmofra
Topic 251 37.93 Topic 276 30.52
Difference (average precision)
Topic 252 7.82 Topic 277 48.93 0.5
Topic 253 66.07 Topic 278 46.72
Topic 254 64.10 Topic 279 7.30
Topic 255 0.94 Topic 280 33.13 0
Topic 256 90.32 Topic 281 32.04
Topic 257 20.70 Topic 282 1.88
−0.5
Topic 258 1.25 Topic 283 75.14
Topic 259 11.60 Topic 284 66.40
Topic 260 58.91 Topic 285 70.52 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.10 Topic 286 4.38 Topic Number
Topic 262 31.78 Topic 287 48.91
Topic 263 41.50 Topic 288 11.38
CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300)
Topic 264 82.38 Topic 289 66.92 1
Topic 265 26.18 Topic 290 56.13 aplmofra
Difference (average precision)
Topic 266 9.69 Topic 291 56.77
0.5
Topic 267 47.04 Topic 292 7.04
Topic 268 69.88 Topic 293 77.78
Topic 269 30.92 Topic 294 60.91 0
Topic 270 63.08 Topic 295 48.37
Topic 271 86.53 Topic 296 31.04
Topic 272 9.71 Topic 297 74.64 −0.5
Topic 273 65.20 Topic 298 58.55
Topic 274 92.19 Topic 299 0.70
−1
Topic 275 62.32 Topic 300 12.46 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.261
jhu-apl aplmofrb AH-Monolingual-FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 2,427 Pooled= false
CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 70.94 aplmofrb
90%
10 62.59
20 56.52 80%
30 51.43
70%
40 48.04
50 43.31
Average Precision
60%
60 38.78
50%
70 33.84
80 28.52 40%
90 20.21
30%
100 8.70
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
41.22
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 54.40 aplmofrb
90%
10 docs 52.80
15 docs 49.47 80%
20 docs 47.80
70%
30 docs 44.00
100 docs 28.82 60%
R−Precision
200 docs 18.33
50%
500 docs 8.82
1000 docs 4.85 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
39.95 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275)
queries 1
aplmofrb
Topic 251 39.36 Topic 276 26.93
Difference (average precision)
Topic 252 4.58 Topic 277 48.59 0.5
Topic 253 56.37 Topic 278 44.13
Topic 254 35.93 Topic 279 4.74
Topic 255 0.96 Topic 280 46.68 0
Topic 256 90.38 Topic 281 26.76
Topic 257 18.01 Topic 282 3.80
−0.5
Topic 258 1.19 Topic 283 74.55
Topic 259 8.26 Topic 284 74.45
Topic 260 58.18 Topic 285 68.06 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.06 Topic 286 1.65 Topic Number
Topic 262 29.92 Topic 287 47.98
Topic 263 38.01 Topic 288 8.08
CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300)
Topic 264 84.99 Topic 289 67.34 1
Topic 265 23.40 Topic 290 48.92 aplmofrb
Difference (average precision)
Topic 266 35.61 Topic 291 58.08
0.5
Topic 267 39.45 Topic 292 7.09
Topic 268 72.38 Topic 293 77.48
Topic 269 27.95 Topic 294 58.91 0
Topic 270 61.22 Topic 295 51.34
Topic 271 86.86 Topic 296 32.00
Topic 272 10.05 Topic 297 74.32 −0.5
Topic 273 67.88 Topic 298 44.89
Topic 274 85.84 Topic 299 7.92
−1
Topic 275 64.99 Topic 300 14.26 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.262
jhu-apl aplmofrc AH-Monolingual-FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 2,283 Pooled= false
CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 69.50 aplmofrc
90%
10 59.90
20 52.22 80%
30 46.82
70%
40 42.61
50 38.76
Average Precision
60%
60 35.28
50%
70 30.20
80 26.09 40%
90 17.02
30%
100 7.52
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
37.65
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 52.80 aplmofrc
90%
10 docs 48.80
15 docs 46.27 80%
20 docs 43.80
70%
30 docs 40.40
100 docs 26.56 60%
R−Precision
200 docs 17.05
50%
500 docs 8.18
1000 docs 4.57 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
37.29 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275)
queries 1
aplmofrc
Topic 251 39.16 Topic 276 30.64
Difference (average precision)
Topic 252 1.55 Topic 277 48.57 0.5
Topic 253 56.61 Topic 278 34.59
Topic 254 22.67 Topic 279 2.23
Topic 255 0.69 Topic 280 38.64 0
Topic 256 90.58 Topic 281 20.99
Topic 257 13.58 Topic 282 4.53
−0.5
Topic 258 1.25 Topic 283 71.96
Topic 259 10.92 Topic 284 67.18
Topic 260 56.98 Topic 285 69.47 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.02 Topic 286 1.58 Topic Number
Topic 262 29.19 Topic 287 25.64
Topic 263 36.65 Topic 288 7.81
CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300)
Topic 264 80.21 Topic 289 66.36 1
Topic 265 25.55 Topic 290 35.66 aplmofrc
Difference (average precision)
Topic 266 12.10 Topic 291 56.21
0.5
Topic 267 47.64 Topic 292 4.81
Topic 268 62.78 Topic 293 76.13
Topic 269 25.19 Topic 294 55.21 0
Topic 270 59.11 Topic 295 46.10
Topic 271 86.51 Topic 296 30.38
Topic 272 10.20 Topic 297 70.53 −0.5
Topic 273 60.87 Topic 298 19.51
Topic 274 88.26 Topic 299 4.90
−1
Topic 275 61.07 Topic 300 13.57 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.263
jhu-apl aplmofre AH-Monolingual-FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 2,274 Pooled= false
CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 68.60 aplmofre
90%
10 60.82
20 52.48 80%
30 47.60
70%
40 42.99
50 39.28
Average Precision
60%
60 35.88
50%
70 30.51
80 26.28 40%
90 17.35
30%
100 7.18
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
38.01
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 53.60 aplmofre
90%
10 docs 49.80
15 docs 45.47 80%
20 docs 43.40
70%
30 docs 41.13
100 docs 26.88 60%
R−Precision
200 docs 17.49
50%
500 docs 8.38
1000 docs 4.55 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
37.94 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275)
queries 1
aplmofre
Topic 251 38.21 Topic 276 27.27
Difference (average precision)
Topic 252 4.71 Topic 277 49.33 0.5
Topic 253 60.41 Topic 278 39.40
Topic 254 50.05 Topic 279 3.83
Topic 255 0.81 Topic 280 21.29 0
Topic 256 90.36 Topic 281 23.33
Topic 257 16.19 Topic 282 2.35
−0.5
Topic 258 1.39 Topic 283 72.40
Topic 259 12.85 Topic 284 60.35
Topic 260 57.72 Topic 285 69.59 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.08 Topic 286 3.33 Topic Number
Topic 262 28.05 Topic 287 25.02
Topic 263 36.12 Topic 288 8.69
CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300)
Topic 264 77.05 Topic 289 67.03 1
Topic 265 27.02 Topic 290 48.10 aplmofre
Difference (average precision)
Topic 266 2.14 Topic 291 54.29
0.5
Topic 267 50.81 Topic 292 3.97
Topic 268 61.85 Topic 293 76.34
Topic 269 27.87 Topic 294 58.51 0
Topic 270 60.11 Topic 295 44.01
Topic 271 85.90 Topic 296 28.53
Topic 272 10.04 Topic 297 68.85 −0.5
Topic 273 56.01 Topic 298 34.46
Topic 274 85.66 Topic 299 0.09
−1
Topic 275 57.49 Topic 300 11.05 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.264
miracle aHRSR AH-Monolingual-FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TDN
Relevant retrieved 2,304 Pooled= false
CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 74.86 aHRSR
90%
10 65.43
20 57.05 80%
30 51.65
70%
40 44.85
50 40.68
Average Precision
60%
60 34.60
50%
70 28.64
80 21.32 40%
90 13.30
30%
100 3.98
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
38.33
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 55.60 aHRSR
90%
10 docs 51.40
15 docs 49.87 80%
20 docs 46.60
70%
30 docs 43.00
100 docs 26.94 60%
R−Precision
200 docs 17.58
50%
500 docs 8.48
1000 docs 4.61 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
40.33 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275)
queries 1
aHRSR
Topic 251 26.44 Topic 276 18.60
Difference (average precision)
Topic 252 24.57 Topic 277 46.77 0.5
Topic 253 26.68 Topic 278 29.40
Topic 254 57.76 Topic 279 6.36
Topic 255 2.50 Topic 280 40.29 0
Topic 256 61.63 Topic 281 40.64
Topic 257 22.92 Topic 282 1.81
−0.5
Topic 258 1.72 Topic 283 63.38
Topic 259 2.54 Topic 284 59.33
Topic 260 25.08 Topic 285 61.10 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 29.07 Topic 286 12.17 Topic Number
Topic 262 16.22 Topic 287 51.16
Topic 263 34.18 Topic 288 12.34
CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300)
Topic 264 64.66 Topic 289 71.61 1
Topic 265 25.69 Topic 290 31.50 aHRSR
Difference (average precision)
Topic 266 39.50 Topic 291 54.99
0.5
Topic 267 47.15 Topic 292 10.40
Topic 268 78.94 Topic 293 65.80
Topic 269 23.64 Topic 294 65.43 0
Topic 270 54.87 Topic 295 49.20
Topic 271 87.02 Topic 296 35.47
Topic 272 14.00 Topic 297 61.26 −0.5
Topic 273 68.04 Topic 298 49.15
Topic 274 73.76 Topic 299 7.93
−1
Topic 275 49.69 Topic 300 11.96 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.265
miracle aHRSRxNP01HR1 AH-Monolingual-FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TDN
Relevant retrieved 2,207 Pooled= true
CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 73.47 aHRSRxNP01HR1
90%
10 64.34
20 56.85 80%
30 49.15
70%
40 43.14
50 39.71
Average Precision
60%
60 32.76
50%
70 27.08
80 19.98 40%
90 11.55
30%
100 2.89
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
36.75
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 54.00 aHRSRxNP01HR1
90%
10 docs 49.00
15 docs 47.87 80%
20 docs 45.80
70%
30 docs 42.40
100 docs 26.24 60%
R−Precision
200 docs 17.18
50%
500 docs 8.41
1000 docs 4.41 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
39.39 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275)
queries 1
aHRSRxNP01HR1
Topic 251 23.28 Topic 276 16.42
Difference (average precision)
Topic 252 24.30 Topic 277 46.60 0.5
Topic 253 27.11 Topic 278 25.04
Topic 254 56.11 Topic 279 6.07
Topic 255 2.56 Topic 280 38.42 0
Topic 256 54.44 Topic 281 39.71
Topic 257 22.58 Topic 282 1.18
−0.5
Topic 258 2.51 Topic 283 63.13
Topic 259 2.33 Topic 284 56.79
Topic 260 21.90 Topic 285 59.24 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 28.29 Topic 286 11.18 Topic Number
Topic 262 13.86 Topic 287 46.97
Topic 263 30.06 Topic 288 11.26
CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300)
Topic 264 63.38 Topic 289 73.30 1
Topic 265 24.87 Topic 290 29.25 aHRSRxNP01HR1
Difference (average precision)
Topic 266 38.14 Topic 291 54.40
0.5
Topic 267 45.13 Topic 292 7.96
Topic 268 76.63 Topic 293 63.78
Topic 269 22.29 Topic 294 64.12 0
Topic 270 50.80 Topic 295 49.30
Topic 271 86.27 Topic 296 34.34
Topic 272 14.05 Topic 297 61.57 −0.5
Topic 273 66.71 Topic 298 47.10
Topic 274 71.18 Topic 299 4.98
−1
Topic 275 45.83 Topic 300 10.93 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.266
miracle aHTST AH-Monolingual-FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 2,242 Pooled= false
CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 69.51 aHTST
90%
10 58.72
20 54.43 80%
30 49.79
70%
40 45.60
50 39.27
Average Precision
60%
60 33.03
50%
70 27.68
80 21.62 40%
90 13.93
30%
100 5.01
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
36.92
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 52.40 aHTST
90%
10 docs 51.40
15 docs 48.00 80%
20 docs 46.20
70%
30 docs 41.60
100 docs 26.14 60%
R−Precision
200 docs 17.09
50%
500 docs 8.34
1000 docs 4.48 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
38.32 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275)
queries 1
aHTST
Topic 251 28.83 Topic 276 19.26
Difference (average precision)
Topic 252 7.00 Topic 277 40.86 0.5
Topic 253 5.97 Topic 278 42.25
Topic 254 57.02 Topic 279 5.72
Topic 255 1.05 Topic 280 31.15 0
Topic 256 81.39 Topic 281 35.21
Topic 257 17.65 Topic 282 3.90
−0.5
Topic 258 4.01 Topic 283 64.47
Topic 259 4.41 Topic 284 69.01
Topic 260 33.47 Topic 285 59.88 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.12 Topic 286 8.01 Topic Number
Topic 262 21.38 Topic 287 54.14
Topic 263 40.28 Topic 288 14.34
CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300)
Topic 264 71.48 Topic 289 64.83 1
Topic 265 27.52 Topic 290 32.49 aHTST
Difference (average precision)
Topic 266 31.21 Topic 291 53.24
0.5
Topic 267 48.89 Topic 292 8.02
Topic 268 67.11 Topic 293 71.10
Topic 269 18.73 Topic 294 65.33 0
Topic 270 62.97 Topic 295 50.32
Topic 271 89.50 Topic 296 25.68
Topic 272 14.37 Topic 297 55.65 −0.5
Topic 273 52.06 Topic 298 51.91
Topic 274 71.67 Topic 299 9.87
−1
Topic 275 39.45 Topic 300 11.57 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.267
miracle xNP01r1SR1 AH-Monolingual-FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TDN
Relevant retrieved 1,811 Pooled= false
CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 73.41 xNP01r1SR1
90%
10 55.87
20 43.42 80%
30 34.85
70%
40 29.46
50 25.57
Average Precision
60%
60 19.67
50%
70 13.63
80 9.53 40%
90 4.55
30%
100 1.09
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
26.36
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 51.60 xNP01r1SR1
90%
10 docs 45.80
15 docs 40.53 80%
20 docs 37.70
70%
30 docs 32.13
100 docs 19.02 60%
R−Precision
200 docs 12.53
50%
500 docs 6.36
1000 docs 3.62 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
28.42 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275)
queries 1
xNP01r1SR1
Topic 251 13.59 Topic 276 10.40
Difference (average precision)
Topic 252 0.83 Topic 277 62.65 0.5
Topic 253 15.43 Topic 278 17.41
Topic 254 19.59 Topic 279 5.31
Topic 255 0.96 Topic 280 34.97 0
Topic 256 59.93 Topic 281 46.60
Topic 257 0.19 Topic 282 0.37
−0.5
Topic 258 0.00 Topic 283 47.95
Topic 259 1.62 Topic 284 43.37
Topic 260 47.99 Topic 285 24.86 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 16.89 Topic 286 19.42 Topic Number
Topic 262 1.00 Topic 287 3.43
Topic 263 37.51 Topic 288 11.52
CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300)
Topic 264 64.26 Topic 289 41.78 1
Topic 265 19.19 Topic 290 0.36 xNP01r1SR1
Difference (average precision)
Topic 266 27.69 Topic 291 39.00
0.5
Topic 267 22.55 Topic 292 0.30
Topic 268 38.25 Topic 293 60.93
Topic 269 25.61 Topic 294 51.46 0
Topic 270 65.23 Topic 295 8.95
Topic 271 46.09 Topic 296 7.20
Topic 272 2.29 Topic 297 18.83 −0.5
Topic 273 51.33 Topic 298 39.80
Topic 274 61.18 Topic 299 5.40
−1
Topic 275 64.58 Topic 300 12.05 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.268
sics sics-fr-b AH-Monolingual-FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 2,136 Pooled= true
CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 68.50 sics−fr−b
90%
10 58.04
20 52.05 80%
30 45.23
70%
40 36.40
50 30.84
Average Precision
60%
60 25.80
50%
70 19.97
80 14.78 40%
90 8.51
30%
100 3.15
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
31.74
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 54.40 sics−fr−b
90%
10 docs 50.20
15 docs 45.47 80%
20 docs 42.10
70%
30 docs 37.60
100 docs 22.94 60%
R−Precision
200 docs 14.93
50%
500 docs 7.65
1000 docs 4.27 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
33.30 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275)
queries 1
sics−fr−b
Topic 251 24.64 Topic 276 17.04
Difference (average precision)
Topic 252 4.48 Topic 277 26.91 0.5
Topic 253 28.05 Topic 278 41.16
Topic 254 52.44 Topic 279 7.56
Topic 255 3.57 Topic 280 0.53 0
Topic 256 86.63 Topic 281 38.06
Topic 257 11.61 Topic 282 2.11
−0.5
Topic 258 5.15 Topic 283 49.54
Topic 259 7.31 Topic 284 59.22
Topic 260 43.74 Topic 285 43.24 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.12 Topic 286 7.03 Topic Number
Topic 262 20.68 Topic 287 41.11
Topic 263 30.73 Topic 288 4.57
CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300)
Topic 264 71.47 Topic 289 58.31 1
Topic 265 34.42 Topic 290 25.73 sics−fr−b
Difference (average precision)
Topic 266 26.65 Topic 291 39.03
0.5
Topic 267 58.25 Topic 292 8.99
Topic 268 64.41 Topic 293 29.41
Topic 269 14.05 Topic 294 67.86 0
Topic 270 57.67 Topic 295 44.09
Topic 271 84.49 Topic 296 12.62
Topic 272 15.35 Topic 297 43.89 −0.5
Topic 273 35.87 Topic 298 48.84
Topic 274 35.47 Topic 299 6.52
−1
Topic 275 34.22 Topic 300 12.15 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.269
sics sics-fr-k AH-Monolingual-FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 2,128 Pooled= false
CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 72.26 sics−fr−k
90%
10 58.94
20 52.37 80%
30 45.50
70%
40 38.25
50 34.44
Average Precision
60%
60 26.91
50%
70 20.98
80 14.04 40%
90 8.46
30%
100 2.84
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
32.71
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 53.20 sics−fr−k
90%
10 docs 50.60
15 docs 46.80 80%
20 docs 42.70
70%
30 docs 38.33
100 docs 23.48 60%
R−Precision
200 docs 15.37
50%
500 docs 7.79
1000 docs 4.26 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
34.66 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275)
queries 1
sics−fr−k
Topic 251 27.20 Topic 276 10.37
Difference (average precision)
Topic 252 2.42 Topic 277 43.53 0.5
Topic 253 21.89 Topic 278 39.96
Topic 254 59.10 Topic 279 7.77
Topic 255 5.88 Topic 280 1.57 0
Topic 256 82.36 Topic 281 46.17
Topic 257 14.07 Topic 282 1.61
−0.5
Topic 258 4.98 Topic 283 40.25
Topic 259 8.63 Topic 284 55.93
Topic 260 41.47 Topic 285 58.23 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.05 Topic 286 4.01 Topic Number
Topic 262 34.42 Topic 287 48.52
Topic 263 27.99 Topic 288 5.50
CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300)
Topic 264 71.27 Topic 289 58.61 1
Topic 265 32.21 Topic 290 28.47 sics−fr−k
Difference (average precision)
Topic 266 34.67 Topic 291 37.49
0.5
Topic 267 49.95 Topic 292 12.79
Topic 268 49.29 Topic 293 28.66
Topic 269 15.58 Topic 294 66.13 0
Topic 270 61.44 Topic 295 43.23
Topic 271 82.44 Topic 296 11.01
Topic 272 20.55 Topic 297 43.09 −0.5
Topic 273 46.82 Topic 298 44.95
Topic 274 39.31 Topic 299 10.03
−1
Topic 275 42.10 Topic 300 11.74 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.270
sics sics-fr-van AH-Monolingual-FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 2,118 Pooled= false
CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 68.72 sics−fr−van
90%
10 57.05
20 51.12 80%
30 45.10
70%
40 36.26
50 31.27
Average Precision
60%
60 25.38
50%
70 19.43
80 13.77 40%
90 8.68
30%
100 3.23
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
31.35
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 52.80 sics−fr−van
90%
10 docs 49.00
15 docs 45.20 80%
20 docs 42.00
70%
30 docs 38.00
100 docs 22.90 60%
R−Precision
200 docs 14.66
50%
500 docs 7.54
1000 docs 4.24 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
33.15 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275)
queries 1
sics−fr−van
Topic 251 24.64 Topic 276 16.99
Difference (average precision)
Topic 252 4.35 Topic 277 28.73 0.5
Topic 253 26.19 Topic 278 36.42
Topic 254 49.62 Topic 279 7.63
Topic 255 3.70 Topic 280 1.05 0
Topic 256 84.68 Topic 281 44.51
Topic 257 11.47 Topic 282 2.16
−0.5
Topic 258 4.41 Topic 283 50.51
Topic 259 7.65 Topic 284 58.23
Topic 260 42.82 Topic 285 42.93 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.23 Topic 286 6.99 Topic Number
Topic 262 20.03 Topic 287 41.04
Topic 263 30.70 Topic 288 4.82
CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300)
Topic 264 71.24 Topic 289 57.68 1
Topic 265 32.45 Topic 290 23.21 sics−fr−van
Difference (average precision)
Topic 266 26.13 Topic 291 37.42
0.5
Topic 267 55.99 Topic 292 7.78
Topic 268 64.41 Topic 293 29.53
Topic 269 14.65 Topic 294 66.86 0
Topic 270 57.09 Topic 295 42.64
Topic 271 83.54 Topic 296 13.71
Topic 272 21.43 Topic 297 43.15 −0.5
Topic 273 30.28 Topic 298 48.10
Topic 274 32.55 Topic 299 7.79
−1
Topic 275 35.40 Topic 300 11.98 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.271
tlr tlrTDfr3 AH-Monolingual-FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 2,275 Pooled= false
CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 73.09 tlrTDfr3
90%
10 60.52
20 55.05 80%
30 51.19
70%
40 45.36
50 40.68
Average Precision
60%
60 32.96
50%
70 26.15
80 20.28 40%
90 14.86
30%
100 5.17
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
37.35
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 52.40 tlrTDfr3
90%
10 docs 50.20
15 docs 45.73 80%
20 docs 43.50
70%
30 docs 40.07
100 docs 25.62 60%
R−Precision
200 docs 16.62
50%
500 docs 8.25
1000 docs 4.55 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
38.79 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275)
queries 1
tlrTDfr3
Topic 251 29.03 Topic 276 22.16
Difference (average precision)
Topic 252 4.64 Topic 277 29.62 0.5
Topic 253 33.78 Topic 278 58.51
Topic 254 45.83 Topic 279 7.00
Topic 255 0.75 Topic 280 17.40 0
Topic 256 79.69 Topic 281 45.62
Topic 257 15.38 Topic 282 2.44
−0.5
Topic 258 57.14 Topic 283 76.24
Topic 259 7.75 Topic 284 53.01
Topic 260 41.30 Topic 285 58.93 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.06 Topic 286 7.43 Topic Number
Topic 262 32.67 Topic 287 43.55
Topic 263 33.40 Topic 288 6.49
CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300)
Topic 264 67.84 Topic 289 62.57 1
Topic 265 35.30 Topic 290 25.50 tlrTDfr3
Difference (average precision)
Topic 266 36.11 Topic 291 39.91
0.5
Topic 267 57.43 Topic 292 6.65
Topic 268 81.07 Topic 293 63.56
Topic 269 13.72 Topic 294 60.82 0
Topic 270 61.29 Topic 295 39.65
Topic 271 89.54 Topic 296 24.64
Topic 272 13.21 Topic 297 50.34 −0.5
Topic 273 45.16 Topic 298 51.88
Topic 274 66.51 Topic 299 11.13
−1
Topic 275 41.81 Topic 300 11.87 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.272
tlr tlrTDfrRFS1 AH-Monolingual-FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 2,333 Pooled= true
CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 73.89 tlrTDfrRFS1
90%
10 63.04
20 54.55 80%
30 51.43
70%
40 47.31
50 43.16
Average Precision
60%
60 38.18
50%
70 32.15
80 24.43 40%
90 18.31
30%
100 5.68
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
40.00
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 56.40 tlrTDfrRFS1
90%
10 docs 51.00
15 docs 47.47 80%
20 docs 45.10
70%
30 docs 41.93
100 docs 27.28 60%
R−Precision
200 docs 17.84
50%
500 docs 8.66
1000 docs 4.67 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
39.90 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275)
queries 1
tlrTDfrRFS1
Topic 251 29.03 Topic 276 16.55
Difference (average precision)
Topic 252 6.10 Topic 277 37.98 0.5
Topic 253 33.78 Topic 278 60.91
Topic 254 55.74 Topic 279 13.04
Topic 255 0.79 Topic 280 24.32 0
Topic 256 82.32 Topic 281 49.13
Topic 257 16.98 Topic 282 1.91
−0.5
Topic 258 19.17 Topic 283 77.83
Topic 259 11.36 Topic 284 56.90
Topic 260 59.32 Topic 285 58.93 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.05 Topic 286 7.74 Topic Number
Topic 262 32.68 Topic 287 53.71
Topic 263 44.10 Topic 288 4.87
CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300)
Topic 264 79.24 Topic 289 72.82 1
Topic 265 39.26 Topic 290 16.93 tlrTDfrRFS1
Difference (average precision)
Topic 266 36.11 Topic 291 40.26
0.5
Topic 267 47.38 Topic 292 7.92
Topic 268 57.48 Topic 293 71.96
Topic 269 15.19 Topic 294 60.53 0
Topic 270 76.68 Topic 295 39.65
Topic 271 88.16 Topic 296 26.88
Topic 272 21.53 Topic 297 67.36 −0.5
Topic 273 64.97 Topic 298 53.61
Topic 274 86.06 Topic 299 9.46
−1
Topic 275 51.75 Topic 300 13.76 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.273
u.glasgow glafrtdn AH-Monolingual-FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TDN
Relevant retrieved 2,052 Pooled= false
CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 68.60 glafrtdn
90%
10 57.53
20 49.62 80%
30 44.02
70%
40 37.78
50 32.84
Average Precision
60%
60 26.86
50%
70 21.56
80 16.41 40%
90 10.21
30%
100 3.66
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
32.06
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 50.80 glafrtdn
90%
10 docs 49.40
15 docs 46.40 80%
20 docs 43.00
70%
30 docs 38.47
100 docs 23.06 60%
R−Precision
200 docs 15.07
50%
500 docs 7.44
1000 docs 4.10 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
35.32 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275)
queries 1
glafrtdn
Topic 251 11.04 Topic 276 13.00
Difference (average precision)
Topic 252 29.35 Topic 277 49.38 0.5
Topic 253 21.35 Topic 278 13.08
Topic 254 52.99 Topic 279 0.51
Topic 255 1.96 Topic 280 32.64 0
Topic 256 68.94 Topic 281 33.71
Topic 257 7.75 Topic 282 1.55
−0.5
Topic 258 1.24 Topic 283 60.69
Topic 259 4.94 Topic 284 51.30
Topic 260 42.95 Topic 285 63.49 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 6.36 Topic 286 15.36 Topic Number
Topic 262 0.40 Topic 287 42.47
Topic 263 34.47 Topic 288 13.82
CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300)
Topic 264 62.15 Topic 289 62.87 1
Topic 265 19.68 Topic 290 0.23 glafrtdn
Difference (average precision)
Topic 266 36.53 Topic 291 44.61
0.5
Topic 267 35.02 Topic 292 13.98
Topic 268 55.20 Topic 293 36.64
Topic 269 11.33 Topic 294 67.24 0
Topic 270 44.15 Topic 295 45.74
Topic 271 90.94 Topic 296 31.77
Topic 272 10.87 Topic 297 49.68 −0.5
Topic 273 62.30 Topic 298 32.44
Topic 274 57.61 Topic 299 3.99
−1
Topic 275 39.33 Topic 300 13.77 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.274
u.glasgow glafrtdqe1 AH-Monolingual-FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 2,269 Pooled= true
CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 77.50 glafrtdqe1
90%
10 66.83
20 56.62 80%
30 50.51
70%
40 45.67
50 41.06
Average Precision
60%
60 36.42
50%
70 31.96
80 24.38 40%
90 18.45
30%
100 7.36
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
40.17
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 57.60 glafrtdqe1
90%
10 docs 52.40
15 docs 49.60 80%
20 docs 48.00
70%
30 docs 43.33
100 docs 27.14 60%
R−Precision
200 docs 17.64
50%
500 docs 8.44
1000 docs 4.54 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
39.69 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275)
queries 1
glafrtdqe1
Topic 251 18.45 Topic 276 18.42
Difference (average precision)
Topic 252 47.88 Topic 277 53.58 0.5
Topic 253 40.99 Topic 278 22.91
Topic 254 55.05 Topic 279 2.36
Topic 255 1.82 Topic 280 40.05 0
Topic 256 86.62 Topic 281 40.74
Topic 257 9.78 Topic 282 4.20
−0.5
Topic 258 4.08 Topic 283 77.69
Topic 259 3.76 Topic 284 59.08
Topic 260 64.16 Topic 285 66.96 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 9.27 Topic 286 27.67 Topic Number
Topic 262 0.27 Topic 287 54.58
Topic 263 42.20 Topic 288 6.83
CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300)
Topic 264 79.97 Topic 289 74.24 1
Topic 265 22.49 Topic 290 0.22 glafrtdqe1
Difference (average precision)
Topic 266 36.24 Topic 291 45.04
0.5
Topic 267 30.58 Topic 292 21.47
Topic 268 58.81 Topic 293 47.74
Topic 269 20.36 Topic 294 63.33 0
Topic 270 63.20 Topic 295 47.49
Topic 271 90.00 Topic 296 41.29
Topic 272 46.47 Topic 297 64.69 −0.5
Topic 273 71.71 Topic 298 58.73
Topic 274 71.94 Topic 299 12.94
−1
Topic 275 68.57 Topic 300 11.51 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.275
u.glasgow glafrtdqe2 AH-Monolingual-FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 2,245 Pooled= false
CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 69.91 glafrtdqe2
90%
10 61.95
20 53.82 80%
30 48.84
70%
40 43.60
50 39.39
Average Precision
60%
60 34.58
50%
70 29.92
80 23.77 40%
90 16.60
30%
100 5.85
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
37.65
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 53.20 glafrtdqe2
90%
10 docs 50.00
15 docs 47.73 80%
20 docs 45.70
70%
30 docs 40.73
100 docs 26.26 60%
R−Precision
200 docs 17.04
50%
500 docs 8.33
1000 docs 4.49 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
37.67 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275)
queries 1
glafrtdqe2
Topic 251 5.47 Topic 276 14.59
Difference (average precision)
Topic 252 43.66 Topic 277 54.03 0.5
Topic 253 41.27 Topic 278 19.10
Topic 254 53.65 Topic 279 0.31
Topic 255 1.52 Topic 280 35.29 0
Topic 256 76.94 Topic 281 36.46
Topic 257 7.46 Topic 282 2.24
−0.5
Topic 258 0.73 Topic 283 67.38
Topic 259 3.52 Topic 284 59.44
Topic 260 63.81 Topic 285 63.76 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 8.88 Topic 286 9.14 Topic Number
Topic 262 0.25 Topic 287 36.78
Topic 263 45.68 Topic 288 8.96
CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300)
Topic 264 80.72 Topic 289 67.70 1
Topic 265 20.12 Topic 290 0.27 glafrtdqe2
Difference (average precision)
Topic 266 36.22 Topic 291 47.00
0.5
Topic 267 31.48 Topic 292 21.40
Topic 268 59.38 Topic 293 39.17
Topic 269 23.63 Topic 294 65.43 0
Topic 270 59.63 Topic 295 46.60
Topic 271 89.16 Topic 296 37.65
Topic 272 39.09 Topic 297 63.15 −0.5
Topic 273 72.03 Topic 298 59.46
Topic 274 77.39 Topic 299 8.56
−1
Topic 275 65.32 Topic 300 11.81 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.276
u.surugadai SrgdMono01 AH-Monolingual-FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 2,380 Pooled= true
CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 69.05 SrgdMono01
90%
10 63.19
20 56.35 80%
30 50.97
70%
40 45.87
50 41.57
Average Precision
60%
60 37.23
50%
70 30.29
80 25.21 40%
90 15.59
30%
100 4.40
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
39.10
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 54.80 SrgdMono01
90%
10 docs 52.60
15 docs 49.87 80%
20 docs 48.00
70%
30 docs 43.00
100 docs 28.14 60%
R−Precision
200 docs 18.80
50%
500 docs 9.01
1000 docs 4.76 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
39.98 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275)
queries 1
SrgdMono01
Topic 251 28.53 Topic 276 19.14
Difference (average precision)
Topic 252 11.01 Topic 277 52.79 0.5
Topic 253 65.57 Topic 278 36.95
Topic 254 51.19 Topic 279 8.08
Topic 255 0.89 Topic 280 30.73 0
Topic 256 83.93 Topic 281 31.41
Topic 257 21.88 Topic 282 0.70
−0.5
Topic 258 0.30 Topic 283 68.86
Topic 259 4.87 Topic 284 62.03
Topic 260 54.93 Topic 285 60.20 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.03 Topic 286 2.96 Topic Number
Topic 262 22.99 Topic 287 47.32
Topic 263 24.81 Topic 288 8.64
CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300)
Topic 264 81.26 Topic 289 49.72 1
Topic 265 27.22 Topic 290 41.63 SrgdMono01
Difference (average precision)
Topic 266 23.09 Topic 291 57.15
0.5
Topic 267 48.63 Topic 292 8.91
Topic 268 54.29 Topic 293 71.69
Topic 269 39.46 Topic 294 66.79 0
Topic 270 59.68 Topic 295 44.31
Topic 271 84.82 Topic 296 31.03
Topic 272 9.25 Topic 297 68.64 −0.5
Topic 273 63.42 Topic 298 72.39
Topic 274 79.87 Topic 299 9.62
−1
Topic 275 49.60 Topic 300 11.69 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.277
unine UniNEfr1 AH-Monolingual-FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 2,398 Pooled= true
CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 71.56 UniNEfr1
90%
10 65.96
20 58.04 80%
30 52.99
70%
40 49.28
50 45.15
Average Precision
60%
60 40.62
50%
70 34.64
80 27.58 40%
90 18.90
30%
100 6.04
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
42.07
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 56.80 UniNEfr1
90%
10 docs 54.40
15 docs 51.47 80%
20 docs 49.50
70%
30 docs 45.87
100 docs 29.36 60%
R−Precision
200 docs 18.98
50%
500 docs 9.11
1000 docs 4.80 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
42.81 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275)
queries 1
UniNEfr1
Topic 251 29.28 Topic 276 23.90
Difference (average precision)
Topic 252 15.65 Topic 277 39.24 0.5
Topic 253 59.78 Topic 278 32.50
Topic 254 66.87 Topic 279 8.65
Topic 255 0.73 Topic 280 34.73 0
Topic 256 86.80 Topic 281 49.91
Topic 257 20.52 Topic 282 3.45
−0.5
Topic 258 2.28 Topic 283 77.28
Topic 259 5.39 Topic 284 72.36
Topic 260 61.13 Topic 285 65.40 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.02 Topic 286 6.70 Topic Number
Topic 262 31.81 Topic 287 50.58
Topic 263 41.26 Topic 288 12.81
CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300)
Topic 264 85.20 Topic 289 73.32 1
Topic 265 41.39 Topic 290 45.64 UniNEfr1
Difference (average precision)
Topic 266 32.08 Topic 291 54.53
0.5
Topic 267 41.77 Topic 292 5.99
Topic 268 57.96 Topic 293 72.25
Topic 269 31.22 Topic 294 74.56 0
Topic 270 74.80 Topic 295 47.87
Topic 271 87.95 Topic 296 21.77
Topic 272 17.21 Topic 297 43.85 −0.5
Topic 273 62.64 Topic 298 58.45
Topic 274 88.17 Topic 299 5.69
−1
Topic 275 65.05 Topic 300 15.22 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.278
unine UniNEfr2 AH-Monolingual-FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 2,385 Pooled= false
CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 71.56 UniNEfr2
90%
10 62.67
20 56.97 80%
30 52.52
70%
40 48.16
50 43.67
Average Precision
60%
60 38.64
50%
70 32.46
80 25.14 40%
90 18.48
30%
100 6.09
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
40.51
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 55.60 UniNEfr2
90%
10 docs 53.20
15 docs 50.40 80%
20 docs 48.50
70%
30 docs 43.93
100 docs 28.28 60%
R−Precision
200 docs 18.41
50%
500 docs 9.02
1000 docs 4.77 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
41.57 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275)
queries 1
UniNEfr2
Topic 251 23.32 Topic 276 20.77
Difference (average precision)
Topic 252 13.53 Topic 277 45.12 0.5
Topic 253 66.77 Topic 278 43.72
Topic 254 56.17 Topic 279 8.05
Topic 255 1.20 Topic 280 28.01 0
Topic 256 81.34 Topic 281 48.13
Topic 257 13.29 Topic 282 2.46
−0.5
Topic 258 3.32 Topic 283 79.94
Topic 259 4.23 Topic 284 71.22
Topic 260 59.53 Topic 285 70.21 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.00 Topic 286 9.38 Topic Number
Topic 262 24.28 Topic 287 45.71
Topic 263 39.21 Topic 288 16.30
CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300)
Topic 264 74.48 Topic 289 72.67 1
Topic 265 36.13 Topic 290 25.86 UniNEfr2
Difference (average precision)
Topic 266 37.84 Topic 291 42.46
0.5
Topic 267 39.59 Topic 292 13.45
Topic 268 67.39 Topic 293 72.65
Topic 269 25.95 Topic 294 65.29 0
Topic 270 71.11 Topic 295 44.72
Topic 271 86.03 Topic 296 30.57
Topic 272 22.04 Topic 297 31.97 −0.5
Topic 273 73.24 Topic 298 51.86
Topic 274 87.94 Topic 299 3.31
−1
Topic 275 62.47 Topic 300 11.38 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.279
unine UniNEfr3 AH-Monolingual-FR
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual French
Retrieved 50,000 RunType= automatic
Relevant 2,537 QueryType= TD
Relevant retrieved 2,345 Pooled= false
CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 73.44 UniNEfr3
90%
10 66.83
20 58.11 80%
30 52.38
70%
40 48.32
50 43.72
Average Precision
60%
60 38.58
50%
70 31.42
80 22.69 40%
90 16.05
30%
100 3.81
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
40.66
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 60.40 UniNEfr3
90%
10 docs 55.40
15 docs 52.40 80%
20 docs 50.30
70%
30 docs 44.87
100 docs 28.48 60%
R−Precision
200 docs 18.28
50%
500 docs 8.81
1000 docs 4.69 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
41.96 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275)
queries 1
UniNEfr3
Topic 251 25.12 Topic 276 21.60
Difference (average precision)
Topic 252 13.70 Topic 277 38.68 0.5
Topic 253 54.85 Topic 278 31.39
Topic 254 61.49 Topic 279 8.52
Topic 255 1.04 Topic 280 35.10 0
Topic 256 85.00 Topic 281 50.03
Topic 257 20.08 Topic 282 4.35
−0.5
Topic 258 3.56 Topic 283 73.16
Topic 259 7.29 Topic 284 70.06
Topic 260 51.32 Topic 285 66.74 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.00 Topic 286 8.91 Topic Number
Topic 262 30.41 Topic 287 53.60
Topic 263 39.31 Topic 288 10.54
CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300)
Topic 264 83.39 Topic 289 76.50 1
Topic 265 44.38 Topic 290 39.93 UniNEfr3
Difference (average precision)
Topic 266 31.75 Topic 291 51.50
0.5
Topic 267 47.06 Topic 292 7.07
Topic 268 51.51 Topic 293 74.01
Topic 269 22.64 Topic 294 71.22 0
Topic 270 67.27 Topic 295 42.71
Topic 271 87.81 Topic 296 21.21
Topic 272 28.35 Topic 297 41.11 −0.5
Topic 273 63.75 Topic 298 56.32
Topic 274 79.62 Topic 299 7.27
−1
Topic 275 50.27 Topic 300 20.62 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.280
alicante IRn-hu-fexp AH-Monolingual-HU
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian
Retrieved 50,000 RunType= automatic
Relevant 939 QueryType= TD
Relevant retrieved 828 Pooled= true
CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 59.29 IRn−hu−fexp
90%
10 52.96
20 44.86 80%
30 39.83
70%
40 34.37
50 31.97
Average Precision
60%
60 27.75
50%
70 23.94
80 18.43 40%
90 13.55
30%
100 8.18
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
30.55
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 37.20 IRn−hu−fexp
90%
10 docs 31.60
15 docs 28.53 80%
20 docs 26.20
70%
30 docs 22.60
100 docs 11.30 60%
R−Precision
200 docs 6.71
50%
500 docs 3.12
1000 docs 1.66 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
30.27 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275)
queries 1
IRn−hu−fexp
Topic 251 13.26 Topic 276 22.77
Difference (average precision)
Topic 252 4.63 Topic 277 6.46 0.5
Topic 253 33.53 Topic 278 26.83
Topic 254 43.43 Topic 279 79.01
Topic 255 26.74 Topic 280 6.19 0
Topic 256 64.28 Topic 281 96.74
Topic 257 8.71 Topic 282 3.93
−0.5
Topic 258 17.78 Topic 283 56.97
Topic 259 17.39 Topic 284 1.46
Topic 260 13.28 Topic 285 1.42 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 33.33 Topic 286 5.41 Topic Number
Topic 262 2.83 Topic 287 42.74
Topic 263 0.50 Topic 288 33.69
CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300)
Topic 264 16.61 Topic 289 95.26 1
Topic 265 24.49 Topic 290 60.58 IRn−hu−fexp
Difference (average precision)
Topic 266 13.45 Topic 291 71.04
0.5
Topic 267 35.68 Topic 292 26.82
Topic 268 59.46 Topic 293 88.26
Topic 269 11.57 Topic 294 95.00 0
Topic 270 23.42 Topic 295 27.75
Topic 271 16.96 Topic 296 27.11
Topic 272 7.69 Topic 297 40.63 −0.5
Topic 273 15.88 Topic 298 5.27
Topic 274 51.13 Topic 299 5.39
−1
Topic 275 30.95 Topic 300 13.90 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.281
alicante IRn-hu-vexp AH-Monolingual-HU
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian
Retrieved 50,000 RunType= automatic
Relevant 939 QueryType= TD
Relevant retrieved 838 Pooled= true
CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 64.47 IRn−hu−vexp
90%
10 56.75
20 46.53 80%
30 42.53
70%
40 36.11
50 33.50
Average Precision
60%
60 27.03
50%
70 23.24
80 18.38 40%
90 13.23
30%
100 8.40
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
31.74
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 38.40 IRn−hu−vexp
90%
10 docs 33.60
15 docs 29.33 80%
20 docs 26.70
70%
30 docs 22.73
100 docs 11.34 60%
R−Precision
200 docs 6.82
50%
500 docs 3.16
1000 docs 1.68 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
30.87 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275)
queries 1
IRn−hu−vexp
Topic 251 15.36 Topic 276 26.76
Difference (average precision)
Topic 252 3.94 Topic 277 6.48 0.5
Topic 253 35.60 Topic 278 31.70
Topic 254 45.31 Topic 279 77.41
Topic 255 46.59 Topic 280 5.87 0
Topic 256 62.97 Topic 281 97.39
Topic 257 17.16 Topic 282 4.49
−0.5
Topic 258 17.78 Topic 283 56.67
Topic 259 16.97 Topic 284 1.30
Topic 260 15.14 Topic 285 1.17 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 33.33 Topic 286 7.08 Topic Number
Topic 262 3.29 Topic 287 44.71
Topic 263 2.82 Topic 288 34.95
CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300)
Topic 264 18.79 Topic 289 95.26 1
Topic 265 22.95 Topic 290 63.91 IRn−hu−vexp
Difference (average precision)
Topic 266 15.81 Topic 291 68.01
0.5
Topic 267 34.30 Topic 292 51.72
Topic 268 54.16 Topic 293 87.89
Topic 269 9.93 Topic 294 95.00 0
Topic 270 20.02 Topic 295 27.17
Topic 271 17.06 Topic 296 24.92
Topic 272 3.33 Topic 297 35.60 −0.5
Topic 273 20.97 Topic 298 5.81
Topic 274 37.83 Topic 299 4.48
−1
Topic 275 45.00 Topic 300 14.89 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.282
alicante IRn-hu-vnexp AH-Monolingual-HU
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian
Retrieved 50,000 RunType= automatic
Relevant 939 QueryType= TD
Relevant retrieved 802 Pooled= false
CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 66.84 IRn−hu−vnexp
90%
10 57.54
20 46.69 80%
30 38.21
70%
40 34.72
50 32.50
Average Precision
60%
60 23.98
50%
70 20.41
80 16.00 40%
90 10.71
30%
100 7.22
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
30.36
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 35.60 IRn−hu−vnexp
90%
10 docs 31.60
15 docs 26.53 80%
20 docs 24.50
70%
30 docs 20.40
100 docs 10.24 60%
R−Precision
200 docs 6.22
50%
500 docs 3.03
1000 docs 1.60 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
30.98 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275)
queries 1
IRn−hu−vnexp
Topic 251 12.59 Topic 276 20.69
Difference (average precision)
Topic 252 2.35 Topic 277 3.31 0.5
Topic 253 37.54 Topic 278 31.00
Topic 254 26.50 Topic 279 81.62
Topic 255 50.00 Topic 280 6.29 0
Topic 256 62.32 Topic 281 96.89
Topic 257 6.34 Topic 282 4.19
−0.5
Topic 258 14.07 Topic 283 53.94
Topic 259 17.00 Topic 284 1.86
Topic 260 26.77 Topic 285 12.25 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 16.67 Topic 286 5.29 Topic Number
Topic 262 5.84 Topic 287 24.18
Topic 263 4.28 Topic 288 17.81
CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300)
Topic 264 31.14 Topic 289 90.85 1
Topic 265 17.97 Topic 290 35.65 IRn−hu−vnexp
Difference (average precision)
Topic 266 12.65 Topic 291 68.98
0.5
Topic 267 34.23 Topic 292 27.70
Topic 268 58.28 Topic 293 78.62
Topic 269 14.72 Topic 294 100.00 0
Topic 270 12.41 Topic 295 25.21
Topic 271 23.33 Topic 296 21.47
Topic 272 0.99 Topic 297 55.27 −0.5
Topic 273 17.10 Topic 298 5.51
Topic 274 36.21 Topic 299 26.25
−1
Topic 275 58.33 Topic 300 23.42 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.283
hildesheim UHIHU1 AH-Monolingual-HU
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian
Retrieved 49,401 RunType= automatic
Relevant 939 QueryType= TD
Relevant retrieved 733 Pooled= true
CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 61.49 UHIHU1
90%
10 51.72
20 45.80 80%
30 39.01
70%
40 34.88
50 31.56
Average Precision
60%
60 26.58
50%
70 23.67
80 20.37 40%
90 15.09
30%
100 8.59
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
31.00
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 36.40 UHIHU1
90%
10 docs 29.40
15 docs 26.13 80%
20 docs 22.60
70%
30 docs 19.47
100 docs 9.52 60%
R−Precision
200 docs 5.61
50%
500 docs 2.60
1000 docs 1.47 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
31.13 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275)
queries 1
UHIHU1
Topic 251 14.66 Topic 276 19.94
Difference (average precision)
Topic 252 8.22 Topic 277 0.00 0.5
Topic 253 43.72 Topic 278 33.07
Topic 254 48.03 Topic 279 8.97
Topic 255 100.00 Topic 280 1.51 0
Topic 256 81.62 Topic 281 92.08
Topic 257 33.82 Topic 282 14.76
−0.5
Topic 258 30.00 Topic 283 0.00
Topic 259 35.34 Topic 284 20.32
Topic 260 27.73 Topic 285 71.03 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 16.67 Topic 286 16.36 Topic Number
Topic 262 16.88 Topic 287 27.01
Topic 263 14.43 Topic 288 3.56
CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300)
Topic 264 35.57 Topic 289 87.49 1
Topic 265 17.45 Topic 290 2.95 UHIHU1
Difference (average precision)
Topic 266 3.19 Topic 291 65.07
0.5
Topic 267 71.65 Topic 292 10.14
Topic 268 53.99 Topic 293 0.67
Topic 269 14.29 Topic 294 77.08 0
Topic 270 19.52 Topic 295 18.44
Topic 271 25.93 Topic 296 0.33
Topic 272 0.13 Topic 297 54.69 −0.5
Topic 273 2.19 Topic 298 26.96
Topic 274 82.95 Topic 299 13.35
−1
Topic 275 61.11 Topic 300 25.09 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.284
hildesheim UHIHU2 AH-Monolingual-HU
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian
Retrieved 50,000 RunType= automatic
Relevant 939 QueryType= TD
Relevant retrieved 776 Pooled= true
CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 63.94 UHIHU2
90%
10 54.74
20 47.27 80%
30 41.57
70%
40 36.24
50 32.40
Average Precision
60%
60 28.51
50%
70 25.32
80 21.92 40%
90 16.22
30%
100 9.97
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
32.64
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 40.40 UHIHU2
90%
10 docs 30.60
15 docs 26.67 80%
20 docs 24.00
70%
30 docs 20.60
100 docs 10.18 60%
R−Precision
200 docs 6.03
50%
500 docs 2.81
1000 docs 1.55 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
32.91 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275)
queries 1
UHIHU2
Topic 251 7.97 Topic 276 18.89
Difference (average precision)
Topic 252 9.95 Topic 277 0.00 0.5
Topic 253 44.40 Topic 278 37.91
Topic 254 47.04 Topic 279 9.65
Topic 255 100.00 Topic 280 3.10 0
Topic 256 83.87 Topic 281 92.80
Topic 257 27.81 Topic 282 4.86
−0.5
Topic 258 26.19 Topic 283 0.76
Topic 259 33.81 Topic 284 19.15
Topic 260 27.27 Topic 285 67.11 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 16.76 Topic 286 21.43 Topic Number
Topic 262 22.05 Topic 287 22.35
Topic 263 12.90 Topic 288 3.85
CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300)
Topic 264 35.67 Topic 289 88.82 1
Topic 265 19.27 Topic 290 5.46 UHIHU2
Difference (average precision)
Topic 266 3.14 Topic 291 68.94
0.5
Topic 267 70.95 Topic 292 10.20
Topic 268 58.05 Topic 293 32.27
Topic 269 18.40 Topic 294 80.42 0
Topic 270 31.29 Topic 295 22.89
Topic 271 32.16 Topic 296 0.44
Topic 272 1.96 Topic 297 38.05 −0.5
Topic 273 5.16 Topic 298 37.32
Topic 274 82.13 Topic 299 13.69
−1
Topic 275 83.33 Topic 300 30.25 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.285
hummingbird humHU05t AH-Monolingual-HU
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian
Retrieved 30,646 RunType= automatic
Relevant 939 QueryType= T
Relevant retrieved 626 Pooled= true
CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 65.57 humHU05t
90%
10 51.78
20 42.94 80%
30 35.53
70%
40 30.26
50 28.33
Average Precision
60%
60 21.03
50%
70 17.53
80 14.19 40%
90 7.03
30%
100 5.33
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
27.41
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 35.60 humHU05t
90%
10 docs 27.80
15 docs 24.13 80%
20 docs 21.40
70%
30 docs 17.87
100 docs 8.68 60%
R−Precision
200 docs 5.20
50%
500 docs 2.39
1000 docs 1.25 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
27.90 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275)
queries 1
humHU05t
Topic 251 4.07 Topic 276 22.49
Difference (average precision)
Topic 252 0.85 Topic 277 0.00 0.5
Topic 253 33.98 Topic 278 33.64
Topic 254 26.61 Topic 279 89.53
Topic 255 50.00 Topic 280 13.58 0
Topic 256 60.74 Topic 281 93.78
Topic 257 11.12 Topic 282 6.36
−0.5
Topic 258 13.26 Topic 283 61.81
Topic 259 41.67 Topic 284 22.02
Topic 260 8.33 Topic 285 18.18 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.00 Topic 286 0.00 Topic Number
Topic 262 4.26 Topic 287 13.86
Topic 263 14.15 Topic 288 4.45
CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300)
Topic 264 24.44 Topic 289 85.82 1
Topic 265 10.16 Topic 290 15.26 humHU05t
Difference (average precision)
Topic 266 16.26 Topic 291 51.89
0.5
Topic 267 46.37 Topic 292 10.00
Topic 268 61.31 Topic 293 70.16
Topic 269 0.00 Topic 294 77.08 0
Topic 270 10.83 Topic 295 15.95
Topic 271 11.11 Topic 296 13.83
Topic 272 3.03 Topic 297 43.24 −0.5
Topic 273 33.53 Topic 298 5.62
Topic 274 45.06 Topic 299 2.78
−1
Topic 275 61.11 Topic 300 6.78 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.286
hummingbird humHU05td AH-Monolingual-HU
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian
Retrieved 50,000 RunType= automatic
Relevant 939 QueryType= TD
Relevant retrieved 809 Pooled= true
CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 64.66 humHU05td
90%
10 54.25
20 47.21 80%
30 40.99
70%
40 36.74
50 32.46
Average Precision
60%
60 24.33
50%
70 20.72
80 15.65 40%
90 9.13
30%
100 6.73
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
30.55
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 40.80 humHU05td
90%
10 docs 32.80
15 docs 27.87 80%
20 docs 23.70
70%
30 docs 20.07
100 docs 10.26 60%
R−Precision
200 docs 6.22
50%
500 docs 3.02
1000 docs 1.62 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
31.59 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275)
queries 1
humHU05td
Topic 251 4.55 Topic 276 26.42
Difference (average precision)
Topic 252 4.46 Topic 277 0.99 0.5
Topic 253 34.20 Topic 278 30.09
Topic 254 21.25 Topic 279 72.43
Topic 255 50.42 Topic 280 9.06 0
Topic 256 72.06 Topic 281 95.84
Topic 257 11.99 Topic 282 1.39
−0.5
Topic 258 4.83 Topic 283 62.10
Topic 259 18.69 Topic 284 14.36
Topic 260 11.85 Topic 285 6.72 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 26.19 Topic 286 32.53 Topic Number
Topic 262 4.64 Topic 287 14.19
Topic 263 13.41 Topic 288 13.70
CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300)
Topic 264 36.58 Topic 289 84.11 1
Topic 265 9.39 Topic 290 46.20 humHU05td
Difference (average precision)
Topic 266 20.41 Topic 291 66.14
0.5
Topic 267 60.76 Topic 292 25.22
Topic 268 66.35 Topic 293 65.52
Topic 269 1.19 Topic 294 100.00 0
Topic 270 17.19 Topic 295 27.38
Topic 271 33.80 Topic 296 11.79
Topic 272 8.33 Topic 297 53.43 −0.5
Topic 273 24.80 Topic 298 5.04
Topic 274 21.56 Topic 299 5.75
−1
Topic 275 62.50 Topic 300 15.90 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.287
hummingbird humHU05tde AH-Monolingual-HU
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian
Retrieved 50,000 RunType= automatic
Relevant 939 QueryType= TD
Relevant retrieved 830 Pooled= true
CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 63.63 humHU05tde
90%
10 56.34
20 51.10 80%
30 42.22
70%
40 39.42
50 36.51
Average Precision
60%
60 28.24
50%
70 23.78
80 19.63 40%
90 12.14
30%
100 8.33
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
33.09
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 40.00 humHU05tde
90%
10 docs 34.40
15 docs 31.20 80%
20 docs 28.40
70%
30 docs 23.00
100 docs 11.10 60%
R−Precision
200 docs 6.72
50%
500 docs 3.14
1000 docs 1.66 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
34.00 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275)
queries 1
humHU05tde
Topic 251 13.48 Topic 276 30.01
Difference (average precision)
Topic 252 3.99 Topic 277 4.02 0.5
Topic 253 38.16 Topic 278 42.35
Topic 254 49.81 Topic 279 54.03
Topic 255 50.42 Topic 280 6.32 0
Topic 256 78.17 Topic 281 95.31
Topic 257 26.40 Topic 282 2.00
−0.5
Topic 258 5.77 Topic 283 56.91
Topic 259 18.89 Topic 284 21.66
Topic 260 15.83 Topic 285 6.45 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 38.89 Topic 286 37.09 Topic Number
Topic 262 3.66 Topic 287 17.99
Topic 263 7.36 Topic 288 15.28
CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300)
Topic 264 28.73 Topic 289 97.05 1
Topic 265 10.26 Topic 290 63.86 humHU05tde
Difference (average precision)
Topic 266 26.99 Topic 291 65.86
0.5
Topic 267 57.43 Topic 292 25.33
Topic 268 64.77 Topic 293 79.58
Topic 269 1.99 Topic 294 100.00 0
Topic 270 22.01 Topic 295 22.09
Topic 271 41.64 Topic 296 14.07
Topic 272 11.11 Topic 297 61.00 −0.5
Topic 273 26.43 Topic 298 2.19
Topic 274 24.17 Topic 299 3.89
−1
Topic 275 59.09 Topic 300 4.66 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.288
ilps UAmsMoHu1AnH AH-Monolingual-HU
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian
Retrieved 49,703 RunType= automatic
Relevant 939 QueryType= TD
Relevant retrieved 740 Pooled= true
CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 65.17 UAmsMoHu1AnH
90%
10 51.85
20 45.81 80%
30 41.03
70%
40 34.03
50 29.89
Average Precision
60%
60 22.84
50%
70 18.13
80 11.56 40%
90 7.11
30%
100 5.12
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
28.19
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 36.40 UAmsMoHu1AnH
90%
10 docs 28.80
15 docs 25.20 80%
20 docs 23.10
70%
30 docs 19.67
100 docs 9.56 60%
R−Precision
200 docs 5.64
50%
500 docs 2.74
1000 docs 1.48 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
28.39 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275)
queries 1
UAmsMoHu1AnH
Topic 251 6.36 Topic 276 17.34
Difference (average precision)
Topic 252 3.01 Topic 277 0.11 0.5
Topic 253 36.29 Topic 278 16.98
Topic 254 38.76 Topic 279 42.61
Topic 255 35.96 Topic 280 13.36 0
Topic 256 71.99 Topic 281 94.73
Topic 257 18.09 Topic 282 1.93
−0.5
Topic 258 7.68 Topic 283 59.17
Topic 259 59.65 Topic 284 0.03
Topic 260 10.98 Topic 285 10.82 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 5.53 Topic 286 7.12 Topic Number
Topic 262 35.66 Topic 287 17.38
Topic 263 4.06 Topic 288 8.09
CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300)
Topic 264 40.30 Topic 289 62.50 1
Topic 265 25.13 Topic 290 29.83 UAmsMoHu1AnH
Difference (average precision)
Topic 266 11.10 Topic 291 58.89
0.5
Topic 267 26.49 Topic 292 50.27
Topic 268 43.92 Topic 293 80.77
Topic 269 2.99 Topic 294 74.63 0
Topic 270 18.79 Topic 295 21.06
Topic 271 29.00 Topic 296 19.56
Topic 272 1.15 Topic 297 45.78 −0.5
Topic 273 12.30 Topic 298 1.18
Topic 274 57.44 Topic 299 5.89
−1
Topic 275 41.67 Topic 300 24.94 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.289
ilps UAmsMoHu2AnG AH-Monolingual-HU
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian
Retrieved 49,434 RunType= automatic
Relevant 939 QueryType= TD
Relevant retrieved 717 Pooled= true
CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 57.01 UAmsMoHu2AnG
90%
10 50.25
20 38.70 80%
30 30.58
70%
40 25.56
50 21.05
Average Precision
60%
60 16.96
50%
70 13.43
80 11.29 40%
90 8.75
30%
100 6.60
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
23.30
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 33.60 UAmsMoHu2AnG
90%
10 docs 25.80
15 docs 22.67 80%
20 docs 21.20
70%
30 docs 18.93
100 docs 9.00 60%
R−Precision
200 docs 5.46
50%
500 docs 2.66
1000 docs 1.43 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
25.56 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275)
queries 1
UAmsMoHu2AnG
Topic 251 6.84 Topic 276 17.83
Difference (average precision)
Topic 252 4.12 Topic 277 2.00 0.5
Topic 253 16.66 Topic 278 27.57
Topic 254 29.13 Topic 279 27.44
Topic 255 6.62 Topic 280 13.39 0
Topic 256 47.05 Topic 281 92.16
Topic 257 14.70 Topic 282 1.09
−0.5
Topic 258 3.94 Topic 283 27.11
Topic 259 21.87 Topic 284 0.03
Topic 260 5.35 Topic 285 18.53 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 11.60 Topic 286 11.66 Topic Number
Topic 262 35.45 Topic 287 17.18
Topic 263 5.99 Topic 288 8.93
CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300)
Topic 264 40.12 Topic 289 62.50 1
Topic 265 30.68 Topic 290 22.14 UAmsMoHu2AnG
Difference (average precision)
Topic 266 11.72 Topic 291 55.99
0.5
Topic 267 20.41 Topic 292 3.71
Topic 268 47.88 Topic 293 96.66
Topic 269 2.58 Topic 294 80.42 0
Topic 270 18.47 Topic 295 26.32
Topic 271 13.55 Topic 296 13.76
Topic 272 1.04 Topic 297 26.17 −0.5
Topic 273 5.53 Topic 298 0.66
Topic 274 37.61 Topic 299 6.14
−1
Topic 275 41.67 Topic 300 25.22 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.290
ilps UAmsMoHu3AnL AH-Monolingual-HU
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian
Retrieved 49,703 RunType= automatic
Relevant 939 QueryType= TD
Relevant retrieved 734 Pooled= false
CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 64.68 UAmsMoHu3AnL
90%
10 51.68
20 45.80 80%
30 40.32
70%
40 33.43
50 29.56
Average Precision
60%
60 22.69
50%
70 17.88
80 10.54 40%
90 7.19
30%
100 4.84
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
27.99
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 36.40 UAmsMoHu3AnL
90%
10 docs 29.60
15 docs 25.60 80%
20 docs 22.70
70%
30 docs 19.80
100 docs 9.56 60%
R−Precision
200 docs 5.60
50%
500 docs 2.72
1000 docs 1.47 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
29.05 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275)
queries 1
UAmsMoHu3AnL
Topic 251 6.68 Topic 276 17.47
Difference (average precision)
Topic 252 0.97 Topic 277 0.20 0.5
Topic 253 36.08 Topic 278 17.64
Topic 254 34.49 Topic 279 43.35
Topic 255 39.58 Topic 280 13.40 0
Topic 256 72.35 Topic 281 94.08
Topic 257 18.10 Topic 282 1.84
−0.5
Topic 258 10.00 Topic 283 61.43
Topic 259 51.55 Topic 284 0.03
Topic 260 10.98 Topic 285 10.91 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 6.09 Topic 286 6.94 Topic Number
Topic 262 34.93 Topic 287 17.44
Topic 263 3.86 Topic 288 7.12
CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300)
Topic 264 40.31 Topic 289 62.50 1
Topic 265 25.24 Topic 290 25.30 UAmsMoHu3AnL
Difference (average precision)
Topic 266 13.82 Topic 291 59.03
0.5
Topic 267 25.60 Topic 292 50.30
Topic 268 44.26 Topic 293 80.57
Topic 269 2.70 Topic 294 74.63 0
Topic 270 19.65 Topic 295 22.94
Topic 271 29.00 Topic 296 21.82
Topic 272 1.09 Topic 297 47.92 −0.5
Topic 273 12.35 Topic 298 1.25
Topic 274 51.52 Topic 299 8.40
−1
Topic 275 36.67 Topic 300 24.94 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.291
ilps UAmsMoHu4AnV AH-Monolingual-HU
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian
Retrieved 49,360 RunType= automatic
Relevant 939 QueryType= TD
Relevant retrieved 700 Pooled= false
CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 55.56 UAmsMoHu4AnV
90%
10 44.46
20 36.75 80%
30 30.50
70%
40 25.67
50 20.09
Average Precision
60%
60 13.80
50%
70 12.53
80 9.20 40%
90 6.05
30%
100 4.01
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
21.50
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 33.60 UAmsMoHu4AnV
90%
10 docs 25.80
15 docs 22.67 80%
20 docs 20.40
70%
30 docs 17.33
100 docs 8.60 60%
R−Precision
200 docs 5.12
50%
500 docs 2.60
1000 docs 1.40 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
24.16 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275)
queries 1
UAmsMoHu4AnV
Topic 251 9.70 Topic 276 18.55
Difference (average precision)
Topic 252 1.22 Topic 277 1.12 0.5
Topic 253 19.62 Topic 278 19.34
Topic 254 29.65 Topic 279 15.44
Topic 255 9.05 Topic 280 14.28 0
Topic 256 48.98 Topic 281 92.76
Topic 257 11.88 Topic 282 2.10
−0.5
Topic 258 2.78 Topic 283 54.56
Topic 259 18.12 Topic 284 0.02
Topic 260 5.50 Topic 285 11.02 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 6.62 Topic 286 2.99 Topic Number
Topic 262 35.95 Topic 287 15.47
Topic 263 4.78 Topic 288 8.34
CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300)
Topic 264 40.42 Topic 289 50.00 1
Topic 265 23.85 Topic 290 26.14 UAmsMoHu4AnV
Difference (average precision)
Topic 266 13.71 Topic 291 51.58
0.5
Topic 267 24.34 Topic 292 1.76
Topic 268 36.21 Topic 293 83.87
Topic 269 2.23 Topic 294 68.11 0
Topic 270 15.74 Topic 295 24.65
Topic 271 20.71 Topic 296 18.52
Topic 272 1.30 Topic 297 8.20 −0.5
Topic 273 3.22 Topic 298 0.43
Topic 274 38.93 Topic 299 7.71
−1
Topic 275 29.17 Topic 300 24.57 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.292
jhu-apl aplmohuc AH-Monolingual-HU
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian
Retrieved 50,000 RunType= automatic
Relevant 939 QueryType= TD
Relevant retrieved 893 Pooled= true
CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 70.58 aplmohuc
90%
10 61.32
20 55.95 80%
30 48.55
70%
40 44.94
50 42.31
Average Precision
60%
60 38.05
50%
70 34.33
80 29.07 40%
90 24.12
30%
100 16.30
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
40.63
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 41.60 aplmohuc
90%
10 docs 38.80
15 docs 33.87 80%
20 docs 31.00
70%
30 docs 26.40
100 docs 13.06 60%
R−Precision
200 docs 7.50
50%
500 docs 3.47
1000 docs 1.79 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
39.37 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275)
queries 1
aplmohuc
Topic 251 26.78 Topic 276 18.73
Difference (average precision)
Topic 252 12.79 Topic 277 0.09 0.5
Topic 253 39.81 Topic 278 34.65
Topic 254 58.52 Topic 279 77.10
Topic 255 97.62 Topic 280 15.15 0
Topic 256 85.65 Topic 281 91.60
Topic 257 19.57 Topic 282 2.77
−0.5
Topic 258 17.86 Topic 283 67.87
Topic 259 22.26 Topic 284 35.95
Topic 260 37.20 Topic 285 71.52 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 20.58 Topic 286 12.89 Topic Number
Topic 262 43.90 Topic 287 49.98
Topic 263 9.66 Topic 288 8.90
CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300)
Topic 264 29.20 Topic 289 100.00 1
Topic 265 30.19 Topic 290 69.98 aplmohuc
Difference (average precision)
Topic 266 9.51 Topic 291 64.34
0.5
Topic 267 50.12 Topic 292 17.14
Topic 268 52.57 Topic 293 96.39
Topic 269 18.45 Topic 294 95.00 0
Topic 270 28.07 Topic 295 29.61
Topic 271 36.35 Topic 296 19.92
Topic 272 6.67 Topic 297 66.12 −0.5
Topic 273 28.08 Topic 298 29.83
Topic 274 84.43 Topic 299 8.68
−1
Topic 275 75.00 Topic 300 6.35 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.293
jhu-apl aplmohud AH-Monolingual-HU
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian
Retrieved 50,000 RunType= automatic
Relevant 939 QueryType= TD
Relevant retrieved 893 Pooled= true
CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 74.15 aplmohud
90%
10 62.47
20 56.59 80%
30 48.59
70%
40 46.15
50 43.76
Average Precision
60%
60 39.35
50%
70 34.17
80 28.73 40%
90 23.82
30%
100 16.56
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
41.12
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 43.20 aplmohud
90%
10 docs 37.20
15 docs 32.80 80%
20 docs 30.70
70%
30 docs 25.73
100 docs 13.06 60%
R−Precision
200 docs 7.39
50%
500 docs 3.42
1000 docs 1.79 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
40.92 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275)
queries 1
aplmohud
Topic 251 30.07 Topic 276 21.98
Difference (average precision)
Topic 252 13.74 Topic 277 0.18 0.5
Topic 253 33.38 Topic 278 33.08
Topic 254 59.29 Topic 279 80.67
Topic 255 94.84 Topic 280 11.44 0
Topic 256 87.24 Topic 281 91.34
Topic 257 14.29 Topic 282 3.84
−0.5
Topic 258 3.97 Topic 283 65.99
Topic 259 20.62 Topic 284 38.06
Topic 260 42.19 Topic 285 68.29 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 48.89 Topic 286 9.84 Topic Number
Topic 262 38.56 Topic 287 50.73
Topic 263 7.95 Topic 288 8.45
CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300)
Topic 264 31.45 Topic 289 98.61 1
Topic 265 29.17 Topic 290 69.37 aplmohud
Difference (average precision)
Topic 266 10.33 Topic 291 62.66
0.5
Topic 267 51.80 Topic 292 25.45
Topic 268 56.93 Topic 293 96.22
Topic 269 20.58 Topic 294 88.75 0
Topic 270 28.15 Topic 295 29.86
Topic 271 27.12 Topic 296 20.47
Topic 272 5.56 Topic 297 70.50 −0.5
Topic 273 23.54 Topic 298 26.81
Topic 274 87.26 Topic 299 27.41
−1
Topic 275 83.33 Topic 300 5.95 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.294
jhu-apl aplmohue AH-Monolingual-HU
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian
Retrieved 50,000 RunType= automatic
Relevant 939 QueryType= TD
Relevant retrieved 891 Pooled= false
CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 72.12 aplmohue
90%
10 63.78
20 57.10 80%
30 48.84
70%
40 45.33
50 41.81
Average Precision
60%
60 37.44
50%
70 32.52
80 28.37 40%
90 23.76
30%
100 15.60
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
40.56
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 42.80 aplmohue
90%
10 docs 39.40
15 docs 34.53 80%
20 docs 31.20
70%
30 docs 26.80
100 docs 13.06 60%
R−Precision
200 docs 7.57
50%
500 docs 3.43
1000 docs 1.78 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
39.11 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275)
queries 1
aplmohue
Topic 251 23.11 Topic 276 16.90
Difference (average precision)
Topic 252 12.06 Topic 277 0.04 0.5
Topic 253 41.61 Topic 278 36.31
Topic 254 57.87 Topic 279 73.02
Topic 255 97.62 Topic 280 17.33 0
Topic 256 82.08 Topic 281 90.73
Topic 257 24.22 Topic 282 1.81
−0.5
Topic 258 21.67 Topic 283 64.75
Topic 259 22.91 Topic 284 27.54
Topic 260 33.55 Topic 285 73.03 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 17.04 Topic 286 22.83 Topic Number
Topic 262 49.14 Topic 287 49.40
Topic 263 10.48 Topic 288 8.97
CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300)
Topic 264 28.85 Topic 289 100.00 1
Topic 265 31.10 Topic 290 68.17 aplmohue
Difference (average precision)
Topic 266 9.06 Topic 291 64.78
0.5
Topic 267 54.45 Topic 292 17.17
Topic 268 45.85 Topic 293 96.17
Topic 269 17.86 Topic 294 95.00 0
Topic 270 28.24 Topic 295 29.42
Topic 271 42.50 Topic 296 19.42
Topic 272 9.09 Topic 297 65.93 −0.5
Topic 273 29.71 Topic 298 32.69
Topic 274 85.38 Topic 299 7.46
−1
Topic 275 66.67 Topic 300 6.99 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.295
miracle HUHT AH-Monolingual-HU
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian
Retrieved 50,000 RunType= automatic
Relevant 939 QueryType= TD
Relevant retrieved 785 Pooled= false
CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 64.52 HUHT
90%
10 52.15
20 44.27 80%
30 37.18
70%
40 33.11
50 30.49
Average Precision
60%
60 22.40
50%
70 18.18
80 11.09 40%
90 7.15
30%
100 4.14
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
27.70
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 38.40 HUHT
90%
10 docs 30.00
15 docs 25.60 80%
20 docs 22.50
70%
30 docs 19.33
100 docs 9.16 60%
R−Precision
200 docs 5.60
50%
500 docs 2.86
1000 docs 1.57 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
28.45 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275)
queries 1
HUHT
Topic 251 1.64 Topic 276 19.72
Difference (average precision)
Topic 252 6.91 Topic 277 0.43 0.5
Topic 253 30.21 Topic 278 13.67
Topic 254 32.24 Topic 279 51.06
Topic 255 30.29 Topic 280 5.54 0
Topic 256 82.65 Topic 281 91.41
Topic 257 8.38 Topic 282 0.79
−0.5
Topic 258 31.45 Topic 283 59.23
Topic 259 50.28 Topic 284 23.98
Topic 260 9.47 Topic 285 8.23 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 5.71 Topic 286 15.55 Topic Number
Topic 262 8.05 Topic 287 14.06
Topic 263 13.21 Topic 288 5.81
CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300)
Topic 264 16.10 Topic 289 74.10 1
Topic 265 14.68 Topic 290 30.45 HUHT
Difference (average precision)
Topic 266 16.32 Topic 291 55.92
0.5
Topic 267 47.19 Topic 292 9.90
Topic 268 52.80 Topic 293 77.83
Topic 269 4.46 Topic 294 87.50 0
Topic 270 14.15 Topic 295 11.53
Topic 271 19.05 Topic 296 12.81
Topic 272 6.25 Topic 297 44.53 −0.5
Topic 273 31.76 Topic 298 1.31
Topic 274 26.71 Topic 299 8.93
−1
Topic 275 62.50 Topic 300 38.23 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.296
miracle aHTSTxNP01ST1 AH-Monolingual-HU
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian
Retrieved 50,000 RunType= automatic
Relevant 939 QueryType= TD
Relevant retrieved 827 Pooled= true
CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 70.96 aHTSTxNP01ST1
90%
10 59.77
20 53.75 80%
30 44.14
70%
40 39.67
50 37.29
Average Precision
60%
60 29.95
50%
70 25.02
80 17.23 40%
90 11.19
30%
100 7.33
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
34.35
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 44.40 aHTSTxNP01ST1
90%
10 docs 34.00
15 docs 28.40 80%
20 docs 26.20
70%
30 docs 21.47
100 docs 10.72 60%
R−Precision
200 docs 6.37
50%
500 docs 3.00
1000 docs 1.65 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
33.85 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275)
queries 1
aHTSTxNP01ST1
Topic 251 2.64 Topic 276 25.46
Difference (average precision)
Topic 252 5.88 Topic 277 0.63 0.5
Topic 253 38.06 Topic 278 34.85
Topic 254 34.24 Topic 279 81.13
Topic 255 46.43 Topic 280 7.44 0
Topic 256 82.78 Topic 281 96.30
Topic 257 10.91 Topic 282 1.19
−0.5
Topic 258 25.50 Topic 283 60.28
Topic 259 36.18 Topic 284 23.86
Topic 260 15.93 Topic 285 8.44 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 23.33 Topic 286 21.56 Topic Number
Topic 262 6.45 Topic 287 14.78
Topic 263 13.59 Topic 288 10.13
CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300)
Topic 264 33.77 Topic 289 78.57 1
Topic 265 27.42 Topic 290 47.31 aHTSTxNP01ST1
Difference (average precision)
Topic 266 21.20 Topic 291 66.00
0.5
Topic 267 64.97 Topic 292 52.00
Topic 268 64.83 Topic 293 82.35
Topic 269 3.61 Topic 294 95.00 0
Topic 270 23.80 Topic 295 18.20
Topic 271 36.79 Topic 296 18.19
Topic 272 14.29 Topic 297 51.05 −0.5
Topic 273 28.78 Topic 298 2.48
Topic 274 27.08 Topic 299 5.02
−1
Topic 275 83.33 Topic 300 43.33 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.297
miracle xNP01ST1 AH-Monolingual-HU
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian
Retrieved 50,000 RunType= automatic
Relevant 939 QueryType= TD
Relevant retrieved 827 Pooled= true
CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 72.72 xNP01ST1
90%
10 60.86
20 53.83 80%
30 46.56
70%
40 40.75
50 37.76
Average Precision
60%
60 30.16
50%
70 24.98
80 19.22 40%
90 11.05
30%
100 7.03
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
35.20
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 44.80 xNP01ST1
90%
10 docs 35.00
15 docs 29.60 80%
20 docs 25.90
70%
30 docs 22.00
100 docs 10.92 60%
R−Precision
200 docs 6.53
50%
500 docs 3.11
1000 docs 1.65 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
34.24 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275)
queries 1
xNP01ST1
Topic 251 3.97 Topic 276 26.05
Difference (average precision)
Topic 252 6.25 Topic 277 1.08 0.5
Topic 253 39.01 Topic 278 32.16
Topic 254 32.72 Topic 279 88.00
Topic 255 46.30 Topic 280 8.75 0
Topic 256 80.33 Topic 281 96.91
Topic 257 12.34 Topic 282 1.19
−0.5
Topic 258 13.75 Topic 283 60.07
Topic 259 15.80 Topic 284 20.49
Topic 260 18.51 Topic 285 5.20 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 44.44 Topic 286 24.46 Topic Number
Topic 262 5.92 Topic 287 13.94
Topic 263 13.38 Topic 288 11.48
CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300)
Topic 264 38.74 Topic 289 85.74 1
Topic 265 37.51 Topic 290 51.56 xNP01ST1
Difference (average precision)
Topic 266 23.03 Topic 291 68.59
0.5
Topic 267 66.35 Topic 292 51.79
Topic 268 65.39 Topic 293 83.30
Topic 269 2.85 Topic 294 95.00 0
Topic 270 29.85 Topic 295 30.98
Topic 271 43.36 Topic 296 17.93
Topic 272 14.29 Topic 297 58.60 −0.5
Topic 273 26.37 Topic 298 4.27
Topic 274 24.10 Topic 299 2.23
−1
Topic 275 70.00 Topic 300 45.59 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.298
tlr tlrTDhuE AH-Monolingual-HU
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian
Retrieved 50,000 RunType= automatic
Relevant 939 QueryType= TD
Relevant retrieved 665 Pooled= true
CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 62.91 tlrTDhuE
90%
10 54.70
20 45.92 80%
30 40.11
70%
40 32.39
50 29.55
Average Precision
60%
60 23.47
50%
70 20.95
80 17.61 40%
90 10.48
30%
100 6.91
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
29.52
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 42.40 tlrTDhuE
90%
10 docs 35.20
15 docs 30.40 80%
20 docs 27.30
70%
30 docs 21.33
100 docs 9.52 60%
R−Precision
200 docs 5.58
50%
500 docs 2.59
1000 docs 1.33 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
32.10 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275)
queries 1
tlrTDhuE
Topic 251 9.04 Topic 276 21.84
Difference (average precision)
Topic 252 4.98 Topic 277 0.00 0.5
Topic 253 0.02 Topic 278 0.02
Topic 254 24.30 Topic 279 36.73
Topic 255 47.24 Topic 280 8.49 0
Topic 256 75.14 Topic 281 76.40
Topic 257 28.12 Topic 282 0.47
−0.5
Topic 258 0.00 Topic 283 47.08
Topic 259 32.29 Topic 284 17.93
Topic 260 15.04 Topic 285 36.04 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 17.19 Topic 286 18.11 Topic Number
Topic 262 2.19 Topic 287 32.22
Topic 263 3.39 Topic 288 16.85
CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300)
Topic 264 13.75 Topic 289 94.72 1
Topic 265 34.67 Topic 290 48.53 tlrTDhuE
Difference (average precision)
Topic 266 17.18 Topic 291 42.76
0.5
Topic 267 58.52 Topic 292 18.10
Topic 268 68.17 Topic 293 84.75
Topic 269 1.45 Topic 294 100.00 0
Topic 270 15.79 Topic 295 26.41
Topic 271 35.07 Topic 296 24.76
Topic 272 0.00 Topic 297 61.76 −0.5
Topic 273 28.75 Topic 298 30.10
Topic 274 33.01 Topic 299 2.76
−1
Topic 275 33.33 Topic 300 30.28 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.299
tlr tlrTDhuSC AH-Monolingual-HU
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian
Retrieved 50,000 RunType= automatic
Relevant 939 QueryType= TD
Relevant retrieved 661 Pooled= true
CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 65.15 tlrTDhuSC
90%
10 56.74
20 46.01 80%
30 39.26
70%
40 31.24
50 28.84
Average Precision
60%
60 23.50
50%
70 19.77
80 16.79 40%
90 12.12
30%
100 8.56
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
29.64
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 41.20 tlrTDhuSC
90%
10 docs 33.60
15 docs 28.67 80%
20 docs 26.10
70%
30 docs 21.73
100 docs 9.74 60%
R−Precision
200 docs 5.59
50%
500 docs 2.57
1000 docs 1.32 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
29.99 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275)
queries 1
tlrTDhuSC
Topic 251 8.32 Topic 276 25.77
Difference (average precision)
Topic 252 8.74 Topic 277 0.00 0.5
Topic 253 0.08 Topic 278 0.00
Topic 254 36.16 Topic 279 41.49
Topic 255 47.26 Topic 280 6.47 0
Topic 256 79.27 Topic 281 92.59
Topic 257 28.37 Topic 282 0.46
−0.5
Topic 258 0.00 Topic 283 46.62
Topic 259 34.05 Topic 284 19.02
Topic 260 21.25 Topic 285 12.73 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 17.21 Topic 286 16.81 Topic Number
Topic 262 2.28 Topic 287 32.94
Topic 263 2.68 Topic 288 20.36
CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300)
Topic 264 13.94 Topic 289 94.72 1
Topic 265 20.22 Topic 290 47.28 tlrTDhuSC
Difference (average precision)
Topic 266 17.10 Topic 291 46.96
0.5
Topic 267 44.47 Topic 292 25.00
Topic 268 68.18 Topic 293 71.07
Topic 269 1.20 Topic 294 100.00 0
Topic 270 15.80 Topic 295 26.84
Topic 271 35.06 Topic 296 24.21
Topic 272 0.00 Topic 297 46.74 −0.5
Topic 273 26.45 Topic 298 23.96
Topic 274 59.05 Topic 299 27.00
−1
Topic 275 15.48 Topic 300 30.44 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.300
u.budapest qalltall AH-Monolingual-HU
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian
Retrieved 48,867 RunType= automatic
Relevant 939 QueryType= TD
Relevant retrieved 759 Pooled= true
CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 64.91 qalltall
90%
10 50.57
20 43.35 80%
30 37.95
70%
40 31.62
50 28.19
Average Precision
60%
60 23.18
50%
70 19.76
80 14.09 40%
90 9.75
30%
100 6.88
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
28.02
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 37.60 qalltall
90%
10 docs 29.40
15 docs 24.93 80%
20 docs 23.10
70%
30 docs 18.93
100 docs 9.38 60%
R−Precision
200 docs 5.84
50%
500 docs 2.73
1000 docs 1.52 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
28.39 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275)
queries 1
qalltall
Topic 251 24.47 Topic 276 18.23
Difference (average precision)
Topic 252 3.63 Topic 277 0.06 0.5
Topic 253 21.80 Topic 278 20.52
Topic 254 3.24 Topic 279 22.45
Topic 255 50.12 Topic 280 9.65 0
Topic 256 67.72 Topic 281 68.40
Topic 257 22.50 Topic 282 0.79
−0.5
Topic 258 1.09 Topic 283 50.54
Topic 259 33.33 Topic 284 6.75
Topic 260 31.82 Topic 285 0.43 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 18.27 Topic 286 21.36 Topic Number
Topic 262 57.69 Topic 287 13.21
Topic 263 12.78 Topic 288 7.47
CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300)
Topic 264 33.60 Topic 289 79.80 1
Topic 265 31.14 Topic 290 9.16 qalltall
Difference (average precision)
Topic 266 5.04 Topic 291 54.94
0.5
Topic 267 44.91 Topic 292 13.62
Topic 268 70.25 Topic 293 95.64
Topic 269 4.16 Topic 294 80.42 0
Topic 270 18.70 Topic 295 8.90
Topic 271 29.13 Topic 296 9.87
Topic 272 0.95 Topic 297 51.19 −0.5
Topic 273 29.50 Topic 298 5.96
Topic 274 55.91 Topic 299 7.42
−1
Topic 275 26.67 Topic 300 45.88 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.301
u.budapest qfirststemtall AH-Monolingual-HU
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian
Retrieved 48,867 RunType= automatic
Relevant 939 QueryType= TD
Relevant retrieved 815 Pooled= true
CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 65.29 qfirststemtall
90%
10 59.02
20 49.24 80%
30 42.76
70%
40 38.15
50 33.22
Average Precision
60%
60 24.90
50%
70 20.82
80 14.43 40%
90 10.13
30%
100 6.96
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
31.03
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 39.60 qfirststemtall
90%
10 docs 32.00
15 docs 28.40 80%
20 docs 25.00
70%
30 docs 22.13
100 docs 11.02 60%
R−Precision
200 docs 6.68
50%
500 docs 3.03
1000 docs 1.63 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
31.60 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275)
queries 1
qfirststemtall
Topic 251 16.26 Topic 276 15.71
Difference (average precision)
Topic 252 3.23 Topic 277 0.16 0.5
Topic 253 45.19 Topic 278 24.79
Topic 254 29.10 Topic 279 48.06
Topic 255 50.61 Topic 280 6.34 0
Topic 256 73.39 Topic 281 88.31
Topic 257 15.43 Topic 282 1.19
−0.5
Topic 258 22.77 Topic 283 50.54
Topic 259 27.26 Topic 284 15.13
Topic 260 16.73 Topic 285 19.00 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 18.98 Topic 286 11.71 Topic Number
Topic 262 27.19 Topic 287 25.29
Topic 263 14.19 Topic 288 9.70
CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300)
Topic 264 40.21 Topic 289 79.80 1
Topic 265 35.63 Topic 290 47.08 qfirststemtall
Difference (average precision)
Topic 266 17.91 Topic 291 48.96
0.5
Topic 267 44.81 Topic 292 51.37
Topic 268 25.70 Topic 293 95.94
Topic 269 4.81 Topic 294 67.92 0
Topic 270 18.70 Topic 295 18.91
Topic 271 29.34 Topic 296 16.51
Topic 272 1.47 Topic 297 60.81 −0.5
Topic 273 20.08 Topic 298 17.09
Topic 274 77.67 Topic 299 6.96
−1
Topic 275 1.64 Topic 300 45.88 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.302
u.budapest qfstfs AH-Monolingual-HU
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian
Retrieved 48,803 RunType= automatic
Relevant 939 QueryType= TD
Relevant retrieved 806 Pooled= true
CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 70.46 qfstfs
90%
10 56.78
20 50.97 80%
30 43.60
70%
40 38.03
50 33.12
Average Precision
60%
60 24.86
50%
70 21.00
80 14.17 40%
90 8.66
30%
100 6.22
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
31.38
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 38.80 qfstfs
90%
10 docs 32.00
15 docs 28.67 80%
20 docs 25.80
70%
30 docs 21.60
100 docs 10.88 60%
R−Precision
200 docs 6.59
50%
500 docs 3.06
1000 docs 1.61 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
32.16 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275)
queries 1
qfstfs
Topic 251 10.87 Topic 276 19.07
Difference (average precision)
Topic 252 2.60 Topic 277 0.20 0.5
Topic 253 43.08 Topic 278 18.36
Topic 254 26.19 Topic 279 62.00
Topic 255 50.57 Topic 280 13.26 0
Topic 256 71.29 Topic 281 88.48
Topic 257 15.83 Topic 282 3.19
−0.5
Topic 258 13.00 Topic 283 57.46
Topic 259 33.94 Topic 284 17.60
Topic 260 10.17 Topic 285 4.96 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 36.22 Topic 286 9.21 Topic Number
Topic 262 24.84 Topic 287 25.74
Topic 263 11.79 Topic 288 10.62
CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300)
Topic 264 40.28 Topic 289 79.45 1
Topic 265 31.61 Topic 290 46.80 qfstfs
Difference (average precision)
Topic 266 19.51 Topic 291 51.43
0.5
Topic 267 42.99 Topic 292 51.32
Topic 268 43.97 Topic 293 84.50
Topic 269 1.21 Topic 294 80.42 0
Topic 270 20.85 Topic 295 16.69
Topic 271 32.92 Topic 296 19.73
Topic 272 1.54 Topic 297 50.63 −0.5
Topic 273 20.96 Topic 298 15.70
Topic 274 57.94 Topic 299 6.79
−1
Topic 275 25.23 Topic 300 46.19 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.303
u.budapest qnostemtall AH-Monolingual-HU
Overall statistics for 48 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian
Retrieved 42,831 RunType= automatic
Relevant 922 QueryType= TD
Relevant retrieved 626 Pooled= false
CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 47.89 qnostemtall
90%
10 41.56
20 34.95 80%
30 32.33
70%
40 27.01
50 21.65
Average Precision
60%
60 18.97
50%
70 15.19
80 12.77 40%
90 9.36
30%
100 7.26
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
22.61
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 27.60 qnostemtall
90%
10 docs 25.80
15 docs 23.33 80%
20 docs 20.70
70%
30 docs 17.53
100 docs 8.40 60%
R−Precision
200 docs 5.06
50%
500 docs 2.31
1000 docs 1.25 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
24.78 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275)
queries 1
qnostemtall
Topic 251 7.76 Topic 276 17.33
Difference (average precision)
Topic 252 0.00 Topic 277 1.08 0.5
Topic 253 30.52 Topic 278 4.44
Topic 254 23.23 Topic 279 0.01
Topic 255 12.62 Topic 280 5.09 0
Topic 256 72.04 Topic 281 88.29
Topic 257 22.53 Topic 282 2.35
−0.5
Topic 258 27.78 Topic 283 57.40
Topic 259 46.59 Topic 284 23.17
Topic 260 16.67 Topic 285 37.03 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.00 Topic 286 0.03 Topic Number
Topic 262 23.80 Topic 287 17.91
Topic 263 0.05 Topic 288 6.18
CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300)
Topic 264 40.63 Topic 289 89.57 1
Topic 265 32.98 Topic 290 35.98 qnostemtall
Difference (average precision)
Topic 266 9.46 Topic 291 44.39
0.5
Topic 267 30.03 Topic 292 7.75
Topic 268 28.55 Topic 293 95.85
Topic 269 0.19 Topic 294 39.88 0
Topic 270 13.27 Topic 295 13.29
Topic 271 5.00 Topic 296 13.53
Topic 272 0.85 Topic 297 0.00 −0.5
Topic 273 18.08 Topic 298 0.00
Topic 274 59.37 Topic 299 7.86
−1
Topic 275 0.12 Topic 300 0.00 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.304
u.budapest qnostemtfirsstem AH-Monolingual-HU
Overall statistics for 48 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian
Retrieved 42,690 RunType= automatic
Relevant 922 QueryType= TD
Relevant retrieved 632 Pooled= false
CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 52.63 qnostemtfirsstem
90%
10 41.90
20 34.08 80%
30 30.23
70%
40 26.43
50 23.26
Average Precision
60%
60 19.80
50%
70 16.78
80 13.77 40%
90 9.47
30%
100 7.30
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
23.58
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 30.80 qnostemtfirsstem
90%
10 docs 25.60
15 docs 22.93 80%
20 docs 20.60
70%
30 docs 17.27
100 docs 8.68 60%
R−Precision
200 docs 5.16
50%
500 docs 2.36
1000 docs 1.26 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
23.80 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275)
queries 1
qnostemtfirsstem
Topic 251 2.61 Topic 276 13.10
Difference (average precision)
Topic 252 0.00 Topic 277 0.96 0.5
Topic 253 22.76 Topic 278 2.59
Topic 254 47.56 Topic 279 6.51
Topic 255 2.21 Topic 280 11.71 0
Topic 256 70.04 Topic 281 88.32
Topic 257 12.04 Topic 282 6.35
−0.5
Topic 258 24.44 Topic 283 54.29
Topic 259 42.99 Topic 284 23.76
Topic 260 23.95 Topic 285 24.88 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.00 Topic 286 0.23 Topic Number
Topic 262 24.57 Topic 287 16.37
Topic 263 0.05 Topic 288 7.30
CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300)
Topic 264 24.16 Topic 289 89.57 1
Topic 265 35.52 Topic 290 37.17 qnostemtfirsstem
Difference (average precision)
Topic 266 10.76 Topic 291 50.51
0.5
Topic 267 45.71 Topic 292 2.63
Topic 268 39.70 Topic 293 84.98
Topic 269 0.05 Topic 294 95.00 0
Topic 270 13.03 Topic 295 13.38
Topic 271 5.37 Topic 296 16.97
Topic 272 0.82 Topic 297 0.00 −0.5
Topic 273 19.25 Topic 298 0.02
Topic 274 49.71 Topic 299 6.80
−1
Topic 275 8.33 Topic 300 0.00 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.305
u.budapest qnostemtnostem AH-Monolingual-HU
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian
Retrieved 46,123 RunType= automatic
Relevant 939 QueryType= TD
Relevant retrieved 651 Pooled= true
CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 55.05 qnostemtnostem
90%
10 41.97
20 33.96 80%
30 29.44
70%
40 23.79
50 21.79
Average Precision
60%
60 16.66
50%
70 14.33
80 10.20 40%
90 6.56
30%
100 4.95
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
21.51
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 29.20 qnostemtnostem
90%
10 docs 25.20
15 docs 23.07 80%
20 docs 20.40
70%
30 docs 17.67
100 docs 8.48 60%
R−Precision
200 docs 5.24
50%
500 docs 2.42
1000 docs 1.30 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
23.91 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275)
queries 1
qnostemtnostem
Topic 251 1.73 Topic 276 21.15
Difference (average precision)
Topic 252 0.00 Topic 277 1.40 0.5
Topic 253 16.92 Topic 278 11.74
Topic 254 16.04 Topic 279 3.86
Topic 255 11.16 Topic 280 12.63 0
Topic 256 60.47 Topic 281 87.02
Topic 257 13.24 Topic 282 5.22
−0.5
Topic 258 4.17 Topic 283 44.57
Topic 259 19.68 Topic 284 9.42
Topic 260 20.04 Topic 285 1.27 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 4.49 Topic 286 0.42 Topic Number
Topic 262 19.91 Topic 287 13.27
Topic 263 0.82 Topic 288 3.12
CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300)
Topic 264 30.71 Topic 289 91.16 1
Topic 265 34.07 Topic 290 39.82 qnostemtnostem
Difference (average precision)
Topic 266 14.75 Topic 291 51.43
0.5
Topic 267 30.74 Topic 292 2.35
Topic 268 40.22 Topic 293 70.51
Topic 269 1.88 Topic 294 69.64 0
Topic 270 15.67 Topic 295 21.41
Topic 271 26.05 Topic 296 17.82
Topic 272 0.53 Topic 297 18.52 −0.5
Topic 273 19.86 Topic 298 0.17
Topic 274 43.41 Topic 299 5.11
−1
Topic 275 25.80 Topic 300 0.00 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.306
u.glasgow glahutdn AH-Monolingual-HU
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian
Retrieved 50,000 RunType= automatic
Relevant 939 QueryType= TDN
Relevant retrieved 386 Pooled= true
CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 41.91 glahutdn
90%
10 31.72
20 23.76 80%
30 11.78
70%
40 8.14
50 5.03
Average Precision
60%
60 1.34
50%
70 0.03
80 0.01 40%
90 0.01
30%
100 0.01
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
9.59
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 20.80 glahutdn
90%
10 docs 16.40
15 docs 14.27 80%
20 docs 12.90
70%
30 docs 11.13
100 docs 4.78 60%
R−Precision
200 docs 2.73
50%
500 docs 1.34
1000 docs 0.77 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
12.80 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275)
queries 1
glahutdn
Topic 251 0.55 Topic 276 4.15
Difference (average precision)
Topic 252 7.22 Topic 277 2.61 0.5
Topic 253 11.30 Topic 278 0.71
Topic 254 31.19 Topic 279 6.11
Topic 255 0.12 Topic 280 1.69 0
Topic 256 24.19 Topic 281 41.29
Topic 257 0.02 Topic 282 0.13
−0.5
Topic 258 3.03 Topic 283 15.53
Topic 259 0.46 Topic 284 1.57
Topic 260 0.14 Topic 285 0.14 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 1.39 Topic 286 4.38 Topic Number
Topic 262 26.84 Topic 287 2.37
Topic 263 8.24 Topic 288 0.95
CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300)
Topic 264 0.32 Topic 289 3.28 1
Topic 265 14.04 Topic 290 19.07 glahutdn
Difference (average precision)
Topic 266 2.92 Topic 291 8.29
0.5
Topic 267 5.77 Topic 292 0.00
Topic 268 24.20 Topic 293 32.62
Topic 269 0.74 Topic 294 31.25 0
Topic 270 11.07 Topic 295 9.81
Topic 271 22.22 Topic 296 9.00
Topic 272 0.45 Topic 297 17.63 −0.5
Topic 273 10.55 Topic 298 0.92
Topic 274 42.37 Topic 299 12.50
−1
Topic 275 3.57 Topic 300 0.34 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.307
u.glasgow glahutdnqe AH-Monolingual-HU
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian
Retrieved 50,000 RunType= automatic
Relevant 939 QueryType= TDN
Relevant retrieved 392 Pooled= false
CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 42.82 glahutdnqe
90%
10 33.28
20 25.92 80%
30 14.38
70%
40 8.99
50 5.70
Average Precision
60%
60 1.84
50%
70 0.05
80 0.02 40%
90 0.02
30%
100 0.02
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
10.39
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 21.20 glahutdnqe
90%
10 docs 18.40
15 docs 15.60 80%
20 docs 13.50
70%
30 docs 10.87
100 docs 5.18 60%
R−Precision
200 docs 2.88
50%
500 docs 1.40
1000 docs 0.78 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
14.41 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275)
queries 1
glahutdnqe
Topic 251 0.49 Topic 276 4.34
Difference (average precision)
Topic 252 13.64 Topic 277 3.97 0.5
Topic 253 14.58 Topic 278 0.25
Topic 254 32.85 Topic 279 4.12
Topic 255 0.09 Topic 280 1.91 0
Topic 256 25.42 Topic 281 47.52
Topic 257 0.02 Topic 282 0.11
−0.5
Topic 258 0.93 Topic 283 16.30
Topic 259 0.61 Topic 284 0.76
Topic 260 0.14 Topic 285 0.13 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.53 Topic 286 5.86 Topic Number
Topic 262 27.83 Topic 287 3.10
Topic 263 11.07 Topic 288 1.27
CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300)
Topic 264 0.58 Topic 289 1.50 1
Topic 265 13.82 Topic 290 22.51 glahutdnqe
Difference (average precision)
Topic 266 3.53 Topic 291 7.66
0.5
Topic 267 9.18 Topic 292 0.00
Topic 268 24.07 Topic 293 40.46
Topic 269 0.89 Topic 294 37.50 0
Topic 270 13.73 Topic 295 9.67
Topic 271 22.22 Topic 296 10.77
Topic 272 1.23 Topic 297 16.40 −0.5
Topic 273 10.02 Topic 298 0.89
Topic 274 40.19 Topic 299 8.33
−1
Topic 275 6.25 Topic 300 0.20 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.308
u.glasgow glahutdqe AH-Monolingual-HU
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian
Retrieved 50,000 RunType= automatic
Relevant 939 QueryType= TD
Relevant retrieved 392 Pooled= true
CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 42.82 glahutdqe
90%
10 33.28
20 25.92 80%
30 14.38
70%
40 8.99
50 5.70
Average Precision
60%
60 1.84
50%
70 0.05
80 0.02 40%
90 0.02
30%
100 0.02
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
10.39
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 21.20 glahutdqe
90%
10 docs 18.40
15 docs 15.60 80%
20 docs 13.50
70%
30 docs 10.87
100 docs 5.18 60%
R−Precision
200 docs 2.88
50%
500 docs 1.40
1000 docs 0.78 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
14.41 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275)
queries 1
glahutdqe
Topic 251 0.49 Topic 276 4.34
Difference (average precision)
Topic 252 13.64 Topic 277 3.97 0.5
Topic 253 14.58 Topic 278 0.25
Topic 254 32.85 Topic 279 4.12
Topic 255 0.09 Topic 280 1.91 0
Topic 256 25.42 Topic 281 47.52
Topic 257 0.02 Topic 282 0.11
−0.5
Topic 258 0.93 Topic 283 16.30
Topic 259 0.61 Topic 284 0.76
Topic 260 0.14 Topic 285 0.13 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.53 Topic 286 5.86 Topic Number
Topic 262 27.83 Topic 287 3.10
Topic 263 11.07 Topic 288 1.27
CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300)
Topic 264 0.58 Topic 289 1.50 1
Topic 265 13.82 Topic 290 22.51 glahutdqe
Difference (average precision)
Topic 266 3.53 Topic 291 7.66
0.5
Topic 267 9.18 Topic 292 0.00
Topic 268 24.07 Topic 293 40.46
Topic 269 0.89 Topic 294 37.50 0
Topic 270 13.73 Topic 295 9.67
Topic 271 22.22 Topic 296 10.77
Topic 272 1.23 Topic 297 16.40 −0.5
Topic 273 10.02 Topic 298 0.89
Topic 274 40.19 Topic 299 8.33
−1
Topic 275 6.25 Topic 300 0.20 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.309
unine UniNEhu1 AH-Monolingual-HU
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian
Retrieved 50,000 RunType= automatic
Relevant 939 QueryType= TD
Relevant retrieved 897 Pooled= true
CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 66.09 UniNEhu1
90%
10 57.66
20 54.04 80%
30 47.80
70%
40 43.21
50 41.21
Average Precision
60%
60 34.59
50%
70 29.38
80 22.02 40%
90 14.40
30%
100 9.27
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
36.99
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 42.80 UniNEhu1
90%
10 docs 37.00
15 docs 31.73 80%
20 docs 28.50
70%
30 docs 24.53
100 docs 12.24 60%
R−Precision
200 docs 7.35
50%
500 docs 3.39
1000 docs 1.79 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
36.34 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275)
queries 1
UniNEhu1
Topic 251 1.88 Topic 276 33.39
Difference (average precision)
Topic 252 20.95 Topic 277 0.70 0.5
Topic 253 40.09 Topic 278 36.10
Topic 254 57.92 Topic 279 89.41
Topic 255 42.00 Topic 280 8.68 0
Topic 256 78.86 Topic 281 97.50
Topic 257 32.84 Topic 282 1.66
−0.5
Topic 258 22.55 Topic 283 61.94
Topic 259 16.75 Topic 284 23.90
Topic 260 7.48 Topic 285 33.17 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 0.86 Topic 286 13.46 Topic Number
Topic 262 4.79 Topic 287 72.46
Topic 263 9.90 Topic 288 25.08
CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300)
Topic 264 32.73 Topic 289 92.84 1
Topic 265 23.02 Topic 290 66.10 UniNEhu1
Difference (average precision)
Topic 266 22.71 Topic 291 63.52
0.5
Topic 267 55.91 Topic 292 25.60
Topic 268 68.03 Topic 293 88.96
Topic 269 4.30 Topic 294 85.00 0
Topic 270 21.38 Topic 295 18.92
Topic 271 74.87 Topic 296 17.70
Topic 272 20.00 Topic 297 70.96 −0.5
Topic 273 33.32 Topic 298 8.98
Topic 274 44.97 Topic 299 4.11
−1
Topic 275 66.67 Topic 300 4.78 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.310
unine UniNEhu2 AH-Monolingual-HU
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian
Retrieved 50,000 RunType= automatic
Relevant 939 QueryType= TD
Relevant retrieved 797 Pooled= true
CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 69.07 UniNEhu2
90%
10 60.25
20 53.00 80%
30 44.68
70%
40 40.38
50 38.15
Average Precision
60%
60 28.53
50%
70 23.12
80 16.45 40%
90 10.82
30%
100 7.91
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
33.95
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 41.60 UniNEhu2
90%
10 docs 34.00
15 docs 29.33 80%
20 docs 26.90
70%
30 docs 21.87
100 docs 10.48 60%
R−Precision
200 docs 6.40
50%
500 docs 3.03
1000 docs 1.59 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
33.77 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275)
queries 1
UniNEhu2
Topic 251 0.63 Topic 276 28.84
Difference (average precision)
Topic 252 2.46 Topic 277 0.18 0.5
Topic 253 34.38 Topic 278 39.48
Topic 254 52.88 Topic 279 78.09
Topic 255 50.07 Topic 280 8.67 0
Topic 256 71.64 Topic 281 97.20
Topic 257 16.20 Topic 282 10.15
−0.5
Topic 258 33.46 Topic 283 51.63
Topic 259 25.92 Topic 284 29.13
Topic 260 11.98 Topic 285 19.57 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 39.73 Topic 286 7.61 Topic Number
Topic 262 15.48 Topic 287 23.81
Topic 263 8.53 Topic 288 8.22
CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300)
Topic 264 33.86 Topic 289 93.18 1
Topic 265 17.62 Topic 290 51.59 UniNEhu2
Difference (average precision)
Topic 266 24.01 Topic 291 70.23
0.5
Topic 267 45.59 Topic 292 50.93
Topic 268 59.27 Topic 293 87.45
Topic 269 6.62 Topic 294 77.08 0
Topic 270 8.30 Topic 295 26.30
Topic 271 47.68 Topic 296 20.29
Topic 272 14.29 Topic 297 56.03 −0.5
Topic 273 39.28 Topic 298 9.04
Topic 274 25.79 Topic 299 3.82
−1
Topic 275 50.55 Topic 300 12.91 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.311
unine UniNEhu3 AH-Monolingual-HU
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian
Retrieved 50,000 RunType= automatic
Relevant 939 QueryType= TD
Relevant retrieved 882 Pooled= false
CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 68.57 UniNEhu3
90%
10 61.11
20 56.79 80%
30 50.79
70%
40 46.75
50 43.10
Average Precision
60%
60 33.18
50%
70 30.12
80 26.01 40%
90 17.76
30%
100 10.27
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
38.89
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 42.00 UniNEhu3
90%
10 docs 38.00
15 docs 34.80 80%
20 docs 31.50
70%
30 docs 26.67
100 docs 13.20 60%
R−Precision
200 docs 7.61
50%
500 docs 3.41
1000 docs 1.76 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
38.64 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275)
queries 1
UniNEhu3
Topic 251 7.61 Topic 276 32.09
Difference (average precision)
Topic 252 14.79 Topic 277 2.98 0.5
Topic 253 47.95 Topic 278 30.55
Topic 254 64.27 Topic 279 90.53
Topic 255 45.77 Topic 280 7.29 0
Topic 256 80.16 Topic 281 97.22
Topic 257 36.13 Topic 282 8.62
−0.5
Topic 258 22.42 Topic 283 57.55
Topic 259 22.95 Topic 284 32.35
Topic 260 24.76 Topic 285 46.76 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 5.80 Topic 286 8.38 Topic Number
Topic 262 12.19 Topic 287 68.62
Topic 263 13.84 Topic 288 19.06
CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300)
Topic 264 31.88 Topic 289 97.50 1
Topic 265 27.81 Topic 290 74.67 UniNEhu3
Difference (average precision)
Topic 266 19.13 Topic 291 63.94
0.5
Topic 267 66.65 Topic 292 51.54
Topic 268 66.26 Topic 293 93.56
Topic 269 3.50 Topic 294 89.29 0
Topic 270 22.65 Topic 295 18.58
Topic 271 41.24 Topic 296 27.15
Topic 272 5.88 Topic 297 58.85 −0.5
Topic 273 36.85 Topic 298 8.22
Topic 274 73.47 Topic 299 2.92
−1
Topic 275 58.33 Topic 300 4.04 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.312
alicante IRn-pt-fexp AH-Monolingual-PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TD
Relevant retrieved 2,441 Pooled= false
CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 75.26 IRn−pt−fexp
90%
10 61.91
20 53.54 80%
30 47.17
70%
40 39.64
50 34.27
Average Precision
60%
60 27.55
50%
70 22.67
80 17.06 40%
90 11.31
30%
100 5.29
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
34.46
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 56.40 IRn−pt−fexp
90%
10 docs 53.00
15 docs 49.87 80%
20 docs 46.70
70%
30 docs 42.27
100 docs 26.20 60%
R−Precision
200 docs 17.34
50%
500 docs 8.82
1000 docs 4.88 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
35.91 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275)
queries 1
IRn−pt−fexp
Topic 251 54.75 Topic 276 30.63
Difference (average precision)
Topic 252 39.20 Topic 277 12.65 0.5
Topic 253 33.64 Topic 278 45.91
Topic 254 54.60 Topic 279 48.93
Topic 255 23.78 Topic 280 3.97 0
Topic 256 96.13 Topic 281 58.26
Topic 257 14.80 Topic 282 20.19
−0.5
Topic 258 15.00 Topic 283 77.48
Topic 259 41.79 Topic 284 32.79
Topic 260 9.47 Topic 285 29.01 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 20.25 Topic 286 48.09 Topic Number
Topic 262 15.01 Topic 287 15.39
Topic 263 8.55 Topic 288 1.71
CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300)
Topic 264 54.80 Topic 289 40.51 1
Topic 265 23.30 Topic 290 71.15 IRn−pt−fexp
Difference (average precision)
Topic 266 50.81 Topic 291 29.60
0.5
Topic 267 13.82 Topic 292 5.66
Topic 268 26.67 Topic 293 69.64
Topic 269 10.58 Topic 294 66.93 0
Topic 270 34.83 Topic 295 35.72
Topic 271 56.33 Topic 296 37.90
Topic 272 16.39 Topic 297 38.53 −0.5
Topic 273 50.74 Topic 298 48.31
Topic 274 7.91 Topic 299 39.44
−1
Topic 275 38.21 Topic 300 3.00 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.313
alicante IRn-pt-vexp AH-Monolingual-PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TD
Relevant retrieved 2,490 Pooled= true
CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 75.78 IRn−pt−vexp
90%
10 63.61
20 55.39 80%
30 48.70
70%
40 42.34
50 36.05
Average Precision
60%
60 29.43
50%
70 24.80
80 17.99 40%
90 11.84
30%
100 4.80
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
36.03
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 58.80 IRn−pt−vexp
90%
10 docs 52.20
15 docs 48.13 80%
20 docs 46.90
70%
30 docs 42.80
100 docs 27.26 60%
R−Precision
200 docs 18.05
50%
500 docs 8.96
1000 docs 4.98 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
37.59 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275)
queries 1
IRn−pt−vexp
Topic 251 58.84 Topic 276 30.70
Difference (average precision)
Topic 252 36.81 Topic 277 11.55 0.5
Topic 253 38.19 Topic 278 47.47
Topic 254 52.57 Topic 279 57.08
Topic 255 31.91 Topic 280 6.08 0
Topic 256 94.88 Topic 281 61.85
Topic 257 16.30 Topic 282 21.27
−0.5
Topic 258 7.32 Topic 283 78.45
Topic 259 39.63 Topic 284 35.59
Topic 260 9.65 Topic 285 30.40 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 18.43 Topic 286 53.36 Topic Number
Topic 262 15.23 Topic 287 14.69
Topic 263 7.91 Topic 288 2.12
CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300)
Topic 264 57.18 Topic 289 46.52 1
Topic 265 31.81 Topic 290 74.23 IRn−pt−vexp
Difference (average precision)
Topic 266 52.38 Topic 291 26.86
0.5
Topic 267 21.46 Topic 292 6.87
Topic 268 28.80 Topic 293 66.16
Topic 269 11.18 Topic 294 69.39 0
Topic 270 38.07 Topic 295 42.06
Topic 271 56.67 Topic 296 42.49
Topic 272 17.23 Topic 297 44.45 −0.5
Topic 273 47.49 Topic 298 38.73
Topic 274 16.31 Topic 299 42.09
−1
Topic 275 40.35 Topic 300 4.24 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.314
alicante IRn-pt-vnexp AH-Monolingual-PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TD
Relevant retrieved 2,409 Pooled= false
CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 79.40 IRn−pt−vnexp
90%
10 64.35
20 51.23 80%
30 42.83
70%
40 36.74
50 32.21
Average Precision
60%
60 26.90
50%
70 21.23
80 15.37 40%
90 10.33
30%
100 4.89
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
33.15
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 57.60 IRn−pt−vnexp
90%
10 docs 51.00
15 docs 47.47 80%
20 docs 43.40
70%
30 docs 39.87
100 docs 25.14 60%
R−Precision
200 docs 16.95
50%
500 docs 8.59
1000 docs 4.82 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
35.01 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275)
queries 1
IRn−pt−vnexp
Topic 251 54.17 Topic 276 21.91
Difference (average precision)
Topic 252 18.61 Topic 277 5.43 0.5
Topic 253 27.69 Topic 278 33.54
Topic 254 34.56 Topic 279 39.61
Topic 255 22.75 Topic 280 7.27 0
Topic 256 94.88 Topic 281 50.29
Topic 257 15.09 Topic 282 20.56
−0.5
Topic 258 25.00 Topic 283 66.69
Topic 259 45.73 Topic 284 32.53
Topic 260 12.63 Topic 285 34.12 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 19.91 Topic 286 52.12 Topic Number
Topic 262 8.42 Topic 287 15.86
Topic 263 10.19 Topic 288 6.07
CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300)
Topic 264 50.67 Topic 289 45.51 1
Topic 265 27.53 Topic 290 47.38 IRn−pt−vnexp
Difference (average precision)
Topic 266 53.12 Topic 291 26.10
0.5
Topic 267 30.34 Topic 292 8.40
Topic 268 50.41 Topic 293 58.78
Topic 269 8.83 Topic 294 70.99 0
Topic 270 27.85 Topic 295 38.43
Topic 271 59.33 Topic 296 39.98
Topic 272 30.72 Topic 297 28.95 −0.5
Topic 273 37.77 Topic 298 35.26
Topic 274 38.87 Topic 299 43.38
−1
Topic 275 20.77 Topic 300 2.39 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.315
buffalo UBmono-pt-comb1 AH-Monolingual-PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TD
Relevant retrieved 2,379 Pooled= false
CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 77.33 UBmono−pt−comb1
90%
10 58.93
20 49.60 80%
30 43.11
70%
40 35.83
50 30.56
Average Precision
60%
60 24.69
50%
70 20.30
80 14.66 40%
90 9.54
30%
100 3.67
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
31.66
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 52.80 UBmono−pt−comb1
90%
10 docs 50.00
15 docs 45.87 80%
20 docs 43.60
70%
30 docs 38.87
100 docs 24.84 60%
R−Precision
200 docs 16.78
50%
500 docs 8.51
1000 docs 4.76 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
33.76 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275)
queries 1
UBmono−pt−comb1
Topic 251 50.14 Topic 276 21.54
Difference (average precision)
Topic 252 21.71 Topic 277 6.95 0.5
Topic 253 31.18 Topic 278 24.76
Topic 254 38.04 Topic 279 16.72
Topic 255 19.90 Topic 280 6.77 0
Topic 256 94.88 Topic 281 33.45
Topic 257 15.19 Topic 282 16.14
−0.5
Topic 258 5.80 Topic 283 69.67
Topic 259 37.20 Topic 284 31.48
Topic 260 16.79 Topic 285 45.66 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 11.21 Topic 286 29.31 Topic Number
Topic 262 9.71 Topic 287 25.01
Topic 263 10.83 Topic 288 2.59
CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300)
Topic 264 50.47 Topic 289 62.68 1
Topic 265 27.38 Topic 290 50.63 UBmono−pt−comb1
Difference (average precision)
Topic 266 53.55 Topic 291 26.11
0.5
Topic 267 39.96 Topic 292 26.51
Topic 268 44.30 Topic 293 57.98
Topic 269 9.11 Topic 294 75.74 0
Topic 270 21.45 Topic 295 44.45
Topic 271 70.06 Topic 296 36.59
Topic 272 15.89 Topic 297 16.83 −0.5
Topic 273 38.74 Topic 298 24.45
Topic 274 13.26 Topic 299 51.77
−1
Topic 275 31.82 Topic 300 0.82 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.316
buffalo UBmono-pt-rf1 AH-Monolingual-PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TD
Relevant retrieved 2,375 Pooled= true
CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 74.14 UBmono−pt−rf1
90%
10 58.35
20 50.36 80%
30 43.83
70%
40 37.15
50 31.40
Average Precision
60%
60 25.09
50%
70 20.62
80 14.41 40%
90 9.24
30%
100 3.52
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
31.71
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 54.00 UBmono−pt−rf1
90%
10 docs 50.00
15 docs 45.47 80%
20 docs 42.90
70%
30 docs 38.93
100 docs 24.86 60%
R−Precision
200 docs 16.78
50%
500 docs 8.56
1000 docs 4.75 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
34.16 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275)
queries 1
UBmono−pt−rf1
Topic 251 52.40 Topic 276 15.48
Difference (average precision)
Topic 252 21.38 Topic 277 5.01 0.5
Topic 253 30.29 Topic 278 20.50
Topic 254 41.53 Topic 279 17.83
Topic 255 20.16 Topic 280 6.02 0
Topic 256 94.06 Topic 281 33.17
Topic 257 14.59 Topic 282 16.99
−0.5
Topic 258 17.16 Topic 283 69.68
Topic 259 35.20 Topic 284 30.82
Topic 260 17.83 Topic 285 48.48 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 11.55 Topic 286 30.60 Topic Number
Topic 262 11.21 Topic 287 24.30
Topic 263 11.01 Topic 288 2.20
CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300)
Topic 264 47.96 Topic 289 64.37 1
Topic 265 26.80 Topic 290 54.89 UBmono−pt−rf1
Difference (average precision)
Topic 266 53.17 Topic 291 23.70
0.5
Topic 267 42.06 Topic 292 20.76
Topic 268 43.90 Topic 293 62.81
Topic 269 7.96 Topic 294 76.35 0
Topic 270 21.02 Topic 295 47.11
Topic 271 69.87 Topic 296 30.93
Topic 272 16.81 Topic 297 19.99 −0.5
Topic 273 40.05 Topic 298 20.38
Topic 274 13.88 Topic 299 50.37
−1
Topic 275 29.83 Topic 300 0.82 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.317
buffalo UBmono-pt-rf2 AH-Monolingual-PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TD
Relevant retrieved 2,396 Pooled= false
CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 74.40 UBmono−pt−rf2
90%
10 59.13
20 50.09 80%
30 43.86
70%
40 36.89
50 31.32
Average Precision
60%
60 25.30
50%
70 20.90
80 14.75 40%
90 9.36
30%
100 3.71
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
31.89
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 54.00 UBmono−pt−rf2
90%
10 docs 50.40
15 docs 45.60 80%
20 docs 42.80
70%
30 docs 38.47
100 docs 24.92 60%
R−Precision
200 docs 16.81
50%
500 docs 8.60
1000 docs 4.79 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
34.40 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275)
queries 1
UBmono−pt−rf2
Topic 251 52.76 Topic 276 16.06
Difference (average precision)
Topic 252 22.40 Topic 277 5.31 0.5
Topic 253 30.21 Topic 278 22.99
Topic 254 40.46 Topic 279 17.08
Topic 255 20.35 Topic 280 6.97 0
Topic 256 94.06 Topic 281 34.48
Topic 257 15.08 Topic 282 16.60
−0.5
Topic 258 17.01 Topic 283 69.67
Topic 259 35.09 Topic 284 31.49
Topic 260 18.77 Topic 285 48.92 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 11.34 Topic 286 29.21 Topic Number
Topic 262 10.46 Topic 287 23.57
Topic 263 11.67 Topic 288 2.52
CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300)
Topic 264 47.89 Topic 289 64.53 1
Topic 265 27.12 Topic 290 57.20 UBmono−pt−rf2
Difference (average precision)
Topic 266 52.57 Topic 291 23.80
0.5
Topic 267 41.92 Topic 292 25.44
Topic 268 43.08 Topic 293 63.92
Topic 269 7.93 Topic 294 75.62 0
Topic 270 21.24 Topic 295 48.34
Topic 271 69.97 Topic 296 31.47
Topic 272 15.60 Topic 297 19.91 −0.5
Topic 273 39.26 Topic 298 20.69
Topic 274 12.63 Topic 299 50.49
−1
Topic 275 28.62 Topic 300 0.84 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.318
buffalo UBmono-pt-rf3 AH-Monolingual-PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TD
Relevant retrieved 2,375 Pooled= false
CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 76.72 UBmono−pt−rf3
90%
10 58.92
20 49.46 80%
30 43.08
70%
40 36.22
50 30.54
Average Precision
60%
60 25.07
50%
70 20.07
80 14.81 40%
90 9.47
30%
100 3.74
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
31.62
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 54.00 UBmono−pt−rf3
90%
10 docs 50.40
15 docs 46.00 80%
20 docs 43.50
70%
30 docs 38.93
100 docs 24.72 60%
R−Precision
200 docs 16.79
50%
500 docs 8.52
1000 docs 4.75 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
33.46 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275)
queries 1
UBmono−pt−rf3
Topic 251 50.44 Topic 276 21.44
Difference (average precision)
Topic 252 22.98 Topic 277 6.31 0.5
Topic 253 30.82 Topic 278 24.31
Topic 254 41.00 Topic 279 17.72
Topic 255 19.52 Topic 280 6.09 0
Topic 256 94.44 Topic 281 31.68
Topic 257 14.73 Topic 282 16.28
−0.5
Topic 258 5.34 Topic 283 69.49
Topic 259 37.01 Topic 284 30.68
Topic 260 16.46 Topic 285 46.18 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 11.46 Topic 286 31.24 Topic Number
Topic 262 10.43 Topic 287 24.31
Topic 263 10.54 Topic 288 2.59
CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300)
Topic 264 49.86 Topic 289 62.22 1
Topic 265 27.80 Topic 290 54.78 UBmono−pt−rf3
Difference (average precision)
Topic 266 55.02 Topic 291 25.65
0.5
Topic 267 39.52 Topic 292 20.33
Topic 268 45.91 Topic 293 57.86
Topic 269 9.34 Topic 294 76.29 0
Topic 270 21.07 Topic 295 43.26
Topic 271 70.52 Topic 296 36.28
Topic 272 16.38 Topic 297 17.49 −0.5
Topic 273 39.28 Topic 298 23.30
Topic 274 11.75 Topic 299 51.53
−1
Topic 275 31.51 Topic 300 0.76 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.319
hummingbird humPT05t AH-Monolingual-PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese
Retrieved 48,503 RunType= automatic
Relevant 2,904 QueryType= T
Relevant retrieved 2,074 Pooled= true
CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 77.30 humPT05t
90%
10 58.32
20 47.81 80%
30 41.66
70%
40 35.97
50 31.53
Average Precision
60%
60 22.59
50%
70 16.87
80 10.44 40%
90 6.79
30%
100 3.73
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
29.99
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 51.20 humPT05t
90%
10 docs 47.80
15 docs 43.07 80%
20 docs 38.80
70%
30 docs 34.33
100 docs 22.02 60%
R−Precision
200 docs 14.17
50%
500 docs 7.38
1000 docs 4.15 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
34.07 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275)
queries 1
humPT05t
Topic 251 20.70 Topic 276 22.93
Difference (average precision)
Topic 252 36.26 Topic 277 8.17 0.5
Topic 253 34.96 Topic 278 60.36
Topic 254 11.20 Topic 279 51.82
Topic 255 62.62 Topic 280 39.16 0
Topic 256 100.00 Topic 281 23.93
Topic 257 26.01 Topic 282 3.84
−0.5
Topic 258 50.00 Topic 283 73.51
Topic 259 44.95 Topic 284 40.69
Topic 260 0.21 Topic 285 43.72 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 10.17 Topic 286 48.79 Topic Number
Topic 262 6.22 Topic 287 18.20
Topic 263 8.21 Topic 288 1.11
CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300)
Topic 264 15.81 Topic 289 78.82 1
Topic 265 29.03 Topic 290 37.94 humPT05t
Difference (average precision)
Topic 266 42.17 Topic 291 21.67
0.5
Topic 267 29.10 Topic 292 12.13
Topic 268 46.91 Topic 293 36.23
Topic 269 9.54 Topic 294 43.22 0
Topic 270 23.78 Topic 295 45.09
Topic 271 34.19 Topic 296 31.72
Topic 272 0.85 Topic 297 11.75 −0.5
Topic 273 13.21 Topic 298 30.49
Topic 274 9.63 Topic 299 20.34
−1
Topic 275 26.58 Topic 300 1.64 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.320
hummingbird humPT05td AH-Monolingual-PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TD
Relevant retrieved 2,472 Pooled= false
CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 83.81 humPT05td
90%
10 66.50
20 53.30 80%
30 46.46
70%
40 40.67
50 36.60
Average Precision
60%
60 29.34
50%
70 22.76
80 17.38 40%
90 10.94
30%
100 4.77
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
35.72
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 57.60 humPT05td
90%
10 docs 54.00
15 docs 49.73 80%
20 docs 46.10
70%
30 docs 41.60
100 docs 26.20 60%
R−Precision
200 docs 17.81
50%
500 docs 9.08
1000 docs 4.94 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
38.21 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275)
queries 1
humPT05td
Topic 251 47.50 Topic 276 29.28
Difference (average precision)
Topic 252 27.04 Topic 277 8.91 0.5
Topic 253 24.20 Topic 278 37.23
Topic 254 37.88 Topic 279 47.85
Topic 255 38.68 Topic 280 10.25 0
Topic 256 96.53 Topic 281 47.71
Topic 257 16.66 Topic 282 24.94
−0.5
Topic 258 5.00 Topic 283 70.94
Topic 259 34.21 Topic 284 36.08
Topic 260 27.19 Topic 285 35.05 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 15.58 Topic 286 61.54 Topic Number
Topic 262 8.69 Topic 287 17.72
Topic 263 18.71 Topic 288 12.17
CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300)
Topic 264 50.23 Topic 289 78.82 1
Topic 265 24.59 Topic 290 43.71 humPT05td
Difference (average precision)
Topic 266 52.16 Topic 291 26.33
0.5
Topic 267 41.43 Topic 292 23.83
Topic 268 40.70 Topic 293 49.73
Topic 269 9.19 Topic 294 74.58 0
Topic 270 32.33 Topic 295 31.44
Topic 271 64.92 Topic 296 40.91
Topic 272 24.50 Topic 297 38.59 −0.5
Topic 273 39.22 Topic 298 34.46
Topic 274 36.45 Topic 299 54.62
−1
Topic 275 34.00 Topic 300 1.70 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.321
hummingbird humPT05tde AH-Monolingual-PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TD
Relevant retrieved 2,476 Pooled= false
CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 82.64 humPT05tde
90%
10 67.71
20 55.97 80%
30 50.86
70%
40 45.43
50 40.82
Average Precision
60%
60 33.60
50%
70 26.61
80 20.08 40%
90 13.13
30%
100 6.19
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
38.64
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 58.80 humPT05tde
90%
10 docs 57.00
15 docs 52.13 80%
20 docs 48.70
70%
30 docs 44.67
100 docs 28.80 60%
R−Precision
200 docs 18.75
50%
500 docs 9.24
1000 docs 4.95 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
40.55 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275)
queries 1
humPT05tde
Topic 251 50.03 Topic 276 33.80
Difference (average precision)
Topic 252 25.25 Topic 277 12.05 0.5
Topic 253 28.59 Topic 278 43.35
Topic 254 57.17 Topic 279 56.23
Topic 255 34.01 Topic 280 13.32 0
Topic 256 97.22 Topic 281 52.88
Topic 257 19.67 Topic 282 29.94
−0.5
Topic 258 0.49 Topic 283 75.46
Topic 259 33.38 Topic 284 36.13
Topic 260 22.87 Topic 285 28.17 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 16.73 Topic 286 56.30 Topic Number
Topic 262 6.44 Topic 287 17.46
Topic 263 19.80 Topic 288 19.17
CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300)
Topic 264 69.92 Topic 289 72.12 1
Topic 265 25.82 Topic 290 74.13 humPT05tde
Difference (average precision)
Topic 266 58.89 Topic 291 30.78
0.5
Topic 267 32.13 Topic 292 21.87
Topic 268 42.66 Topic 293 62.68
Topic 269 10.22 Topic 294 79.11 0
Topic 270 29.24 Topic 295 37.63
Topic 271 69.57 Topic 296 39.71
Topic 272 23.42 Topic 297 43.98 −0.5
Topic 273 51.67 Topic 298 40.46
Topic 274 12.49 Topic 299 61.51
−1
Topic 275 54.32 Topic 300 1.87 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.322
jhu-apl aplmopta AH-Monolingual-PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TD
Relevant retrieved 2,263 Pooled= false
CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 64.44 aplmopta
90%
10 53.48
20 47.59 80%
30 40.74
70%
40 35.29
50 31.06
Average Precision
60%
60 25.84
50%
70 20.92
80 16.24 40%
90 11.08
30%
100 7.37
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
30.63
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 45.20 aplmopta
90%
10 docs 42.60
15 docs 40.27 80%
20 docs 38.80
70%
30 docs 35.87
100 docs 24.54 60%
R−Precision
200 docs 16.38
50%
500 docs 8.24
1000 docs 4.53 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
32.62 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275)
queries 1
aplmopta
Topic 251 43.29 Topic 276 23.06
Difference (average precision)
Topic 252 32.91 Topic 277 10.46 0.5
Topic 253 12.29 Topic 278 30.58
Topic 254 58.59 Topic 279 49.90
Topic 255 5.20 Topic 280 0.84 0
Topic 256 100.00 Topic 281 36.85
Topic 257 13.90 Topic 282 12.07
−0.5
Topic 258 7.13 Topic 283 80.96
Topic 259 33.51 Topic 284 23.50
Topic 260 13.44 Topic 285 41.32 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 18.60 Topic 286 37.29 Topic Number
Topic 262 1.02 Topic 287 15.22
Topic 263 7.94 Topic 288 0.63
CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300)
Topic 264 43.25 Topic 289 84.15 1
Topic 265 27.20 Topic 290 68.44 aplmopta
Difference (average precision)
Topic 266 24.65 Topic 291 22.22
0.5
Topic 267 49.06 Topic 292 29.20
Topic 268 12.44 Topic 293 73.10
Topic 269 5.00 Topic 294 51.03 0
Topic 270 25.06 Topic 295 24.33
Topic 271 47.94 Topic 296 49.39
Topic 272 27.83 Topic 297 35.79 −0.5
Topic 273 40.00 Topic 298 9.66
Topic 274 5.40 Topic 299 45.43
−1
Topic 275 19.90 Topic 300 0.73 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.323
jhu-apl aplmoptc AH-Monolingual-PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TD
Relevant retrieved 2,446 Pooled= true
CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 79.71 aplmoptc
90%
10 62.87
20 54.27 80%
30 45.97
70%
40 40.61
50 35.75
Average Precision
60%
60 31.22
50%
70 24.42
80 19.32 40%
90 13.90
30%
100 7.34
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
36.10
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 57.20 aplmoptc
90%
10 docs 52.60
15 docs 48.67 80%
20 docs 46.20
70%
30 docs 41.67
100 docs 26.26 60%
R−Precision
200 docs 17.41
50%
500 docs 8.74
1000 docs 4.89 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
36.62 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275)
queries 1
aplmoptc
Topic 251 72.62 Topic 276 40.17
Difference (average precision)
Topic 252 7.51 Topic 277 14.77 0.5
Topic 253 20.24 Topic 278 35.86
Topic 254 68.11 Topic 279 44.31
Topic 255 6.16 Topic 280 17.66 0
Topic 256 100.00 Topic 281 38.62
Topic 257 23.43 Topic 282 16.91
−0.5
Topic 258 1.55 Topic 283 80.64
Topic 259 22.66 Topic 284 26.78
Topic 260 20.51 Topic 285 48.63 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 11.88 Topic 286 29.86 Topic Number
Topic 262 3.55 Topic 287 26.03
Topic 263 9.79 Topic 288 0.52
CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300)
Topic 264 45.95 Topic 289 82.54 1
Topic 265 26.02 Topic 290 67.08 aplmoptc
Difference (average precision)
Topic 266 43.59 Topic 291 25.69
0.5
Topic 267 49.00 Topic 292 32.42
Topic 268 44.89 Topic 293 78.51
Topic 269 7.83 Topic 294 76.20 0
Topic 270 22.21 Topic 295 51.57
Topic 271 52.61 Topic 296 45.55
Topic 272 28.25 Topic 297 58.55 −0.5
Topic 273 49.96 Topic 298 10.65
Topic 274 20.59 Topic 299 46.90
−1
Topic 275 48.04 Topic 300 1.72 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.324
jhu-apl aplmoptd AH-Monolingual-PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TD
Relevant retrieved 2,343 Pooled= false
CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 76.85 aplmoptd
90%
10 57.56
20 48.83 80%
30 41.20
70%
40 36.27
50 31.77
Average Precision
60%
60 26.73
50%
70 21.54
80 17.49 40%
90 11.72
30%
100 6.48
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
32.46
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 52.00 aplmoptd
90%
10 docs 48.80
15 docs 45.87 80%
20 docs 44.00
70%
30 docs 38.73
100 docs 24.38 60%
R−Precision
200 docs 16.47
50%
500 docs 8.33
1000 docs 4.69 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
32.33 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275)
queries 1
aplmoptd
Topic 251 70.49 Topic 276 43.26
Difference (average precision)
Topic 252 0.19 Topic 277 13.31 0.5
Topic 253 15.17 Topic 278 26.25
Topic 254 56.14 Topic 279 8.41
Topic 255 2.69 Topic 280 29.23 0
Topic 256 100.00 Topic 281 40.90
Topic 257 25.29 Topic 282 13.46
−0.5
Topic 258 0.85 Topic 283 80.43
Topic 259 19.51 Topic 284 25.83
Topic 260 18.34 Topic 285 39.75 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 11.84 Topic 286 28.52 Topic Number
Topic 262 1.36 Topic 287 9.98
Topic 263 8.30 Topic 288 0.67
CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300)
Topic 264 42.93 Topic 289 82.21 1
Topic 265 25.83 Topic 290 55.12 aplmoptd
Difference (average precision)
Topic 266 41.07 Topic 291 26.59
0.5
Topic 267 42.64 Topic 292 19.10
Topic 268 43.25 Topic 293 69.64
Topic 269 5.75 Topic 294 57.89 0
Topic 270 21.23 Topic 295 50.47
Topic 271 49.88 Topic 296 48.10
Topic 272 29.79 Topic 297 59.07 −0.5
Topic 273 53.57 Topic 298 11.17
Topic 274 3.77 Topic 299 47.15
−1
Topic 275 44.64 Topic 300 1.91 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.325
jhu-apl aplmopte AH-Monolingual-PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TD
Relevant retrieved 2,450 Pooled= false
CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 78.41 aplmopte
90%
10 62.96
20 54.44 80%
30 48.15
70%
40 41.24
50 36.52
Average Precision
60%
60 30.96
50%
70 25.55
80 19.14 40%
90 13.68
30%
100 7.39
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
36.54
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 55.60 aplmopte
90%
10 docs 53.00
15 docs 48.93 80%
20 docs 46.60
70%
30 docs 41.87
100 docs 26.76 60%
R−Precision
200 docs 17.67
50%
500 docs 8.82
1000 docs 4.90 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
37.00 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275)
queries 1
aplmopte
Topic 251 72.60 Topic 276 35.91
Difference (average precision)
Topic 252 24.58 Topic 277 15.61 0.5
Topic 253 22.67 Topic 278 34.79
Topic 254 68.82 Topic 279 50.71
Topic 255 13.27 Topic 280 2.99 0
Topic 256 100.00 Topic 281 36.92
Topic 257 21.67 Topic 282 19.00
−0.5
Topic 258 2.66 Topic 283 78.10
Topic 259 26.64 Topic 284 28.23
Topic 260 21.50 Topic 285 47.95 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 11.95 Topic 286 29.75 Topic Number
Topic 262 5.78 Topic 287 34.14
Topic 263 10.47 Topic 288 0.34
CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300)
Topic 264 46.29 Topic 289 84.15 1
Topic 265 25.25 Topic 290 72.14 aplmopte
Difference (average precision)
Topic 266 43.89 Topic 291 24.86
0.5
Topic 267 51.54 Topic 292 36.34
Topic 268 44.93 Topic 293 80.15
Topic 269 8.76 Topic 294 77.67 0
Topic 270 22.42 Topic 295 46.53
Topic 271 54.78 Topic 296 39.36
Topic 272 25.88 Topic 297 57.97 −0.5
Topic 273 43.56 Topic 298 9.31
Topic 274 24.54 Topic 299 44.85
−1
Topic 275 43.27 Topic 300 1.45 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.326
miracle SR AH-Monolingual-PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TDN
Relevant retrieved 2,519 Pooled= true
CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 82.17 SR
90%
10 68.83
20 60.45 80%
30 49.07
70%
40 41.65
50 36.57
Average Precision
60%
60 30.34
50%
70 24.13
80 18.60 40%
90 11.51
30%
100 5.66
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
36.98
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 61.20 SR
90%
10 docs 54.80
15 docs 51.20 80%
20 docs 48.80
70%
30 docs 43.53
100 docs 28.18 60%
R−Precision
200 docs 18.53
50%
500 docs 9.20
1000 docs 5.04 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
37.71 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275)
queries 1
SR
Topic 251 40.05 Topic 276 31.54
Difference (average precision)
Topic 252 30.80 Topic 277 8.77 0.5
Topic 253 39.50 Topic 278 37.73
Topic 254 50.14 Topic 279 20.15
Topic 255 39.89 Topic 280 7.02 0
Topic 256 92.28 Topic 281 65.57
Topic 257 23.47 Topic 282 20.50
−0.5
Topic 258 1.30 Topic 283 69.04
Topic 259 40.42 Topic 284 35.27
Topic 260 13.13 Topic 285 37.96 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 24.02 Topic 286 46.89 Topic Number
Topic 262 16.40 Topic 287 35.25
Topic 263 16.63 Topic 288 18.33
CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300)
Topic 264 57.36 Topic 289 53.57 1
Topic 265 25.25 Topic 290 37.47 SR
Difference (average precision)
Topic 266 57.58 Topic 291 28.30
0.5
Topic 267 32.35 Topic 292 30.41
Topic 268 39.67 Topic 293 52.45
Topic 269 9.79 Topic 294 81.57 0
Topic 270 27.79 Topic 295 58.23
Topic 271 54.81 Topic 296 52.76
Topic 272 34.84 Topic 297 41.84 −0.5
Topic 273 52.83 Topic 298 35.92
Topic 274 16.89 Topic 299 54.14
−1
Topic 275 44.97 Topic 300 5.94 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.327
miracle ST AH-Monolingual-PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TD
Relevant retrieved 2,444 Pooled= false
CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 82.32 ST
90%
10 65.24
20 52.85 80%
30 45.27
70%
40 38.81
50 33.35
Average Precision
60%
60 27.81
50%
70 22.41
80 16.56 40%
90 11.73
30%
100 5.36
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
34.56
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 60.40 ST
90%
10 docs 53.80
15 docs 48.00 80%
20 docs 44.30
70%
30 docs 40.87
100 docs 25.76 60%
R−Precision
200 docs 17.69
50%
500 docs 8.88
1000 docs 4.89 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
36.30 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275)
queries 1
ST
Topic 251 51.28 Topic 276 31.60
Difference (average precision)
Topic 252 22.11 Topic 277 9.72 0.5
Topic 253 29.42 Topic 278 31.58
Topic 254 35.24 Topic 279 11.23
Topic 255 24.55 Topic 280 12.48 0
Topic 256 97.22 Topic 281 45.19
Topic 257 17.02 Topic 282 18.57
−0.5
Topic 258 2.68 Topic 283 65.34
Topic 259 35.50 Topic 284 27.87
Topic 260 21.11 Topic 285 39.15 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 12.55 Topic 286 34.84 Topic Number
Topic 262 9.05 Topic 287 27.23
Topic 263 14.70 Topic 288 11.87
CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300)
Topic 264 53.68 Topic 289 71.20 1
Topic 265 24.22 Topic 290 49.14 ST
Difference (average precision)
Topic 266 51.41 Topic 291 27.83
0.5
Topic 267 36.15 Topic 292 28.07
Topic 268 47.45 Topic 293 60.47
Topic 269 8.60 Topic 294 78.81 0
Topic 270 27.96 Topic 295 44.49
Topic 271 66.96 Topic 296 46.94
Topic 272 32.41 Topic 297 33.42 −0.5
Topic 273 39.21 Topic 298 26.02
Topic 274 33.56 Topic 299 55.07
−1
Topic 275 39.43 Topic 300 6.24 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.328
miracle aSRr1SR AH-Monolingual-PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TDN
Relevant retrieved 1,949 Pooled= false
CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 72.17 aSRr1SR
90%
10 56.83
20 45.99 80%
30 39.34
70%
40 33.75
50 27.16
Average Precision
60%
60 21.32
50%
70 15.69
80 10.28 40%
90 6.20
30%
100 2.90
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
28.32
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 51.60 aSRr1SR
90%
10 docs 48.40
15 docs 43.07 80%
20 docs 39.70
70%
30 docs 35.80
100 docs 21.24 60%
R−Precision
200 docs 14.74
50%
500 docs 7.45
1000 docs 3.90 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
31.37 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275)
queries 1
aSRr1SR
Topic 251 35.61 Topic 276 19.35
Difference (average precision)
Topic 252 14.60 Topic 277 9.48 0.5
Topic 253 20.08 Topic 278 34.57
Topic 254 51.66 Topic 279 0.48
Topic 255 55.71 Topic 280 20.42 0
Topic 256 94.64 Topic 281 72.85
Topic 257 29.64 Topic 282 23.80
−0.5
Topic 258 0.00 Topic 283 63.84
Topic 259 12.94 Topic 284 19.87
Topic 260 6.35 Topic 285 23.59 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 6.65 Topic 286 17.46 Topic Number
Topic 262 0.20 Topic 287 4.85
Topic 263 3.97 Topic 288 0.23
CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300)
Topic 264 63.15 Topic 289 47.86 1
Topic 265 26.64 Topic 290 62.87 aSRr1SR
Difference (average precision)
Topic 266 39.69 Topic 291 18.20
0.5
Topic 267 11.72 Topic 292 42.15
Topic 268 40.60 Topic 293 39.66
Topic 269 5.25 Topic 294 56.68 0
Topic 270 7.93 Topic 295 34.79
Topic 271 60.60 Topic 296 31.49
Topic 272 26.88 Topic 297 12.09 −0.5
Topic 273 36.29 Topic 298 6.29
Topic 274 0.26 Topic 299 41.79
−1
Topic 275 50.60 Topic 300 9.53 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.329
miracle xNP01SR1 AH-Monolingual-PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TDN
Relevant retrieved 2,519 Pooled= false
CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 81.60 xNP01SR1
90%
10 67.15
20 58.14 80%
30 47.45
70%
40 41.14
50 36.21
Average Precision
60%
60 29.42
50%
70 22.90
80 17.95 40%
90 11.34
30%
100 5.61
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
36.28
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 60.80 xNP01SR1
90%
10 docs 54.80
15 docs 50.93 80%
20 docs 48.30
70%
30 docs 43.40
100 docs 28.08 60%
R−Precision
200 docs 18.47
50%
500 docs 9.17
1000 docs 5.04 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
37.08 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275)
queries 1
xNP01SR1
Topic 251 40.05 Topic 276 27.15
Difference (average precision)
Topic 252 30.80 Topic 277 6.85 0.5
Topic 253 39.00 Topic 278 37.73
Topic 254 50.14 Topic 279 22.17
Topic 255 27.99 Topic 280 7.02 0
Topic 256 91.45 Topic 281 65.47
Topic 257 23.59 Topic 282 20.55
−0.5
Topic 258 1.30 Topic 283 68.84
Topic 259 42.02 Topic 284 35.27
Topic 260 13.13 Topic 285 37.96 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 21.67 Topic 286 47.83 Topic Number
Topic 262 16.63 Topic 287 35.25
Topic 263 16.63 Topic 288 18.43
CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300)
Topic 264 57.36 Topic 289 53.57 1
Topic 265 25.25 Topic 290 37.47 xNP01SR1
Difference (average precision)
Topic 266 57.61 Topic 291 28.47
0.5
Topic 267 32.68 Topic 292 28.91
Topic 268 26.66 Topic 293 52.45
Topic 269 9.82 Topic 294 81.57 0
Topic 270 31.18 Topic 295 58.24
Topic 271 51.96 Topic 296 50.85
Topic 272 29.04 Topic 297 43.21 −0.5
Topic 273 52.21 Topic 298 35.92
Topic 274 19.40 Topic 299 54.02
−1
Topic 275 44.98 Topic 300 6.04 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.330
tlr tlrTDpt3 AH-Monolingual-PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TD
Relevant retrieved 2,437 Pooled= false
CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 79.01 tlrTDpt3
90%
10 62.79
20 53.32 80%
30 45.28
70%
40 39.72
50 34.74
Average Precision
60%
60 29.19
50%
70 24.24
80 18.32 40%
90 12.61
30%
100 7.63
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
35.01
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 56.40 tlrTDpt3
90%
10 docs 51.40
15 docs 47.20 80%
20 docs 44.30
70%
30 docs 40.73
100 docs 25.18 60%
R−Precision
200 docs 16.88
50%
500 docs 8.71
1000 docs 4.87 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
37.34 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275)
queries 1
tlrTDpt3
Topic 251 51.11 Topic 276 20.69
Difference (average precision)
Topic 252 21.36 Topic 277 12.14 0.5
Topic 253 18.05 Topic 278 33.21
Topic 254 31.25 Topic 279 50.90
Topic 255 39.46 Topic 280 6.92 0
Topic 256 98.81 Topic 281 51.18
Topic 257 17.75 Topic 282 19.88
−0.5
Topic 258 45.00 Topic 283 71.63
Topic 259 38.52 Topic 284 36.81
Topic 260 9.79 Topic 285 44.86 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 17.60 Topic 286 58.98 Topic Number
Topic 262 8.08 Topic 287 20.12
Topic 263 11.80 Topic 288 9.94
CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300)
Topic 264 46.74 Topic 289 68.45 1
Topic 265 28.30 Topic 290 43.55 tlrTDpt3
Difference (average precision)
Topic 266 44.88 Topic 291 24.98
0.5
Topic 267 41.88 Topic 292 12.75
Topic 268 53.31 Topic 293 46.77
Topic 269 5.13 Topic 294 69.34 0
Topic 270 28.97 Topic 295 40.78
Topic 271 59.09 Topic 296 49.49
Topic 272 28.05 Topic 297 44.19 −0.5
Topic 273 35.07 Topic 298 43.26
Topic 274 22.78 Topic 299 42.84
−1
Topic 275 22.26 Topic 300 1.85 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.331
tlr tlrTDptRF2 AH-Monolingual-PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TD
Relevant retrieved 2,544 Pooled= false
CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 73.05 tlrTDptRF2
90%
10 62.13
20 56.25 80%
30 49.62
70%
40 43.60
50 38.75
Average Precision
60%
60 33.16
50%
70 26.92
80 22.56 40%
90 14.69
30%
100 8.61
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
37.42
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 56.00 tlrTDptRF2
90%
10 docs 51.80
15 docs 47.20 80%
20 docs 45.10
70%
30 docs 40.60
100 docs 26.54 60%
R−Precision
200 docs 18.07
50%
500 docs 9.27
1000 docs 5.09 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
39.04 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275)
queries 1
tlrTDptRF2
Topic 251 56.66 Topic 276 30.09
Difference (average precision)
Topic 252 20.43 Topic 277 13.03 0.5
Topic 253 29.52 Topic 278 36.97
Topic 254 54.17 Topic 279 59.80
Topic 255 44.83 Topic 280 6.85 0
Topic 256 96.63 Topic 281 50.90
Topic 257 22.91 Topic 282 21.75
−0.5
Topic 258 100.00 Topic 283 76.41
Topic 259 36.97 Topic 284 31.93
Topic 260 11.75 Topic 285 47.94 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 12.12 Topic 286 57.93 Topic Number
Topic 262 6.79 Topic 287 13.81
Topic 263 9.98 Topic 288 1.82
CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300)
Topic 264 65.98 Topic 289 54.84 1
Topic 265 32.83 Topic 290 15.01 tlrTDptRF2
Difference (average precision)
Topic 266 47.80 Topic 291 25.78
0.5
Topic 267 40.52 Topic 292 13.44
Topic 268 49.57 Topic 293 56.05
Topic 269 5.06 Topic 294 65.36 0
Topic 270 36.36 Topic 295 52.41
Topic 271 53.47 Topic 296 51.11
Topic 272 37.53 Topic 297 35.20 −0.5
Topic 273 40.80 Topic 298 44.00
Topic 274 4.42 Topic 299 52.00
−1
Topic 275 36.53 Topic 300 2.76 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.332
tlr tlrTDptRFS1 AH-Monolingual-PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TD
Relevant retrieved 2,488 Pooled= true
CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 73.06 tlrTDptRFS1
90%
10 61.36
20 55.07 80%
30 48.10
70%
40 42.14
50 36.69
Average Precision
60%
60 30.63
50%
70 24.55
80 20.49 40%
90 13.47
30%
100 7.48
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
35.84
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 56.00 tlrTDptRFS1
90%
10 docs 52.40
15 docs 47.73 80%
20 docs 45.30
70%
30 docs 40.40
100 docs 26.06 60%
R−Precision
200 docs 17.54
50%
500 docs 8.98
1000 docs 4.98 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
38.05 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275)
queries 1
tlrTDptRFS1
Topic 251 56.66 Topic 276 30.09
Difference (average precision)
Topic 252 20.43 Topic 277 12.14 0.5
Topic 253 29.52 Topic 278 36.97
Topic 254 31.25 Topic 279 59.80
Topic 255 44.83 Topic 280 6.85 0
Topic 256 96.63 Topic 281 51.18
Topic 257 17.75 Topic 282 21.75
−0.5
Topic 258 45.00 Topic 283 76.41
Topic 259 36.97 Topic 284 31.93
Topic 260 11.75 Topic 285 44.86 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 12.12 Topic 286 57.93 Topic Number
Topic 262 8.08 Topic 287 13.81
Topic 263 9.98 Topic 288 1.82
CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300)
Topic 264 65.98 Topic 289 54.84 1
Topic 265 32.83 Topic 290 15.01 tlrTDptRFS1
Difference (average precision)
Topic 266 47.80 Topic 291 25.78
0.5
Topic 267 40.52 Topic 292 13.44
Topic 268 49.57 Topic 293 56.05
Topic 269 5.06 Topic 294 65.36 0
Topic 270 36.36 Topic 295 40.78
Topic 271 53.47 Topic 296 51.11
Topic 272 37.53 Topic 297 35.20 −0.5
Topic 273 40.80 Topic 298 44.00
Topic 274 22.78 Topic 299 52.00
−1
Topic 275 36.53 Topic 300 2.76 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.333
u.glasgow glapttdn AH-Monolingual-PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TDN
Relevant retrieved 1,862 Pooled= true
CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 65.51 glapttdn
90%
10 49.37
20 36.02 80%
30 29.84
70%
40 24.80
50 20.66
Average Precision
60%
60 17.22
50%
70 13.58
80 8.76 40%
90 5.38
30%
100 2.18
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
23.16
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 42.40 glapttdn
90%
10 docs 38.80
15 docs 34.40 80%
20 docs 32.80
70%
30 docs 29.20
100 docs 17.72 60%
R−Precision
200 docs 12.28
50%
500 docs 6.36
1000 docs 3.72 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
24.86 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275)
queries 1
glapttdn
Topic 251 37.37 Topic 276 0.04
Difference (average precision)
Topic 252 6.66 Topic 277 0.00 0.5
Topic 253 13.60 Topic 278 29.08
Topic 254 45.49 Topic 279 0.07
Topic 255 19.26 Topic 280 4.38 0
Topic 256 89.54 Topic 281 57.80
Topic 257 0.72 Topic 282 12.63
−0.5
Topic 258 0.00 Topic 283 65.44
Topic 259 37.95 Topic 284 6.85
Topic 260 6.92 Topic 285 34.20 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 6.67 Topic 286 0.69 Topic Number
Topic 262 1.99 Topic 287 0.40
Topic 263 2.90 Topic 288 3.17
CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300)
Topic 264 47.30 Topic 289 66.92 1
Topic 265 19.40 Topic 290 0.00 glapttdn
Difference (average precision)
Topic 266 51.65 Topic 291 24.74
0.5
Topic 267 25.15 Topic 292 11.88
Topic 268 33.06 Topic 293 38.10
Topic 269 2.77 Topic 294 7.76 0
Topic 270 22.51 Topic 295 47.86
Topic 271 11.47 Topic 296 53.16
Topic 272 22.08 Topic 297 13.94 −0.5
Topic 273 39.66 Topic 298 35.33
Topic 274 19.57 Topic 299 45.41
−1
Topic 275 33.63 Topic 300 0.58 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.334
u.glasgow glapttdnqe AH-Monolingual-PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TDN
Relevant retrieved 2,020 Pooled= false
CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 55.85 glapttdnqe
90%
10 49.04
20 41.75 80%
30 36.92
70%
40 32.16
50 26.60
Average Precision
60%
60 22.70
50%
70 19.26
80 14.04 40%
90 8.77
30%
100 4.09
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
27.50
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 44.00 glapttdnqe
90%
10 docs 43.60
15 docs 40.40 80%
20 docs 36.70
70%
30 docs 32.33
100 docs 20.02 60%
R−Precision
200 docs 13.62
50%
500 docs 7.08
1000 docs 4.04 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
27.13 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275)
queries 1
glapttdnqe
Topic 251 56.53 Topic 276 0.03
Difference (average precision)
Topic 252 64.14 Topic 277 0.00 0.5
Topic 253 30.43 Topic 278 44.91
Topic 254 62.06 Topic 279 0.08
Topic 255 9.90 Topic 280 1.71 0
Topic 256 93.45 Topic 281 60.83
Topic 257 0.77 Topic 282 21.04
−0.5
Topic 258 0.00 Topic 283 73.57
Topic 259 53.31 Topic 284 10.10
Topic 260 10.18 Topic 285 39.36 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 4.06 Topic 286 0.15 Topic Number
Topic 262 1.07 Topic 287 0.31
Topic 263 4.89 Topic 288 2.26
CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300)
Topic 264 62.34 Topic 289 61.93 1
Topic 265 21.36 Topic 290 0.00 glapttdnqe
Difference (average precision)
Topic 266 52.46 Topic 291 24.37
0.5
Topic 267 18.93 Topic 292 7.31
Topic 268 31.15 Topic 293 46.34
Topic 269 2.90 Topic 294 3.34 0
Topic 270 22.55 Topic 295 52.79
Topic 271 2.79 Topic 296 60.48
Topic 272 22.78 Topic 297 37.21 −0.5
Topic 273 33.20 Topic 298 57.96
Topic 274 4.13 Topic 299 58.10
−1
Topic 275 44.85 Topic 300 0.35 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.335
u.glasgow glapttdqe AH-Monolingual-PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TD
Relevant retrieved 2,087 Pooled= false
CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 56.82 glapttdqe
90%
10 46.38
20 40.93 80%
30 36.91
70%
40 32.51
50 27.20
Average Precision
60%
60 22.52
50%
70 19.49
80 14.44 40%
90 9.68
30%
100 4.09
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
27.38
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 44.00 glapttdqe
90%
10 docs 41.60
15 docs 38.40 80%
20 docs 37.00
70%
30 docs 32.93
100 docs 20.60 60%
R−Precision
200 docs 14.20
50%
500 docs 7.34
1000 docs 4.17 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
28.03 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275)
queries 1
glapttdqe
Topic 251 59.41 Topic 276 0.01
Difference (average precision)
Topic 252 23.13 Topic 277 0.00 0.5
Topic 253 28.80 Topic 278 49.25
Topic 254 66.92 Topic 279 0.08
Topic 255 7.18 Topic 280 0.74 0
Topic 256 94.98 Topic 281 61.38
Topic 257 28.55 Topic 282 21.44
−0.5
Topic 258 0.00 Topic 283 73.69
Topic 259 40.87 Topic 284 16.99
Topic 260 9.15 Topic 285 37.57 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 4.75 Topic 286 0.45 Topic Number
Topic 262 0.41 Topic 287 0.28
Topic 263 3.76 Topic 288 2.49
CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300)
Topic 264 61.56 Topic 289 67.61 1
Topic 265 23.71 Topic 290 0.00 glapttdqe
Difference (average precision)
Topic 266 52.86 Topic 291 24.82
0.5
Topic 267 20.06 Topic 292 11.48
Topic 268 33.48 Topic 293 52.04
Topic 269 2.78 Topic 294 6.24 0
Topic 270 24.15 Topic 295 58.28
Topic 271 7.68 Topic 296 59.95
Topic 272 21.51 Topic 297 10.40 −0.5
Topic 273 38.22 Topic 298 57.62
Topic 274 2.81 Topic 299 59.05
−1
Topic 275 39.91 Topic 300 0.54 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.336
unine UniNEpt1 AH-Monolingual-PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TD
Relevant retrieved 2,474 Pooled= true
CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 77.57 UniNEpt1
90%
10 67.44
20 60.29 80%
30 51.51
70%
40 45.10
50 38.35
Average Precision
60%
60 31.92
50%
70 24.62
80 19.05 40%
90 12.44
30%
100 6.39
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
38.25
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 60.00 UniNEpt1
90%
10 docs 55.00
15 docs 52.80 80%
20 docs 49.30
70%
30 docs 44.00
100 docs 27.50 60%
R−Precision
200 docs 18.06
50%
500 docs 8.97
1000 docs 4.95 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
38.57 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275)
queries 1
UniNEpt1
Topic 251 54.53 Topic 276 29.93
Difference (average precision)
Topic 252 31.18 Topic 277 12.24 0.5
Topic 253 29.11 Topic 278 50.24
Topic 254 63.59 Topic 279 52.74
Topic 255 44.73 Topic 280 2.12 0
Topic 256 95.65 Topic 281 64.62
Topic 257 26.26 Topic 282 29.61
−0.5
Topic 258 3.08 Topic 283 75.44
Topic 259 35.49 Topic 284 20.21
Topic 260 17.07 Topic 285 39.81 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 23.45 Topic 286 53.42 Topic Number
Topic 262 16.88 Topic 287 3.76
Topic 263 9.45 Topic 288 1.91
CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300)
Topic 264 71.12 Topic 289 57.50 1
Topic 265 20.80 Topic 290 54.08 UniNEpt1
Difference (average precision)
Topic 266 50.03 Topic 291 30.07
0.5
Topic 267 22.81 Topic 292 38.65
Topic 268 56.28 Topic 293 67.33
Topic 269 11.44 Topic 294 77.27 0
Topic 270 23.21 Topic 295 49.81
Topic 271 69.68 Topic 296 42.81
Topic 272 25.19 Topic 297 41.28 −0.5
Topic 273 56.23 Topic 298 38.72
Topic 274 17.77 Topic 299 53.81
−1
Topic 275 47.30 Topic 300 2.60 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.337
unine UniNEpt2 AH-Monolingual-PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TD
Relevant retrieved 2,474 Pooled= false
CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 81.57 UniNEpt2
90%
10 68.26
20 60.61 80%
30 53.09
70%
40 45.39
50 39.15
Average Precision
60%
60 32.29
50%
70 24.81
80 19.35 40%
90 12.96
30%
100 5.82
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
38.75
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 60.40 UniNEpt2
90%
10 docs 57.60
15 docs 53.47 80%
20 docs 49.80
70%
30 docs 45.47
100 docs 27.80 60%
R−Precision
200 docs 17.79
50%
500 docs 8.90
1000 docs 4.95 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
39.17 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275)
queries 1
UniNEpt2
Topic 251 52.06 Topic 276 32.09
Difference (average precision)
Topic 252 42.74 Topic 277 9.73 0.5
Topic 253 26.55 Topic 278 44.02
Topic 254 67.14 Topic 279 45.82
Topic 255 48.55 Topic 280 6.11 0
Topic 256 95.65 Topic 281 70.71
Topic 257 26.94 Topic 282 29.66
−0.5
Topic 258 4.75 Topic 283 72.00
Topic 259 32.59 Topic 284 21.54
Topic 260 14.42 Topic 285 43.44 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 22.23 Topic 286 53.27 Topic Number
Topic 262 10.58 Topic 287 3.22
Topic 263 9.97 Topic 288 3.86
CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300)
Topic 264 71.52 Topic 289 60.30 1
Topic 265 20.38 Topic 290 66.05 UniNEpt2
Difference (average precision)
Topic 266 50.04 Topic 291 30.10
0.5
Topic 267 26.68 Topic 292 35.16
Topic 268 38.85 Topic 293 63.95
Topic 269 14.27 Topic 294 80.65 0
Topic 270 24.53 Topic 295 43.07
Topic 271 65.39 Topic 296 44.55
Topic 272 27.58 Topic 297 35.02 −0.5
Topic 273 56.70 Topic 298 53.85
Topic 274 27.27 Topic 299 56.29
−1
Topic 275 51.68 Topic 300 3.75 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.338
unine UniNEpt3 AH-Monolingual-PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese
Retrieved 50,000 RunType= automatic
Relevant 2,904 QueryType= TD
Relevant retrieved 2,485 Pooled= false
CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 77.29 UniNEpt3
90%
10 65.75
20 56.83 80%
30 49.54
70%
40 41.82
50 36.45
Average Precision
60%
60 30.73
50%
70 24.61
80 18.50 40%
90 10.70
30%
100 5.22
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
36.65
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 58.40 UniNEpt3
90%
10 docs 56.40
15 docs 52.13 80%
20 docs 48.40
70%
30 docs 42.73
100 docs 26.28 60%
R−Precision
200 docs 17.26
50%
500 docs 8.80
1000 docs 4.97 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
37.72 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275)
queries 1
UniNEpt3
Topic 251 52.60 Topic 276 25.70
Difference (average precision)
Topic 252 45.43 Topic 277 11.91 0.5
Topic 253 30.16 Topic 278 50.25
Topic 254 61.27 Topic 279 49.15
Topic 255 68.06 Topic 280 22.63 0
Topic 256 94.64 Topic 281 58.37
Topic 257 23.61 Topic 282 28.29
−0.5
Topic 258 0.13 Topic 283 78.93
Topic 259 32.17 Topic 284 17.90
Topic 260 11.96 Topic 285 42.84 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 14.16 Topic 286 44.27 Topic Number
Topic 262 9.14 Topic 287 2.58
Topic 263 2.90 Topic 288 0.12
CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300)
Topic 264 68.21 Topic 289 66.86 1
Topic 265 27.60 Topic 290 39.17 UniNEpt3
Difference (average precision)
Topic 266 41.64 Topic 291 33.94
0.5
Topic 267 20.48 Topic 292 41.76
Topic 268 38.89 Topic 293 56.93
Topic 269 14.39 Topic 294 55.43 0
Topic 270 17.28 Topic 295 62.00
Topic 271 53.60 Topic 296 53.43
Topic 272 25.23 Topic 297 29.29 −0.5
Topic 273 56.44 Topic 298 47.37
Topic 274 5.26 Topic 299 47.35
−1
Topic 275 46.52 Topic 300 4.01 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.339
xldb XLDBTumba01 AH-Monolingual-PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese
Retrieved 12,595 RunType= manual
Relevant 2,904 QueryType= TDN
Relevant retrieved 1,675 Pooled= true
CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 79.13 XLDBTumba01
90%
10 63.66
20 53.61 80%
30 44.78
70%
40 33.45
50 28.61
Average Precision
60%
60 17.05
50%
70 11.97
80 7.85 40%
90 1.92
30%
100 0.40
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
29.00
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 55.60 XLDBTumba01
90%
10 docs 51.20
15 docs 48.00 80%
20 docs 44.40
70%
30 docs 40.53
100 docs 22.26 60%
R−Precision
200 docs 13.68
50%
500 docs 6.52
1000 docs 3.35 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
34.35 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275)
queries 1
XLDBTumba01
Topic 251 41.86 Topic 276 15.52
Difference (average precision)
Topic 252 3.50 Topic 277 2.50 0.5
Topic 253 33.80 Topic 278 10.53
Topic 254 6.97 Topic 279 54.22
Topic 255 40.96 Topic 280 22.10 0
Topic 256 61.88 Topic 281 46.94
Topic 257 25.85 Topic 282 17.17
−0.5
Topic 258 50.00 Topic 283 65.75
Topic 259 43.53 Topic 284 49.22
Topic 260 1.87 Topic 285 21.18 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 3.40 Topic 286 55.80 Topic Number
Topic 262 0.00 Topic 287 13.79
Topic 263 24.66 Topic 288 2.51
CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300)
Topic 264 46.69 Topic 289 66.07 1
Topic 265 8.68 Topic 290 36.00 XLDBTumba01
Difference (average precision)
Topic 266 25.47 Topic 291 25.69
0.5
Topic 267 15.90 Topic 292 18.43
Topic 268 18.57 Topic 293 49.53
Topic 269 17.76 Topic 294 28.65 0
Topic 270 24.38 Topic 295 69.23
Topic 271 21.60 Topic 296 71.37
Topic 272 18.33 Topic 297 37.97 −0.5
Topic 273 28.50 Topic 298 30.69
Topic 274 20.83 Topic 299 36.44
−1
Topic 275 14.08 Topic 300 3.74 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.340
xldb XLDBTumba02 AH-Monolingual-PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese
Retrieved 5,546 RunType= automatic
Relevant 2,904 QueryType= TDN
Relevant retrieved 986 Pooled= false
CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 74.50 XLDBTumba02
90%
10 47.18
20 32.63 80%
30 25.21
70%
40 19.13
50 16.93
Average Precision
60%
60 11.78
50%
70 8.63
80 3.26 40%
90 1.63
30%
100 0.68
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
19.71
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 51.20 XLDBTumba02
90%
10 docs 45.60
15 docs 39.60 80%
20 docs 34.00
70%
30 docs 27.93
100 docs 13.50 60%
R−Precision
200 docs 8.34
50%
500 docs 3.91
1000 docs 1.97 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
23.15 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275)
queries 1
XLDBTumba02
Topic 251 19.82 Topic 276 16.38
Difference (average precision)
Topic 252 11.36 Topic 277 0.00 0.5
Topic 253 25.08 Topic 278 41.43
Topic 254 6.35 Topic 279 53.52
Topic 255 51.67 Topic 280 20.96 0
Topic 256 75.00 Topic 281 31.59
Topic 257 6.34 Topic 282 5.36
−0.5
Topic 258 8.33 Topic 283 46.73
Topic 259 41.20 Topic 284 26.21
Topic 260 0.00 Topic 285 11.41 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 12.94 Topic 286 42.88 Topic Number
Topic 262 2.79 Topic 287 6.20
Topic 263 1.33 Topic 288 0.54
CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300)
Topic 264 27.96 Topic 289 67.33 1
Topic 265 8.66 Topic 290 0.76 XLDBTumba02
Difference (average precision)
Topic 266 5.64 Topic 291 4.82
0.5
Topic 267 34.10 Topic 292 13.42
Topic 268 53.91 Topic 293 19.56
Topic 269 5.98 Topic 294 28.83 0
Topic 270 19.43 Topic 295 47.70
Topic 271 9.17 Topic 296 1.70
Topic 272 7.51 Topic 297 4.88 −0.5
Topic 273 9.23 Topic 298 21.82
Topic 274 16.67 Topic 299 5.54
−1
Topic 275 4.17 Topic 300 1.27 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.341
xldb XLDBTumba05 AH-Monolingual-PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese
Retrieved 12,595 RunType= manual
Relevant 2,904 QueryType= TDN
Relevant retrieved 1,666 Pooled= true
CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 73.23 XLDBTumba05
90%
10 53.56
20 42.48 80%
30 35.80
70%
40 27.26
50 23.52
Average Precision
60%
60 14.29
50%
70 10.61
80 7.82 40%
90 1.79
30%
100 0.31
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
24.00
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 48.80 XLDBTumba05
90%
10 docs 43.40
15 docs 40.13 80%
20 docs 37.80
70%
30 docs 34.33
100 docs 21.04 60%
R−Precision
200 docs 13.23
50%
500 docs 6.47
1000 docs 3.33 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
30.58 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275)
queries 1
XLDBTumba05
Topic 251 29.28 Topic 276 15.79
Difference (average precision)
Topic 252 1.71 Topic 277 1.67 0.5
Topic 253 28.37 Topic 278 6.14
Topic 254 8.19 Topic 279 41.64
Topic 255 29.58 Topic 280 17.49 0
Topic 256 58.21 Topic 281 47.89
Topic 257 16.70 Topic 282 17.94
−0.5
Topic 258 25.00 Topic 283 58.86
Topic 259 40.01 Topic 284 44.40
Topic 260 1.65 Topic 285 23.38 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 4.22 Topic 286 51.96 Topic Number
Topic 262 0.00 Topic 287 11.25
Topic 263 15.37 Topic 288 2.45
CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300)
Topic 264 46.77 Topic 289 43.02 1
Topic 265 11.76 Topic 290 20.26 XLDBTumba05
Difference (average precision)
Topic 266 24.40 Topic 291 23.01
0.5
Topic 267 15.63 Topic 292 12.58
Topic 268 22.26 Topic 293 31.74
Topic 269 14.36 Topic 294 15.42 0
Topic 270 21.17 Topic 295 61.14
Topic 271 19.05 Topic 296 57.79
Topic 272 26.38 Topic 297 20.40 −0.5
Topic 273 21.61 Topic 298 31.20
Topic 274 20.83 Topic 299 26.07
−1
Topic 275 10.57 Topic 300 3.59 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.342
xldb XLDBTumba06 AH-Monolingual-PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese
Retrieved 5,546 RunType= automatic
Relevant 2,904 QueryType= TDN
Relevant retrieved 985 Pooled= false
CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 73.33 XLDBTumba06
90%
10 44.17
20 29.94 80%
30 22.06
70%
40 17.77
50 15.16
Average Precision
60%
60 10.76
50%
70 7.93
80 2.94 40%
90 1.36
30%
100 0.63
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
18.08
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 48.00 XLDBTumba06
90%
10 docs 40.60
15 docs 35.60 80%
20 docs 31.50
70%
30 docs 25.33
100 docs 12.90 60%
R−Precision
200 docs 8.05
50%
500 docs 3.85
1000 docs 1.97 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
22.51 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275)
queries 1
XLDBTumba06
Topic 251 16.62 Topic 276 15.68
Difference (average precision)
Topic 252 10.11 Topic 277 0.00 0.5
Topic 253 16.81 Topic 278 43.94
Topic 254 6.06 Topic 279 48.33
Topic 255 61.11 Topic 280 20.57 0
Topic 256 75.00 Topic 281 37.74
Topic 257 5.77 Topic 282 5.01
−0.5
Topic 258 8.33 Topic 283 30.91
Topic 259 45.48 Topic 284 24.09
Topic 260 0.00 Topic 285 9.32 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 14.64 Topic 286 42.37 Topic Number
Topic 262 6.60 Topic 287 5.14
Topic 263 2.00 Topic 288 0.83
CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300)
Topic 264 27.44 Topic 289 57.97 1
Topic 265 7.18 Topic 290 0.76 XLDBTumba06
Difference (average precision)
Topic 266 4.65 Topic 291 5.53
0.5
Topic 267 18.41 Topic 292 13.49
Topic 268 39.12 Topic 293 16.61
Topic 269 5.31 Topic 294 21.33 0
Topic 270 16.49 Topic 295 40.08
Topic 271 8.54 Topic 296 2.04
Topic 272 8.90 Topic 297 4.88 −0.5
Topic 273 7.76 Topic 298 19.09
Topic 274 16.67 Topic 299 4.54
−1
Topic 275 3.80 Topic 300 0.74 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.343
xldb XLDBTumba09 AH-Monolingual-PT
Overall statistics for 50 queries : General info:
Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese
Retrieved 6,521 RunType= automatic
Relevant 2,904 QueryType= TD
Relevant retrieved 989 Pooled= false
CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 74.12 XLDBTumba09
90%
10 48.54
20 31.36 80%
30 24.37
70%
40 18.47
50 16.89
Average Precision
60%
60 11.96
50%
70 8.68
80 3.13 40%
90 1.64
30%
100 0.65
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
19.40
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 49.20 XLDBTumba09
90%
10 docs 45.00
15 docs 39.20 80%
20 docs 33.40
70%
30 docs 27.53
100 docs 13.42 60%
R−Precision
200 docs 8.27
50%
500 docs 3.92
1000 docs 1.98 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
22.91 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275)
queries 1
XLDBTumba09
Topic 251 19.63 Topic 276 17.48
Difference (average precision)
Topic 252 10.99 Topic 277 0.00 0.5
Topic 253 24.01 Topic 278 41.48
Topic 254 6.22 Topic 279 55.11
Topic 255 45.63 Topic 280 26.93 0
Topic 256 75.00 Topic 281 25.83
Topic 257 5.35 Topic 282 5.36
−0.5
Topic 258 7.14 Topic 283 46.33
Topic 259 34.61 Topic 284 27.14
Topic 260 0.00 Topic 285 10.83 −1
251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275
Topic 261 10.94 Topic 286 43.09 Topic Number
Topic 262 0.13 Topic 287 6.39
Topic 263 1.31 Topic 288 0.50
CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300)
Topic 264 28.16 Topic 289 66.71 1
Topic 265 8.77 Topic 290 0.76 XLDBTumba09
Difference (average precision)
Topic 266 5.64 Topic 291 4.82
0.5
Topic 267 36.08 Topic 292 21.50
Topic 268 47.50 Topic 293 19.85
Topic 269 4.42 Topic 294 28.76 0
Topic 270 20.03 Topic 295 47.34
Topic 271 9.50 Topic 296 1.70
Topic 272 7.54 Topic 297 4.88 −0.5
Topic 273 9.56 Topic 298 21.42
Topic 274 16.67 Topic 299 5.49
−1
Topic 275 4.17 Topic 300 1.30 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300
Topic Number
A.344
berkeley BERK1MUDEALL01 DS-Multi
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Multilingual German
Retrieved 25,000 RunType= automatic
Relevant 5,618 QueryType= TD
Relevant retrieved 660 Pooled= false
CLEF 2005 DS−Multi − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 34.86 BERK1MUDEALL01
90%
10 9.14
20 5.07 80%
30 2.54
70%
40 1.20
50 0.91
Average Precision
60%
60 0.49
50%
70 0.28
80 0.00 40%
90 0.00
30%
100 0.00
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
2.94
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Multi − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 18.40 BERK1MUDEALL01
90%
10 docs 20.00
15 docs 18.13 80%
20 docs 17.40
70%
30 docs 15.33
100 docs 9.92 60%
R−Precision
200 docs 6.96
50%
500 docs 3.92
1000 docs 2.64 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
6.86 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Multi − Comparison to median by topic (topics 126 to 138)
queries 1
BERK1MUDEALL01
Topic 126 6.78 Topic 139 1.61
Difference (average precision)
Topic 127 2.29 Topic 140 0.14 0.5
Topic 128 1.24 Topic 141 0.12
Topic 129 0.01 Topic 142 0.64
Topic 130 1.07 Topic 143 0.21 0
Topic 131 0.19 Topic 144 16.03
Topic 132 1.23 Topic 145 2.04
−0.5
Topic 133 0.04 Topic 146 20.99
Topic 134 8.57 Topic 147 0.13
Topic 135 0.23 Topic 148 1.82 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 0.03 Topic 149 1.39 Topic Number
Topic 137 0.38 Topic 150 1.06
Topic 138 5.37
CLEF 2005 DS−Multi − Comparison to median by topic (topics 139 to 150)
1
BERK1MUDEALL01
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.345
berkeley BERK1MUENALL01 DS-Multi
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Multilingual English
Retrieved 25,000 RunType= automatic
Relevant 5,618 QueryType= TD
Relevant retrieved 1,041 Pooled= false
CLEF 2005 DS−Multi − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 42.84 BERK1MUENALL01
90%
10 11.17
20 6.29 80%
30 4.54
70%
40 1.60
50 1.36
Average Precision
60%
60 0.93
50%
70 0.44
80 0.00 40%
90 0.00
30%
100 0.00
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
3.46
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Multi − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 24.80 BERK1MUENALL01
90%
10 docs 20.80
15 docs 18.67 80%
20 docs 17.00
70%
30 docs 14.67
100 docs 9.68 60%
R−Precision
200 docs 7.10
50%
500 docs 5.19
1000 docs 4.16 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
7.89 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Multi − Comparison to median by topic (topics 126 to 138)
queries 1
BERK1MUENALL01
Topic 126 13.05 Topic 139 0.35
Difference (average precision)
Topic 127 1.71 Topic 140 0.45 0.5
Topic 128 6.46 Topic 141 1.82
Topic 129 0.00 Topic 142 0.14
Topic 130 1.03 Topic 143 0.09 0
Topic 131 2.09 Topic 144 16.62
Topic 132 3.55 Topic 145 5.25
−0.5
Topic 133 0.56 Topic 146 13.63
Topic 134 9.78 Topic 147 0.29
Topic 135 0.15 Topic 148 0.57 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 0.10 Topic 149 0.75 Topic Number
Topic 137 1.32 Topic 150 3.62
Topic 138 3.02
CLEF 2005 DS−Multi − Comparison to median by topic (topics 139 to 150)
1
BERK1MUENALL01
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.346
berkeley BERK1MURUALL01 DS-Multi
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Multilingual Russian
Retrieved 25,000 RunType= automatic
Relevant 5,618 QueryType= TD
Relevant retrieved 1,116 Pooled= false
CLEF 2005 DS−Multi − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 45.73 BERK1MURUALL01
90%
10 16.47
20 10.85 80%
30 6.87
70%
40 4.57
50 2.41
Average Precision
60%
60 1.46
50%
70 0.59
80 0.00 40%
90 0.00
30%
100 0.00
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
5.32
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Multi − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 28.80 BERK1MURUALL01
90%
10 docs 24.40
15 docs 21.33 80%
20 docs 20.20
70%
30 docs 18.13
100 docs 14.12 60%
R−Precision
200 docs 11.02
50%
500 docs 6.71
1000 docs 4.46 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
12.12 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Multi − Comparison to median by topic (topics 126 to 138)
queries 1
BERK1MURUALL01
Topic 126 1.31 Topic 139 1.32
Difference (average precision)
Topic 127 3.87 Topic 140 1.66 0.5
Topic 128 3.34 Topic 141 5.12
Topic 129 0.01 Topic 142 5.00
Topic 130 2.33 Topic 143 9.19 0
Topic 131 0.78 Topic 144 21.49
Topic 132 21.26 Topic 145 11.33
−0.5
Topic 133 0.53 Topic 146 30.28
Topic 134 3.58 Topic 147 0.80
Topic 135 0.56 Topic 148 1.05 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 0.20 Topic 149 0.46 Topic Number
Topic 137 1.30 Topic 150 0.26
Topic 138 5.98
CLEF 2005 DS−Multi − Comparison to median by topic (topics 139 to 150)
1
BERK1MURUALL01
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.347
berkeley BERK1BLENDE01 DS-Bilingual-X2DE
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Bilingual English to German
Retrieved 25,000 RunType= automatic
Relevant 2,682 QueryType= TD
Relevant retrieved 1,128 Pooled= true
CLEF 2005 DS−Bilingual−X2DE − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 49.50 BERK1BLENDE01
90%
10 33.15
20 27.65 80%
30 20.31
70%
40 13.38
50 11.27
Average Precision
60%
60 8.55
50%
70 6.15
80 4.64 40%
90 2.31
30%
100 0.00
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
14.77
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Bilingual−X2DE − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 35.20 BERK1BLENDE01
90%
10 docs 32.00
15 docs 30.13 80%
20 docs 27.00
70%
30 docs 24.53
100 docs 16.32 60%
R−Precision
200 docs 11.94
50%
500 docs 7.14
1000 docs 4.51 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
18.67 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 126 to 138)
queries 1
BERK1BLENDE01
Topic 126 7.66 Topic 139 0.40
Difference (average precision)
Topic 127 17.66 Topic 140 0.90 0.5
Topic 128 2.69 Topic 141 0.02
Topic 129 0.00 Topic 142 2.45
Topic 130 0.79 Topic 143 20.11 0
Topic 131 21.65 Topic 144 11.38
Topic 132 84.13 Topic 145 40.53
−0.5
Topic 133 5.72 Topic 146 31.99
Topic 134 27.05 Topic 147 0.12
Topic 135 0.01 Topic 148 7.98 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 0.01 Topic 149 30.75 Topic Number
Topic 137 47.51 Topic 150 7.56
Topic 138 0.10
CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 139 to 150)
1
BERK1BLENDE01
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.348
berkeley BERK1BLRUDE01 DS-Bilingual-X2DE
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Bilingual Russian to German
Retrieved 25,000 RunType= automatic
Relevant 2,682 QueryType= TD
Relevant retrieved 1,097 Pooled= true
CLEF 2005 DS−Bilingual−X2DE − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 57.82 BERK1BLRUDE01
90%
10 36.71
20 27.95 80%
30 21.80
70%
40 18.10
50 15.42
Average Precision
60%
60 12.22
50%
70 8.29
80 5.12 40%
90 2.37
30%
100 0.10
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
16.87
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Bilingual−X2DE − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 36.80 BERK1BLRUDE01
90%
10 docs 34.40
15 docs 32.27 80%
20 docs 31.40
70%
30 docs 28.67
100 docs 18.72 60%
R−Precision
200 docs 13.12
50%
500 docs 7.49
1000 docs 4.39 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
19.73 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 126 to 138)
queries 1
BERK1BLRUDE01
Topic 126 17.09 Topic 139 26.42
Difference (average precision)
Topic 127 3.33 Topic 140 0.18 0.5
Topic 128 0.06 Topic 141 0.00
Topic 129 0.00 Topic 142 28.08
Topic 130 15.74 Topic 143 12.51 0
Topic 131 26.80 Topic 144 9.51
Topic 132 84.81 Topic 145 58.14
−0.5
Topic 133 10.36 Topic 146 54.50
Topic 134 31.25 Topic 147 0.31
Topic 135 0.16 Topic 148 8.80 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 0.75 Topic 149 0.31 Topic Number
Topic 137 28.91 Topic 150 1.10
Topic 138 2.69
CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 139 to 150)
1
BERK1BLRUDE01
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.349
berkeley-2 BK2GBLEG1 DS-Bilingual-X2DE
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Bilingual English to German
Retrieved 25,000 RunType= automatic
Relevant 2,682 QueryType= TD
Relevant retrieved 2,238 Pooled= true
CLEF 2005 DS−Bilingual−X2DE − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 85.19 BK2GBLEG1
90%
10 76.95
20 65.89 80%
30 55.40
70%
40 48.16
50 41.73
Average Precision
60%
60 34.67
50%
70 26.82
80 20.48 40%
90 12.06
30%
100 2.14
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
42.01
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Bilingual−X2DE − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 68.80 BK2GBLEG1
90%
10 docs 67.60
15 docs 63.73 80%
20 docs 62.20
70%
30 docs 58.67
100 docs 41.72 60%
R−Precision
200 docs 29.00
50%
500 docs 15.57
1000 docs 8.95 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
41.92 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 126 to 138)
queries 1
BK2GBLEG1
Topic 126 23.92 Topic 139 35.71
Difference (average precision)
Topic 127 59.40 Topic 140 40.12 0.5
Topic 128 65.92 Topic 141 78.44
Topic 129 40.14 Topic 142 26.81
Topic 130 73.77 Topic 143 31.58 0
Topic 131 55.04 Topic 144 24.20
Topic 132 91.29 Topic 145 55.85
−0.5
Topic 133 12.39 Topic 146 62.19
Topic 134 41.36 Topic 147 55.44
Topic 135 0.30 Topic 148 21.01 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 13.60 Topic 149 27.19 Topic Number
Topic 137 54.83 Topic 150 57.99
Topic 138 1.83
CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 139 to 150)
1
BK2GBLEG1
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.350
berkeley-2 BK2GBLEG2 DS-Bilingual-X2DE
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Bilingual English to German
Retrieved 25,000 RunType= automatic
Relevant 2,682 QueryType= TD
Relevant retrieved 2,192 Pooled= true
CLEF 2005 DS−Bilingual−X2DE − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 82.22 BK2GBLEG2
90%
10 67.72
20 60.16 80%
30 50.49
70%
40 45.25
50 40.40
Average Precision
60%
60 32.08
50%
70 24.78
80 17.20 40%
90 9.49
30%
100 1.24
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
38.09
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Bilingual−X2DE − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 64.80 BK2GBLEG2
90%
10 docs 61.20
15 docs 57.87 80%
20 docs 56.40
70%
30 docs 53.73
100 docs 39.08 60%
R−Precision
200 docs 27.84
50%
500 docs 15.07
1000 docs 8.77 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
38.44 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 126 to 138)
queries 1
BK2GBLEG2
Topic 126 35.45 Topic 139 29.83
Difference (average precision)
Topic 127 59.90 Topic 140 40.97 0.5
Topic 128 66.96 Topic 141 78.18
Topic 129 44.57 Topic 142 47.14
Topic 130 33.98 Topic 143 22.10 0
Topic 131 7.76 Topic 144 16.80
Topic 132 90.09 Topic 145 59.98
−0.5
Topic 133 8.15 Topic 146 60.56
Topic 134 42.12 Topic 147 39.19
Topic 135 3.99 Topic 148 19.18 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 7.83 Topic 149 27.58 Topic Number
Topic 137 47.92 Topic 150 58.76
Topic 138 3.25
CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 139 to 150)
1
BK2GBLEG2
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.351
berkeley-2 BK2GBLEG3 DS-Bilingual-X2DE
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Bilingual English to German
Retrieved 25,000 RunType= automatic
Relevant 2,682 QueryType= TD
Relevant retrieved 2,089 Pooled= true
CLEF 2005 DS−Bilingual−X2DE − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 85.12 BK2GBLEG3
90%
10 65.52
20 56.87 80%
30 45.21
70%
40 39.26
50 34.71
Average Precision
60%
60 28.81
50%
70 21.67
80 16.62 40%
90 6.86
30%
100 0.86
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
35.11
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Bilingual−X2DE − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 64.80 BK2GBLEG3
90%
10 docs 62.40
15 docs 59.20 80%
20 docs 55.80
70%
30 docs 50.80
100 docs 36.32 60%
R−Precision
200 docs 25.36
50%
500 docs 14.22
1000 docs 8.36 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
35.80 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 126 to 138)
queries 1
BK2GBLEG3
Topic 126 28.53 Topic 139 44.17
Difference (average precision)
Topic 127 56.37 Topic 140 56.75 0.5
Topic 128 62.63 Topic 141 26.97
Topic 129 20.94 Topic 142 58.67
Topic 130 46.06 Topic 143 22.85 0
Topic 131 6.01 Topic 144 12.36
Topic 132 87.98 Topic 145 52.11
−0.5
Topic 133 2.01 Topic 146 64.53
Topic 134 45.15 Topic 147 40.63
Topic 135 5.28 Topic 148 46.66 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 3.96 Topic 149 4.76 Topic Number
Topic 137 25.30 Topic 150 54.65
Topic 138 2.33
CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 139 to 150)
1
BK2GBLEG3
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.352
berkeley-2 BK2GBLEG4 DS-Bilingual-X2DE
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Bilingual English to German
Retrieved 25,000 RunType= automatic
Relevant 2,682 QueryType= TD
Relevant retrieved 2,192 Pooled= true
CLEF 2005 DS−Bilingual−X2DE − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 82.22 BK2GBLEG4
90%
10 67.72
20 60.16 80%
30 50.49
70%
40 45.25
50 40.40
Average Precision
60%
60 32.08
50%
70 24.78
80 17.20 40%
90 9.49
30%
100 1.24
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
38.09
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Bilingual−X2DE − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 64.80 BK2GBLEG4
90%
10 docs 61.20
15 docs 57.87 80%
20 docs 56.40
70%
30 docs 53.73
100 docs 39.08 60%
R−Precision
200 docs 27.84
50%
500 docs 15.07
1000 docs 8.77 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
38.44 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 126 to 138)
queries 1
BK2GBLEG4
Topic 126 35.45 Topic 139 29.83
Difference (average precision)
Topic 127 59.90 Topic 140 40.97 0.5
Topic 128 66.96 Topic 141 78.18
Topic 129 44.57 Topic 142 47.14
Topic 130 33.98 Topic 143 22.10 0
Topic 131 7.76 Topic 144 16.80
Topic 132 90.09 Topic 145 59.98
−0.5
Topic 133 8.15 Topic 146 60.56
Topic 134 42.12 Topic 147 39.19
Topic 135 3.99 Topic 148 19.18 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 7.83 Topic 149 27.58 Topic Number
Topic 137 47.92 Topic 150 58.76
Topic 138 3.25
CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 139 to 150)
1
BK2GBLEG4
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.353
hagen FUHegfyyn DS-Bilingual-X2DE
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Bilingual English to German
Retrieved 25,000 RunType= automatic
Relevant 2,682 QueryType= TD
Relevant retrieved 1,518 Pooled= true
CLEF 2005 DS−Bilingual−X2DE − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 78.17 FUHegfyyn
90%
10 52.61
20 38.13 80%
30 30.93
70%
40 25.45
50 21.25
Average Precision
60%
60 16.18
50%
70 11.74
80 8.47 40%
90 4.74
30%
100 0.00
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
23.92
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Bilingual−X2DE − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 56.00 FUHegfyyn
90%
10 docs 53.60
15 docs 48.27 80%
20 docs 45.40
70%
30 docs 40.80
100 docs 26.88 60%
R−Precision
200 docs 18.04
50%
500 docs 9.98
1000 docs 6.07 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
26.32 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 126 to 138)
queries 1
FUHegfyyn
Topic 126 20.35 Topic 139 5.44
Difference (average precision)
Topic 127 62.47 Topic 140 18.02 0.5
Topic 128 1.36 Topic 141 80.17
Topic 129 0.16 Topic 142 25.77
Topic 130 16.22 Topic 143 7.48 0
Topic 131 21.77 Topic 144 42.06
Topic 132 87.65 Topic 145 47.04
−0.5
Topic 133 6.69 Topic 146 48.74
Topic 134 3.49 Topic 147 22.73
Topic 135 0.58 Topic 148 6.75 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 0.14 Topic 149 22.49 Topic Number
Topic 137 4.90 Topic 150 44.67
Topic 138 0.74
CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 139 to 150)
1
FUHegfyyn
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.354
hagen FUHegpyyd DS-Bilingual-X2DE
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Bilingual English to German
Retrieved 25,000 RunType= automatic
Relevant 2,682 QueryType= TD
Relevant retrieved 1,567 Pooled= true
CLEF 2005 DS−Bilingual−X2DE − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 81.20 FUHegpyyd
90%
10 53.89
20 40.11 80%
30 31.35
70%
40 24.12
50 19.91
Average Precision
60%
60 15.51
50%
70 10.72
80 7.38 40%
90 4.58
30%
100 0.00
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
23.99
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Bilingual−X2DE − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 60.00 FUHegpyyd
90%
10 docs 52.00
15 docs 46.67 80%
20 docs 43.20
70%
30 docs 40.80
100 docs 27.48 60%
R−Precision
200 docs 18.62
50%
500 docs 10.33
1000 docs 6.27 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
27.14 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 126 to 138)
queries 1
FUHegpyyd
Topic 126 18.87 Topic 139 27.14
Difference (average precision)
Topic 127 62.47 Topic 140 10.92 0.5
Topic 128 1.43 Topic 141 68.93
Topic 129 10.39 Topic 142 15.60
Topic 130 16.79 Topic 143 32.83 0
Topic 131 8.43 Topic 144 41.97
Topic 132 86.87 Topic 145 53.42
−0.5
Topic 133 5.22 Topic 146 25.70
Topic 134 8.80 Topic 147 14.49
Topic 135 0.45 Topic 148 12.53 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 2.61 Topic 149 22.77 Topic Number
Topic 137 5.02 Topic 150 44.78
Topic 138 1.42
CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 139 to 150)
1
FUHegpyyd
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.355
hagen FUHegpyyn DS-Bilingual-X2DE
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Bilingual English to German
Retrieved 25,000 RunType= automatic
Relevant 2,682 QueryType= TD
Relevant retrieved 1,567 Pooled= true
CLEF 2005 DS−Bilingual−X2DE − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 81.20 FUHegpyyn
90%
10 53.89
20 40.11 80%
30 31.35
70%
40 24.12
50 19.91
Average Precision
60%
60 15.51
50%
70 10.72
80 7.38 40%
90 4.58
30%
100 0.00
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
23.99
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Bilingual−X2DE − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 60.00 FUHegpyyn
90%
10 docs 52.00
15 docs 46.67 80%
20 docs 43.20
70%
30 docs 40.80
100 docs 27.48 60%
R−Precision
200 docs 18.62
50%
500 docs 10.33
1000 docs 6.27 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
27.14 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 126 to 138)
queries 1
FUHegpyyn
Topic 126 18.87 Topic 139 27.14
Difference (average precision)
Topic 127 62.47 Topic 140 10.92 0.5
Topic 128 1.43 Topic 141 68.93
Topic 129 10.39 Topic 142 15.60
Topic 130 16.79 Topic 143 32.83 0
Topic 131 8.43 Topic 144 41.97
Topic 132 86.87 Topic 145 53.42
−0.5
Topic 133 5.22 Topic 146 25.70
Topic 134 8.80 Topic 147 14.49
Topic 135 0.45 Topic 148 12.53 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 2.61 Topic 149 22.77 Topic Number
Topic 137 5.02 Topic 150 44.78
Topic 138 1.42
CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 139 to 150)
1
FUHegpyyn
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.356
hagen FUHegsyyn DS-Bilingual-X2DE
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Bilingual English to German
Retrieved 25,000 RunType= automatic
Relevant 2,682 QueryType= TD
Relevant retrieved 1,584 Pooled= true
CLEF 2005 DS−Bilingual−X2DE − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 66.61 FUHegsyyn
90%
10 48.03
20 39.31 80%
30 30.90
70%
40 25.13
50 19.55
Average Precision
60%
60 15.54
50%
70 9.91
80 7.49 40%
90 4.85
30%
100 0.15
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
22.61
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Bilingual−X2DE − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 51.20 FUHegsyyn
90%
10 docs 48.80
15 docs 45.33 80%
20 docs 42.00
70%
30 docs 38.13
100 docs 26.60 60%
R−Precision
200 docs 18.72
50%
500 docs 10.53
1000 docs 6.34 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
26.53 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 126 to 138)
queries 1
FUHegsyyn
Topic 126 24.61 Topic 139 1.74
Difference (average precision)
Topic 127 62.47 Topic 140 12.97 0.5
Topic 128 46.79 Topic 141 48.37
Topic 129 0.04 Topic 142 0.34
Topic 130 47.45 Topic 143 22.34 0
Topic 131 8.43 Topic 144 30.31
Topic 132 87.12 Topic 145 11.07
−0.5
Topic 133 5.22 Topic 146 58.09
Topic 134 17.79 Topic 147 14.70
Topic 135 0.06 Topic 148 4.90 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 2.48 Topic 149 6.94 Topic Number
Topic 137 5.52 Topic 150 43.62
Topic 138 1.79
CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 139 to 150)
1
FUHegsyyn
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.357
hagen FUHegwyyn DS-Bilingual-X2DE
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Bilingual English to German
Retrieved 25,000 RunType= automatic
Relevant 2,682 QueryType= TD
Relevant retrieved 1,580 Pooled= true
CLEF 2005 DS−Bilingual−X2DE − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 65.41 FUHegwyyn
90%
10 47.29
20 39.16 80%
30 30.90
70%
40 25.13
50 19.55
Average Precision
60%
60 15.54
50%
70 9.91
80 7.49 40%
90 4.85
30%
100 0.15
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
22.48
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Bilingual−X2DE − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 49.60 FUHegwyyn
90%
10 docs 47.60
15 docs 44.27 80%
20 docs 41.40
70%
30 docs 38.13
100 docs 26.60 60%
R−Precision
200 docs 18.72
50%
500 docs 10.50
1000 docs 6.32 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
26.57 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 126 to 138)
queries 1
FUHegwyyn
Topic 126 24.61 Topic 139 1.74
Difference (average precision)
Topic 127 62.47 Topic 140 12.97 0.5
Topic 128 46.79 Topic 141 48.37
Topic 129 0.04 Topic 142 0.34
Topic 130 47.45 Topic 143 22.34 0
Topic 131 5.23 Topic 144 30.31
Topic 132 87.12 Topic 145 11.07
−0.5
Topic 133 5.22 Topic 146 58.09
Topic 134 17.79 Topic 147 14.70
Topic 135 0.06 Topic 148 4.90 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 2.48 Topic 149 6.94 Topic Number
Topic 137 5.52 Topic 150 43.62
Topic 138 1.79
CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 139 to 150)
1
FUHegwyyn
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.358
hildesheim UHIGIRT3 DS-Bilingual-X2DE
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Bilingual English to German
Retrieved 24,848 RunType= automatic
Relevant 2,682 QueryType= TD
Relevant retrieved 1,159 Pooled= true
CLEF 2005 DS−Bilingual−X2DE − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 62.16 UHIGIRT3
90%
10 39.22
20 33.31 80%
30 26.20
70%
40 21.05
50 15.39
Average Precision
60%
60 11.31
50%
70 8.44
80 0.00 40%
90 0.00
30%
100 0.00
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
17.79
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Bilingual−X2DE − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 43.20 UHIGIRT3
90%
10 docs 41.20
15 docs 39.47 80%
20 docs 38.00
70%
30 docs 36.13
100 docs 23.12 60%
R−Precision
200 docs 14.58
50%
500 docs 7.64
1000 docs 4.64 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
21.35 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 126 to 138)
queries 1
UHIGIRT3
Topic 126 27.31 Topic 139 7.49
Difference (average precision)
Topic 127 31.02 Topic 140 1.53 0.5
Topic 128 0.22 Topic 141 72.77
Topic 129 0.60 Topic 142 7.72
Topic 130 7.59 Topic 143 13.33 0
Topic 131 0.69 Topic 144 4.18
Topic 132 67.52 Topic 145 34.58
−0.5
Topic 133 4.37 Topic 146 45.95
Topic 134 3.45 Topic 147 46.16
Topic 135 0.05 Topic 148 0.97 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 1.89 Topic 149 15.73 Topic Number
Topic 137 36.34 Topic 150 13.39
Topic 138 0.00
CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 139 to 150)
1
UHIGIRT3
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.359
u.glasgow glaendetdn DS-Bilingual-X2DE
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Bilingual English to German
Retrieved 25,000 RunType= automatic
Relevant 2,682 QueryType= TDN
Relevant retrieved 1,000 Pooled= true
CLEF 2005 DS−Bilingual−X2DE − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 49.89 glaendetdn
90%
10 24.62
20 16.59 80%
30 12.91
70%
40 10.38
50 7.89
Average Precision
60%
60 6.59
50%
70 5.43
80 3.51 40%
90 2.96
30%
100 0.00
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
11.16
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Bilingual−X2DE − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 36.80 glaendetdn
90%
10 docs 28.00
15 docs 26.93 80%
20 docs 24.60
70%
30 docs 21.87
100 docs 15.04 60%
R−Precision
200 docs 11.04
50%
500 docs 6.19
1000 docs 4.00 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
14.28 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 126 to 138)
queries 1
glaendetdn
Topic 126 20.90 Topic 139 2.29
Difference (average precision)
Topic 127 2.00 Topic 140 0.63 0.5
Topic 128 0.48 Topic 141 2.26
Topic 129 0.23 Topic 142 8.86
Topic 130 19.48 Topic 143 6.97 0
Topic 131 13.90 Topic 144 3.25
Topic 132 86.72 Topic 145 12.28
−0.5
Topic 133 0.01 Topic 146 14.01
Topic 134 0.11 Topic 147 4.36
Topic 135 0.00 Topic 148 2.49 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 0.07 Topic 149 17.81 Topic Number
Topic 137 51.62 Topic 150 8.20
Topic 138 0.00
CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 139 to 150)
1
glaendetdn
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.360
u.glasgow glaendetdnqe DS-Bilingual-X2DE
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Bilingual English to German
Retrieved 25,000 RunType= automatic
Relevant 2,682 QueryType= TDN
Relevant retrieved 1,272 Pooled= true
CLEF 2005 DS−Bilingual−X2DE − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 47.39 glaendetdnqe
90%
10 36.02
20 31.98 80%
30 27.30
70%
40 24.14
50 19.77
Average Precision
60%
60 15.48
50%
70 12.34
80 7.14 40%
90 3.66
30%
100 0.00
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
19.46
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Bilingual−X2DE − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 36.80 glaendetdnqe
90%
10 docs 34.40
15 docs 33.87 80%
20 docs 33.20
70%
30 docs 31.47
100 docs 23.28 60%
R−Precision
200 docs 15.96
50%
500 docs 8.38
1000 docs 5.09 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
22.43 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 126 to 138)
queries 1
glaendetdnqe
Topic 126 28.74 Topic 139 1.09
Difference (average precision)
Topic 127 1.76 Topic 140 0.04 0.5
Topic 128 0.53 Topic 141 10.39
Topic 129 0.22 Topic 142 20.32
Topic 130 59.54 Topic 143 15.44 0
Topic 131 40.96 Topic 144 4.87
Topic 132 86.57 Topic 145 63.44
−0.5
Topic 133 0.00 Topic 146 12.20
Topic 134 0.06 Topic 147 44.15
Topic 135 0.00 Topic 148 3.82 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 0.04 Topic 149 12.00 Topic Number
Topic 137 65.75 Topic 150 14.66
Topic 138 0.00
CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 139 to 150)
1
glaendetdnqe
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.361
u.glasgow glaendetdqe DS-Bilingual-X2DE
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Bilingual English to German
Retrieved 25,000 RunType= automatic
Relevant 2,682 QueryType= TD
Relevant retrieved 1,272 Pooled= true
CLEF 2005 DS−Bilingual−X2DE − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 47.39 glaendetdqe
90%
10 36.02
20 31.98 80%
30 27.30
70%
40 24.14
50 19.77
Average Precision
60%
60 15.48
50%
70 12.34
80 7.14 40%
90 3.66
30%
100 0.00
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
19.46
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Bilingual−X2DE − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 36.80 glaendetdqe
90%
10 docs 34.40
15 docs 33.87 80%
20 docs 33.20
70%
30 docs 31.47
100 docs 23.28 60%
R−Precision
200 docs 15.96
50%
500 docs 8.38
1000 docs 5.09 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
22.43 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 126 to 138)
queries 1
glaendetdqe
Topic 126 28.74 Topic 139 1.09
Difference (average precision)
Topic 127 1.76 Topic 140 0.04 0.5
Topic 128 0.53 Topic 141 10.39
Topic 129 0.22 Topic 142 20.32
Topic 130 59.54 Topic 143 15.44 0
Topic 131 40.96 Topic 144 4.87
Topic 132 86.57 Topic 145 63.44
−0.5
Topic 133 0.00 Topic 146 12.20
Topic 134 0.06 Topic 147 44.15
Topic 135 0.00 Topic 148 3.82 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 0.04 Topic 149 12.00 Topic Number
Topic 137 65.75 Topic 150 14.66
Topic 138 0.00
CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 139 to 150)
1
glaendetdqe
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.362
berkeley BERK1BLDEEN01 DS-Bilingual-X2EN
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Bilingual German to English
Retrieved 25,000 RunType= automatic
Relevant 2,105 QueryType= TD
Relevant retrieved 1,275 Pooled= true
CLEF 2005 DS−Bilingual−X2EN − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 72.65 BERK1BLDEEN01
90%
10 52.57
20 38.86 80%
30 32.59
70%
40 24.08
50 20.18
Average Precision
60%
60 17.02
50%
70 13.22
80 9.78 40%
90 5.47
30%
100 0.00
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
23.98
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Bilingual−X2EN − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 53.60 BERK1BLDEEN01
90%
10 docs 46.80
15 docs 45.07 80%
20 docs 41.20
70%
30 docs 36.53
100 docs 23.20 60%
R−Precision
200 docs 15.78
50%
500 docs 8.50
1000 docs 5.10 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
27.57 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 126 to 138)
queries 1
BERK1BLDEEN01
Topic 126 32.29 Topic 139 11.76
Difference (average precision)
Topic 127 5.73 Topic 140 1.34 0.5
Topic 128 20.16 Topic 141 0.00
Topic 129 0.93 Topic 142 47.13
Topic 130 33.30 Topic 143 33.30 0
Topic 131 20.59 Topic 144 34.77
Topic 132 85.23 Topic 145 39.88
−0.5
Topic 133 13.20 Topic 146 76.24
Topic 134 22.73 Topic 147 2.04
Topic 135 10.16 Topic 148 7.21 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 2.93 Topic 149 1.31 Topic Number
Topic 137 37.27 Topic 150 35.56
Topic 138 24.50
CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 139 to 150)
1
BERK1BLDEEN01
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.363
berkeley BERK1BLRUEN01 DS-Bilingual-X2EN
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Bilingual Russian to English
Retrieved 25,000 RunType= automatic
Relevant 2,105 QueryType= TD
Relevant retrieved 1,280 Pooled= true
CLEF 2005 DS−Bilingual−X2EN − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 69.56 BERK1BLRUEN01
90%
10 51.82
20 38.79 80%
30 29.63
70%
40 24.09
50 21.15
Average Precision
60%
60 16.54
50%
70 12.43
80 8.76 40%
90 4.89
30%
100 0.28
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
23.58
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Bilingual−X2EN − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 55.20 BERK1BLRUEN01
90%
10 docs 48.00
15 docs 45.33 80%
20 docs 41.00
70%
30 docs 37.07
100 docs 23.60 60%
R−Precision
200 docs 16.16
50%
500 docs 8.66
1000 docs 5.12 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
29.24 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 126 to 138)
queries 1
BERK1BLRUEN01
Topic 126 18.90 Topic 139 17.28
Difference (average precision)
Topic 127 15.23 Topic 140 26.54 0.5
Topic 128 30.62 Topic 141 25.96
Topic 129 0.19 Topic 142 28.72
Topic 130 18.47 Topic 143 23.25 0
Topic 131 15.43 Topic 144 29.19
Topic 132 82.93 Topic 145 43.41
−0.5
Topic 133 1.72 Topic 146 87.25
Topic 134 23.75 Topic 147 19.07
Topic 135 8.16 Topic 148 4.44 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 3.35 Topic 149 5.68 Topic Number
Topic 137 16.49 Topic 150 0.79
Topic 138 42.78
CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 139 to 150)
1
BERK1BLRUEN01
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.364
berkeley-2 BK2GBLGE1 DS-Bilingual-X2EN
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Bilingual German to English
Retrieved 25,000 RunType= automatic
Relevant 2,105 QueryType= TD
Relevant retrieved 1,856 Pooled= true
CLEF 2005 DS−Bilingual−X2EN − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 95.72 BK2GBLGE1
90%
10 80.04
20 66.48 80%
30 58.31
70%
40 51.18
50 45.12
Average Precision
60%
60 38.50
50%
70 31.53
80 24.08 40%
90 15.36
30%
100 2.56
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
45.14
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Bilingual−X2EN − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 76.00 BK2GBLGE1
90%
10 docs 69.60
15 docs 66.40 80%
20 docs 63.40
70%
30 docs 58.40
100 docs 39.76 60%
R−Precision
200 docs 26.96
50%
500 docs 13.54
1000 docs 7.42 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
46.15 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 126 to 138)
queries 1
BK2GBLGE1
Topic 126 39.82 Topic 139 28.70
Difference (average precision)
Topic 127 56.40 Topic 140 60.42 0.5
Topic 128 68.97 Topic 141 83.09
Topic 129 22.75 Topic 142 43.39
Topic 130 51.35 Topic 143 37.53 0
Topic 131 53.36 Topic 144 42.14
Topic 132 90.99 Topic 145 59.40
−0.5
Topic 133 12.82 Topic 146 83.83
Topic 134 26.74 Topic 147 46.42
Topic 135 12.04 Topic 148 27.52 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 48.92 Topic 149 11.67 Topic Number
Topic 137 24.39 Topic 150 64.53
Topic 138 31.38
CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 139 to 150)
1
BK2GBLGE1
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.365
berkeley-2 BK2GBLGE2 DS-Bilingual-X2EN
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Bilingual German to English
Retrieved 25,000 RunType= automatic
Relevant 2,105 QueryType= TD
Relevant retrieved 1,879 Pooled= true
CLEF 2005 DS−Bilingual−X2EN − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 92.30 BK2GBLGE2
90%
10 85.65
20 72.14 80%
30 60.23
70%
40 53.66
50 46.91
Average Precision
60%
60 40.37
50%
70 34.15
80 26.77 40%
90 12.54
30%
100 2.39
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
47.43
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Bilingual−X2EN − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 78.40 BK2GBLGE2
90%
10 docs 75.20
15 docs 70.13 80%
20 docs 67.00
70%
30 docs 61.07
100 docs 40.96 60%
R−Precision
200 docs 27.56
50%
500 docs 13.77
1000 docs 7.52 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
46.82 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 126 to 138)
queries 1
BK2GBLGE2
Topic 126 54.93 Topic 139 41.39
Difference (average precision)
Topic 127 65.91 Topic 140 53.78 0.5
Topic 128 69.56 Topic 141 86.12
Topic 129 23.58 Topic 142 51.69
Topic 130 47.42 Topic 143 28.58 0
Topic 131 52.10 Topic 144 50.86
Topic 132 91.81 Topic 145 60.12
−0.5
Topic 133 3.66 Topic 146 85.35
Topic 134 28.66 Topic 147 49.51
Topic 135 10.17 Topic 148 31.16 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 43.27 Topic 149 33.42 Topic Number
Topic 137 27.51 Topic 150 63.35
Topic 138 31.75
CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 139 to 150)
1
BK2GBLGE2
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.366
berkeley-2 BK2GBLGE3 DS-Bilingual-X2EN
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Bilingual German to English
Retrieved 25,000 RunType= automatic
Relevant 2,105 QueryType= TD
Relevant retrieved 1,758 Pooled= true
CLEF 2005 DS−Bilingual−X2EN − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 92.21 BK2GBLGE3
90%
10 77.97
20 64.76 80%
30 55.35
70%
40 46.02
50 38.67
Average Precision
60%
60 31.73
50%
70 24.16
80 18.02 40%
90 8.78
30%
100 0.69
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
40.34
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Bilingual−X2EN − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 74.40 BK2GBLGE3
90%
10 docs 66.80
15 docs 65.07 80%
20 docs 62.40
70%
30 docs 57.60
100 docs 35.92 60%
R−Precision
200 docs 23.82
50%
500 docs 12.33
1000 docs 7.03 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
40.19 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 126 to 138)
queries 1
BK2GBLGE3
Topic 126 26.24 Topic 139 40.49
Difference (average precision)
Topic 127 62.85 Topic 140 65.18 0.5
Topic 128 71.12 Topic 141 90.72
Topic 129 27.66 Topic 142 47.60
Topic 130 40.37 Topic 143 28.26 0
Topic 131 49.70 Topic 144 47.91
Topic 132 57.82 Topic 145 54.78
−0.5
Topic 133 11.94 Topic 146 68.16
Topic 134 18.86 Topic 147 31.68
Topic 135 0.91 Topic 148 5.38 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 34.85 Topic 149 53.29 Topic Number
Topic 137 7.84 Topic 150 44.68
Topic 138 20.13
CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 139 to 150)
1
BK2GBLGE3
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.367
msu-nivc cirGIRTru2en DS-Bilingual-X2EN
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Bilingual Russian to English
Retrieved 24,299 RunType= automatic
Relevant 2,105 QueryType= TDN
Relevant retrieved 1,141 Pooled= true
CLEF 2005 DS−Bilingual−X2EN − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 58.31 cirGIRTru2en
90%
10 46.19
20 39.97 80%
30 32.61
70%
40 29.42
50 27.04
Average Precision
60%
60 22.82
50%
70 18.62
80 7.53 40%
90 2.58
30%
100 0.00
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
24.03
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Bilingual−X2EN − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 39.20 cirGIRTru2en
90%
10 docs 37.60
15 docs 37.60 80%
20 docs 37.40
70%
30 docs 33.60
100 docs 20.88 60%
R−Precision
200 docs 14.58
50%
500 docs 7.39
1000 docs 4.56 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
27.37 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 126 to 138)
queries 1
cirGIRTru2en
Topic 126 5.03 Topic 139 8.89
Difference (average precision)
Topic 127 30.53 Topic 140 9.08 0.5
Topic 128 0.13 Topic 141 16.65
Topic 129 0.64 Topic 142 66.62
Topic 130 31.39 Topic 143 32.07 0
Topic 131 0.04 Topic 144 33.20
Topic 132 18.14 Topic 145 7.26
−0.5
Topic 133 35.41 Topic 146 75.00
Topic 134 7.17 Topic 147 49.47
Topic 135 0.68 Topic 148 45.89 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 26.09 Topic 149 69.91 Topic Number
Topic 137 0.22 Topic 150 4.67
Topic 138 26.68
CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 139 to 150)
1
cirGIRTru2en
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.368
u.glasgow gladeentdn DS-Bilingual-X2EN
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Bilingual German to English
Retrieved 25,000 RunType= automatic
Relevant 2,105 QueryType= TDN
Relevant retrieved 1,460 Pooled= true
CLEF 2005 DS−Bilingual−X2EN − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 79.32 gladeentdn
90%
10 61.33
20 53.51 80%
30 40.52
70%
40 33.41
50 27.63
Average Precision
60%
60 22.09
50%
70 17.09
80 13.42 40%
90 7.37
30%
100 0.44
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
30.63
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Bilingual−X2EN − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 61.60 gladeentdn
90%
10 docs 56.40
15 docs 53.87 80%
20 docs 48.20
70%
30 docs 44.53
100 docs 27.96 60%
R−Precision
200 docs 19.40
50%
500 docs 10.30
1000 docs 5.84 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
34.17 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 126 to 138)
queries 1
gladeentdn
Topic 126 25.74 Topic 139 10.79
Difference (average precision)
Topic 127 58.68 Topic 140 43.87 0.5
Topic 128 0.96 Topic 141 58.18
Topic 129 0.28 Topic 142 37.89
Topic 130 49.06 Topic 143 36.33 0
Topic 131 5.75 Topic 144 50.47
Topic 132 84.02 Topic 145 20.01
−0.5
Topic 133 4.54 Topic 146 62.86
Topic 134 36.53 Topic 147 32.74
Topic 135 9.64 Topic 148 16.26 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 48.87 Topic 149 6.66 Topic Number
Topic 137 17.11 Topic 150 34.23
Topic 138 14.27
CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 139 to 150)
1
gladeentdn
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.369
u.glasgow gladeentdnqe DS-Bilingual-X2EN
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Bilingual German to English
Retrieved 25,000 RunType= automatic
Relevant 2,105 QueryType= TDN
Relevant retrieved 1,615 Pooled= true
CLEF 2005 DS−Bilingual−X2EN − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 81.24 gladeentdnqe
90%
10 65.73
20 58.90 80%
30 49.04
70%
40 41.11
50 36.22
Average Precision
60%
60 32.01
50%
70 28.14
80 22.66 40%
90 15.39
30%
100 0.77
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
38.37
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Bilingual−X2EN − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 65.60 gladeentdnqe
90%
10 docs 62.00
15 docs 58.13 80%
20 docs 55.60
70%
30 docs 50.53
100 docs 32.48 60%
R−Precision
200 docs 22.04
50%
500 docs 11.41
1000 docs 6.46 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
40.28 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 126 to 138)
queries 1
gladeentdnqe
Topic 126 31.59 Topic 139 12.82
Difference (average precision)
Topic 127 62.81 Topic 140 52.86 0.5
Topic 128 0.84 Topic 141 78.35
Topic 129 0.20 Topic 142 39.07
Topic 130 59.30 Topic 143 40.43 0
Topic 131 7.87 Topic 144 67.65
Topic 132 90.09 Topic 145 44.31
−0.5
Topic 133 2.45 Topic 146 92.69
Topic 134 45.26 Topic 147 44.83
Topic 135 8.83 Topic 148 19.92 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 46.50 Topic 149 6.95 Topic Number
Topic 137 21.93 Topic 150 53.44
Topic 138 28.31
CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 139 to 150)
1
gladeentdnqe
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.370
u.glasgow gladeentdqe DS-Bilingual-X2EN
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Bilingual German to English
Retrieved 25,000 RunType= automatic
Relevant 2,105 QueryType= TD
Relevant retrieved 1,614 Pooled= true
CLEF 2005 DS−Bilingual−X2EN − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 81.23 gladeentdqe
90%
10 65.88
20 58.83 80%
30 48.86
70%
40 41.02
50 36.11
Average Precision
60%
60 31.97
50%
70 28.13
80 22.62 40%
90 15.29
30%
100 0.77
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
38.30
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Bilingual−X2EN − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 64.80 gladeentdqe
90%
10 docs 61.60
15 docs 58.13 80%
20 docs 55.60
70%
30 docs 50.67
100 docs 32.52 60%
R−Precision
200 docs 22.04
50%
500 docs 11.40
1000 docs 6.46 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
40.26 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 126 to 138)
queries 1
gladeentdqe
Topic 126 31.58 Topic 139 12.75
Difference (average precision)
Topic 127 61.83 Topic 140 52.78 0.5
Topic 128 0.83 Topic 141 78.34
Topic 129 0.20 Topic 142 38.90
Topic 130 59.23 Topic 143 40.51 0
Topic 131 7.83 Topic 144 67.63
Topic 132 90.08 Topic 145 44.41
−0.5
Topic 133 2.45 Topic 146 92.70
Topic 134 45.19 Topic 147 44.84
Topic 135 8.52 Topic 148 19.87 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 46.43 Topic 149 6.96 Topic Number
Topic 137 21.93 Topic 150 53.37
Topic 138 28.31
CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 139 to 150)
1
gladeentdqe
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.371
u.glasgow glaruentdn DS-Bilingual-X2EN
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Bilingual Russian to English
Retrieved 25,000 RunType= automatic
Relevant 2,105 QueryType= TDN
Relevant retrieved 1,476 Pooled= true
CLEF 2005 DS−Bilingual−X2EN − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 82.97 glaruentdn
90%
10 64.17
20 54.13 80%
30 41.28
70%
40 32.72
50 27.07
Average Precision
60%
60 22.92
50%
70 19.64
80 14.76 40%
90 7.48
30%
100 0.13
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
31.49
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Bilingual−X2EN − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 64.00 glaruentdn
90%
10 docs 59.20
15 docs 55.47 80%
20 docs 52.00
70%
30 docs 45.87
100 docs 29.00 60%
R−Precision
200 docs 20.26
50%
500 docs 10.54
1000 docs 5.90 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
34.39 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 126 to 138)
queries 1
glaruentdn
Topic 126 29.29 Topic 139 8.21
Difference (average precision)
Topic 127 47.81 Topic 140 42.01 0.5
Topic 128 70.02 Topic 141 31.99
Topic 129 2.29 Topic 142 16.36
Topic 130 37.42 Topic 143 30.39 0
Topic 131 29.81 Topic 144 59.17
Topic 132 89.21 Topic 145 23.95
−0.5
Topic 133 15.51 Topic 146 82.95
Topic 134 23.57 Topic 147 32.50
Topic 135 6.79 Topic 148 7.90 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 54.32 Topic 149 8.25 Topic Number
Topic 137 19.85 Topic 150 1.63
Topic 138 16.03
CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 139 to 150)
1
glaruentdn
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.372
u.glasgow glaruentdnqe DS-Bilingual-X2EN
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Bilingual Russian to English
Retrieved 25,000 RunType= automatic
Relevant 2,105 QueryType= TDN
Relevant retrieved 1,663 Pooled= true
CLEF 2005 DS−Bilingual−X2EN − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 80.70 glaruentdnqe
90%
10 65.89
20 57.59 80%
30 48.70
70%
40 43.42
50 38.26
Average Precision
60%
60 34.04
50%
70 28.50
80 23.00 40%
90 13.91
30%
100 0.82
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
38.48
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Bilingual−X2EN − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 63.20 glaruentdnqe
90%
10 docs 60.00
15 docs 55.47 80%
20 docs 53.80
70%
30 docs 50.67
100 docs 34.56 60%
R−Precision
200 docs 23.54
50%
500 docs 11.91
1000 docs 6.65 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
40.84 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 126 to 138)
queries 1
glaruentdnqe
Topic 126 29.18 Topic 139 12.35
Difference (average precision)
Topic 127 57.20 Topic 140 51.92 0.5
Topic 128 75.85 Topic 141 63.10
Topic 129 1.67 Topic 142 17.48
Topic 130 35.52 Topic 143 41.41 0
Topic 131 69.15 Topic 144 65.69
Topic 132 90.87 Topic 145 38.17
−0.5
Topic 133 10.46 Topic 146 90.79
Topic 134 31.14 Topic 147 43.94
Topic 135 4.81 Topic 148 8.61 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 57.60 Topic 149 11.39 Topic Number
Topic 137 23.62 Topic 150 1.25
Topic 138 28.83
CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 139 to 150)
1
glaruentdnqe
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.373
u.glasgow glaruentdqe DS-Bilingual-X2EN
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Bilingual Russian to English
Retrieved 25,000 RunType= automatic
Relevant 2,105 QueryType= TD
Relevant retrieved 1,662 Pooled= true
CLEF 2005 DS−Bilingual−X2EN − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 80.90 glaruentdqe
90%
10 65.80
20 57.58 80%
30 48.60
70%
40 43.46
50 38.25
Average Precision
60%
60 33.99
50%
70 28.46
80 22.94 40%
90 13.84
30%
100 0.81
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
38.46
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Bilingual−X2EN − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 63.20 glaruentdqe
90%
10 docs 60.00
15 docs 55.73 80%
20 docs 53.40
70%
30 docs 50.67
100 docs 34.56 60%
R−Precision
200 docs 23.52
50%
500 docs 11.92
1000 docs 6.65 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
40.81 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 126 to 138)
queries 1
glaruentdqe
Topic 126 29.09 Topic 139 12.28
Difference (average precision)
Topic 127 57.19 Topic 140 51.89 0.5
Topic 128 75.70 Topic 141 63.11
Topic 129 1.67 Topic 142 17.44
Topic 130 35.75 Topic 143 41.39 0
Topic 131 69.01 Topic 144 65.63
Topic 132 90.85 Topic 145 38.23
−0.5
Topic 133 10.45 Topic 146 90.75
Topic 134 31.05 Topic 147 43.94
Topic 135 4.81 Topic 148 8.57 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 57.57 Topic 149 11.42 Topic Number
Topic 137 23.62 Topic 150 1.25
Topic 138 28.79
CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 139 to 150)
1
glaruentdqe
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.374
u.glasgow glaruentdqeD DS-Bilingual-X2EN
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Bilingual Russian to English
Retrieved 25,000 RunType= automatic
Relevant 2,105 QueryType= TD
Relevant retrieved 1,682 Pooled= true
CLEF 2005 DS−Bilingual−X2EN − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 80.97 glaruentdqeD
90%
10 66.34
20 56.69 80%
30 48.85
70%
40 43.56
50 39.98
Average Precision
60%
60 34.87
50%
70 29.77
80 23.17 40%
90 15.62
30%
100 0.80
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
38.99
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Bilingual−X2EN − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 62.40 glaruentdqeD
90%
10 docs 58.80
15 docs 55.20 80%
20 docs 52.60
70%
30 docs 50.67
100 docs 34.76 60%
R−Precision
200 docs 23.80
50%
500 docs 12.06
1000 docs 6.73 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
41.56 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 126 to 138)
queries 1
glaruentdqeD
Topic 126 30.47 Topic 139 9.25
Difference (average precision)
Topic 127 55.27 Topic 140 49.13 0.5
Topic 128 75.75 Topic 141 69.23
Topic 129 2.06 Topic 142 15.46
Topic 130 31.61 Topic 143 41.66 0
Topic 131 71.22 Topic 144 63.49
Topic 132 90.48 Topic 145 40.07
−0.5
Topic 133 11.76 Topic 146 91.71
Topic 134 32.03 Topic 147 43.86
Topic 135 3.86 Topic 148 9.05 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 56.41 Topic 149 9.86 Topic Number
Topic 137 22.06 Topic 150 3.28
Topic 138 45.66
CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 139 to 150)
1
glaruentdqeD
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.375
berkeley BERK1BLDERU01 DS-Bilingual-X2RU
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Bilingual German to Russian
Retrieved 24,726 RunType= automatic
Relevant 831 QueryType= TD
Relevant retrieved 586 Pooled= true
CLEF 2005 DS−Bilingual−X2RU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 49.48 BERK1BLDERU01
90%
10 38.06
20 30.93 80%
30 21.80
70%
40 19.41
50 16.98
Average Precision
60%
60 10.78
50%
70 7.98
80 5.58 40%
90 4.13
30%
100 3.08
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
17.17
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Bilingual−X2RU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 25.60 BERK1BLDERU01
90%
10 docs 22.80
15 docs 21.07 80%
20 docs 19.60
70%
30 docs 17.87
100 docs 11.68 60%
R−Precision
200 docs 7.74
50%
500 docs 4.09
1000 docs 2.34 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
18.64 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2RU − Comparison to median by topic (topics 126 to 138)
queries 1
BERK1BLDERU01
Topic 126 41.19 Topic 139 22.41
Difference (average precision)
Topic 127 61.74 Topic 140 2.56 0.5
Topic 128 23.74 Topic 141 20.40
Topic 129 0.00 Topic 142 13.39
Topic 130 5.97 Topic 143 83.33 0
Topic 131 9.76 Topic 144 1.07
Topic 132 30.40 Topic 145 59.83
−0.5
Topic 133 10.71 Topic 146 0.00
Topic 134 1.28 Topic 147 0.00
Topic 135 8.01 Topic 148 6.39 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 2.03 Topic 149 1.36 Topic Number
Topic 137 11.14 Topic 150 1.56
Topic 138 10.95
CLEF 2005 DS−Bilingual−X2RU − Comparison to median by topic (topics 139 to 150)
1
BERK1BLDERU01
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.376
berkeley BERK1BLENRU01 DS-Bilingual-X2RU
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Bilingual English to Russian
Retrieved 25,000 RunType= automatic
Relevant 831 QueryType= TD
Relevant retrieved 498 Pooled= true
CLEF 2005 DS−Bilingual−X2RU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 49.51 BERK1BLENRU01
90%
10 32.25
20 23.50 80%
30 18.89
70%
40 15.33
50 12.95
Average Precision
60%
60 8.33
50%
70 5.64
80 3.58 40%
90 1.91
30%
100 1.27
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
13.64
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Bilingual−X2RU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 21.60 BERK1BLENRU01
90%
10 docs 19.60
15 docs 17.87 80%
20 docs 16.60
70%
30 docs 15.47
100 docs 10.52 60%
R−Precision
200 docs 6.70
50%
500 docs 3.45
1000 docs 1.99 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
15.46 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2RU − Comparison to median by topic (topics 126 to 138)
queries 1
BERK1BLENRU01
Topic 126 15.52 Topic 139 20.28
Difference (average precision)
Topic 127 68.72 Topic 140 3.58 0.5
Topic 128 19.03 Topic 141 20.86
Topic 129 0.00 Topic 142 0.50
Topic 130 0.48 Topic 143 64.29 0
Topic 131 0.72 Topic 144 2.70
Topic 132 12.50 Topic 145 56.70
−0.5
Topic 133 10.43 Topic 146 0.00
Topic 134 0.72 Topic 147 0.16
Topic 135 8.45 Topic 148 15.11 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 2.20 Topic 149 5.55 Topic Number
Topic 137 8.45 Topic 150 1.78
Topic 138 2.25
CLEF 2005 DS−Bilingual−X2RU − Comparison to median by topic (topics 139 to 150)
1
BERK1BLENRU01
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.377
berkeley-2 BK2GBLGR1 DS-Bilingual-X2RU
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Bilingual German to Russian
Retrieved 25,000 RunType= automatic
Relevant 831 QueryType= TD
Relevant retrieved 629 Pooled= true
CLEF 2005 DS−Bilingual−X2RU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 57.41 BK2GBLGR1
90%
10 39.08
20 32.92 80%
30 28.22
70%
40 26.08
50 23.94
Average Precision
60%
60 20.84
50%
70 19.19
80 12.74 40%
90 7.89
30%
100 5.24
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
23.31
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Bilingual−X2RU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 36.00 BK2GBLGR1
90%
10 docs 31.20
15 docs 27.73 80%
20 docs 24.60
70%
30 docs 21.20
100 docs 15.12 60%
R−Precision
200 docs 10.02
50%
500 docs 4.74
1000 docs 2.52 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
25.01 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2RU − Comparison to median by topic (topics 126 to 138)
queries 1
BK2GBLGR1
Topic 126 51.82 Topic 139 51.45
Difference (average precision)
Topic 127 75.59 Topic 140 2.71 0.5
Topic 128 37.93 Topic 141 13.44
Topic 129 0.11 Topic 142 28.86
Topic 130 0.61 Topic 143 100.00 0
Topic 131 29.76 Topic 144 1.37
Topic 132 10.00 Topic 145 68.21
−0.5
Topic 133 46.43 Topic 146 0.00
Topic 134 6.07 Topic 147 0.00
Topic 135 2.57 Topic 148 5.51 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 10.02 Topic 149 2.57 Topic Number
Topic 137 19.10 Topic 150 1.02
Topic 138 17.70
CLEF 2005 DS−Bilingual−X2RU − Comparison to median by topic (topics 139 to 150)
1
BK2GBLGR1
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.378
berkeley-2 BK2GBLER1 DS-Bilingual-X2RU
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Bilingual English to Russian
Retrieved 25,000 RunType= automatic
Relevant 831 QueryType= TD
Relevant retrieved 567 Pooled= true
CLEF 2005 DS−Bilingual−X2RU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 55.81 BK2GBLER1
90%
10 39.88
20 27.90 80%
30 22.85
70%
40 20.90
50 19.59
Average Precision
60%
60 13.03
50%
70 10.28
80 8.24 40%
90 4.33
30%
100 0.84
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
18.10
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Bilingual−X2RU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 28.00 BK2GBLER1
90%
10 docs 25.20
15 docs 22.67 80%
20 docs 20.60
70%
30 docs 19.07
100 docs 13.28 60%
R−Precision
200 docs 8.46
50%
500 docs 4.19
1000 docs 2.27 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
19.79 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2RU − Comparison to median by topic (topics 126 to 138)
queries 1
BK2GBLER1
Topic 126 42.10 Topic 139 22.94
Difference (average precision)
Topic 127 86.91 Topic 140 2.55 0.5
Topic 128 25.94 Topic 141 19.33
Topic 129 0.21 Topic 142 1.36
Topic 130 0.25 Topic 143 0.94 0
Topic 131 52.94 Topic 144 0.65
Topic 132 12.50 Topic 145 59.49
−0.5
Topic 133 39.15 Topic 146 0.00
Topic 134 9.13 Topic 147 0.11
Topic 135 18.76 Topic 148 16.18 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 11.09 Topic 149 8.80 Topic Number
Topic 137 15.55 Topic 150 1.39
Topic 138 4.32
CLEF 2005 DS−Bilingual−X2RU − Comparison to median by topic (topics 139 to 150)
1
BK2GBLER1
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.379
msu-nivc cirRSSCen2ru DS-Bilingual-X2RU
Overall statistics for 24 queries : General info:
Total number of documents over all queries Track= Domain Specific Bilingual English to Russian
Retrieved 8,696 RunType= automatic
Relevant 829 QueryType= TDN
Relevant retrieved 90 Pooled= true
CLEF 2005 DS−Bilingual−X2RU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 19.53 cirRSSCen2ru
90%
10 9.92
20 1.15 80%
30 0.77
70%
40 0.17
50 0.17
Average Precision
60%
60 0.00
50%
70 0.00
80 0.00 40%
90 0.00
30%
100 0.00
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
2.16
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Bilingual−X2RU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 13.60 cirRSSCen2ru
90%
10 docs 13.60
15 docs 12.80 80%
20 docs 10.60
70%
30 docs 8.93
100 docs 3.24 60%
R−Precision
200 docs 1.66
50%
500 docs 0.72
1000 docs 0.36 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
3.43 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2RU − Comparison to median by topic (topics 126 to 138)
queries 1
cirRSSCen2ru
Topic 126 0.26 Topic 139 7.76
Difference (average precision)
Topic 127 11.62 Topic 140 2.89 0.5
Topic 128 0.02 Topic 141 0.00
Topic 129 0.00 Topic 142 6.78
Topic 130 5.35 Topic 143 0.00 0
Topic 131 0.00 Topic 144 1.89
Topic 132 0.00 Topic 145 14.75
−0.5
Topic 133 0.00 Topic 146 0.00
Topic 134 2.00 Topic 147 0.00
Topic 135 0.55 Topic 148 0.00 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 0.22 Topic 149 0.00 Topic Number
Topic 137 0.00 Topic 150 0.00
Topic 138 0.00
CLEF 2005 DS−Bilingual−X2RU − Comparison to median by topic (topics 139 to 150)
1
cirRSSCen2ru
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.380
berkeley BERK1MLEN01 DS-Monolingual-EN
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Monolingual English
Retrieved 25,000 RunType= automatic
Relevant 2,105 QueryType= TD
Relevant retrieved 1,711 Pooled= true
CLEF 2005 DS−Monolingual−EN − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 78.99 BERK1MLEN01
90%
10 61.23
20 52.34 80%
30 44.99
70%
40 36.30
50 31.21
Average Precision
60%
60 26.06
50%
70 20.91
80 15.08 40%
90 8.76
30%
100 0.43
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
32.91
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Monolingual−EN − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 62.40 BERK1MLEN01
90%
10 docs 58.40
15 docs 55.20 80%
20 docs 51.40
70%
30 docs 47.33
100 docs 32.52 60%
R−Precision
200 docs 22.28
50%
500 docs 11.87
1000 docs 6.84 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
36.46 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 126 to 138)
queries 1
BERK1MLEN01
Topic 126 43.75 Topic 139 19.80
Difference (average precision)
Topic 127 37.93 Topic 140 37.17 0.5
Topic 128 64.74 Topic 141 49.78
Topic 129 0.13 Topic 142 29.80
Topic 130 52.93 Topic 143 26.25 0
Topic 131 23.32 Topic 144 8.98
Topic 132 85.23 Topic 145 47.08
−0.5
Topic 133 3.67 Topic 146 87.75
Topic 134 36.98 Topic 147 35.68
Topic 135 7.03 Topic 148 8.42 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 33.69 Topic 149 1.47 Topic Number
Topic 137 20.92 Topic 150 45.05
Topic 138 15.29
CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 139 to 150)
1
BERK1MLEN01
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.381
berkeley-2 BK2GMLEE1 DS-Monolingual-EN
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Monolingual English
Retrieved 25,000 RunType= automatic
Relevant 2,105 QueryType= TD
Relevant retrieved 1,885 Pooled= true
CLEF 2005 DS−Monolingual−EN − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 91.85 BK2GMLEE1
90%
10 76.53
20 63.34 80%
30 56.38
70%
40 51.61
50 45.42
Average Precision
60%
60 40.17
50%
70 33.09
80 26.72 40%
90 16.92
30%
100 4.46
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
45.31
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Monolingual−EN − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 77.60 BK2GMLEE1
90%
10 docs 68.40
15 docs 63.47 80%
20 docs 61.60
70%
30 docs 56.80
100 docs 41.28 60%
R−Precision
200 docs 28.10
50%
500 docs 13.98
1000 docs 7.54 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
43.95 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 126 to 138)
queries 1
BK2GMLEE1
Topic 126 41.73 Topic 139 41.25
Difference (average precision)
Topic 127 57.43 Topic 140 61.07 0.5
Topic 128 66.92 Topic 141 81.10
Topic 129 2.59 Topic 142 30.01
Topic 130 64.51 Topic 143 40.70 0
Topic 131 61.50 Topic 144 36.01
Topic 132 88.87 Topic 145 60.87
−0.5
Topic 133 3.13 Topic 146 77.34
Topic 134 25.02 Topic 147 75.29
Topic 135 15.38 Topic 148 18.62 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 54.33 Topic 149 15.50 Topic Number
Topic 137 16.60 Topic 150 68.28
Topic 138 28.66
CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 139 to 150)
1
BK2GMLEE1
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.382
berkeley-2 BK2GMLEE2 DS-Monolingual-EN
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Monolingual English
Retrieved 25,000 RunType= automatic
Relevant 2,105 QueryType= TD
Relevant retrieved 1,728 Pooled= true
CLEF 2005 DS−Monolingual−EN − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 89.78 BK2GMLEE2
90%
10 71.11
20 62.97 80%
30 54.43
70%
40 48.45
50 41.05
Average Precision
60%
60 34.77
50%
70 28.09
80 22.05 40%
90 9.51
30%
100 2.72
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
41.49
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Monolingual−EN − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 72.80 BK2GMLEE2
90%
10 docs 68.40
15 docs 64.80 80%
20 docs 62.80
70%
30 docs 57.60
100 docs 37.64 60%
R−Precision
200 docs 24.40
50%
500 docs 12.28
1000 docs 6.91 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
41.70 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 126 to 138)
queries 1
BK2GMLEE2
Topic 126 48.01 Topic 139 52.73
Difference (average precision)
Topic 127 39.61 Topic 140 66.41 0.5
Topic 128 66.44 Topic 141 61.53
Topic 129 4.89 Topic 142 65.26
Topic 130 57.02 Topic 143 32.80 0
Topic 131 21.95 Topic 144 36.09
Topic 132 86.82 Topic 145 56.70
−0.5
Topic 133 0.98 Topic 146 82.87
Topic 134 32.19 Topic 147 51.65
Topic 135 29.85 Topic 148 15.00 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 49.24 Topic 149 7.81 Topic Number
Topic 137 6.63 Topic 150 58.61
Topic 138 6.05
CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 139 to 150)
1
BK2GMLEE2
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.383
berkeley-2 BK2GMLEE3 DS-Monolingual-EN
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Monolingual English
Retrieved 25,000 RunType= automatic
Relevant 2,105 QueryType= TD
Relevant retrieved 1,847 Pooled= true
CLEF 2005 DS−Monolingual−EN − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 89.71 BK2GMLEE3
90%
10 79.37
20 70.73 80%
30 62.30
70%
40 53.79
50 48.09
Average Precision
60%
60 41.15
50%
70 32.38
80 26.54 40%
90 16.15
30%
100 2.93
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
46.97
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Monolingual−EN − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 75.20 BK2GMLEE3
90%
10 docs 71.60
15 docs 68.27 80%
20 docs 66.00
70%
30 docs 60.53
100 docs 40.84 60%
R−Precision
200 docs 26.66
50%
500 docs 13.38
1000 docs 7.39 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
46.33 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 126 to 138)
queries 1
BK2GMLEE3
Topic 126 46.90 Topic 139 56.83
Difference (average precision)
Topic 127 38.96 Topic 140 68.20 0.5
Topic 128 73.46 Topic 141 77.94
Topic 129 8.14 Topic 142 64.72
Topic 130 57.04 Topic 143 25.55 0
Topic 131 59.05 Topic 144 38.69
Topic 132 84.02 Topic 145 59.59
−0.5
Topic 133 0.57 Topic 146 83.99
Topic 134 28.42 Topic 147 76.03
Topic 135 48.13 Topic 148 20.47 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 58.58 Topic 149 15.92 Topic Number
Topic 137 8.63 Topic 150 47.58
Topic 138 26.79
CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 139 to 150)
1
BK2GMLEE3
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.384
irit CWNSE_T DS-Monolingual-EN
Overall statistics for 24 queries : General info:
Total number of documents over all queries Track= Domain Specific Monolingual English
Retrieved 22,781 RunType= automatic
Relevant 1,956 QueryType= T
Relevant retrieved 1,234 Pooled= true
CLEF 2005 DS−Monolingual−EN − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 81.10 CWNSET
90%
10 62.58
20 51.28 80%
30 41.92
70%
40 33.06
50 28.03
Average Precision
60%
60 25.16
50%
70 21.50
80 16.84 40%
90 10.46
30%
100 2.33
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
32.51
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Monolingual−EN − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 64.00 CWNSET
90%
10 docs 60.80
15 docs 57.87 80%
20 docs 55.20
70%
30 docs 50.00
100 docs 28.56 60%
R−Precision
200 docs 17.80
50%
500 docs 8.44
1000 docs 4.94 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
32.60 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 126 to 138)
queries 1
CWNSET
Topic 126 0.43 Topic 139 16.87
Difference (average precision)
Topic 127 25.64 Topic 140 54.40 0.5
Topic 128 68.90 Topic 141 86.29
Topic 129 7.77 Topic 142 75.44
Topic 130 47.10 Topic 143 20.02 0
Topic 131 41.04 Topic 144 54.82
Topic 132 0.00 Topic 145 34.12
−0.5
Topic 133 1.99 Topic 146 74.75
Topic 134 9.99 Topic 147 63.10
Topic 135 16.32 Topic 148 9.61 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 58.48 Topic 149 5.91 Topic Number
Topic 137 22.79 Topic 150 11.91
Topic 138 5.16
CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 139 to 150)
1
CWNSE
T
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.385
irit CWNSE_TD DS-Monolingual-EN
Overall statistics for 24 queries : General info:
Total number of documents over all queries Track= Domain Specific Monolingual English
Retrieved 24,000 RunType= automatic
Relevant 1,956 QueryType= TD
Relevant retrieved 1,458 Pooled= true
CLEF 2005 DS−Monolingual−EN − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 76.89 CWNSETD
90%
10 57.04
20 51.41 80%
30 43.63
70%
40 36.00
50 30.28
Average Precision
60%
60 25.58
50%
70 22.76
80 18.11 40%
90 7.83
30%
100 0.37
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
32.35
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Monolingual−EN − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 57.60 CWNSETD
90%
10 docs 52.00
15 docs 49.87 80%
20 docs 48.60
70%
30 docs 46.13
100 docs 29.80 60%
R−Precision
200 docs 20.18
50%
500 docs 10.38
1000 docs 5.83 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
34.03 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 126 to 138)
queries 1
CWNSETD
Topic 126 36.09 Topic 139 15.15
Difference (average precision)
Topic 127 34.66 Topic 140 44.59 0.5
Topic 128 72.64 Topic 141 85.96
Topic 129 5.62 Topic 142 6.42
Topic 130 47.32 Topic 143 19.39 0
Topic 131 38.59 Topic 144 50.99
Topic 132 0.00 Topic 145 61.79
−0.5
Topic 133 7.98 Topic 146 82.88
Topic 134 44.46 Topic 147 60.58
Topic 135 11.81 Topic 148 3.49 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 12.06 Topic 149 5.20 Topic Number
Topic 137 21.91 Topic 150 34.83
Topic 138 4.44
CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 139 to 150)
1
CWNSE D
T
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.386
irit CWN_T DS-Monolingual-EN
Overall statistics for 24 queries : General info:
Total number of documents over all queries Track= Domain Specific Monolingual English
Retrieved 22,726 RunType= automatic
Relevant 1,956 QueryType= T
Relevant retrieved 1,276 Pooled= true
CLEF 2005 DS−Monolingual−EN − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 81.48 CWNT
90%
10 64.65
20 53.40 80%
30 45.20
70%
40 33.71
50 29.43
Average Precision
60%
60 26.94
50%
70 22.21
80 18.71 40%
90 13.87
30%
100 0.34
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
34.11
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Monolingual−EN − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 66.40 CWNT
90%
10 docs 62.00
15 docs 59.73 80%
20 docs 57.60
70%
30 docs 52.13
100 docs 28.92 60%
R−Precision
200 docs 18.32
50%
500 docs 8.79
1000 docs 5.10 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
35.06 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 126 to 138)
queries 1
CWNT
Topic 126 0.43 Topic 139 45.53
Difference (average precision)
Topic 127 25.64 Topic 140 54.40 0.5
Topic 128 68.90 Topic 141 85.41
Topic 129 4.29 Topic 142 75.44
Topic 130 47.10 Topic 143 20.02 0
Topic 131 33.08 Topic 144 46.97
Topic 132 0.00 Topic 145 38.51
−0.5
Topic 133 1.99 Topic 146 88.67
Topic 134 7.83 Topic 147 68.42
Topic 135 16.64 Topic 148 9.61 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 69.62 Topic 149 4.30 Topic Number
Topic 137 22.79 Topic 150 11.91
Topic 138 5.18
CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 139 to 150)
1
CWN
T
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.387
irit CWN_TD DS-Monolingual-EN
Overall statistics for 24 queries : General info:
Total number of documents over all queries Track= Domain Specific Monolingual English
Retrieved 24,000 RunType= automatic
Relevant 1,956 QueryType= TD
Relevant retrieved 1,486 Pooled= true
CLEF 2005 DS−Monolingual−EN − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 74.63 CWNTD
90%
10 57.06
20 51.07 80%
30 43.42
70%
40 34.98
50 29.55
Average Precision
60%
60 24.95
50%
70 21.95
80 18.03 40%
90 11.58
30%
100 0.52
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
32.23
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Monolingual−EN − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 55.20 CWNTD
90%
10 docs 53.60
15 docs 52.80 80%
20 docs 50.40
70%
30 docs 47.73
100 docs 29.76 60%
R−Precision
200 docs 20.68
50%
500 docs 10.58
1000 docs 5.94 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
33.53 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 126 to 138)
queries 1
CWNTD
Topic 126 44.47 Topic 139 15.19
Difference (average precision)
Topic 127 40.59 Topic 140 41.75 0.5
Topic 128 72.64 Topic 141 85.89
Topic 129 1.02 Topic 142 6.42
Topic 130 52.33 Topic 143 19.39 0
Topic 131 33.77 Topic 144 21.86
Topic 132 0.00 Topic 145 61.90
−0.5
Topic 133 2.58 Topic 146 88.89
Topic 134 32.15 Topic 147 57.72
Topic 135 3.94 Topic 148 3.66 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 55.94 Topic 149 5.46 Topic Number
Topic 137 21.52 Topic 150 32.57
Topic 138 4.01
CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 139 to 150)
1
CWN D
T
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.388
irit C_T DS-Monolingual-EN
Overall statistics for 24 queries : General info:
Total number of documents over all queries Track= Domain Specific Monolingual English
Retrieved 22,715 RunType= automatic
Relevant 1,956 QueryType= T
Relevant retrieved 1,231 Pooled= true
CLEF 2005 DS−Monolingual−EN − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 87.17 CT
90%
10 65.98
20 54.36 80%
30 43.78
70%
40 32.11
50 29.40
Average Precision
60%
60 27.02
50%
70 21.87
80 17.79 40%
90 12.44
30%
100 0.29
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
34.11
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Monolingual−EN − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 69.60 CT
90%
10 docs 64.80
15 docs 61.33 80%
20 docs 57.60
70%
30 docs 52.93
100 docs 28.52 60%
R−Precision
200 docs 18.24
50%
500 docs 8.82
1000 docs 4.92 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
36.19 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 126 to 138)
queries 1
CT
Topic 126 11.32 Topic 139 46.24
Difference (average precision)
Topic 127 14.17 Topic 140 57.21 0.5
Topic 128 69.28 Topic 141 69.99
Topic 129 3.44 Topic 142 79.79
Topic 130 45.71 Topic 143 41.28 0
Topic 131 33.12 Topic 144 46.87
Topic 132 0.00 Topic 145 29.01
−0.5
Topic 133 1.55 Topic 146 88.67
Topic 134 7.50 Topic 147 68.47
Topic 135 19.04 Topic 148 9.05 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 69.99 Topic 149 3.08 Topic Number
Topic 137 22.94 Topic 150 10.66
Topic 138 4.35
CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 139 to 150)
1
C
T
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.389
msu-nivc cirGIRTen2en DS-Monolingual-EN
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Monolingual English
Retrieved 24,136 RunType= automatic
Relevant 2,105 QueryType= TDN
Relevant retrieved 1,076 Pooled= true
CLEF 2005 DS−Monolingual−EN − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 68.14 cirGIRTen2en
90%
10 49.46
20 43.43 80%
30 37.36
70%
40 34.94
50 31.69
Average Precision
60%
60 29.25
50%
70 26.82
80 15.34 40%
90 2.52
30%
100 0.00
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
29.03
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Monolingual−EN − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 49.60 cirGIRTen2en
90%
10 docs 47.20
15 docs 44.53 80%
20 docs 44.40
70%
30 docs 39.33
100 docs 24.76 60%
R−Precision
200 docs 15.62
50%
500 docs 7.73
1000 docs 4.30 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
33.49 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 126 to 138)
queries 1
cirGIRTen2en
Topic 126 4.08 Topic 139 11.55
Difference (average precision)
Topic 127 41.37 Topic 140 59.86 0.5
Topic 128 0.16 Topic 141 84.12
Topic 129 0.17 Topic 142 65.22
Topic 130 37.38 Topic 143 32.07 0
Topic 131 2.20 Topic 144 33.83
Topic 132 76.68 Topic 145 3.96
−0.5
Topic 133 25.19 Topic 146 75.00
Topic 134 4.28 Topic 147 42.95
Topic 135 9.86 Topic 148 9.78 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 20.55 Topic 149 69.91 Topic Number
Topic 137 0.22 Topic 150 2.72
Topic 138 12.56
CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 139 to 150)
1
cirGIRTen2en
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.390
u.glasgow glaentd DS-Monolingual-EN
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Monolingual English
Retrieved 25,000 RunType= automatic
Relevant 2,105 QueryType= TD
Relevant retrieved 1,668 Pooled= true
CLEF 2005 DS−Monolingual−EN − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 86.37 glaentd
90%
10 68.96
20 56.04 80%
30 42.30
70%
40 37.32
50 31.86
Average Precision
60%
60 27.12
50%
70 22.02
80 18.12 40%
90 11.90
30%
100 1.31
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
34.84
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Monolingual−EN − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 68.80 glaentd
90%
10 docs 61.20
15 docs 55.47 80%
20 docs 52.80
70%
30 docs 48.53
100 docs 32.76 60%
R−Precision
200 docs 22.98
50%
500 docs 11.95
1000 docs 6.67 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
36.98 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 126 to 138)
queries 1
glaentd
Topic 126 30.33 Topic 139 9.60
Difference (average precision)
Topic 127 49.27 Topic 140 50.91 0.5
Topic 128 72.59 Topic 141 40.93
Topic 129 0.43 Topic 142 30.04
Topic 130 64.40 Topic 143 35.75 0
Topic 131 20.81 Topic 144 31.41
Topic 132 85.47 Topic 145 34.46
−0.5
Topic 133 12.13 Topic 146 69.34
Topic 134 35.34 Topic 147 53.49
Topic 135 11.32 Topic 148 9.87 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 55.58 Topic 149 4.81 Topic Number
Topic 137 16.98 Topic 150 33.93
Topic 138 11.78
CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 139 to 150)
1
glaentd
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.391
u.glasgow glaentdnqe DS-Monolingual-EN
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Monolingual English
Retrieved 25,000 RunType= automatic
Relevant 2,105 QueryType= TDN
Relevant retrieved 1,840 Pooled= true
CLEF 2005 DS−Monolingual−EN − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 89.58 glaentdnqe
90%
10 71.20
20 61.68 80%
30 53.64
70%
40 46.43
50 40.64
Average Precision
60%
60 35.28
50%
70 30.31
80 24.30 40%
90 15.61
30%
100 2.88
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
41.71
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Monolingual−EN − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 69.60 glaentdnqe
90%
10 docs 63.20
15 docs 60.00 80%
20 docs 57.40
70%
30 docs 53.07
100 docs 37.40 60%
R−Precision
200 docs 25.94
50%
500 docs 13.30
1000 docs 7.36 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
42.11 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 126 to 138)
queries 1
glaentdnqe
Topic 126 23.13 Topic 139 18.13
Difference (average precision)
Topic 127 52.29 Topic 140 55.89 0.5
Topic 128 81.44 Topic 141 68.76
Topic 129 0.66 Topic 142 28.33
Topic 130 62.27 Topic 143 36.89 0
Topic 131 60.14 Topic 144 31.40
Topic 132 91.44 Topic 145 50.67
−0.5
Topic 133 11.76 Topic 146 90.08
Topic 134 45.61 Topic 147 55.61
Topic 135 6.67 Topic 148 11.93 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 49.54 Topic 149 4.48 Topic Number
Topic 137 23.96 Topic 150 54.77
Topic 138 26.93
CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 139 to 150)
1
glaentdnqe
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.392
unine UniNEgen1 DS-Monolingual-EN
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Monolingual English
Retrieved 25,000 RunType= automatic
Relevant 2,105 QueryType= TD
Relevant retrieved 1,958 Pooled= true
CLEF 2005 DS−Monolingual−EN − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 87.96 UniNEgen1
90%
10 76.87
20 70.29 80%
30 64.52
70%
40 58.85
50 52.64
Average Precision
60%
60 46.66
50%
70 40.82
80 31.94 40%
90 24.83
30%
100 5.28
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
50.65
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Monolingual−EN − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 76.00 UniNEgen1
90%
10 docs 69.60
15 docs 68.00 80%
20 docs 65.20
70%
30 docs 62.00
100 docs 43.44 60%
R−Precision
200 docs 28.72
50%
500 docs 14.27
1000 docs 7.83 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
49.15 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 126 to 138)
queries 1
UniNEgen1
Topic 126 47.24 Topic 139 34.79
Difference (average precision)
Topic 127 50.01 Topic 140 48.86 0.5
Topic 128 77.92 Topic 141 82.42
Topic 129 0.56 Topic 142 60.35
Topic 130 62.22 Topic 143 39.89 0
Topic 131 72.37 Topic 144 56.25
Topic 132 93.40 Topic 145 62.34
−0.5
Topic 133 1.39 Topic 146 92.89
Topic 134 49.03 Topic 147 67.07
Topic 135 16.88 Topic 148 14.69 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 55.32 Topic 149 4.86 Topic Number
Topic 137 74.42 Topic 150 71.08
Topic 138 30.03
CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 139 to 150)
1
UniNEgen1
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.393
unine UniNEgen2 DS-Monolingual-EN
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Monolingual English
Retrieved 25,000 RunType= automatic
Relevant 2,105 QueryType= TD
Relevant retrieved 1,955 Pooled= true
CLEF 2005 DS−Monolingual−EN − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 86.93 UniNEgen2
90%
10 76.02
20 69.90 80%
30 64.76
70%
40 57.82
50 51.89
Average Precision
60%
60 46.69
50%
70 41.25
80 32.54 40%
90 24.33
30%
100 6.69
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
50.43
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Monolingual−EN − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 75.20 UniNEgen2
90%
10 docs 70.40
15 docs 67.73 80%
20 docs 65.40
70%
30 docs 61.87
100 docs 42.88 60%
R−Precision
200 docs 28.86
50%
500 docs 14.39
1000 docs 7.82 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
48.77 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 126 to 138)
queries 1
UniNEgen2
Topic 126 47.29 Topic 139 34.15
Difference (average precision)
Topic 127 49.81 Topic 140 49.42 0.5
Topic 128 76.96 Topic 141 77.96
Topic 129 0.55 Topic 142 62.05
Topic 130 66.75 Topic 143 39.86 0
Topic 131 76.00 Topic 144 52.24
Topic 132 93.12 Topic 145 63.20
−0.5
Topic 133 0.36 Topic 146 92.71
Topic 134 48.95 Topic 147 64.74
Topic 135 21.28 Topic 148 13.96 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 48.89 Topic 149 5.13 Topic Number
Topic 137 73.92 Topic 150 69.45
Topic 138 32.01
CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 139 to 150)
1
UniNEgen2
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.394
unine UniNEgen3 DS-Monolingual-EN
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Monolingual English
Retrieved 25,000 RunType= automatic
Relevant 2,105 QueryType= TD
Relevant retrieved 1,892 Pooled= true
CLEF 2005 DS−Monolingual−EN − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 87.21 UniNEgen3
90%
10 71.63
20 61.47 80%
30 56.65
70%
40 52.04
50 45.90
Average Precision
60%
60 40.75
50%
70 33.39
80 26.27 40%
90 18.08
30%
100 4.53
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
44.19
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Monolingual−EN − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 72.00 UniNEgen3
90%
10 docs 63.60
15 docs 61.33 80%
20 docs 59.20
70%
30 docs 55.73
100 docs 38.84 60%
R−Precision
200 docs 26.24
50%
500 docs 13.34
1000 docs 7.57 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
43.61 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 126 to 138)
queries 1
UniNEgen3
Topic 126 44.85 Topic 139 19.14
Difference (average precision)
Topic 127 41.64 Topic 140 44.95 0.5
Topic 128 63.64 Topic 141 79.91
Topic 129 0.32 Topic 142 53.97
Topic 130 46.54 Topic 143 38.09 0
Topic 131 64.81 Topic 144 48.60
Topic 132 89.44 Topic 145 48.21
−0.5
Topic 133 4.08 Topic 146 89.94
Topic 134 32.31 Topic 147 60.35
Topic 135 11.25 Topic 148 14.74 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 40.29 Topic 149 6.05 Topic Number
Topic 137 70.83 Topic 150 59.62
Topic 138 31.26
CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 139 to 150)
1
UniNEgen3
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.395
berkeley BERK1MLRU01 DS-Monolingual-RU
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Monolingual Russian
Retrieved 23,450 RunType= automatic
Relevant 831 QueryType= TD
Relevant retrieved 702 Pooled= true
CLEF 2005 DS−Monolingual−RU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 57.64 BERK1MLRU01
90%
10 47.18
20 35.28 80%
30 31.54
70%
40 28.07
50 24.37
Average Precision
60%
60 19.35
50%
70 15.41
80 12.40 40%
90 7.24
30%
100 4.54
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
24.09
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Monolingual−RU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 35.20 BERK1MLRU01
90%
10 docs 33.60
15 docs 30.13 80%
20 docs 27.60
70%
30 docs 23.60
100 docs 15.32 60%
R−Precision
200 docs 10.88
50%
500 docs 5.34
1000 docs 2.81 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
24.71 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Monolingual−RU − Comparison to median by topic (topics 126 to 138)
queries 1
BERK1MLRU01
Topic 126 37.19 Topic 139 43.40
Difference (average precision)
Topic 127 79.28 Topic 140 2.95 0.5
Topic 128 24.42 Topic 141 5.39
Topic 129 4.65 Topic 142 17.06
Topic 130 12.27 Topic 143 100.00 0
Topic 131 3.12 Topic 144 0.87
Topic 132 12.50 Topic 145 62.82
−0.5
Topic 133 17.91 Topic 146 3.03
Topic 134 8.25 Topic 147 0.00
Topic 135 38.78 Topic 148 18.92 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 34.87 Topic 149 1.68 Topic Number
Topic 137 20.22 Topic 150 0.00
Topic 138 52.69
CLEF 2005 DS−Monolingual−RU − Comparison to median by topic (topics 139 to 150)
1
BERK1MLRU01
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.396
berkeley-2 BK2GMLRU1 DS-Monolingual-RU
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Monolingual Russian
Retrieved 25,000 RunType= automatic
Relevant 831 QueryType= TD
Relevant retrieved 726 Pooled= true
CLEF 2005 DS−Monolingual−RU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 67.76 BK2GMLRU1
90%
10 54.84
20 44.44 80%
30 35.30
70%
40 30.59
50 27.70
Average Precision
60%
60 24.91
50%
70 23.54
80 20.50 40%
90 16.20
30%
100 9.08
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
30.38
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Monolingual−RU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 37.60 BK2GMLRU1
90%
10 docs 34.00
15 docs 30.13 80%
20 docs 28.60
70%
30 docs 24.80
100 docs 16.80 60%
R−Precision
200 docs 11.34
50%
500 docs 5.51
1000 docs 2.90 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
29.42 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Monolingual−RU − Comparison to median by topic (topics 126 to 138)
queries 1
BK2GMLRU1
Topic 126 54.37 Topic 139 39.66
Difference (average precision)
Topic 127 90.36 Topic 140 2.92 0.5
Topic 128 27.83 Topic 141 5.39
Topic 129 5.96 Topic 142 37.31
Topic 130 8.01 Topic 143 100.00 0
Topic 131 100.00 Topic 144 0.56
Topic 132 12.50 Topic 145 53.35
−0.5
Topic 133 17.16 Topic 146 0.40
Topic 134 10.24 Topic 147 0.00
Topic 135 14.19 Topic 148 24.05 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 58.50 Topic 149 20.66 Topic Number
Topic 137 28.70 Topic 150 0.00
Topic 138 47.27
CLEF 2005 DS−Monolingual−RU − Comparison to median by topic (topics 139 to 150)
1
BK2GMLRU1
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.397
berkeley-2 BK2GMLRU2 DS-Monolingual-RU
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Monolingual Russian
Retrieved 25,000 RunType= automatic
Relevant 831 QueryType= TDN
Relevant retrieved 730 Pooled= true
CLEF 2005 DS−Monolingual−RU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 58.11 BK2GMLRU2
90%
10 45.66
20 33.90 80%
30 30.06
70%
40 27.67
50 24.30
Average Precision
60%
60 18.37
50%
70 15.50
80 12.19 40%
90 8.42
30%
100 2.67
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
23.49
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Monolingual−RU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 35.20 BK2GMLRU2
90%
10 docs 30.80
15 docs 27.73 80%
20 docs 26.00
70%
30 docs 23.87
100 docs 15.08 60%
R−Precision
200 docs 10.66
50%
500 docs 5.30
1000 docs 2.92 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
24.41 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Monolingual−RU − Comparison to median by topic (topics 126 to 138)
queries 1
BK2GMLRU2
Topic 126 20.83 Topic 139 42.23
Difference (average precision)
Topic 127 87.89 Topic 140 3.42 0.5
Topic 128 19.73 Topic 141 28.47
Topic 129 0.95 Topic 142 24.39
Topic 130 2.60 Topic 143 45.00 0
Topic 131 50.89 Topic 144 0.91
Topic 132 3.12 Topic 145 20.58
−0.5
Topic 133 11.52 Topic 146 0.91
Topic 134 9.59 Topic 147 12.50
Topic 135 53.40 Topic 148 35.87 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 43.24 Topic 149 17.34 Topic Number
Topic 137 18.55 Topic 150 0.00
Topic 138 33.37
CLEF 2005 DS−Monolingual−RU − Comparison to median by topic (topics 139 to 150)
1
BK2GMLRU2
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.398
msu-nivc cirRSSCru2ru DS-Monolingual-RU
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Monolingual Russian
Retrieved 8,688 RunType= automatic
Relevant 831 QueryType= TDN
Relevant retrieved 98 Pooled= true
CLEF 2005 DS−Monolingual−RU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 23.05 cirRSSCru2ru
90%
10 8.50
20 0.60 80%
30 0.60
70%
40 0.17
50 0.17
Average Precision
60%
60 0.00
50%
70 0.00
80 0.00 40%
90 0.00
30%
100 0.00
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
2.09
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Monolingual−RU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 14.40 cirRSSCru2ru
90%
10 docs 13.60
15 docs 12.53 80%
20 docs 11.00
70%
30 docs 9.87
100 docs 3.44 60%
R−Precision
200 docs 1.78
50%
500 docs 0.74
1000 docs 0.39 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
3.74 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Monolingual−RU − Comparison to median by topic (topics 126 to 138)
queries 1
cirRSSCru2ru
Topic 126 0.75 Topic 139 7.42
Difference (average precision)
Topic 127 10.38 Topic 140 0.72 0.5
Topic 128 0.59 Topic 141 0.00
Topic 129 0.00 Topic 142 6.80
Topic 130 3.70 Topic 143 0.00 0
Topic 131 0.00 Topic 144 1.94
Topic 132 0.00 Topic 145 12.02
−0.5
Topic 133 0.00 Topic 146 0.00
Topic 134 0.67 Topic 147 0.00
Topic 135 0.01 Topic 148 0.00 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 4.84 Topic 149 0.00 Topic Number
Topic 137 0.00 Topic 150 0.00
Topic 138 2.41
CLEF 2005 DS−Monolingual−RU − Comparison to median by topic (topics 139 to 150)
1
cirRSSCru2ru
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.399
u.glasgow glarutdqe DS-Monolingual-RU
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Monolingual Russian
Retrieved 25,000 RunType= automatic
Relevant 831 QueryType= TD
Relevant retrieved 368 Pooled= true
CLEF 2005 DS−Monolingual−RU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 16.54 glarutdqe
90%
10 13.53
20 10.00 80%
30 8.91
70%
40 7.87
50 6.36
Average Precision
60%
60 3.11
50%
70 1.87
80 0.00 40%
90 0.00
30%
100 0.00
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
5.53
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Monolingual−RU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 9.60 glarutdqe
90%
10 docs 9.20
15 docs 8.00 80%
20 docs 8.00
70%
30 docs 7.73
100 docs 7.04 60%
R−Precision
200 docs 4.68
50%
500 docs 2.50
1000 docs 1.47 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
6.89 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Monolingual−RU − Comparison to median by topic (topics 126 to 138)
queries 1
glarutdqe
Topic 126 2.63 Topic 139 2.54
Difference (average precision)
Topic 127 64.23 Topic 140 5.03 0.5
Topic 128 20.44 Topic 141 3.74
Topic 129 0.31 Topic 142 10.76
Topic 130 0.01 Topic 143 8.33 0
Topic 131 0.10 Topic 144 0.43
Topic 132 0.89 Topic 145 0.87
−0.5
Topic 133 0.16 Topic 146 0.00
Topic 134 0.18 Topic 147 0.00
Topic 135 12.92 Topic 148 0.45 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 0.50 Topic 149 0.77 Topic Number
Topic 137 0.43 Topic 150 0.00
Topic 138 2.60
CLEF 2005 DS−Monolingual−RU − Comparison to median by topic (topics 139 to 150)
1
glarutdqe
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.400
unine UniNEgru1 DS-Monolingual-RU
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Monolingual Russian
Retrieved 25,000 RunType= automatic
Relevant 831 QueryType= TD
Relevant retrieved 737 Pooled= true
CLEF 2005 DS−Monolingual−RU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 44.77 UniNEgru1
90%
10 41.90
20 38.77 80%
30 34.83
70%
40 30.85
50 28.26
Average Precision
60%
60 22.43
50%
70 17.73
80 13.24 40%
90 5.60
30%
100 0.71
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
24.91
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Monolingual−RU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 36.80 UniNEgru1
90%
10 docs 33.20
15 docs 33.87 80%
20 docs 31.80
70%
30 docs 30.53
100 docs 19.08 60%
R−Precision
200 docs 11.26
50%
500 docs 5.72
1000 docs 2.95 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
23.29 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Monolingual−RU − Comparison to median by topic (topics 126 to 138)
queries 1
UniNEgru1
Topic 126 19.24 Topic 139 61.60
Difference (average precision)
Topic 127 84.33 Topic 140 4.22 0.5
Topic 128 67.74 Topic 141 2.66
Topic 129 3.07 Topic 142 76.26
Topic 130 0.20 Topic 143 7.20 0
Topic 131 0.00 Topic 144 1.65
Topic 132 2.27 Topic 145 63.02
−0.5
Topic 133 1.01 Topic 146 4.35
Topic 134 38.25 Topic 147 0.00
Topic 135 15.08 Topic 148 37.87 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 65.76 Topic 149 1.01 Topic Number
Topic 137 14.02 Topic 150 0.00
Topic 138 52.03
CLEF 2005 DS−Monolingual−RU − Comparison to median by topic (topics 139 to 150)
1
UniNEgru1
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.401
unine UniNEgru2 DS-Monolingual-RU
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Monolingual Russian
Retrieved 25,000 RunType= automatic
Relevant 831 QueryType= TD
Relevant retrieved 703 Pooled= true
CLEF 2005 DS−Monolingual−RU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 59.15 UniNEgru2
90%
10 50.56
20 41.29 80%
30 36.29
70%
40 31.79
50 27.28
Average Precision
60%
60 23.74
50%
70 19.36
80 14.82 40%
90 8.15
30%
100 4.54
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
27.74
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Monolingual−RU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 40.80 UniNEgru2
90%
10 docs 36.40
15 docs 34.13 80%
20 docs 31.80
70%
30 docs 28.40
100 docs 19.48 60%
R−Precision
200 docs 11.60
50%
500 docs 5.39
1000 docs 2.81 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
28.32 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Monolingual−RU − Comparison to median by topic (topics 126 to 138)
queries 1
UniNEgru2
Topic 126 41.73 Topic 139 58.44
Difference (average precision)
Topic 127 81.57 Topic 140 4.66 0.5
Topic 128 52.86 Topic 141 5.33
Topic 129 4.96 Topic 142 43.43
Topic 130 0.26 Topic 143 100.00 0
Topic 131 0.00 Topic 144 4.02
Topic 132 6.25 Topic 145 65.53
−0.5
Topic 133 11.11 Topic 146 3.23
Topic 134 15.80 Topic 147 0.10
Topic 135 27.68 Topic 148 25.79 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 69.05 Topic 149 1.14 Topic Number
Topic 137 17.38 Topic 150 0.00
Topic 138 53.13
CLEF 2005 DS−Monolingual−RU − Comparison to median by topic (topics 139 to 150)
1
UniNEgru2
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.402
unine UniNEgru3 DS-Monolingual-RU
Overall statistics for 25 queries : General info:
Total number of documents over all queries Track= Domain Specific Monolingual Russian
Retrieved 25,000 RunType= automatic
Relevant 831 QueryType= TD
Relevant retrieved 739 Pooled= true
CLEF 2005 DS−Monolingual−RU − Interpolated Recall vs Average Precision
Interploated Recall (%) Precision Averages (%) 100%
0 43.63 UniNEgru3
90%
10 41.48
20 37.22 80%
30 33.93
70%
40 30.59
50 27.55
Average Precision
60%
60 22.66
50%
70 18.64
80 13.12 40%
90 6.36
30%
100 0.64
Average precision (non-interpolated) for all 20%
relevant documents (averaged over queries)
10%
24.77
0%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 DS−Monolingual−RU − Retrieved documents vs Precision
Docs Cutoff Levels Precision at DCL (%) 100%
5 docs 36.80 UniNEgru3
90%
10 docs 32.80
15 docs 31.73 80%
20 docs 30.60
70%
30 docs 30.00
100 docs 19.20 60%
R−Precision
200 docs 11.18
50%
500 docs 5.61
1000 docs 2.96 40%
R-Precision (precision after R document retrieved,
where R = Relevant retrieved) 30%
22.99 20%
10%
0%
5 10 15 20 30 100 200 500 1000
Retrieved Documents (logarithmic scale)
Precision averages (%) for individual CLEF 2005 DS−Monolingual−RU − Comparison to median by topic (topics 126 to 138)
queries 1
UniNEgru3
Topic 126 14.95 Topic 139 61.39
Difference (average precision)
Topic 127 86.68 Topic 140 3.94 0.5
Topic 128 70.85 Topic 141 1.35
Topic 129 2.51 Topic 142 76.98
Topic 130 0.21 Topic 143 5.99 0
Topic 131 0.00 Topic 144 0.75
Topic 132 1.47 Topic 145 63.57
−0.5
Topic 133 0.70 Topic 146 3.45
Topic 134 39.17 Topic 147 0.25
Topic 135 10.60 Topic 148 39.39 −1
126 127 128 129 130 131 132 133 134 135 136 137 138
Topic 136 65.10 Topic 149 1.07 Topic Number
Topic 137 22.16 Topic 150 0.00
Topic 138 46.76
CLEF 2005 DS−Monolingual−RU − Comparison to median by topic (topics 139 to 150)
1
UniNEgru3
Difference (average precision)
0.5
0
−0.5
−1
139 140 141 142 143 144 145 146 147 148 149 150
Topic Number
A.403